Data Science

A collection of 13 posts

A way to build CRUD apps with R Shiny and SQLite cover image
R,  Data Science,  Web Development

A way to build CRUD apps with R Shiny and SQLite

Background Often as software engineers working within organisations we are coerced into using a software stack that we may not have chosen…

Python mono repo for Data Science with Poetry cover image
Software Development,  Data Science,  Python

Python mono repo for Data Science with Poetry

Mono repo with Python Poetry What we are looking to do is create a code repository that can be used as the source for many Python…

Install Posit Connect on Ubuntu cover image
System Administration,  Data Science,  R

Install Posit Connect on Ubuntu

Overview We want to test out the installation and management of Posit Connect (previously RStudio Connect). Prerequisites A machine running…

Databricks security model architecture cover image
Cloud Infrastructure,  Data Science,  System Administration

Databricks security model architecture

Overview Let’s say we have a brand new Databricks resource that we have just created from Azure. It comes as an empty shell ready for use…

Databricks and Azure DevOps CICD Pipeline for DBFS cover image
Cloud Infrastructure,  Data Science,  System Administration

Databricks and Azure DevOps CICD Pipeline for DBFS

DevOps CICD Pipeline for Databricks This is in reference to this Git repo https://dev.azure.com/mortimer-xyz/mortie23/_git/dbfs-cicd-pieline…

Databricks using Azure ML model registry cover image
Data Science

Databricks using Azure ML model registry

Registering a model in AzureML from Databricks What if we want to use AzureML as a central model repository for all models across many…

Model scoring API as a Docker container cover image
Cloud Infrastructure,  Data Science

Model scoring API as a Docker container

Use Docker to host a Python FastAPI service In my preview blog post (Model scoring API) I went through the technical basics of a model…

Databricks sample NFL MLFlow cover image
Data Science

Databricks sample NFL MLFlow

Fit a decision tree model for predicting win or loss The code this post is relating to is here: https://github.com/mortie23/databricks-nfl…

Databricks sample NFL dataset cover image
Data Engineering,  Data Science

Databricks sample NFL dataset

Create a Databricks database with sample NFL data The code this post is relating to is here: https://github.com/mortie23/databricks-nfl-data…

Model scoring API examples cover image
Data Science,  Web Development

Model scoring API examples

A basic example of a predictive model scoring API The associate Github repo for this blog post is https://github.com/mortie23/fastapi-linear…

Integrating Azure Cognitive with Retool cover image
Data Science,  Web Development

Integrating Azure Cognitive with Retool

What is Retool Retool is a simple tool for creating a web application. One of the things that makes Retool great is you’re never limited by…

RStudio with SSL proxy cover image
Cloud Infrastructure,  Data Science,  System Administration,  R

RStudio with SSL proxy

What are we doing We have a server hosting RStudio, and we want encrypt the traffic too and from the RStudio service. We also do not want to…

Agent Based Modelling cover image
Data Science

Agent Based Modelling

I was experimenting with Agent based models and came across a really great talk Jackie Kazil | Agent based modelling in Python. This lead me…