Christopher Mortimer

Christopher Mortimer

Specialising in data

Canberra, Australia
41 posts
WebsiteTwitter
Debugging Dataform with Node.js in VScode cover image
Cloud Infrastructure,  Data Engineering

Debugging Dataform with Node.js in VScode

Debugging Dataform with Node.js in VScode Debugging Dataform JavaScript If you happen to be a data engineer who is not familiar with the…

GCP Cloud Functions for Web Scraping AFL data cover image
Cloud Infrastructure,  Data Engineering

GCP Cloud Functions for Web Scraping AFL data

Scraping web data using GCP Cloud Functions The main reason for this blog post is a practical example of writing a GCP Cloud Function with…

Flask application with custom package deployed to GCP Artifact Registry and Cloud Run cover image
Software Development,  Data Science,  Python

Flask application with custom package deployed to GCP Artifact Registry and Cloud Run

Flask application with custom package deployed to GCP Artifact Registry and Cloud Run What we are looking to do in this example is…

Converting table schemas from any database to BigQuery for Dataflow cover image
Dataflow,  Data Engineering,  GCP,  BigQuery

Converting table schemas from any database to BigQuery for Dataflow

Why do this? When using Dataflow Google-provided templates for any RDBMS to BigQuery (such as PostgreSQL to BigQuery) the target table in…

A way to build CRUD apps with R Shiny and SQLite cover image
R,  Data Science,  Web Development

A way to build CRUD apps with R Shiny and SQLite

Background Often as software engineers working within organisations we are coerced into using a software stack that we may not have chosen…

KMS encrypted credentials with Dataflow on GCP cover image
Dataflow,  Data Engineering,  GCP,  KMS

KMS encrypted credentials with Dataflow on GCP

Encrypting credentials Google KMS Cloud Key Management Service (Cloud KMS) lets you create and manage encryption keys for use in compatible…

Python Beam and DataFlow to write data to BigQuery with a custom Docker image cover image
Apache Beam,  Data Engineering,  GCP,  BigQuery,  Docker

Python Beam and DataFlow to write data to BigQuery with a custom Docker image

Dataflow build and run Basic example of how to develop an Apache Beam pipeline written in Python that writes data to BigQuery. To then build…

Copying a table from Teradata to Google BigQuery cover image
Teradata,  Data Engineering,  GCP,  BigQuery

Copying a table from Teradata to Google BigQuery

Copying a table from Teradata to Google BigQuery For this demo I will be using a Windows PC including: Teradata Studio Teradata ClearScape…

Connecting Nifi to Teradata cover image
Teradata,  Data Engineering

Connecting Nifi to Teradata

Connecting Nifi to Teradata For this demo I will be using a Windows PC including: Docker desktop PowerShell Core 7.3.6 VMWare Workstation…

Hip-hop collaboration network graph cover image
Analysis,  EDA,  Graph,  Python

Hip-hop collaboration network graph

Introduction As a Hip-hop fan (and other genres of music) it is obvious that certain artists are more alike than others. I was interested to…

Flask application with Postgres containerized across multiple clouds cover image
Web Development,  Cloud Infrastructure,  System Administration

Flask application with Postgres containerized across multiple clouds

Flask app with a Postgres database containerized across multiple clouds Background We are building out an application that has a decoupled…

Connecting to Teradata from Python cover image
Data Engineering,  Python

Connecting to Teradata from Python

Reading and Writing data between Python and Teradata This blog post is paired with the associated Github repository https://github.com…

Python mono repo for Data Science with Poetry cover image
Software Development,  Data Science,  Python

Python mono repo for Data Science with Poetry

Mono repo with Python Poetry What we are looking to do is create a code repository that can be used as the source for many Python…

Install Posit Connect on Ubuntu cover image
System Administration,  Data Science,  R

Install Posit Connect on Ubuntu

Overview We want to test out the installation and management of Posit Connect (previously RStudio Connect). Prerequisites A machine running…

Publish an R Package to a private repository and use cover image
System Administration,  R

Publish an R Package to a private repository and use

Overview Let’s say we want to manage an R code base as a package. The benefits might include: a good way to distribute R code for other…

Databricks security model architecture cover image
Cloud Infrastructure,  Data Science,  System Administration

Databricks security model architecture

Overview Let’s say we have a brand new Databricks resource that we have just created from Azure. It comes as an empty shell ready for use…

Databricks and Azure DevOps CICD Pipeline for DBFS cover image
Cloud Infrastructure,  Data Science,  System Administration

Databricks and Azure DevOps CICD Pipeline for DBFS

DevOps CICD Pipeline for Databricks This is in reference to this Git repo https://dev.azure.com/mortimer-xyz/mortie23/_git/dbfs-cicd-pieline…

Databricks using Azure ML model registry cover image
Data Science

Databricks using Azure ML model registry

Registering a model in AzureML from Databricks What if we want to use AzureML as a central model repository for all models across many…

Model scoring API as a Docker container cover image
Cloud Infrastructure,  Data Science

Model scoring API as a Docker container

Use Docker to host a Python FastAPI service In my preview blog post (Model scoring API) I went through the technical basics of a model…

Databricks sample NFL MLFlow cover image
Data Science

Databricks sample NFL MLFlow

Fit a decision tree model for predicting win or loss The code this post is relating to is here: https://github.com/mortie23/databricks-nfl…

Databricks sample NFL dataset cover image
Data Engineering,  Data Science

Databricks sample NFL dataset

Create a Databricks database with sample NFL data The code this post is relating to is here: https://github.com/mortie23/databricks-nfl-data…

Model scoring API examples cover image
Data Science,  Web Development

Model scoring API examples

A basic example of a predictive model scoring API The associate Github repo for this blog post is https://github.com/mortie23/fastapi-linear…

Power BI PBIX Git version control cover image
Business Intelligence,  Software Development

Power BI PBIX Git version control

How to commit a Power BI PBIX to Git This is in reference to the associated https://github.com/mortie23/pbix-git-version-control What is the…

Git post-receive hook for deployment of a static site cover image
CI/CD,  Web Development,  System Administration

Git post-receive hook for deployment of a static site

Using a post receive hook for website deployment Other deployment methods Firstly, let’s mention that there are other potentially easier…

Raspberry Pi time lapse server cover image
Software Development

Raspberry Pi time lapse server

Building a time lapse server with a Raspberry Pi and a webcam I had a Raspberry Pi lying around that I use to use as a media server, and an…

Dynamic Images in Power BI Dashboards cover image
Business Intelligence

Dynamic Images in Power BI Dashboards

Dynamic images in Power BI Getting images to be dynamic, such as changing in reaction to an change in the selected value of a slicer seems…

Integrating Azure Cognitive with Retool cover image
Data Science,  Web Development

Integrating Azure Cognitive with Retool

What is Retool Retool is a simple tool for creating a web application. One of the things that makes Retool great is you’re never limited by…

Installing Prefect Server on Azure cover image
System Administration,  Cloud Infrastructure,  Data Engineering

Installing Prefect Server on Azure

Reading Firstly I came across the following docs on how to install prefect server Prefect Server 101 Deploying to GCP Deploying to a Single…

Secret Santa with Node.js and Gmail cover image
Software Development

Secret Santa with Node.js and Gmail

What is Secret Santa an arrangement by which a group of friends or colleagues exchange Christmas presents anonymously, each member of the…

How I develop Python in VSCode cover image
Software Development,  Python

How I develop Python in VSCode

Why Working on Javascript code in Visual Studio Code (VSCode) for the best part of last year got me use to all the good stuff…

Git Cleanup cover image
Software Development

Git Cleanup

What is the issue? Collaborating on a repo and someone accedientally commits a very large file that is not very compressable. It makes the…

RStudio with SSL proxy cover image
Cloud Infrastructure,  Data Science,  System Administration,  R

RStudio with SSL proxy

What are we doing We have a server hosting RStudio, and we want encrypt the traffic too and from the RStudio service. We also do not want to…

Tableau Web Data Connector Node Generator cover image
Business Intelligence,  Web Development,  Data Engineering

Tableau Web Data Connector Node Generator

Using Tableau Web Data Connector (WDC) as the data source for dashboard. This post is in reference to the associated Github repo at https…

Agent Based Modelling cover image
Data Science

Agent Based Modelling

I was experimenting with Agent based models and came across a really great talk Jackie Kazil | Agent based modelling in Python. This lead me…

Geospatial shapes for vizualisation cover image
Business Intelligence,  Geospatial

Geospatial shapes for vizualisation

Putting analysis on a map People always seem to like seeing data visualised on a map. Something about looking at a gradient of colour on a…

Setting up a cloud webserver for hosting a static site cover image
Cloud Infrastructure,  Web Development

Setting up a cloud webserver for hosting a static site

Why would I want to do this? Since there are many easier (options) for hosting a static website (of which I recommend and also use Github…

Tableau Web Data Connector cover image
Business Intelligence,  Data Engineering

Tableau Web Data Connector

This post is in reference to the associated Github repo at https://github.com/mortie23/tableau-wdc. Tableau WDC Quick example of a Tableau…

Embedded BI cover image
Business Intelligence,  Web Development

Embedded BI

What is Embedded BI When people talk about Embedded Business Intelligence (BI) they are usually referring to putting things such as…

Speed Up My Site cover image
Web Development

Speed Up My Site

Originally I built my personal site by using a free responsive template and then I just modified the source code. The page loads were slow…

Linux Users Groups cover image
System Administration

Linux Users Groups

This post is in reference to the associated Github repo at https://github.com/mortie23/linux-users-groups. Deploy a security model (users…

Welcome to Mortimer XYZ cover image
About

Welcome to Mortimer XYZ

Welcome, it's great to have you here. Please read about the things I am interested in and what I have done.