Cloud Infrastructure, Generative AI, AWS, Azure, GCPIf cloud platforms were people (thoughts from a Generative AI)Can you relate to these? As of writing this blog post, I have been really enjoying the new releases in Google’s Gemini AI for both images…
Cloud Infrastructure, Data Engineering, Python, DuckDBQuackpipe, running DuckDB local and on AWS GlueQuackpipe Stop waiting for AWS Glue jobs while in development by using a local-first workflow with DuckDB and deploy with Terraform. Your…
Cloud Infrastructure, Data Engineering, Python, SalesforceQuery Salesforce with PythonQuery SalesForce objects with Python Ever found yourself exporting data from Salesforce using the Web UI over and over again. Ever wished…
Cloud Infrastructure, Data Engineering, GCP, Machine Learning, Python, Software EngineeringMaking Machine Learning predictions from BigQuery DataformNFL Touchdown Prediction with Dataform and BigQuery ML This blog post demonstrates how to build an end-to-end ML pipeline using Google Cloud…
Cloud Infrastructure, Data Engineering, GCP, Machine Learning, Python, Software EngineeringThe Tale of Two Routes: A Love Story Between BigQuery and Vertex AI for Machine Learning predictionsThis blog post is the first, and probably last where I thought I would see what the Github Copilot VSCode extension could do with writing a…
Cloud Infrastructure, MLOps, Machine Learning, PythonGCP Serverless prediction service using Cloud Run from a Vertex AI modelDeploying ML Models on Cloud Run: From Placeholder to Production This guide walks through deploying a machine learning model on Google Cloud…
Cloud Infrastructure, Data Engineering, DevOpsChecking the public IP address of a GCP Cloud FunctionPublic IP address of a GCP Cloud Function When you deploy a Cloud Function without configuring a VPC, it operates within Google’s internal…
Cloud Infrastructure, Data EngineeringDebugging Dataform with Node.js in VScodeDebugging Dataform with Node.js in VScode Debugging Dataform JavaScript If you happen to be a data engineer who is not familiar with the…
Cloud Infrastructure, Data EngineeringGCP Cloud Functions for Web Scraping AFL dataScraping web data using GCP Cloud Functions The main reason for this blog post is a practical example of writing a GCP Cloud Function with…
Web Development, Cloud Infrastructure, System AdministrationFlask application with Postgres containerized across multiple cloudsFlask app with a Postgres database containerized across multiple clouds Background We are building out an application that has a decoupled…
Cloud Infrastructure, Data Science, System AdministrationDatabricks security model architectureOverview Let’s say we have a brand new Databricks resource that we have just created from Azure. It comes as an empty shell ready for use…
Cloud Infrastructure, Data Science, System AdministrationDatabricks and Azure DevOps CICD Pipeline for DBFSDevOps CICD Pipeline for Databricks This is in reference to this Git repo https://dev.azure.com/mortimer-xyz/mortie23/_git/dbfs-cicd-pieline…
Cloud Infrastructure, Data ScienceModel scoring API as a Docker containerUse Docker to host a Python FastAPI service In my preview blog post (Model scoring API) I went through the technical basics of a model…
System Administration, Cloud Infrastructure, Data EngineeringInstalling Prefect Server on AzureReading Firstly I came across the following docs on how to install prefect server Prefect Server 101 Deploying to GCP Deploying to a Single…
Cloud Infrastructure, Data Science, System Administration, RRStudio with SSL proxyWhat are we doing We have a server hosting RStudio, and we want encrypt the traffic too and from the RStudio service. We also do not want to…
Cloud Infrastructure, Web DevelopmentSetting up a cloud webserver for hosting a static siteWhy would I want to do this? Since there are many easier (options) for hosting a static website (of which I recommend and also use Github…
