Cloud Infrastructure, Generative AI, AWS, Azure, GCPIf cloud platforms were people (thoughts from a Generative AI)Can you relate to these? As of writing this blog post, I have been really enjoying the new releases in Google’s Gemini AI for both images…
Cloud Infrastructure, Data Engineering, GCP, Machine Learning, Python, Software EngineeringMaking Machine Learning predictions from BigQuery DataformNFL Touchdown Prediction with Dataform and BigQuery ML This blog post demonstrates how to build an end-to-end ML pipeline using Google Cloud…
Cloud Infrastructure, Data Engineering, GCP, Machine Learning, Python, Software EngineeringThe Tale of Two Routes: A Love Story Between BigQuery and Vertex AI for Machine Learning predictionsThis blog post is the first, and probably last where I thought I would see what the Github Copilot VSCode extension could do with writing a…
Dataflow, Data Engineering, GCP, BigQueryConverting table schemas from any database to BigQuery for DataflowWhy do this? When using Dataflow Google-provided templates for any RDBMS to BigQuery (such as PostgreSQL to BigQuery) the target table in…
Dataflow, Data Engineering, GCP, KMSKMS encrypted credentials with Dataflow on GCPEncrypting credentials Google KMS Cloud Key Management Service (Cloud KMS) lets you create and manage encryption keys for use in compatible…
Apache Beam, Data Engineering, GCP, BigQuery, DockerPython Beam and DataFlow to write data to BigQuery with a custom Docker imageDataflow build and run Basic example of how to develop an Apache Beam pipeline written in Python that writes data to BigQuery. To then build…
Teradata, Data Engineering, GCP, BigQueryCopying a table from Teradata to Google BigQueryCopying a table from Teradata to Google BigQuery For this demo I will be using a Windows PC including: Teradata Studio Teradata ClearScape…
