Recent posts tagged gcp

Context Every time a new client was onboarded, their web application had to be deployed and exposed to the internet. As part of the deployment, the infrastructure required several configuration steps across different services before the applicatio...

A media company moves its analytics platform to Google Cloud. The migration goes well, and the team adopts many managed services along the way: BigQuery for analytics, Dataflow for pipelines, Pub/Sub for messaging, and Cloud Functions for automation....

How I combined Apache Flink, Redpanda, Airflow, dbt Cloud, and Grafana to track Bitcoin, Ethereum, Solana, BNB, and Cardano in real time — all running on Google Cloud for less than a cup of coffee per month. If you've been learning data engineering...

Introduction Global sovereign debt is one of the most consequential datasets in existence. It shapes foreign policy, determines credit ratings, drives IMF bailout decisions, and affects the daily lives of billions of people in developing countries....

Just completed my DEZ Zoomcamp 2026 capstone project — the Tech Ecosystem Observatory Built a full cloud-native batch data pipeline from scratch that answers: which industries are shedding the most jobs, and how does that correlate with YC startup a...

Week 4 of Data Engineering Zoomcamp by @DataTalksClub complete Just finished Module 4 - Analytics Engineering with dbt. Learned how to: ✅ Build transformation models with dbt ✅ Create staging, intermediate, and fact tables ✅ Write tests to ensure d...

Just completed Module 2 of the Data Engineering Zoomcamp 2026. Built production-ready data pipelines using Kestra to process 26 million NYC taxi trip records. What I accomplished: Orchestrated ETL workflows with Kestra Ingested data from GitHub to G...

In the early days of IT, we manually configured servers–each one a precious snowflake, lovingly maintained and documented. But the size of the infrastructure grew and this approach couldn't scale. Chef and Puppet popularized the idea of Infrastructur...

!1 1: https://scontent.fblr1-4.fna.fbcdn.net/o1/v/t0/f2/m340/AQMjIquaKdKQLGI1jzLoE6Cb-lTe-jdKXGIvFE38ew1uGSO54T9rpRUFbvx9a-u9UX3PX7KMv6IcmMCFn3YrAhjBIGwwgCHoM7FEq8GcwgbWjP7mugbsbfrZxXNfDhNU1hHFuxxp3Hf0oDMWOGvZLvVB0zbjQ.jpeg?stp=s1440x1440&ncht=sc...