From APIs to Warehouses: AI-Assisted Data Ingestion with dlt

Sun, 01 Mar 2026 11:45:47 +0000

dlt Workshop of Data Engineering Zoomcamp by @DataTalksClub complete

Just finished the Data Ingestion workshop with @dltHub. Learned how to:
✅ Build REST API data pipelines with dlt
✅ Use AI-assisted development with dlt MCP Server
✅ Load paginated API data into DuckDB
✅ Inspect pipeline data with dlt Dashboard and marimo notebooks

Built a full NYC taxi data pipeline from a custom API - AI-assisted data engineering is the future

Here's my homework solution: https://github.com/Derrick-Ryan-Giggs/-my-dlt-taxi-pipeline

Following along with this amazing free course - who else is learning data engineering?

You can sign up here: https://github.com/DataTalksClub/data-engineering-zoomcamp/

Client DLT

Mon, 27 Oct 2025 16:44:15 +0000

I’ve been working on an open-source MVP, a web UI for DLT that brings low/no-code and AI-assisted data pipeline management to life!
The idea is to have for DLT (dltHub) what Databricks is for Spark/PySpark, a UI/X layer focused on designing/diagraming, scheduling, managing and monitoring data pipelines.

The MPV1 is already live in the cloud for testing and validation, check it out and see some of the features in action in the videos below!

This MVP already lets you:

Design/Create pipelines through a low/no-code
Query ingested data on DuckDB with an AI Agent with a full SQL editor
Schedule pipeline
Pipelines versioning (to support safe iteration/rollback in the future)
Monitor pipeline run
App-level DuckDB lock management for safe concurrency

Built with Still.js on DLT’s (dltHub) powerful foundation, this MVP sets a solid base for a great product ahead.
I’d love to get the community insights, you can test it in the cloud or deploy it locally (see github repo readme for instructions), explore the code, open issues, and contribute new ideas, coding and new features. Let’s build this together!

Check the code: Github Repo
Videos with some features show case:

Coder Legion - Recent posts tagged dlt

From APIs to Warehouses: AI-Assisted Data Ingestion with dlt

Client DLT