Recent posts tagged databricks

Level UI • 21 hours • in Articles • 9 min read
Somewhere in the last year, "do we need an MCP server?" joined the list of questions that arrive in a brief before anyone has said what the thing is for. It is usually framed as MCP vs API, as though the Model Context Protocol were a newer kind of AP...
post-cover-33074
  • ai
  • api
  • webdev
  • security
firatcelik • 5 days • in Articles • 9 min read
Originally published on DEV.to: https://dev.to/firfircelik/auto-cdf-moved-the-cdc-tax-from-writes-to-reads-delta-cdf-vs-auto-cdf-vs-spark-42-changes-9bb On September 1, 2026, Databricks made automatic change data feed Auto CDF generally available. T...
post-cover-32478
  • data-engineering
  • databricks
  • apache-spark
  • delta-lake
firatcelik • Oct 9 • in Articles • 8 min read
Originally published on DEV.tohttps://dev.to/firfircelik/two-pyspark-contracts-staff-des-learn-on-a-bad-tuesday-foreachbatch-restarts-and-applyinpandas-skew-39pa. Your streaming MERGE looked fine in the notebook. Your applyInPandas transform looked...
post-cover-30476
  • databricks
  • pyspark
  • python
  • data-engineering
firatcelik • Oct 9 • in Articles • 10 min read
Originally published on DEV.tohttps://dev.to/firfircelik/azure-synapse-databricks-a-migration-playbook-that-survives-production-nge. Azure Synapse → Databricks: A Migration Playbook That Survives Production A field-style guide for Lead / Senior Dat...
post-cover-30474
  • databricks
  • azure
  • data-engineering
  • etl
Posted in Data Engineering group
Dr. Usman Zafar • Feb 6 • in Articles • 1 min read
ETL vs ELT — Why Notebook Placement Matters Body / Content: The placement of your Databricks notebooks determines whether your pipeline behaves like ETL or ELT. If Databricks runs after loading data into the lake, it’s ELT. If Databricks runs be...
post-cover-11185
  • etl
  • databricks
  • bigdata
  • mdm
Dr. Usman Zafar • Feb 2 • in Articles • 1 min read
New Project: Cost & Performance Comparison of Data Orchestration on Azure I recently completed an experimental study comparing runtime and cost efficiency across three common data engineering orchestration approaches on Azure: • Databricks Notebook...
post-cover-10949
  • dataengineering
  • databricks
  • azuredatafactory
  • spark
Tom Smithverified • 17 hours • in Articles • 9 min read
Security dominated this week, but not in the usual way. Two active campaigns turned GitHub configuration files into attack surfaces. Researchers demonstrated that the built-in browsers inside AI coding tools can read your SSH keys. And at Oracle AI ...
post-cover-33104
  • agenticai
  • devsecops
  • github
  • localai
To see more, click for the full list of posts or popular tags.
chevron_left
🔥 5 posts • 👩‍💻 2 active writers

✨ Want to write in this topic?
Share your learning. Get discovered. Build your profile.
Join CoderLegion

💡 Why developers use CoderLegion
Track learning • Share posts • Get ranked publicly
Create your profile