<?xml version="1.0" encoding="utf-8"?>
<rss version="2.0">
<channel>
<title>Coder Legion - Recent posts tagged apacheairflow</title>
<link>https://coderlegion.com/tag/apacheairflow</link>
<description>Powered by Question2Answer</description>
<item>
<title>Running Apache Airflow + Docker for Free Using GitHub Codespaces</title>
<link>https://coderlegion.com/21185/running-apache-airflow-docker-for-free-using-github-codespaces</link>
<description>&lt;p&gt;While building my ETL pipeline project, I ran into a common beginner problem:&lt;/p&gt;
&lt;p&gt;Running Apache Airflow locally on Windows with Docker was painful.&lt;/p&gt;
&lt;p&gt;Problems included:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Low disk space&lt;/li&gt;
&lt;li&gt;Docker setup issues&lt;/li&gt;
&lt;li&gt;Linux compatibility problems&lt;/li&gt;
&lt;li&gt;Environment debugging overhead&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;With only ~17GB free on my laptop, running multiple Airflow containers locally became difficult.&lt;/p&gt;
&lt;p&gt;So I moved the entire setup to GitHub Codespaces.&lt;/p&gt;
&lt;h3 id=&quot;what-codespaces-provided&quot;&gt;What Codespaces Provided&lt;/h3&gt;
&lt;p&gt;Out of the box:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Ubuntu Linux environment&lt;/li&gt;
&lt;li&gt;Docker pre-installed&lt;/li&gt;
&lt;li&gt;VS Code in browser&lt;/li&gt;
&lt;li&gt;Auto-cloned GitHub repo&lt;/li&gt;
&lt;li&gt;Port forwarding for Airflow UI&lt;/li&gt;
&lt;/ul&gt;
&lt;h3 id=&quot;workflow&quot;&gt;Workflow&lt;/h3&gt;
&lt;pre&gt;&lt;code class=&quot;language-bash&quot;&gt;docker-compose up
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;Then:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Open Airflow UI&lt;/li&gt;
&lt;li&gt;Trigger ETL DAG&lt;/li&gt;
&lt;li&gt;Verify successful execution ✔️&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;Airflow was running in ~90 seconds.&lt;/p&gt;
&lt;h3 id=&quot;important-security-lesson&quot;&gt;Important Security Lesson&lt;/h3&gt;
&lt;p&gt;I accidentally committed my GCP service account key once.&lt;/p&gt;
&lt;p&gt;GitHub Secret Scanning blocked the push automatically.&lt;/p&gt;
&lt;p&gt;Immediately added:&lt;/p&gt;
&lt;pre&gt;&lt;code class=&quot;language-gitignore&quot;&gt;*.json
.env
&lt;/code&gt;&lt;/pre&gt;
&lt;p&gt;Never commit cloud credentials.&lt;/p&gt;
&lt;h3 id=&quot;why-this-setup-helps-beginners&quot;&gt;Why This Setup Helps Beginners&lt;/h3&gt;
&lt;p&gt;Codespaces removes a huge amount of local environment friction and lets you focus more on:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Airflow orchestration&lt;/li&gt;
&lt;li&gt;ETL pipelines&lt;/li&gt;
&lt;li&gt;Docker workflows&lt;/li&gt;
&lt;li&gt;Cloud integrations&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;If you'd like:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Beginner-friendly walkthrough → check Medium&lt;/li&gt;
&lt;li&gt;Engineering-focused breakdown → check Hashnode&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;Medium: &lt;a rel=&quot;nofollow&quot; href=&quot;https://medium.com/p/8832297e4d85/&quot;&gt;Link&lt;/a&gt;&lt;br&gt;
Hashnode: &lt;a rel=&quot;nofollow&quot; href=&quot;https://engineeringfriction.hashnode.dev/how-github-codespaces-helped-me-run-airflow-docker-free?utm_source=hashnode&amp;amp;utm_medium=feed&quot;&gt;Link&lt;/a&gt;&lt;/p&gt;
&lt;p&gt;Project Repo:&lt;a rel=&quot;nofollow&quot; href=&quot;https://github.com/tanmaybhurkunde/ETL-Pipeline&quot;&gt;ETL Pipeline&lt;/a&gt;&lt;/p&gt;
&lt;h2 id=&quot;dataengineering-docker-apacheairflow-githubcodespaces&quot;&gt;DataEngineering #Docker #ApacheAirflow #GitHubCodespaces&lt;/h2&gt;
</description>
<category>Articles</category>
<guid isPermaLink="true">https://coderlegion.com/21185/running-apache-airflow-docker-for-free-using-github-codespaces</guid>
<pubDate>Tue, 23 Jun 2026 07:22:54 +0000</pubDate>
</item>
</channel>
</rss>