Recent posts tagged batchprocessing

Week 6 of Data Engineering Zoomcamp by @DataTalksClub complete Just finished Module 6 - Batch Processing with Spark. Learned how to: ✅ Set up PySpark and create Spark sessions ✅ Read and process Parquet files at scale ✅ Repartition data for opti...