These promotions will be applied to this item:
Some promotions may be combined; others are not eligible to be combined with other offers. For details, please see the Terms & Conditions associated with these promotions.
Your Memberships and Subscriptions
-
-
-
Image Unavailable
Image not available for
Colour:
Follow the authors
OK
Optimizing Databricks Workloads: Harness the power of Apache Spark in Azure and maximize the performance of modern big data workloads
Accelerate computations and make the most of your data effectively and efficiently on Databricks
Key Features
- Understand Spark optimizations for big data workloads and maximizing performance
- Build efficient big data engineering pipelines with Databricks and Delta Lake
- Efficiently manage Spark clusters for big data processing
Book Description
Databricks is an industry-leading, cloud-based platform for data analytics, data science, and data engineering supporting thousands of organizations across the world in their data journey. It is a fast, easy, and collaborative Apache Spark-based big data analytics platform for data science and data engineering in the cloud.
In Optimizing Databricks Workloads, you will get started with a brief introduction to Azure Databricks and quickly begin to understand the important optimization techniques. The book covers how to select the optimal Spark cluster configuration for running big data processing and workloads in Databricks, some very useful optimization techniques for Spark DataFrames, best practices for optimizing Delta Lake, and techniques to optimize Spark jobs through Spark core. It contains an opportunity to learn about some of the real-world scenarios where optimizing workloads in Databricks has helped organizations increase performance and save costs across various domains.
By the end of this book, you will be prepared with the necessary toolkit to speed up your Spark jobs and process your data more efficiently.
What you will learn
- Get to grips with Spark fundamentals and the Databricks platform
- Process big data using the Spark DataFrame API with Delta Lake
- Analyze data using graph processing in Databricks
- Use MLflow to manage machine learning life cycles in Databricks
- Find out how to choose the right cluster configuration for your workloads
- Explore file compaction and clustering methods to tune Delta tables
- Discover advanced optimization techniques to speed up Spark jobs
Who this book is for
This book is for data engineers, data scientists, and cloud architects who have working knowledge of Spark/Databricks and some basic understanding of data engineering principles. Readers will need to have a working knowledge of Python, and some experience of SQL in PySpark and Spark SQL is beneficial.
Table of Contents
- Discovering Databricks
- Batch and Real-Time Processing in Databricks
- Learning about Machine Learning and Graph Processing in Databricks
- Managing Spark Clusters
- Big Data Analytics
- Databricks Delta Lake
- Spark Core
- Case Studies
- LanguageEnglish
- PublisherPackt Publishing
- Publication date24 December 2021
- File size14.5 MB
Product description
About the Author
Product details
- ASIN : B09KCQY9ZS
- Publisher : Packt Publishing
- Accessibility : Learn more
- Publication date : 24 December 2021
- Edition : 1st
- Language : English
- File size : 14.5 MB
- Screen Reader : Supported
- Enhanced typesetting : Enabled
- X-Ray : Not Enabled
- Word Wise : Not Enabled
- Print length : 230 pages
- ISBN-13 : 978-1801811927
- Page Flip : Enabled
- Best Sellers Rank: #1,031,715 in Kindle Store (See Top 100 in Kindle Store)
- #1,017 in Databases & Big Data
- #1,524 in Software Architecture
- #1,546 in Computer Databases
- Customer Reviews:
About the authors

Sarthak is a certified data engineer and analyst with a wide technical breadth and a deep understanding of Databricks. His background has led him to a variety of Azure data services with an eye towards data warehousing and big data analytics. Sarthak graduated with a degree in Mechanical Engineering from Manipal University Jaipur (India) and enjoys working and solving real-world business problems with technology. He is also passionate about travel and enjoys learning about different cultures and meeting new people from different parts of the world.

Anirudh is a Though Leader in Data and AI and is also the cofounder of Celebal Technologies. During his tenure as Data Architect, he has implemented large scale data lakes and Centre of Excellence for Data and Innovation across multiple fortune 500 companies. He has mentored thousands of young Data Engineers and Data Scientists across the globe and is an active participant in the AI community in India.

I am a seasoned data solution architect and co-founder of Mandelbulb Technologies.
At Mandelbulb, I am helping enterprise customers and partners with modern data analytics.
I am an expert in IT consulting, enterprise cloud data services, driving data driven decisions, customer communications, business development, product and process design.
Before MandelBulb, I had worked as programmer, data engineer, data architect, data scientist, solution architect for fortune 500 companies.
Customer reviews
Customer reviews, including Product Star Ratings, help customers to learn more about the product and decide whether it is the right product for them.
To calculate the overall star rating and percentage breakdown by star, we do not use a simple average. Instead, our system considers things such as how recent a review is and if the reviewer bought the item on Amazon. It also analyses reviews to verify trustworthiness.
Learn more about how customer reviews work on AmazonTop reviews from India
- 5 out of 5 stars
Very helpful and good examples covering optimizing workloads in Databricks
Reviewed in India on 17 January 2022This book gave me whole new prospective in addressing few of the challenges that I was facing. The authors have put a lot of thought into making this book useful to address real world challenges and it's well done. This book also provides detailed insights about the data lake and the spark.
One person found this helpfulSending feedbackâĶSending feedback...HelpfulThank you for your feedback.Sorry, we failed to record your vote. Please try againThank you. We'll investigate in the next few days.Sorry, We failed to report this review. Please try againWe'll check if this review meets our community guidelinesOpens in a new tab. If it doesn't, we'll remove it.
CancelReport - 5 out of 5 stars
The best book for Mastering Azure Databricks
Reviewed in India on 19 January 2022Having read this book, must say, this is one of the best books authored on Azure Databricks in the market today. A few salient points:
- Personally, there are very very few people whom I truly, deeply and sincerely admire & respect based on their combination of solid technical expertise, customer centricity + focus & ability to deliver complex projects under pressing timelines having worked across multiple projects across multiple continents, these past 15+ years. Anirudh Kala & Anshul Bhatnagar, both with Celebal Technologies, both of whom I have had the opportunity of working day & night on some supremely complex Azure projects past 2+ years - I can say, first-hand from my personal experience - are both probably the 2 best Technical Experts on Azure Databricks in India, and to write on this topic.
- Secondly, I read through the eBook version of the book. It is straight to the point, matter of fact concepts explained, with code to execute wherein relevant.
a) Core concepts including Delta Lake, core differences between parquet, avro & orc, Batch ETL process stages, Spark Structured Streaming WALs, MLflow, GraphFrames are well explained.
b) Optimizing Databricks strategies and solutions are all excellent to save your precious DBUs (== dollars) and getting the best performance. Loved the section on 'column predicate pushdown' as an optimization technique.
c) The chapter on Spark Core Performance Tuning is simply fantastic. Every Databricks Developer/Expert ought to know all these points by heart.
- The chapter on Case Studies is excellent. Am very happy and proud to see that a few projects wherein I have had the opportunity of collaborating with the Authors on delivering some solid complex projects are mentioned therein... very proud of some of the work we have done in 2019-2021.
- In summary, I strongly recommend getting this book if you're aspiring to or already a professional Data Engineer and/or Data Scientist and/or Data Analyst and/or Data Architects. Big Data is a truth today, and a solid grasp of Databricks, and how to optimize Spark workloads on Databricks for different use-cases efficiently, is a mandatory must.
Once again, thank you to the authors for the wonderful effort, and to Packt, Priyanka Mhatre for inviting me to read the eBook and provide a review of the same. Am sure the Big Data community would love this Book.
Sending feedbackâĶSending feedback...HelpfulThank you for your feedback.Sorry, we failed to record your vote. Please try againThank you. We'll investigate in the next few days.Sorry, We failed to report this review. Please try againWe'll check if this review meets our community guidelinesOpens in a new tab. If it doesn't, we'll remove it.
CancelReport - 4 out of 5 stars
A very Practical-Oriented book!!!
Reviewed in India on 26 December 2021This is my review after reading "Optimizing Databricks Workloads". To be honest I opted for the Kindle version of this book because wanted to upskill myself in the Data bricks and Big Data Domain and not many are books available in the market for the same. Although the Book Mentions "Optimizing" but I feel anyone with Basic SQL/Python Understanding Can easily start his/her journey with the help of this book. Hence, I feel this Should not be restricted to data engineers, data scientists, and cloud architects.
The book covers all the Important points in an optimal Spark cluster configuration for running big data
processing and workloads in Databricks, some very useful optimization techniques for
Spark DataFrames, best practices for optimizing Delta Lake, and techniques to optimize
Spark jobs through Spark core.
You'll find (almost) everything about DataBricks/Apache Spark in this book. It's not a book for fast reading. This book will stay with you for a while. The Best part of the book is the last section which covers the Real-world scenarios covering different Sectors and industries. (The cherry on the Cake, I would say!)
Happy Learning!
One person found this helpfulSending feedbackâĶSending feedback...HelpfulThank you for your feedback.Sorry, we failed to record your vote. Please try againThank you. We'll investigate in the next few days.Sorry, We failed to report this review. Please try againWe'll check if this review meets our community guidelinesOpens in a new tab. If it doesn't, we'll remove it.
CancelReport
Top reviews from other countries
Kindle Customer5 out of 5 starsExcellent book. Clear and precise.
Reviewed in the United States on 9 September 2024I recommend this book for beginners or intermediate users, as it not only covers the basics, but tries to go deeper into theory that not everyone knows even if they already use Databricks.
Sending feedbackâĶThank you. We'll investigate in the next few days.Sorry, We failed to report this review. Please try againWe'll check if this review meets our community guidelinesOpens in a new tab. If it doesn't, we'll remove it.
CancelReport
AQ1 out of 5 starsVery superficial!
Reviewed in Canada on 18 June 2023The title of this book is very misleading. I was super excited to finally have a book that digs into optimizing databricks workflows. The book however is a mere introduction to the world of databricks. The first half talks about how to provision a databricks, run a notebook, create a cluster and filter a table. The second half barely covers a paragraph about some of the most important topics in jobs optimization. No depth in any of these topics whatsoever. To readers, please only buy if you have never touched databricks before and looking for something to start. To authors, please respect your readers and change the title to something more reflective of the content. May be âDatabricks for absolute beginnersâ would be more reflective.
Sending feedbackâĶThank you. We'll investigate in the next few days.Sorry, We failed to report this review. Please try againWe'll check if this review meets our community guidelinesOpens in a new tab. If it doesn't, we'll remove it.
CancelReport
