Booktopia has been placed into Voluntary Administration. Orders have been temporarily suspended, whilst the process for the recapitalisation of Booktopia and/or sale of its business is completed, following which services may be re-established. All enquiries from creditors, including customers with outstanding gift cards and orders and placed prior to 3 July 2024, please visit https://www.mcgrathnicol.com/creditors/booktopia-group/
Add free shipping to your order with these great books
Data Engineering with Databricks Cookbook : Build effective data and AI solutions using Apache Spark, Databricks, and Delta Lake - Pulkit Chadha

Data Engineering with Databricks Cookbook

Build effective data and AI solutions using Apache Spark, Databricks, and Delta Lake

By: Pulkit Chadha

eBook | 31 May 2024

At a Glance

eBook


RRP $61.59

$55.99

or 4 interest-free payments of $14.00 with

Instant Digital Delivery to your Booktopia Reader App

Over 90 recipes to learn how to implement reliable data pipelines with Apache Spark, optimally store and process structured and unstructured data in Delta Lake and use Databricks to orchestrate and govern your data.

Key Features

  • Learn data ingestion, data transformation, and data management techniques using Apache Spark and Delta Lake
  • Gain practical guidance on using Delta Lake tables and orchestrating data pipelines
  • Implement reliable DataOps and DevOps practices, and enforce data governance policies on Databricks

Book Description

Apache Spark is a powerful open-source distributed computing system that enables fast and flexible data processing and Delta Lake is an open-source storage layer that provides reliability, performance, and scale for data lakes. This book will show you recipes for effectively using Apache Spark, Delta Lake, and Databricks for data engineering, beginning with an introduction to data ingestion and loading with Apache Spark. You will be introduced to various data manipulation and data transformation solutions that can be applied to data. You will discover how to manage and optimize Delta tables, as well as how to ingest and process streaming data. You will learn how to improve the performance problems of Apache Spark apps and Delta Lake. Later chapters will teach you how to orchestrate and schedule data pipelines using Databricks Workflows. You will then go over how to set up and configure Unity Catalog for data governance. Finally, you will learn how to use Databricks to implement DataOps and DevOps practices. By the end of this book, you will learn how to build reliable data pipelines with modern data engineering technologies as well as have a comprehensive understanding of how to build efficient and scalable data pipelines.

What you will learn

  • Perform data loading, ingestion, and processing with Apache Spark
  • Discover data transformation techniques and custom UDFs in Apache Spark
  • Manage and optimize Delta tables with Apache Spark and Delta Lake APIs
  • Use Spark Structured Streaming for real-time data processing
  • Optimize Apache Spark application and Delta table query performance
  • Implement DataOps and DevOps practices on Databricks
  • Orchestrate data pipelines with Delta Live Tables and Databricks Workflows
  • Implement data governance policies with Unity Catalog

Who this book is for

This book is for data engineers and data practitioners who want to learn how to build efficient and scalable data pipelines using Apache Spark, Delta Lake, and Databricks. To get the most out of this book, you should have basic knowledge of Data Architecture, SQL, and Python

on

More in Data Capture & Analysis

China's Megatrends : The 8 Pillars of a New Society - John Naisbitt

eBOOK

Data Rules : Reinventing the Market Economy - Cristina Alaimo

eBOOK

RRP $66.01

$52.99

20%
OFF
Data for All - John K. Thompson

eBOOK

$37.99

Information Modeling and Relational Databases - Terry Halpin

eBOOK