Spark and Big Data Processing with R and Python: Building Scalable Pipelines with Sparklyr, PySpark, and Databricks

By Julian K. Mercer

Reactive Publishing

Learn big data processing with Spark using R and Python.

This book offers a practical introduction to Apache Spark for large-scale data work. It focuses on building scalable data pipelines using Sparklyr, PySpark, and Databricks.

You will discover how to:

Work with large datasets using Apache SparkUse Sparklyr to integrate Spark with RDevelop with PySpark in PythonLeverage Databricks for cloud-based Spark environmentsConstruct reliable data pipelines for real-world use

The book bridges the R and Python ecosystems, helping data professionals use the right language for different Spark tasks. It covers core concepts including data transformation, distributed processing, and moving projects from development to production.

Written for data analysts, data scientists, and engineers who want to add Spark to their toolkit.

Perfect for: Professionals looking to expand their skills in big data processing with Spark across both R and Python.

• Format: Paperback
• Language: English
• ISBN: B0H32ZHLFX
• ISBN13: 9798198822771
• Release Date: May 2026
• Publisher: Independently published
• Length: 423 Pages
• Weight: 1.13 lbs.
• Dimensions: 9.0" x 1.0" x 6.0"