Modern Data Engineering with Apache Spark: A Hands-On Guide for Building Mission-Critical Streaming Applications - Paperback >
/ Modern Data Engineering with Apache Spark: A Hands-On Guide for Building Mission-Critical Streaming Applications - Paperback

Modern Data Engineering with Apache Spark: A Hands-On Guide for Building Mission-Critical Streaming Applications - Paperback

Regular price$70.18
/
(Tax included. Shipping calculated at checkout.)
✔ Authenticity Guaranteed — Verified Designer Goods
✔ 100% Money-Back Guarantee on Eligible Items
✔ Prices Displayed in Your Local Currency
✔ Final Price = No Surprise Import Fees
✔ Complimentary Insured Worldwide Shipping on Qualifying Orders
✔ Select Collector & Specialty Pieces May Require Secured Delivery Handling
Our authentication process ensures every item meets strict luxury verification standards. Learn more
Complimentary worldwide shipping on qualifying orders

by Scott Haines (Author)

Leverage Apache Spark within a modern data engineering ecosystem. This hands-on guide will teach you how to write fully functional applications, follow industry best practices, and learn the rationale behind these decisions. With Apache Spark as the foundation, you will follow a step-by-step journey beginning with the basics of data ingestion, processing, and transformation, and ending up with an entire local data platform running Apache Spark, Apache Zeppelin, Apache Kafka, Redis, MySQL, Minio (S3), and Apache Airflow.

Apache Spark applications solve a wide range of data problems from traditional data loading and processing to rich SQL-based analysis as well as complex machine learning workloads and even near real-time processing of streaming data. Spark fits well as a central foundation for any data engineering workload. This book will teach you to write interactive Spark applications using Apache Zeppelin notebooks, write and compile reusable applications and modules, and fully test both batch and streaming. You will also learn to containerize your applications using Docker and run and deploy your Spark applications using a variety of tools such as Apache Airflow, Docker and Kubernetes.

​Reading this book will empower you to take advantage of Apache Spark to optimize your data pipelines and teach you to craft modular and testable Spark applications. You will create and deploy mission-critical streaming spark applications in a low-stress environment that paves the way for your own path to production.


What You Will Learn
  • Simplify data transformation with Spark Pipelines and Spark SQL
  • Bridge data engineering with machine learning
  • Architect modular data pipeline applications
  • Build reusable application components and libraries
  • Containerize your Spark applications for consistency and reliability
  • Use Docker and Kubernetes to deploy your Spark applications
  • Speed up application experimentation using Apache Zeppelin and Docker
  • Understand serializable structured data and data contracts
  • Harness effective strategies for optimizing data in your data lakes
  • Build end-to-end Spark structured streaming applications using Redis and Apache Kafka
  • Embrace testing for your batch and streaming applications
  • Deploy and monitor your Spark applications

Who This Book Is For
Professional software engineers who want to take their current skills and apply them to new and exciting opportunities within the data ecosystem, practicing data engineers who are looking for a guiding light while traversing the many challenges of moving from batch to streaming modes, data architects who wish to provide clear and concise direction for how best to harness and use Apache Spark within their organization, and those interested in the ins and outs of becoming a modern data engineer in today's fast-paced and data-hungry world

Back Jacket

Leverage Apache Spark within a modern data engineering ecosystem. This hands-on guide will teach you how to write fully functional applications, follow industry best practices, and learn the rationale behind these decisions. With Apache Spark as the foundation, you will follow a step-by-step journey beginning with the basics of data ingestion, processing, and transformation, and ending up with an entire local data platform running Apache Spark, Apache Zeppelin, Apache Kafka, Redis, MySQL, Minio (S3), and Apache Airflow.
Apache Spark applications solve a wide range of data problems from traditional data loading and processing to rich SQL-based analysis as well as complex machine learning workloads and even near real-time processing of streaming data. Spark fits well as a central foundation for any data engineering workload. This book will teach you to write interactive Spark applications using Apache Zeppelin notebooks, write and compile reusable applications and modules, and fully test both batch and streaming. You will also learn to containerize your applications using Docker and run and deploy your Spark applications using a variety of tools such as Apache Airflow, Docker and Kubernetes.

​Reading this book will empower you to take advantage of Apache Spark to optimize your data pipelines and teach you to craft modular and testable Spark applications. You will create and deploy mission-critical streaming spark applications in a low-stress environment that paves the way for your own path to production.

What You Will Learn
  • Simplify data transformation with Spark Pipelines and Spark SQL
  • Bridge data engineering with machine learning
  • Architect modular data pipeline applications
  • Build reusable application components and libraries
  • Containerize your Spark applications for consistency and reliability
  • Use Docker and Kubernetes to deploy your Spark applications
  • Speed up application experimentation using Apache Zeppelin and Docker
  • Understand serializable structured data and data contracts
  • Harness effective strategies for optimizing data in your data lakes
  • Build end-to-end Spark structured streaming applications using Redis and Apache Kafka
  • Embrace testing for your batch and streaming applications
  • Deploy and monitor your Spark applications

Author Biography

Scott Haines is a full stack engineer with a current focus on real-time, highly available, trustworthy analytics systems. He works at Twilio as a Principal Software Engineer on the Voice Insights team, where he helps drive Spark adoption, creates streaming pipeline architectures, and helps to architect and build out a massive stream and batch processing platform.
Prior to Twilio, Scott worked writing the backend Java APIs for Yahoo Games as well as the real-time game ranking and ratings engine (built on Storm) to provide personalized recommendations and page views for 10 million customers. He finished his tenure at Yahoo working for Flurry Analytics where he wrote the alerts and notifications system for mobile devices.

Number of Pages: 585
Dimensions: 1.24 x 10 x 7 IN
Illustrated: Yes
Publication Date: March 23, 2022
  • In stock, ready to ship
  • Backordered, shipping soon
Shop with Confidence
  • ✔ Authenticity Guaranteed — Verified Designer Goods
  • ✔ Sourced from Authorized European/U.S. Luxury Distributors
  • ✔ Secure Checkout — SSL Encrypted Payments
  • ✔ Fast Global Delivery — 3–11 Business Days
  • ✔ Easy Returns on Eligible Items
  • ✔ 100% Money-Back Guarantee — Full Refund if Not Satisfied
Verified Trust Rating: 91/100
Amazon American Express Apple Pay Bancontact Diners Club Discover Google Pay Mastercard PayPal Shop Pay USDC Visa SSL Secure
Amazon Pay Logo Fast checkout with Amazon Pay. Use your Amazon account to skip entering shipping or card info.
Trusted by discerning buyers worldwide — secure, verified luxury sourcing

AUTHENTICITY GUARANTEED

Reserved for you — complete your purchase to secure this piece.

Authorized Designer Inventory Secure & Encrypted Checkout Tracked & Insured Delivery

OFFICIALLY AUTHORIZED RESELLER

Discover Officially Authorized Authentic Items at STORE7994.com - Certificates Available on Request!

Independently verified for store quality and customer safety.
Trust score: 91/100

All designer items offered by STORE 7994 are sourced from trusted luxury distributors and verified through independent authentication services.

Learn how STORE 7994 authenticates luxury items

Guaranteed Authentic — Includes Brand Documentation & Third-Party Verification Options.

Shipping information

  • Free Shipping* on all orders over $300 USD to most countries* Estimated delivery: 2-5 business days Mon-Sat to U.S., CA, EU etc.
  • Tracking available: DHL Express
  • Store 7994 Shipping policy
  • Global delivery in 3–9 business days (location dependent).
  • Free Worldwide Shipping $300+. International duties & VAT are calculated by destination country and may be collected upon delivery. UK orders are subject to 20% import VAT upon delivery.

Our innovation isn’t just in the brands we carry — it’s in the way we connect them. From our automation engine that keeps collections globally updated to our commitment to authenticity-first presentation, STORE 7994 exists where timeless design meets modern precision.

Every product we offer is:
Elevated · Intentional · Exclusive · Authentic

STORE 7994 is an authorized reseller of luxury fashion houses. Certificates and proof of authenticity are available to brand owners and partners upon request.

This site is protected by hCaptcha and the hCaptcha Privacy Policy and Terms of Service apply.

Returns & Refunds

We want you to shop with confidence at STORE 7994. If your purchase does not meet expectations, eligible items may be returned under the conditions below.

Return Eligibility
Items must be unused, unworn, and in original condition with all tags, packaging, and accessories included. Items showing any signs of wear or damage will not be accepted.

Return Window
Return requests must be made within 14 days of delivery.

Return Shipping
Customers are responsible for return shipping costs unless the item is defective, damaged, or incorrect.

Luxury Items
Items valued over $1,000 may be subject to a 7% restocking fee upon approved return.

Non-Returnable Items
For hygiene and product integrity reasons, the following items are final sale once opened or used:

• Underwear
• Fragrances
• Any worn or used items

Made-to-Order Items
Custom-designed products, including STORE 7994 hoodies, are made exclusively for each customer and are final sale. These items are not eligible for return or exchange unless defective or incorrect.

If you receive a defective or incorrect item, please contact us and we will make it right.

International Shipping & Duties
Many of our products ship directly from trusted international partners. Any applicable customs duties or import taxes are calculated at checkout and are non-refundable, even if the item is returned.

Returns & Associated Fees
All approved returns are subject to a $24 return processing fee. For international orders, duties, taxes, and return fees will be deducted from the original payment.

Shipping Policy
Complimentary shipping is offered on orders over $300. Orders below this threshold are subject to standard shipping rates at checkout.