Skip to main content
grasp.study
About
Explore
Pricing
Log in
Try it for free
Back to course
👋
Welcome to a Grasp lesson
Create a free account
to keep studying and create your own study path.
Databricks Data Engineer Certification
·
Module 5
Building Streaming Data Pipelines
1
Reading Streaming Data with Spark Structured Streaming
Read streaming data sources using Spark Structured Streaming.
2
Understanding Output Modes: Complete, Append, and Update
Differentiate between complete, append, and update output modes.
3
Setting Trigger Intervals for Streaming Queries
Configure trigger intervals for streaming queries (fixed interval, availableNow, continuous).
4
Stream to Delta Lake
Write streaming query results to Delta tables as a sink.
5
Handling Late Data with Watermarks
Use watermarking to handle late-arriving data in streaming queries.
6
Optimizing Streaming Queries with Spark UI
Monitor and troubleshoot streaming queries using the Spark UI and query progress.
Previous module
Incremental Data Ingestion
Next module
Declarative Pipelines with Delta Live Tables