Batch Processing

Back: Data Pipelines

Processing large volumes of data in discrete jobs that run on a schedule. Suited for workloads where latency of minutes to hours is acceptable.

Concepts

• Apache Hadoop
• Apache Spark
• Apache Beam
• Trino
• dbt (data build tool)
• Airflow

---

data-pipelines batch