Software Engineering KB
Search
Search
Dark mode
Light mode
Explorer
Home
❯
03 Data Management
❯
06 Data Pipelines
❯
02 Sub Concept
Folder: 03-Data-Management/06-Data-Pipelines/02-Sub-Concept
29 items under this folder.
Feb 10, 2026
MapReduce (Pipelines)
data-pipelines
batch
hadoop
mapreduce
Feb 10, 2026
Amundsen
data-pipelines
governance
data-catalogs
Feb 10, 2026
Anonymization
data-pipelines
governance
compliance
anonymization
Feb 10, 2026
Apache Hudi
data-pipelines
storage-tiers
data-lakehouse
hudi
Feb 10, 2026
Apache Iceberg
data-pipelines
storage-tiers
data-lakehouse
iceberg
Feb 10, 2026
BigQuery
data-pipelines
storage-tiers
data-warehouse
bigquery
Feb 10, 2026
CCPA
data-pipelines
governance
compliance
ccpa
Feb 10, 2026
Consumer Groups
data-pipelines
streaming
kafka
consumer-groups
Feb 10, 2026
DAG-Based Orchestration
data-pipelines
batch
airflow
dag
Feb 10, 2026
Data Masking
data-pipelines
governance
compliance
data-masking
Feb 10, 2026
DataFrames
data-pipelines
batch
spark
dataframes
Feb 10, 2026
DataHub
data-pipelines
governance
data-catalogs
Feb 10, 2026
Databricks
data-pipelines
storage-tiers
data-warehouse
databricks
Feb 10, 2026
Debezium
data-pipelines
cdc
debezium
Feb 10, 2026
Delta Lake
data-pipelines
storage-tiers
data-lakehouse
delta-lake
Feb 10, 2026
Event Time
data-pipelines
streaming
flink
event-time
Feb 10, 2026
Exactly-Once Semantics
data-pipelines
streaming
kafka
exactly-once
Feb 10, 2026
GDPR
data-pipelines
governance
compliance
gdpr
Feb 10, 2026
Great Expectations
data-pipelines
governance
quality
great-expectations
Feb 10, 2026
HDFS
data-pipelines
batch
hadoop
hdfs
Feb 10, 2026
Maxwell
data-pipelines
cdc
maxwell
Feb 10, 2026
Partitions (Kafka)
data-pipelines
streaming
kafka
partitions
Feb 10, 2026
RDDs
data-pipelines
batch
spark
rdd
Feb 10, 2026
Redshift
data-pipelines
storage-tiers
data-warehouse
redshift
Feb 10, 2026
Snowflake
data-pipelines
storage-tiers
data-warehouse
snowflake
Feb 10, 2026
SparkSQL
data-pipelines
batch
spark
sparksql
Feb 10, 2026
Topics
data-pipelines
streaming
kafka
topics
Feb 10, 2026
Watermarks
data-pipelines
streaming
flink
watermarks
Feb 10, 2026
YARN
data-pipelines
batch
hadoop
yarn