Skill Exchange›Browse by domain›Data, AI & Analytics›Data Engineering & Pipelines›Batch & Stream Processing
Batch & Stream Processing
A skill group in Data, AI & Analytics › Data Engineering & Pipelines: 26 skills, 24 of them carrying a SynapseScope Skill Rating, named in 65,291 open US roles at the latest reading.
| Skill | Organisation rating | Open roles | Median salary |
|---|
| Data Processing | Maintain | 37,112 | $152,500 |
| Data Streaming | Invest | 4,411 | $177,500 |
| Real-time Data | Not rated | 3,348 | $177,500 |
| Real-time analytics | Invest | 3,015 | $157,500 |
| Amazon Kinesis | Invest | 2,863 | $182,500 |
| Batch Processing | Maintain | 2,833 | $162,500 |
| Real-Time Data Processing | Maintain | 1,782 | $182,500 |
| Stream processing | Invest | 1,674 | $187,500 |
| Event Stream Processing | Invest | 1,661 | $162,500 |
| Real-time processing | Not rated | 1,179 | $182,500 |
| Google Dataflow | Maintain | 1,020 | $182,500 |
| Spark Streaming | Migrate | 778 | $182,500 |
| Azure Event Hubs | Maintain | 767 | $162,500 |
| Live Data Streaming | Invest | 676 | $172,500 |
| Apache Flink | Invest | 658 | $187,500 |
| Streaming Materialized View Engineering | Monitor | 438 | $132,500 |
| Streaming Analytics | Invest | 348 | $157,500 |
| Kafka Streams | Maintain | 342 | $167,500 |
| Change Data Capture Streaming with Debezium | Invest | 214 | $192,500 |
| Comet | Monitor | 97 | $67,500 |
| Real-Time Data Monitoring | Maintain | 28 | $162,500 |
| Streaming Data Quality Validation | Invest | 20 | $117,500 |
| Kinesis Data Analytics | Migrate | 12 | — |
| Lambda architecture | Monitor | 8 | — |
| Kappa Architecture Design | Monitor | 7 | — |
| Streaming Lakehouse Architecture | Invest | — | — |
← Data Engineering & Pipelines · Data, AI & Analytics · All domains