Skill Exchange›Browse by domain›Data, AI & Analytics›Data Engineering & Pipelines›Distributed & Big Data Processing
Distributed & Big Data Processing
A skill group in Data, AI & Analytics › Data Engineering & Pipelines: 30 skills, 29 of them carrying a SynapseScope Skill Rating, named in 98,475 open US roles at the latest reading.
| Skill | Organisation rating | Open roles | Median salary |
|---|---|---|---|
| Big Data | Not rated | 24,996 | $152,500 |
| Databricks | Invest | 23,116 | $167,500 |
| Spark | Invest | 13,462 | $172,500 |
| High Performance Computing | Invest | 11,251 | $132,500 |
| Big Data Technologies | Invest | 5,512 | $167,500 |
| PySpark | Invest | 5,363 | $147,500 |
| Cloud Analytics | Invest | 3,454 | $142,500 |
| MapReduce | Migrate | 1,774 | $177,500 |
| Big Data Analytics | Invest | 1,749 | $142,500 |
| Apache Iceberg Table Management | Invest | 1,450 | $202,500 |
| Big Data Processing (Hadoop, Spark) | Invest | 1,228 | $177,500 |
| Distributed Query Federation with Trino | Invest | 1,169 | $202,500 |
| Dask | Maintain | 698 | $202,500 |
| Amazon EMR | Maintain | 478 | $177,500 |
| Big Data Frameworks | Invest | 433 | $162,500 |
| Rust-Based Data Processing Engineering | Invest | 421 | $172,500 |
| Google Dataproc | Maintain | 413 | $182,500 |
| Hadoop Ecosystem | Monitor | 348 | $137,500 |
| Snowpark | Invest | 324 | $152,500 |
| Big Data Management | Invest | 319 | $102,500 |
| Delta Lake Engineering | Invest | 218 | $132,500 |
| GPU-Accelerated Data Processing | Invest | 105 | $187,500 |
| Cloudera CDP | Migrate | 56 | $147,500 |
| Talend Big Data Integration | Monitor | 49 | $122,500 |
| Azure HDInsight | Migrate | 44 | $172,500 |
| Apache Pig | Migrate | 15 | $137,500 |
| Open Table Catalog Engineering | Invest | 15 | $272,500 |
| Informatica Big Data | Maintain | 12 | — |
| Pig Latin | Migrate | 3 | — |
| Cloud-Agnostic Data Processing | Invest | — | — |
← Data Engineering & Pipelines · Data, AI & Analytics · All domains