Files
data-engineer/references/market.md
2026-08-15 14:43:48 +02:00

101 lines
3.2 KiB
Markdown
Raw Permalink Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

# Market evidence report — data-engineer
Source: **22 real job ads** (JSearch API, countries: us 22), extracted into the MSSQL evidence store; as of 2026-07-11.
This report contains extracted, aggregated facts only — no ad text is
reproduced (copyright / platform terms).
## Seniority distribution
| Seniority | Ads | Share |
|---|---|---|
| mid | 14 | 64 % |
| senior | 6 | 27 % |
| lead | 1 | 5 % |
| n/a | 1 | 5 % |
## Tools — full market ranking
| # | Item | Ads | Share |
|---|---|---|---|
| 1 | Databricks | 9 | 41 % |
| 2 | Python | 9 | 41 % |
| 3 | Apache Spark | 5 | 23 % |
| 4 | AWS | 5 | 23 % |
| 5 | Spark | 5 | 23 % |
| 6 | SQL | 5 | 23 % |
| 7 | informatica | 4 | 18 % |
| 8 | Snowflake | 4 | 18 % |
| 9 | Azure Data Factory | 3 | 14 % |
## Hard skills — full market ranking
| # | Item | Ads | Share |
|---|---|---|---|
| 1 | data modeling | 11 | 50 % |
| 2 | data integration | 6 | 27 % |
| 3 | data pipeline design | 6 | 27 % |
| 4 | data analysis | 5 | 23 % |
| 5 | data engineering | 5 | 23 % |
| 6 | data transformation | 5 | 23 % |
| 7 | data warehousing | 4 | 18 % |
| 8 | statistical analysis | 4 | 18 % |
| 9 | data architecture | 3 | 14 % |
| 10 | database design | 3 | 14 % |
## Methods — full market ranking
| # | Item | Ads | Share |
|---|---|---|---|
| 1 | agile development | 4 | 18 % |
## Responsibilities — full market ranking
| # | Item | Ads | Share |
|---|---|---|---|
| 1 | data pipeline maintenance | 4 | 18 % |
## Regional breakdown
> **Corpus note:** 22 relevant ads in total — below the 100-ad target for a fully reliable ranking. Percentages above should be read as indicative.
### US (us)
**Insufficient evidence** — 22 ads (minimum for a regional ranking: 30). No ranking is reported for this region.
### UK (gb)
**Insufficient evidence** — 0 ads (minimum for a regional ranking: 30). No ranking is reported for this region.
### EU/DACH (de, at, ch, nl)
**Insufficient evidence** — 0 ads (minimum for a regional ranking: 30). No ranking is reported for this region.
## Job title variants in the market
| Title | Ads |
|---|---|
| Senior Full-Stack Data Engineer TS/SCI Clearance | 2 |
| Cloud Data Engineer: Pipelines, Spark & Databricks | 1 |
| Combat Data Systems Engineer 🏆 | 1 |
| Data Engineer (Databricks) | 1 |
| Data Engineer / Analytics Programmer (Healthcare Data) | 1 |
| Data Engineer / Data Architect III | 1 |
| Data Engineer All Levels Crystal City VA | 1 |
| Data Engineer III | 1 |
| Data Engineer- up to $260k - FS Poly McLean, VA | 1 |
| Data Engineer(AWS/DataBricks experience REQUIRED) | 1 |
| Data Engineer, Mid | 1 |
| Data Engineer: ETL, Databricks & Big Data (Remote) | 1 |
| Entry Level Data Engineer | 1 |
| ETL Data Engineer | 1 |
| Kearney Activate Senior Consultant Data Engineer | 1 |
| Mid Data Engineer | 1 |
| Remote Data Engineer | 1 |
| Senior Data Engineer | 1 |
| Senior Data Engineer (Remote) | 1 |
| Senior Data Engineer: Build Scalable Data Pipelines | 1 |
| Senior Data Engineer: Mission-Critical Pipelines (Secret) | 1 |
Methodology: entities extracted per ad ({hard_skills, tools, methods, responsibilities, seniority}), normalized, counted as DISTINCT ads per entity; report threshold ≥ 3 ads. Headline sections in skills.md/tools.md use the stricter ≥ 20 % threshold.