Files
data-engineer/references/skills.md
2026-08-14 17:28:40 +02:00

2.0 KiB

Competences — data engineer

Source: ESCO v1.2.1 occupation-skill relations (http://data.europa.eu/esco/occupation/2079755f-d809-49e6-8037-4de6180e54c0).

Essential

  • cloud technologies (knowledge)
  • computer science (knowledge)
  • create data sets (skill/competence)
  • data analytics (knowledge)
  • data models (knowledge)
  • data storage (knowledge)
  • data warehouse (knowledge)
  • database management systems (knowledge)
  • design database in the cloud (skill/competence)
  • develop data processing applications (skill/competence)
  • digital data processing (nan)
  • establish data processes (skill/competence)
  • implement data warehousing techniques (skill/competence)
  • manage data (skill/competence)
  • manage ICT data architecture (skill/competence)
  • manage quantitative data (skill/competence)
  • manage research data (skill/competence)
  • perform dimensionality reduction (skill/competence)
  • process data (skill/competence)
  • store digital data and systems (skill/competence)
  • unstructured data (knowledge)
  • use data processing techniques (skill/competence)
  • use databases (skill/competence)

Optional

  • analyse pipeline database information (skill/competence)
  • create data models (skill/competence)
  • SAS Data Management (knowledge)
  • statistics (knowledge)
  • Teradata Database (knowledge)

Market evidence (job-ad analysis, 22 ads, as of 2026-07-11)

Share of analyzed job ads mentioning the item (threshold ≥ 20 %). Source: JSearch/Adzuna APIs.

Hard skills

  • data modeling — 50 %
  • data pipeline design — 27 %
  • data integration — 27 %
  • data analysis — 23 %
  • data engineering — 23 %
  • data transformation — 23 %
  • data warehousing — 18 %
  • statistical analysis — 18 %

Methods

  • agile development — 18 %

Responsibilities

  • data pipeline maintenance — 18 %