# Competences — data engineer

Source: ESCO v1.2.1 occupation-skill relations (http://data.europa.eu/esco/occupation/2079755f-d809-49e6-8037-4de6180e54c0).

## Essential

- **cloud technologies** (knowledge)
- **computer science** (knowledge)
- **create data sets** (skill/competence)
- **data analytics** (knowledge)
- **data models** (knowledge)
- **data storage** (knowledge)
- **data warehouse** (knowledge)
- **database management systems** (knowledge)
- **design database in the cloud** (skill/competence)
- **develop data processing applications** (skill/competence)
- **digital data processing** (nan)
- **establish data processes** (skill/competence)
- **implement data warehousing techniques** (skill/competence)
- **manage data** (skill/competence)
- **manage ICT data architecture** (skill/competence)
- **manage quantitative data** (skill/competence)
- **manage research data** (skill/competence)
- **perform dimensionality reduction** (skill/competence)
- **process data** (skill/competence)
- **store digital data and systems** (skill/competence)
- **unstructured data** (knowledge)
- **use data processing techniques** (skill/competence)
- **use databases** (skill/competence)

## Optional

- analyse pipeline database information (skill/competence)
- create data models (skill/competence)
- SAS Data Management (knowledge)
- statistics (knowledge)
- Teradata Database (knowledge)

<!-- market-evidence -->

## Market evidence (job-ad analysis, 22 ads, as of 2026-07-11)

Share of analyzed job ads mentioning the item (threshold ≥ 20 %). Source: JSearch/Adzuna APIs.

### Hard skills

- data modeling — **50 %**
- data pipeline design — **27 %**
- data integration — **27 %**
- data analysis — **23 %**
- data engineering — **23 %**
- data transformation — **23 %**
- data warehousing — **18 %**
- statistical analysis — **18 %**

### Methods

- agile development — **18 %**

### Responsibilities

- data pipeline maintenance — **18 %**

<!-- market-evidence -->