65 lines
2.0 KiB
Markdown
65 lines
2.0 KiB
Markdown
# Competences — data engineer
|
|
|
|
Source: ESCO v1.2.1 occupation-skill relations (http://data.europa.eu/esco/occupation/2079755f-d809-49e6-8037-4de6180e54c0).
|
|
|
|
## Essential
|
|
|
|
- **cloud technologies** (knowledge)
|
|
- **computer science** (knowledge)
|
|
- **create data sets** (skill/competence)
|
|
- **data analytics** (knowledge)
|
|
- **data models** (knowledge)
|
|
- **data storage** (knowledge)
|
|
- **data warehouse** (knowledge)
|
|
- **database management systems** (knowledge)
|
|
- **design database in the cloud** (skill/competence)
|
|
- **develop data processing applications** (skill/competence)
|
|
- **digital data processing** (nan)
|
|
- **establish data processes** (skill/competence)
|
|
- **implement data warehousing techniques** (skill/competence)
|
|
- **manage data** (skill/competence)
|
|
- **manage ICT data architecture** (skill/competence)
|
|
- **manage quantitative data** (skill/competence)
|
|
- **manage research data** (skill/competence)
|
|
- **perform dimensionality reduction** (skill/competence)
|
|
- **process data** (skill/competence)
|
|
- **store digital data and systems** (skill/competence)
|
|
- **unstructured data** (knowledge)
|
|
- **use data processing techniques** (skill/competence)
|
|
- **use databases** (skill/competence)
|
|
|
|
## Optional
|
|
|
|
- analyse pipeline database information (skill/competence)
|
|
- create data models (skill/competence)
|
|
- SAS Data Management (knowledge)
|
|
- statistics (knowledge)
|
|
- Teradata Database (knowledge)
|
|
|
|
<!-- market-evidence -->
|
|
|
|
## Market evidence (job-ad analysis, 22 ads, as of 2026-07-11)
|
|
|
|
Share of analyzed job ads mentioning the item (threshold ≥ 20 %). Source: JSearch/Adzuna APIs.
|
|
|
|
### Hard skills
|
|
|
|
- data modeling — **50 %**
|
|
- data pipeline design — **27 %**
|
|
- data integration — **27 %**
|
|
- data analysis — **23 %**
|
|
- data engineering — **23 %**
|
|
- data transformation — **23 %**
|
|
- data warehousing — **18 %**
|
|
- statistical analysis — **18 %**
|
|
|
|
### Methods
|
|
|
|
- agile development — **18 %**
|
|
|
|
### Responsibilities
|
|
|
|
- data pipeline maintenance — **18 %**
|
|
|
|
<!-- market-evidence -->
|