Data Engineering Flashcards
Data Engineer
Type: Technical
Responsibilities:
- Ensure Data gets from sources to the Data Warehouse in an efficient, and reliable manner and in a format it can easily be queried
Top Pain:
- Slow, inefficient, complex, data pipelines that lead to stale incomplete data preventing accuracy
ETL Developer
Type: Technical
Responsibilities :
- Similar to Data Engineer, focused on building and maintaining data transformation jobs (usually 3rd party tools like informatics and talend.
Top Pain:
- Complex, long-running ETL/ELT jobs, Slow job performance, have to schedule loads off-hours; Possible missed SLAs for data loading
Enterprise / Data Architect
type: Technical
Responsibilities:
- Deliver modern architecture design and tech to meet different needs of business teams
Top Pain:
- Evolution of methodologies, adapting to tech changes
- Complex data environments and different needs for the various stakeholders
VP Analytics, Data & Engineering
Type: Executive
Responsibilities :
- Align technical capabilities with business leaders
- Build scalable technology, teams and culture
Top Pain:
- Betting their career on technology and its evolution
- Building and hiring talents
- Meeting different needs of business use cases.