Junior
Tell us about your work experience: tasks, technology stack.
sobes.tech AI
Answer from AI
In my experience as a Data Engineer, I have been involved in processing and transforming large volumes of data for analytics and reporting. The main tasks included:
- Developing and maintaining ETL processes
- Optimizing data loading from various sources
- Automating data pipelines
The technology stack I worked with:
- Python for scripting and data processing
- Apache Airflow for task orchestration
- Databases: PostgreSQL, ClickHouse
- Cloud services for data storage and processing
For example, I implemented a pipeline that daily fetched data from an API, cleaned it, and loaded it into an analytical database for further use by the analytics team.