Sobes.tech
Junior

Tell us about your work experience: tasks, technology stack.

sobes.tech AI

Answer from AI

In my experience as a Data Engineer, I have been involved in processing and transforming large volumes of data for analytics and reporting. The main tasks included:

  • Developing and maintaining ETL processes
  • Optimizing data loading from various sources
  • Automating data pipelines

The technology stack I worked with:

  • Python for scripting and data processing
  • Apache Airflow for task orchestration
  • Databases: PostgreSQL, ClickHouse
  • Cloud services for data storage and processing

For example, I implemented a pipeline that daily fetched data from an API, cleaned it, and loaded it into an analytical database for further use by the analytics team.