Where can I view task logs in Airflow?
Data Engineer
How familiar are you with Linux/Docker?
How do you pass data between different Airflow tasks?
How can data be transferred when migrating a materialized view from Greenplum to ClickHouse?
What types of databases do you know?
Given two tables t1 and t2. List all types of joins you know, and the result of the query select * from t1 <join> t2 on t1.t = t2.t for each. |t1.t| ------ 1 2 4 null ------ |t2.t| ------ 1 3 null null
[name] tell us about your current project: what did you do, what interesting tasks, technologies, and the complexity of the project.
How does the query optimizer in Oracle work, what does it consider, and to which class does it belong?
What data volumes did you have to process?
What is the difference between RANK() and DENSE_RANK()?
What does the window function LEAD do in SQL?
Have you worked with Apache NiFi?
How can an SQL injection occur through a date input field?
Do you have any questions at this stage?
Describe an end-to-end technical task: from source to storefront, including layers and actions at each stage.
How does ClickHouse work and how does it differ from PostgreSQL?
Tell about your recent work experience, what projects, what stack?
What is the difference between docker run and docker exec commands?
What is the purpose of slicing data into blocks in HDFS?
How does Pandas handle missing data?