What are indexes in databases, why are they needed, and what is their internal structure?
Data Engineer
Tell about your recent work experience, what projects, what stack?
What is the difference between UNION and UNION ALL? What conditions must be met?
What groups of SQL operators do you know? What do they include?
What is the Catalyst optimizer in Spark and what specific optimizations does it perform (e.g., predicate pushdown)?
How does Hash Join work?
What is normalization? Which form do we mainly work with?
How do you verify data correctness when translating a pipeline from SAS to DBT?
What causes deadlocks and which mechanism in databases is responsible for data consistency during parallel queries?.
Why did you choose DBT? What are the pros and cons of this framework?
Data Quality checks — at what stage, what checks, what happens to invalid data?
Have you worked with data quality incidents?
What are the features and differences of Set from List in Python? Besides performance, what other features are there?
Tell about an interesting task in the last 2.5 years in the company, for example related to ClickHouse.
How does Merge Join (sort-merge join) work?
What formats of distribution are there in Greenplum besides BY column and RANDOMLY?
Describe the sequence of operations in an SQL query with SELECT, FROM, WHERE, GROUP BY, HAVING, ORDER BY, LIMIT from first to last.
Do you prefer to work individually as an expert or in a team of developers?
What types of physical table joins exist (Hash Join, Merge Join, Nested Loop)?
If you join transactions with clients by client_id and date_start (without BETWEEN), what will be captured in the result?