How do Precision and Recall behave under class imbalance? Example: 95 ones and 5 zeros, the model always predicts 1.
Intern
234
Machine Learning / AI
3636
0
If the AUC of a new model is 0.82 compared to 0.80 for the production model — can we confidently say that the new one is better? How to check statistical significance?
Intern
234
What statistical tests should be used to assess the significance of differences between groups and how do they differ?
Middle
234
What are the practical problems of RLHF (reward hacking, mode collapse)?
Middle — Senior
233
What is the ReAct (Reason + Act) pattern?
Middle
233
What is MT-Bench and how is the score calculated?
Senior
233
Are there any questions about the product and the tasks the company solves?
Middle
233
If the worker is synchronous, will it have batching?
Middle+
233
Why is an ensemble of multiple trees better than a single tree?
Middle — Senior
233
How exactly was the embedder fine-tuned — LoRA or full fine-tuning?
Senior
233
Какая сложность по памяти и по времени у self-attention?
Middle — Senior
233
How is request routing between scenarios implemented — in what form does the LLM give an answer and how is the scenario chosen based on it?
Middle
233
What is an advantage function and why does it reduce variance?
Middle — Senior
233
Was the conversation compared in its entirety or only parts of it?
Middle
233
What models did you use for demand forecasting?
Middle
233
What is the Unigram language model in tokenization (like in SentencePiece)?
Junior — Middle
233
233
Describe the architecture of U-Net and why skip connections are used there.
Middle — Senior
233
A correlation coefficient equals 0. Can we claim that the samples are independent? Why?
Middle
233
What is a re-ranker in RAG? What models are used (cross-encoder, bge-reranker)?
Middle — Senior
233