How does tokenization work? Why are subword tokens used instead of whole words?
Machine Learning / AI
Tell us about BGE-M3: three representations — dense, sparse, multi-vector.
What are Recall and Precision? Task: 50 fruits, 30 apples, and 20 pears, a robot correctly identified 20 apples, but 15 pears were misclassified as apples. Calculate the metrics.
Are you familiar with LoRA and fine-tuning methods?
How were the coefficients for hybrid search selected?
Why did you need 12,000 question-answer pairs when there were only 15 templates?
Why did you recognize documents as images instead of creating a parser?
How did you form the test data set — from the same 12 thousand pairs or from new data?
Tell us about clustering: what problem did you solve, what method did you use, and how did you measure quality?
How did you evaluate the quality of the RAG system? What metrics did you use?
What is a dense vector (dense embedding)? How is it obtained? What is its size?
How does a transformer work? Tell me about BERT and GPT.
What models were used at each stage? For entity extraction, vectorization, generation?
Why is it necessary to reduce the size of the dictionary? What are the disadvantages of a large dictionary? In which function does the load occur?
What is a cross-encoder and where have you used it?
What is a sparse vector? How does it differ from a dense one?
What was sent to the end user in your system?
What is the difference between GET and POST requests?
Is it one of 12,000 answers or multiple answers suitable for a single query?
Explain simply how your system works for a single user without asynchronous processes.