How do mean/max pooling differ from learnable pooling?
Machine Learning / AI
How to choose the size of embedding vectors?
What are the limitations of Whisper and how to bypass them (long-form, hallucinations)?
What is NSP (next sentence prediction) and why did RoBERTa abandon it?
What is LoRA and why does it work (low-rank hypothesis)?
What is meta-prompting and what are its use cases?
What is cross-encoder QA and what is the input format?
Why is bias=False used in Linear layers in modern LLMs?
What compression formats (binary, scalar quant) are available in VDB?
What is beam search and why is it rarely used for open-ended generation?
What is the role of payload filters in a vector database?
What is DocVQA and what models are popular there?
What is a filter bubble and how is it detected?
What is the idea of the Byte Pair Encoding (BPE) algorithm? Describe the training steps.