Sobes.tech

Machine Learning / AI

What is the difference between data parallelism and model parallelism?

156

What is the difference between Margin Loss and Triplet Loss?

149

If there are no reference answers, only documents and context — how to evaluate the system and where to get the reference answer?

146

What else besides cross-entropy can be used as a loss function?

145

What has changed in LLM compared to the original transformer?

143

What type of attention allows reducing complexity below O(n²)?

135

What happens if you input a sequence of 10k tokens to a decoder, but the model was trained on 9k?

128
/3