Sobes.tech
Senior

What does the matrix after softmax over QKᵀ look like? How are its values distributed?