Dispersion loss counteracts embedding condensation in small language models

 (chenliu-1996.github.io)

42 points | by E-Reverance 3 days ago

8 comments