DUSUNEN-Rota-270M-v3 / train-manifest.json
GoktugD's picture
DUSUNEN Rota 270M v3: natural-data E5-large distillation, beats base +4.6% nDCG
73b2156 verified
Raw History Blame Contribute Delete
218 Bytes
{
"base": "microsoft/harrier-oss-v1-270m",
"records": 308487,
"steps": 30848,
"epochs": 2,
"lr": 3e-05,
"batch": 20,
"neg_per": 4,
"loss": "in-batch InfoNCE + 0.1*marginMSE(E5-large)",
"data": "NATURAL only"
}