Benchmark	Measure		160M MiniPile	160M k440 Inter High
ARC-Challenge	acc	↑	0.2125 ± 0.0120	0.1911 ± 00115
MMLU	acc	↑	0.2699 ± 0.0037	0.2295 ± 0.0035
HellaSwag	acc	↑	0.2560 ± 0.0044	0.2610 ± 0.0044
WinoGrande	acc	↑	0.4720 ± 0.0140	0.5185 ± 0.0140
Lambada (OpenAI)	acc	↑	0.0000 ± 0.0000	0.0000 ± 0.0000
Lambada (OpenAI)	perplexity	↓	3033175.2693 ± 288926.5827	1976271.1659 ± 158805.4234
Lambada (Std)	acc	↑	0.0000 ± 0.0000	0.0000 ± 0.0000
Lambada (Std)	perplexity	↓	27067951.3460 ± 2710040.191	12395759.9269 ± 1104763.2927
BLiMP	acc	↑	0.5194 ± 0.0018	0.5440 ± 0.0017

Safetensors

Model size

0.2B params

Tensor type

F32

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Marcus2112/pythia-160m-minipile_k440_high-inter_density-proportioned

Base model

Finetuned

(52)

this model

Dataset used to train Marcus2112/pythia-160m-minipile_k440_high-inter_density-proportioned