Open Benchmark Leaderboard¶

OpenMed rows are aggregated from the canonical model manifest and joined with the latest BenchmarkReport for each family, tier, and format.

System	Family	Tier	Format	Models	Current Leakage	Last Green Release	Harness Freshness	Evidence
OpenMed	`General`	`n/a`	`mlx-4bit`	1	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`General`	`n/a`	`pytorch`	3	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`NER`	`Large`	`pytorch`	1	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`NER`	`n/a`	`mlx-fp`	272	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`NER`	`n/a`	`pytorch`	604	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`NER`	`Tiny`	`mlx-fp`	52	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`NER`	`Tiny`	`pytorch`	104	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`PII`	`Base`	`mlx-fp`	90	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`PII`	`Base`	`pytorch`	218	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`PII`	`Large`	`mlx-fp`	132	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`PII`	`Large`	`pytorch`	308	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`PII`	`n/a`	`mlx-8bit`	3	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`PII`	`n/a`	`mlx-fp`	4	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`PII`	`n/a`	`pytorch`	16	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`PII`	`Small`	`mlx-fp`	50	0.00%	`2026-04-14`	`2026-06-14T00:00:00Z`	`golden`
OpenMed	`PII`	`Small`	`pytorch`	100	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`PII`	`XLarge`	`pytorch`	13	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`Vision`	`n/a`	`mlx-fp`	4	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`Vision`	`n/a`	`pytorch`	6	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`ZeroShot`	`Base`	`pytorch`	13	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`ZeroShot`	`Large`	`mlx-fp`	13	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`ZeroShot`	`Large`	`pytorch`	26	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`ZeroShot`	`Medium`	`mlx-fp`	13	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`ZeroShot`	`Medium`	`pytorch`	26	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`ZeroShot`	`n/a`	`mlx-fp`	15	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`ZeroShot`	`n/a`	`pytorch`	28	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`ZeroShot`	`Small`	`mlx-fp`	13	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`ZeroShot`	`Small`	`pytorch`	26	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`ZeroShot`	`Tiny`	`pytorch`	13	n/a	`n/a`	`n/a`	`n/a`
OpenMed	`ZeroShot`	`XLarge`	`pytorch`	13	n/a	`n/a`	`n/a`	`n/a`
SHIELD	`declared competitor`	`n/a`	`n/a`	n/a	n/a	n/a	n/a	`no BenchmarkReport source`
Declared competitors	`declared competitor`	`n/a`	`n/a`	n/a	n/a	n/a	n/a	`no BenchmarkReport source`