Physix Frontier badgePhysix Frontier
PublishChinese | EN

Physix Frontier · News Briefing Card (Hacker News · Oct 8, 2026)

Snorkel Expands Open Benchmark Fund to $30M

KEY FACTS

  • Snorkel announced it is expanding its open benchmark fund tenfold to $30 million.
  • The new program adds an open benchmark red-teaming project to investigate issues such as reward hacking and data contamination.
  • The company is establishing research fellowships that provide compute and engineering support for independent evaluation research.
  • The previous $3 million fund already backed multiple benchmark projects, including Terminal-Bench and ARC-AGI-3.
  • Snorkel says its funded benchmarks have appeared in the model cards of major frontier labs.

KEY DATA

$30 millionTotal funding
10xFunding expansion factor
$3 millionInitial funding amount

PHYSIX OBSERVATION

Benchmark development has fallen noticeably behind model iteration, and benchmaxxing makes scores increasingly poor at reflecting real capability. Snorkel is putting real money behind an independent, continuously updated open evaluation layer - the direction is right, but $30 million is still a drop in the bucket next to frontier labs' compute spending. The key question is whether the red-teaming mechanism can actually curb leaderboard gaming, rather than just producing another batch of new leaderboards.

Source: Hacker News report