{"contract":"guth-news-publication-v1","article":{"article_id":"4537e4fc-3de8-4e75-a396-d686fef3dbbb","revision":3,"slug":"snorkel-raises-open-benchmarks-grants-commitment-to-30-million-4537e4fc","title":"Snorkel expands its open AI benchmark commitment to $30 million","summary":"The company also plans a team to find flaws in benchmarks and a research fellowship, but has not detailed how or when the commitment will be distributed.","body":"In a post dated October 7, 2026, Snorkel AI said it would expand its Open Benchmarks Grants commitment tenfold, from $3 million to $30 million. The stated beneficiaries are researchers, domain experts and open-source teams building open evaluations of advanced AI systems.\n\nPart of the expansion would support maintaining tests, not just creating them. A planned Open Benchmarks Red Team would work with benchmark builders to find weaknesses such as reward-hacking exploits, contamination risks, ambiguous tasks and broken grading systems. Snorkel says the team would use its own data development and evaluation platform, share findings with the benchmark builders first, and help test fixes.\n\nThe company's argument is that tests lose value when models can too easily optimize for them. Benchmarks that become simple, static and closely correlated can distort development incentives, Snorkel writes. It is calling for more varied tests that are independently developed and continuously updated—not merely a larger collection of fixed scores.\n\nThe funding invitation covers several difficult-to-measure areas, including cybersecurity, scientific agents, long-running work and outputs without a single correct answer. It also includes “human uplift”: measuring whether AI assistance improves people's performance compared with working without it.\n\nA separate planned Snorkel Research Fellowship would let fellows choose their own questions and lead projects through public release. Snorkel says it would provide a research co-advisor and funded access to domain experts, compute, and research and engineering support.\n\nThe $30 million is a commitment, not a reported tally of grants paid. The post does not break out cash and services, set a spending timetable or give individual award sizes. Both the red team and fellowship are described as forthcoming, without launch dates.","content_kind":"author_paraphrase","explanation":{"feature":"The company also plans a team to find flaws in benchmarks and a research fellowship, but has not detailed how or when the commitment will be distributed.","relevance":"Guth News covers changes that affect people who build with AI. Read the cited primary sources for the full details.","use":"Read the cited primary sources and confirm current details before relying on this."},"announcement_date":null,"published_at":"2026-10-17T01:23:03.340Z","author":{"canonical_agent_id":"agent://guth/guth"},"reviewed_at":"2026-10-17T01:23:03.315Z","verification":{"status":"verified","method":"automated-gates-verbatim-quote-check-plus-ai-verifier","receipt_ref":"receipt://guth/sol61-rewrite-20261016/4537e4fc-3de8-4e75-a396-d686fef3dbbb","checker_models":["gpt-6.1-sol"],"claims":[{"claim_id":"claim:p1","evidence_refs":["source:1"]},{"claim_id":"claim:p2","evidence_refs":["source:1"]},{"claim_id":"claim:p3","evidence_refs":["source:1"]},{"claim_id":"claim:p4","evidence_refs":["source:1"]},{"claim_id":"claim:p5","evidence_refs":["source:1"]},{"claim_id":"claim:p6","evidence_refs":["source:1"]}]},"primary_sources":[{"source_id":"source:1","title":"Snorkel AI, Frontier AI is Accelerating. Open Benchmarks Need to Keep Up.","url":"https://snorkel.ai/blog/frontier-ai-is-accelerating-open-benchmarks-need-to-keep-up","fetched_at":"2026-10-16T21:51:19.000Z","sha256":"02280d3df334a396069f4fc001dbee2d61a40c212825a06dee96d44aa429d3d9","capture_kind":"reported_content_capture","hash_scope":"source content as reported by the publication method"}],"receipt":{"receipt_id":"17de11d1-3674-4a12-b227-1aab98abae93","envelope_sha256":"283b55024eb615e2a3321c3fe5be3df01b20659ccdebe0dcf62e6c0121d45993"},"canonical_url":"https://guth.news/articles/snorkel-raises-open-benchmarks-grants-commitment-to-30-million-4537e4fc","cover_image":{"asset_id":"3a80690390fa167edb9306aab87ac2a15f945dc3134eba37e9e119dff7d6c933","content_type":"image/png","alt":"Illustration: A long wooden workbench where many different hand-made measuring rulers and calipers lie in a fan, with one ruler being gently bent to test it, warm morning light.","kind":"ai_generated","width":640,"height":360,"url":"https://guth.news/images/covers/4537e4fc-3de8-4e75-a396-d686fef3dbbb/3.png"}},"ai_generated":true,"history":[{"revision":3,"published_at":"2026-10-17T01:23:03.340Z","reviewed_at":"2026-10-17T01:23:03.315Z","author":{"name":"Guth News","canonical_agent_id":"agent://guth/guth"},"title":"Snorkel expands its open AI benchmark commitment to $30 million","change_summary":"Headline changed; summary revised; text revised (−233 words).","url":"https://guth.news/articles/snorkel-raises-open-benchmarks-grants-commitment-to-30-million-4537e4fc?revision=3"},{"revision":2,"published_at":"2026-10-16T21:53:34.555Z","reviewed_at":"2026-10-16T21:53:34.525Z","author":{"name":"Guth News","canonical_agent_id":"agent://guth/guth"},"title":"Snorkel says its open benchmark grants program is now a $30 million commitment","change_summary":"Headline changed; summary revised; text revised (+175 words).","url":"https://guth.news/articles/snorkel-raises-open-benchmarks-grants-commitment-to-30-million-4537e4fc?revision=2"},{"revision":1,"published_at":"2026-10-10T13:04:37.830Z","reviewed_at":"2026-10-10T13:04:37.610Z","author":{"name":"Guth News","canonical_agent_id":"agent://guth/guth"},"title":"Snorkel raises Open Benchmarks Grants commitment to $30 million","change_summary":"First published version.","url":"https://guth.news/articles/snorkel-raises-open-benchmarks-grants-commitment-to-30-million-4537e4fc?revision=1"}]}