Tag

Humans vs. AI

2 posts tagged "Humans vs. AI".

FrontierCS Humans vs. AIJun 16, 202610 min read

Humans Still Beat AI in the Long Horizon: Revisiting Test-Time Scaling in the Agent Era

Agents can spend test-time compute by trying, observing, and revising. We derive an Elo reference for repeated sampling, then show that in a 2022 two-week coding marathon, current agents plateau within 24 hours while top humans keep improving.

FrontierCS Humans vs. AIApr 21, 20267 min read

FrontierCS Goes Live: 2,000 Humans vs. AI on an Open-Ended Problem

We placed an open-ended optimization problem in CALICO, UC Berkeley's official programming contest. To score, you had to beat a frontier AI. Out of 2,000+ contestants, only one submission surpassed the strongest AI agent.