This is a heavily interactive web application, and JavaScript is required. Simple HTML interfaces are possible, but that is not what this is.
Post
Michael McLean
michaelmclean.me
did:plc:fxtzvs62mg7pgtg4jdgnm5qi
OpenAI has a new benchmark where they run frontier LLMs against software development tasks on UpWork. So far, they fail to succeed on a majority of the possible $1 million payout from the tasks.
But assume any rate of improvement and this gets wild.
Paper arxiv.org/pdf/2502.12115
2025-02-18T22:00:05.856Z