This is a heavily interactive web application, and JavaScript is required. Simple HTML interfaces are possible, but that is not what this is.
Post
Gradient Flow
gradientflow.com
did:plc:ahtyudnsxy3he5ynxbijws6r
SWE-Lancer is a new benchmark from OpenAI that evaluates large language models' ability to handle freelance software engineering tasks
- Best model (Claude 3.5 Sonnet) only earned ~$400k out of possible $1M
- Tasks range from $50 bug fixes to $32k feature implementations
arxiv.org/abs/2502.12115
https://arxiv.org/abs/2502.12115
2025-02-20T22:26:46.150Z