Post
Simon Willison
simonwillison.net
did:plc:kft6lu4trxowqmter2b6vg6z
I tried running it again with Qwen 3.8 27B on reasoning effort "medium" - just one run per calculation (not 30) because they took a lot longer
It got them exactly right 167 out of 169 times, so the chart is pretty dull looking!
Full details here: https://gist.github.com/simonw/8ef79c777ad34c53e9c09094800576a5
2026-09-30T13:47:29.259Z