I lead Cohere For AI. Formerly Research Google Brain. ML Efficiency, LLMs, @trustworthy_ml. https://bsky.app/profile/sarahooker.bsky.socialhttps://bsky.app/profile/sarahooker.bsky.social/post/3lo22hcho2s27It is critical for scientific integrity that we trust our measure of progress. The @lmarena.bsky.social has become the go-to evaluation for AI progress. Our release today demonstrates the difficulty in maintaining fair evaluations on the Arena, despite best intentions.30 Apr 2025 14:55 +0000at://did:plc:mxun2pqszqqevztpby26lsvr/app.bsky.feed.post/3lo22hcho2s27https://bsky.app/profile/sarahooker.bsky.social/post/3lkr5wlvrq22xIt is rare I get to completely disconnect. Very grateful for this week in Patagonia.19 Mar 2025 21:47 +0000at://did:plc:mxun2pqszqqevztpby26lsvr/app.bsky.feed.post/3lkr5wlvrq22xhttps://bsky.app/profile/sarahooker.bsky.social/post/3li2dnqvkxs2uMany people have asked me about the France Action Summit. I think a summit is typically most valuable as a catalyst, not as a solution in itself. But, will share some observations.13 Feb 2025 09:08 +0000at://did:plc:mxun2pqszqqevztpby26lsvr/app.bsky.feed.post/3li2dnqvkxs2uhttps://bsky.app/profile/sarahooker.bsky.social/post/3lfyjiyf7gk2fAs the @cohereforai.bsky.social joins the Bluesky family — we will be sharing paper gems from when we first started as a lab. This paper is part of a larger research agenda where we have focused on how to better represent the long tail = making AI work for almost all real world distributions. [contains quote post or other embedded content]18 Jan 2025 04:57 +0000at://did:plc:mxun2pqszqqevztpby26lsvr/app.bsky.feed.post/3lfyjiyf7gk2fhttps://bsky.app/profile/sarahooker.bsky.social/post/3lfw2i3x4i226Last year we published a fantastic cross-institutional survey on efficiency techniques for language models. Comprehensive and a good starting pointing for researchers working on efficiency. [contains quote post or other embedded content]17 Jan 2025 05:23 +0000at://did:plc:mxun2pqszqqevztpby26lsvr/app.bsky.feed.post/3lfw2i3x4i226https://bsky.app/profile/sarahooker.bsky.social/post/3lfq7qj2tr224Changing the spaces where AI breakthroughs happen. ✨ Join us. 🔥 [contains quote post or other embedded content]14 Jan 2025 21:41 +0000at://did:plc:mxun2pqszqqevztpby26lsvr/app.bsky.feed.post/3lfq7qj2tr224