Research fellow @OxfordStats @OxCSML, spent time at FAIR and MSR Former quant 📈 (@GoldmanSachs), former former gymnast 🤸‍♀️ My opinions are my own 🇧🇬-🇬🇧 sh/sshhttps://bsky.app/profile/desirivanova.bsky.socialhttps://bsky.app/profile/desirivanova.bsky.social/post/3lm7xenlrok2wResearch internships in AI safety www.lasrlabs.org https://www.lasrlabs.org07 Apr 2025 12:25 +0000at://did:plc:wgcopuptcic2w2dwpekflrc5/app.bsky.feed.post/3lm7xenlrok2whttps://bsky.app/profile/desirivanova.bsky.social/post/3ljpr3u3x3c2gOur paper on the best way to add error bars to LLM evals is on arXiv! TL;DR: Avoid the Central Limit Theorem -- there are better, simple Bayesian and frequentist methods you should be using instead. We also provide a super lightweight library: github.com/sambowyer/baye… 🧵👇06 Mar 2025 15:00 +0000at://did:plc:wgcopuptcic2w2dwpekflrc5/app.bsky.feed.post/3ljpr3u3x3c2ghttps://bsky.app/profile/desirivanova.bsky.social/post/3liouupla3s2hI’m teaching a grad course for the first time (a bit terrifying 😅) and I’ve decided to write a short blog post after each lecture, that will highlight a key takeaway from it and reflect on what can be improved. First one ⬇️21 Feb 2025 13:10 +0000at://did:plc:wgcopuptcic2w2dwpekflrc5/app.bsky.feed.post/3liouupla3s2hhttps://bsky.app/profile/desirivanova.bsky.social/post/3lhylnijhz225📣 Jobs alert We’re hiring postdoc and research engineer to work on UQ for LLMs!! Details ⬇️ #ai #llm #uq [contains quote post or other embedded content]12 Feb 2025 16:26 +0000at://did:plc:wgcopuptcic2w2dwpekflrc5/app.bsky.feed.post/3lhylnijhz225https://bsky.app/profile/desirivanova.bsky.social/post/3lhylnijhz225📣 Jobs alert We’re hiring postdoc and research engineer to work on UQ for LLMs!! Details ⬇️ #ai #llm #uq [contains quote post or other embedded content]12 Feb 2025 16:26 +0000at://did:plc:wgcopuptcic2w2dwpekflrc5/app.bsky.feed.post/3lhylnijhz225https://bsky.app/profile/desirivanova.bsky.social/post/3lhozeup5rc22A tiny "embers of autoregression" artifact in simple arithmetic probapproxincorrect.substack.com/p/embers-of-au…08 Feb 2025 21:05 +0000at://did:plc:wgcopuptcic2w2dwpekflrc5/app.bsky.feed.post/3lhozeup5rc22https://bsky.app/profile/desirivanova.bsky.social/post/3ldxbuclsek2zBeing able to do “academic research” at a tech salary was a zero interest rate phenomenon [contains quote post or other embedded content]23 Dec 2024 06:17 +0000at://did:plc:wgcopuptcic2w2dwpekflrc5/app.bsky.feed.post/3ldxbuclsek2zhttps://bsky.app/profile/desirivanova.bsky.social/post/3lc4aozofb22rIt’s hot takes Friday 😅 https://probapproxincorrect.substack.com/p/some-thoughts-on-the-role-of-bayesianism29 Nov 2024 18:49 +0000at://did:plc:wgcopuptcic2w2dwpekflrc5/app.bsky.feed.post/3lc4aozofb22rhttps://bsky.app/profile/desirivanova.bsky.social/post/3lbotbt7bgs2zHow about we stop writing and submitting papers that should have been a blog/reddit post at best [contains quote post or other embedded content]24 Nov 2024 10:45 +0000at://did:plc:wgcopuptcic2w2dwpekflrc5/app.bsky.feed.post/3lbotbt7bgs2zhttps://bsky.app/profile/desirivanova.bsky.social/post/3lbhwsce5as27Bring stats to LM evals!! https://open.substack.com/pub/desirivanova/p/towards-more-rigorous-evaluations?utm_source=app-post-stats-page&r=1tjzip&utm_medium=ios21 Nov 2024 16:59 +0000at://did:plc:wgcopuptcic2w2dwpekflrc5/app.bsky.feed.post/3lbhwsce5as27https://bsky.app/profile/desirivanova.bsky.social/post/3lbhipl6m5k27💥 the most exciting new CDT just opened for admissions!! More details will be announced soon, I promise it will be huge!! www.dtc.ox.ac.uk/foai-cdt https://www.dtc.ox.ac.uk/foai-cdt21 Nov 2024 12:47 +0000at://did:plc:wgcopuptcic2w2dwpekflrc5/app.bsky.feed.post/3lbhipl6m5k27https://bsky.app/profile/desirivanova.bsky.social/post/3lbdbtwjgys2uDecent 0-shot performance (conditional on it has been like 100 years since retirement) 😅19 Nov 2024 20:33 +0000at://did:plc:wgcopuptcic2w2dwpekflrc5/app.bsky.feed.post/3lbdbtwjgys2uhttps://bsky.app/profile/desirivanova.bsky.social/post/3lbceyupwvk2xStatML is probably the best programme in the UK to do an ML PhD/DPhil! [contains quote post or other embedded content]19 Nov 2024 11:57 +0000at://did:plc:wgcopuptcic2w2dwpekflrc5/app.bsky.feed.post/3lbceyupwvk2xhttps://bsky.app/profile/desirivanova.bsky.social/post/3lbafgemcls26Thanks to UK academia, today I was reminded (for the N-th time) what happens when you allocate resources by optimising the wrong objective 🫠18 Nov 2024 16:59 +0000at://did:plc:wgcopuptcic2w2dwpekflrc5/app.bsky.feed.post/3lbafgemcls26