Principal AI research scientist @Vanguard_Group | Founder&Host @WiAIR_podcast | Evaluation and reliability of foundation models | own opinions only 🇨🇦🇪🇺🏳️‍🌈https://bsky.app/profile/j-novikova-nlp.bsky.socialhttps://bsky.app/profile/j-novikova-nlp.bsky.social/post/3mk6kkn3djc2cWe're all Oppenheimers, so take care who you work with and what you work for. The caution from Max Welling giving his talk at @iclr-conf.bsky.social #iclr202623 Apr 2026 17:39 +0000at://did:plc:ezehedsbsukjatzzg7utv6ps/app.bsky.feed.post/3mk6kkn3djc2chttps://bsky.app/profile/j-novikova-nlp.bsky.social/post/3m77qae67zk2fIf you're not yet following my podcast on youtube, it's time to subscribe now - I'm covering the ##neurips2025 conference in San Diego there https://youtu.be/1vAJdWiWLAg?si=7PkvAllcQX3HBDCC #wiair #wiairpodcast05 Dec 2025 05:16 +0000at://did:plc:ezehedsbsukjatzzg7utv6ps/app.bsky.feed.post/3m77qae67zk2fhttps://bsky.app/profile/j-novikova-nlp.bsky.social/post/3m76zxjvgds2k@melaniemitchell.bsky.social giving her keynote at #neurips2025 on alien intelligence. Do benchmarks measure intelligence properly? And if not, how do we actually measure it?04 Dec 2025 22:37 +0000at://did:plc:ezehedsbsukjatzzg7utv6ps/app.bsky.feed.post/3m76zxjvgds2khttps://bsky.app/profile/j-novikova-nlp.bsky.social/post/3m73vkmgqvk2aRich Sutton's keynote talk on the vision of superintelligence at #NeurIPS2025 is fully packed03 Dec 2025 16:41 +0000at://did:plc:ezehedsbsukjatzzg7utv6ps/app.bsky.feed.post/3m73vkmgqvk2ahttps://bsky.app/profile/j-novikova-nlp.bsky.social/post/3m72rnvmwds26Records broken at #neurips2025 - more than 29,000 registered participants 🤯 and the most coffee amount that this Convention Centre ever ordered 😅☕️03 Dec 2025 05:58 +0000at://did:plc:ezehedsbsukjatzzg7utv6ps/app.bsky.feed.post/3m72rnvmwds26https://bsky.app/profile/j-novikova-nlp.bsky.social/post/3m6iypzmwzc2fI am heading to #NeurIPS2025 in San Diego next week! Happy to meet old and new friends and chat about consistency of LLMs, hallucinations, also about vision-language models. And please ask me about @wiair.bsky.social ! :)26 Nov 2025 04:17 +0000at://did:plc:ezehedsbsukjatzzg7utv6ps/app.bsky.feed.post/3m6iypzmwzc2fhttps://bsky.app/profile/j-novikova-nlp.bsky.social/post/3loa6rbkcrs2hRead this if you're new to academic conferences or if you'd just like a bit of helpful advice on how to make friends at conferences (as opposed to a formal "networking ") [contains quote post or other embedded content]03 May 2025 01:28 +0000at://did:plc:ezehedsbsukjatzzg7utv6ps/app.bsky.feed.post/3loa6rbkcrs2hhttps://bsky.app/profile/j-novikova-nlp.bsky.social/post/3lmw7b2uglk2wGlad to share that our publication was recognized as the Top Viewed Article. Read it here https://alz-journals.onlinelibrary.wiley.com/doi/full/10.1002/DAD2.1244516 Apr 2025 08:45 +0000at://did:plc:ezehedsbsukjatzzg7utv6ps/app.bsky.feed.post/3lmw7b2uglk2whttps://bsky.app/profile/j-novikova-nlp.bsky.social/post/3lmiejc6ckc25Proud to be a part of this multi-cultural multi-institutional collaborative project [contains quote post or other embedded content]10 Apr 2025 20:42 +0000at://did:plc:ezehedsbsukjatzzg7utv6ps/app.bsky.feed.post/3lmiejc6ckc25https://bsky.app/profile/j-novikova-nlp.bsky.social/post/3llh6427nt22pDon't miss this episode! It's going to be an interesting discussion about social and ethical implications of biased AI, and how researchers are working to create fair and inclusive systems [contains quote post or other embedded content]28 Mar 2025 15:49 +0000at://did:plc:ezehedsbsukjatzzg7utv6ps/app.bsky.feed.post/3llh6427nt22phttps://bsky.app/profile/j-novikova-nlp.bsky.social/post/3ljng36so4225Following up on my last post - it's time for the big reveal! 🎉 Thrilled to announce that @malikeh97.bsky.social and I are launching a podcast called Women in AI Research! We're excited to bring you inspiring stories from women in AI. Follow @wiair.bsky.social for all the updates #womeninai05 Mar 2025 16:37 +0000at://did:plc:ezehedsbsukjatzzg7utv6ps/app.bsky.feed.post/3ljng36so4225https://bsky.app/profile/j-novikova-nlp.bsky.social/post/3lji5xchmh22zBig announcement coming up! My friend @malikeh97.bsky.social and I have been working on something very special. Can't wait to reveal what we have been up to. Stay tuned for more info! 🚀 #WomenInAI03 Mar 2025 14:29 +0000at://did:plc:ezehedsbsukjatzzg7utv6ps/app.bsky.feed.post/3lji5xchmh22zhttps://bsky.app/profile/j-novikova-nlp.bsky.social/post/3lipepj3imc2fI am not into sports and not a hockey fan. But this time, I am very glad about the outcome of this game. Go Canada! 🇨🇦🇨🇦🇨🇦🏒🎉 [contains quote post or other embedded content]21 Feb 2025 17:53 +0000at://did:plc:ezehedsbsukjatzzg7utv6ps/app.bsky.feed.post/3lipepj3imc2fhttps://bsky.app/profile/j-novikova-nlp.bsky.social/post/3lggbbphkbs2fOur paper is accepted to ICLR! INCLUDE: Evaluating Multilingual LLMs with Regional Knowledge (arxiv.org/abs/2411.19799) A benchmark of ~200k QA pairs across 44 languages, capturing real-world cultural nuances. A collaborative effort led by @cohereforai.bsky.social, with contributors worldwide. /123 Jan 2025 16:07 +0000at://did:plc:ezehedsbsukjatzzg7utv6ps/app.bsky.feed.post/3lggbbphkbs2fhttps://bsky.app/profile/j-novikova-nlp.bsky.social/post/3leukkapqps2kLast month I attended the #NeurIPS2024 conference in Vancouver. Now that I'm home, I'd like to reflect on all the interesting works I encountered at the conference. Part 1 is about multimodal #LLM, next parts coming soon. https://typhoon-mirror-155.notion.site/Multimodal-LLMs-156e74336238808c9c3ed28c6f89f1bf03 Jan 2025 21:40 +0000at://did:plc:ezehedsbsukjatzzg7utv6ps/app.bsky.feed.post/3leukkapqps2khttps://bsky.app/profile/j-novikova-nlp.bsky.social/post/3lesixzyehu2xExcited to co-organize the HEAL workshop at @acm_chi 2025! HEAL addresses the "evaluation crisis" in LLM research and brings HCI and AI experts together to develop human-centered approaches to evaluating and auditing LLMs. 🔗 heal-workshop.github.io #NLProc #LLMeval #LLMsafety03 Jan 2025 02:07 +0000at://did:plc:ezehedsbsukjatzzg7utv6ps/app.bsky.feed.post/3lesixzyehu2x