Connecting AI research & Applied AI since 2018 | Previously: ML, NLP, RecSys | Now: GenAI, LLMs, RAG | Natural science, tech and climbing is my thing.https://bsky.app/profile/marcoher.bsky.socialhttps://bsky.app/profile/marcoher.bsky.social/post/3lcpvbcbmn22iI’ve tested the new llama 3.3 70b 🦙 and the instruction following so far is magnifique. 👌07 Dec 2024 14:18 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lcpvbcbmn22ihttps://bsky.app/profile/marcoher.bsky.social/post/3lcmw5htzms2nIf you are a leader, you shouldn't ignore this paper from MIT for your business and your workforce. This research from a large U.S. firm's R&D department shows real-world effects of AI — positive and negative. These findings can be adopted by other businesses and departments as well. 🧵 #AI #ML06 Dec 2024 09:56 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lcmw5htzms2nhttps://bsky.app/profile/marcoher.bsky.social/post/3lcilcbjgls2bTencent open sourced this, Impressive! But I think we need to start talking about AI generated content detection on social media more seriously … This open source is 🤯 More content with other capabilities in 🧵 aivideo.hunyuan.tencent.com04 Dec 2024 16:31 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lcilcbjgls2bhttps://bsky.app/profile/marcoher.bsky.social/post/3lcijy2mobs2bThis essay from DeepMind is something you shouldn't miss, it made me very excited about the future of science. A new golden age of discovery Seizing the AI for Science opportunity https://deepmind.google/public-policy/ai-for-science/ #AI #ML #Science04 Dec 2024 16:07 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lcijy2mobs2bhttps://bsky.app/profile/marcoher.bsky.social/post/3lcgieco6pk22If this is not telling an interesting story, than what does? Accenture makes more money with GenAI than OpenAI. GenAI revenue: OpenAI: $3.4bn Accenture: $3.7bn I’m still thinking what that means…03 Dec 2024 20:33 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lcgieco6pk22https://bsky.app/profile/marcoher.bsky.social/post/3lcggtgxdkc22Unveiling the true inspiration behind the ‘attention’ operator in Transformers! From Bahdanau’s emails to Karpathy, we learn how attention transformed neural networks. Surprising that ‘Attention is All You Need’ outshines its predecessor by Bahdanau et al. #AI #ML #Transformers03 Dec 2024 20:06 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lcggtgxdkc22https://bsky.app/profile/marcoher.bsky.social/post/3lc3oy2lgvc23By far the best visualization and walkthrough of a Transformer I've ever seen. You can explore the algorithm down to every add & multiply, seeing the whole process in action. With animation and explanation. That was definitely created with a lot of passion and work. By Brendan Bycroft. #AI #LLM #LM29 Nov 2024 13:32 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lc3oy2lgvc23https://bsky.app/profile/marcoher.bsky.social/post/3lbzvla22es2tA new update on the AI feed. The feed now has 66 unique negative filters. They remove any form of AI art. There are 186 filters that are filtering content related to the sphere of AI. https://bsky.app/profile/did:plc:yner3io2th57ilpj5xdcldt2/feed/aaafbfpnhnvfk #AI #LLM #ML [contains quote post or other embedded content]28 Nov 2024 20:25 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lbzvla22es2thttps://bsky.app/profile/marcoher.bsky.social/post/3lbztql3r7k27@bsky.app Impression stats are really missing. Not necessarily visible for everyone on the post, but at least for the post creator. 1. To know how big the audience really is 2. To see the actual quality of post (engagement/Impressions)28 Nov 2024 19:52 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lbztql3r7k27https://bsky.app/profile/marcoher.bsky.social/post/3lbytymj2ds2rDo you want to see the new Anthropic Model Context Protocol in action? It was announced just 3 d ago, and we already see great apps. This time build by Alec Velikanov. Take this project as an example to build something yourself. I'm off, need to cook 7 courses with the stuff Claude ordered. #AI28 Nov 2024 10:24 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lbytymj2ds2rhttps://bsky.app/profile/marcoher.bsky.social/post/3lbxoq6sf6k2sWhat can we do about the benchmark fatigue for #LLM? More people I speak to don’t take them seriously anymore, and I can’t blame them. I still hesitate, but I’m about to drop them as well. I think we need something new for #AI eval. Or is there something I’m not aware of?27 Nov 2024 23:17 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lbxoq6sf6k2shttps://bsky.app/profile/marcoher.bsky.social/post/3lbwwzjkuj223I've updated the filters for the AI feed. Using 186 filters in total now. Feel free to ping me if you want the filter list. https://bsky.app/profile/did:plc:yner3io2th57ilpj5xdcldt2/feed/aaafbfpnhnvfk #AI #LLM #ML [contains quote post or other embedded content]27 Nov 2024 16:13 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lbwwzjkuj223https://bsky.app/profile/marcoher.bsky.social/post/3lbwvk6kqas2uOnce moving away from naive RAG, chunking becomes pretty important. I use semantic chunking with BERT, and I'm quite happy with it. I didn't use this, but looks promising. Quite handy if you don't use bigger libs like Haystack, LangChain, LLamaIndex etc. https://github.com/bhavnicksm/chonkie?tab=readme-ov-file #LLM #RAG #AI27 Nov 2024 15:46 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lbwvk6kqas2uhttps://bsky.app/profile/marcoher.bsky.social/post/3lbwrqesqe22hI used to think #LLM were just fancy next-token parrots. Turns out they’re secretly doing math. The end of Scaling laws? Surprise! Your #AI can now do symbolic reasoning. I can't be more thrilled to let it do my taxes. https://arxiv.org/html/2407.11421v1 Hopefully it doesn't think in these symbols:27 Nov 2024 14:38 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lbwrqesqe22hhttps://bsky.app/profile/marcoher.bsky.social/post/3lbrxjlgcrs2fI had a talk with Elena Samuylova from Evidently AI and she was super helpful. Evidently is an open-source framework to evaluate, test and monitor ML and LLM-powered systems. Does anyone have experience with it in prod env or an opinion on other eval tools?25 Nov 2024 16:39 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lbrxjlgcrs2fhttps://bsky.app/profile/marcoher.bsky.social/post/3lbpytmz6cs2uAn AI starter pack to get quickly into the community by following the most active members. The goal is to get meaningful content fast and engage with the community. Please tag very active members in the comments to add them into the list. go.bsky.app/CanJ3xW #AI #ML #starterPack [contains quote post or other embedded content]24 Nov 2024 21:57 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lbpytmz6cs2uhttps://bsky.app/profile/marcoher.bsky.social/post/3lboxuihf222dI like his brutal honesty. 😆 "...in my opinion there's like 5% of an idea and then 95% is like smoke and mirrors trying to couch things in modern words that have already existed for a long time, and they're fundamentally nothing new. I don't want to be too harsh..." https://www.youtube.com/watch?v=gfU5y7qCxF024 Nov 2024 12:07 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lboxuihf222dhttps://bsky.app/profile/marcoher.bsky.social/post/3lbn7aqg65k2dQuite an unusual benchmark. RE-Bench tests AI Agents against human experts in ML research tasks. Key findings: • AI shines in sprints up to 4 h • Humans lead in longer projects • Sonnet 3.5 and o1-prev do substantially better than humans given 2 h • Human improvement is much steeper #AI #ML23 Nov 2024 19:14 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lbn7aqg65k2dhttps://bsky.app/profile/marcoher.bsky.social/post/3lbmymegldg2dNavigating Bluesky's content curation tools 🧭 • Lists: Organize accounts • Moderated Lists: Tighter content control • Starter Packs: Onboard new users (max 150) • Feeds: Custom algorithmic timelines I was lost at first, but here's what I learned! 🧵👇23 Nov 2024 17:15 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lbmymegldg2dhttps://bsky.app/profile/marcoher.bsky.social/post/3lblpono6ac2xActually, an interesting thought for generalization in AI. It seems there is a connection between spacial location and latent context similarly to influence decision-making, despite the task being non-spatial, at least in the hippocampus. Is not Fei-Fei Li currently working on something similar? [contains quote post or other embedded content]23 Nov 2024 05:02 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lblpono6ac2xhttps://bsky.app/profile/marcoher.bsky.social/post/3lblphdwsfc25Feel free to ping me, if I haven't added you to the RAG - Retrieval Augmented Generation starter pack yet. go.bsky.app/PUts9PH [contains quote post or other embedded content]23 Nov 2024 04:58 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lblphdwsfc25https://bsky.app/profile/marcoher.bsky.social/post/3lblpfqinn225Feel free to ping me, if I haven't added you to the AI Agents starter pack yet. Enjoy the community. go.bsky.app/U8M5Rk6 [contains quote post or other embedded content]23 Nov 2024 04:57 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lblpfqinn225https://bsky.app/profile/marcoher.bsky.social/post/3lbidqpops22h🔬 𝗔𝗜 𝗔𝗧 𝗪𝗢𝗥𝗞 — 𝗘𝗻𝗵𝗮𝗻𝗰𝗶𝗻𝗴 𝗘𝗳𝗳𝗶𝗰𝗶𝗲𝗻𝗰𝘆, 𝗗𝗶𝗺𝗶𝗻𝗶𝘀𝗵𝗶𝗻𝗴 𝗦𝗮𝘁𝗶𝘀𝗳𝗮𝗰𝘁𝗶𝗼𝗻 New MIT study. The numbers tell a striking story: • Overall 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝘃𝗶𝘁𝘆 ⬆️ 𝟰𝟰% • Patent filings ⬆️ 39% • BUT 𝗷𝗼𝗯 𝘀𝗮𝘁𝗶𝘀𝗳𝗮𝗰𝘁𝗶𝗼𝗻 ⬇ 𝗳𝗼𝗿 𝟴𝟮% Here's the twist: • Top performers: 𝗣𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝘃𝗶𝘁𝘆 𝘀𝘂𝗿𝗴𝗲 ⬆️ 𝟴𝟭% • Bottom third: Minimal gains21 Nov 2024 20:51 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lbidqpops22hhttps://bsky.app/profile/marcoher.bsky.social/post/3lbi6t3rlwc26@bsky.app Seems like you are getting momentum. Congrats! Feels like a lot of excitement and genuine interactions are shared here. Would you mind sharing any features and other plans users can expect for the future?21 Nov 2024 19:23 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lbi6t3rlwc26https://bsky.app/profile/marcoher.bsky.social/post/3lbi5fylbws24So Jack changed from 🐤 to 🦋. So we don't tweet anymore, but… click?21 Nov 2024 18:57 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lbi5fylbws24https://bsky.app/profile/marcoher.bsky.social/post/3lbhoopgo5d2mI've created a list of 𝗟𝗟𝗠 𝗹𝗲𝗮𝗱𝗲𝗿𝗯𝗼𝗮𝗿𝗱𝘀. 🕶️ Share it, grow it, enjoy it! Link to the GitHub page: https://github.com/git-git-hurrah/awesome-llm-leaderboards21 Nov 2024 14:34 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lbhoopgo5d2mhttps://bsky.app/profile/marcoher.bsky.social/post/3lbhokwormc2mYou heard about DSPy? Let's talk TextGrad. The upgraded version in AI optimization. I've been diving into TextGrad lately, and I thought I'd share some insights. It's a Python framework from Stanford that's making waves in AI optimization. Here's the lowdown: 🧵21 Nov 2024 14:32 +0000at://did:plc:yner3io2th57ilpj5xdcldt2/app.bsky.feed.post/3lbhokwormc2m