https://joshuacrowley.com/ – Software Designer. Builds lots of prototypes, mostly web. Sometimes games. Nintendo & Apple tragic. He/him.https://bsky.app/profile/joshuacrowley.comhttps://bsky.app/profile/joshuacrowley.com/post/3liuxaxd6ms2xHi @jesseyuen.bsky.social added you to this handy starter pack, hope that's okay -> go.bsky.app/GXihHDK [contains quote post or other embedded content]23 Feb 2025 23:08 +0000at://did:plc:fjp7grfglf3l5474v4cqrr5b/app.bsky.feed.post/3liuxaxd6ms2xhttps://bsky.app/profile/joshuacrowley.com/post/3letjzjxzv22pMultimodal models like Flash 2.0 and GPT4o can use audio tokens to natively reason over audio input. Neither can yet provide text and audio tokens that come from the same inference pass, and presumably wont ever. So that presents a flaw in these models no one seems to be discussing.03 Jan 2025 11:58 +0000at://did:plc:fjp7grfglf3l5474v4cqrr5b/app.bsky.feed.post/3letjzjxzv22phttps://bsky.app/profile/joshuacrowley.com/post/3lej6lmtkfc2eI don’t know what agentic ai really means for users. I can see how an immediate barrier for deeper LLM experiences is access to user data. So will agents just be for integrating your service into a user’s auth/cloud/filesystem? a crutch for interoperability?30 Dec 2024 09:07 +0000at://did:plc:fjp7grfglf3l5474v4cqrr5b/app.bsky.feed.post/3lej6lmtkfc2ehttps://bsky.app/profile/joshuacrowley.com/post/3ldzsczlzxs25Collaboratively plan all your last minute Christmas todos with your significant other and tinytalkingtodos.com. It's a local-first voice assistant with a focus on privacy and families.24 Dec 2024 06:17 +0000at://did:plc:fjp7grfglf3l5474v4cqrr5b/app.bsky.feed.post/3ldzsczlzxs25https://bsky.app/profile/joshuacrowley.com/post/3ldvgerh2vc2lGemini's Flash 2.0 is great, a true multimodal model I've been waiting for. Just finished upgrading TTT to use the new websocket live api today, just in time for Christmas. Here's a demo of tool callings and it's audio understanding. vimeo.com/1041500694 https://vimeo.com/1041500694?share=copy22 Dec 2024 12:33 +0000at://did:plc:fjp7grfglf3l5474v4cqrr5b/app.bsky.feed.post/3ldvgerh2vc2lhttps://bsky.app/profile/joshuacrowley.com/post/3ldu6plajlc2gI’ll be trying Gemini 2 for code gen soon in my app, specifically to test its visual understanding. I’ve been pretty happy Claude Sonnet 3.5, especially because my current workflow is just to one shot via the users prompt. But excited to see where multiple fast iterations on a workflow gets us.22 Dec 2024 00:43 +0000at://did:plc:fjp7grfglf3l5474v4cqrr5b/app.bsky.feed.post/3ldu6plajlc2ghttps://bsky.app/profile/joshuacrowley.com/post/3ldmjynikb226One nice quality of building an assistant app is you can just ask for mock data to test your features, as you build them. "Can you try and delete a todo with a fake id".18 Dec 2024 23:44 +0000at://did:plc:fjp7grfglf3l5474v4cqrr5b/app.bsky.feed.post/3ldmjynikb226https://bsky.app/profile/joshuacrowley.com/post/3ldespu74us2yMCP has a page explaining how to best configure your LLM so it can pair with you on building out your implementation. First time I’ve seen this for an open source project. https://modelcontextprotocol.io/tutorials/building-mcp-with-llms15 Dec 2024 21:58 +0000at://did:plc:fjp7grfglf3l5474v4cqrr5b/app.bsky.feed.post/3ldespu74us2yhttps://bsky.app/profile/joshuacrowley.com/post/3ld5lsfwsf22nHere's a dev talk I gave on building voice agents in the browser at SydJS. In the talk I try and breakdown the different services you might use, and show how users can BYO keys, for a client based approach. I also demo using OpenAI's realtime websocket approach. https://www.youtube.com/watch?v=b61UaIpUbiE&list=PL4qKegW3WEE7jII3juTcPUPnN_ciohkFC&index=2&t=1026s13 Dec 2024 01:06 +0000at://did:plc:fjp7grfglf3l5474v4cqrr5b/app.bsky.feed.post/3ld5lsfwsf22nhttps://bsky.app/profile/joshuacrowley.com/post/3lbosnzspos2rIs there any up to date advice on tool call responses? Seems like a powerful concept, but unclear how to approach it. Atm I have acknowledgment, action_summary, result and next_steps properties – though I can't recall where I found this props. https://platform.openai.com/docs/guides/function-calling#step-5-provide-the-function-call-result-back-to-the-model24 Nov 2024 10:34 +0000at://did:plc:fjp7grfglf3l5474v4cqrr5b/app.bsky.feed.post/3lbosnzspos2rhttps://bsky.app/profile/joshuacrowley.com/post/3lbdwnrqlok2kI'm building tinytalkingtodos.com a family voice assistant. My partner and I are constantly planning our week on the go. What's for dinner, who's doing pickup? Talkies captures our convos, photos and urls into todos. Talkies creates custom lists, so we always have an answer for "What's next"?20 Nov 2024 02:46 +0000at://did:plc:fjp7grfglf3l5474v4cqrr5b/app.bsky.feed.post/3lbdwnrqlok2k