Training robots in simulation.https://bsky.app/profile/ankurhandos.bsky.socialhttps://bsky.app/profile/ankurhandos.bsky.social/post/3lnw2v42quc2bCollaboration with Boston Dynamics on extending our DextrAH-RGB work on their robot. The head movement is deliberate and learned thru training. Each arm has its own independent controller. Which one to invoke when is determined by its proximity to the object. https://www.youtube.com/watch?v=dFObux6mfTc29 Apr 2025 00:52 +0000at://did:plc:o7ttip2vbjaieisx7tuffa65/app.bsky.feed.post/3lnw2v42quc2bhttps://bsky.app/profile/ankurhandos.bsky.social/post/3lm6w7zygfs2qNice substack post that has a funny legend about Brunelleschi and his challenge to make an egg stand on its end. Whoever can make it stand gets to build the dome of santa maria del fiore. https://www.james-lucas.com/p/it-always-seems-impossible-until07 Apr 2025 02:32 +0000at://did:plc:o7ttip2vbjaieisx7tuffa65/app.bsky.feed.post/3lm6w7zygfs2qhttps://bsky.app/profile/ankurhandos.bsky.social/post/3lhur2xyil22tWe have been using "direct" image to action mapping for a while now and the word "direct" took me back to tracking in SLAM. Back in the 90s many people were looking at recovering camera pose directly from the images rather than doing feature tracking first and then recovering homography afterwards. [contains quote post or other embedded content]11 Feb 2025 03:52 +0000at://did:plc:o7ttip2vbjaieisx7tuffa65/app.bsky.feed.post/3lhur2xyil22thttps://bsky.app/profile/ankurhandos.bsky.social/post/3lhsedmmiok2kOur new work has made a big leap moving away from depth based end-to-end to raw rgb pixels based end-to-end. We have two versions: mono and stereo, all trained entirely in simulation (IsaacLab).10 Feb 2025 04:59 +0000at://did:plc:o7ttip2vbjaieisx7tuffa65/app.bsky.feed.post/3lhsedmmiok2khttps://bsky.app/profile/ankurhandos.bsky.social/post/3lehpmw5dy22wLove the AI cartoons here: https://timoelliott.com/blog/cartoons/artificial-intelligence-cartoons29 Dec 2024 19:06 +0000at://did:plc:o7ttip2vbjaieisx7tuffa65/app.bsky.feed.post/3lehpmw5dy22whttps://bsky.app/profile/ankurhandos.bsky.social/post/3lbcyk7enak2mMy workshop talk at CoRL on our work on dexterity that we've been doing for the past 5 years is here https://docs.google.com/presentation/d/1QhJY8Ewa7PEsjr1RwwXsuwGNUEM4w2mhDzOsL0Ch1vo/edit?usp=sharing We have only started to scratch the surface of what we can do with simulations & I hope we can leverage ideas of self-play and alphazero going forward for robotics.19 Nov 2024 17:47 +0000at://did:plc:o7ttip2vbjaieisx7tuffa65/app.bsky.feed.post/3lbcyk7enak2m