Hello Robot’s Stretch AI toolkit explores embodied intelligence

By Mike Oitzman | December 6, 2024

Hello Robot released an open-source collection of tools, tutorials, and reference code called Stretch AI that empowers developers to explore the future of embodied AI on the Stretch 3 mobile manipulator. Stretch 3, released in February 2024, is gaining traction with university labs as a both a platform for research about AI research and real-world deployments.

This comes on the heels of the advancement of robot utility models as a precursor for embodied AI capabilities. Available policies include ACT, VQ-BeT, and Diffusion Policy.

Stretch AI is a powerful toolkit designed to empower researchers and developers to create intelligent behaviors for the Stretch 3 mobile manipulator. This platform offers a range of capabilities, including:

• Code for precise grasping and manipulation
• Advanced mapping and navigation techniques
• Integration with LLM agents for sophisticated decision-making, seamless text-to-speech and speech-to-text functionality
• Robust visualization and debugging tools to streamline development and testing processes.

Stretch AI integrates open-source AI models, allowing it to accomplish home tasks with natural verbal requests such as “Stretch, pick up the toy, and put it in the bin.” There is a dedicated GitHub repo for Stretch AI.

“With Stretch AI, we wanted to open up access to the latest Embodied AI techniques and make them available to the fast-growing community of Stretch developers,” said Chris Paxton, senior embodied AI lead at Hello Robot. “We’re moving towards a world where robots can perform complex, multi-step tasks in homes. Stretch AI advances the ability to simply develop autonomous systems such as these using AI.”

Register now

Taking AI from labs to living rooms

“Thanks to advances in AI, general-purpose home robots like Stretch are developing faster than expected,” said Hello Robot CEO Aaron Edsinger. “However, it is uncommon to see these robots actually working in real homes with real people. With Stretch AI, roboticists can take their work from the lab and begin developing real applications for realistic home settings.”

Stretch AI offers a distinct vision of the future in which AI-powered robots benefit everyone, including older adults, children, and people with disabilities. “Homes are an inclusive place. To truly succeed in homes, robots, and the AI that powers them, should be made for everyone,” said Edsinger.

Hello Robot said its Stretch mobile manipulator is used by developers in 20 countries, from leading universities to innovative companies. With Stretch AI, Hello Robot invites the research community to collaborate on shaping the future of embodied intelligence.

The Stretch 3 is priced at $24,950 and is available on Hello Robot’s website.