🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
-
Updated
Mar 5, 2024 - Python
🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
UnrealCV: Connecting Computer Vision to Unreal Engine
A library for differentiable nonlinear optimization
Dataflow-Oriented Robotic Application is middleware that streamlines and simplifies the creation of AI-based robotic applications with low latency, composable, and distributed dataflow.
Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...
This is a curated list of "Embodied AI or robot with Large Language Models" research. Watch this repository for the latest updates!
Unified Reinforcement Learning Framework
SAPIEN Manipulation Skill Framework, a GPU parallelized robotics simulator and benchmark
VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models
[Incl. GenAD, CVPR 2024 Highlight] Embracing Foundation Models into Autonomous Agent and System
🏘️ Scaling Embodied AI by Procedurally Generating Interactive 3D Houses
Official Code for "Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents"
A universal summary of current robotics simulators
[TPAMI 2024] Official repo of "ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environments"
[ICCV 2023} Official repo of "BEVBert: Multimodal Map Pre-training for Language-guided Navigation"
Open Platform for Embodied Agents
A curated list of awesome papers on Embodied AI and related research/industry-driven resources.
Official Github repository for "Renderable Neural Radiance Map for Visual Navigation". (CVPR 2023)
ManipulaTHOR, a framework that facilitates visual manipulation of objects using a robotic arm
[ACM MM 2021 Oral] Official repo of "Neighbor-view Enhanced Model for Vision and Language Navigation"
Add a description, image, and links to the embodied-ai topic page so that developers can more easily learn about it.
To associate your repository with the embodied-ai topic, visit your repo's landing page and select "manage topics."