The easiest way to interact with robots
Instructing robots via natural language
PickGPT is the first commercially-available robotics transformer that enables robots to understand natural language and perceive their environment with an unprecedented level of intelligence and accuracy.
Intuitive operation
PickGPT can be used via natural language, allowing instructing and programming robots without prior knowledge.
Exceptional scene understanding
Based on synthetic and real-world experience, PickGPT can adapt effortlessly to unseen environments.
Zero-shot planning
PickGPT captures the scope and context of a task and can also solve implicit problems.
Reaching the next level of intelligent robotics
Unlike traditional models, PickGPT utilizes zero-shot planning, which enables it to calculate and execute sequences of actions to achieve a target state even in complex, dynamic and unstructured environments without prior specific training.
Grasping previously unseen objects
PickGPT's capabilities stem from its comprehensive training on web-scale datasets, combined with synthetic and real-world robotics data. This extensive and diverse training not only enhances its scene understanding, but also enables it to generalize to new and previously unseen objects.
Converting Words into Actions
PickGPT fuses multimodal sensor data (RGB, depth and other) and injects them into a Large Language Model, combined with natural language instructions from a human operator or higher-level system. By analyzing this data using segmentation, scene decomposition and sequencing, PickGPT can understand the overall meaning, generate responses and execute decisions by a robot.
Exceptional robot performance with user-friendly operation
PickGPT provides a new way of communicating with robots, which offers unbridled potential for a wide variety of fields. In logistics, in particular, PickGPT enables robots to solve key problems.
Simplifying robot interaction
PickGPT supports seamless communication between human operators and AI-enabled robots, allowing workers to instruct robots through voice commands and an intuitive interface. This enables seamless interfacing with other warehouse systems and allows the instructor to define pick points and blacklist items easily.
Enables vision-language picking
PickGPT allows robots to recognize and identify objects and products in real-time based on visual appearance alone. It automatically analyzes product images and matches them to items in any real-world scenario. PickGPT fully understands and interprets product titles, descriptions, and other textual information to automatically identify corresponding products and correlate regions in an image.
Distinguishing between objects
The ability to automatically recognize certain objects offers unbridled potential, especially in logistics. PickGPT can revolutionize returns handling, for example, by enabling the transformer to distinguish packaging materials from products and sort them out. In addition, PickGPT provides additional quality control by detecting damaged items.
Read our manifesto and discover more about the technological background of PickGPT.
Learn more
