ByteDance Unveils AI Brain for Robot Assistance in Daily Tasks

The TikTok-owning company ByteDance has unveiled a system that serves as the “brain” for robots, enabling them to perform everyday tasks such as hanging up clothes or clearing off tables.

GR-3 is an advanced language model that integrates vision and language with action, allowing robots to understand natural language commands and tackle a variety of tasks involving unfamiliar objects. These robots can adapt to new environments and handle abstract concepts related to size and spatial relationships.

In a video shared on the company’s website, a dual-arm laboratory robot named ByteMini is shown placing a hanger into a shirt and hanging it on a rack.

A separate technical report indicated that the robot is capable of managing short-sleeved garments, even though “all items in the training data were long-sleeved.”

With the GR-3 system, the robot can follow commands to select a specific item from a group and position it in a designated location.

The system can recognize objects not just by their name but also by attributes such as size (for example, «large plate») or spatial descriptors (like «to the left»). It can fully execute the task of “clearing the dining table” with a single command.

To train the model, ByteDance employed a multi-faceted approach, including:

“We hope that GR-3 will be a significant step toward developing versatile robots that can assist people in their daily lives,” the team stated.

It’s worth noting that in January, the startup Perplexity AI announced its intention to acquire TikTok in the United States, proposing a merger of Perplexity, TikTok U.S., and new capital partners into a single legal entity.