Brainwave-Trained Robots: Why China and the U.S. Are All In

Opening

Dear reader, a fascinating scene recently came out of a research lab in China. Researchers fitted a brainwave-measuring helmet on people’s heads and recorded, in real time, the electrical signals coming from their brains as they folded laundry, picked up a coffee pot, and organized objects. Then they fed that data to a robot.

This is a completely different approach from the conventional method of “teaching robots the laws of physics.” Instead, it extracts a human veteran’s know-how itself as electrical signals and transplants it into a robot. Academically, this is called BCI (Brain-Computer Interface)¹-based robot training.

But this raises a question. If this technology really works, what should we give the person who lent their brain? Today, let’s talk about the substance of this technology—and the uncomfortable questions it raises.

How Brainwaves Teach Robots

Let’s start with the scientific background. The core principle is more intuitive than you’d think.

When a person watches a robot’s actions and the robot makes a mistake, a specific electrical signal fires unconsciously in the brain. This is called ErrP (Error-Related Potential)², a distinctive waveform that appears in the frontocentral region (near the forehead) about 200–400 milliseconds after the mistake is perceived. Put simply, it’s the brain unconsciously reacting, “ah, that’s wrong.”

Researchers discovered that this “brain wince” can be used as a reward signal for robot reinforcement learning³. Instead of a person manually inputting “correct/incorrect” for every action, the brain automatically provides feedback just by watching.

The foundational study in this field is a 2017 paper from Germany’s DFKI research institute, published in Scientific Reports. Using only error signals measured via EEG⁴, this team succeeded in getting a robot to learn gesture-action mapping, achieving 91% single-trial error detection accuracy.

In 2020, Akinola and colleagues at Columbia University took it a step further. They showed that as long as BCI feedback accuracy exceeds 60%, brain-signal-based learning performs comparably to a reward function manually designed by humans. In other words, a robot can learn just by being watched, without a person coding complex rules.

In 2023, Germany’s Fraunhofer Institute achieved an important practical breakthrough. They confirmed that meaningful learning effects still occur with dry EEG headsets, instead of the cumbersome wet electrodes that require gel. This opened up the possibility of moving beyond the lab and onto the factory floor.