MIT Students Build AI System That Controls Hand Movements

Software engineering students at the Massachusetts Institute of Technology have developed a wearable device called Human Operator that uses artificial intelligence to guide hand movements through electrical muscle stimulation.

The system combines a vision-language model (VLM), a head-mounted camera, and electrical muscle stimulation (EMS) pads. It analyzes the user's environment and spoken commands, then sends small electrical pulses to specific muscles in the wrist or forearm to produce physical responses.

In demonstrations, the device guided users to wave, play piano notes, and make an “OK” hand gesture.

“We gave AI a body,” the team said. “Human Operator is a human augmentation tool that allows AI to briefly take control of your body to help you learn or do things you cannot do.”

The prototype was built during a 48-hour hackathon, MIT Hard Mode 2026, where it won the Learn Track.