Intentions are good, but what if the device was capable of harm?
Researchers at the Computer Science and Artificial Intelligence Laboratory (CSAIL) at the Massachusetts Institute of Technology (MIT) created an artificial intelligence software called RF-Pose that can see you through walls. Other systems using wireless technology also detect human movement through walls, but their images are grainy.
They either identify only one limb at a time, or give us a static and fuzzy image of the body. According to the experiment of Zao and team, any one of us can walk around a room and an AI camera located in another room will “peek” through the dividing wall and photograph our precise movements in 2D representation. Even if I turn off the lights and draw down the blinds, the AI device still captures my movements as though it were day.
The Tech Behind RF-Pose
The system uses radio waves which bounce off human bodies and pass through walls. The image appears as a fluorescent skeletal figure or as a stick figure made off fuzzy dotted blue and yellow specks. It’s possible I can hide my actual identity, but there’s no hiding my movement. Even through a 40mm thick wall (which is quite thick), even if I ducked into a cupboard or hid behind a chair, this AI’s sharp eyes can pierce through that dividing wall and see me as though the wall were glass.
This process is called a deep learning neural network, where the researchers fed the computer with thousands of radio wave profiles and images corresponding to hundreds and thousands of postures like sitting, walking, or opening a door. In time, the Artificial Intelligence learned to associate any particular radio signal with a certain movement. Once trained, the AI algorithm worked only from radio waves, just as surveillance machines do when photographing people walking through security barriers.
Describing the Study
The team of seven researchers, Zao, Li, Alsheikh, Tian, Zhao , Torralba, and Katabi, described their pilot tests in an open-access paper.
For each setting, the team trained a special computer trained to identify images and fed it 50 consecutive frames of skeleton heatmaps (each of these frames had numerous photographs of different postures). At the end, the researchers found that the AI accurately identified movement 83.4% of the time in visible scenes, where light was on. This occurs “even when a wall blocked the device and our pose extractor never saw these people and such environments during training.”
The researchers say they’re planning to create 3D images to tone in on finer moments like squatting, sitting, crawling, and even tremors in an elderly person.
The Louis Story
This reminds me of the story captured by a painting done by Napoleon’s second wife, Marie Louise, that I saw just this week in the Virginia Museum of Fine Arts. Louis XIV was extremely sharp-sighted. While visiting one of his mistresses, he lunched by her: candied fruit, wine, some oysters, a rice salad.
Suddenly, he took up a hard-boiled egg, bent down and proffered it to a man hidden by screens under his mistress’ bed. “That person,” he said, “is probably hungry, too.” Those AI are programmed to see people hiding under even more opaque constructions such as in cupboards, under floorboards, and so forth. There’s little way to hide from the RF-Pose AI.
What’s the Purpose?
The researchers plan to use the device for altruistic motives, like helping rescuers find victims under rubble after an earthquake or helping caregivers “peek” in on people in advanced dementia or other states of serious illnesses (like Parkinson’s disease, multiple sclerosis or muscular dystrophy).
Katabi and her team say they want to help elderly people live independently by preventing falls.
What about if this gets out of control, however, and we use it for spying on individuals, in any and all situations, without them knowing? Wouldn’t an unscrupulous government just love such a device? And how can we prevent such a government or others from spying on us? So how do we put controls in place?