• AI Journal
  • Posts
  • Facebook Is Researching AI Systems That See, Hear, and Remember Everything You Do

Facebook Is Researching AI Systems That See, Hear, and Remember Everything You Do

October 15, 2021

Facebook is pouring a lot of time and money into augmented reality, including building its own AR glasses with Ray-Ban. Right now these gadgets can only record footage for other people who have them - but what does the company think such devices will be used for in five or ten years?

To help people live better lives, Facebook's AI researchers have created a series of skills that they want these artificial intelligence systems to develop. These include "episodic memory" (answering questions like "where did I leave my keys?") and audio-visual diarization - recording everything you see or hear for future reference.

Facebook's new AR glasses are set to be a major privacy concern for some, as they could allow their wearers to covertly record members of the public. The worry may only increase when future versions not only film footage but analyze and transcribe it too, turning people into walking surveillance machines.

The dataset is the biggest of its kind, and Facebook partnered with 13 universities around to collect data. In total 3205 hours were recorded by 855 participants living in nine different countries who took part in this revolutionary study on how people interact online video content across social networks like YouTube or Twitter. The university rather than Facebook was responsible for collecting all these videos - you could say they are boon masters at snooping.

Participants, some of whom were paid, wore GoPro cameras and AR glasses to record videos of the unscripted activity. This ranges from construction work to baking to playing with pets and socializing with friends. All footage was de-identified by the universities, which included blurring the faces of bystanders and removing any personally identifiable information.

Hottest tweets about this topic:

Learn more about this topic here:

To build the metaverse, Facebook needs us to get used to smart glasses.

The Facebook glasses, starting at $299, let users take photos and video, listen to music and answer phone calls.

We're launching Ray-Ban Stories, our first-generation smart glasses that let you capture photos and videos, take phone calls and listen to music.