Facebook’s new Moments app scans those images for faces and matches them to your Facebook friends. You can then share the photos, which are grouped by occasion, directly with those people through the app. It’s a neat trick and a fun tool for sharing group photos. It also happens to be a window into Facebook’s ambitious push into artificial intelligence.
Moments app uses facial recognition technology, which was developed by Facebook’s Artificial Intelligence Research (FAIR) lab, a group of 50 researchers led by Yan LeCun, an expert in a type of machine learning called deep learning. Their techniques are being used for voice recognition, natural language processing, and detecting faces and objects in images.
“The one thing we’re missing is actually understanding what we’re showing to people,” said Mike Schroepfer, Facebook’s chief technology officer. If Facebook has a clearer idea of the content and context of posts, then it can create a smarter, more personalized version of your news feed. Some of FAIR’s face detection technology is already being used in Facebook and Instagram’s Layout app.
Facebook’s accessibility group is testing out new ways to use FAIR’s research to help blind users. It’s working on a prototype of a tool generates a text description of what’s in a photo. Someone using a screen reading program could know exactly who and what’s in an image, their location, maybe even their expressions.
“One of the core problems of the modern age is just how much information is out there,” said Schroepfer. “We suffer from this, we can’t actually pay attention to everything because we don’t have the time.” AI could also help eventually automate posts by looking through, say, hundreds of baby photos and identifying the best one. Eventually, Schroepfer sees us talking to Facebook like we do Siri, asking casual questions like “What’s going on with my grandkids this week?” AI will be crucial for developments like this.
Artificial intelligence is one of the next major battlefields for technology companies. Google, Microsoft, Apple and China’s Baidu are investing heavily in AI labs, and they are snatching up some of the best academic minds in the field. Facebook just opened a new Paris office in June. AI is one of Facebook’s three big long-term technology bets. The company is also investing in virtual reality with Oculus and is developing technology to bring Internet to underserved communities around the world.
Some of the features in Facebook’s Moments app are similar to Google’s new Photos App, which was launched last month. Google has face recognition, but also uses impressive image recognition tools to search photos by keywords. Another difference is that Google has been careful to avoid the phrase “artificial intelligence” when describing Google Photos reports CNN Money.