Facebook AR Platform

First Gen Product Features

AR Sticker & Face Masks

Before AR Kit (Apple) and AR Core (Google) were launched, I helped develop and launch the first AR experiences on Facebook. Our team’s mission was to enable creative expression and conversation using a core set of existing technologies, and to develop the next generation of those technologies. My work led to new patented AR features and technologies used across Instagram, Facebook and Messenger.  

Point Tracking

Combining a simple 2D tracking algorithm with gyro data allows placement of AR objects quickly without impacting device performance. A first at Facebook, my Point Tracking prototype (animation hand drawn by my colleague) demonstrated to our team that we could create AR apps without SLAM. This work lead to the launch of Point Tracking, a widely used AR feature.

Plane Tracking

Placing AR objects on flat surfaces was made possible by combining multiple computer vision algorithms. This prototype demonstrated the power and ease of use of this approach which was later patented and launched in Instagram, Messenger and Facebook.