Research Scientist, 3D ML, AI & Computer Vision (PhD)

Summary: Meta Reality Labs Research (RL Research) brings together a world-class R&D team of researchers, developers, and engineers with the shared goal of developing AI and AR/VR technology across the spectrum. The Surreal Spatial AI group is seeking exceptional research scientists to build machine perception technology allowing AI agents and systems to perceive and understand the 3D world around them. The aim of this role is to develop, advance and integrate ML and computer vision models and SW systems for advanced, real-time machine perception for egocentric devices such as Meta's Project Aria, including 3D environment and object reconstruction, semantic understanding, estimation and understanding of user motion, actions and activities, and learning of predictive, causal world models for embodied AI agents and egocentric devices.

1. Research, develop and prototype state of the art ML and software technology in the domains of 3D environment and object reconstruction, semantic understanding, estimation and understanding of user motion and more

2. Build/integrate real-time prototypes for advanced, real-time 3D machine perception systems as part of a fast-moving research and research engineering team

3. Collaborate with team members throughout the lifetime of a project, from prototyping to deployed products

4. Deliver research results that have a direct impact on Meta and Meta's AI-enabled products

1. Currently has or is in the process of obtaining a PhD in the field of computer vision, Machine Learning / Artificial Intelligence, robotics or equivalent

2. Track-record of state-of-the-art publications in the field and at top conferences in the field

3. Experienced in advanced 3D computer vision and ML, thorough understanding of 3D geometry fundamentals as well as state of the art ML/AI models incorporate that

4. Mathematical background and understanding of numerical optimization, linear algebra, probabilistic estimation and 3D geometry

5. 5+ years C++ experience with a mastery of modern C++ features

6. 3+ years python experience, including appropriate ML frameworks

7. Interpersonal experience: cross-group and cross-functional collaboration

8. Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment

1. Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences such as CVPR, ECCV/ICCV, ICCP, 3DV, BMVC, or SIGGRAPH.

2. Demonstrated software engineer experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g. GitHub).

3. Broad understanding of the state of the art of ML and AI model architectures and training paradigms.

4. Experience working on real-time, high-performance systems in robotics, AR/VR, or other areas

5. Experience working in a Linux environment.

Industry: Internet