Facebook Postdoctoral Research Scientist, Real-Time Multi-Sensor Integration in Pittsburgh, Pennsylvania


Oculus Research Pittsburgh is looking for talented researchers to accelerate the progression to authentic social presence in virtual reality. In our current pipeline, a multitude of sensing components, including image sensors, microphones, inertial measurement units, and bio-potential sensors, are installed on the headset prototypes in order to collect a rich suite of information that reflects the user's state. By developing state-of-the-art algorithms that jointly extract information from these signals, we intend to create a real-time 3D representation of the user (an avatar) that authentically represents the user's behavior (gaze, expression, face/head/body movement) with near-zero latency. The position is a fixed term contract for 24 months and requires a PhD in computer science, robotics, computer engineering, or similar areas, and a strong background in modeling, analysis, and system building, who will develop and implement innovative algorithms and systems that integrate the multiple sensing modalities (especially bio-potential signals) to render the realistic authentic avatars in real time.

Required Skills:

  1. Develop and implement algorithms and software that combine different sensing modalities in real-time.

  2. Collaborate with other researchers and engineers to develop sophisticated machine learning models that leverage different modalities to achieve good performance with minimal delay and power consumption.

  3. Conduct cutting the edge research to model the dynamics of human behavior (e.g. gaze and facial movement) and relate multi-model sensor inputs to the dynamics.

  4. Work with the team to help design, setup, and run user study experiments to collect data and evaluate built systems.

  5. Produce publications in peer-reviewed international conferences and journals.

Minimum Qualifications:

  1. PhD and/or postdoctoral assignment in the field of Computer Science, Robotics, Bio-Robotics, Computer Engineering, Machine learning or related field.

  2. Experience building real-time systems in C/C++.

  3. Experience with ARM Cortex-Mx processors, MCUs, and low power SoCs.

  4. Experience with standard hardware protocols (USB, UART, SPI, I2C, I2S, PCIe, MIPI, HDMI, DDR).

  5. Problem solving experience.

  6. Knowledge with function generators, scopes and logic analyzers.

  7. Hands-on experience with prototyping and debugging techniques.

Preferred Qualifications:

  1. Hands-on experience in developing for embedded systems.

  2. 1+ years experience with wearable real-time systems and multiple sensing modalities.

  3. 1+ years experience with system building, including systematic evaluation design.

  4. Knowledge and experience on machine learning, especially deep learning and reinforcement learning.

  5. Track record of achieving significant results.

  6. Interpersonal skills - cross-group and cross-culture collaboration.

  7. 1+ years programming FPGAs in verilog or VHLD.

Industry: Internet

Equal Opportunity: Facebook is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. If you need assistance or an accommodation due to a disability, you may contact us at accommodations-ext@fb.com or you may call us at +1 650-308-7837.