Senior AI Research Scientist (Model-based RL)

Who You Are

Research Scientists at Phaidra lead our efforts in developing novel algorithmic architecture towards the end goal of bringing intelligent control systems to industrial sector.

Having pioneered research in the world's leading academic and industrial labs as PhDs post-docs or professors Research Scientists join Phaidra to work collaboratively within and across research fields.

Drawing on expertise from a variety of disciplines including model-based reinforcement learning planning and optimal control deep learning world models and safe reinforcement learning our Research Scientists are at the forefront of groundbreaking research and applying it to real-world industrial control systems.

Responsibilities

• Design implement and evaluate model-based reinforcement learning agents — including planning-based controllers (MPC MPPI) — and the software prototypes needed to deploy them on real industrial control systems.
• Develop learned dynamics and world models (learned surrogates) that generalize across systems including the training pipelines — pretraining curriculum learning active/adversarial learning and fine-tuning — needed to make them reliable for planning and control.
• Research and implement methods for e.g. safe RL constrained control scenario planning and Bayesian RL to develop agents that satisfy safety constraints during deployment.
• Report and present research findings and developments including status and results clearly and efficiently both internally and externally verbally and in writing.
• Participate in and organize ambitious collaborative research projects and work with external collaborators and partners to translate research into production outcomes.
• Mentor and guide Research Engineers to apply research findings and developments to industrial domains.
• Independently defines new research directions
• Translates research into practical outcomes
• Owns the development and rollout for an entire research area or large project

Key Qualifications

• PhD in a technical field or equivalent practical experience with a strong background in model-based reinforcement learning and demonstrated knowledge in one or more of the following:
  • Planning algorithms
  • World models / learned dynamics surrogates
  • Reinforcement Learning and Deep Learning
  • Control Theory
  • Safe / constrained RL
• Either:
  • 2+ years of research experience in academia or industry after PhD graduation.
  • 5+ years of research experience in academia or industry after Master’s graduation.
• Extensive research in the fields of {ModelBased ModelFree Safe}RL and Control Theory with particular depth in model-based methods.
• Hands-on experience building and evaluating agents against simulators (e.g. differentiable simulators or world models) and closing the sim-to-real gap.
• Share our company values: Collaboration Transparency Operational Excellence Ownership and Empathy

Preferred Skills & Experience

• PhD in machine learning control or a closely related field.
• Deep hands-on experience with model-based RL and planning agents applied to real-world dynamical or industrial systems.
• Strong Python and PyTorch skills including vectorized/differentiable simulators and scaling experiments on distributed compute (e.g.

  Ray Kubernetes GCP).

• A proven track record of publications in RL control or a related area.
• A real passion for AI and applying it to industrial systems to improve resource efficiency.

Our Stack 

• Python
• PyTorch scipy
• Kubernetes Docker Ray
• GCP

Onboarding

In your first 30 days...

• You will be immersed in an onboarding program that introduces you to Phaidra and our product.
• You will spend time in the research team and get introduced to the different tracks of research that we perform.
• You will learn how other teams operate interact and approach problems.
• You will read various parts of our handbook and familiarize yourself with the documentation culture at Phaidra.
• You will set up your development environment and get introduced to various parts of our code base.

By your first 60 days...

• You will have a solid understanding of what Phaidra does and how we do it.
• You will have met with team members across Phaidra and started building relationships that will help you be successful at your job.
• You will have a good understanding of our research tracks which allowed you to form a plan for your first project or maybe you have already started one.

By your first 90 days...

• You will have been fully integrated in the team and with team members across the company.
• You will have started to contribute to knowledge sharing throughout Phaidra.
• Your project is in full swing and you might have some early results already.

 

General Interview Process

All of our interviews are held via Google Meet and an active camera connection is required.

1. Meeting with People Operations team member (30 minutes) 
2. Meeting with Hiring Manager (30 minutes)
3. Meeting with Research team member (60 minutes)
4. Meeting with Hiring Manager (60 minutes)
5. Culture fit interview with Phaidra’s co-founders (30 minutes)

Base Salary

• Tier 1 (London): 96 159 GBP - 132 219 GBP
• Tier 2 (Manchester Birmingham Edinburgh Bristol): 90 502 GBP - 124 441 GBP
• Tier 3 (Smaller cities / rural areas): 84 847 GBP - 116 664 GBP

In addition to base salary this position is eligible for equity. Final salary will be determined based on several factors including a candidate’s qualifications skills competencies experience expertise education and location.

In some cases final compensation may fall outside the posted range.

Salary ranges are regularly reviewed and may be adjusted in response to market trends.