About the role:
The Capability Performance Team is responsible for owning the Systems Engineering for Behavioral Competencies (also called as AV Capabilities) for the Motional ADS. The team sets up behavioral expectations for the Motional ADS and uses a Multimodal Testing (Simulation, Resimulation, Closed Course, Public Road) approach to evaluate the AV performance against the set expectation.
As the team is growing to support more and more behavioral competencies, we are looking for an Senior System Engineer to help build a robust framework to establish performance thresholds for AV capabilities. These performance thresholds play a key role in evaluating AV behavioral performance and help guide developments in right areas. This person will get to build relationships with the team as well cross-functional across organization to help build a cohesive understanding AV performance as applicable to the Behavioral Competencies.
What you will work on:
- Propose behavioral expectations on AV capabilities
- Support standardization of metrics used in performance evaluation for AV Capabilities to ensure consistency
- Effectively utilize existing metrics and propose the need for new metrics to evaluate AV performance in large scale simulation testing
- Propose soft/hard targets for metrics using statistical methods and back them up with driving data
- Characterize the performance target against parameters used to define AV capabilities to provide nuance in performance evaluation
- Propose and implement ideas to analyze simulation, resimulation, public road and closed course testing results for stakeholders in Systems, Autonomy, Safety etc.
- Deliver strategic insights and recommendations based on AV capability testing by building meaningful visualizations
- Focus on automating simulation result analysis processes and gaps, removing manual processes where applicable
- Support the development, execution, and analyses of scenario simulation test cases for features validation
- Communicate test results to development teams and management and facilitate the resolving of technical issues
Minimum requirement on Education and experience
- MS in Computer Science, Robotics, Electrical Engineering, Physics, or a related field with 3 years of experience in owning the technical responsibility over a complex system preferably a perception or localization/SLAM sub-system
- Or BS in Engineering with 5 years of experience in owning the technical responsibility over a complex system preferably a perception or localization/SLAM sub-system
Skills required:
- Bachelor's degree and 2 years of experience in Data Science, Statistics or Computer Science OR equivalent experience in data science in relevant industry
- Experience in evaluating Autonomous Driving Behavior
- Fluency in SQL or similar languages
- Fluency in data visualization techniques
- Python coding experience
- Excellent interpersonal skills to build relationships with other teams
- Excellent communication skills; effective in communicating complex concepts and driving resolutions
- Self-starter who is motivated to set and achieve goals and takes initiative to drive ambiguous tasks/projects to completion
Bonus points:
- Masters degree in Data Science or Computer Science
- Experience in Autonomous Vehicles or other robotics industries
- Experience using simulation tools