Avatar for May Mobility
May Mobility uses technology to create a better, cleaner and more accessible way to get around
  • B2C
  • B2B
  • Scale Stage
    Rapidly increasing operations
  • +4

Lead Machine Learning Engineer - Perception

Posted: 3 weeks ago
Job Location
Remote Work Policy

In office - WFH flexibility

Visa Sponsorship

Not Available

RelocationAllowed
Skills
Python
Data Mining
Computer Vision
Optimization
Linux
Classification
Deployment
Sensor Fusion
Segmentation
WorkFlows
Object Detection
TensorFlow
PyTorch
C/C++
Testing frameworks
Data Pipeline
Semantic Scene Understanding
Contrastive Learning
Prompt Engineering
LLMs
Foundation Models
VLMs
Multi-Modal Models
Multi-Target Tracking
Data Balancing
Open-Vocabulary Detection
Data-Driven Performance Improvement
Scene/scenario Detection
Perception Robustness in Degraded or Adverse-Weather Conditions
Multi-Sensor Fusion Models
VLM Backbones
ML Development Cycle

About the job

Job SummaryMay Mobility is entering an exciting phase of growth as we expand our first-of-its-kind autonomous shuttle and mobility services across the nation. Launched in 2017 with a strong team of experienced roboticists and software engineers with decades of experience fielding robotic systems in the wild, May Mobility is looking to expand its team of robotics engineers with a background in robotics or autonomous vehicles.As Perception Lead, you will own the technical direction of how our vehicles see and interpret the world. This is a hands-on role focused on three priorities: advancing scene detection so the system reliably recognizes its operating context and engages the right behavior; hardening perception against sensor degradation and adverse weather (rain, snow, fog, glare, low light, and sensor soiling or occlusion) so performance degrades gracefully and safely; and driving major architectural updates to evolve our perception stack into a scalable, maintainable, production-grade foundation. You will set the technical bar, mentor engineers, and deliver capabilities that operate safely in the real world.Essential ResponsibilitiesWork independently with cross-functional teams to develop software and system requirements.Lead major architectural updates to the perception stack, including system-level design, modularization, and migration strategies that improve scalability, latency, and maintainability across the fleet.Design, develop, and own scene detection and activation capabilities, classifying the operating scene/scenario and triggering the appropriate perception behaviors and operational design domain (ODD) logic at runtime.Improve perception robustness under degradation and adverse weather, including sensor fault detection, health monitoring, graceful degradation, and fallback strategies for rain, snow, fog, glare, low-light, and sensor soiling/occlusion conditions.Design, implement, and test state-of-the-art perception features on time with high quality, industrial-grade production code.Integrate large-scale multi-modal models (including but not limited to VLMs and LLMs) into the perception stack to improve semantic scene understanding and reasoning.Track and trend technical performance of perception in the field.Lead major feature development including feature design, code reviews, issue diagnosis, and resolution.Lead extensive testing to validate features and satisfy release schedules.Lead development related to data, development, and ML pipelines, specifically focused on multimodal data alignment for training foundation models.Skills and AbilitiesSuccess in this role typically requires the following competencies:Proven ability to architect and evolve large-scale perception or autonomy systems, balancing performance, latency, safety, and long-term maintainability.Strong grasp of perception robustness and reliability engineering, including degraded-sensor operation, adverse-weather handling, fault detection, and graceful degradation.Experience with scene/scenario understanding and runtime activation logic (e.g., context classification, ODD monitoring, behavior triggering).Familiar with ML development cycle, deployment, and optimization.Deep understanding of data: data pipeline, data balancing, data mining, and data-driven performance improvement.Knowledge of multimodal learning techniques, including contrastive learning and prompt engineering for zero-shot visual recognition.Deep understanding of testing frameworks and workflows.Excellent attention to detail and rigorous testing methodology.Exceptional written and verbal communication skills and team-leading abilities.Qualifications and ExperienceCandidates most successful in this role typically hold the following qualifications or comparable knowledge or experience:RequiredA minimum of 5+ years of industry experience working on real-world robot systems maintaining high-quality industrial-grade code.Master's degree in Robotics, Computer Science, or Computer Engineering, or a field that requires a strong mathematical and/or engineering foundation.Demonstrated experience leading or making major architectural decisions for a perception, robotics, or autonomy software stack.Strong programming skills in C/C++/Python; software development in Linux environments.Strong experience in ML/DL development with PyTorch/TensorFlow.Direct experience developing or fine-tuning large-scale multi-modal models (e.g., multi-sensor fusion models, foundation models, including VLM backbones) for real-world perception applications.Experience working on a combination of several of the following real-time areas:Computer Vision: object detection, classification, segmentation.Semantic scene understanding, scene/scenario detection, and open-vocabulary detection.Perception robustness in degraded or adverse-weather conditions.Multi-target tracking and sensor fusion.Extensive experience deploying features/ML/DL models in real-time systems with high accuracy and low latency.DesirableExperience developing all-weather / adverse-condition perception, sensor degradation modeling, fault detection, and graceful-degradation strategies for safety-critical systems.Experience with scene/scenario classification, ODD monitoring, and runtime capability activation in autonomous systems.Experience re-architecting or migrating large, legacy perception systems to modern, scalable frameworks.Experience utilizing large-scale multi-modal models for edge-case (long-tail) detection and explainable AI in autonomous systems.Familiar with synthetic data in ML system development.Familiar with Reinforcement Learning (RL) for ML systems.Familiar with ML/DL optimization on real-time products with limited compute resources (e.g., quantization of large transformer models).Strong background demonstrated through high-quality capability deliveries to robots working in the field.Physical RequirementsStandard office working conditions which includes but is not limited to:Prolonged sittingProlonged standingProlonged computer useTravel required? - Moderate: 11%-25%Don’t meet every single requirement? Studies have shown that women and/or people of color are less likely to apply to a job unless they meet every qualification. At May Mobility, we’re committed to building a diverse, inclusive, and authentic workforce, so if you’re excited about this role but your previous experience doesn’t align perfectly with every qualification, we encourage you to apply anyway! You may be the perfect candidate for this or another role at May.Want to learn more about our culture & benefits? Check out our website!May Mobility is an equal opportunity employer. All applicants for employment will be considered without regard to race, color, religion, sex, national origin, age, disability, sexual orientation, gender identity or expression, veteran status, genetics or any other legally protected basis. Below, you have the opportunity to share your preferred gender pronouns, gender, ethnicity, and veteran status with May Mobility to help us identify areas of improvement in our hiring and recruitment processes. Completion of these questions is entirely voluntary. Any information you choose to provide will be kept confidential, and will not impact the hiring decision in any way. If you believe that you will need any type of accommodation, please let us know. Note to Recruitment Agencies: May Mobility does not accept unsolicited agency resumes. Furthermore, May Mobility does not pay placement fees for candidates submitted by any agency other than its approved partners.

About the company

May Mobility company logo
May Mobility uses technology to create a better, cleaner and more accessible way to get around201-500 Employees
  • B2C
  • B2B
  • Scale Stage
    Rapidly increasing operations
  • Top Investors
    This company has received a significant amount of investment from top investors
  • YC Funded
    Startup funded by Y Combinator
  • Valuation $500M+
    This company has a valuation of $500M or more
  • Recently funded
    Raised funding in the past six months
Learn more about May Mobility image

Funding

AMOUNT RAISED
$198.2M
FUNDED OVER
6 rounds
Rounds
C
$111000000
Series C - Jul 2022+5

Founders

Steve Vozar
CTO • 10 years
Ann Arbor
image
Edwin Olson
CEO • 10 years
Ann Arbor
image
View the team image

Similar Jobs

Astranis company logo
Astranis
Building next-generation internet satellites to get the world online
Scale AI company logo
Scale AI
Accelerate the development of AI applications
Juniper Square company logo
Juniper Square
Unlock the potential of every investment partnership
Maple company logo
Maple
Voice AI for Local Businesses
EliseAI company logo
EliseAI
Building AI agents that transform complex healthcare and housing systems
Pulse company logo
Pulse
Transforming healthcare by creating remarkable experiences for doctors and patients
Mercor company logo
Mercor
Mercor is at the intersection of labor markets and AI research
OuterSignal company logo
OuterSignal
OuterSignal is building the customer intelligence layer for commerce
Lexi company logo
Lexi
Multilingual AI for language access in healthcare