Senior Machine Learning Engineer - Foundation Model
XPENG
Salary not disclosed
Applying takes a free account: you'll come right back to this job to finish with your profile.
Need a reasonable accommodation to apply or interview? Contact us.
JobMinglr uses automated technology to recommend jobs based on profile information and job preferences. Match Score does not determine eligibility for a position, prevent a user from viewing or applying to a job, or make hiring decisions on behalf of an employer.
Description
Key Responsibilities
- Design and implement large-scale multi-modal architectures (e.g., vision–language–action transformers) for end-to-end autonomous driving.
- Develop pretraining and fine-tuning strategies leveraging massive labeled and unlabeled fleet data (images, video, LiDAR, CAN bus, maps, human driving behaviors, etc.).
- Research and integrate cross-modal alignment (e.g., visual grounding, temporal reasoning, policy distillation, imitation and reinforcement learning) to improve model interpretability and action quality.
- Collaborate with infrastructure engineers to scale training across thousands of GPUs using distributed training frameworks (FSDP, DDP, etc.).
- Conduct systematic ablation, evaluation, and visualization of model behavior across perception, reasoning, and planning tasks.
- Contribute to model deployment optimization, including quantization, export, and latency–accuracy trade-offs for onboard execution.
Minimum Qualifications
- Master’s degree or higher in Computer Science, Electrical/Computer Engineering, or related field, with 3+ years of experience in deep learning research or productization.
- Strong proficiency in PyTorch and modern transformer-based model design.
- Experience in large-scale pretraining or multi-modal modeling (vision, language, or planning).
- Deep understanding of representation learning, temporal modeling, and self-supervised or reinforcement learning techniques.
- Familiarity with distributed training (DDP, FSDP) and large-batch optimization.
Preferred Qualifications
- PhD in CS/CE/EE or related field, with 1+ years of relevant industry experience.
- Publication record in top-tier AI conferences (CVPR, ICCV, NeurIPS, ICLR, ICML, ECCV).
- Prior experience building foundation or end-to-end driving models, or LLM/VLM architectures (e.g., ViT, Flamingo, BEVFormer, RT-2, or GRPO-style policies).
- Familiarity with RLHF/DPO/GRPO, trajectory prediction, or policy learning for control tasks.
- Proven ability to collaborate cross-functionally with infra, perception, and planning teams to deliver production-ready models.
- A collaborative, research-driven environment with access to massive real-world data and industry-scale compute.
- An opportunity to work with top-tier researchers and engineers advancing the frontier of foundation models for autonomous driving.
- Direct impact on the next generation of intelligent mobility systems.
- Opportunity to make significant impact on the transportation revolution by the means of advancing autonomous driving.
- Competitive compensation package.
- Snacks, lunches, dinners, and fun activities.
Pay for this role
The employer didn't post a pay range for this role. That usually means pay is set in negotiation, which favors whoever arrives with numbers. Check ranges on comparable Senior Machine Learning Engineer - Foundation Model postings in Santa Clara, and analyze any offer before you accept it.
Before you apply, worth reading
How JobMinglr reads this job
Every listing here is scored against your profile before you apply: skills overlap, experience level, location and work arrangement, each weighted and explained. You see the score and the reasons, not just a list. How the matching works.