Technical Program Manager
RadixArk
CA$160,000 - CA$300,000 / year
Need a reasonable accommodation to apply or interview? Contact us.
JobMinglr uses automated technology to recommend jobs based on profile information and job preferences. Match Score does not determine eligibility for a position, prevent a user from viewing or applying to a job, or make hiring decisions on behalf of an employer.
Description
About the Role
Key Responsibilities
Program Execution & Delivery
-
Drive end-to-end execution of large-scale, cross-functional programs spanning inference engines (e.g., SGLang), training frameworks (e.g., Miles), and hardware integration efforts.
-
Define program structure, including milestones, dependencies, critical paths, risks, and success criteria. Maintain a clear source of truth for status across all stakeholders.
-
Run design reviews, sprint planning, release readiness reviews, and post-mortems. Ensure decisions are documented and follow-ups are closed out.
-
Identify and unblock cross-team dependencies across kernel, runtime, scheduler, networking, and model teams before they become release blockers.
-
Drive release management for major versions, including changelog ownership, compatibility validation, partner rollout sequencing, and rollback planning.
Technical Coordination
-
Partner with Product Management to translate roadmap priorities into executable program plans, with clear scope, staffing, and timelines.
-
Work shoulder-to-shoulder with engineering leads on technical trade-off decisions; understand the architecture deeply enough to ask the right questions and surface hidden risks.
-
Coordinate hardware enablement programs with partners like Nvidia, Google, and AWS, including new accelerator bring-up, kernel co-development, and benchmark validation.
-
Manage integration programs with frontier AI labs and early adopters, ensuring technical requirements, SLAs, and feedback loops are well-defined.
Operational Excellence
-
Build and improve the engineering operating cadence, including standups, planning rituals, OKR tracking, dashboards, and reporting to leadership.
-
Establish metrics and instrumentation for program health such as velocity, defect rates, benchmark regressions, and customer-reported issues, and drive accountability against them.
-
Lead incident response coordination for production issues affecting partners; own root-cause review and corrective-action tracking.
-
Improve developer productivity by identifying and removing systemic friction in our build, test, and release pipelines.
Stakeholder Communication
-
Serve as the connective tissue between engineering, product, GTM, and external partners, ensuring everyone has the right information at the right altitude.
-
Produce clear, concise written updates for leadership and partners. Translate engineering progress into business-relevant signals.
-
Represent program status honestly, including risks and slips, with concrete mitigation plans.
Qualifications
Minimum Requirements
-
Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field.
-
4+ years of direct experience in Technical Program Management, Engineering Management, or a senior engineering role with significant program ownership, in a software or infrastructure company.
-
Strong technical fluency in systems software, distributed systems, or AI/ML infrastructure; able to read code, follow architecture discussions, and challenge technical assumptions productively.
-
Demonstrated track record shipping complex, multi-team programs on time, including managing dependencies, risks, and scope changes.
-
Excellent written and verbal communication skills; able to drive alignment across engineers, executives, and external partners.
Preferred (Bonus) Qualifications
-
Direct experience shipping AI/ML infrastructure such as inference engines, training frameworks, GPU kernels, distributed schedulers, or model serving platforms.
-
Hands-on coding background (Python, C++, CUDA) and comfort working in engineering codebases, including reading PRs, running benchmarks, and reproducing issues.
-
Experience coordinating with hardware vendors (Nvidia, AMD, Google TPU, AWS Trainium/Inferentia) on enablement or co-engineering programs.
-
Experience driving open-source release programs or working in OSS communities, including issue triage, RFC processes, and contributor coordination.
-
Familiarity with release engineering, CI/CD systems, and observability tooling for large-scale distributed systems.
-
Experience supporting B2B or developer-facing products with enterprise SLAs.
About RadixArk
RadixArk is an infrastructure-first company built by engineers who've shipped production AI systems, created SGLang (30K+ GitHub stars, the fastest open LLM serving engine), and developed Miles (our large-scale RL framework). Founded by AI infrastructure veterans from xAI and NVIDIA, we're on a mission to democratize frontier-level AI infrastructure by building world-class open systems for inference and training. Our team has optimized kernels serving billions of tokens daily, designed distributed training systems coordinating 10,000+ GPUs, and contributed to infrastructure that powers leading AI companies and research labs.
Compensation
Depending on background, skills, and experience, the expected annual salary range for this position is $160,000 - $300,000 USD + equity.
Equal Opportunity
RadixArk is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Benefits
- stock options
About this role
RadixArk is hiring a Technical Program Manager to orchestrate the delivery of large-scale infrastructure programs serving billions of tokens daily across inference engines, training frameworks, and hardware integration. You'll work at the intersection of deep technical understanding and rigorous execution, owning the end-to-end delivery of complex, cross-functional initiatives that coordinate kernel teams, distributed systems engineers, and external hardware partners like Nvidia and AWS. This role demands someone who can translate ambitious technical roadmaps into shipped reality while managing dependencies, risks, and scope across multiple teams.
The position requires at least four years of direct technical program management or senior engineering experience, with proven ability to ship multi-team programs on time. You'll need strong fluency in systems software and distributed systems—enough to read code, follow architecture discussions, and challenge technical assumptions productively. Beyond execution, you'll build engineering operating cadence, establish program health metrics, drive incident response coordination, and serve as the connective tissue between engineering, product, and external partners, translating progress into business-relevant signals for leadership.
Experience with AI/ML infrastructure—inference engines, training frameworks, GPU kernels, or model serving platforms—is strongly preferred, as is hands-on coding ability in Python, C++, or CUDA and prior work coordinating hardware vendor enablement programs. The role is full-time, in-office in Palo Alto, with a salary range of $160,000–$300,000 plus equity.
How this employer is doing
average
- Sponsors Visas
This role's local market on JobMinglr
Pay for this role
$160,000 to $300,000 per year
That is the employer's posted range, and where you land in it is usually decided in one conversation. Before that conversation, run the numbers: analyze an offer for this role.
Before you apply, worth reading
How JobMinglr reads this job
Every listing here is scored against your profile before you apply: skills overlap, experience level, location and work arrangement, each weighted and explained. You see the score and the reasons, not just a list. How the matching works.