Member of Technical Staff — Developer Technology

RadixArk

Salary undisclosed

Palo Alto, CAOn-siteExpert

Need a reasonable accommodation to apply or interview? Contact us.

JobMinglr uses automated technology to recommend jobs based on profile information and job preferences. Match Score does not determine eligibility for a position, prevent a user from viewing or applying to a job, or make hiring decisions on behalf of an employer.

Description

About the Role

RadixArk is seeking a Member of Technical Staff, Developer Technology (DevTech) to make LLM inference and training dramatically faster, cheaper, and more accessible on modern GPU hardware. Our systems sit at the center of how modern AI is served and trained: SGLang is a high-performance inference engine that serves trillions of tokens daily across leading AI companies and research labs, and Miles is our reinforcement-learning post-training framework for large-scale LLM and MoE models. Your work directly advances our mission to democratize AI: every improvement you ship lowers the cost and raises the ceiling of what developers everywhere can build.

As our technical face to a community of expert users and partners, you'll push the performance of SGLang and Miles through the lens of real production workloads. You'll profile and optimize GPU performance, enable new models and hardware, build kernels, deliver day-0 model support, and push the limits of inference and training. Working in close partnership with leading teams across the ecosystem, you'll turn their hardest, most ambiguous problems into concrete wins and clear guidance, and feed those improvements back into our systems and future roadmap.

Key Responsibilities

Accelerate AI workloads. Profile and optimize GPU performance for real production workloads on current and next-generation hardware, root-causing bottlenecks from kernels to distributed multi-node systems.
Go deep in one or two focus areas. The team collectively covers the full stack; each engineer specializes in one or two tracks:
- Inference performance: engine tuning, benchmarking, long-context and multi-turn optimization, parallelism strategy, production debugging
- Kernels and model/hardware enablement: custom CUDA/ROCm/Triton kernels, low-precision quantization, day-0 support for new models on new silicon
- Speculative decoding: draft-model training, acceptance-rate tuning, cross-platform kernel adaptation
- Training systems: RL post-training with Miles, FP8 training, elasticity, long-rollout and long-context efficiency
Partner directly with the ecosystem. Turn ambiguous, high-stakes problems from expert engineers at our key partners into concrete wins, clear technical guidance, and reproducible cookbooks.
Enhance SGLang and Miles. Feed user-driven improvements back into our open-source systems and roadmap, so every win compounds across the ecosystem.

Qualifications

Minimum Requirements

4+ years of experience in GPU systems, LLM infrastructure, or performance engineering.
Strong profiling and debugging skills: able to root-cause performance and correctness issues across the stack.
Hands-on GPU programming experience in at least one of CUDA, ROCm, or Triton, and willingness to work across platforms.
Strong programming skills in Python plus C++ or CUDA.
Comfortable making progress on hard, ambiguous problems with little context to start from, and fast to ramp into unfamiliar systems, codebases, and domains.
Ability to translate ambiguous asks into clear technical plans, verified cookbooks, and actionable recommendations, and to communicate credibly with expert engineering audiences.

Preferred (Bonus) Qualifications

Deep familiarity with LLM inference internals: distributed serving, parallelism, routing, KV-cache management, scheduling.
Experience with low-precision quantization and inference/training (FP8, INT8/INT4; NVFP4 or MXFP4 a strong plus).
Experience writing and optimizing custom GPU kernels.
Practical familiarity with speculative decoding methods such as Eagle, DFlash, or DSpark.
Working knowledge of large-scale distributed training: pre-training, SFT, RL post-training, elasticity, long-context workloads.
Experience optimizing across both NVIDIA and AMD platforms.
Hands-on experience with SGLang, Miles, vLLM, TensorRT-LLM, Megatron, or comparable frameworks; contributions to open-source AI/ML projects.

About RadixArk

RadixArk is an infrastructure-first company built by engineers who've shipped production AI systems, created SGLang (30K+ GitHub stars, the fastest open LLM serving engine), and developed Miles (our large-scale RL framework). Founded by AI infrastructure veterans from xAI and NVIDIA, we're on a mission to democratize frontier-level AI infrastructure by building world-class open systems for inference and training. Our team has optimized kernels serving billions of tokens daily, designed distributed training systems coordinating 10,000+ GPUs, and contributed to infrastructure that powers leading AI companies and research labs.

Compensation

Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD + equity.

Equal Opportunity

RadixArk is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

About this role

RadixArk's Developer Technology team sits at the intersection of infrastructure and real-world AI deployment. You'd work on SGLang and Miles—systems that already serve trillions of tokens daily—optimizing them against the hardest production workloads from leading AI companies and research labs. The role is fundamentally about taking ambiguous, high-stakes problems from expert partners and turning them into concrete performance wins, reproducible solutions, and clear technical guidance that feeds back into the open-source systems.

The work spans the full GPU stack: profiling and debugging bottlenecks from custom kernels to distributed multi-node systems, enabling new models and hardware, and pushing inference and training performance on current and next-generation silicon. You'll go deep in one or two specializations—whether that's inference tuning, kernel development, speculative decoding, or training systems—while collaborating closely with a team that collectively covers the entire landscape. This is hands-on work: CUDA, ROCm, or Triton programming; Python and C++; and the ability to ramp quickly into unfamiliar codebases and domains.

You should have at least four years in GPU systems, LLM infrastructure, or performance engineering, with strong profiling and debugging skills. Experience with LLM inference internals, low-precision quantization, custom kernel optimization, or large-scale distributed training is valuable. The role is in-office in Palo Alto and offers $200,000–$400,000 annually plus equity, depending on background and experience.

How this employer is doing

average

Sponsors Visas

This role's local market on JobMinglr

Pay for this role

The employer didn't post a pay range for this role. That usually means pay is set in negotiation, which favors whoever arrives with numbers. Check ranges on comparable Member of Technical Staff — Developer Technology postings in Palo Alto, and analyze any offer before you accept it.

Before you apply, worth reading

How JobMinglr reads this job

Every listing here is scored against your profile before you apply: skills overlap, experience level, location and work arrangement, each weighted and explained. You see the score and the reasons, not just a list. How the matching works.