Software Engineer, Inference AI/ML

CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute into capability.

Founded in 2017, CoreWeave became a publicly traded company (Nasdaq: CRWV) in March 2025. com .

What You’Ll Do

: Join the Inference team to ship production features that improve latency, reliability, and cost for model serving on our GPU platform. As an IC1, you’ll implement well-scoped changes, learn our operational practices, and grow quickly with mentorship from experienced engineers.

About The Role

, Triton, vLLM, TensorRT-LLM, Ray Serve). Write tests, code comments, and short design docs; participate in code reviews. Add basic metrics and dashboards; assist with alarms and runbooks.

Follow on-call runbooks and learn incident response in a guided rotation. , request batching, concurrency, caching) with guidance.

Who You Are

: BS/MS in CS, EE, or related field, or equivalent practical experience. Foundations in data structures, algorithms, and networked services. Experience with Python or Go (C++ a plus) and Linux fundamentals; Git/CI basics.

Exposure to containers and Kubernetes (coursework or projects welcome). Curiosity about GPU inference concepts (micro-batching, KV cache, streaming). Preferred: Internship or project that deployed a microservice or ML inference demo.

Coursework/research with PyTorch or TensorFlow; simple CUDA projects a plus. Familiarity with Grafana/Prometheus/OpenTelemetry or similar tooling. Why CoreWeave?

At CoreWeave, we work hard, have fun, and move fast! We’re in an exciting stage of hyper-growth that you will not want to miss out on. We’re not afraid of a little chaos, and we’re constantly learning.

Our team cares deeply about how we build our product and how we work together, which is represented through our core values: Be Curious at Your Core Act Like an Owner Empower Employees Deliver Best-in-Class Client Experiences Achieve More Together We support and encourage an entrepreneurial outlook and independent thinking. We foster an environment that encourages collaboration and provides the opportunity to develop innovative solutions to complex problems. As we get set for take off, the growth opportunities within the organization are constantly expanding.

You will be surrounded by some of the best talent in the industry, who will want to learn from you, too. Come join us! The base salary range for this role is $92,000 to $135,000.

The starting salary will be determined based on job-related knowledge, skills, experience, and market location.

Compensation

. In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive

range for this role.

, we review the market rate for each candidate which can include a variety of factors.

Benefits

program (all based on eligibility).

to support your needs.

below reflect our US-based offerings; for roles in other locations,

vary and are shared during the hiring process.

What We Offer

The range we’ve posted represents the typical

Qualifications

, experience, interview performance, and location.