Member of Technical Staff

About Us: At Fireworks, we’re building the future of generative AI infrastructure. Our platform delivers the highest-quality models with the fastest and most scalable inference in the industry. We’ve been independently benchmarked as the leader in LLM inference speed and are driving cutting-edge innovation through projects like our own function calling and multimodal models.

Fireworks is a Series C company valued at $4 billion and backed by top investors including Benchmark, Sequoia, Lightspeed, Index, and Evantic. We’re an ambitious, collaborative team of builders, founded by veterans of Meta PyTorch and Google Vertex AI. The Role: As a Training Infrastructure Engineer, you'll design, develop, and maintain large-scale backend and cloud-native infrastructure to support distributed machine learning training, inference, and data processing pipelines for our generative AI platform.

You'll architect scalable, resilient backend infrastructure, lead technical design discussions, mentor engineers, and establish best practices for large-scale machine learning systems.

Key Responsibilities

: Architect and build scalable, resilient backend infrastructure to support distributed training, inference, and data processing pipelines Lead technical design discussions, mentor engineers, and establish best practices for large-scale machine learning systems Design and implement core backend services with a focus on efficiency and low latency Drive infrastructure optimization initiatives for compute cost, storage lifecycle management, and network performance Collaborate with machine learning, DevOps, and product teams to translate research and product

Requirements

into robust infrastructure solutions Evaluate and integrate cloud-native and open-source technologies such as Kubernetes, Ray, Kubeflow, and MLFlow to enhance platform reliability Own end-to-end systems from design to deployment, emphasizing reliability, fault tolerance, and operational excellence

Minimum Qualifications

ai/careers and search for job by title. Fireworks AI is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all innovators.

Compensation

for this role also includes meaningful equity in a fast-growing startup, along with a competitive salary and comprehensive

Benefits

package.

Qualifications

, experience, skills, interview performance, market data, a