Loading jobs…
Loading jobs…
UM — Francisco
About HumanSignal Real-world data is the competitive edge in AI. HumanSignal is a human data partner for companies building AI models and products. Our customers ship better AI, faster, because we partner with their researchers from real-world data creation to annotation to delivery.
We design and create datasets from scratch, recruit and manage the domain experts who evaluate model output, and run everything through our own platform, Label Studio, the open-source standard for data labeling and evaluation, used by over 1 million practitioners worldwide. We specialize in the operationally complex: real-world data collection, multimodal pipelines, and multi-step workflows. Advanced ML and AI teams use our enterprise platform to run their own data factories, and our services team to extend their reach where in-house capacity runs out.
If you want to do work that materially shapes how the next generation of AI products gets built, we'd love to talk.
Compensation
: $110,000 – $140,000 Location: San Francisco, CA
About The Role
HumanSignal specializes in operationally complex, multimodal data collection and annotation — delivering the datasets that frontier AI research requires and remote workforce marketplaces can't. We own projects end-to-end, from scoping and protocol design through final delivery, running on-site and distributed expert workforces across 50+ knowledge domains, 30+ languages, and 75+ countries. Our work spans RLHF, evals, red-teaming, and custom multimodal data creation, all powered by Label Studio Enterprise and built on a foundation of rigorous quality workflows, ethical sourcing, and full data security.
This role sits at the operational core of that delivery engine — responsible for ensuring our clients get the highest-quality data on time, every time. This role is not for everyone. HumanSignal Services operates at the intersection of frontier AI research and large-scale human data delivery — and the work is fast, demanding, and unforgiving of dropped balls.
Requirements
, and holding quality and delivery timelines simultaneously. There is no playbook handed to you. You will build it, break it, and rebuild it better.
into clear operational plans Collaborate with AI lab researchers and procurement partners to define data strategies, scope programs, and resolve escalations Drive systems-level improvements — standardize playbooks, improve tooling, and build infrastructure that makes the team faster and more reliable at scale Coach and develop SPLs; ensure high-quality AI Trainer experience and strong contributor retention Partner with Product and Engineering to evolve internal tooling, automation, and operational systems
What You'Ll Do
The day-to-day is intense by design. You'll juggle multiple programs at once, each with its own contributors, quality standards, and customer expectations. You'll make hard calls with incomplete information, hold contributors and vendors accountable, and find creative solutions to problems that don't have obvious answers.
The expectation is simple: own the outcome, no excuses. High performers here grow faster than anywhere else in the industry. The bar is high — and that's the point.
Required Qualifications
5+ years in operationally intensive roles (marketplace, data ops, logistics, or similar) 1+ year of people management with clear impact on team performance Metrics-driv