Quality Analyst
Roblox
Salary undisclosed
Need a reasonable accommodation to apply or interview? Contact us.
JobMinglr uses automated technology to recommend jobs based on profile information and job preferences. Match Score does not determine eligibility for a position, prevent a user from viewing or applying to a job, or make hiring decisions on behalf of an employer.
Description
Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators.
At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there.
A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone.
You will
- Build and maintain the answer key. Use your policy and enforcement expertise to create correctly labeled image cases for moderator training, QA, and policy work. Add new cases as policies and content trends change.
- Make final calls on disputed decisions. Blind-audit sampled cases and resolve disagreements between moderators, vendor QA, and automated systems.
- Calibrate vendor QA teams. Measure vendor auditors’ accuracy against the answer key and lead calibration sessions to close gaps.
- Find root causes and trends. Tag every error using a standard error taxonomy, and analyze quality data to find patterns, bottlenecks, and ways to improve. Flag new risks early and run deep dives on the biggest problems.
- Recommend fixes. Write short briefs for weekly stakeholder reviews. Each brief should size the problem, describe its impact, and name the team best placed to fix it.
- Report on quality. Pull statistically valid samples and publish weekly quality reports with accuracy metrics and confidence intervals.
- Use outside quality signals. Include data from user appeals, escalations, partner feedback, and customer support to get a fuller picture of quality.
- Confirm that fixes worked. Audit affected queues again after each change to check that quality improved.
You have
- 3+ years in quality assurance, content moderation, Trust & Safety, or a related operations role
- A strong understanding of content policy, plus sound judgment on close calls
- Experience building answer keys, test sets, or calibration materials
- Experience auditing and calibrating reviewers, including outsourced or vendor teams
- Working knowledge of sampling and basic statistics, including accuracy rates, inter-rater agreement, and confidence intervals
- Experience doing root-cause analysis and turning findings into practical recommendations
- Skill with spreadsheets for pulling and analyzing data
- Clear written and verbal communication, including writing short summaries for leadership
- Experience working with cross-functional partners such as Policy, Operations, Engineering, and vendors
Roles that are based in an office are onsite Tuesday, Wednesday, and Thursday, with optional presence on Monday and Friday (unless otherwise noted).
Roblox provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Roblox also provides reasonable accommodations to candidates with qualifying disabilities or religious beliefs during the recruiting process.
For US based roles only, please note the Company may not be able to employ candidates for this role who have United States work authorization related to certain U.S. visa categories, or support future H-1B sponsorship at this time.
About this role
Roblox is seeking a Quality Analyst to oversee content moderation standards across its platform, where tens of millions of users create and experience 3D digital worlds daily. This role sits at the intersection of policy enforcement and operational excellence, requiring you to build and maintain the authoritative answer key for moderator decisions, audit and calibrate vendor QA teams, and identify systemic quality issues before they scale. You'll spend significant time analyzing moderation data, tagging errors against a standard taxonomy, and translating findings into actionable briefs for cross-functional stakeholders—work that directly shapes how safely and fairly the platform operates.
The ideal candidate brings at least three years in quality assurance, content moderation, Trust & Safety, or similar operations work, with demonstrated expertise in building calibration materials and auditing reviewer performance. You'll need solid grounding in sampling methodology and basic statistics, strong judgment on nuanced policy questions, and the ability to do root-cause analysis that leads to concrete recommendations. Equally important are spreadsheet proficiency for data work and clear communication skills, since you'll be writing weekly summaries for leadership and coordinating closely with Policy, Engineering, Operations, and external vendor teams.
This is a full-time, in-office role based in Gurugram, Haryana, with an expectation of on-site presence Tuesday through Thursday.
How this employer is doing
average
- H1B: Active Visa Sponsor
- Active Visa Sponsor
This role's local market on JobMinglr
Pay for this role
The employer didn't post a pay range for this role. That usually means pay is set in negotiation, which favors whoever arrives with numbers. Check ranges on comparable Quality Analyst postings in Gurugram Haryana, and analyze any offer before you accept it.
Before you apply, worth reading
How JobMinglr reads this job
Every listing here is scored against your profile before you apply: skills overlap, experience level, location and work arrangement, each weighted and explained. You see the score and the reasons, not just a list. How the matching works.