Generative AI Analyst, Trust and Safety Operations
- Bangalore, Karnataka
- Permanent
- Full-time
- Bachelor's degree in Computer Science, Engineering, Statistics, Mathematics, a related discipline, or equivalent practical experience.
- 4 years of experience working with analytical tools or data analysis (e.g., SQL, Python, business Intelligence/dashboards).
- Experience using statistical analysis and hypothesis testing.
- Experience analyzing machine learning models performance or working on Large Language Models (LLM).
- Excellent influencing skills, with the ability to work in a dynamic environment.
- Establish metrics to benchmark Generative AI issues and quantify improvements, develop datasets and run evaluations for engineers to evaluate and improve Search, Labs, and Assistant products, and perform data analyses to derive insights that help identify and fight abuse.
- Use technical judgment to drive project delivery, challenge proposals, and identify risks. Manage multiple projects and scope against crashed timelines.
- Improve tools through data analysis, technical expertise, and presentations, as well as enhance operational workflows via process improvements and identification of automation opportunities.
- Analyze and debug escalations, identify trends that can indicate product risks, and perform on-call responsibilities on a rotating basis, including weekend coverage.
- Review graphic, controversial, and offensive/sensitive content as needed.