Senior Data Scientist, Research, Search Intelligence Quality
- linkCopy link
- emailEmail a friend
Minimum qualifications:
- Master's degree in Statistics, Data Science, Mathematics, Physics, Economics, Operations Research, Engineering, or a related quantitative field.
- 5 years of work experience using analytics to solve product or business problems, coding (e.g., Python, R, SQL), querying databases or statistical analysis, or 3 years of work experience with a PhD degree.
Preferred qualifications:
- 8 years of work experience using analytics to solve product or business problems, coding (e.g., Python, R, SQL), querying databases or statistical analysis, or 6 years of work experience with a PhD degree.
- Experience working with eval data (human and AI rated).
- Strong organization, prioritization, written and verbal communication skills.
About the job
As a member of this team, you will be at the forefront of Google Search, pioneering the evaluation of groundbreaking AI products. We provide the essential groundwork for Search’s primary Generative AI products, including AI overview and AI mode. By developing SOTA AI Raters and advanced measurement frameworks, we try to ensure high quality for AI-generated responses. We work on the most complex challenges in AI quality, architecting novel ways for billions of users to experience Google’s capabilities on a daily basis. This is a unique opportunity to shape and refine the future of state-of-the-art Search AI products at Google.
In this role, you will evaluate and improve the Google Search user experience. We work on challenging problems at the frontiers of Generative AI evaluation, and collaborate cross-functionally. We use available data sources (human ratings, offline eval, live experiments, user surveys, etc.) to bring analytical accuracy and statistical methods to the challenges of measuring quality, developing metrics, and improving training data for model development.
As a key member of the team, you work with engineers and researchers to analyze/interpret data, develop metrics, and integrate new methodologies into existing evaluation systems.
US: $174000 - $253000 (USD) + 15% bonus target + bonus + equity + benefits
Learn more about benefits at Google.
Responsibilities
- Work with large, complex data set and solve difficult, non-routine analysis problems, applying advanced analytical methods as needed. Conduct end-to-end analysis that includes data gathering and requirements specification, processing, analysis, ongoing deliverables, and presentations.
- Build and prototype analysis pipelines iteratively to provide insights at scale. Develop comprehensive understanding of Google data structures and metrics, advocating for changes where needed for both products development and business strategy.
- Interact cross-functionally with a wide variety of people and teams. Work closely with engineers to identify opportunities for design, and assess improvements to Google products.
- Make business recommendations (e.g., cost-benefit, forecasting, experiment analysis) with effective presentations of findings at multiple levels of stakeholders through visual displays of quantitative information.
- Research and develop analysis methods to improve the quality of Google Search.
Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy.
Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.
If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.
Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.
To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.
Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc. Alphabet Inc. is your sole contractual partner with respect to equity grants. GSU grants are not guaranteed, are discretionary, are subject to approval by the Alphabet Inc. board of directors or its delegate, the terms of the relevant Alphabet Inc. stock plan, and your grant agreement. They have no impact on statutory payments. Current or past grants do not confer an acquired right.