Is this the next step in your career Find out if you are the right candidate by reading through the complete overview below.
Role Overview:
We are hiring for one of our clients, seeking an AI Quality Analyst - English to work on a full-time basis. You will evaluate a new personalization feature for an AI model by assessing how well it integrates information from past conversations, email, search, and activity to deliver relevant responses. This role requires a combination of creative prompt design and analytical evaluation of AI-generated content.
Key Responsibilities:
• Evaluate the quality of personalized responses from an AI model using your own personal experiences as context.
• Design creative, multi-turn prompts that test the model's ability to integrate personal data sources accurately.
• Assess model responses for grounding, integration, and helpfulness, identifying incorrect personalization or forced connections.
• Review side-by-side comparisons of AI responses to detect subtle differences in relevance and accuracy.
• Provide detailed feedback on model behavior to improve personalization performance.
Required Skills & Qualifications:
• English proficiency with a high degree of competence in reading and writing.
• Experience in prompt engineering or designing test cases for AI models.
• Ability to analyze nuanced and ambiguous AI responses with analytical rigor.
• Familiarity with personalization concepts and evaluation metrics in AI systems.
• Attention to detail to identify subtle discrepancies in model outputs.
• Willingness to use your primary personal Google account and enable personal data sources for assessment.
• Full-time availability in your local time zone to support a global, 24-hour operations team.
More About the Opportunity:
This role offers a unique opportunity to work with a global leader in the Technology, Information and Internet industry, contributing to the development of advanced AI systems that deliver measurable business impact.
Equal Opportunity Employer:
We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications. xhyhwjd
Apply Now!
Remote working/work at home options are available for this role.
("document management" OR "document control" OR "records management" OR EDMS OR DMS OR SharePoint OR Documentum OR OpenText OR MasterControl OR Veeva OR Aconex OR Teamcenter OR Vault OR PLM OR "change control" OR "controlled documents" OR SOPs OR GMP OR "quality management...
...'ll Do Own the performance, repair, and calibration of complex clinical equipment-keeping care uninterrupted Ensure critical medical equipment is safe, accurate, and ready when clinicians need it. Guide clinicians on safe, effective equipment use Strengthen...
...College of Wisconsin and its affiliated hospitals for our leadership and innovation. Our faculty team currently includes 140 Anesthesiologists, 26 Certified Anesthesiologist Assistants, four mental-health specialists and 12 scientists dedicated exclusively to research....
...flexible schedules, employee discounts on food, free beverages while at work, and free uniforms in a clean environment. A Sandwich Artist will learn sandwich preparation, food prep, baking, packaging, and customer service to create consistent, high-quality subs served...
...and optimise their tax positions.Those in international tax at PwC will provide advice and... ...need to lead and deliver value at this level include but are not limited to:Craft and... ...does not intend to hire experienced or entry level job seekers who will need, now or...