Research Analyst

At Dewey, we're building AI-powered personal librarians for experts and brands to expand access to their content. Our sweet spot is working with highly sensitive content and specific brand voices, to make a safe–and brand-safe–experience for users. We work with an incredible roster of parenting experts, including Emily Oster and Dr. Lisa Damour, alongside many others ranging fro ---------- dical to education to a voting guide. We are a small, bootstrapped team committed to doing good with AI by increasing access and building ethical tools.

Responsibilities:

Data Quality & AI Training (70% of role):
Conduct detailed manual review of AI-generated responses using our proprietary hallucination detection tools
Label and categorize responses for accuracy and brand voice consistency
Flag potential issues, such as hallucinations or low quality responses
Maintain detailed logs and provide feedback to improve our AI systems

Content Management (30% of role):
Review and clean knowledge request queues in our database
Update document titles, remove duplicates, and organize content libraries
Monitor conversation logs to identify and tag low-quality responses

Growth Opportunities:

As you demonstrate excellence and interest, this role could expand to include:
Building monthly client reports using SQL queries and internal analytics tools
Contributing to product quality initiatives and process improvements
Supporting customer success activities and client communications

Sample of Responsibilities:

Evaluate a target number of answers daily for hallucinations and use your scoring system to label them
Update and clean data - weekly sweeps in our admin system to change document titles, remove duplicates, update URLs, etc
Product quality sweeps - read recent conversations for a variety of clients to flag any bugs or quality concerns
Build monthly reports for clients - involves using our in-house analytics system, updating SQL, putting data into spreadsheets, and translating that into a client-facing narrative

What We Offer:
Flexible schedule that respects work-life balance
Opportunity to work with cutting-edge AI technology in a meaningful application
Exposure to high-quality expert content across multiple domains
Clear path for growth and expanded responsibilities
Supportive team environment with strong communication practices

Position Details:
Compensation: Competitive hourly rate, commensurate with experience and location
Hours: Min of 20 / week, potential to scale up to full-time
Time Zone: Flexible, but some should overlap EST working hours (9-5 pm)
Start Date: Immediate


Candidate Requirements

Required:
Exceptional attention to detail and strong reading and written English language skills
Ability to understand nuance, context, and subtle differences in meaning
Comfortable working independently with minimal supervision
Highly organized, with strong time and task management skills
Reliable internet connection and quiet workspace for focused work
Comfortable working in Slack & Asana, plus learning new web based tools

Strongly Preferred:
Previous experience in content review, quality assurance, or data annotation
Familiarity with AI tools or interest in learning about AI systems
Previous remote work experience with US-based teams
Love of learning and reading!

Nice to Have:
Experience as a parent or working with parenting/family content
Experience with SQL or willingness to learn
Curiosity about data analytics, customer success, or sales are all a plus too