LLM Model Response Evaluation Job at Lifted, an Upwork Company™, Maryland

YUltakMzRDdudTdxSXduQXVVM3BodWVBRWc9PQ==
  • Lifted, an Upwork Company™
  • Maryland

Job Description



Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.

Job Description

  • Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
  • The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
  • The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
  • Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
  • Each task will include detailed project guidelines within the evaluation platform.

Qualifications

  • 3+ years of hands-on experience in LLM / GenAI data evaluation.
  • Bachelor's Degree required 
  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
  • Comfortable evaluating content across multiple modalities 

Additional Information



Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours:  Workload may vary weekly

Job Tags

Contract work, Remote work, Flexible hours

Similar Jobs

Banker's Toolbox

Data Analyst Job at Banker's Toolbox

 ...business requirements.~Manipulate, analyze, and interpret complex data sets; identify trends and issues; and translate findings into...  ...the client experience.~Partner with internal teams on data-collection needs, reporting trends, and opportunities to improve... 

BrightStar Care

RN Needed for Infusion Case - RDU Areas Job at BrightStar Care

 ...Midtown Raleigh is looking for an experienced RN to cover high paying per diem shifts lasting 3 to 4 hours across the RDU of North Carolina...  ...could be the part-time position you've been looking for. Our Nurses are highly compensated for the clinical skills they possess and... 

The University of Iowa

TENURE-TRACK FACULTY POSITION IN CLINICAL SCIENCE Job at The University of Iowa

 ...Position Description:Tenure-Track Faculty Position in Clinical ScienceThe Department of Psychological and Brain Sciences at the University...  ...the understanding, prevention, and treatment of mental health disorders and the promotion of adaptive behavior and health. We... 

Confidential

Historic Preservation and Neighborhood Planner for the City of Binghamton Job at Confidential

City of BinghamtonHistoric Preservation and Neighborhood PlannerType:Full TimeSalary/Pay Rate:$50,270 per YearPosted Date:08/22/2025 Open Until FilledPlanning, Housing & Community DevelopmentDISTINGUISHING FEATURES OF THE CLASS: This is a specialized professional... 

Gridnaut Recruiting

Audiobook QA Expert — French Job at Gridnaut Recruiting

Gridnaut Recruiting is hiring a remote Audiobook QA Expert French contractor (pay $15-$20/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: Native or near-native fluency in French (France), and an active, genuine audiobook listener someone...