LLM Model Response Evaluation Job at Lifted, an Upwork Company™, Maryland

YUltakMzRDdudTdxSXduQXVVM3BodWVBRWc9PQ==
  • Lifted, an Upwork Company™
  • Maryland

Job Description



Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.

Job Description

  • Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
  • The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
  • The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
  • Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
  • Each task will include detailed project guidelines within the evaluation platform.

Qualifications

  • 3+ years of hands-on experience in LLM / GenAI data evaluation.
  • Bachelor's Degree required 
  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
  • Comfortable evaluating content across multiple modalities 

Additional Information



Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours:  Workload may vary weekly

Job Tags

Contract work, Remote work, Flexible hours

Similar Jobs

Private Family Position in Sherman, CT

Childminder/private nanny/au pair Job at Private Family Position in Sherman, CT

 ...Hi there! We are a warm and adventurous family living on five ares across from an eight hundred acre preserve in Sherman, Connecticut. We are hoping to find someone who would love to spend time in this environment and help maintain a rhythm and beautiful childhood... 

Decatur Rehabilitation and Healthcare Center

Licensed Nursing Home Administrator Job at Decatur Rehabilitation and Healthcare Center

 ...and compliance while fostering a supportive and caring environment? If so, we want you to lead our team as the Licensed Nursing Home Administrator (LNHA) at Decatur Rehabilitation and Healthcare Center! About Us: We are dedicated to providing exceptional long-term... 

Confidential

Warehouse Picker Packer - Now Hiring Job at Confidential

 ...locations following specific client or carrier instructions. - Packing mastery: Determine the optimal packaging method and materials...  ...boxes, tape, labels). location: Washington Court House, OH work hours: Variable dress code: Shirts or t-shirts must have sleeves... 

Ko tank trucks

Class A Oilfield service driver tanker and rock truck Job Job at Ko tank trucks

Class A Oilfield service driver tanker and rock truck JobHaul rock and haul produced waterPay: 19/hr startingDrive day cab mack How to apply for this Driving JobFill out a Gary's Job Board application. That same application can be used to apply to as many jobs... 

John XXIII Montessori Center

Montessori Primary Guide for 2026-2027 Job at John XXIII Montessori Center

Join us in a mission-driven and joyful community that educates children with a simpler and more human approach. Your purpose will be to accompany them on their journey of self-discovery and learning so they can live joyfully in God's love and fulfill their unique call in...