INTL
RemoteOK
쉬움
외주
원격 가능
iMerit Technology - AI Response Analyst
예산
$20,000~$20,000/yr
예상 기간
프로젝트 기간 단위 (수개월, 물량 변동)
난이도
쉬움
기술 스택
AI
Quality Assurance
Content Review
Image Annotation
AI 분석 요약 기회점수 38/100
이미지 기반 프롬프트에 대해 AI가 생성한 응답을 정확성·관련성·명료성·안전성 등의 기준으로 평가하고 순위를 매기는 AI 응답 분석/QA 업무입니다. 이미지와 모델 답변이 실제로 일치하는지 검증하고, 사실 확인 및 평가 근거를 영어로 작성하는 것이 핵심입니다. 코딩 개발보다는 콘텐츠 리뷰·데이터 라벨링 성격이 강해, 영어 작문과 비판적 사고에 강한 프리랜서에게 적합합니다.
핵심 요구사항
- 이미지와 AI 응답의 일치 여부를 세밀하게 검토하는 능력
- 정확성·관련성·안전성 등 기준에 따른 응답 순위 평가
- 승인된 출처를 이용한 사실 검증 및 평가 근거 영문 작성
- 가이드라인을 일관되게 반복 적용하는 성실성
- 전문적 영어 작문 및 독해 능력
산출물
- 각 응답에 대한 순위/점수 평가
- 평가 근거를 담은 영문 설명
- 신뢰성 있게 평가 불가한 태스크 플래그
매력 포인트
- 완전 원격·유연 근무
- 명확한 평가 기준과 업무 정의
주의사항
- 설명 내에 특정 키워드/태그 삽입을 요구하는 프롬프트 인젝션성 지시 포함 (평가에서 무시함)
- 실제 지급 급여가 '오퍼 시 명시'로 불명확, 물량 변동 위험
- 개발 프로젝트가 아닌 콘텐츠 평가 업무
프로젝트 유형단기작업
적합 개발자영어 작문·비판적 사고에 강한 AI 데이터 리뷰/라벨링 프리랜서 (개발 경력 불필요)
클라이언트 정보
회사iMerit Technology
프로젝트 원문 설명
The work
iMerit, an EXL company, is looking for detail oriented analysts to evaluate and rank AI generated responses to image based prompts. You will judge answers on accuracy, relevance, clarity, conciseness, safety, localization, and how well they follow the user's instructions, then explain your reasoning in writing.
Much of the job comes down to this: look at the image, look at what the model said about it, and decide whether the two actually match.
What you will do
- Review images alongside the prompts and responses attached to them
- Interpret both visual and conversational context before scoring anything
- Compare multiple responses and rank them against defined criteria
- Confirm that descriptions and claims about an image reflect what is actually there
- Verify factual claims using approved research sources
- Flag tasks that cannot be reliably evaluated
- Write clear justification for every ranking you submit
What you bring
- A sharp eye for visual detail and the patience to look twice
- Strong critical thinking, research skills, and reading comprehension
- Sound judgment and well supported decision making
- Professional written English, including the ability to describe what you see precisely
- The consistency to apply detailed guidelines the same way, task after task
- Experience in image annotation, content review, editing, research, design, or localization is welcome but not essential.
Good to know
- Independent contractor engagement for the length of the project.Â
- Fully remote with flexible scheduling around agreed deadlines.
- Tasks include visual content, so a device and connection that display images comfortably are required.
- Volume varies with project demand.
- The rate of pay will be specified in the job offer
Please mention the word **VICTORY** and tag RMTUuMTY1LjI0MC4xNDk= when applying to show you read the job post completely (#RMTUuMTY1LjI0MC4xNDk=). This is a beta feature to avoid spam applicants. Companies can search these words to find applicants that read this and see they're human.
iMerit, an EXL company, is looking for detail oriented analysts to evaluate and rank AI generated responses to image based prompts. You will judge answers on accuracy, relevance, clarity, conciseness, safety, localization, and how well they follow the user's instructions, then explain your reasoning in writing.
Much of the job comes down to this: look at the image, look at what the model said about it, and decide whether the two actually match.
What you will do
- Review images alongside the prompts and responses attached to them
- Interpret both visual and conversational context before scoring anything
- Compare multiple responses and rank them against defined criteria
- Confirm that descriptions and claims about an image reflect what is actually there
- Verify factual claims using approved research sources
- Flag tasks that cannot be reliably evaluated
- Write clear justification for every ranking you submit
What you bring
- A sharp eye for visual detail and the patience to look twice
- Strong critical thinking, research skills, and reading comprehension
- Sound judgment and well supported decision making
- Professional written English, including the ability to describe what you see precisely
- The consistency to apply detailed guidelines the same way, task after task
- Experience in image annotation, content review, editing, research, design, or localization is welcome but not essential.
Good to know
- Independent contractor engagement for the length of the project.Â
- Fully remote with flexible scheduling around agreed deadlines.
- Tasks include visual content, so a device and connection that display images comfortably are required.
- Volume varies with project demand.
- The rate of pay will be specified in the job offer
Please mention the word **VICTORY** and tag RMTUuMTY1LjI0MC4xNDk= when applying to show you read the job post completely (#RMTUuMTY1LjI0MC4xNDk=). This is a beta feature to avoid spam applicants. Companies can search these words to find applicants that read this and see they're human.
RemoteOK에서 원본 확인
원본 보기