Video Annotator
$30,000 USD/year Pay is set based on global value, not the local market. Most roles = hourly rate x 40 hrs x 50 weeks 

Worldwide
Semi-flexible schedule
Fully-remote
full-time (40 hrs/week)
Long-term role

Video Annotator   $30,000 USD/year

Description

This position is built for people who value correctness over speed. The labels you create become the foundation for AI systems that support thousands of students daily. Precise behavioral tagging strengthens the model; inconsistent labeling teaches it incorrect patterns.

LearnWith.AI develops AI-driven learning tools grounded in learning science, data analytics, and expert knowledge. Your role is to convert unstructured student session recordings into reliable, rubric-aligned annotations the team depends on. You will review recorded sessions, pinpoint critical behavioral moments, and apply defined classification rules to capture what occurred and its timing. You will also validate LLM-generated pre-annotations, correct inaccuracies, and flag ambiguous cases to help engineers refine the pipeline.

This is not freelance, ad-hoc labeling work. It involves a consistent workflow within one product area, supported by regular feedback, alignment with gold-standard benchmarks, and advancement tied to precision and reliability. If you thrive on explicit standards, trackable quality metrics, and contributions that shape model outcomes, this opportunity is for you.

What you will be doing

  • Label student session recordings by detecting, categorizing, and timestamping behavioral events according to a comprehensive rubric
  • Audit and refine LLM pre-annotations by eliminating incorrect labels, inserting overlooked events, and adjusting time markers
  • Document reasoning for ambiguous decisions, referencing rubric sections and clarifying the logic applied
  • Record edge cases and unresolved questions for scenarios lacking clear guidance, and maintain session metadata in an annotation log
  • Participate in calibration sessions, integrate QA feedback, and adapt to rubric revisions to sustain high accuracy

What you will NOT be doing

  • Develop AI models, conduct experiments, or perform behavioral research on students
  • Alter the annotation rubric or reinterpret category criteria based on subjective judgment
  • Prioritize throughput over accuracy, consistency, or temporal precision
  • Handle sporadic, disconnected tasks spanning unrelated fields without context or feedback

Key responsibilities

Your primary function is to transform student session videos into labeled datasets achieving ≥95% accuracy with precise timestamps, enabling the team to reliably measure model improvements or regressions.

Candidate requirements

  • A minimum of 1 year in data annotation, content moderation, QA evaluation, or comparable rubric-based assessment roles
  • Excellent English comprehension with the capacity to interpret and adhere to detailed written guidelines consistently
  • Capability to maintain concentration and precision during 4–6 hours of daily video review
  • Skill in identifying nuanced visual and behavioral signals on-screen and applying uniform classification across multiple sessions
  • Proficient written communication for documenting edge cases, reasoning, and questions requiring clarification
  • Dependable internet service suitable for video streaming
  • Experience reviewing, correcting, and enhancing AI or LLM-produced annotations

Meet a successful candidate

Watch Interview
Fabiano Lucchese
Fabiano  |  SVP of Software Engineering
Brazil

Does your company encourage your natural creativity? This Brazilian engineering leader rediscovered his purpose after unleashing both his an...

Meet Fabiano

Applying for a role? Here’s what to expect.

Crossover's skill assessment process combines innovative AI power with decades of human research, to take the guesswork, human bias, and pointless filters out of recruiting high-performing teams.

Chat-style
screening interview.
STEP 1

Chat-style
screening interview.

Cognitive 
aptitude test.
STEP 2

Cognitive 
aptitude test.

Prove real-world 
job skills.
STEP 3

Prove real-world 
job skills.

Interview with the hiring manager.
STEP 4

Interview with the hiring manager.

Pass
proctored test.
STEP 5

Pass
proctored test.

Accept job offer.
STEP 6

Accept job offer.

Frequently asked questions

About Crossover

Meet some people who've landed similar jobs

Why Crossover

Recruitment sucks. So we’re fixing it.

The Olympics of work

The Olympics of work

It’s super hard to qualify—extreme quality standards ensure every single team member is at the top of their game.

Premium pay for premium talent

Premium pay for premium talent

Over 50% of new hires double or triple their previous pay. Why? Because that’s what the best person in the world is worth.

Shortlist by skills, not bias

Shortlist by skills, not bias

We don’t care where you went to school, what color your hair is, or whether we can pronounce your name. Just prove you’ve got the skills.

Crossover Logo White
Follow us on
Have a question?

Get answers to common questions using our smart chatbot Crosby.

HELP AND FAQs

Join the world's largest community of  AI first Remote WorkersAI-first remote workers.