Skip to content
GenMediaOpen workspace
Browse documentationReviewer guide

Make each judgment on the written criterion

A good review is consistent, complete, and willing to admit when the evidence cannot support a choice. The task criterion matters more than personal model preferences or an attempt to identify which system produced a candidate.

Before the first item

  1. 1

    Read the task criterion and variant notes before playing any candidate.

  2. 2

    Complete the device, audio, display, and familiarity preflight honestly.

  3. 3

    Follow the stated setup guidance and keep browser zoom and playback settings stable.

  4. 4

    Open the input reference when identity, product, composition, source motion, or sound is part of the criterion.

For every item

  • Finish the evidence

    Watch or listen for the required time before choosing.

  • Follow the rubric

    Judge prompt adherence, fidelity, motion, visual quality, or another stated criterion rather than an unstated preference.

  • Use tie honestly

    A tie is better than inventing a difference that is not meaningful.

  • Use skip when needed

    A broken or incomparable item should not become a forced vote.

  • Keep comments factual

    Describe the visible issue and avoid names, private information, or model guesses.

After submission

Internal fal.ai Standard reviewers can open Basic results after completing an eligible task. Creative Engineer and MLOpt accounts may have broader result access. External reviewers return to their narrow assignment list and cannot open task or result pages.