Skip to content
IdeaScore

Running Evaluation Rounds

Open a round, assign evaluators, chase progress, read the leaderboard with normalised scores, then close the round and promote with a written rule.

IdeaScore team

About 12 minutesUpdated 30 October 2026

A round is one stage of review, such as Screening, Semi-final or Final, with its own rubric, assignments and leaderboard. This guide runs one from opening to promotion, using 181 applications screened down to 40 as the example.

Related: Evaluation, Review and running a multi-round seed-fund call.

Before You Start

  • The rubric for this round, with low and high descriptors written.
  • Evaluators invited and conflicts declared.
  • Evaluators per team and the scoring deadline, told to evaluators in advance.
  • The promotion rule, written down before any score exists: top 40, or everyone above a score.
  • A clean submissions list: eligibility checked, duplicates resolved.

More than one round needs multi-round selection on your plan (Growth and up).

Step 1: Set Up the Round

On Rounds, choose New round. The round editor reads back the round in plain sentences; click any underlined part to change it.

  1. Basics and Dates: the name and when it runs.
  2. Judging: the rubric it is scored against.
  3. Evaluators: what they see, including Blind review.
  4. Who moves on: the rule, such as the top 40. You can narrow it with a condition, such as readiness level 6 or more.

Nothing changes until you choose Save changes.

Step 2: Assign Evaluators

Two evaluators per team suits screening; three is the usual standard for a final. Do the arithmetic now: 181 teams at two each is 362 reads, about 26 each across 14 evaluators. If that is too many, screen harder or add evaluators now, not in week three.

On Assignments, use the Conflict-Aware Assignment plan or Auto-assign with Avoid conflicts of interest on. The evaluator guide covers this step in full.

The Assignments page: 37 of 101 teams with evaluators, 49 of 72 scored, 3 overdue and 7 open conflicts.
Coverage, scoring, overdue reviews and conflicts at the top of one page.Full size(opens the image in a new tab)

Step 3: Open the Round and Watch Progress

Choose Open round on its card. Then watch progress by evaluator, not in aggregate: 80 per cent done usually means most have finished and two have not started.

  • Remind overdue emails only evaluators behind on their work, and never twice in 24 hours.
  • The Review Progress Forecast says when scoring will finish at the current pace.
  • If a batch must move, use Reassign at least four days before the deadline.

Step 4: Read the Leaderboard

Each round has its own leaderboard. Three views answer three questions:

ViewRanks byUse it to
HumanThe panel's scores onlyProduce the ranking the committee signs off
BlendedPanel and IdeaScore AI, at the weight you setSort quickly and spot divergence
AIIdeaScore AI's score aloneSee what the evidence says on its own

Keep Human as the view of record. Turn on Normalise when evaluators scored different sets of teams: each evaluator's scores are rescaled by their own average and spread, so a harsh and a lenient evaluator count the same. The Fair Scoring card shows which teams move and why, before you rely on it.

The leaderboard ranked by a 70% human and 30% IdeaScore AI blend, with each team's score, AI score and blended score.
The Blended view, with the panel's score and IdeaScore AI's beside it.Full size(opens the image in a new tab)

Where the Human and AI views disagree sharply, read the application again before the committee does.

Step 5: Close and Promote

  1. Choose Close round once scoring is done.
  2. Choose Promote and apply your written rule: Top N, Cut-off or I choose. Each team shows Goes through or Doesn't go through, and a tie at the line is pointed out.
  3. Export the ranking from the leaderboard as CSV or Excel for the meeting.
The Rounds page for Meridian Seed Fund 2026: Screening, Semi-final and Final with their teams, and the Screening standings below.
Every round side by side, with standings and promotion one click away.Full size(opens the image in a new tab)

Step 6: Share Feedback with Teams

In the round editor, With teams has Share feedback with teams. Choose the criteria whose averages teams may see. Each team sees only its own averages, and only after you tell it the round's outcome. Evaluators' comments can be shared too, one at a time after you review them; blind rounds keep comments private.

Checklist Before You Close the Round

  • Every team has its full number of evaluators, and all scores are in
  • Conflicts reassigned, none still open
  • Normalised and raw rankings both looked at
  • Large Human and AI disagreements read again
  • Promotion rule applied exactly as written, ties decided and recorded
  • Ranking exported for the committee
TopicsEvaluationRounds

Keep Going

Every guide
  • Next guide

    Using IdeaScore AI Responsibly

    Accept the data terms once, decide what evaluators see, check the cost before each run, read the evidence, and keep the panel's ranking the one of record.

    About 8 minBeginner6 steps

  • Decide

    Running a Pitch Day

    Create the session, set the running order and timings, show teams their slots, run the stage live, and decide when the room sees the standings.

    About 10 minIntermediate6 steps

See IdeaScore Run a Call with Your Own Rubric

A 30-minute walkthrough with a product specialist, using your programme's form and criteria.

IdeaScore