Independent practice · Evidence review

Repair an inflated accuracy claim

Your task

Return correct_tickets, total_tickets (numbers), accuracy_percent (number), source_ids (array).
Use the fixed source IDs. Array order follows the contract.
Do not invent unsupported values. Missing evidence must remain unknown.

Target: 70/100. Suggested active time: 10 minutes. You can keep working after that.

Show a hint

Check the denominator before calculating the percent.

View the scoring standard

Accuracy checks the values. Coverage checks the requested output. Time is recorded separately and never changes your score.

correct_tickets: 25 points

total_tickets: 25 points

accuracy_percent: 25 points

source_ids: 25 points

This score checks fixed evidence fields and exact types. It does not assess the quality of arbitrary writing.

Input materials

{
  "sources": [
    {
      "id": "S1",
      "title": "Pilot brief",
      "text": "The fictional Northstar pilot starts 2026-11-02. It covers 12 support agents. The pilot lasts 14 calendar days. Budget is 2400 USD."
    },
    {
      "id": "S2",
      "title": "Review policy",
      "text": "Morgan owns the review. No customer personal data may enter the pilot. No automation may send customer replies without human approval."
    },
    {
      "id": "S3",
      "title": "Results memo",
      "text": "The test processed 80 synthetic tickets. 72 had the correct category. Median handling time was 6 minutes. Customer satisfaction was not measured."
    }
  ],
  "brief": "Return correct_tickets, total_tickets (numbers), accuracy_percent (number), source_ids (array).",
  "flawed_output": "The pilot achieved 95% accuracy across 100 tickets."
}

Download the input →

Your work

Active 0:00 · Paused 0s

JSON answer

Import answer

Show the reference answer

{
  "correct_tickets": 72,
  "total_tickets": 80,
  "accuracy_percent": 90,
  "source_ids": [
    "S3"
  ]
}

Compute 72 ÷ 80 × 100 = 90. S3 is the fixed evidence.