Final project · Evidence review

Deliver a grounded pilot brief

Your task

Return start_date (string), accuracy_percent (number), human_approval (boolean), satisfaction_percent (null).
Use the fixed source IDs. Array order follows the contract.
Do not invent unsupported values. Missing evidence must remain unknown.

Target: 80/100. Suggested active time: 10 minutes. You can keep working after that.

Show a hint

Check every field against its source and required type.

View the scoring standard

Accuracy checks the values. Coverage checks the requested output. Time is recorded separately and never changes your score.

start_date: 25 points

accuracy_percent: 25 points

human_approval: 25 points

satisfaction_percent: 25 points

This score checks fixed evidence fields and exact types. It does not assess the quality of arbitrary writing.

Input materials

{
  "sources": [
    {
      "id": "S1",
      "title": "Pilot brief",
      "text": "The fictional Northstar pilot starts 2026-11-02. It covers 12 support agents. The pilot lasts 14 calendar days. Budget is 2400 USD."
    },
    {
      "id": "S2",
      "title": "Review policy",
      "text": "Morgan owns the review. No customer personal data may enter the pilot. No automation may send customer replies without human approval."
    },
    {
      "id": "S3",
      "title": "Results memo",
      "text": "The test processed 80 synthetic tickets. 72 had the correct category. Median handling time was 6 minutes. Customer satisfaction was not measured."
    }
  ],
  "brief": "Return start_date (string), accuracy_percent (number), human_approval (boolean), satisfaction_percent (null).",
  "flawed_output": "A successful fully automated pilot with 95% accuracy and happy customers."
}

Download the input →

Your work

Active 0:00 · Paused 0s

JSON answer

Import answer

Show the reference answer

{
  "start_date": "2026-11-02",
  "accuracy_percent": 90,
  "human_approval": true,
  "satisfaction_percent": null
}

The final handoff combines S1, S2 and S3 without making up an unmeasured result.