Assessment Item Analyzer
Compare question success rates and upper/lower-group differences to identify items worth reviewing.
- 1Explore the example
- 2Edit your assumptions
- 3Compare & export
Loading the worked example…
Your working data
Edit cells directly or import a CSV. Download “Input CSV” for the required column names. Up to 200 rows; scroll the table sideways for additional fields.
Detailed analysis
Exports include all results, regardless of the search filter. The HTML report includes assumptions and source data; use your browser’s Print command for PDF.
Chart shows the first 20 rows; negative values use a warm color. Click table headers to sort.
Compare up to four scenarios
Capture the current inputs, change assumptions and capture again. Scenarios are included in downloaded projects.
What this model includes
Upper and lower groups must be disjoint subsets of the attempts. Difference is upper success fraction minus lower; small samples are unstable and no formal significance test is performed.
Import and save safely
CSV imports use your current assumptions. Project files restore assumptions, rows and saved scenarios. No automatic saving: download a project before closing this page. Imports are limited to 10 MiB and 200 rows. Calculations run in your browser; the site’s advertising and analytics follow its privacy policy.
Using Assessment Item Analyzer
Compare question success rates and upper/lower-group differences to identify items worth reviewing.
- Review the preloaded example and the model limits before entering real data.
- Adjust low success threshold (%), high success threshold (%).
- Edit the question id rows or import a CSV using the Input CSV column template.
- Open Results & chart to inspect details, sort columns and filter rows.
- Capture alternative scenarios, then download a project, result CSV or printable report.
Example
The worked example includes Q1, Q2, Q3. Change the first low success threshold (%) setting and compare the result with a saved baseline.
Questions & answers
What does Assessment Item Analyzer calculate?
Compare question success rates and upper/lower-group differences to identify items worth reviewing.
What are the important limitations?
Upper and lower groups must be disjoint subsets of the attempts. Difference is upper success fraction minus lower; small samples are unstable and no formal significance test is performed.
Can I continue my work later?
Yes. Save a project JSON file and reopen it with Import CSV / project. It contains the working data, assumptions and up to four scenarios. Nothing is saved automatically.
What CSV columns do I need?
item, attempts, correct, upperN, upper, lowerN, lower. Download Input CSV for a compatible example. CSV imports keep your current assumptions.
Are these example figures current industry benchmarks?
No. They are illustrative values to demonstrate the model. Replace them with figures appropriate to your situation.
Help improve this tool
Report a problem or suggest an improvement
Describe the issue without pasting private tool input. Feedback goes to our admin inbox.
