PROTOTYPE DATA — For demonstration only. Not connected to production systems.

Prototype navigation only — switching does not authenticate across portals or change tenancy. Employer work uses employer sign-in; Operations staff use the Ops staff switcher.

Assessment Quality & Reviewer Calibration Audit

AUD-2026-AQ-014 · Assessment-quality audit · Immutable append-only report

Back to Audit & Activity Controls
Amani Otieno

Report metadata

Employer
Company PLC
Outcome
Warning
Audit period
Last 90 days
Trigger
Manual
Initiated by
Amani Otieno
Generated
2026-06-18 14:42:00
Scope
Assessment quality
Records analysed
46

Executive summary

Pattern detected; human review required. One reviewer submitted 72% materially high ratings and another submitted 48% materially low ratings. Twelve extreme ratings lacked sufficient comments.

Findings by severity

Critical (0)

  • None

Warning (3)

  • Reviewer score distribution is materially higher than the organisational baseline

    Warning

    One reviewer submitted 72% materially high ratings (4.5–5.0).

    Assessment quality · Human reviewer calibration recommended.

  • Reviewer score distribution is materially lower than the organisational baseline

    Warning

    One reviewer submitted 48% materially low ratings (0.0–1.5).

    Assessment quality · Review sample assessments and confirm scoring standards.

  • Extreme ratings require evidence review

    Warning

    Twelve extreme ratings lacked sufficient comments.

    Evidence · Require comments for ratings at 0.0–1.0 and 4.5–5.0.

Observation (1)

  • Repeated identical scoring may require calibration

    Observation

    Unusual rating pattern detected where every pillar received the same score on multiple assessments.

    Assessment quality · Include calibration in the next HR review meeting.

Information (0)

  • None

HR reviewer calibration

James Otieno

Assessments: 18Mean: 4.4Median: 4.5Low: 0%High: 72%Extreme: 39%Comments: 33%Evidence: 61%Identical scoring pattern

Grace Njeri

Assessments: 12Mean: 2.1Median: 2Low: 48%High: 8%Extreme: 25%Comments: 42%Evidence: 58%Varied scoring

Possible scoring imbalance indicators require human review and do not automatically accuse reviewers of bias or misconduct.

Report sections

Scoring-distribution analysis

Distribution shows polarisation between two reviewers rather than an organisational baseline issue.

  • Materially low (0.0–1.5): 19%
  • Expected band (3.0–3.5): 28%
  • Materially high (4.5–5.0): 24%

Possible bias and imbalance indicators

Possible scoring imbalance detected. These indicators require human review and are not automatic accusations.

  • Reviewers requiring calibration: 2
  • Insufficient sample size cases: 1

Recommended actions

  • Human reviewer calibration recommended for James Otieno and Grace Njeri.
  • Require comments on extreme ratings before approval.
  • Compare department-level distributions in the next scheduled audit.

Previous-period comparison

Extreme-score rate increased versus the prior 90-day window.

Methodology and limitations

Assessment-quality audit using the ERN 1–5 half-step scale. Score bands are analytical references, not verdicts. Patterns identify possible scoring imbalance for human review only.

Audit trail

  • Report generated at 2026-06-18 14:42:00 by Amani Otieno.
  • Report reference AUD-2026-AQ-014 is immutable and append-only.
  • Ordinary employer users cannot edit, delete or replace this report.