EdReports
Evaluation runs
Every scored judge run, treated as a rater and measured against gold. Track the model bake-off and Signal Studio vs AutoEdReport across the canonical curricula.
47 scored runs across 4 curricula
| Source | Model | Date | Indicator | κw | Gateway | Diverge |
|---|---|---|---|---|---|---|
| AutoEdReport | — | 2026-05-25 | 86%n=28 | 0.93 | 100% | 4 |
| Signal Studio | claude-sonnet-4-6 | 2026-05-25 | — | — | 100% | 0 |
| Signal Studio | claude-sonnet-4-6 | 2026-05-25 | 82%n=28 | 0.87 | 100% | 5 |
| Signal Studio | claude-haiku-4-5 | 2026-05-25 | 61%n=28 | 0.76 | 67% | 11 |
| AutoEdReport | — | 2026-05-25 | 89%n=28 | 0.89 | 100% | 3 |
| AutoEdReport | — | 2026-05-25 | 86%n=28 | 0.88 | 67% | 4 |
| Signal Studio | claude-opus-4-7 | 2026-05-25 | — | — | 100% | 0 |
| AutoEdReport | — | 2026-05-25 | 57%n=28 | 0.72 | 33% | 12 |
| Signal Studio | claude-opus-4-7 | 2026-05-25 | — | — | 100% | 0 |
| Signal Studio | claude-sonnet-4-6 | 2026-05-25 | — | — | 33% | 0 |
| Signal Studio | claude-sonnet-4-6 | 2026-05-25 | — | — | 100% | 0 |
| AutoEdReport | — | 2026-05-25 | 86%n=28 | 0.88 | 100% | 4 |
| AutoEdReport | — | 2026-05-25 | 54%n=28 | 0.62 | 0% | 13 |
| AutoEdReport | — | 2026-05-25 | 71%n=28 | 0.72 | 100% | 8 |
| AutoEdReport | — | 2026-05-25 | 68%n=28 | 0.70 | 100% | 9 |
| AutoEdReport | — | 2026-05-25 | 89%n=28 | 0.95 | 100% | 3 |
| AutoEdReport | — | 2026-05-25 | 82%n=28 | 0.76 | 100% | 5 |
| AutoEdReport | — | 2026-05-25 | 43%n=28 | 0.52 | 0% | 16 |
| AutoEdReport | — | 2026-05-25 | 79%n=28 | 0.74 | 100% | 6 |
| Signal Studio | claude-opus-4-7 | 2026-05-25 | 86%n=28 | 0.84 | 100% | 4 |
| Signal Studio | claude-sonnet-4-6 | 2026-05-24 | — | — | 0% | 0 |
| Signal Studio | claude-sonnet-4-6 | 2026-05-24 | 71%n=28 | 0.71 | 33% | 8 |
| Source | Model | Date | Indicator | κw | Gateway | Diverge |
|---|---|---|---|---|---|---|
| Signal Studio | claude-sonnet-4-6 | 2026-05-25 | 100%n=29 | 1.00 | 100% | 0 |
| Signal Studio | claude-haiku-4-5 | 2026-05-25 | 100%n=29 | 1.00 | 100% | 0 |
| Signal Studio | claude-sonnet-4-6 | 2026-05-25 | 100%n=29 | 1.00 | 100% | 0 |
| Signal Studio | claude-sonnet-4-6 | 2026-05-25 | 100%n=29 | 1.00 | 100% | 0 |
| Signal Studio | claude-opus-4-7 | 2026-05-25 | 100%n=29 | 1.00 | 100% | 0 |
| Signal Studio | claude-opus-4-7 | 2026-05-25 | 100%n=29 | 1.00 | 100% | 0 |
| Signal Studio | claude-sonnet-4-6 | 2026-05-25 | 100%n=29 | 1.00 | 100% | 0 |
| Signal Studio | claude-opus-4-7 | 2026-05-25 | 100%n=29 | 1.00 | 100% | 0 |
| Signal Studio | claude-sonnet-4-6 | 2026-05-24 | 90%n=29 | 0.80 | 100% | 3 |
| AutoEdReport | — | 2026-05-24 | 48%n=29 | 0.28 | 0% | 15 |
| AutoEdReport | — | 2026-05-24 | 97%n=29 | 0.97 | 100% | 1 |
| Signal Studio | claude-sonnet-4-6 | 2026-05-24 | 100%n=29 | 1.00 | 100% | 0 |
| Signal Studio | claude-sonnet-4-6 | 2026-05-24 | 100%n=29 | 1.00 | 100% | 0 |
| Signal Studio | claude-sonnet-4-6 | 2026-05-24 | 97%n=29 | 0.86 | 100% | 1 |
| AutoEdReport | — | 2026-05-24 | 100%n=29 | 1.00 | 100% | 0 |
| AutoEdReport | — | 2026-05-24 | 100%n=29 | 1.00 | 100% | 0 |
| AutoEdReport | — | 2026-05-24 | 100%n=29 | 1.00 | 100% | 0 |
| AutoEdReport | — | 2026-05-24 | 97%n=29 | 0.97 | 100% | 1 |
| AutoEdReport | — | 2026-05-24 | 31%n=29 | 0.27 | 0% | 20 |
| Source | Model | Date | Indicator | κw | Gateway | Diverge |
|---|---|---|---|---|---|---|
| AutoEdReport | — | 2026-05-25 | 97%n=30 | 0.97 | 100% | 1 |
| Signal Studio | claude-opus-4-7 | 2026-05-25 | 97%n=30 | 0.90 | 100% | 1 |
| Source | Model | Date | Indicator | κw | Gateway | Diverge |
|---|---|---|---|---|---|---|
| AutoEdReport | — | 2026-05-24 | — | — | 100% | 0 |
| AutoEdReport | — | 2026-05-24 | — | — | 100% | 0 |
| AutoEdReport | — | 2026-05-24 | — | — | 67% | 0 |
| Signal Studio | claude-sonnet-4-6 | 2026-05-24 | — | — | 0% | 0 |