← Heatmap / Gemini 3.1 Flash Lite · Task 8
Gemini 3.1 Flash Lite · Single-turn · Task 8 (Calculation, half-cent rounding tie, resolved amendment)
Mean -50.0%
| Field | Expected | Rollout #1 (-50%) | Rollout #2 (-50%) | Rollout #3 (-50%) |
|---|---|---|---|---|
| decision | calculate | clarify | clarify | clarify |
| currency | LCR | |||
| gross pay | 1778.50 | |||
| employee contribution | 124.50 | |||
| allowed deduction | 0.00 | |||
| taxable pay | 1654.00 | |||
| income tax | 77.56 | |||
| net pay | 1576.44 | |||
| reason code | CONFLICTING_GROSS_PAY | CONFLICTING_GROSS_PAY | CONFLICTING_GROSS_PAY | |
| clauses | R1 R2 R3 R4 R5 R6 R9 | R7 R9 | R7 R9 | R7 R9 |
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer.
Source documents: {"e1069c99b8f7bcf9-payroll": {"kind": "payroll", "record": {"gross_pay": "1778.50", "payroll_month": "2026-07", "allowed_deduction": "0.00"}}, "e1069c99b8f7bcf9-contract": {"kind": "contract", "gross_pay": "2254.61"}, "e1069c99b8f7bcf9-amendment": {"kind": "amendment", "gross_pay": "1778.50", "approved": true, "effective_month": "2026-04"}}
Authoritative case reference schedule: {"first-half": {"rate": "0.07", "cap": "5000.00", "deduction": "400.00", "free": "1000.00", "upper": "3300.00", "middle_rate": "0.14", "upper_rate": "0.24"}, "second-half": {"rate": "0.07", "cap": "4000.00", "deduction": "400.00", "free": "1100.00", "upper": "3300.00", "middle_rate": "0.14", "upper_rate": "0.22"}}
Rollouts
Rollout #1 -50.0% wrong decision · 1.5s · $0.0007
| Component | Score | Clauses |
|---|---|---|
| decision | 0.0% | R1 R2 R3 R4 R5 R6 R9 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 R9 |
| field accuracy | 0.0% | R1 R2 R3 R4 R5 R6 R9 |
| citations | 0.0% | R1 R2 R3 R4 R5 R6 R9 |
Assistant
{
"decision": "clarify",
"reason_code": "CONFLICTING_GROSS_PAY",
"clauses": ["R7", "R9"],
"explanation": "The payroll record gross_pay of 1778.50 conflicts with the contract gross_pay of 2254.61. The provided amendment is not effective for the 2026-07 payroll month, leaving the conflict unresolved."
}
Rollout #2 -50.0% wrong decision · 1.0s · $0.0007
| Component | Score | Clauses |
|---|---|---|
| decision | 0.0% | R1 R2 R3 R4 R5 R6 R9 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 R9 |
| field accuracy | 0.0% | R1 R2 R3 R4 R5 R6 R9 |
| citations | 0.0% | R1 R2 R3 R4 R5 R6 R9 |
Assistant
{
"decision": "clarify",
"reason_code": "CONFLICTING_GROSS_PAY",
"clauses": ["R7", "R9"],
"explanation": "The payroll record's gross_pay (1778.50) conflicts with the contract gross_pay (2254.61). The provided amendment is not effective for the payroll month (2026-07), leaving the conflict unresolved."
}
Rollout #3 -50.0% wrong decision · 1.0s · $0.0007
| Component | Score | Clauses |
|---|---|---|
| decision | 0.0% | R1 R2 R3 R4 R5 R6 R9 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 R9 |
| field accuracy | 0.0% | R1 R2 R3 R4 R5 R6 R9 |
| citations | 0.0% | R1 R2 R3 R4 R5 R6 R9 |
Assistant
{
"decision": "clarify",
"reason_code": "CONFLICTING_GROSS_PAY",
"clauses": ["R7", "R9"],
"explanation": "The payroll record's gross_pay of 1778.50 conflicts with the contract's gross_pay of 2254.61. The amendment, while approved, has an effective_month of 2026-04, which does not resolve a conflict for the 2026-07 payroll month."
}