← Heatmap / Gemini 3.1 Flash Lite · Task 10
Gemini 3.1 Flash Lite · Tool use · Task 10 (Calculation, middle bracket)
Mean 100.0%
| Field | Expected | Rollout #1 (100%) | Rollout #2 (100%) | Rollout #3 (100%) |
|---|---|---|---|---|
| decision | calculate | calculate | calculate | calculate |
| currency | LCR | LCR | LCR | LCR |
| gross pay | 1978.24 | 1978.24 | 1978.24 | 1978.24 |
| employee contribution | 79.13 | 79.13 | 79.13 | 79.13 |
| allowed deduction | 82.86 | 82.86 | 82.86 | 82.86 |
| taxable pay | 1816.25 | 1816.25 | 1816.25 | 1816.25 |
| income tax | 61.63 | 61.63 | 61.63 | 61.63 |
| net pay | 1754.62 | 1754.62 | 1754.62 | 1754.62 |
| clauses | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 |
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer. Retrieve the case inputs with list_documents and read_document. Reference rows are available only through lookup_reference. Use calculate for exact decimal arithmetic.
Rollouts
Rollout #1 100.0% passed · 4 tool calls · 5.6s · $0.0033
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 100.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 100.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
list_documents()Tool
[
{"id": "8d558bb0cabd2e37-payroll", "kind": "payroll"}
]
Assistant
read_document(document_id="8d558bb0cabd2e37-payroll")Tool
{
"kind": "payroll",
"record": {"gross_pay": "1978.24", "payroll_month": "2026-10", "allowed_deduction": "82.86"}
}
Assistant
lookup_reference(reference="second-half")Tool
{
"reference": "second-half",
"months": ["2026-07", "2026-12"],
"rate": "0.04",
"cap": "4000.00",
"deduction": "400.00",
"free": "1200.00",
"upper": "3000.00",
"middle_rate": "0.10",
"upper_rate": "0.22"
}
Assistant
calculate(program="employee_contribution = round(min(1978.24, 4000.00) * 0.04, 2)\ntaxable_pay = 1978.24 - employee_contribution - 82.86\ntax_part1 = max(0, min(taxable_pay, 3000.00) - 1200.00) * 0.10\ntax_part2 = max(0, taxable_pay - 3000.00) * 0.22\nincome_tax = round(tax_part1 + tax_part2, 2)\nnet_pay = 1978.24 - employee_contribution - 82.86 - income_tax")Tool
{
"results": {"employee_contribution": "79.13", "taxable_pay": "1816.25", "tax_part1": "61.6250", "tax_part2": "0.00", "income_tax": "61.63", "net_pay": "1754.62"}
}
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "1978.24",
"employee_contribution": "79.13",
"allowed_deduction": "82.86",
"taxable_pay": "1816.25",
"income_tax": "61.63",
"net_pay": "1754.62",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}
Rollout #2 100.0% passed · 4 tool calls · 4.3s · $0.0033
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 100.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 100.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
list_documents()Tool
[
{"id": "8d558bb0cabd2e37-payroll", "kind": "payroll"}
]
Assistant
read_document(document_id="8d558bb0cabd2e37-payroll")Tool
{
"kind": "payroll",
"record": {"gross_pay": "1978.24", "payroll_month": "2026-10", "allowed_deduction": "82.86"}
}
Assistant
lookup_reference(reference="second-half")Tool
{
"reference": "second-half",
"months": ["2026-07", "2026-12"],
"rate": "0.04",
"cap": "4000.00",
"deduction": "400.00",
"free": "1200.00",
"upper": "3000.00",
"middle_rate": "0.10",
"upper_rate": "0.22"
}
Assistant
calculate(program="employee_contribution = round(min(1978.24, 4000.00) * 0.04, 2)\ntaxable_pay = 1978.24 - employee_contribution - 82.86\ntax_bracket_1 = max(0, min(taxable_pay, 1200.00) - 0.00) * 0.00\ntax_bracket_2 = max(0, min(taxable_pay, 3000.00) - 1200.00) * 0.10\ntax_bracket_3 = max(0, taxable_pay - 3000.00) * 0.22\nincome_tax = round(tax_bracket_1 + tax_bracket_2 + tax_bracket_3, 2)\nnet_pay = 1978.24 - employee_contribution - 82.86 - income_tax")Tool
{
"results": {"employee_contribution": "79.13", "taxable_pay": "1816.25", "tax_bracket_1": "0.0000", "tax_bracket_2": "61.6250", "tax_bracket_3": "0.00", "income_tax": "61.63", "net_pay": "1754.62"}
}
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "1978.24",
"employee_contribution": "79.13",
"allowed_deduction": "82.86",
"taxable_pay": "1816.25",
"income_tax": "61.63",
"net_pay": "1754.62",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}
Rollout #3 100.0% passed · 4 tool calls · 4.9s · $0.0033
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 100.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 100.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
list_documents()Tool
[
{"id": "8d558bb0cabd2e37-payroll", "kind": "payroll"}
]
Assistant
read_document(document_id="8d558bb0cabd2e37-payroll")Tool
{
"kind": "payroll",
"record": {"gross_pay": "1978.24", "payroll_month": "2026-10", "allowed_deduction": "82.86"}
}
Assistant
lookup_reference(reference="second-half")Tool
{
"reference": "second-half",
"months": ["2026-07", "2026-12"],
"rate": "0.04",
"cap": "4000.00",
"deduction": "400.00",
"free": "1200.00",
"upper": "3000.00",
"middle_rate": "0.10",
"upper_rate": "0.22"
}
Assistant
calculate(program="employee_contribution = round(min(1978.24, 4000.00) * 0.04, 2)\ntaxable_pay = 1978.24 - employee_contribution - 82.86\ntax_bracket1 = max(0, min(taxable_pay, 1200.00) - 0)\ntax_bracket2 = max(0, min(taxable_pay, 3000.00) - 1200.00)\ntax_bracket3 = max(0, taxable_pay - 3000.00)\nincome_tax = round(tax_bracket1 * 0.00 + tax_bracket2 * 0.10 + tax_bracket3 * 0.22, 2)\nnet_pay = 1978.24 - employee_contribution - 82.86 - income_tax")Tool
{
"results": {"employee_contribution": "79.13", "taxable_pay": "1816.25", "tax_bracket1": "1200.00", "tax_bracket2": "616.25", "tax_bracket3": "0", "income_tax": "61.63", "net_pay": "1754.62"}
}
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "1978.24",
"employee_contribution": "79.13",
"allowed_deduction": "82.86",
"taxable_pay": "1816.25",
"income_tax": "61.63",
"net_pay": "1754.62",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}