Luma Payroll Gym
← Heatmap / Gemini 3.1 Flash Lite · Task 75
Gemini 3.1 Flash Lite · Tool use · Task 75 (Calculation, half-cent rounding tie) Mean 100.0%
Field Expected Rollout #1 (100%) Rollout #2 (100%) Rollout #3 (100%)
decision calculate calculate calculate calculate
currency LCR LCR LCR LCR
gross pay 2107.50 2107.50 2107.50 2107.50
employee contribution 147.53 147.53 147.53 147.53
allowed deduction 273.91 273.91 273.91 273.91
taxable pay 1686.06 1686.06 1686.06 1686.06
income tax 54.88 54.88 54.88 54.88
net pay 1631.18 1631.18 1631.18 1631.18
clauses R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer.
Retrieve the case inputs with list_documents and read_document. Reference rows are available only through lookup_reference. Use calculate for exact decimal arithmetic.
Rollouts
Rollout #1 100.0% passed · 4 tool calls · 6.1s · $0.0034
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 100.0% R1 R2 R3 R4 R5 R6
field accuracy 100.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
list_documents()
Tool
[
  {"id": "9c34fc341666103e-payroll", "kind": "payroll"}
]
Assistant
read_document(document_id="9c34fc341666103e-payroll")
Tool
{
  "kind": "payroll",
  "record": {"gross_pay": "2107.50", "payroll_month": "2026-04", "allowed_deduction": "273.91"}
}
Assistant
lookup_reference(reference="first-half")
Tool
{
  "reference": "first-half",
  "months": ["2026-01", "2026-06"],
  "rate": "0.07",
  "cap": "4500.00",
  "deduction": "400.00",
  "free": "1000.00",
  "upper": "3600.00",
  "middle_rate": "0.08",
  "upper_rate": "0.24"
}
Assistant
calculate(program="employee_contribution = round(min(2107.50, 4500.00) * 0.07, 2)\ntaxable_pay = 2107.50 - employee_contribution - 273.91\ntax_bracket_1 = max(0, min(taxable_pay, 1000.00) - 0) * 0.00\ntax_bracket_2 = max(0, min(taxable_pay, 3600.00) - 1000.00) * 0.08\ntax_bracket_3 = max(0, taxable_pay - 3600.00) * 0.24\nincome_tax = round(tax_bracket_1 + tax_bracket_2 + tax_bracket_3, 2)\nnet_pay = 2107.50 - employee_contribution - 273.91 - income_tax")
Tool
{
  "results": {"employee_contribution": "147.53", "taxable_pay": "1686.06", "tax_bracket_1": "0.0000", "tax_bracket_2": "54.8848", "tax_bracket_3": "0.00", "income_tax": "54.88", "net_pay": "1631.18"}
}
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "2107.50",
  "employee_contribution": "147.53",
  "allowed_deduction": "273.91",
  "taxable_pay": "1686.06",
  "income_tax": "54.88",
  "net_pay": "1631.18",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}
Rollout #2 100.0% passed · 4 tool calls · 6.1s · $0.0034
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 100.0% R1 R2 R3 R4 R5 R6
field accuracy 100.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
list_documents()
Tool
[
  {"id": "9c34fc341666103e-payroll", "kind": "payroll"}
]
Assistant
read_document(document_id="9c34fc341666103e-payroll")
Tool
{
  "kind": "payroll",
  "record": {"gross_pay": "2107.50", "payroll_month": "2026-04", "allowed_deduction": "273.91"}
}
Assistant
lookup_reference(reference="first-half")
Tool
{
  "reference": "first-half",
  "months": ["2026-01", "2026-06"],
  "rate": "0.07",
  "cap": "4500.00",
  "deduction": "400.00",
  "free": "1000.00",
  "upper": "3600.00",
  "middle_rate": "0.08",
  "upper_rate": "0.24"
}
Assistant
calculate(program="employee_contribution = round(min(2107.50, 4500.00) * 0.07, 2)\ntaxable_pay = 2107.50 - employee_contribution - 273.91\ntax_bracket_1 = max(0, min(taxable_pay, 1000.00) - 0.00) * 0.00\ntax_bracket_2 = max(0, min(taxable_pay, 3600.00) - 1000.00) * 0.08\ntax_bracket_3 = max(0, taxable_pay - 3600.00) * 0.24\nincome_tax = round(tax_bracket_1 + tax_bracket_2 + tax_bracket_3, 2)\nnet_pay = 2107.50 - employee_contribution - 273.91 - income_tax")
Tool
{
  "results": {"employee_contribution": "147.53", "taxable_pay": "1686.06", "tax_bracket_1": "0.0000", "tax_bracket_2": "54.8848", "tax_bracket_3": "0.00", "income_tax": "54.88", "net_pay": "1631.18"}
}
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "2107.50",
  "employee_contribution": "147.53",
  "allowed_deduction": "273.91",
  "taxable_pay": "1686.06",
  "income_tax": "54.88",
  "net_pay": "1631.18",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}
Rollout #3 100.0% passed · 4 tool calls · 4.8s · $0.0033
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 100.0% R1 R2 R3 R4 R5 R6
field accuracy 100.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
list_documents()
Tool
[
  {"id": "9c34fc341666103e-payroll", "kind": "payroll"}
]
Assistant
read_document(document_id="9c34fc341666103e-payroll")
Tool
{
  "kind": "payroll",
  "record": {"gross_pay": "2107.50", "payroll_month": "2026-04", "allowed_deduction": "273.91"}
}
Assistant
lookup_reference(reference="first-half")
Tool
{
  "reference": "first-half",
  "months": ["2026-01", "2026-06"],
  "rate": "0.07",
  "cap": "4500.00",
  "deduction": "400.00",
  "free": "1000.00",
  "upper": "3600.00",
  "middle_rate": "0.08",
  "upper_rate": "0.24"
}
Assistant
calculate(program="employee_contribution = round(min(2107.50, 4500.00) * 0.07, 2)\ntaxable_pay = 2107.50 - employee_contribution - 273.91\ntax_bracket1 = max(0, min(taxable_pay, 1000.00) - 0.00) * 0.00\ntax_bracket2 = max(0, min(taxable_pay, 3600.00) - 1000.00) * 0.08\ntax_bracket3 = max(0, taxable_pay - 3600.00) * 0.24\nincome_tax = round(tax_bracket1 + tax_bracket2 + tax_bracket3, 2)\nnet_pay = 2107.50 - employee_contribution - 273.91 - income_tax")
Tool
{
  "results": {"employee_contribution": "147.53", "taxable_pay": "1686.06", "tax_bracket1": "0.0000", "tax_bracket2": "54.8848", "tax_bracket3": "0.00", "income_tax": "54.88", "net_pay": "1631.18"}
}
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "2107.50",
  "employee_contribution": "147.53",
  "allowed_deduction": "273.91",
  "taxable_pay": "1686.06",
  "income_tax": "54.88",
  "net_pay": "1631.18",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}