Luma Payroll Gym
← Heatmap / Gemini 3.1 Flash Lite · Task 55
Gemini 3.1 Flash Lite · Tool use · Task 55 (Calculation, middle bracket) Mean 100.0%
Field Expected Rollout #1 (100%) Rollout #2 (100%) Rollout #3 (100%)
decision calculate calculate calculate calculate
currency LCR LCR LCR LCR
gross pay 3092.77 3092.77 3092.77 3092.77
employee contribution 216.49 216.49 216.49 216.49
allowed deduction 0.00 0.00 0.00 0.00
taxable pay 2876.28 2876.28 2876.28 2876.28
income tax 187.63 187.63 187.63 187.63
net pay 2688.65 2688.65 2688.65 2688.65
clauses R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer.
Retrieve the case inputs with list_documents and read_document. Reference rows are available only through lookup_reference. Use calculate for exact decimal arithmetic.
Rollouts
Rollout #1 100.0% passed · 4 tool calls · 4.9s · $0.0033
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 100.0% R1 R2 R3 R4 R5 R6
field accuracy 100.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
list_documents()
Tool
[
  {"id": "2dabbb0836821c10-payroll", "kind": "payroll"}
]
Assistant
read_document(document_id="2dabbb0836821c10-payroll")
Tool
{
  "kind": "payroll",
  "record": {"gross_pay": "3092.77", "payroll_month": "2026-06"}
}
Assistant
lookup_reference(reference="first-half")
Tool
{
  "reference": "first-half",
  "months": ["2026-01", "2026-06"],
  "rate": "0.07",
  "cap": "3500.00",
  "deduction": "400.00",
  "free": "1000.00",
  "upper": "3000.00",
  "middle_rate": "0.10",
  "upper_rate": "0.18"
}
Assistant
calculate(program="employee_contribution = round(min(3092.77, 3500.00) * 0.07, 2)\nallowed_deduction = 0.00\ntaxable_pay = 3092.77 - employee_contribution - allowed_deduction\ntax_bracket1 = min(taxable_pay, 1000.00) * 0.00\ntax_bracket2 = min(max(0, taxable_pay - 1000.00), 3000.00 - 1000.00) * 0.10\ntax_bracket3 = max(0, taxable_pay - 3000.00) * 0.18\nincome_tax = round(tax_bracket1 + tax_bracket2 + tax_bracket3, 2)\nnet_pay = 3092.77 - employee_contribution - allowed_deduction - income_tax")
Tool
{
  "results": {"employee_contribution": "216.49", "allowed_deduction": "0.00", "taxable_pay": "2876.28", "tax_bracket1": "0.0000", "tax_bracket2": "187.6280", "tax_bracket3": "0.00", "income_tax": "187.63", "net_pay": "2688.65"}
}
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "3092.77",
  "employee_contribution": "216.49",
  "allowed_deduction": "0.00",
  "taxable_pay": "2876.28",
  "income_tax": "187.63",
  "net_pay": "2688.65",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}
Rollout #2 100.0% passed · 4 tool calls · 5.6s · $0.0032
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 100.0% R1 R2 R3 R4 R5 R6
field accuracy 100.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
list_documents()
Tool
[
  {"id": "2dabbb0836821c10-payroll", "kind": "payroll"}
]
Assistant
read_document(document_id="2dabbb0836821c10-payroll")
Tool
{
  "kind": "payroll",
  "record": {"gross_pay": "3092.77", "payroll_month": "2026-06"}
}
Assistant
lookup_reference(reference="first-half")
Tool
{
  "reference": "first-half",
  "months": ["2026-01", "2026-06"],
  "rate": "0.07",
  "cap": "3500.00",
  "deduction": "400.00",
  "free": "1000.00",
  "upper": "3000.00",
  "middle_rate": "0.10",
  "upper_rate": "0.18"
}
Assistant
calculate(program="employee_contribution = round(min(3092.77, 3500.00) * 0.07, 2)\nallowed_deduction = 0.00\ntaxable_pay = 3092.77 - employee_contribution - allowed_deduction\nincome_tax = round(max(0, min(taxable_pay - 1000.00, 2000.00)) * 0.10 + max(0, taxable_pay - 3000.00) * 0.18, 2)\nnet_pay = 3092.77 - employee_contribution - allowed_deduction - income_tax\n")
Tool
{
  "results": {"employee_contribution": "216.49", "allowed_deduction": "0.00", "taxable_pay": "2876.28", "income_tax": "187.63", "net_pay": "2688.65"}
}
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "3092.77",
  "employee_contribution": "216.49",
  "allowed_deduction": "0.00",
  "taxable_pay": "2876.28",
  "income_tax": "187.63",
  "net_pay": "2688.65",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}
Rollout #3 100.0% passed · 4 tool calls · 5.7s · $0.0033
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 100.0% R1 R2 R3 R4 R5 R6
field accuracy 100.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
list_documents()
Tool
[
  {"id": "2dabbb0836821c10-payroll", "kind": "payroll"}
]
Assistant
read_document(document_id="2dabbb0836821c10-payroll")
Tool
{
  "kind": "payroll",
  "record": {"gross_pay": "3092.77", "payroll_month": "2026-06"}
}
Assistant
lookup_reference(reference="first-half")
Tool
{
  "reference": "first-half",
  "months": ["2026-01", "2026-06"],
  "rate": "0.07",
  "cap": "3500.00",
  "deduction": "400.00",
  "free": "1000.00",
  "upper": "3000.00",
  "middle_rate": "0.10",
  "upper_rate": "0.18"
}
Assistant
calculate(program="employee_contribution = round(min(3092.77, 3500.00) * 0.07, 2)\nallowed_deduction = 0.00\ntaxable_pay = 3092.77 - employee_contribution - allowed_deduction\ntax_bracket1 = min(taxable_pay, 1000.00) * 0.00\ntax_bracket2 = max(0, min(taxable_pay, 3000.00) - 1000.00) * 0.10\ntax_bracket3 = max(0, taxable_pay - 3000.00) * 0.18\nincome_tax = round(tax_bracket1 + tax_bracket2 + tax_bracket3, 2)\nnet_pay = 3092.77 - employee_contribution - allowed_deduction - income_tax\n")
Tool
{
  "results": {"employee_contribution": "216.49", "allowed_deduction": "0.00", "taxable_pay": "2876.28", "tax_bracket1": "0.0000", "tax_bracket2": "187.6280", "tax_bracket3": "0.00", "income_tax": "187.63", "net_pay": "2688.65"}
}
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "3092.77",
  "employee_contribution": "216.49",
  "allowed_deduction": "0.00",
  "taxable_pay": "2876.28",
  "income_tax": "187.63",
  "net_pay": "2688.65",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}