← Back to field notes

AGENT ECONOMICS / EDITORIAL GUIDE

Budget for accepted work, including the retries

A cheap generation is not the same as a cheap useful result. Include review effort, failed attempts and peak demand in the plan.

Norla Editorial5 min

A cost estimate based on one clean model call usually describes the easiest part of an operating workflow. Real jobs may retrieve context, invoke tools, encounter errors and return for revision. A team deciding whether a workflow is worthwhile needs to understand the cost of an accepted result, including the work that was rejected along the way.

Choose a unit the business recognizes, such as one approved brief or one reviewed support suggestion. List the steps required to produce it and record expected volumes, input sizes, retry rates and review time. Use current provider prices supplied by the team rather than embedding a price that will quietly become outdated.

Build at least three scenarios and identify the assumption that matters most. If review time dominates, switching to a cheaper model may not address the main cost. If long source documents dominate, a better retrieval boundary may be more useful. Treat these as design questions to test, not automatic conclusions from a spreadsheet.

Add an operating response to the budget. Define maximum attempts, spending boundaries and what the workflow returns when it reaches a limit. Save partial work and a clear status when appropriate. An explicit fallback is more useful than either endless retries or a completion message issued after the task has stopped making progress.

Put it into practice

  • Define one accepted unit of work.
  • Include tool calls, retries and human review.
  • Create low, expected and high usage scenarios.
  • Set a retry limit and a visible fallback status.
NORLA EDITORIAL · WORKED Q&A

Questions worth following through.

Specific questions, practical answers, and the next detail to check. Prepared by Norla Editorial.

Question 01

A workflow produces usable briefs quickly, but reviewers spend additional time restoring missing references. How should an operator compare its cost with a slower process that usually arrives ready for review?

Norla Editorial · Answer

Compare the same accepted deliverable and include the reference repair work in the faster workflow's cost. Keep ordinary subject-matter approval separate from avoidable correction. Track attempts, external charges when known, and review effort for each process. A shorter drafting stage does not settle which complete process uses fewer resources.

Follow-up question

What if reviewers perform those repairs during an existing meeting and say they cannot separate the time precisely from their other review duties?

Norla Editorial · Clarification

Use an explicitly labeled estimate or range and record the uncertainty instead of assigning zero time. A brief sampling exercise can help distinguish recurring repairs from routine judgment. The comparison should remain useful for a decision without pretending that incomplete measurement supports a precise savings figure.

Question 02

A team sets a retry limit for a drafting task, but difficult inputs repeatedly reach that limit without producing usable work. Which operating change should be considered before increasing the allowance?

Norla Editorial · Answer

Classify the failures first. Missing evidence, contradictory instructions, and formatting errors may require different responses. Improve the input contract, return a specific correction request, or route a partial result to review where appropriate. Increasing attempts only helps if another attempt has a plausible path to resolving the identified failure.

Follow-up question

How should the capacity plan represent tasks that are returned to the requester and completed later, rather than accepted during the original operating window?

Norla Editorial · Clarification

Track them as deferred work with their own remaining effort and review needs. Do not count the first window as a completed unit or remove the later effort from the estimate. The plan should make carryover visible so apparent throughput does not improve simply by moving unresolved tasks elsewhere.

YOUR SIDE OF THE DISCUSSION

Add your perspective.

Your own notes stay private on this device. They are not sent to other members.

Background discussion & source notes
NORLA EDITORIAL / DISCUSSION DESK

Let’s take the question further.

Practical follow-ups, open questions and considered answers from the Norla editorial desk.

5 official discussion notes
Norla Editorial@norla.editorial · Note 01

Define accepted work before counting cost

A low price per model call can hide an expensive workflow if most outputs need repair. Start by defining the unit that matters to the team: an approved brief, a reconciled report, or a support suggestion that a reviewer can use. Track all attempts associated with that unit, including discarded drafts and manual review. For a planning exercise, keep tool charges, operator time, and exceptional rework separate so assumptions remain visible. The resulting estimate should describe cost per accepted result for a stated workload, not suggest that a cheap individual request proves the entire process is economical.

Norla Editorial@norla.editorial · Note 02
Following up: Define accepted work before counting cost

Budget a difficult reporting week

Consider a reporting assistant that usually receives a clean export but occasionally encounters changed columns and incomplete periods. A forecast based only on routine runs understates the effort needed during that difficult week. Build a small workload table with routine, repairable, and blocked cases. Estimate the allowed attempts and review effort for each, then show the mix used in the forecast. These are planning assumptions, not measured production performance. Ask which assumption would most change the decision to proceed. That conversation often matters more than optimizing a small component of the normal-case token bill.

Norla Editorial@norla.editorial · Note 03
Following up: Define accepted work before counting cost

Retry, escalate, or return partial work

Retries can help with some transient failures, but they are not a general remedy for missing data or an invalid instruction. An escalation may cost operator time yet prevent repeated unusable attempts. A partial result can be valuable if it states what is complete and what still needs review. Choose among these responses by failure type. For actions with side effects, also check the provider's duplicate-request behavior; Stripe's documented idempotency mechanism is one specific example, not a universal guarantee. The budget should reflect the chosen recovery path rather than assuming every unsuccessful run deserves another identical attempt.

Norla Editorial@norla.editorial · Note 04
Following up: Define accepted work before counting cost

Avoid counting repair time as free

A workflow can appear efficient when the person who fixes its outputs does not record the effort. This is especially easy when corrections happen inside an existing review meeting. Separate necessary subject-matter approval from avoidable repair, such as restoring omitted sources or reformatting invalid fields. Both consume time, but they suggest different improvements. Do not claim a time saving by comparing raw generation speed with the full previous process. Compare the same accepted deliverable and include setup, checking, and recovery. If the available measurements are incomplete, present a range and name the missing component.

Norla Editorial@norla.editorial · Note 05
Following up: Define accepted work before counting cost

Build a small cost review sheet

Use one sheet with a row for each completed or blocked task. Record workload type, number of attempts, external charges when known, review minutes, acceptance status, and reason for rejection. Add a separate line for setup and maintenance rather than spreading it invisibly across a few successful outputs. Review the rejected cases first to find a repeated cause that can be addressed. The next discussion should ask whether a tighter input contract, a different recovery rule, or additional reviewer guidance would reduce total effort without lowering the acceptance standard merely to improve the reported number.

NORLA EDITORIAL / FIELD NOTES

Continue exploring.

Working methods, decisions to document, and useful questions to take into your next project.

All field notes