ContextBudget
Tracks the last pre-flight input token estimate and compares it to provider-reported actuals.
Constructors
Section titled “Constructors”Constructor
Section titled “Constructor”new ContextBudget(config): ContextBudget;Parameters
Section titled “Parameters”| Parameter | Type |
|---|---|
|
|
Returns
Section titled “Returns”ContextBudget
Accessors
Section titled “Accessors”modelContextWindow
Section titled “modelContextWindow”Get Signature
Section titled “Get Signature”get modelContextWindow(): number;Returns
Section titled “Returns”number
Methods
Section titled “Methods”recordPreFlightEstimate()
Section titled “recordPreFlightEstimate()”recordPreFlightEstimate(estimatedInputTokens): void;Call after assembling the request (e.g. from onBeforeModelCall estimated tokens).
Parameters
Section titled “Parameters”| Parameter | Type |
|---|---|
|
|
|
Returns
Section titled “Returns”void
validateActual()
Section titled “validateActual()”validateActual(actualInputTokens): object;Compares the last pre-flight estimate to actual input tokens from the provider. Logs a warning when absolute drift percentage exceeds 20%.
Parameters
Section titled “Parameters”| Parameter | Type |
|---|---|
|
|
|
Returns
Section titled “Returns”object
actual
Section titled “actual”actual: number;drift: number;driftPct
Section titled “driftPct”driftPct: number;estimated
Section titled “estimated”estimated: number;