Question 300
A chatbot's input appears below its context limit when counted as characters, yet requests fail after retrieval adds several lengthy documents and output tokens. What budget should engineers measure?
Explanation
Correct Answer
Context windows are token-based and include more than the visible user message. Full prompt assembly and output allocation must fit the chosen deployment's supported budget.
Incorrect Answers
Message count ignores content size.
Characters do not map consistently to tokens.
Spend does not establish an individual request's token limit.