Question 690
An enterprise has a strict latency SLA for a steady high-volume chat workload but uses a best-effort consumption tier and observes unpredictable queuing. Which provisioned property may help?
Explanation
Correct Answer
Provisioned capacity reserves serving resources, reducing latency variance for suitable sustained workloads relative to best-effort consumption.
Incorrect Answers
Training epochs do not reserve inference capacity.
Labels cannot change throughput assurances.
Document count alone is not the capacity reservation mechanism.