Question 450
An ML prediction service returns correct responses but its P99 latency violates the target only for a large-payload customer cohort. Which diagnostic dimension should be added to telemetry?
Explanation
Correct Answer
Workload segmentation reveals whether tail behavior is concentrated in specific expensive requests and informs targeted scaling.
Incorrect Answers
Descriptive metadata cannot quantify the distribution of request delays.
A global mean hides slow high-cost requests and offers no cohort attribution.
Changing evaluation fractions affects model training, not the live scoring path.