Question 570
An engineer trains an ML model to forecast interface congestion and reports 99% accuracy by testing on the same time windows used for training. What is the primary concern?
Explanation
Correct Answer
An ML model can memorize particular training patterns without predicting a later traffic surge reliably. A separated evaluation period better tests performance on unseen load and helps identify leakage from future observations. The engineer should compare useful forecast metrics and operational consequences rather than citing in-sample accuracy alone.
Incorrect Answers
Production-origin data can still be overfit. Authentic measurements do not replace an independent evaluation period.
Names identify devices but do not establish forecast reliability. A held-out time period and real congestion outcomes are the needed test.
Disk size and parameter count do not demonstrate predictive generalization. The case requires measuring unseen traffic outcomes.