Question 280
A retailer's product model uses one feature formula at training time and a different online calculation, causing incorrect forecasts. Which limitation must be considered before claiming the issue is fully resolved?
Explanation
Correct Answer
Equal feature definitions do not ensure the input population is free of drift. This caution prevents extrapolating beyond the specific evidence or product boundary. ML quality depends on parity of feature computation across lifecycle stages. The unresolved point should be tested using training feature transformations, serving payloads and prediction residuals by segment rather than assuming a working interface proves full compliance or resilience.
Incorrect Answers
Identical feature names guarantee identical feature values across environments. This limitation is framed as a blanket exception, but the case requires a different, narrower caution. The relevant boundary is that equal feature definitions do not ensure the input population is free of drift. ML quality depends on parity of feature computation across lifecycle stages. Inspect training feature transformations, serving payloads and prediction residuals by segment.
Training success proves that live input features are computed identically. The proposed claim mistakes an incomplete signal or product feature for a universal guarantee. The relevant boundary is that equal feature definitions do not ensure the input population is free of drift. ML quality depends on parity of feature computation across lifecycle stages. Inspect training feature transformations, serving payloads and prediction residuals by segment.
Model training convergence guarantees that the live API computes features identically. This claim exceeds the evidence and ignores an important risk or operational dependency. The relevant boundary is that equal feature definitions do not ensure the input population is free of drift. ML quality depends on parity of feature computation across lifecycle stages. Inspect training feature transformations, serving payloads and prediction residuals by segment.