Question 140
During a root-cause review, the team reports: A crawler fetches HTML product manuals but outputs menu text instead of article content. What evidence best identifies the reason?
Explanation
Correct Answer
Correct. Extract text with a parser suited to source format; image-only scans require OCR rather than HTML or plain-text parsing. In the given situation — A crawler fetches HTML product manuals but outputs menu text instead of article content. — the targeted diagnose action is: Inspect MIME types, text-layer availability, encoding and parsing failures per source. It inspects the stage or constraint most likely to explain the observed failure before changing the system.
Incorrect Answers
Not the strongest diagnose choice for this specific question. Inspect data schema, primary identifiers, change detection, UC permissions and ingestion checkpoint behavior. This action primarily relates to Delta and Unity Catalog pipeline for chunk tables: A governed retrieval corpus stores chunk text, IDs, source lineage and metadata in managed Delta/Unity Catalog tables before indexing. However, the described case — A crawler fetches HTML product manuals but outputs menu text instead of article content. — is testing Format-specific document extraction and OCR needs. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.
Not the strongest diagnose choice for this specific question. Inspect heading structure, sentence breaks, table boundaries and parent document identifiers. This action primarily relates to Semantic boundaries versus fixed-window chunks: Headings, paragraphs and tables can require structure-aware splitting rather than arbitrary token windows. However, the described case — A crawler fetches HTML product manuals but outputs menu text instead of article content. — is testing Format-specific document extraction and OCR needs. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.
Not the strongest diagnose choice for this specific question. Inspect the most frequent n-grams, extracted layout artifacts and top retrieved false positives. This action primarily relates to Boilerplate and navigation filtering in source corpora: Duplicated headers, disclaimers and navigation menus contaminate embeddings and cause irrelevant hits. However, the described case — A crawler fetches HTML product manuals but outputs menu text instead of article content. — is testing Format-specific document extraction and OCR needs. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.