Question 250
During a regional deployment expansion at a media technology business, engineers report the following issue: An engineer increases batch size without checking live device-memory use. The affected work supports language and visual-content AI services; different workloads compete for shared acceleration and storage. Choose TWO: one corrective approach and one result demonstrating it works. (Select TWO.)
Explanation
Correct Answers
Correct corrective action. Account for GPU memory capacity and the cost of moving inputs between host memory and device memory when assessing acceleration and batch size. This fits the specific reported issue: An engineer increases batch size without checking live device-memory use. The corresponding failure being reduced is: Transfer overhead and out-of-memory conditions can erase expected GPU gains even when peak GPU arithmetic throughput is high.
Correct independent evidence. A representative run measures host-to-device transfer, allocated GPU memory and kernel execution without exceeding supported memory limits. This verifies the corrective approach for the affected language and visual-content AI services instead of treating an architecture diagram alone as success.
Incorrect Answers
Not the most direct the action-and-evidence pair for these facts. Select a GPU for many data-parallel numerical operations and a CPU for branching control or low-parallelism tasks, considering end-to-end bottlenecks. This choice concerns gpu parallel throughput versus cpu serial control and may be valid in another design. But this case reports 'An engineer increases batch size without checking live device-memory use', which calls for reasoning about gpu device memory and transfer considerations. The targeted response is: Account for GPU memory capacity and the cost of moving inputs between host memory and device memory when assessing acceleration and batch size.
Not the most direct the action-and-evidence pair for these facts. Evaluate request latency, concurrency, batching and model size together when selecting inference resources, with measurements under a representative service-level target. This choice concerns inference latency throughput and batching tradeoffs and may be valid in another design. But this case reports 'An engineer increases batch size without checking live device-memory use', which calls for reasoning about gpu device memory and transfer considerations. The targeted response is: Account for GPU memory capacity and the cost of moving inputs between host memory and device memory when assessing acceleration and batch size.
Not the most direct the action-and-evidence pair for these facts. A representative image dataset is used to assess the selected vision task and error categories in realistic operating conditions. This choice concerns computer vision inspection and imaging use cases and may be valid in another design. But this case reports 'An engineer increases batch size without checking live device-memory use', which calls for reasoning about gpu device memory and transfer considerations. The targeted response is: Account for GPU memory capacity and the cost of moving inputs between host memory and device memory when assessing acceleration and batch size.