Question 70
During a shared-cluster operating review at a university HPC center, engineers report the following issue: A benchmark measures raw GPU kernels but excludes request serialization and queuing. The affected work supports research training and scheduled compute allocations; fair resource access and repeatable cluster operations matter. Choose TWO: one corrective approach and one result demonstrating it works. (Select TWO.)
Explanation
Correct Answers
Correct corrective action. Evaluate request latency, concurrency, batching and model size together when selecting inference resources, with measurements under a representative service-level target. This fits the specific reported issue: A benchmark measures raw GPU kernels but excludes request serialization and queuing. The corresponding failure being reduced is: Maximizing batch throughput without tracking queue delay can violate interactive inference latency even if GPUs appear busy.
Correct independent evidence. Load testing reports end-to-end latency percentiles and completed requests per second at the intended concurrency and batch settings. This verifies the corrective approach for the affected research training and scheduled compute allocations instead of treating an architecture diagram alone as success.
Incorrect Answers
Not the most direct the action-and-evidence pair for these facts. Distinguish training with repeated forward and backward passes and model updates from inference that applies a trained model to new inputs, and size compute for the actual phase. This choice concerns training versus inference compute requirements and may be valid in another design. But this case reports 'A benchmark measures raw GPU kernels but excludes request serialization and queuing', which calls for reasoning about inference latency throughput and batching tradeoffs. The targeted response is: Evaluate request latency, concurrency, batching and model size together when selecting inference resources, with measurements under a representative service-level target.
Not the most direct the action-and-evidence pair for these facts. Explain recent AI adoption through the combined availability of larger datasets, improved algorithms and architectures, scalable computing, and practical deployment tooling. This choice concerns data algorithms and model architecture advances and may be valid in another design. But this case reports 'A benchmark measures raw GPU kernels but excludes request serialization and queuing', which calls for reasoning about inference latency throughput and batching tradeoffs. The targeted response is: Evaluate request latency, concurrency, batching and model size together when selecting inference resources, with measurements under a representative service-level target.
Not the most direct the action-and-evidence pair for these facts. The supported framework detects the intended GPUs and successfully executes a representative operation using documented compatible versions. This choice concerns driver runtime and framework compatibility and may be valid in another design. But this case reports 'A benchmark measures raw GPU kernels but excludes request serialization and queuing', which calls for reasoning about inference latency throughput and batching tradeoffs. The targeted response is: Evaluate request latency, concurrency, batching and model size together when selecting inference resources, with measurements under a representative service-level target.