Question 560
During technical commissioning, this weakness is reported: A new multi-tenant inference service assigns a whole GPU to every tiny model despite approved MIG-capable hardware. What observed test would best demonstrate closure?
Explanation
Correct Answer
A completed remediation must demonstrate that Tenant benchmark runs use only their allocated profiles with expected per-instance resource limits. That tests the specific weakness because MIG partitions expose isolated compute and memory allocations that can improve utilization for compatible jobs.
Incorrect Answers
The option would apply to “After reboot, a previously assigned MIG layout disappears and the scheduler tries to place jobs on nonexistent device UUIDs”. The decisive evidence is that A controlled reboot restores the intended GPU and compute instances before accepting tenant jobs. This question instead requires “Tenant benchmark runs use only their allocated profiles with expected per-instance resource limits”.
The related but distinct situation is “Two tenants see the same MIG device assignment because an orchestration template reuses one accelerator identifier”. The strongest acceptance result is that A concurrent workload test shows distinct assigned MIG identifiers and authorized resource visibility, not merely that a command executed. For the stated problem, “Tenant benchmark runs use only their allocated profiles with expected per-instance resource limits” addresses the central condition.
This option serves the scenario “An administrator enables MIG mode on a supported GPU but creates no GPU or compute instances and the workload sees no device”. The strongest acceptance result is that The instance inventory lists valid GPU and compute instances and a sample job uses the assigned device, not merely that a command executed. The present scenario is distinguished by “Tenant benchmark runs use only their allocated profiles with expected per-instance resource limits”.