Monitoring GPU performance
Introduction
This document will demonstrate several techniques that can be used to observe GPU utilization. GPU monitoring is critical in understanding how effective your application is at utilizing attached GPUs.
We will use Ubuntu 20.04 Application Bundle configured with a multi-instance GPU (MIG) for this example.
Launch Ubuntu application
For additional documentation on how to launch an Application please refer to Running your first application
Monitor from command-line
The screenshots below are examples of an unutilized MIG that has no processes running.
nvida-smi is a command that can be used to display a snapshot of current GPU utilization.
To get a continuous output of GPU utilization include the -l option followed by a time interval (seconds).
Another command to continuously monitor GPU utilization is nvidia-smi dmon.
nvidia-smi can be captured for logging; for additional documentation on nvidia-smi queries, refer to useful nvidia-smi queries.