gputaskman utility shows VRAM usage for AI models and browsers

Microsoft employee Scott Hanselman created a complimentary Windows program known as gputaskman to offer deeper insights into graphics card activity than the standard Task Manager. The software remains in its initial creation phase, providing compatibility for Windows PCs running AMD or Nvidia graphics processors.

Image: Digital Citizen

This utility is designed to reveal how individual processes utilize graphics memory. It is able to recognize on-device large language models and show their resource needs, separating memory allocated for model weights and key value caches. Furthermore, the application monitors browser and desktop rendering memory, while including thermal tracking so users can watch temperatures alongside memory usage.

Although the program currently functions on AMD and Nvidia hardware, expanding device support remains a key objective for Hanselman. He has specifically noted intentions to accommodate the Surface Laptop Ultra, RTX Spark systems, and alternative Windows on Arm machines. Because this project is experimental, its features and system compatibility are subject to change over time.