Simple NVIDIA-SMI based software watchdog written in Powershell.
Fires when GPU utilization falls below user-defined threshold.
- Customizable list of performed actions when watchdog is triggered
- Customizable watchdog timers
- Prevents false-positive triggering (for example on miner start/switch)
- Write message to the Windows Event Log when watchdog is triggered
- Windows, tested on version
6.1.7601 - Powershell, tested on version
5.x - NVIDIA-SMI, tested on version
390.77
-
Copy watchdog.ps1 and actions.bat to the desired location
-
Create new Windows Task Scheduler task with following parameters:
- Run with highest privileges:
true - Begin task:
on a schedule - Schedule:
One-time - Repeat task every:
(choose appropriate duration from 5 to 10 minutes) - For a duration of
Indefinitely - Stop task if it runs longer than:
false - Expire:
false - Enabled:
true - Allow Start On Demand:
true - Run only on AC power:
false - Action: start a program
- Action details:
- Command:
powershell.exe - Arguments:
-ExecutionPolicy Bypass "%path_from_p1%\watchdog.ps1 [optional_arguments]"
- Command:
OR just import Rig Utilization Monitoring.xml task (change UserId, schedule and arguments appropriately before use).
- Run with highest privileges:
-
[Optional] Define your own actions in actions.bat (performs system restart by default).
Watchdog supports following arguments (all arguments are optional):
watchdog.ps1 -path 'C:\Program Files\NVIDIA Corporation\NVSMI' -threshold 25 -cycleCount 3 -sleepInterval 30 -writeLog 1
-
path - path to
nvidia-smi.exeexecutable file.Default value:
'C:\Program Files\NVIDIA Corporation\NVSMI'. -
threshold - GPU utilization for a single GPU (in percents), watchdog fires if utilization for ANY GPU falls below this value.
Default value:
25. -
cycleCount - number of checks (to prevent false-positive triggering).
Default value:
3. -
sleepInterval - sleep interval between checks (in seconds).
Default value:
30. -
writeLog - write or not messages in Event Log when watchdog fires. Also see warning below.
Default value:
1(write messages to log).
If you want to use Windows Event Log - you must register log source manually once before use with the following command:
New-EventLog -source "Rig Monitoring" -logname Application
NVIDIA SMI watchdog is released under an MIT license. See LICENSE for more information.