need to be able to cancel job run

This is from staging:
```
Thu Jun 6 14:53:29 2024
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 460.32.03 Driver Version: 460.32.03 CUDA Version: 11.2 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|===============================+======================+======================|
| 0 Tesla K80 On | 00000000:00:05.0 Off | 0 |
| N/A 67C P0 152W / 149W | 11099MiB / 11441MiB | 99% Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=============================================================================|
| 0 N/A N/A 29782 C /usr/bin/python3.7 11094MiB |
+-----------------------------------------------------------------------------+
```
Sometimes a GPU job takes a long time and we don't want to wait, it is helpful if we can cancel the job and remove it from the quene.

The GPU-celery container crashed and restarted itself and now are are back at 0%
```
6xyfw04urdue1xo8187timvcv rodan_gpu-celery.1 ddmal/rodan-gpu-celery:nightly@sha256:471e11427ca83726fde0544c4d9b5b50912edc81d68290ed526be43a8e20e22a staging-rodan-gpu-swarm Running Starting 23 seconds ago
k1k1jncfq9hu9b1i9r5ru47ib \_ rodan_gpu-celery.1 ddmal/rodan-gpu-celery:nightly@sha256:471e11427ca83726fde0544c4d9b5b50912edc81d68290ed526be43a8e20e22a staging-rodan-gpu-swarm Shutdown Failed 32 seconds ago "task: non-zero exit (143): dockerexec: unhealthy container"
```