[FEATURE] Make cuda/gpu optional

**Is your feature request related to a problem? Please describe.**
From an operational perspective, having a cuda requirement is the highest (followed by rocm and then whatever other platform an asic might need).

**Describe the solution you'd like**
It would be great if we can make this package "cpu-only".

**Describe alternatives you've considered**
Continue to pay homage to the GPU gods.

**Additional context**
My conversation with @neuronflow.