Should we pin other CUDA components tightly?

During the review in staged-recipes, there was [a discussion](https://github.com/conda-forge/staged-recipes/pull/21924#discussion_r1155112007) on whether this pinning should/can be relaxed, given that we already pin `cuda-version` tightly:
https://github.com/conda-forge/libcusparse-feedstock/blob/38c8582741c3f03b2372b7f6371de081f724e0ab/recipe/meta.yaml#L55
Opening an issue here to track the discussion.