Splitting tests with awareness of skips

I have two settings for CI

a) run all the tests on GPU
b) run a subset of the tests on CPU the subset is because many tests are decorated with `pytest.mark.skipif(not os.environ['IS_CUDA'])`

when I run b with any number of splits one of them is empty.

Do I need to make a second durations file or is there a way to make the splitter know which tests will be skipped?