`import` is very slow

In tests, or when wanting to just debug something quickly, the process hangs on `import evaluate`.
I benchmarked it on two devices:
```bash
python -c "import time; start = time.time(); import datasets; print(f'datasets: {time.time() - start:.3f}s')"
python -c "import time; start = time.time(); import transformers; print(f'transformers: {time.time() - start:.3f}s')"
python -c "import time; start = time.time(); import evaluate; print(f'evaluate: {time.time() - start:.3f}s')"
```

Linux server:
datasets: 0.724s
transformers: 1.527s
evaluate: 3.438s

macOS:
datasets: 1.076s
transformers: 1.072s
evaluate: 8.987s

9 seconds on my mac (m1 pro) is very slow just for the import. can you please look at why this is the case?