Cannot `pip install` nightly

Describe the bug
Cannot pip install nightly version of this package

System information

TensorFlow version (installed from source or binary): none

TensorFlow Model Optimization version (installed from source or binary): current master

Python version: 3.10

Describe the expected behavior
tfmot is installed
Describe the current behavior

Building wheels for collected packages: tf-model-optimization-nightly
  Building wheel for tf-model-optimization-nightly (setup.py) ... error
  error: subprocess-exited-with-error
  
  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> [7 lines of output]
      /<path-to-virtual-env>/lib/python3.10/site-packages/setuptools/dist.py:509: InformationOnly: Normalizing '0.7.5-dev' to '0.7.5.dev0'
        self.metadata.version = self._normalize_version(
      running bdist_wheel
      running build
      running build_py
      creating build
      error: could not create 'build': File exists
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for tf-model-optimization-nightly
  Running setup.py clean for tf-model-optimization-nightly
Failed to build tf-model-optimization-nightly
ERROR: Could not build wheels for tf-model-optimization-nightly, which is required to install pyproject.toml-based projects

Code to reproduce the issue
pip install tf-model-optimization-nightly@git+https://github.com/tensorflow/model-optimization@master

Additional context
I have a fix in a fork of this project and want to install it via pip.