Viewer shows outdated cache after renaming a repo and creating a new one with the old name

Reported by @lewtun (internal link: https://huggingface.slack.com/archives/C02EMARJ65P/p1719818961944059):
> If I rename a dataset via the UI from D -> D' and then create a new dataset with the same name D, I seem to get a copy instead of an empty dataset
> Indeed it was the dataset viewer showing a cached result - the git history is clean and there's no files in the new dataset repo

No files or tests are named in the issue. Start by reproducing the dataset rename-and-recreate flow through the public viewer API and trace where the cached result is served; done means the newly created repository returns an empty dataset rather than the renamed repository's contents.

Written by the indexing model from the issue text.