[Bug] No way to you specify a model revision?

### Checklist

- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.

### Describe the bug

From what I can tell, this uses the various Transformers `*.from_pretrained()` calls to download models from hugging face.

I'm using some models where the the actual model files are only present in non-main branches of the repository. For an example, see https://huggingface.co/bartowski/Yi-34B-200K-RPMerge-exl2

This fails if you try to simply refer to the model.

I cannot see any way to specify a specific branch.

### Reproduction

```
(base) durr@learner:/media/Scripts/book_cat$ docker run --runtime nvidia --gpus all \
> -v ~/.cache/huggingface:/root/.cache/huggingface \
> -p 23333:23333 \
> --ipc=host \
> openmmlab/lmdeploy:latest \
> lmdeploy serve api_server bartowski/Yi-34B-200K-RPMerge-exl2

=============================
== Triton Inference Server ==
=============================

NVIDIA Release 22.12 (build 50109463)
Triton Server Version 2.29.0

Copyright (c) 2018-2022, NVIDIA CORPORATION & AFFILIATES. All rights reserved.

Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES. All rights reserved.

This container image and its contents are governed by the NVIDIA Deep Learning Container License.
By pulling and using the container, you accept the terms and conditions of this license:
https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license

Fetching 3 files: 100%|██████████| 3/3 [00:00<00:00, 3.74it/s]
Traceback (most recent call last):
File "/opt/lmdeploy/lmdeploy/archs.py", line 172, in get_model_arch
cfg = AutoConfig.from_pretrained(model_path,
File "/opt/py38/lib/python3.8/site-packages/transformers/models/auto/configuration_auto.py", line 934, in from_pretrained
config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
File "/opt/py38/lib/python3.8/site-packages/transformers/configuration_utils.py", line 632, in get_config_dict
config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
File "/opt/py38/lib/python3.8/site-packages/transformers/configuration_utils.py", line 689, in _get_config_dict
resolved_config_file = cached_file(
File "/opt/py38/lib/python3.8/site-packages/transformers/utils/hub.py", line 370, in cached_file
raise EnvironmentError(
OSError: /root/.cache/huggingface/hub/models--bartowski--Yi-34B-200K-RPMerge-exl2/snapshots/6a044cb3ec9b116e41d049817f1c38e8e74a09f1 does not appear to have a file named config.json. Checkout 'https://huggingface.co//root/.cache/huggingface/hub/models--bartowski--Yi-34B-200K-RPMerge-exl2/snapshots/6a044cb3ec9b116e41d049817f1c38e8e74a09f1/tree/None' for available files.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/opt/py38/bin/lmdeploy", line 33, in
sys.exit(load_entry_point('lmdeploy', 'console_scripts', 'lmdeploy')())
File "/opt/lmdeploy/lmdeploy/cli/entrypoint.py", line 37, in run
args.run(args)
File "/opt/lmdeploy/lmdeploy/cli/serve.py", line 268, in api_server
backend = autoget_backend(args.model_path)
File "/opt/lmdeploy/lmdeploy/archs.py", line 44, in autoget_backend
turbomind_has = is_supported_turbomind(model_path)
File "/opt/lmdeploy/lmdeploy/turbomind/supported_models.py", line 70, in is_supported
arch, cfg = get_model_arch(model_path)
File "/opt/lmdeploy/lmdeploy/archs.py", line 176, in get_model_arch
cfg = PretrainedConfig.from_pretrained(model_path)
File "/opt/py38/lib/python3.8/site-packages/transformers/configuration_utils.py", line 603, in from_pretrained
config_dict, kwargs = cls.get_config_dict(pretrained_model_name_or_path, **kwargs)
File "/opt/py38/lib/python3.8/site-packages/transformers/configuration_utils.py", line 632, in get_config_dict
config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
File "/opt/py38/lib/python3.8/site-packages/transformers/configuration_utils.py", line 689, in _get_config_dict
resolved_config_file = cached_file(
File "/opt/py38/lib/python3.8/site-packages/transformers/utils/hub.py", line 370, in cached_file
raise EnvironmentError(
OSError: /root/.cache/huggingface/hub/models--bartowski--Yi-34B-200K-RPMerge-exl2/snapshots/6a044cb3ec9b116e41d049817f1c38e8e74a09f1 does not appear to have a file named config.json. Checkout 'https://huggingface.co//root/.cache/huggingface/hub/models--bartowski--Yi-34B-200K-RPMerge-exl2/snapshots/6a044cb3ec9b116e41d049817f1c38e8e74a09f1/tree/main' for available files.
```

### Environment

```Shell
Not relevant.
```