[Feature Request] Loading LLM and CLIP in .safetensors format

Hello, I would really love to see the implementation of loading custom LLM and CLIP from .safetensors models. Maybe through command line arguments like --llm-path and --clip-path.
Thanks in advance!

No files or tests are named. Start by locating the existing LLM and CLIP loading paths and command-line argument definitions, then determine how custom .safetensors models should be selected through --llm-path and --clip-path. Done means both model types can be loaded in that format through the requested arguments.

Written by the indexing model from the issue text.