[Feature]:Support for non-NVIDIA backends (e.g., Iluvatar CoreX )

🚀 The feature, motivation and pitch

Background

I am very interested in the Unified Cache Management (UCM) project. Currently, it provides an excellent way to persist and reuse KV Cache to speed up LLM inference. In the current landscape of diverse hardware, adapting such cache management logic to domestic GPUs (like Iluvatar CoreX / 天数智芯) is becoming increasingly important.

Question

I would like to know if there are any plans or architectural considerations for supporting non-NVIDIA backends. Specifically:

1. Hardware Abstraction: Does the current implementation of UCM heavily rely on NVIDIA-specific features (e.g., CUDA VMM API, specific NVLink behaviors)?
2. Framework Dependency: Does UCM require a specific version of vLLM or other engines that are strictly tied to CUDA?
3. Porting Effort: In your opinion, what are the most critical modules that need to be rewritten or abstracted to support the Iluvatar CoreX software stack (which uses the DeepLink/CoreX SDK)?

I have access to Iluvatar CoreX hardware and would love to hear your thoughts on the feasibility of this adaptation.

Alternatives

No response

Additional context

No response

No files, tests, or entry points are named. Start by tracing the current CUDA- and NVIDIA-specific paths and framework dependencies, then identify the interfaces and modules that would need abstraction for Iluvatar CoreX. Done means the porting scope, backend boundary, and compatibility requirements are documented or implemented.