Assertion error when supporting non-diffusers' models.

When integrating cache-dit into sglang, we encountered an assertion error.
It appears that this happens because sglang’s FluxTransformer2DModel is not compatible with diffusers’ FluxTransformer2DModel, which the current adapter code assumes.

After temporarily commenting out the assertion, the integration can run without issues:

https://github.com/Brain97/cache-dit/blob/b6a9648156e8fa42e713adf11b69a5b45a3a7547/src/cache_dit/caching/block_adapters/__init__.py#L19

From the latest version, it looks like the adapter still only supports diffusers’ FLUX*Model:

https://github.com/vipshop/cache-dit/blob/ed9a226a061cd8b82043c0df0c4088bb344e7a33/src/cache_dit/caching/block_adapters/__init__.py#L27

Would it be possible to add support for sglang’s Flux implementation, or make the adapter interface more flexible?