gltf sparse accessors bug

**Describe the bug**

https://github.com/google/filament/assets/15972489/6f3312d6-43f9-4e20-abec-bddf7bcfbf26

Firstly,the "male_sparse.glb" is from **male.glb**(use **gltf-transform sparse** to process **male.glb**)

As the video shown, there is two bugs
1.There is only light was effected when i use seekbar to change morph target weights of **male_sparse.glb**.
2.The face will be broken when i change the model as this sequence(**male.glb** -> **male_sparse.glb** -> **male.glb** -> **male_sparse.glb**)

**To Reproduce**
the sample code has been upload to github.

https://github.com/August1996/filament-bugreport/tree/main/SparseTest

**Smartphone (please complete the following information):**
- Device: Xiaomi 9
- OS: Android 11
- GPU: Adreno 640
- Backend: OpenGL

**Filament version is 1.52.0**

@romainguy @pixelflinger @bejado @poweifeng