[Discuss] Paimon datalake for AI training

Hi everyone,

I am exploring some situations about PAIMON + AI. How Paimon could work with AI situations for training Large Model. Paimon has now partially integrated the Lance file format in my draft, but I need some input for the next step.

If you are using Paimon for AI training, could you describe the following question to help me develop Paimon more？
* What are your specific AI training scenarios?
* What features you are using in Paimon?
* What features you are expecting that the Paimon doesn't currently handle?

Could you leave a message here or contact me in email?

This is a discussion about using Paimon for AI training, including a partial draft integration of the Lance file format; no files, tests, or entry points are named. Start by reviewing that draft and the three requested questions about scenarios, current features, and missing features. Done would require agreed use cases and concrete feature requirements.

Written by the indexing model from the issue text.