4paradigm / 4paradigm/OpenMLDB
Spark job is trigger when compiling SQL with offline engine
未关闭
batch-engine
bug
- 主要语言
- C++
- 星标
- 1.7k
- 派生
- 331
- 平均合并
- 12 天 12 小时
- 30 天内合并 PR
- 1
描述
Now it takes much time to compile SQL and the data is processed even if getting output dataframe.
贡献指南
调研方向
The issue mentions a Spark job being triggered during SQL compilation with the offline engine, causing unnecessary data processing and slow compilation. Look at the SQL compilation path in the offline engine code, likely in the Spark-related modules. Identify where the job is being inadvertently triggered and ensure compilation does not execute data processing. Check existing tests for SQL compilation to verify the fix.
由索引模型根据 Issue 内容生成。
评估
- 技术栈
- spark, sql
- 领域
- databases, machine-learning, performance
- Issue 类型
- 缺陷
- 难度
- 3/5
- 预计耗时
- 1-2 天
- 活跃度
- 停滞
- 描述清晰度
- 基本清楚
- 新手友好度
- 45/100