4paradigm / 4paradigm/OpenMLDB

Spark job is trigger when compiling SQL with offline engine

未关闭
#2,880 3 条评论 0 个 reaction 已指派 1 人 已被 @tobegit3hub 认领 在 GitHub 查看
batch-engine bug
主要语言
C++
星标
1.7k
派生
331
平均合并
12 天 12 小时
30 天内合并 PR
1

描述

Now it takes much time to compile SQL and the data is processed even if getting output dataframe.

image

贡献指南

打开贡献指南

调研方向

The issue mentions a Spark job being triggered during SQL compilation with the offline engine, causing unnecessary data processing and slow compilation. Look at the SQL compilation path in the offline engine code, likely in the Spark-related modules. Identify where the job is being inadvertently triggered and ensure compilation does not execute data processing. Check existing tests for SQL compilation to verify the fix.

由索引模型根据 Issue 内容生成。

评估

技术栈
spark, sql
领域
databases, machine-learning, performance
Issue 类型
缺陷
难度
3/5
预计耗时
1-2 天
活跃度
停滞
描述清晰度
基本清楚
新手友好度
45/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。