4paradigm / 4paradigm/OpenMLDB

count(*) over table in offline mode

未关闭
#3,652 0 条评论 0 个 reaction 已指派 1 人 已被 @tobegit3hub 认领 在 GitHub 查看
batch-engine enhancement high-priority
主要语言
C++
星标
1.7k
派生
331
平均合并
12 天 12 小时
30 天内合并 PR
1

描述

We don't support agg over table in offline mode, only online mode supports.
So if user wants to get offline data count, it's hard to do. Now user can run it on spark-shell/pyspark.
But if user can't prepare the spark env, it's better to enable sparksql in openmldb.

pass --spark_conf with option `spark.openmldb.sparksql`

P.S. user should know that not all openmldb sql can be run on spark engine.

贡献指南

打开贡献指南

调研方向

Look for the offline mode execution path and the SQL parser. The issue mentions enabling sparksql via a spark.conf flag `spark.openmldb.sparksql`. Find where offline queries are routed and how to conditionally use Spark's SQL engine for aggregate functions like count(*). Check test files for offline query execution to understand the expected behavior.

由索引模型根据 Issue 内容生成。

评估

技术栈
spark, sql
领域
backend, databases, machine-learning
Issue 类型
功能
难度
3/5
预计耗时
1-2 天
活跃度
停滞
描述清晰度
基本清楚
新手友好度
45/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。