apache / apache/gluten

[VL] RAS: Cost model file

Open
#6,798 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

Currently cost models are implemented as Scala code which requires compilation before used. We'd add support for a simple DSL (or leveraging JSON / YAML etc.) to make it easier to tune against the cost model by constructing it from an external cost model file.

In the initial version, we can just make the file store some magical / empirical numeric costs for different operators. As we haven't yet introduced Spark's statistics into RAS planner.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.