apache / apache/datafusion-python
Spike: evaluate if cuDF can be used with datafusion-python
- 主要語言
- Python
- 星號
- 604
- 分支
- 174
- 平均合併
- 1 天 7 小時
- 30 天內合併 PR
- 4
描述
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
As other DataFrame libraries start moving to leveraging GPU resources, it would be useful to see if we could leverage the work already done in pandas and polars for interoperating with cuDF to give a similar experience in DataFusion.
**Describe the solution you'd like**
Evaluate the level of effort and technical limitations to using cuDF to evaluate DataFrames. Also worth evaluating is their c++ interface which we could potentially bring in to DataFusion upstream if we are willing to write the appropriate wrappers.
**Describe alternatives you've considered**
Leave as is.
**Additional context**
This task is really just focused on researching what would be required and if there is an opportunity here.
貢獻指南
這個儲存庫沒有索引到貢獻指南
研究方向
未指定具體的檔案、測試或進入點。檢視現有的 pandas 與 polars 互操作性工作,然後評估 cuDF DataFrame 的評估及其 C++ 介面。完成的標準是記錄所需的工作量、技術限制,以及是否存在上游 DataFusion 機會。
由索引模型根據 Issue 內容生成。
評估
- 技術堆疊
- cpp, python
- 領域
- data-engineering
- Issue 類型
- 功能
- 難度
- 5/5
- 預估耗時
- 一週以上
- 活躍度
- 停滯
- 描述清晰度
- 需要釐清
- 新手友好度
- 25/100