baidu/bigflow

View on GitHub

Baidu Bigflow is an interface that allows for writing distributed computing programs and provides lots of simple, flexible, powerful APIs. Using Bigflow, you can easily handle data of any scale. Bigflow processes 4P+ data inside Baidu and runs about 10k jobs every day.

Stars: 1.1k
Forks: 159
Open beginner issues: 0
Indexed issues: 22

Dominant language: C++
License: Apache-2.0
Last GitHub push: Oct 31, 2022
Latest indexed: Sep 14, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: help wanted
PR merge metrics: No merged PRs in 30d

Open All

22 open issues indexed

Continuous Integration Support Open

building problem

baidu/bigflow#1 · 4 comments · 1 reaction · 0 assignees · Indexed Sep 14, 2026
A benchmark system is needed Open

baidu/bigflow#2 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Better handle LINK_ALL_SYMBOLS option in cmake/generic.cmake Open

help wanted

baidu/bigflow#3 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
API Plan optimizations is needed Open

baidu/bigflow#4 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Remove code which is used for streaming process Open

baidu/bigflow#5 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
lower the required cmake version Open

help wanted

baidu/bigflow#6 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
English documents are required Open

help wanted

baidu/bigflow#7 · 0 comments · 2 reactions · 1 assignee · Indexed Sep 14, 2026
Support structure IO format on Spark Open

enhancement

baidu/bigflow#11 · 1 comment · 0 reactions · 2 assignees · Indexed Sep 14, 2026
Enable travis' build matrix Open

enhancement

baidu/bigflow#13 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 14, 2026
Hive Support Open

feature

baidu/bigflow#16 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
readline install failed Open

bug help wanted

baidu/bigflow#18 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Maybe we should build Bigflow to a python egg Open

baidu/bigflow#19 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Translate readme into English Open

help wanted

baidu/bigflow#29 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 14, 2026
Is it possible to run sklearn on bigflow? Open

baidu/bigflow#39 · 1 comment · 0 reactions · 1 assignee · Indexed Sep 14, 2026
bigflow用来文本挖掘可以提高速度吗？ Open

baidu/bigflow#42 · 1 comment · 0 reactions · 1 assignee · Indexed Sep 14, 2026
build failed Open

baidu/bigflow#43 · 3 comments · 0 reactions · 1 assignee · Indexed Sep 14, 2026
关于 bigflow.transforms.join 的一些疑问 Open

baidu/bigflow#45 · 1 comment · 0 reactions · 1 assignee · Indexed Sep 14, 2026
manage byproducts Open

baidu/bigflow#47 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Could bigflow support either SQL or a familiar DataFrame API to query structured data. Open

baidu/bigflow#48 · 3 comments · 0 reactions · 1 assignee · Indexed Sep 14, 2026
希望增加group_by之后的统计函数？ Open

baidu/bigflow#49 · 4 comments · 0 reactions · 1 assignee · Indexed Sep 14, 2026
会有python3版本的吗 Open

baidu/bigflow#59 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
在线试用网页挂掉了？ Open

baidu/bigflow#62 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026

baidu/bigflow

Get new issues in your inbox