apache / apache/beam

[Task]: Install TFT from nightly builds for the TFT Criteo tests.

Open
#25,358 0 comments 0 reactions 0 assignees View on GitHub
P3 python task
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
2d 2h
Merged PRs (30d)
205

Description

### What needs to happen?

TFT tests uses https://github.com/apache/beam/blob/master/sdks/python/apache_beam/testing/benchmarks/cloudml/requirements.txt.

Install the TFT and tfx_bsl from nightly build instead of official release. It will help catch the bugs early.

### Issue Priority

Priority: 3 (nice-to-have improvement)

### Issue Components

- [x] Component: Python SDK
- [ ] Component: Java SDK
- [ ] Component: Go SDK
- [ ] Component: Typescript SDK
- [ ] Component: IO connector
- [ ] Component: Beam examples
- [ ] Component: Beam playground
- [ ] Component: Beam katas
- [ ] Component: Website
- [ ] Component: Spark Runner
- [ ] Component: Flink Runner
- [ ] Component: Samza Runner
- [ ] Component: Twister2 Runner
- [ ] Component: Hazelcast Jet Runner
- [ ] Component: Google Cloud Dataflow Runner

Contributor guide

Open the contributing guide

Research direction

Start with sdks/python/apache_beam/testing/benchmarks/cloudml/requirements.txt, which is used by the TFT Criteo tests. Inspect the current TFT and tfx_bsl requirements and change them from official releases to nightly builds. Run the TFT Criteo tests to verify that the nightly dependencies install and the tests pass.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, tensorflow
Domain
testing-qa
Issue type
Feature
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.