aws / aws/amazon-sagemaker-examples
help needed for xgboost bring-your-own with distributed training
- Dominant language
- Jupyter Notebook
- Stars
- 11k
- Forks
- 7k
- Avg merge
- 8h 29m
- Merged PRs (30d)
- 8
Description
hi guys,
we are trying to create our own Docker image for xgboost distributed training. We have managed to successfully create an image for single instance training, but are unable to figure out how to hook to the xgboost distributed backend.
I see there is an equivalent example for other algos - https://github.com/awslabs/amazon-sagemaker-examples/blob/0e17c31a69ad014bee71fa9c4d700d35cd30a421/advanced_functionality/fairseq_translation/fairseq/train#L112-L119
is there any way that you guys could share an example of a BYO distributed training docker image for xgboost ?
Contributor guide
Research direction
Start with the linked fairseq train example, especially lines 112-119, and compare it with the repository's available SageMaker training examples. Determine what a bring-your-own XGBoost distributed-training Docker example would need to demonstrate; done would be a working example or documented pattern, but the issue does not name an existing XGBoost file or test.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, docker, machine-learning
- Domain
- cloud, distributed-systems, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100