For rank:pairewise objective, it needs partition the dataset on the group by user, and set numWorkers to be same as the partitions
Open
LTR
type: java-scala
- Dominant language
- C++
- Stars
- 28.8k
- Forks
- 8.9k
- Avg merge
- 1d 12h
- Merged PRs (30d)
- 54
Description
We are training a pairwisde model with rank:pairewise objective. We found that we have to pre partition our dataframe on group column when we setting the numWorkers > 1, otherwise the model performance will degrade. And we also found that we have to set the numWorkers to be same as the pre partition number, otherwise the model performance will degrade too.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.