dotnet / dotnet/machinelearning

API to identify colinearity (high-correlation between attributes/features/input-variables)

Open
#2,078 2 comments 0 reactions 0 assignees View on GitHub
area-Transforms enhancement Priority:2
Dominant language
C#
Stars
9.4k
Forks
2k
Avg merge
2d 20h
Merged PRs (30d)
11

Description

Related to model explainability features and feature or input variable selection in general, if would be good to have any API to identify colinearity (high correlation between attributes/features/input-variables).

Colinearity in the input variables can make choosing the correct attributes/input-variables to use more difficult, especially in linear models.

This issue is also related to the more general issue: https://github.com/dotnet/machinelearning/issues/749
But this issue focuses on a particular feature which is "colinearity detection".

In short, collinearity:

- Can make choosing the correct predictors to include more difficult.
- Interferes in determining the precise effect of each predictor, but...
- BUT, it doesn’t affect the overall fit of the model or produce bad predictions.

Depending on your goals, multicollinearity isn’t always a problem. However, because of the difficulty in choosing the correct model when severe multicollinearity is present, it’s always worth exploring.

This feature is not critical for our current major release (v1.0) that we are currently stabilizing, but should be taken into account for future releases.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.