dotnet / dotnet/machinelearning
PFI (Permutation Feature Importance) takes forever on some regression models created using AutoML
- Dominant language
- C#
- Stars
- 9.4k
- Forks
- 2k
- Avg merge
- 2d 20h
- Merged PRs (30d)
- 11
Description
**System Information**
- Windows 11
- ML.NET v4.0.0
- .NET 8.0
**Describe the bug**
Calculating PFI seems to hang (take forever) for some regression models created using AutoML. For other models (created against the same learning data) calculating PFI takes just a couple of seconds.
**To Reproduce**
Run the attached program.
**Expected behavior**
I would expect PFI to complete in a timely fashion. Or at least provide a mechanism to monitor the progress of PFI calculation with the ability to cancel it.
**Screenshots, Code, Sample Projects**
The attached program contains two regression models created using AutoML, and a set of data used to create the two models. The program first calculates PFI against the first model which takes just a couple of seconds. Then the program tries to calculate PFI against the second model which takes forever.
[test project.zip](https://github.com/user-attachments/files/18167832/test.project.zip)
Contributor guide
Assessment
This issue has not been assessed yet.