Minimize information inside "MyApp.deps.json" file

* .NET Core Version: .Net 5.0.13
* Windows version: 10.19043
* Does the bug reproduce also in WPF for .NET Framework 4.8?: No

**Problem description:**
Having a MyApp.deps.json file is requiring all dependent libraries to be packaged in my installer. This does not make sense to me because when my app was running on .NET Framework I wasn't packaging all these dll files inside my installer. I have tried removing MyApp.deps.json file with `false`, but this is crashing my application upon start up with no errors in Event Viewer. Am I missing some tag or attribute that is needed in my project files?

**Actual behavior:**
All libraries are required to run application.

**Expected behavior:**
Is there a way to use MyApp.deps.json with only the core libraries that are required to run my application or remove the file all together without breaking my application?

**Minimal repro:**
Create a basic WPF application and add a Nuget package for example Xceed.Wpf.Toolkit.
This package is adding 4 more Xceed dll files along.
Delete 1 of those libraries and try to start your executable and observe that it failed with an error in Event Viewer.
`An assembly specified in the application dependencies manifest (MyApp.deps.json) was not found:
package: 'Extended.Wpf.Toolkit', version: '4.2.0'
path: 'lib/net40/Xceed.Wpf.AvalonDock.dll'`
This behavior is not observed in .NET Framework as there is no MyApp.deps.json.