Is there a way for all nodes to share the most commonly used dependencies while independently using less popular dependencies?

One common issue we often encounter is that when installing a new plugin, there may be conflicts between the dependency versions it specifies and the existing dependencies on the local system.
Is there a way to create a virtual environment where all plugins share the same common dependencies (such as the torch library), and then for each plugin's dependencies that are not in the common dependencies, create an additional separate virtual environment, so that each plugin can enjoy its own independent dependencies plus the shared common dependencies?
This approach maintains the independence of the environment while also reducing redundant dependencies to some extent.