Run Actions of a Namespace on the same VM

Hello
I would like to know if it's possible to dedicate specific VMs that run the Invokers to a specific Namespace.
I'll give an example-
I have 6 VMs that can run invokers as containers(let's call them A-F), and I have three Namespaces( let's call them 1-3).
I want to make sure that actions that are related to namespace 1 run only on the invokers that are on VM A or B.
The same goes for Namespace 2 and VM C and D and so on.

I apologize If it is a beginner question, but it would help me a lot to know if that use case is possible in Openwhisk, and If not - if it can be.

Thank:)