Built-in role management for SWA with FrondDoor

Should built-in roles management (invited via portal) work when Static Web App is configured to work with FrontDoor and custom domain? In this case, the custom domain is setup on FrontDoor side and points to SWA. But SWA doesn't know about it. When you want to invite a new user in Role management section of SWA, there is no option to generate the invitation link for that custom domain. If you generate the link for default SWA URL and manually change the link to the custom domain, you get 400 Bad Request. Am I doing something wrong or I am just not supposed to use built-in SWA role management when using FrontDoor?