Create a wireguard mesh network between a set of projects and some outside network to allow for private networking. Allow outside peers i.e. a relay in an aws account or a local / on-prem machine.
Alternatively some sort of tailscale proxy integration would achieve the same thing. Check out how they are enabling usage on heroku. https://tailscale.com/kb/1107/heroku/