Publish base docker images

**Community Note**
* Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
* Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do * not help prioritize the request
If you are interested in working on this issue or have submitted a pull request, please leave a comment

**Tell us about your request**

It would be useful for local development purposes to have the same environment as within App Runner. AWS should publish the base images that they use for their build environments.

**Describe alternatives you've considered**

I've briefly tried to download the image directly from ECR without success

**Additional context**

A Node.js dependency that compiles with `node-gyp` is failing to build within App Runner, but works fine locally.

**Attachments**

N/A