Problem with intermediate Image in docker build for varying Architectures with same Base Image

In my system, I need to create a large number of images for different devices with different architectures. For this, I have a pipeline that creates multiple images using Docker in Docker, all based on one Python:3.8 image, but for different architectures. In the Docker file, I specify the base image in general:

FROM python:3.8

In the build command, I specify the architecture of the particular device:

docker build --platform linux/arm/v7 --force-rm -t localhost:5000/ImageName

docker build --platform linux/amd64 --force-rm -t localhost:5000/ImageName

The problem I'm facing at the moment is that the Docker host gets confused with the images when the pipeline triggers both or more builds at the same time. Docker doesn't seem to be able to store intermediate images for different architectures because they only differ in digest and identical tags are overwritten. For this reason, docker only seems to select the intermediate image by the name and tag and not by the sha265: that matches the architecture. This results in the following error:

failed to get destination image "sha256:4d470a81cd7a4eb2a886d8d6ca7848d66f711ea2d44375f4ab10a97c42c1adf3": image with reference sha256: 4d470a81cd7a4eb2a886d8d6ca7848d66f711ea2d44375f4ab10a97c42c1adf3 was found but does not match the specified platform: wanted linux/arm/v7, actual: linux/amd64

Also the --force-rm option in the build command does not work here, because the deletion is done after the build process is finished. I also don't want to declare the images with @sha in the dockerfile, because the identical code should be used on different devices.

What is the best way to work around or solve this problem?

No source files or tests are named. Start by reproducing the concurrent linux/arm/v7 and linux/amd64 docker build commands described in the issue, then inspect Docker's intermediate-image handling for platform-specific references. Done would require a documented, verified workaround or fix that prevents the concurrent builds from selecting an image for the wrong platform.