Skaffold rebuilding images instead of using cache (Github Actions)

I am new to Skaffold and trying to understand why Skaffold is not building images from '~/.skaffold/cache' and rebuilds new images when running on GitHub actions. When running locally, I can see the Found Locally when Skaffold is checking the cache. Following is my GitHub workflow - https://github.com/rajivsavroop/GH_skaffold_example/blob/test-skaffold-cache/.github/workflows/example.yaml

I really appreciate any help you can provide.

I tried -https://github.com/GoogleContainerTools/skaffold/issues/4842 but not working.

I am expecting Skaffold to use cached images instead of building new ones on every run in GitHub Actions.