Dying Kernel on Apple M1

I was previously using Julia 1.6.3 on Rosetta and Python 3.9 installed for intel, with no issues.
I've now moved to Julia 1.7.1 running natively on ARM, with Python 3.9 to match. I've installed PyCall using Pkg.add and Pkg.build, but the Julia kernel dies every time I attempt "using PyCall".

EDIT: Seeing the comment below, I tried it directly CLI Julia rather than in a Jupyter notebook, and I am indeed getting "No module named site"