alignment and landmarks for pose analysis

I'm experimenting with face recognition to do a people counter from video. Every time I have a new frame it detects faces and uses norm embeddings to compare with previously detected faces. In general, it works pretty well and fast (better than SORT trackers) but I'm seeing now that there are some face poses that his 512 embedding are very "general" and new faces are detected as this face/person Those faces are people with masks getting out from a lift or door (not a frontal view) where we only see one eye like [this](https://drive.google.com/file/d/1v68fSqiQPSnMgRkZNc_i1FMWmRshB-pw/view?usp=sharing) one

I decided to only keep some pose faces (frontal view) and wanted to use landmarks (distance between eyes) to do it but I see that buffalo_s (or L) 's detection model is "guessing" KPS that are not seen in the image

A[ face example](https://drive.google.com/file/d/1LR9ntJjrBAKcM0LozmK5A1SSQqHGhff8/view?usp=sharing,) another [face example](https://drive.google.com/file/d/1ZED1VNGuzDv8sKdyWFesl1giF3qYprDN/view?usp=sharing)

A [nice face image](https://drive.google.com/file/d/1bwtSyChIFm6cTnIbLldgP1De5ihqVozC/view?usp=sharing) that I will love to use.

I'm guessing that those false landmarks are returned by the face alignment and I don't want to avoid face alignment so, is there any way to have those kps previous face alignment?

Thank you very much for your work! Juan Luis