Getting many false matches for an enrolled face in the user database is common if the enrolled face is very low quality. For example, if the enrolled face is looking away from the camera or has poor sharpness or contrast. False match rate can be exasperated (made larger) when enrolled face is hearing a baseball cap, turbine or some other head covering.
If a single face results in many false matches, you should disable that face for recognition as described below.
1. Go to People > "..." > Manage Groups and create a new group and uncheck "Enable face recognition" as follows:
Edit the person record and add that person to that group (people can belong to multiple groups).
This person will then still exist in your database but will not result in false matches. In future we hope to add option to set a different threshold for certain groups allowing you to match that face at a higher threshold.