This perk is about the advantage of surprise. Once the surprise happens a few times the perk will be lost. Similarly, in a very realistic campaign where this is a Quirk, it is also lost after a couple of surprise reveals. But the surprise reveals are less likely to happen.
I don't see any reason why the perk would be lost with new people who have never heard of you.