I have to same problem, my husband is 6’4 (about 190CM) and I am like 5’2 (156cm?) and believe me people give us the "STARE DOWN" I guess I am used to it now, but it’s even worse when we visit Japan.
I just say to poeple that STARE at us "Take a picture, it lasts longer" or " Dont you know it’s RUDE to stare!"
Dont worry abot it too much, I ma sure you will get over it.