Gee - that place and your boss is just plain weird. As you quite rightly say, how can someone to whom you don't report and who doesn't know you conduct a review of your work? Will your boss speak to his boss ie the reviewer to discuss this first? If that's the case, why don't they conduct it together so at least your idiot boss gets some idea of how to conduct a secretarial review??
And yes, that smirk would've made me want to give him a slap (and I'm not a violent person!).
My former employers, in the three years I was there, NEVER conducted a review of my work, nor that of my predecessor... in fact, my end-of-probation review happened when I was on holiday. Oddly, though, they were extremely hot on everyone else having their appraisals.
