It would have to be something in Silent Hill. As many mentioned, the mirror scene in Silent Hill 3 is great. Silent Hill 2 was pretty creepy throughout. I think there were some scary parts (or at least, eerie, namely that big music box) at the hotel on the water (can't remember the name).
The opening 10 minutes of Dead Space is also very scary. In fact, the game goes down hill from that point.