Yes, sometimes web masters DO allow search engines to view with out membership. This includes some of the bigger newspapers as well. Sometimes, search engines send out a different browser header than we do. So, sites can recognize it as a spider and let it through.
Also, spiders regularly check...