#This is a file retrieved by webwalkers a.k.a. spiders that #conform to a defacto standard. # See # The webmaster for this site is: # # #Format is: # User-agent: # Disallow: | # #----------------------------------------------------------------------------- # following prevents access to /misc/ for spiders User-Agent: * Disallow: /family Disallow: /baby Disallow: /images Disallow: /pager Disallow: /ftp Disallow: /cheryl Disallow: /stanford/capra.html Disallow: /stanford/archive Disallow: /stanford/marx.html Disallow: /stanford/octdec96.html Disallow: /stanford/filmnoir.html Disallow: /stanford/text.html Disallow: /movies Disallow: where.htm Disallow: email.html Disallow: /_stanchat Disallow: /movielist.htm Disallow: /videos.htm