Today's Posts Follow Us On Twitter! TFL Members on Twitter  
Forum search: Advanced Search  
Navigation
Marketplace
  Members Login:
Lost password?
  Forum Statistics:
Forum Members: 24,254
Total Threads: 80,792
Total Posts: 566,472
There are 1994 users currently browsing (tf).
 
  Our Partners:
 
  TalkFreelance     Business and Website Management     Advertising, SEO and Social Marketing :

Interesting robot.txt's

Thread title: Interesting robot.txt's
     
    Thread tools Search this thread Display Modes  
Prev Previous Post   Next Post Next
09-07-2010, 12:39 AM
 #1
Dan is offline Dan
Dan's Avatar
Status: Request a custom title
Join date: Feb 2005
Location:
Expertise:
Software:
 
Posts: 3,164
iTrader: 15 / 86%
 

Dan is an unknown quantity at this point

  Old  Interesting robot.txt's

Thought this was cute; http://www.dailymail.co.uk/robots.txt - Both intersting and creative for a job listing.

Also while we're at it take a peep at http://www.last.fm/robots.txt.

Know of any other websites with interesting robot.txt files? (:
Reply With Quote
     

« Previous Thread | Next Thread »

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 

  Posting Rules  
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump:
 
  Contains New Posts Forum Contains New Posts   Contains No New Posts Forum Contains No New Posts   A Closed Forum Forum is Closed  

Home   |     |   News   |   Rules   |   FAQ   |  


Powered by HandsOnWebHosting.com

The time is now 07:40 PM (GMT).


Powered by: vBulletin Version 3.8.4 Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.