Robotx txt V2
Maravilla que me he encontrado analizando unos archivos de robots.txt
copio y pego:
# Hi, I'm a big, fat, bloated company that is unable to think outside the box. Here's a list of things I can't figure out how to do yet... # a. Make an operating system that doesn't suck # b. Determine the context of a web page # c. Make web-based email that doesn't make users want to cry # d. Make a SQL server that is worth a damn # e. Make an IM client that can stay connected to the net # f. Make a web browser # g. Come up with my own ideas # h. Control my own spiders (let alone use the right HTTP protocol for them) User-agent: msnbot Crawl-delay: 10 # /sbin/route add -net 65.52.0.0 netmask 255.252.0.0 reject // block all of Microsoft if it doesn't adhere # This is what I can do... # a. Make a game console # b. Make a sweet iPod killer (Zune) # Does not use HTTP/1.1 with compression # These are the brain dead spiders from major search engines # # User-agent: yahoo! Slurp # User-agent: msnbot # Disallow: / # Allow: if ($_SERVER["SERVER_PROTOCOL"] === 'HTTP/1.1' || $relevancy > 0) # # Learn to use a HTTP protocol standard that's more than a decade old # www.w3.org/Protocols/rfc2068/rfc2068.txt
8 Responses to “Robotx txt V2”
moure said:
Tweets that mention Robotx txt V2 -- Topsy.com said:
[...] This post was mentioned on Twitter by Daniel Ulczyk, Eduardo Croissier, Ariel Isaac, Pedro Delgado, Arturo Marimon and others. Arturo Marimon said: Este es mejor que el de las leyes de la robotica RT @vseo_es: para reirse antes de irse a casa #bromaseo bit.ly/50kCkE [...]
uberVU - social comments said:
Social comments and google analytics for this post…
This post was mentioned on Twitter by vseo_es: para reirse antes de irse a casa #bromaseo bit.ly/50kCkE...
Diseño web Ciudad Real said:
Que bueno…;)
Snake said:
Jejeje está buenisimo :D
Drako said:
jaja esta muy original…
No se si se puede poner enlaces, si no mil disculpas, este es un error 404 de una pagina que tambien esta muy original y me gustaria compartirles:
:D
buzoneo said:
Nunca habia visto algo así… buenisimo!
BUZONEO said:
ES ALGO MUY CREATIVO ,PERO QUIEN VA AVER EL ROBOTS.TXT SALVO SI ES UN USUARIO AVANZADO.
Joer es buenísimo xDDD