Robotx txt V2

Maravilla que me he encontrado analizando unos archivos de robots.txt

copio y pego:

# Hi, I'm a big, fat, bloated company that is unable to think outside the box.  Here's a list of things I can't figure out how to do yet...
#   a. Make an operating system that doesn't suck
#   b. Determine the context of a web page
#   c. Make web-based email that doesn't make users want to cry
#   d. Make a SQL server that is worth a damn
#   e. Make an IM client that can stay connected to the net
#   f. Make a web browser
#   g. Come up with my own ideas
#   h. Control my own spiders (let alone use the right HTTP protocol for them)

User-agent: msnbot
Crawl-delay: 10
# /sbin/route add -net 65.52.0.0 netmask 255.252.0.0  reject  // block all of Microsoft if it doesn't adhere

# This is what I can do...
#   a. Make a game console
#   b. Make a sweet iPod killer (Zune)

# Does not use HTTP/1.1 with compression
# These are the brain dead spiders from major search engines
#
# User-agent: yahoo! Slurp
# User-agent: msnbot
# Disallow: /
# Allow: if ($_SERVER["SERVER_PROTOCOL"] === 'HTTP/1.1' || $relevancy > 0)
#
# Learn to use a HTTP protocol standard that's more than a decade old
# http://www.w3.org/Protocols/rfc2068/rfc2068.txt
Si te gustó, compartelo compañero
[del.icio.us] [Google] [Ma.gnolia] [Mister Wong] [Technorati] [Windows Live] [Yahoo!]

actualizaciones por RSS!

January 15, 2010 • Tags: 

10 Tweets

14 Responses to “Robotx txt V2”

  1. vseo_es - January 15th, 2010

    para reirse antes de irse a casa #bromaseo http://bit.ly/50kCkE

    This comment was originally posted on Twitter

  2. DanielUlczyk - January 15th, 2010

    Robotx.txt V2 http://www.vseo.es/buscadores/robotx-txt-v2/

    This comment was originally posted on Twitter

  3. arturomarimon - January 15th, 2010

    Este es mejor que el de las leyes de la robotica RT @vseo_es: para reirse antes de irse a casa #bromaseo http://bit.ly/50kCkE

    This comment was originally posted on Twitter

  4. moure - January 15th, 2010

    Joer es buenísimo xDDD

  5. Tweets that mention Robotx txt V2 -- Topsy.com - January 15th, 2010

    [...] This post was mentioned on Twitter by Daniel Ulczyk, Eduardo Croissier, Ariel Isaac, Pedro Delgado, Arturo Marimon and others. Arturo Marimon said: Este es mejor que el de las leyes de la robotica RT @vseo_es: para reirse antes de irse a casa #bromaseo http://bit.ly/50kCkE [...]

  6. ElMaxi - January 15th, 2010

    Robots.txt V2 http://bit.ly/8FMKN2

    This comment was originally posted on Twitter

  7. corbaxseo - January 16th, 2010

    !!! RT @ElMaxi Robots.txt V2 http://bit.ly/8FMKN2

    This comment was originally posted on Twitter

  8. geosdigital - January 16th, 2010

    chiste SEO Robots.txt V2 http://bit.ly/8FMKN2 via @corbaxseo @ElMaxi

    This comment was originally posted on Twitter

  9. uberVU - social comments - January 16th, 2010

    Social comments and google analytics for this post…

    This post was mentioned on Twitter by vseo_es: para reirse antes de irse a casa #bromaseo http://bit.ly/50kCkE…

  10. Emirodgar - January 18th, 2010

    Archivo robots.txt de msn.com hackeado http://www.vseo.es/buscadores/robotx-txt-v2/

    This comment was originally posted on Twitter

  11. Diseño web Ciudad Real - January 18th, 2010

    Que bueno…;)

  12. Snake - February 1st, 2010

    Jejeje está buenisimo :D

  13. Drako - February 3rd, 2010

    jaja esta muy original…

    No se si se puede poner enlaces, si no mil disculpas, este es un error 404 de una pagina que tambien esta muy original y me gustaria compartirles:

    http://marqueze.net/dgdagad

    :D

  14. buzoneo - February 12th, 2010

    Nunca habia visto algo así… buenisimo!

Leave a Reply

Additional comments powered by BackType

Private