Probably you should let the bot follow shortlinks...not sure if it's feasible. That would probably take quite some bandwidth.
You are viewing a single comment's thread from:
Probably you should let the bot follow shortlinks...not sure if it's feasible. That would probably take quite some bandwidth.
Already implemented ;)