nicht angemeldet
hi,
Sofern dieses Programm die robot.txt nicht umgehen kann
falls es sich um http://www.sitesucker.us/basic.html handelt - zitat:
SiteSucker honors robots.txt exclusions and the Robots META tag.
gruß,
wahsaga
--
"Look, that's why there's rules, understand? So that you _think_ before you break 'em."
"Look, that's why there's rules, understand? So that you _think_ before you break 'em."