I would like to know if there is some issue to avoid website copiers like httrack to copy a full site in local
i know that we can use useragent,
but is there some other tricks ?
-------------------------------------
can we tell lighttpd, to not serve more that x pages in a period for the same IP ?
-------------------------------------
can we automatically ban browser that leech invisible link (or any special link)
for instance, you have a
Code:
<a href="ban-link.php" onClick="return false;">.</a>
this link can't be view by browsers, if a bot get it... his ip is banned (if the ip doesn't belong to a trust list with google, msn and yahoo bots in it).
i did on an apache by appending a "deny from xxx" in a htaccess, but i don't think it's possible with lighttpd
perhaps it's more an iptables works ?
thanks in advance