View Single Post

  #1 (permalink)  
Old 05-24-2008, 04:21 PM
mumuri mumuri is offline
Junior Member
User
 
Join Date: May 2008
My distro: Debian
Posts: 11
Rep Power: 0
mumuri is on a distinguished road
Default lighttpd issue for website copiers

I would like to know if there is some issue to avoid website copiers like httrack to copy a full site in local

i know that we can use useragent,

but is there some other tricks ?

-------------------------------------
can we tell lighttpd, to not serve more that x pages in a period for the same IP ?
-------------------------------------
can we automatically ban browser that leech invisible link (or any special link)

for instance, you have a

Code:
<a href="ban-link.php" onClick="return false;">.</a>
this link can't be view by browsers, if a bot get it... his ip is banned (if the ip doesn't belong to a trust list with google, msn and yahoo bots in it).

i did on an apache by appending a "deny from xxx" in a htaccess, but i don't think it's possible with lighttpd

perhaps it's more an iptables works ?

thanks in advance

Last edited by mumuri; 05-24-2008 at 04:31 PM..
Reply With Quote