[Hpr] Slow downloads again

Joshua Knapp jknapp85 at gmail.com
Wed Sep 6 07:14:03 PDT 2017


They mean that some times it didn't identify as yandex, sometimes it would
fake as a browser.  I saw the same thing in the logs after I started trying
to block the bot by user agent.

On Sep 6, 2017 7:09 AM, "Claes Wallin (韋嘉誠)" <
hackerpublicradio at clacke.user.lysator.liu.se> wrote:

> On Sep 6, 2017 4:09 PM, "Ken Fallon" <ken at fallon.ie> wrote:
> http://www.webhostingtalk.com/showthread.php?t=924727
>
> That thread is so funny. People really don't bother to read the full tread
> before they post, do they?
>
>  - Using robots.txt didn't help, so here's how I detect and redirect that
> bot.
>  - Dude use robots.txt
>  - IP block!
>  - I redirected instead.
>  - Dude you really should be using robots txt.
>  - Here's how I IP block!
>
> :-D
>
> Some people seem to believe that text file has magical powers.
>
>
> I didn't get this part:
>
> > One more thing: it identifies as client, not as bot !! Google and Yahoo
> identified as bots !
>
> What are they talking about? Is there anything aside from the user agent
> that indicates what the client is?
>
> --
>    /c
>
> _______________________________________________
> Hpr mailing list
> Hpr at hackerpublicradio.org
> http://hackerpublicradio.org/mailman/listinfo/hpr_hackerpublicradio.org
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://hackerpublicradio.org/pipermail/hpr_hackerpublicradio.org/attachments/20170906/59792d29/attachment.html>


More information about the Hpr mailing list