Skip to content

Add msnbot for results with "Fetch as bingbot"Β #191

@cyrilgandon

Description

@cyrilgandon

I am using the Fetch as bingbot feature (https://www.bing.com/webmaster/diagnostics/fetch/bingbot) for testing my pages, and it didn't hit prerender.

After searching what useragent they use, I found this in my logs:

[06/Dec/2019:11:16:50 +0100] "GET / HTTP/1.1" 200 1342 "-" "msnbot/2.0b (+http://search.msn.com/msnbot.htm)"

Maybe we can update all the list of user agent of all the examples/libraries, and add msnbot to the list ?

It may be a bug on their side also. After some research, an article from 2010

Microsoft To Replace MSNBot With BingBot October 1, 2010

Whatever if it is their mistake or not, I guess it will not hurt to add msnbot. I will do that on our nginx config, I let you handle the decision to add it or not to all the repo too :)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions