To give Semji access to your content
Why does Semji use a bot?
Semji uses a crawler, commonly called a bot (or crawler, web crawler, web spider) in order to analyze and extract the content of your website as well as the pages that rank for your keywords.
This bot, called SemjiBot, developed specifically for Semji's needs, has to be authorized to visit your website to extract its content, analyze it and show it within the platform.
If this is not possible, some of Semji's features will be restricted.
When does SemjiBot access my website?
- As a client, SemjiBot accesses your site when you import one or more pages into the platform.
- SemjiBot comes back when you request a synchronization of your content.
- SemjiBot can also come back in other cases and at different times of the week in order to improve the performance of your content.
How do I allow SemjiBot to browse my site?
Allow Semji's user agents
The Semji bot identifies itself to the websites it visits using one of the following User-Agent strings:
- Mozilla/5.0 (compatible; SemjiBot/1.0; +http://semji.com)
- AppleWebKit/537.36 (KHTML, like Gecko; compatible; SemjiBot/1.0; +http://semji.com) Chrome/W.X.Y.Z Safari/537.36
In this context, "Chrome/W.X.Y.Z"
is a placeholder that evolves with updates to the SemjiBot and may, for example, appear as "Chrome/79.0.3945.88"
.
This information should be processed by your technical team, who can then explicitly authorize SemjiBot for website access.
Allow Semji's IP adresses
On the other hand, if you have the possibility to allow public IP addresses used by Semjibot, here they are:
- 63.34.75.122
- 63.35.78.179
- 54.228.104.165
- 18.200.156.37
- 34.248.117.83
- 52.213.28.177