1. Help Center
  2. General
  3. Authorizations and data management

All you need to know about SemjiBot

To give Semji access to your content

 

Why does Semji use a bot?

Semji uses a crawler, commonly called a bot (or crawler, web crawler, web spider) in order to analyze and extract the content of your website as well as the pages that rank for your keywords.

This bot, called SemjiBot, developed specifically for Semji's needs, has to be authorized to visit your website to extract its content, analyze it and show it within the platform.

If this is not possible, some of Semji's features will be restricted.

semji bot

When does SemjiBot access my website?

  • As a client, SemjiBot accesses your site when you import one or more pages into the platform.
  • SemjiBot comes back when you request a synchronization of your content.
  • SemjiBot can also come back in other cases and at different times of the week in order to improve the performance of your content.

How do I allow SemjiBot to browse my site?

Allow Semji's user agents

The Semji bot identifies itself to the websites it visits using one of the following User-Agent strings:

  • Mozilla/5.0 (compatible; SemjiBot/1.0; +http://semji.com)
  • AppleWebKit/537.36 (KHTML, like Gecko; compatible; SemjiBot/1.0; +http://semji.com) Chrome/W.X.Y.Z Safari/537.36

In this context, "Chrome/W.X.Y.Z" is a placeholder that evolves with updates to the SemjiBot and may, for example, appear as "Chrome/79.0.3945.88".

This information should be processed by your technical team, who can then explicitly authorize SemjiBot for website access.

Allow Semji's IP adresses

On the other hand, if you have the possibility to allow public IP addresses used by Semjibot, here they are: 

  • 63.34.75.122
  • 63.35.78.179
  • 54.228.104.165
  • 18.200.156.37
  • 34.248.117.83
  • 52.213.28.177