Crawler documentation

LohiSoftBot

LohiSoftBot is the web crawler operated by LohiSoft s.r.o. This page documents what it does, how to recognise it, and how to keep it off your site.

Last updated: 23 August 2026

At a glance

User-agent: LohiSoftBot/1.0
Source IP addresses: 79.139.58.98, 79.139.58.121
Crawl budget: Max. 20 pages per site
Crawler hostnames: *.bot.lohisoft.com
Contact: message@lohisoft.com

Who operates the crawler

Operator:: LohiSoft s.r.o.
Contact:: message@lohisoft.com

What LohiSoftBot is for

LohiSoftBot/1.0 builds LohiSoft's own search index.

It does not collect training data for AI models, and it does not copy content for republication.

What it stores

For each page, the crawler stores only the following:

The page title
The meta description
The h1–h3 headings
The URL
The text of links pointing to the page

What it does not store

The textual content of the page is not stored.

The index points the way, it does not answer: a search result always links back to the original page.

How much it requests

At most 20 pages per site.

Crawling etiquette

It obeys robots.txt as specified in RFC 9309.
It sends a single request per host at a time, with a delay between requests.
On HTTP 429 and 5xx responses it backs off, honouring the Retry-After header.
It never bypasses logins, paywalls or bot protection.

How to block it

Add the following to your robots.txt:

User-agent: LohiSoftBot
Disallow: /

You can also request immediate exclusion by email at message@lohisoft.com. We will then remove the domain from the crawl list.

message@lohisoft.com

Identifying and verifying the crawler

User-agent string

Currently in use: LohiSoftBot/1.0 (+message@lohisoft.com)
Being rolled out: LohiSoftBot/1.0 (+https://lohisoft.com/bot)

The older, email-based form is gradually being replaced by the URL form. Both are legitimate, so expect to see either one during the transition.

Source IP addresses

The crawler fetches pages exclusively from these fixed IPv4 addresses:

79.139.58.98
79.139.58.121

It makes no requests over IPv6.

Machine-readable list for firewall and WAF rules:

https://lohisoft.com/bot/ips.json

Served as application/json over HTTPS, without authentication or redirects.

Forward-confirmed reverse DNS (FCrDNS)

This is the recommended way to verify the crawler. It does not depend on the IP list above, so it stays correct even if we move the crawler to a different machine.

Run a reverse lookup on the IP address the request came from. The hostname returned must end in .bot.lohisoft.com
Run a forward lookup on that hostname. It must resolve back to exactly the same IP address.
If either step fails to match, the request is not from us and you are right to block it.

Match on the .bot.lohisoft.com suffix, not on a bare .lohisoft.com: the bare domain also covers our web server and our mail server, whereas .bot.lohisoft.com covers the crawlers only.

Crawler hostnames

79.139.58.98: crawler1.bot.lohisoft.com
79.139.58.121: crawler2.bot.lohisoft.com

Example

$ dig +short -x 79.139.58.98
crawler1.bot.lohisoft.com.

$ dig +short crawler1.bot.lohisoft.com
79.139.58.98

This page in other languages

Questions?

If anything here is unclear, or you want your domain excluded from crawling, write to us.

LohiSoft s.r.o.

message@lohisoft.com