How Sitejet websites rank in AI searches?

Helpdesk SEO and Website Performance
1

Hi everyone,

I have a question related to AI-based search (e.g., ChatGPT/AI search) that came up after reading a recent article: Why don’t you rank in AI searches? It might simply be because of your hosting provider.

On Sitejet-hosted websites, are any AI bots/crawlers blocked by default on the servers (e.g., GPTBot, OAI-SearchBot, ChatGPT-User, or similar AI user-agents)?

If yes, where/how can this be checked, and is there a way to enable/allow them on a per project/domain basis (e.g., via robots.txt, server-side settings, or whitelisting)?

Thanks in advance!

2

Just a thought: Have you cross-checked the assumptions the author of this articles makes with somebody else? The assumption he tries to prove is only partially valid but technically definitely more “nuanced”, I would say :slight_smile:

I have forwarded this to our developers to give you more info from our side.

3

Hey Andre, I just want to know if good AI bots/crawlers can access websites made by Sitejet studio. This is very important thing for AI visibility. Has the tech team answered? They might be able to answer this question in few min. Thanks!

1 Like
4

And I just want to know if you cross checked the assumption he makes. Always cross check :slight_smile:

Also, what would have helped in the article is to name a few sites where you can manually check if your website is blocked on a infrastructure level.

I ran a few user sites through these tools:

They all show up green. :partying_face:

Did a quick search and can confirm the assumption from multiple high authoritiy sources. AI bots are being blocked at the server and CDN level, often by default - search for Cloudflare’s “AIndependence” Feature and Hostinger Data Study.

But, be aware that there are different types of AI bots. There is also a significant debate around “zero-click searches” and a real traffic loss.

Another technical issue is the JavaScript Rendering - Unline Googlebot, most bots are not yet great at executing complex JS. This could be a short time issue with Collections as we rely on JS there.

Since we do not charge for clicks and traffic though, the constant clicks will not cost you more.

Unless you have a CDN like Cloudflare in front of your website, you “should” be fine :slightly_smiling_face:

I still await an answer from Hetzner if they do block any AI bots just to get close to 100% with my yes :smiley:

5

Thanks André!

1 Like