WorksiMarketingBot
The crawler behind Worksi's AI marketing agents.
If you found WorksiMarketingBot/1.0 in your logs, it is software run by Worksi. Our AI marketing agents use it to read pages they research and to check that the links in our articles still work.
What it does
- It fetches a page when an agent asks to read that page, or when an article links to it. It does not crawl other sites from end to end.
- It runs no scripts, logs in to nothing and fills in no forms.
- It reads pages only over http and https on the standard ports.
How to keep it out
- It honours
robots.txt. It answers toUser-agent: WorksiMarketingBot, and otherwise follows the rules for*. It reads the file again at least once a day. - If your
robots.txtanswers with a server error, it stays away from your site until the file works again. - It leaves at least a second between two requests to one site.
Reaching us
If it causes you trouble, tell us through the contact page on worksi.ai.