Hidden AI visits
AI crawlers like PanguBot can use your content without you noticing.
AI Bots
PanguBot Crawl Analysis
🟡 Caution
See in real time when the PanguBot AI crawler scans your site. Separate AI crawl traffic from other visitors.
Don't manage PanguBot traffic blindly
Content strategy gap
Planning content is hard when you don't know which pages AI systems pull.
Unmeasured AI traffic
AI crawl rarely shows clearly in classic analytics-dedicated detection is required.
Crawl visibility with NMOS.NET
rDNS verification, robots/llms checks, and site readiness—no blocking promises.
rDNS verification
Confirm whether crawler IPs match known reverse-DNS patterns
robots.txt checks
See Allow/Disallow coverage for this crawler against your policy
llms.txt / AI policy
Check llms.txt and the Markdown template from the panel
Site readiness
One score across robots, sitemap, llms, security.txt, and tracking
What NMOS.NET shows for this crawler
Track visits, verify identity, and review policy—no blocking promise.
llms.txt / AI policy
See whether llms.txt is in place and how AI crawlers are visiting.
robots.txt policy check
Compare crawler hits with your Allow/Disallow rules and spot gaps.
Safety & risk level
Catalog safety badges (safe / caution / danger) on every visit filter.
How it works
Start seeing crawler visits in three steps.
1
Create an account
Sign up for free and add your site.
2
Install tracking
Add the meta tag, tracking.js, and optional no-JS beacon; verify with Check.
3
Track and review
See PanguBot visits, verification, and policy checks in your dashboard.
Frequently asked questions
About PanguBot detection and NMOS.NET.
What is PanguBot?
PanguBot is a crawler used by AI systems to scan web content.
How does NMOS.NET detect PanguBot?
It matches user-agents against the catalog, logs PanguBot visits, and shows category plus safety level.
How long does setup take?
Adding the meta tag usually takes just a few minutes.
Is my data safe?
Tracking is passive via meta tag and collects crawl records without hurting site performance.
Start tracking PanguBot visits
Free account and a short install. See crawl traffic with category and safety levels.
Tracking Systems
Similar crawlers by category or risk level