Edge traffic
Every request to the projects on the front page, rolled up from the access log of the Traefik edge proxy in front of them. Most of it is crawlers. Updated every 10 minutes, last 3 min ago.
598,757
requests in the last 24 hours · 87.6% from self-identified bots
- Served
- 503K
- 84.0%
- Challenged
- 36K
- 6.0%
- Blocked
- 58K
- 9.7%
- Not found / other
- 1.7K
- 0.3%
- Server error
- 19
- <0.1%
Last 24 hours
Requests per hour, by outcome. Hours in UTC.
- Served
- Challenged
- Blocked
- Not found / other
- Server error
010K20K30K40K
22:0004:0010:0016:00
Daily
One bar per complete UTC day, kept indefinitely. History starts 2026-10-02: older raw logs had already rotated away.
- Served
- Challenged
- Blocked
- Not found / other
- Server error
0200K400K600K800K
Oct 2Oct 3Oct 4Oct 5Oct 6Oct 7
Who is crawling
Grouped by the user agent each request claims, which is not verified: a scraper posing as Googlebot counts as Googlebot. The challenge page checks IPs instead, so impostors tend to show up as challenged. Last 24 hours.
| user agent | kind | requests | share | served | challenged | blocked | |
|---|---|---|---|---|---|---|---|
| Applebot | search | 226,568 | 37.8% | 100.0% | 3 | — | |
| meta-webindexer | ai search | 170,911 | 28.5% | 100.0% | — | — | |
| Claude-SearchBot | ai search | 85,031 | 14.2% | 100.0% | — | — | |
| browsers & other | 74,322 | 12.4% | 4.0% | 11,872 | 58,076 | ||
| ExaSearchBot | ai search | 21,323 | 3.6% | 2.0% | 20,892 | — | |
| Bingbot | search | 9,354 | 1.6% | 99.9% | — | — | |
| Amazonbot | ai search | 6,759 | 1.1% | 99.8% | — | — | |
| Baiduspider | search | 3,121 | 0.5% | 0.2% | 3,099 | — | |
| facebookexternalhit | preview | 355 | <0.1% | 99.4% | — | — | |
| OAI-SearchBot | ai search | 209 | <0.1% | 94.3% | — | — | |
| Googlebot | search | 176 | <0.1% | 88.1% | — | — | |
| SEO tools | seo | 134 | <0.1% | 99.3% | — | — | |
| ClaudeBot | training | 109 | <0.1% | 90.8% | — | — | |
| PerplexityBot | ai search | 86 | <0.1% | 61.6% | — | — | |
| meta-externalagent | training | 78 | <0.1% | 52.6% | — | — | |
| GPTBot | training | 61 | <0.1% | 60.7% | — | — | |
| Bytespider | training | 43 | <0.1% | 69.8% | — | — | |
| ChatGPT-User | ai fetch | 43 | <0.1% | 74.4% | — | — | |
| Claude-User | ai fetch | 39 | <0.1% | 43.6% | — | — | |
| YandexBot | search | 17 | <0.1% | 100.0% | — | — | |
| DuckDuckBot | search | 10 | <0.1% | 90.0% | — | — | |
| CCBot | training | 8 | <0.1% | 0.0% | — | — |
By site
The projects on the front page. Blocked includes challenged. Latency is for served requests only. Last 24 hours.
| site | requests | served | blocked | 5xx | p50 | p95 |
|---|---|---|---|---|---|---|
| npiradar.com | 594,398 | 84.2% | 93,942 | 19 | 30 ms | 66 ms |
| theqrcode.io | 1,929 | 75.0% | — | — | 18 ms | 269 ms |
| camberstack.io | 1,092 | 33.2% | — | — | 2 ms | 24 ms |
| redbudway.com | 829 | 65.0% | — | — | 2 ms | 29 ms |
| centurylate.com | 509 | 73.7% | — | — | 1 ms | 95 ms |