Generates a dynamic llms.txt file for AI crawlers and tracks visitor statistics with detailed bot analysis.
CF LLMS Stats Tracker creates an optimized llms.txt file at /llms.txt that provides AI crawlers (like those from GPTBot, ClaudeBot, etc.) with structured information about your recent content, contact details, and usage policies.
Key Features:
– Automatically generates llms.txt with your 20 most recent posts
– Tracks every llms.txt request with IP, user agent, referrer, and bot detection
* Detailed admin dashboard with statistics, bot analysis, and timelines
– Export visitor data as CSV
– Configurable contact information and privacy policy links
– Automatic cache refresh (hourly + on post publish)
– Data retention settings (default 90 days)
– Dashboard widget with key metrics
Perfect for:
– Blog owners wanting AI-friendly content discovery
– Privacy-conscious site owners tracking AI crawlers
– Developers monitoring llms.txt usage patterns
FAQ
What is llms.txt?
llms.txt is an emerging standard for websites to provide structured information to AI training crawlers, similar to robots.txt but specifically for Large Language Models. It helps you control what content AI systems can discover and use.
Where can I find my llms.txt file?
Your llms.txt file is available at https://yoursite.com/llms.txt
Does this replace robots.txt?
No. robots.txt controls crawling permissions. llms.txt provides content discovery and licensing information for AI systems that respect both files.
Can I customize what content appears in llms.txt?
Yes! Configure owner contact info, privacy policy links, and post types in LLMS Stats → Settings.
How does bot detection work?
The plugin analyzes User-Agent strings against common bot patterns (Google, Bing, Facebook, etc.) and categorizes requests as human or bot visits.
Is my data secure?
Yes. All data is stored securely in your WordPress database with proper sanitization and nonces. Data retention is configurable (default 90 days).
Can I export the statistics?
Yes! Use the Download Stats CSV button in the stats dashboard to export all visitor data.
ChangeLog
1.3.2
- Fixed reset stats button issue
1.3.1
1.3
- Fixed WordPress Coding Standards compliance
1.2.2
- Fixed WordPress Coding Standards compliance (WP_Filesystem, wpdb::prepare, sanitization)
- Added %i placeholders for table names in all queries
- Improved CSV export using WP_Filesystem API
- Enhanced superglobal sanitization (HTTP_USER_AGENT, HTTP_REFERER)
- Added cache invalidation for dashboard statistics
1.2.1
- Added wp_safe_redirect, wp_parse_url, gmdate compliance
- Full register_setting sanitization callbacks
- Prefixed global functions
- Added object caching for statistics queries
- Improved admin interface with proper escaping
1.2.0
- Initial release with llms.txt generation and stats tracking
- Bot detection and analysis dashboard
- Admin settings and CSV export
- Automatic cache management
