Installation
This guide will walk you through installing Better Robots.txt on your WordPress site.
Requirements
Before installing, ensure your WordPress site meets these requirements:
- WordPress version: 4.1 or higher
- PHP version: 7.4 or higher
- Access: Administrator access to WordPress dashboard
- Storage: 10MB free space for plugin files
Installation Methods
Method 1: WordPress.org Directory (Recommended)
- Log in to your WordPress dashboard
- Navigate to Plugins → Add New
- Search for "Better Robots.txt"
- Click Install Now on the plugin by Pagup
- Click Activate after installation completes
Method 2: Manual Upload
- Download the plugin from WordPress.org
- Unzip the downloaded file to your computer
- Connect to your website via FTP or file manager
- Navigate to
/wp-content/plugins/ - Upload the
better-robots-txtfolder - Log in to WordPress and activate the plugin
Method 3: Direct Download
- Visit the Better Robots.txt WordPress.org page
- Click Download button
- Follow Method 2 steps 2-6
Post-Installation Setup
1. Initial Configuration
After activation, you'll see a new menu item:
- In your WordPress dashboard, navigate to Better Robots.txt → Settings
- The plugin will automatically detect your current setup and suggest optimal settings
- Review the default configuration and make any desired changes
- Click Save Changes
2. Freemius Setup (Optional)
Better Robots.txt uses Freemius for premium features:
- You'll see an opt-in screen after activation
- Free Version: Click "Skip" to continue with free features
- Pro Version: Click "Allow & Continue" to unlock premium features
Why Opt-In?
Opting in allows us to:
- Provide automatic updates
- Offer priority support
- Send security notifications
- Share feature announcements
3. Verify Installation
To verify your robots.txt is working:
- Visit
https://yoursite.com/robots.txt - You should see the generated robots.txt content
- Check that it contains the Better Robots.txt signature
# This robots.txt file was created by Better Robots.txt (Index & Rank Booster by Pagup) PluginCommon Installation Issues
Plugin Installation Failed
Problem: WordPress shows "Installation failed: Could not create directory"
Solutions:
- Check WordPress file permissions
- Ensure
/wp-content/plugins/is writable (755 permissions) - Try manual installation method
White Screen After Activation
Problem: Website shows white screen after plugin activation
Solutions:
- Increase PHP memory limit in
wp-config.php:phpdefine('WP_MEMORY_LIMIT', '256M'); - Check PHP version - requires PHP 7.4+
- Deactivate conflicting plugins
- Switch to a default theme temporarily
robots.txt Not Found
Problem: yoursite.com/robots.txt returns 404 error
Solutions:
Check WordPress privacy settings:
- Go to Settings → Reading
- Ensure "Discourage search engines..." is unchecked
Verify permalink structure:
- Go to Settings → Permalinks
- Save settings (no changes needed)
Check .htaccess file:
apache<Files robots.txt> Allow from all </Files>
Plugin Settings Not Saving
Problem: Changes in settings don't save
Solutions:
- Clear WordPress cache
- Check PHP version compatibility
- Verify user permissions (must be Administrator)
- Disable caching plugins temporarily
Uninstallation
If you need to remove Better Robots.txt:
Safe Removal
- Backup your settings (screenshot or copy configuration)
- Navigate to Plugins → Installed Plugins
- Find "Better Robots.txt" and click Deactivate
- Click Delete to remove completely
Preserve Settings During Removal
To keep your robots.txt configuration after deactivation:
- Go to Better Robots.txt → Settings
- Scroll to Advanced Options
- Uncheck "Remove settings on uninstall"
- Save changes before deactivation
Migration from Other Robots.txt Plugins
Switching from another robots.txt plugin? Better Robots.txt automatically:
- Detects existing robots.txt files
- Imports current settings when possible
- Backups original configuration
- Provides migration recommendations
Physical Files
If you have a physical robots.txt file in your root directory, the plugin will suggest removing it for virtual generation, or convert it for Pro version users.
Getting Help
If you encounter issues during installation:
- Support Forum: WordPress.org Support
- Documentation: Continue reading these guides
- Premium Support: Available for Pro version users
- Contact: Through the plugin's support page
Next Steps
After successful installation:
- 📖 Read the Quick Start Guide
- ⚙️ Configure your Basic Settings
- 🚀 Explore Pro Features (if applicable)
- 🎯 Check our Examples for common use cases
Need help? Visit our Support Forum or check our Troubleshooting Guide.