cschantz df96addc9f Make CT_LIMIT optimizer MUCH smarter - CDN, caching, time patterns, resources
USER REQUEST: "are we missing anything with it? can it be smarter"

ADDED 5 MAJOR INTELLIGENCE LAYERS:

═══════════════════════════════════════════════════════════════════════
1. CDN DETECTION & ADJUSTMENT
═══════════════════════════════════════════════════════════════════════

NEW: detect_cdn_usage()
- Checks DNS records for Cloudflare, Akamai, Fastly, CloudFront, Sucuri
- Checks nameservers for CDN providers
- REDUCES complexity score by -2 if CDN detected
- Reason: CDN handles static assets = fewer direct server connections

IMPACT:
  Before: WordPress site = complexity 7
  After (with CDN): complexity 5
  Result: Lower CT_LIMIT needed, better security

═══════════════════════════════════════════════════════════════════════
2. CACHING LAYER DETECTION & ADJUSTMENT
═══════════════════════════════════════════════════════════════════════

NEW: detect_caching()
- Checks for Redis running (systemctl/pgrep)
- Checks for Memcached running
- Detects WordPress caching plugins:
  • WP Rocket
  • W3 Total Cache
  • WP Super Cache
  • LiteSpeed Cache
  • WP Fastest Cache
- Checks .htaccess for cache headers
- REDUCES complexity by -(caching_score/2)

IMPACT:
  Site with Redis + WP Rocket: -3 complexity
  Result: Well-cached sites need lower CT_LIMIT

═══════════════════════════════════════════════════════════════════════
3. TIME-OF-DAY TRAFFIC PATTERN ANALYSIS
═══════════════════════════════════════════════════════════════════════

NEW: Hourly traffic tracking in AWK script
- Extracts hour from timestamps
- Tracks requests per hour
- Identifies peak hour
- Calculates peak vs average ratio

DISPLAYS:
```
Traffic Patterns:
  Peak hour: 14:00 (8,542 requests)
  Average: 2,845 requests/hour
  Peak is 300% above average
  → CT_LIMIT should handle peak, not average
```

INTELLIGENCE:
- If peak >200% of average, shows warning
- Reminds: Set CT_LIMIT for peak, not average traffic
- Prevents blocking during legitimate traffic spikes

═══════════════════════════════════════════════════════════════════════
4. SERVER RESOURCE LIMITS CHECKING
═══════════════════════════════════════════════════════════════════════

NEW: check_server_resources()
- Reads total RAM (free -m)
- Counts CPU cores (nproc)
- Calculates max safe connections:
  • RAM-based: total_mb / 2 (reserve 50% for OS)
  • CPU-based: cores * 50 (rough max per core)
  • Takes lower of the two

DISPLAYS:
```
Server Resource Limits:
  RAM: 4096MB | CPU: 4 cores
  Max safe connections (hardware): 200
```

SAFETY:
- Caps recommendations at server maximum
- Prevents recommending CT_LIMIT=500 on 1GB VPS
- Shows "Note: Capped at server max" if needed

═══════════════════════════════════════════════════════════════════════
5. SITE-SPECIFIC OPTIMIZATION RECOMMENDATIONS
═══════════════════════════════════════════════════════════════════════

NEW: Actionable advice per site

DISPLAYS:
```
Optimization Opportunities:
  📦 CDN Recommended for:
     • shop.example.com (would reduce CT_LIMIT need)
     • blog.example.com (would reduce CT_LIMIT need)

   Caching Recommended for:
     • wordpress.example.com (WP Rocket, Redis, or W3 Total Cache)
     • site2.com (WP Rocket, Redis, or W3 Total Cache)

  Or if optimized:
   Sites are well-optimized (CDN + caching in place)
```

INTELLIGENCE:
- Only suggests CDN for high-complexity sites (≥6)
- Only suggests caching for WordPress without it
- Shows top 3 sites needing each optimization
- Explains benefit: "would reduce CT_LIMIT need"

═══════════════════════════════════════════════════════════════════════
ENHANCED RECOMMENDATION LOGIC:
═══════════════════════════════════════════════════════════════════════

Now factors in:
 Site type (WordPress/ecommerce/static)
 Plugin count
 Ajax complexity
 CDN usage (reduces needs)
 Caching layer (reduces needs)
 Ecommerce presence (+15 buffer)
 Average site complexity
 Peak hour traffic patterns
 Server hardware limits

EXAMPLE CALCULATION:
  Base: max_legit = 45
  Complexity buffer: +14 (avg complexity 7)
  Ecommerce bonus: +10
  Subtotal: 69
  With Redis + CDN: -3
  Final: CT_LIMIT = 66
  Capped at server max: 200 (OK, no cap needed)

═══════════════════════════════════════════════════════════════════════
FUNCTIONS ADDED:
═══════════════════════════════════════════════════════════════════════

- detect_cdn_usage() - DNS/NS checking for CDN (lines 54-74)
- detect_caching() - Redis/Memcached/WP plugins (lines 76-110)
- check_server_resources() - RAM/CPU limits (lines 260-283)
- Enhanced AWK script - Hourly traffic tracking (lines 319-336)
- Enhanced generate_recommendation() - All new displays (lines 547-617)

═══════════════════════════════════════════════════════════════════════
RESULT:
═══════════════════════════════════════════════════════════════════════

BEFORE: "Set CT_LIMIT=100 (generic guess)"

AFTER: "Set CT_LIMIT=66 because:
  • Your peak traffic is 14:00 (300% above average)
  • 2 sites have ecommerce (need headroom)
  • 1 site has Redis (can be lower)
  • 1 site has CDN (can be lower)
  • Your server can handle max 200 connections
  • Recommendation fits your specific setup"

Plus: "Install Redis on wordpress.com to reduce CT_LIMIT by 15%"

SMARTER: Yes. Much smarter.
2025-11-14 15:43:36 -05:00
2025-11-03 18:14:51 -05:00

Linux Server Management Toolkit

Comprehensive cPanel/Linux server management suite with modular architecture and intelligent security features.

📦 Directory Structure

server-toolkit/
├── launcher.sh                          # Main menu system
├── README.md                            # This file
│
├── modules/                             # Modular scripts organized by category
│   │
│   ├── security/                        # 🛡️ Security & Threat Analysis
│   │   ├── bot-analyzer.sh             # Full bot/threat analysis
│   │   ├── live-attack-monitor.sh      # Real-time attack monitoring dashboard
│   │   ├── ssh-attack-monitor.sh       # SSH brute force detection
│   │   ├── web-traffic-monitor.sh      # Web traffic monitoring
│   │   ├── firewall-activity-monitor.sh # CSF/iptables monitoring
│   │   ├── enable-cphulk.sh            # cPHulk enablement with CSF whitelist import
│   │   ├── ip-reputation-manager.sh    # Centralized IP reputation tracking
│   │   └── tail-*.sh                   # Various log monitoring scripts
│   │
│   ├── backup/                          # 💾 Backup & Recovery (Acronis Cyber Protect)
│   │   ├── acronis-backup-manager.sh   # Main backup management menu
│   │   ├── acronis-install.sh          # Install Acronis agent
│   │   ├── acronis-update.sh           # Update Acronis agent
│   │   ├── acronis-uninstall.sh        # Uninstall Acronis agent
│   │   ├── acronis-register.sh         # Register agent with cloud
│   │   ├── acronis-configure.sh        # Configure agent settings
│   │   ├── acronis-agent-status.sh     # Comprehensive agent status check
│   │   ├── acronis-trigger-backup.sh   # Trigger manual backups with optimizations
│   │   ├── acronis-backup-status.sh    # Check backup job status
│   │   ├── acronis-list-backups.sh     # List all backups
│   │   ├── acronis-plan-manager.sh     # Manage protection plans
│   │   ├── acronis-schedule-viewer.sh  # View backup schedules
│   │   ├── acronis-restore.sh          # Restore from backup
│   │   ├── acronis-logs.sh             # View Acronis logs
│   │   └── acronis-troubleshoot.sh     # Troubleshoot common issues
│   │
│   ├── website/                         # 🌐 Website Diagnostics & Troubleshooting
│   │   ├── website-error-analyzer.sh   # Comprehensive website error analysis
│   │   └── 500-error-tracker.sh        # Track and analyze 500 errors
│   │
│   ├── diagnostics/                     # 🔍 System Diagnostics
│   │   └── system-health-check.sh      # Comprehensive health analysis
│   │
│   ├── performance/                     # 📊 Performance Analysis
│   │   ├── hardware-health-check.sh    # Hardware diagnostics
│   │   ├── mysql-query-analyzer.sh     # MySQL performance analysis
│   │   └── network-bandwidth-analyzer.sh # Network analysis
│   │
│   └── maintenance/                     # 🧹 System Maintenance
│       └── cleanup-toolkit-data.sh     # Clean temporary toolkit data
│
├── lib/                                 # Shared libraries
│   ├── common-functions.sh             # Reusable functions
│   ├── system-detect.sh                # System type detection
│   ├── user-manager.sh                 # User account management
│   ├── mysql-analyzer.sh               # MySQL utilities
│   └── reference-db.sh                 # Cross-module intelligence sharing
│
├── config/                              # Configuration files
│   ├── settings.conf                   # Main configuration
│   ├── whitelist-ips.txt               # IP whitelist
│   └── whitelist-user-agents.txt       # User-Agent whitelist
│
└── tools/                               # Utility scripts
    ├── diagnostic-report.sh            # Generate system reports
    └── test-*.sh                       # Testing utilities

🚀 Quick Start

Installation & Running

One command - automatic cleanup:

curl -sL https://git.mull.lol/cschantz/Linux-Server-Management-Toolkit/archive/main.tar.gz | tar xz && source linux-server-management-toolkit/run.sh

When exiting (option 0), answer "yes" and cleanup happens automatically - no extra steps.

Or if already downloaded:

source /root/server-toolkit/run.sh

Key Features

🛡️ Security & Threat Analysis

  • 3-Mode Security Menu: Analysis / Actions / Live Monitoring
  • Live Attack Monitor: Real-time SOC dashboard with threat classification
  • Intelligent cPHulk Setup: Auto-imports CSF whitelists from all sources
  • IP Reputation Tracking: Centralized cross-module IP intelligence
  • Multi-Source Monitoring: SSH, Web, Firewall, cPHulk integration

💾 Backup & Recovery (Acronis Cyber Protect)

  • Complete Agent Management: Install, update, uninstall, register
  • Comprehensive Status Monitoring: Agent health, registration, cloud connectivity
  • Manual Backup Triggering: CLI-managed plans with performance optimizations
  • Backup Type Selection: Full, Incremental, Differential backups
  • Plan Management: View, enable/disable, delete protection plans
  • Restore Operations: Full restore capabilities from backups
  • Troubleshooting Tools: Log viewing and automated diagnostics

🌐 Website Diagnostics

  • Error Analysis: Comprehensive website error detection and troubleshooting
  • 500 Error Tracking: Detailed analysis of application errors
  • Log Integration: Apache, PHP-FPM, cPanel error log analysis
  • Smart Recommendations: Context-aware suggestions for fixing issues

🔍 System Diagnostics

  • Comprehensive Health Checks: Hardware, services, security posture
  • Smart Recommendations: Context-aware suggestions based on findings
  • cPanel/WHM Integration: Native support for cPanel environments

📊 Session Intelligence

  • Reference Database: Cross-module data sharing (.sysref)
  • No Historical Tracking: Session-based intelligence only
  • "Download, Run, Fix, Delete": Designed for one-time troubleshooting

🎯 Usage Examples

Security Analysis with Live Monitoring

bash launcher.sh
# Select: Security & Threat Analysis
# Select: Live Monitoring & Alerts
# Select: Live Network Security Monitor

Enable cPHulk with CSF Whitelist

bash launcher.sh
# Select: Security & Threat Analysis
# Select: Security Actions & Fixes
# Select: Authentication Security
# Select: Enable cPHulk Protection

Acronis Backup Management

bash launcher.sh
# Select: Backup & Recovery
# Select: Check Agent Status (view health, registration, connectivity)
# Select: Trigger Manual Backup (with type selection and optimizations)
# Select: Manage Protection Plans

Website Error Analysis

bash launcher.sh
# Select: Website Diagnostics & Troubleshooting
# Select: Website Error Analyzer
# Choose a cPanel user account to analyze

System Health Check

bash launcher.sh
# Select: System Diagnostics
# Select: System Health Check

🔧 Configuration

Edit the configuration file:

nano /root/server-toolkit/config/settings.conf

🔒 Security Considerations

  • Run as root: Most modules require root access
  • Credentials stored safely: Git credentials in ~/.git-credentials (outside project)
  • No sensitive data in repo: .gitignore excludes keys, tokens, credentials
  • Test first: Try on non-production environments first

📊 Recent Updates (v2.1)

Backup & Recovery

  • Complete Acronis Cyber Protect integration (16 management scripts)
  • Agent installation, registration, and update automation
  • Comprehensive status monitoring (health, registration, connectivity)
  • Manual backup triggering with performance optimizations
  • Backup type selection (Full/Incremental/Differential)
  • Protection plan management and scheduling

Website Diagnostics

  • Comprehensive website error analyzer
  • 500 error tracking and troubleshooting
  • Multi-log integration (Apache, PHP-FPM, cPanel)
  • Smart error detection and recommendations

Security Enhancements

  • Centralized IP reputation tracking across modules
  • Complete security menu restructure (3-mode hierarchy)
  • Live network security monitoring dashboard
  • Intelligent cPHulk enablement with multi-source CSF whitelist discovery
  • Real-time threat detection and classification

Core Infrastructure

  • Reference database for cross-module intelligence
  • Git repository integration with auto-commit workflows
  • Modular architecture with organized category structure

🙏 Credits

Built for comprehensive cPanel/Linux server management with a focus on security and intelligent automation.


Version: 2.1.0 Repository: https://git.mull.lol/cschantz/Linux-Server-Management-Toolkit

S
Description
No description provided
Readme MIT 18 MiB
Languages
Shell 100%