Commit Graph

4 Commits

Author SHA1 Message Date
cschantz fa79663d9e CRITICAL: Add advanced health indicators to loadwatch analyzer
Added 3 CRITICAL missing health indicators that were identified during
comprehensive log analysis. These detect the most severe system issues
that require immediate attention.

NEW CRITICAL DETECTIONS:
========================

1. Memory Thrashing Detection (kswapd0)
   - Detects when kernel swap daemon (kswapd0) is consuming CPU
   - THE definitive indicator of severe memory pressure
   - System is constantly swapping pages in/out - performance destroyed
   - Alert threshold: kswapd0 CPU > 1%
   - Recommendation: Immediate RAM upgrade required

2. I/O Blocking Detection (D-state processes)
   - Counts processes stuck in uninterruptible sleep (D-state)
   - Processes blocked waiting for I/O operations
   - Indicates severe disk performance issues or hardware failure
   - Alert threshold: Any D-state processes detected
   - Recommendation: Check disk health, look for failing drives

3. CPU Steal Time Alerts (VM resource contention)
   - Detects hypervisor stealing CPU cycles from VM
   - Physical host overcommitted or experiencing contention
   - Critical for cloud/VPS environments
   - Alert threshold: steal time > 10%
   - Recommendation: Contact hosting provider, request migration

ENHANCEMENTS ADDED:
===================

4. Top Memory Consumers Tracking
   - Similar to top CPU consumers
   - Aggregates MEM% across all snapshots
   - Shows average memory usage by process
   - Helps identify memory leaks

REPORT IMPROVEMENTS:
====================

- Added 3 new alert types to Critical Alerts Summary
- Added Top Memory Consumers section
- Added critical recommendations for new alerts with action steps
- Used red circle emoji (🔴) for CRITICAL severity
- Provided specific commands to run for diagnostics

TECHNICAL IMPLEMENTATION:
=========================

- Parse ps auxf STAT column for D-state detection
- Search top processes for kswapd pattern
- Already parsing steal time, added threshold check
- Created top_mem_processes.txt for memory tracking
- All enhancements tested on production logs

IMPACT:
=======

These 3 additions close critical gaps in system health monitoring:
- Memory thrashing: Most severe memory issue, previously undetected
- I/O blocking: Indicates imminent disk failure, critical early warning
- CPU steal: Cloud/VPS-specific issue, helps identify hosting problems

The analyzer now detects ALL critical system health issues that can
be identified from loadwatch logs.
2025-11-20 21:21:53 -05:00
cschantz 0a8cb302df Add Loadwatch Health Analyzer for system monitoring analysis
NEW FEATURE: Loadwatch Health Analyzer
- Comprehensive system health analysis from loadwatch monitoring logs
- Time-range analysis: 1h, 6h, 24h, 7d, 30d options
- Intelligent problem detection and trending

CAPABILITIES:
- Memory pressure detection (low available memory, high swap usage)
- CPU saturation analysis (idle %, iowait, steal time)
- Load average trending and threshold detection
- Process issue detection (zombie processes, high CPU/MEM consumers)
- MySQL performance monitoring (slow queries, thread counts)
- Network connection analysis
- Historical trending across snapshots (3-minute intervals)

IMPLEMENTATION:
- modules/diagnostics/loadwatch-analyzer.sh - Main analyzer script
- Handles symlinked loadwatch directories
- Parses 7 log sections: alerts, summary, memory, CPU, tasks, MySQL, network
- Generates detailed reports with actionable recommendations
- Saves reports to tmp/ directory for review

INTEGRATION:
- Added to Performance & Diagnostics menu (option 10)
- Time range selection submenu for user-friendly access
- Updated README.md with feature documentation and usage examples

ANALYSIS FEATURES:
- Swap threshold alerts (>= 50% usage)
- CPU saturation detection (< 10% idle)
- High I/O wait warnings (> 20%)
- Zombie process tracking
- Memory availability trending (avg/min/max)
- Top CPU consumers aggregated across period

Perfect for:
- Post-incident investigation
- Capacity planning
- Performance trending
- System health monitoring
- Identifying resource bottlenecks

Works with servers that have loadwatch monitoring enabled
(logs in /root/loadwatch or /var/log/loadwatch)
2025-11-20 20:35:16 -05:00
cschantz 8a2d9f5eec REFACTOR: Class D modules - Panel-specific conditionals
Completed Class D refactoring (panel-specific modules).

MODULES REFACTORED:

1. enable-cphulk.sh (ALREADY COMPLIANT)
   - Already checks SYS_CONTROL_PANEL at startup (line 35)
   - Exits gracefully if not cPanel
   - Shows detected panel in error message
   - All whmapi1 calls only reachable after panel check
   - No changes needed 

2. system-health-check.sh (ENHANCED)
   - Already had conditional checks for CPHulk (lines 606, 1706)
   - Enhanced control panel version detection (line 940-947)
   - Now uses SYS_CONTROL_PANEL_VERSION from system-detect.sh
   - Supports cPanel, Plesk, InterWorx version reporting
   - All panel-specific features properly gated

ARCHITECTURE COMPLIANCE:
 Panel-specific features wrapped in conditionals
 Graceful degradation when feature unavailable
 Clear error messages mentioning panel requirements
 Uses system-detect.sh variables
 All syntax validated

VERIFIED COMPLIANT:
 mysql-query-analyzer.sh - Already uses get_user_databases()

TESTING:
- Both modules passed `bash -n` syntax check
- enable-cphulk.sh will exit gracefully on non-cPanel
- system-health-check.sh will skip cPanel features on other panels

PROGRESS UPDATE:
- Class A:  7 modules (no changes needed)
- Class B:  6/6 modules COMPLETE
- Class C:  3/6 modules (bot-analyzer, malware-scanner, mysql-query)
- Class D:  2/2 modules COMPLETE
- Acronis:  13 modules (no changes needed)

Total: 31/38 modules architecture-compliant!

Remaining: 7 modules (website error analyzers + WordPress)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-19 20:08:31 -05:00
cschantz a51d968185 Initial commit: Server Management Toolkit v2.0
- Complete security menu restructure (3-mode: Analysis/Actions/Live)
- Intelligent cPHulk enablement with CSF whitelist import
- Live network security monitoring dashboard
- Multi-source threat detection and classification
- 50+ organized security tools across 4-level menu hierarchy
- System health diagnostics with cPanel/WHM integration
- Reference database for cross-module intelligence sharing
2025-11-03 18:21:40 -05:00