Quote:
Originally Posted by ilbb
I recommend set cron every minute and log apache server status so you can see which pages/scripts are requested in the peaks. This will help you determine which script is causing server overload
|
I did this 100 times already. It is not a specific script that is overloading it.
ps -aux gives me this
Code:
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
nobody 6852 0.4 0.9 41988 18228 ? RN 04:38 0:45 /usr/local/apache/bin/httpd -k start -DSSL
nobody 8893 0.4 0.8 41884 17608 ? RN 05:17 0:37 /usr/local/apache/bin/httpd -k start -DSSL
nobody 9950 0.4 0.8 41756 17884 ? RN 05:38 0:32 /usr/local/apache/bin/httpd -k start -DSSL
nobody 10153 0.4 0.9 44352 19716 ? RN 05:42 0:30 /usr/local/apache/bin/httpd -k start -DSSL
nobody 10682 0.3 0.8 41756 17032 ? RN 05:52 0:27 /usr/local/apache/bin/httpd -k start -DSSL
nobody 10900 0.4 0.8 41780 17336 ? RN 05:57 0:27 /usr/local/apache/bin/httpd -k start -DSSL
nobody 11720 0.4 0.8 41640 16820 ? RN 06:11 0:24 /usr/local/apache/bin/httpd -k start -DSSL
root 11891 1.2 1.7 38516 34880 ? S 06:14 1:11 spamd child
nobody 12856 0.4 0.9 44232 19332 ? RN 06:37 0:19 /usr/local/apache/bin/httpd -k start -DSSL
nobody 12973 0.4 0.8 41652 16812 ? RN 06:40 0:17 /usr/local/apache/bin/httpd -k start -DSSL
nobody 12975 0.4 0.8 41640 16952 ? RN 06:40 0:18 /usr/local/apache/bin/httpd -k start -DSSL
nobody 13359 0.4 0.9 44220 19472 ? RN 06:48 0:15 /usr/local/apache/bin/httpd -k start -DSSL
nobody 13507 0.4 0.8 41640 16736 ? RN 06:52 0:15 /usr/local/apache/bin/httpd -k start -DSSL
nobody 13770 0.4 0.8 41580 17052 ? RN 06:59 0:11 /usr/local/apache/bin/httpd -k start -DSSL
nobody 13903 0.4 0.8 41528 16676 ? RN 07:01 0:12 /usr/local/apache/bin/httpd -k start -DSSL
nobody 14287 0.5 0.8 41528 17040 ? RN 07:11 0:10 /usr/local/apache/bin/httpd -k start -DSSL
nobody 14638 0.5 0.8 41524 16712 ? RN 07:22 0:08 /usr/local/apache/bin/httpd -k start -DSSL
nobody 14773 0.7 0.8 41516 16644 ? RN 07:27 0:08 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15054 0.7 0.8 41528 16956 ? RN 07:33 0:06 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15333 0.9 0.8 41568 16412 ? RN 07:38 0:04 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15649 1.3 0.8 41528 16208 ? RN 07:44 0:02 /usr/local/apache/bin/httpd -k start -DSSL
mailnull 15667 0.0 0.2 9596 4076 ? S 07:44 0:00 /usr/sbin/exim -bd -q60m
mailnull 15669 0.0 0.0 0 0 ? Z 07:44 0:00 [exim] <defunct>
nobody 15719 1.4 0.7 41364 15336 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15722 1.4 0.7 41364 15336 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15723 1.1 0.7 41364 15372 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15724 1.0 0.7 41364 15368 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15725 1.0 0.7 41364 15368 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15726 1.0 0.7 41364 15368 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15728 1.1 0.7 41364 15368 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15730 1.1 0.7 41364 15368 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15731 1.3 0.7 41364 15336 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15732 1.1 0.7 41364 15372 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15733 1.2 0.7 41364 15344 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15734 1.3 0.7 41364 15336 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15735 1.3 0.7 41364 15336 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15736 1.2 0.7 41364 15336 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15737 1.2 0.7 41364 15336 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15740 1.1 0.7 41364 15336 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15741 1.1 0.7 41364 15336 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15742 0.9 0.7 41364 15364 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15744 1.1 0.7 41364 15332 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15746 1.0 0.7 41364 15388 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15747 0.9 0.7 41364 15364 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15751 1.1 0.7 41364 15340 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15752 0.9 0.7 41364 15364 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15753 0.9 0.7 41372 15372 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15754 1.1 0.7 41364 15340 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15755 0.9 0.7 41364 15364 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15756 1.1 0.7 41364 15344 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15757 0.9 0.7 41364 15384 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15758 1.1 0.7 41364 15332 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15759 0.9 0.7 41364 15372 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
nobody 15760 1.1 0.7 41364 15336 ? RN 07:45 0:01 /usr/local/apache/bin/httpd -k start -DSSL
Is it normal that an httpd process will take 0.7% memory, and 1.1% CPU time?
Server got stuck again this morning at exactly 4:41am. Still didn't find what cron job it is...
Code:
# crontab -l
* * * * * /root/loadcheck.sh >/dev/null 2>&1
11,26,41,56 * * * * /usr/local/cpanel/whostmgr/bin/dnsqueue > /dev/null 2>&1
2,58 * * * * /usr/local/bandmin/bandmin
0 0 * * * /usr/local/bandmin/ipaddrmap
55 1 * * * /usr/local/cpanel/whostmgr/docroot/cgi/cpaddons_report.pl --notify
*/5 * * * * /usr/local/cpanel/bin/dcpumon >/dev/null 2>&1
30 */4 * * * /usr/bin/test -x /scripts/update_db_cache && /scripts/update_db_cache
45 */8 * * * /usr/bin/test -x /usr/local/cpanel/bin/optimizefs && /usr/local/cpanel/bin/optimizefs
51 0 * * * /scripts/upcp
0 1 * * * /scripts/cpbackup
0 2 * * * /scripts/mailman_chown_archives
35 * * * * /usr/bin/test -x /usr/local/cpanel/bin/tail-check && /usr/local/cpanel/bin/tail-check
0 6 * * * /scripts/exim_tidydb > /dev/null 2>&1
At least now I can predict when it will crash..4am, 12, 8pm. Now I just gotta find out why.