do i need a new server?
 

server load on my Dual Xeon 3.0/2G RAM/3x120 RAID 5 averages around 6-8, should i consider getting a new more powerful server?

maybe tune mysql and apache?

running any cache programs like memcached?

What OS?

Debian 4.0

The server load is coming from the hotlinking -- there is quite a lot of it and apache is working hard to keep up with the repeated requests.

only permit your domain from serving images, ignore everything else

It sounds like you need a better host. Throwing more hardware at a problem like this is what inexperienced hosts will do. You need to fix the hotlinkiing problem and tweak your server better. If your host can't fix this then they suck.:2 cents::2 cents:

Hi There Zentz,

A load average of 6-8 for esentially a four core server, is definitely overloaded.
Especially if it holds at that level consistantly. Performance will definitely suffer at that level.

You did not mention what OS you are using because that can make a huge difference - and in your options to deal with this.

Adding RAM is usually the quickest way to bring the load averages down.

But ideally, on a four core box, you want that load average at 2 or less.

I also strongly suggest that you explore what is called "null routing" to deal with hotlinkers/freeloaders (assuming you already have sufficient htaccess protection in effect).

Null routing is where you block ip addresses from your server by country of origin. This will elimate server load from countries that don't produce income.

It has become very very common practice, for example, for commercial porn sites to block literally all of mainland China.


You can get a current and constantly updated list of IP assignments by country from http://www.ipdeny.com.

Best regards,

Archer

are you on nationalnet?

natnet is the host and the apache has been tweaked already, cant to much more there.

i use that server to host only scripts and html files and the images are hosted on a remote server, thats where the hotlinking is coming from. i am hotlinking to images hosted on a remote server, so any anti-hotlinking protection wouldnt make a big difference.

its a dual xeon with debian 4 as OS.

As i mentioned above the ant-hotlinking wouldnt help cause i am the one hotlinking to a remote server actually :)

why not just cache all the images then pull from cache instead of mysql

Check disk I/O you may just need to disable logging or add/change your RAID setup. Also put some more ram in it.

Hi There Zentz,

Yeah, in that case I would definitely start by adding RAM.

I am not all that familiar with Debian and if it supports PAE (RAM addressing above 4GB).

But at very least it should handle 4GB (8GB would be better if supported).

RAM is relatively cheap these days and 2GB is way too little for a dual zeon box which is obviously under a heavy load.

With the added RAM, Apache can cache the most requested files and significantly improve the processor load (load averages).

Best regards,

Archer

Think about lighttpd instead of Apache if it works with your scripts

just because you host the main server at nat net means nothing, there are better techs out there. The problem also may have nothing to do with the main server and could be with the media server, in any case there are tons of sites that do way more bw and traffic than you and don't have this problem, so if your 2 hosts together cant fix it you are working with the wrong hosts.:2 cents: