LVS
lvs-users
Google
 
Web LinuxVirtualServer.org

Re: What are people doing for data sharing between real servers

To: "LinuxVirtualServer.org users mailing list." <lvs-users@xxxxxxxxxxxxxxxxxxxxxx>
Subject: Re: What are people doing for data sharing between real servers
From: Jan Klopper <janklopper@xxxxxxxxx>
Date: Fri, 15 Jul 2005 09:25:13 +0200
On the other hand you might consider changing to reiserFS which is capable of reading every file on your FS within 1 or 2 clock cycli, independant of the size of the parent dir.

Im currently reading cache files of ~4-9K from a dir containing well over 12000 of them without any speed problems on a single p3 1ghz with a scsi 2 hdd in raid 0.

Besides, hasing also requires you to change most of your scripts which will also (if done for webcontent) increase the load dramatically.

greets


Joe Stump wrote:

Are you hashing your directories? My read/write speeds dropped through the floor when I didn't notice PHP wasn't cleaning up session files after itself. The problem was I had a couple of million session files in a single directory. I now run a script that nukes old session files and my speeds are more than adequate.

If you have more than a thousand files in a single directory that could be a huge problem. The solution I like to use is to hash directories based on file name:

foobar.jpg -> /images/fo/ba/foobar.jpg (using substr() for instance). That way you break up images across multiple directories.

--Joe

On Jul 14, 2005, at 2:13 PM, Randy Paries wrote:

On each server I am getting about 45 million hits a month. That is about 4 millions pages a month but unfortunately the pages are customer designed and some are very very large with lots of images. That is why I gave you hits instead of visits. My one real server is running SCSI Raid 5. I have about 80nfsd running. The symptom I am having is sometimes when I am in the editor and do a write or if I do a directory listing it can take up to 30 seconds
to write.

For Jacob's question, I am serving up static web pages and also I have
scripts that read text and xml files and lots and lots of images

Randy

-----Original Message-----
From: lvs-users-bounces@xxxxxxxxxxxxxxxxxxxxxx
[mailto:lvs-users-bounces@xxxxxxxxxxxxxxxxxxxxxx] On Behalf Of Joe Stump
Sent: Thursday, July 14, 2005 3:53 PM
To: LinuxVirtualServer.org users mailing list.
Subject: Re: What are people doing for data sharing between real servers

You must be doing crazy ass traffic. What NFS server are you using?
Are you running v3 over TCP? Are you running the kernel server? We  have
three real servers connecting to a single NFS server, which has
8 SATA Raptor's in RAID5 (crazy fast). This setup does 12 million page views a month with little to no load (it also has a dedicated MySQL server that
all the real servers connect to).

--Joe

On Jul 14, 2005, at 1:47 PM, Randy Paries wrote:


Hello,

I have 1 director and 2 real servers. They are Web and j2ee  servers on
RH9

They both need access to the same data, so real server 2 nfs mounts
real server 1 /home/webroot filesystem

this is working ok, but i am getting to the level where i need to  look
at better performance options.

What are people on this list using?

I am not a hardware guy, but from what i can tell i think a need a
fiber array that can be clustered???

Thanks for any insight

Randy
_______________________________________________
LinuxVirtualServer.org mailing list - lvs- users@xxxxxxxxxxxxxxxxxxxxxx
Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
or go to http://www.in-addr.de/mailman/listinfo/lvs-users



_______________________________________________
LinuxVirtualServer.org mailing list - lvs- users@xxxxxxxxxxxxxxxxxxxxxx Send
requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
or go to http://www.in-addr.de/mailman/listinfo/lvs-users



_______________________________________________
LinuxVirtualServer.org mailing list - lvs-users@xxxxxxxxxxxxxxxxxxxxxx
Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
or go to http://www.in-addr.de/mailman/listinfo/lvs-users


_______________________________________________
LinuxVirtualServer.org mailing list - lvs-users@xxxxxxxxxxxxxxxxxxxxxx
Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
or go to http://www.in-addr.de/mailman/listinfo/lvs-users



<Prev in Thread] Current Thread [Next in Thread>