LVS
lvs-users
Google
 
Web LinuxVirtualServer.org

RE: What are people doing for data sharing between real servers

To: "'LinuxVirtualServer.org users mailing list.'" <lvs-users@xxxxxxxxxxxxxxxxxxxxxx>
Subject: RE: What are people doing for data sharing between real servers
From: "Randy Paries" <randy.paries@xxxxxxxxxxx>
Date: Thu, 14 Jul 2005 17:18:28 -0500
 Joe

I think you are on to something. My site has grown way bigger than I ever
expected and my docroot is now over 4000 user/directories

So now I have to figure out how to set up my apache(another mailing list) to
help me split these out

Thanks
Randy

-----Original Message-----
From: lvs-users-bounces@xxxxxxxxxxxxxxxxxxxxxx
[mailto:lvs-users-bounces@xxxxxxxxxxxxxxxxxxxxxx] On Behalf Of Joe Stump
Sent: Thursday, July 14, 2005 4:24 PM
To: LinuxVirtualServer.org users mailing list.
Subject: Re: What are people doing for data sharing between real servers

Are you hashing your directories? My read/write speeds dropped through the
floor when I didn't notice PHP wasn't cleaning up session files after
itself. The problem was I had a couple of million session files in a single
directory. I now run a script that nukes old session files and my speeds are
more than adequate.

If you have more than a thousand files in a single directory that could be a
huge problem. The solution I like to use is to hash directories based on
file name:

foobar.jpg -> /images/fo/ba/foobar.jpg (using substr() for instance).  
That way you break up images across multiple directories.

--Joe

On Jul 14, 2005, at 2:13 PM, Randy Paries wrote:

> On each server I am getting about 45 million hits a month. That is 
> about 4 millions pages a month but unfortunately the pages are 
> customer designed and some are very very large with lots of images. 
> That is why I gave you hits instead of visits. My one real server is 
> running SCSI Raid 5. I have about 80nfsd running. The symptom I am 
> having is sometimes when I am in the editor and do a write or if I do 
> a directory listing it can take up to 30 seconds to write.
>
> For Jacob's question, I am serving up static web pages and also I have 
> scripts that read text and xml files and lots and lots of images
>
> Randy
>
> -----Original Message-----
> From: lvs-users-bounces@xxxxxxxxxxxxxxxxxxxxxx
> [mailto:lvs-users-bounces@xxxxxxxxxxxxxxxxxxxxxx] On Behalf Of Joe 
> Stump
> Sent: Thursday, July 14, 2005 3:53 PM
> To: LinuxVirtualServer.org users mailing list.
> Subject: Re: What are people doing for data sharing between real 
> servers
>
> You must be doing crazy ass traffic. What NFS server are you using?
> Are you running v3 over TCP? Are you running the kernel server? We 
> have three real servers connecting to a single NFS server, which has
> 8 SATA Raptor's in RAID5 (crazy fast). This setup does 12 million page 
> views a month with little to no load (it also has a dedicated MySQL 
> server that all the real servers connect to).
>
> --Joe
>
> On Jul 14, 2005, at 1:47 PM, Randy Paries wrote:
>
>
>> Hello,
>>
>> I have 1 director and 2 real servers. They are Web and j2ee servers 
>> on
>> RH9
>>
>> They both need access to the same data, so real server 2 nfs mounts 
>> real server 1 /home/webroot filesystem
>>
>> this is working ok, but i am getting to the level where i need to 
>> look at better performance options.
>>
>> What are people on this list using?
>>
>> I am not a hardware guy, but from what i can tell i think a need a 
>> fiber array that can be clustered???
>>
>> Thanks for any insight
>>
>> Randy
>> _______________________________________________
>> LinuxVirtualServer.org mailing list - lvs- 
>> users@xxxxxxxxxxxxxxxxxxxxxx Send requests to 
>> lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
>> or go to http://www.in-addr.de/mailman/listinfo/lvs-users
>>
>>
>
> _______________________________________________
> LinuxVirtualServer.org mailing list - lvs- 
> users@xxxxxxxxxxxxxxxxxxxxxx Send requests to 
> lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
> or go to http://www.in-addr.de/mailman/listinfo/lvs-users
>
>
>
> _______________________________________________
> LinuxVirtualServer.org mailing list - lvs-users@xxxxxxxxxxxxxxxxxxxxxx 
> Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
> or go to http://www.in-addr.de/mailman/listinfo/lvs-users
>





<Prev in Thread] Current Thread [Next in Thread>