Re: What are people doing for data sharing between real servers

[Jan Klopper <janklopper@xxxxxxxxx>]

On the other hand you might consider changing to reiserFS which is 
capable of reading every file on your FS within 1 or 2 clock cycli, 
independant of the size of the parent dir.
Im currently reading cache files of ~4-9K from a dir containing well 
over 12000 of them without any speed problems on a single p3 1ghz with a 
scsi 2 hdd in raid 0.
Besides, hasing also requires you to change most of your scripts which 
will also (if done for webcontent) increase the load dramatically.
greets


Joe Stump wrote:

> Are you hashing your directories? My read/write speeds dropped  
> through the floor when I didn't notice PHP wasn't cleaning up session  
> files after itself. The problem was I had a couple of million session  
> files in a single directory. I now run a script that nukes old  
> session files and my speeds are more than adequate.
> If you have more than a thousand files in a single directory that  
> could be a huge problem. The solution I like to use is to hash  
> directories based on file name:
> foobar.jpg -> /images/fo/ba/foobar.jpg (using substr() for instance).  
> That way you break up images across multiple directories.
> --Joe
>
> On Jul 14, 2005, at 2:13 PM, Randy Paries wrote:
>
> > On each server I am getting about 45 million hits a month. That is  
> > about 4
> > millions pages a month but unfortunately the pages are customer  
> > designed and
> > some are very very large with lots of images. That is why I gave  you 
> > hits
> > instead of visits. My one real server is running SCSI Raid 5. I  have 
> > about
> > 80nfsd running. The symptom I am having is sometimes when I am in  
> > the editor
> > and do a write or if I do a directory listing it can take up to 30  
> > seconds
> > to write.
> >
> > For Jacob's question, I am serving up static web pages and also I have
> > scripts that read text and xml files and lots and lots of images
> >
> > Randy
> >
> > -----Original Message-----
> > From: lvs-users-bounces@xxxxxxxxxxxxxxxxxxxxxx
> > [mailto:lvs-users-bounces@xxxxxxxxxxxxxxxxxxxxxx] On Behalf Of Joe  
> > Stump
> > Sent: Thursday, July 14, 2005 3:53 PM
> > To: LinuxVirtualServer.org users mailing list.
> > Subject: Re: What are people doing for data sharing between real  
> > servers
> > You must be doing crazy ass traffic. What NFS server are you using?
> > Are you running v3 over TCP? Are you running the kernel server? We  have
> > three real servers connecting to a single NFS server, which has
> > 8 SATA Raptor's in RAID5 (crazy fast). This setup does 12 million  
> > page views
> > a month with little to no load (it also has a dedicated MySQL  server 
> > that
> > all the real servers connect to).
> >
> > --Joe
> >
> > On Jul 14, 2005, at 1:47 PM, Randy Paries wrote:
> >
> >
> > > Hello,
> > >
> > > I have 1 director and 2 real servers. They are Web and j2ee  servers on
> > > RH9
> > >
> > > They both need access to the same data, so real server 2 nfs mounts
> > > real server 1 /home/webroot filesystem
> > >
> > > this is working ok, but i am getting to the level where i need to  look
> > > at better performance options.
> > >
> > > What are people on this list using?
> > >
> > > I am not a hardware guy, but from what i can tell i think a need a
> > > fiber array that can be clustered???
> > >
> > > Thanks for any insight
> > >
> > > Randy
> > > _______________________________________________
> > > LinuxVirtualServer.org mailing list - lvs- users@xxxxxxxxxxxxxxxxxxxxxx
> > > Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
> > > or go to http://www.in-addr.de/mailman/listinfo/lvs-users
> > _______________________________________________
> > LinuxVirtualServer.org mailing list - lvs- 
> > users@xxxxxxxxxxxxxxxxxxxxxx Send
> > requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
> > or go to http://www.in-addr.de/mailman/listinfo/lvs-users
> >
> >
> >
> > _______________________________________________
> > LinuxVirtualServer.org mailing list - lvs-users@xxxxxxxxxxxxxxxxxxxxxx
> > Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
> > or go to http://www.in-addr.de/mailman/listinfo/lvs-users
> _______________________________________________
> LinuxVirtualServer.org mailing list - lvs-users@xxxxxxxxxxxxxxxxxxxxxx
> Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
> or go to http://www.in-addr.de/mailman/listinfo/lvs-users