LVS
lvs-users
Google
 
Web LinuxVirtualServer.org

Re: [lvs-users] Are LVS / ldirectord Multithreaded?

To: "LinuxVirtualServer.org users mailing list." <lvs-users@xxxxxxxxxxxxxxxxxxxxxx>
Subject: Re: [lvs-users] Are LVS / ldirectord Multithreaded?
From: "Robinson, Eric" <eric.robinson@xxxxxxxxx>
Date: Fri, 31 Oct 2008 14:57:06 -0700
> this is in the HOWTO. LVS doesn't benefit from multiple 
> CPUs (or it didn't last we looked) 

Oops, it's been a few years since I read it. Sorry about that.

> What sort of packet throughput are you getting? 

How would you like that measured?

> Are you using LVS-DR or LVS-NAT? 

LVS-NAT

> Is the director doing anything else as well? 

Aside from running heartbeat and ldirectord with 100+ virtual servers,
not too much. Here's the output from top:

top - 13:43:47 up 81 days,  9:12,  1 user,  load average: 1.40, 1.42,
1.38
Tasks:  60 total,   1 running,  59 sleeping,   0 stopped,   0 zombie
Cpu(s): 46.8% us,  3.0% sy,  0.0% ni, 48.8% id,  0.0% wa,  1.3% hi,
0.0% si
Mem:    516304k total,   506348k used,     9956k free,    45448k buffers
Swap:  1048568k total,        4k used,  1048564k free,   369656k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
 2762 root      17   0 13708 9884 1744 S 50.4  1.9  13386:29 ldirectord
28957 root      15   0  7108 2320 1848 S  0.3  0.4   0:00.03 sshd
28993 root      16   0  1956  948  756 R  0.3  0.2   0:00.06 top
    1 root      15   0  1688  568  488 S  0.0  0.1   0:00.95 init
    2 root      34  19     0    0    0 S  0.0  0.0   0:01.00 ksoftirqd/0
    3 root      RT   0     0    0    0 S  0.0  0.0   0:00.00 watchdog/0
    4 root      10  -5     0    0    0 S  0.0  0.0   0:01.54 events/0
    5 root      10  -5     0    0    0 S  0.0  0.0   0:00.78 khelper
    6 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kthread
    8 root      10  -5     0    0    0 S  0.0  0.0   0:00.02 kblockd/0
    9 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 kacpid
   97 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 khubd
   99 root      10  -5     0    0    0 S  0.0  0.0   0:00.00 kseriod
  146 root      20   0     0    0    0 S  0.0  0.0   0:00.00 pdflush
  147 root      15   0     0    0    0 S  0.0  0.0   0:00.17 pdflush
  148 root      15   0     0    0    0 S  0.0  0.0   0:00.08 kswapd0
  149 root      20  -5     0    0    0 S  0.0  0.0   0:00.00 aio/0
  303 root      11  -5     0    0    0 S  0.0  0.0   0:00.00 kpsmoused
  322 root      11  -5     0    0    0 S  0.0  0.0   0:00.00 kmirrord
  335 root      10  -5     0    0    0 S  0.0  0.0   2:02.22 kjournald
 1164 root      11  -5  1588  468  384 S  0.0  0.1   0:00.01 udevd
 1550 root      11  -5     0    0    0 S  0.0  0.0   0:00.00 shpchpd
 2064 root      11  -5     0    0    0 S  0.0  0.0   0:00.00 kauditd
 2180 root      11  -5     0    0    0 S  0.0  0.0   0:00.00 kjournald
 3017 root      15   0  1596  592  500 S  0.0  0.1   0:48.74 syslogd
 3021 root      15   0  1548  384  312 S  0.0  0.1   0:00.00 klogd
 3031 root      25   0  1544  440  368 S  0.0  0.1   0:00.00 acpid
 3043 root      15   0  4068 1144  836 S  0.0  0.2   1:44.23 sshd
 3105 ntp       15   0  4456 4456 3432 S  0.0  0.9   0:00.19 ntpd
 3117 root      16   0  4524  944  536 S  0.0  0.2   0:47.57 crond
 3140 xfs       15   0  3288 1572  796 S  0.0  0.3   0:00.01 xfs
 3159 dbus      15   0  2440  812  672 S  0.0  0.2   0:00.07
dbus-daemon-1
 3184 root      15   0  2648  972  804 S  0.0  0.2   0:00.16 ha_logd
 3192 root      15   0  2648  556  392 S  0.0  0.1   0:00.15 ha_logd
 3376 root      -2   0 10812  10m 2492 S  0.0  2.1   4:11.26 heartbeat
 3434 root      15   0     0    0    0 D  0.0  0.0   0:00.09
ipvs_syncmaster
 3450 root      -2   0  4216 4216 2492 S  0.0  0.8   0:00.00 heartbeat
 3451 root      -2   0  4212 4212 2492 S  0.0  0.8   0:06.50 heartbeat
 3452 root      -2   0  4392 4216 2492 S  0.0  0.8   0:08.15 heartbeat
 3453 root      -2   0  4212 4212 2492 S  0.0  0.8   0:05.60 heartbeat
 3454 root      -2   0  4212 4212 2492 S  0.0  0.8   4:17.47 heartbeat
 3455 root      -2   0  4212 4212 2492 S  0.0  0.8   0:05.64 heartbeat
 3456 root      -2   0  4212 4212 2492 S  0.0  0.8   4:26.11 heartbeat
 3457 root      -2   0  4212 4212 2492 S  0.0  0.8   0:09.36 heartbeat
 3458 root      -2   0  4212 4212 2492 S  0.0  0.8   2:47.11 heartbeat
 3459 root      -2   0  4344 4344 2492 S  0.0  0.8   0:50.39 heartbeat
 3460 root      -2   0  4344 4344 2492 S  0.0  0.8  10:51.33 heartbeat
 3463 root      18   0  1532  412  356 S  0.0  0.1   0:00.00 mingetty
 3520 root      18   0  1532  412  356 S  0.0  0.1   0:00.00 mingetty
 3521 root      18   0  1532  412  356 S  0.0  0.1   0:00.00 mingetty
 3522 root      18   0  1532  412  356 S  0.0  0.1   0:00.00 mingetty
 3523 root      18   0  1532  412  356 S  0.0  0.1   0:00.00 mingetty
 3545 root      18   0  1536  412  356 S  0.0  0.1   0:00.00 mingetty
 3546 root      15   0 10824 2352 1932 S  0.0  0.5   0:00.04 gdm-binary
 3782 hacluste  15   0  2648 1196 1000 S  0.0  0.2   0:10.95 ipfail
 3908 root      16   0 11340 2192 1656 S  0.0  0.4   0:00.02 gdm-binary
 3931 root      15   0 19100 8872 2468 S  0.0  1.7   0:07.02 X
 3983 gdm       15   0 21368  11m 6512 S  0.0  2.3   0:06.26 gdmgreeter
 4019 root      15   0  4456 1364  340 S  0.0  0.3   0:00.00 ntpd
28961 root      15   0  4428 1464 1188 S  0.0  0.3   0:00.02 bash

> Some nics are better at handling the packets on-board, but 
> I don't know what they are. Have you looked into getting 
> the best nics? From postings on this list you should avoid 
> Broadcom. Some people like Intel.

They are all Intel. Two are on the motherboard and 1 is an add-in. I
have realservers on two different internal subnets.

--Eric


Disclaimer - October 31, 2008 
This email and any files transmitted with it are confidential and intended 
solely for LinuxVirtualServer.org users mailing list.. If you are not the named 
addressee you should not disseminate, distribute, copy or alter this email. Any 
views or opinions presented in this email are solely those of the author and 
might not represent those of . Warning: Although  has taken reasonable 
precautions to ensure no viruses are present in this email, the company cannot 
accept responsibility for any loss or damage arising from the use of this email 
or attachments. 
This disclaimer was added by Policy Patrol: http://www.policypatrol.com/


<Prev in Thread] Current Thread [Next in Thread>