LVS
lvs-users
Google
 
Web LinuxVirtualServer.org

Re: [lvs-users] [DSR] improve performance

To: Julian Anastasov <ja@xxxxxx>
Subject: Re: [lvs-users] [DSR] improve performance
Cc: lvs-users@xxxxxxxxxxxxxxxxxxxxxx
From: Derick Fontes <dbfontes@xxxxxxxxx>
Date: Thu, 14 Jun 2018 13:33:34 -0300
Thanks for reply,

We have a bug in the "NSS" that is used by curl in our process of checking
the state of the backend that runs by "nanny".

Basically:
https://bugzilla.redhat.com/show_bug.cgi?format=multiple&id=1044666

After resolving this, there was still high CPU usage.

To better illustrate my environment, look at the number of "nanny" processes

$ ps aux | grep nanny | wc-1
913

We have basically 64 VIPs with some backends and the nanny is simply
consuming a lot of CPU.

Does anyone have this? Suggestions on how to improve this scenario?

It really is pessimistic, I have peaks of 80% -100% CPU usage.

2018-06-11 15:51 GMT-03:00 Julian Anastasov <ja@xxxxxx>:

>
>         Hello,
>
> On Sun, 10 Jun 2018, Derick Fontes wrote:
>
> > Hello guys,
> >
> > I'm looking for improvements for DSR balancing.
> >
> > As for balancing I have nothing to complain about, it fulfills its role
> > perfectly. But I am suffering from high memory usage and at times high
> > usage of cpu.
> >
> > I do not know if anyone has ever suffered from this, but I would like
> > suggestions on how to improve and get more performance.
> >
> > I'm open to suggestions.
>
>         You can save memory/cycles by disabling conntrack for
> the IPVS traffic. Try such rules and report if there is any gain:
>
> # Remote clients:
> iptables -t raw -A PREROUTING -p tcp -d VIP --dport VPORT -j CT --notrack
>
> # If using local clients to VIP:VPORT:
> iptables -t raw -A OUTPUT -o lo -p tcp -d VIP --dport VPORT -j CT --notrack
>
>         You will not be able to match by RELATED,ESTABLISHED but
> -m state --state UNTRACKED should work, if needed at all.
>
> > linux: CentOS release 6.9 (Final)
> > kernel: 4.4.128-1.el6.elrepo
> > piranha: 0.8.6-7.el6
> > ipvsadm: 1.26-4.el6
> >
> >
> > #free -m
> >              total       used       free     shared    buffers     cached
> > Mem:        128893     128298        595          0        133        586
>
>         Interesting :) Just 128MB?
>
> > -/+ buffers/cache:     127578       1315
> > Swap:         4095          0       4095
>
> Regards
>
> --
> Julian Anastasov <ja@xxxxxx>
>



-- 
Derick Fontes
dbfontes@xxxxxxxxx
_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users@xxxxxxxxxxxxxxxxxxxxxx
Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
or go to http://lists.graemef.net/mailman/listinfo/lvs-users

<Prev in Thread] Current Thread [Next in Thread>