LVS
lvs-users
Google
 
Web LinuxVirtualServer.org

Re: [lvs-users] Glusterfs native nfs port for LVS

To: Tomasz Chmielewski <tch@xxxxxxxxxxx>
Subject: Re: [lvs-users] Glusterfs native nfs port for LVS
Cc: "LinuxVirtualServer.org users mailing list." <lvs-users@xxxxxxxxxxxxxxxxxxxxxx>
From: yang feng电话 <hoking.yang@xxxxxxxxx>
Date: Sat, 8 Mar 2014 21:31:16 +0800
Tomasz,
Thanks for your help.

I have three gluster nodes, it seems rpc.statd is random port....
What I want is to let LVS Loadbalance among those three nodes.

[root@gluster02 ~]# netstat -tupna
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address               Foreign Address
State       PID/Program name
tcp        0      0 0.0.0.0:139                 0.0.0.0:*
LISTEN      3480/smbd
tcp        0      0 0.0.0.0:111                 0.0.0.0:*
LISTEN      2335/rpcbind
tcp        0      0 0.0.0.0:60275               0.0.0.0:*
LISTEN      2533/rpc.statd
tcp        0      0 0.0.0.0:22                  0.0.0.0:*
LISTEN      2557/sshd
tcp        0      0 127.0.0.1:25                0.0.0.0:*
LISTEN      2641/master
tcp        0      0 192.168.0.222:4379          0.0.0.0:*
LISTEN      2734/ctdbd
tcp        0      0 0.0.0.0:445                 0.0.0.0:*
LISTEN      3480/smbd
tcp        0      0 0.0.0.0:49152               0.0.0.0:*
LISTEN      2502/glusterfsd
tcp        0      0 0.0.0.0:2049                0.0.0.0:*
LISTEN      2507/glusterfs
tcp        0      0 0.0.0.0:38465               0.0.0.0:*
LISTEN      2507/glusterfs
tcp        0      0 0.0.0.0:49153               0.0.0.0:*
LISTEN      2486/glusterfsd
tcp        0      0 0.0.0.0:38466               0.0.0.0:*
LISTEN      2507/glusterfs
tcp        0      0 0.0.0.0:49154               0.0.0.0:*
LISTEN      2478/glusterfsd
tcp        0      0 0.0.0.0:49155               0.0.0.0:*
LISTEN      2482/glusterfsd
tcp        0      0 0.0.0.0:38468               0.0.0.0:*
LISTEN      2507/glusterfs
tcp        0      0 0.0.0.0:49156               0.0.0.0:*
LISTEN      2493/glusterfsd
tcp        0      0 0.0.0.0:997                 0.0.0.0:*
LISTEN      2507/glusterfs
tcp        0      0 0.0.0.0:38469               0.0.0.0:*
LISTEN      2507/glusterfs
tcp        0      0 0.0.0.0:24007               0.0.0.0:*
LISTEN      2382/glusterd

[root@gluster03 ~]# netstat -tupna
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address               Foreign Address
State       PID/Program name
tcp        0      0 0.0.0.0:139                 0.0.0.0:*
LISTEN      3383/smbd
tcp        0      0 0.0.0.0:51243               0.0.0.0:*
LISTEN      2693/rpc.statd
tcp        0      0 0.0.0.0:111                 0.0.0.0:*
LISTEN      2354/rpcbind
tcp        0      0 0.0.0.0:22                  0.0.0.0:*
LISTEN      2500/sshd
tcp        0      0 127.0.0.1:25                0.0.0.0:*
LISTEN      2585/master
tcp        0      0 192.168.0.223:4379          0.0.0.0:*
LISTEN      3109/ctdbd
tcp        0      0 0.0.0.0:445                 0.0.0.0:*
LISTEN      3383/smbd
tcp        0      0 0.0.0.0:736                 0.0.0.0:*
LISTEN      2670/glusterfs
tcp        0      0 0.0.0.0:49152               0.0.0.0:*
LISTEN      2652/glusterfsd
tcp        0      0 0.0.0.0:2049                0.0.0.0:*
LISTEN      2670/glusterfs
tcp        0      0 0.0.0.0:49153               0.0.0.0:*
LISTEN      2658/glusterfsd
tcp        0      0 0.0.0.0:38465               0.0.0.0:*
LISTEN      2670/glusterfs
tcp        0      0 0.0.0.0:49154               0.0.0.0:*
LISTEN      2641/glusterfsd
tcp        0      0 0.0.0.0:38466               0.0.0.0:*
LISTEN      2670/glusterfs
tcp        0      0 0.0.0.0:49155               0.0.0.0:*
LISTEN      2648/glusterfsd
tcp        0      0 0.0.0.0:38468               0.0.0.0:*
LISTEN      2670/glusterfs
tcp        0      0 0.0.0.0:49156               0.0.0.0:*
LISTEN      2665/glusterfsd
tcp        0      0 0.0.0.0:38469               0.0.0.0:*
LISTEN      2670/glusterfs
tcp        0      0 0.0.0.0:24007               0.0.0.0:*
LISTEN      2401/glusterd

[root@gluster04 ~]# netstat -tupna
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address               Foreign Address
State       PID/Program name
tcp        0      0 0.0.0.0:139                 0.0.0.0:*
LISTEN      3115/smbd
tcp        0      0 0.0.0.0:111                 0.0.0.0:*
LISTEN      2337/rpcbind
tcp        0      0 0.0.0.0:35984               0.0.0.0:*
LISTEN      2557/rpc.statd
tcp        0      0 0.0.0.0:22                  0.0.0.0:*
LISTEN      2559/sshd
tcp        0      0 127.0.0.1:25                0.0.0.0:*
LISTEN      2644/master
tcp        0      0 192.168.0.224:4379          0.0.0.0:*
LISTEN      2769/ctdbd
tcp        0      0 0.0.0.0:445                 0.0.0.0:*
LISTEN      3115/smbd
tcp        0      0 0.0.0.0:606                 0.0.0.0:*
LISTEN      2540/glusterfs
tcp        0      0 0.0.0.0:49152               0.0.0.0:*
LISTEN      2505/glusterfsd
tcp        0      0 0.0.0.0:2049                0.0.0.0:*
LISTEN      2540/glusterfs
tcp        0      0 0.0.0.0:38465               0.0.0.0:*
LISTEN      2540/glusterfs
tcp        0      0 0.0.0.0:49153               0.0.0.0:*
LISTEN      2490/glusterfsd
tcp        0      0 0.0.0.0:38466               0.0.0.0:*
LISTEN      2540/glusterfs
tcp        0      0 0.0.0.0:49154               0.0.0.0:*
LISTEN      2489/glusterfsd
tcp        0      0 0.0.0.0:49155               0.0.0.0:*
LISTEN      2487/glusterfsd
tcp        0      0 0.0.0.0:38468               0.0.0.0:*
LISTEN      2540/glusterfs
tcp        0      0 0.0.0.0:49156               0.0.0.0:*
LISTEN      2483/glusterfsd
tcp        0      0 0.0.0.0:38469               0.0.0.0:*
LISTEN      2540/glusterfs
tcp        0      0 0.0.0.0:24007               0.0.0.0:*
LISTEN      2384/glusterd




2014-03-08 21:04 GMT+08:00 Tomasz Chmielewski <tch@xxxxxxxxxxx>:

> Use "-tupna", the output should be more readable.
>
> --
> Tomasz Chmielewski
> http://wpkg.org
>
>
> On Sat, 8 Mar 2014 20:38:12 +0800
> yang feng电话 <hoking.yang@xxxxxxxxx> wrote:
>
> > I can not tell which one should be gluster native nfs used port...
> >
> > [root@gluster02 ~]# netstat -a
> > Active Internet connections (servers and established)
> > Proto Recv-Q Send-Q Local Address               Foreign Address
> > State
> > tcp        0      0 *:netbios-ssn               *:*
> > LISTEN
> > tcp        0      0 *:sunrpc                    *:*
> > LISTEN
> > tcp        0      0 *:60275                     *:*
> > LISTEN
> > tcp        0      0 *:ssh                       *:*
> > LISTEN
> > tcp        0      0 localhost:smtp              *:*
> > LISTEN
> > tcp        0      0 gluster02.isilon.cn:ctdb    *:*
> > LISTEN
> > tcp        0      0 *:microsoft-ds              *:*
> > LISTEN
> > tcp        0      0 *:49152                     *:*
> > LISTEN
> > tcp        0      0 *:nfs                       *:*
> > LISTEN
> > tcp        0      0 *:38465                     *:*
> > LISTEN
> > tcp        0      0 *:49153                     *:*
> > LISTEN
> > tcp        0      0 *:38466                     *:*
> > LISTEN
> > tcp        0      0 *:49154                     *:*
> > LISTEN
> > tcp        0      0 *:49155                     *:*
> > LISTEN
> > tcp        0      0 *:38468                     *:*
> > LISTEN
> > tcp        0      0 *:49156                     *:*
> > LISTEN
> > tcp        0      0 *:maitrd                    *:*
> > LISTEN
> > tcp        0      0 *:38469                     *:*
> > LISTEN
> > tcp        0      0 *:24007                     *:*
> > LISTEN
> > tcp        0     40 gluster02.isilon.cn:49156
> > gluster02.isilon.cn:ftps ESTABLISHED
> > tcp        0      0 localhost:24007             localhost:1012
> > ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49155
> > gluster04.isilon.cn:985 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49153
> > gluster03.isilon.cn:985 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:984
> > gluster04.isilon.cn:49152 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:ctdb
> > gluster03.isilon.cn:43225 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49153
> > gluster03.isilon.cn:1002 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:985
> > gluster04.isilon.cn:49153 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:41860
> > gluster04.isilon.cn:ctdb ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49154
> > gluster04.isilon.cn:987 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:24007
> > gluster02.isilon.cn:1016 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:973
> > gluster03.isilon.cn:24007 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:983
> > gluster02.isilon.cn:49152 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:ctdb
> > gluster04.isilo:profinet-rt ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:24007
> > gluster03.isilon.cn:1023 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49156
> > gluster04.isilon.cn:1005 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:966
> > gluster03.isilon.cn:49156 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49152
> > gluster02.isilon.cn:983 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49156
> > gluster02.isilon.cn:1011 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:24007
> > gluster04.isilon.cn:1023 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:24007
> > gluster02.isilon.cn:1015 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:979
> > gluster02.isilon.cn:49153 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:1014
> > gluster02.isilon.cn:24007 ESTABLISHED
> > tcp        0      0 localhost:1012              localhost:24007
> > ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49156
> > gluster03.isilon.cn:1001 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49153
> > gluster04.isilon.cn:983 ESTABLISHED
> > tcp        0      0 store.isilon.c:microsoft-ds 10.67.68.22:50843
> > ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:1012
> > gluster02.isilon.cn:49154 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49156
> > gluster02.isilon.cn:975 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:1017
> > gluster02.isilon.cn:24007 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:24007
> > gluster02.isilon.cn:1017 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:exp2
> > gluster04.isilon.cn:24007 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49152
> > gluster03.isilon.cn:972 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:51174
> > gluster03.isilon.cn:ctdb ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:24007
> > gluster02.isilon.cn:1014 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49156
> > gluster04.isilon.cn:surf ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:987
> > gluster02.isilon.cn:49153 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:exp1
> > gluster02.isilon.cn:24007 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:965
> > gluster03.isilon.cn:49152 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:988
> > gluster02.isilon.cn:49155 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:964
> > gluster03.isilon.cn:49153 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49156
> > gluster03.isilon.cn:980 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:977
> > gluster04.isilon.cn:49153 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:24007
> > gluster02.isilon.cn:exp1 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49155
> > gluster02.isilon.cn:988 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:981
> > gluster04.isilon.cn:49156 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:1016
> > gluster02.isilon.cn:24007 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:24007
> > gluster04.isilon.cn:1018 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49156
> > gluster03.isilon.cn:1017 ESTABLISHED
> > tcp        0   3880 store02.isilon.cn:ssh
> > pptpclient02.yxsd:60381 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:975
> > gluster02.isilon.cn:49156 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49154
> > gluster03.isilon.cn:979 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49153
> > gluster02.isilon.cn:979 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:ftps
> > gluster02.isilon.cn:49156 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:1011
> > gluster02.isilon.cn:49156 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49155
> > gluster03.isilon.cn:973 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:960
> > gluster03.isilon.cn:49156 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:986
> > gluster04.isilon.cn:49155 ESTABLISHED
> > tcp        0      0 localhost:24007             localhost:1011
> > ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:982
> > gluster04.isilon.cn:49154 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:970
> > gluster03.isilon.cn:49153 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:1015
> > gluster02.isilon.cn:24007 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49154
> > gluster02.isilon.cn:1012 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:974
> > gluster04.isilon.cn:49156 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49156
> > gluster04.isilon.cn:ftps ESTABLISHED
> > tcp        0      0 localhost:1011              localhost:24007
> > ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49153
> > gluster02.isilon.cn:987 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49153
> > gluster04.isilon.cn:garcon ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:1013
> > gluster02.isilon.cn:24007 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:962
> > gluster03.isilon.cn:49155 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:980
> > gluster04.isilon.cn:49156 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:24007
> > gluster03.isilon.cn:exp1 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:24007
> > gluster02.isilon.cn:1013 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:49152
> > gluster04.isilon.cn:982 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:963
> > gluster03.isilon.cn:49156 ESTABLISHED
> > tcp        0      0 gluster02.isilon.cn:968
> > gluster03.isilon.cn:49154 ESTABLISHED
> > tcp        0      0 *:netbios-ssn               *:*
> > LISTEN
> > tcp        0      0 *:sunrpc                    *:*
> > LISTEN
> > tcp        0      0 *:ssh                       *:*
> > LISTEN
> > tcp        0      0 *:56347                     *:*
> > LISTEN
> > tcp        0      0 *:microsoft-ds              *:*
> > LISTEN
> > tcp        0      0 *:exec                      *:*
> > LISTEN
> > tcp        0      0 *:login                     *:*
> > LISTEN
> > tcp        0      0 *:shell                     *:*
> > LISTEN
> > udp        0      0 *:sunrpc
> > *:*
> > udp        0      0 *:1013
> > *:*
> > udp        0      0 *:57856
> > *:*
> > udp        0      0 *:814
> > *:*
> > udp        0      0 *:987
> > *:*
> > udp        0      0 *:ircs
> > *:*
> > udp        0      0 *:sunrpc
> > *:*
> > udp        0      0 *:814
> > *:*
> > udp        0      0 *:54466
> > *:*
> >
> >
> >
> > 2014-03-08 20:12 GMT+08:00 Tomasz Chmielewski <tch@xxxxxxxxxxx>:
> >
> > > On Sat, 8 Mar 2014 10:04:16 +0800
> > > yang feng电话 <hoking.yang@xxxxxxxxx> wrote:
> > >
> > > > I am running gluster with native nfs, and want to configure
> > > > loadbalance with LVS.
> > > >
> > > > I had successfully set up samba and glusterfs, but can not work
> > > > with gluster native nfs.
> > > >
> > > > I had googled that gluster native nfs use 34865-34867 port, I
> > > > added them into lvs configure file, but no luck to success, can
> > > > anyone suggest me what port or other operation needed to make
> > > > that happen?
> > > >
> > > > BTW, I had disabled iptables, add port
> > > > 111/2049/24007/24008/34865-34867 to LVS config. any help is very
> > > > appreciated.
> > >
> > > Can you check what netstat shows when it comes to open ports?
> > >
> > > --
> > > Tomasz Chmielewski
> > > http://wpkg.org
> > >
>
>
_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users@xxxxxxxxxxxxxxxxxxxxxx
Send requests to lvs-users-request@xxxxxxxxxxxxxxxxxxxxxx
or go to http://lists.graemef.net/mailman/listinfo/lvs-users
<Prev in Thread] Current Thread [Next in Thread>