Configuring Transitive IPMP on Solaris 11 | Toki Winter

Page 1 of 4

Configuring Transitive IPMP on Solaris 11

We all know the pain of configuring probe-based IPMP under Solaris, with a slew of test addresses being required, and a long line of ifconfig configuration in our /etc/hostname.<interface> files. With Solaris 11, there is a new type of probe-based IPMP called transitive probing. This new type of probing does not require test addresses, as per the documentation: Transitive probes are sent by the alternate interfaces in the group to probe the active interface. An alternate interface is an underlying interface that does not actively receive any inbound IP packets. In this article, I will configure failover (active/passive) IPMP on clusternode1 (the first node of a Solaris Cluster Im building). Interface net0 has an address of 10.1.1.80 (configured at install time), and Ill be adding this into an IPMP group ipmp0 along with a standby interface, net1. Make sure you are performing these steps via a console connection, as the original address associated with net0 will need to be removed before attempting to add it to an IPMP group. The first step, ensure that there is an entry in /etc/hosts for the IP address youre configuring IPMP for:
# grep '^10\.1\.1\.80' /etc/hosts 10.1.1.80 clusternode1

Next, ensure that automatic network configuration is disabled. In my case it was as Id configured networking manually during the installation of Solaris 11:
# netadm list -p ncp -x TYPE PROFILESTATEAUXILIARY STATE ncp Automaticdisabled disabled by administrator ncp DefaultFixed online active

Verify that the appropriate physical interfaces are available. In the following output, Ill be bonding

e1000g0 (net0) and e1000g1 (net1) into a failover IPMP group.

# dladm show-phys LINK MEDIASTATESPEEDDUPLEXDEVICE net1Ethernet unknown 0 unknown e1000g1 net2Ethernet unknown 0 unknown e1000g2

http://www.tokiwinter.com/configuring-transitive-ipmp-on-solaris-11/

2/6/2014

Configuring Transitive IPMP on Solaris 11 | Toki Winter

Page 2 of 4

net3Ethernet unknown net0Ethernet up

0 1000

unknown e1000g3 fulle1000g0

List the current addresses from the output of ipadm show-addr I can see that Ill need to delete

net0/v4 and net0/v6, otherwise Ill be unable to add net0 to the IPMP group.
# ipadm delete-addr net0/v4 # ipadm delete-addr net0/v6

As the net0 IP interface is already created, I only need to create the net1 interface:
# ipadm create-ip net1

I can then create the IPMP group, which Ill call ipmp0:
# ipadm add-ipmp -i net0 -i net1 ipmp0

Next, enable transitive probing, which is disabled by default:

# svccfg -s svc:/network/ipmp setprop config/transitive-probing=true # svccfg -s svc:/network/ipmp listprop config/transitive-probing config/transitive-probing boolean true # svcadm refresh svc:/network/ipmp:default

And configure the appropriate interface (in my case net1) to be a standby interface (as Im using failover):
# ipadm set-ifprop -p standby=on -m ip net1

Now I can create my IPv4 address on the IPMP group:

# ipadm create-addr -T static -a clusternode1/24 ipmp0/v4 # ipadm show-addr ipmp0 ADDROBJ TYPE STATE ADDR ipmp0/v4 static ok 10.1.1.80/24

Finally, fix the default route. I removed the existing route and added a new default route using the new and correct interface ipmp0:
# route -p delete default 10.1.1.1 # route -p add default 10.1.1.1 -ifp ipmp0 # netstat -rn -f inet Routing Table: IPv4 Destination -------------------default 10.1.1.0 127.0.0.1

Gateway -------------------10.1.1.1 10.1.1.80 127.0.0.1

Flags Ref Use Interface ----- ----- ---------- --------UG 1 0 ipmp0 U 8 388 ipmp0 UH 2 554 lo0

http://www.tokiwinter.com/configuring-transitive-ipmp-on-solaris-11/

2/6/2014

Configuring Transitive IPMP on Solaris 11 | Toki Winter

Page 3 of 4

You can use ipmpstat to verify the configuration and health of the IPMP group:
# ipmpstat -g GROUP GROUPNAME STATE FDT INTERFACES ipmp0 ipmp0 ok 10.00s net0 (net1) # ipmpstat -a ADDRESS STATEGROUP INBOUND OUTBOUND :: down ipmp0 --clusternode1up ipmp0 net0net0 # ipmpstat -t INTERFACE MODE TESTADDRTARGETS net1transitive <net1> <net0> net0routes clusternode1 10.1.1.1

Lets perform a failover test. Ill disable net0 and ensure that the clusternode1 address fails over:
# ipadm disable-if -t net0 # ipmpstat -t INTERFACE MODE TESTADDRTARGETS net1routes clusternode1 10.1.1.1

It works! (and my SSH connection is still active) net1 is now active with the correct IP address. Lets fail it back:
# ipadm enable-if -t net0 # ipmpstat -t INTERFACE MODE TESTADDRTARGETS net0routes clusternode1 10.1.1.1 net1transitive <net1> <net0>

The address has failed back to net0, and again my SSH connection is still active. I can now continue with clusternode2, and the rest of the cluster install.

Related posts:
1. Solaris Cluster 4.1 Part One: Initial Preparation 2. How to Upgrade from Solaris 10 to Solaris 11: Network Preparation 3. Configuring Interface Bonding on CentOS/RHEL/OEL 6.x 4. How to Network Solaris 11 Zones Under VMware or VirtualBox 5. Configuring Interface Bonding on Debian (Wheezy)

This entry was posted in UNIX & Linux How Tos and Tutorials and tagged clustering, IPMP, solaris, solaris 11 on May 22, 2013 [http://www.tokiwinter.com/configuring-transitive-ipmp-on-solaris-11/] .

http://www.tokiwinter.com/configuring-transitive-ipmp-on-solaris-11/

2/6/2014

Configuring Transitive IPMP on Solaris 11 | Toki Winter

Page 4 of 4

http://www.tokiwinter.com/configuring-transitive-ipmp-on-solaris-11/

2/6/2014