Difference between revisions of "Switch your model/image from TIPC to UDP"

(Step 2)
Line 1: Line 1:
== From Model ==
+
UDP can be run in two modes -- local or cloud.  In local mode, the UDP system uses multicast to find members of the cluster and auto-assigns non-routable IP addresses onto an alias of your chosen backplane network interface.  The advantage of local mode is that no IP addresses need to be configured.
 +
 
 +
In cloud mode, it is assumed that the cluster is potentially running across the entire internet (no multicast) on machines with specified IP addresses.  Since no initial discovery is possible, every node needs to be configured with the IP addresses of the two system controller nodes.
 +
 
 +
== Changing Your Model from TIPC to UDP ==
 
=== Step 1 ===
 
=== Step 1 ===
- If you have a pre-60 model you will need to upgrade it.  Using IDE open your model, it will require an upgrade before it can be used.  This will generate a configuration file in <your model>/config/clTransport.xml.
+
- If you have a pre-60 model you will need to upgrade it.  Using the IDE open your model, every option will be grey except model->update.  This update will generate a configuration file called <your model>/config/clTransport.xml that looks something like this:
  
 
     <?xml version="1.0" encoding="UTF-8"?>
 
     <?xml version="1.0" encoding="UTF-8"?>
Line 27: Line 31:
  
 
=== Step 2 ===
 
=== Step 2 ===
Edit the content clTransport.xml with some UDP configuration details:
+
Edit the content clTransport.xml with the UDP configuration details, and remove the TIPC details:
  
 
     <?xml version="1.0" encoding="UTF-8"?>
 
     <?xml version="1.0" encoding="UTF-8"?>
Line 50: Line 54:
 
     <openClovisAsp>
 
     <openClovisAsp>
  
=== Step 3 ===
+
=== Step 3 (Local mode) ===
Add 2 env variables into <model_dir>/src/target.env:
+
Add 2 environment variables into <model_dir>/src/target.env, or make sure these variables are defined before starting SAFplus:
  
 
  export ASP_UDP_SUBNET=<IP Range>/Length
 
  export ASP_UDP_SUBNET=<IP Range>/Length
Line 61: Line 65:
 
  export ASP_UDP_LINK_NAME=eth0
 
  export ASP_UDP_LINK_NAME=eth0
  
=== Step 4 ===
 
Before running ASP, should export/setenv 2 below variables:
 
export ASP_UDP_SUBNET=192.168.57.0/24
 
export ASP_UDP_LINK_NAME=eth0
 
  
== UDP without Auto IP address assignment ==
+
=== Step 3 (Cloud mode) ===
 +
To use the UDP transport without node discovery (multicast) or IP address assignment, you must:
  
To use the UDP transport with the IP address, 'already configured' on a link, set these variables in your environment before starting SAFplus:
+
1. Add these 2 environment variables into <model_dir>/src/target.env, or make sure these variables are defined before starting SAFplus:
  
ASP_UDP_USE_EXISTING_IP=true
+
ASP_UDP_USE_EXISTING_IP=true
ASP_UDP_LINK_NAME=<link name, for example 'eth0'>
+
ASP_UDP_LINK_NAME=<link name, for example 'eth0'>
 
+
'''clTransport.xml''' should add static IP addresses for cluster:
+
  
 +
2. Configure UDP peer addresses like this:
 +
<code>
 
     <peerAddresses port="6789">
 
     <peerAddresses port="6789">
 
         <peer addr="192.168.56.101"/>
 
         <peer addr="192.168.56.101"/>
 
         <peer addr="192.168.56.102"/>
 
         <peer addr="192.168.56.102"/>
 
     </peerAddresses>
 
     </peerAddresses>
 +
</code>
  
 +
The following is a this complete example of a cloud mode configuration file:
  
== UDP without Node Discovery (Multicast) ==
+
<code>
 
+
To use the UDP transport without node discovery, you must explicitly configure the static addresses and define variable environments ASP_UDP_USE_EXISTING_IP=true and ASP_UDP_LINK_NAME for getting ip addresses below. 
+
 
+
 
  <?xml version="1.0" encoding="UTF-8"?>
 
  <?xml version="1.0" encoding="UTF-8"?>
 
  <openClovisAsp>
 
  <openClovisAsp>
Line 108: Line 108:
 
   </version>
 
   </version>
 
  </openClovisAsp>
 
  </openClovisAsp>
 +
</code>
 +
 +
=== Before or After "make images"? ===
 +
clTransport.xml and target.env can be changed before the "make images" step so all generated images are UDP by default OR these files can be changed on every node after deployment.
  
== From Image ==
+
== FAQ ==
Create a clTransport.xml like step 2 & 3 above and retarball your images.
+
  
== Q&A ==
+
* Q: Is the SAFplus able to run in UDP local mode as a non-root user?
* Q: Is the SAFplus able to run as a user other than root?
+
* A: Yes, but you must properly configure the interfaces since SAFplus cannot.
* A: Only pre-requisites, configure interface name (ASP_UDP_LINK_NAME) with IP address (ASP_UDP_SUBNET.DEFAULT_NODEADDR) (Use DEFAULT_NODEADDR settings from asp.conf file)
+
Configure interface name (ASP_UDP_LINK_NAME) with the IP address calculated from your subnet and node address (ASP_UDP_SUBNET.DEFAULT_NODEADDR).  The node address is the DEFAULT_NODEADDR settings from etc/asp.conf file.
  
 
  Example:
 
  Example:

Revision as of 16:01, 7 October 2013

UDP can be run in two modes -- local or cloud. In local mode, the UDP system uses multicast to find members of the cluster and auto-assigns non-routable IP addresses onto an alias of your chosen backplane network interface. The advantage of local mode is that no IP addresses need to be configured.

In cloud mode, it is assumed that the cluster is potentially running across the entire internet (no multicast) on machines with specified IP addresses. Since no initial discovery is possible, every node needs to be configured with the IP addresses of the two system controller nodes.

Contents

Changing Your Model from TIPC to UDP

Step 1

- If you have a pre-60 model you will need to upgrade it. Using the IDE open your model, every option will be grey except model->update. This update will generate a configuration file called <your model>/config/clTransport.xml that looks something like this:

   <?xml version="1.0" encoding="UTF-8"?>
   <openClovisAsp>
     <version v0="4.0.0">
       <multixport xmlns="multixport.ecore">
         <xports>
           <xport>
             <type>TIPC</type>
             <plugin>libClTIPC.so</plugin>
           </xport>
         </xports>
       </multixport>
     </version>
   </openClovisAsp>

Step 2

Edit the content clTransport.xml with the UDP configuration details, and remove the TIPC details:

   <?xml version="1.0" encoding="UTF-8"?>
   <openClovisAsp>
     <version v0="4.0.0">
      <multixport xmlns="multixport.ecore">
         <xports>
           <xport>
             <type>UDP</type>
             <plugin>libClUDP.so</plugin>
           </xport>
         </xports>
         <protocol default="UDP"/>
         <multicast address="226.0.1.1" port="9595" />
         <heartbeat>
             <interval>3000</interval>
             <intervalLocal>3000</intervalLocal>
             <retries>5</retries>
         </heartbeat>
       </multixport>
     </version>
   <openClovisAsp>

Step 3 (Local mode)

Add 2 environment variables into <model_dir>/src/target.env, or make sure these variables are defined before starting SAFplus:

export ASP_UDP_SUBNET=<IP Range>/Length
export ASP_UDP_LINK_NAME=<your interface>
  • Example:
export ASP_UDP_SUBNET=192.168.57.0/24
export ASP_UDP_LINK_NAME=eth0


Step 3 (Cloud mode)

To use the UDP transport without node discovery (multicast) or IP address assignment, you must:

1. Add these 2 environment variables into <model_dir>/src/target.env, or make sure these variables are defined before starting SAFplus:

ASP_UDP_USE_EXISTING_IP=true ASP_UDP_LINK_NAME=<link name, for example 'eth0'>

2. Configure UDP peer addresses like this:

    <peerAddresses port="6789">
       <peer addr="192.168.56.101"/>
       <peer addr="192.168.56.102"/>
    </peerAddresses>

The following is a this complete example of a cloud mode configuration file:

<?xml version="1.0" encoding="UTF-8"?>
<openClovisAsp>
 <version v0="4.0.0">
  <multixport xmlns="multixport.ecore">
    <xports>
      <xport>
        <type>UDP</type>
        <plugin>libClUDP.so</plugin>
      </xport>
    </xports>
    <protocol default="UDP"/>
    <heartbeat>
         <interval>1000</interval>
         <intervalLocal>1000</intervalLocal>
         <retries>4</retries>
    </heartbeat>
    <peerAddresses port="6789">
       <peer addr="192.168.56.101"/>
       <peer addr="192.168.56.102"/>
    </peerAddresses>
   </multixport>
 </version>
</openClovisAsp>

Before or After "make images"?

clTransport.xml and target.env can be changed before the "make images" step so all generated images are UDP by default OR these files can be changed on every node after deployment.

FAQ

  • Q: Is the SAFplus able to run in UDP local mode as a non-root user?
  • A: Yes, but you must properly configure the interfaces since SAFplus cannot.

Configure interface name (ASP_UDP_LINK_NAME) with the IP address calculated from your subnet and node address (ASP_UDP_SUBNET.DEFAULT_NODEADDR). The node address is the DEFAULT_NODEADDR settings from etc/asp.conf file.

Example:
 root:#ifconfig eth0 192.168.57.1
 user:#export ASP_UDP_SUBNET=192.168.57.0/24
 user:#export ASP_UDP_LINK_NAME=eth0
 user:#./etc/init.d/safplus start