Installing the Remote Replication Option

To prepare for this service action, perform the following:

  • If this is an existing configuration verify the "State" and "Status" of the FC controllers that the remote replication option is being installed on. If this is a new configuration this step can be skipped.

    1. Verify the State and Status of the FC controllers.

      a) At the Devices window, select the appropriate name of the storage array from under the Name column.

      b) At the Device Details window, select the FRUs link at the left top of the screen or scroll down to the FRUs section.

      c) From the left column under FRUs, select Controller to verify that the State is "Enabled" and the Status is "OK".

    2. Continue until all of the FC controllers in the configuration have been checked.

    3. If any of the controllers do not have a "State" of "Enable" and a "Status" of "OK" check for associated alarms and if necessary proceed to the controller removal/replacement procedures. If necessary contact your Sun Service provider.

    Hardware Configuration Requirements

    1. Using standard single-mode fibre cable the maximum supported distance is 10km (6.25 miles) between storage arrays. Using Fibre Channel over IP (FCIP) the maximum supported distance is 4000km (2500) between storage arrays. Use FC cables of the appropriate length for all connections.

    2. The Remote Replication option dedicates the FC controller Host I/O port 4 of the Primary/Local tray controllers "A" and "B" and FC controllers Host I/O port 4 of the Secondary/Remote tray controllers "A" and "B".

    3. Direct connect between the primary/local and secondary/remote array controllers is not supported.

    FC Switch Zoning Requirements

    To configure the FC switch zoning, use the management software provided by the manufacturer of the FC switch.

    1. Set the zoning of the FC switches so that a single host bus adapter (HBA) port can access only one controller per storage array.

    2. Set a separate zone for the ports reserved for data replication.

    3. Do not include any uplink ports (E_port that cascades switches within a fabric) in the same zone as any array ports.

    4. Set the FC switch ports to F-ports (Fabric Port).

    Zoning Non-Cascaded FC Switches

    The following illustration shows non-cascaded (independent) FC switches on the same network. Switch 1 and Switch 2 exist as two 16-port FC switches, each showing ports 0 through 15. Even though both switches contain a Zone 1 and 2 (shown as Zones A and B in Switch 2) , these zones are independent of each other.

    View an illustration of Switch Zoning in Non-Cascaded FC Switches.

    Zoning Cascaded FC Switches

    The following illustration shows two switches cascaded together. An FC cable connects uplink port 15 of Switch 1A to port 16 of Switch 1B. The uplink ports are not zoned. The switch management software combined the ports on the switches and shows ports 0 through 31 participating in the fabric. Switch 1 and Switch 2 now share Zone 1 and Zone 2. Note that HBA1a and HBA1b are in separate zones so that each can only access one array controller.

    View an illustration of Switch Zoning in Cascaded FC Switches.

    Hardware Configurations for Data Replication

    The following three example hardware configurations provide information regarding host cabling, array cabling, FC switch cabling and zoning.

  • Highest Availability Campus Configuration

    The Highest Availability Campus Configuration provides complete redundancy without a single point of failure. This configuration includes four FC switches, two switches at both the primary/local and secondary/remote locations to provide for complete redundancy in fabrics, all storage array components and hosts.

    View the Highest Availability Campus Configuration illustration.

    Note: Start the installation at the primary/local site and repeat these steps for the secondary/remote site when instructed to. In the following procedure, FC switch 1 represents FC switch 1A for the primary/local site, and FC switch 1B for the secondary/remote site. FC switch 2 represents FC switch 2A for the primary/local site, and FC switch 2B for the secondary/remote site.

    After the four FC switches are properly zoned, complete the following procedure to set up the Highest Availability Campus Configuration for the Remote Replication option.

    Cabling the Configuration

    1. Is the Remote Replication option being added to an existing 6140 storage array configuration?

      • Yes - Stop all I/O activity from all hosts before proceeding to step 3.
      • No - This is a new storage array installation, proceed to step 4.
    2. Ensure that Host port 4 from controller "A" and "B" is unused on each array on which the Remote Replication option will be configured.

    3. Power down all storage arrays, hosts, FC switches and all other equipment in the storage array environment.

    4. Ensure that the cabling between all controller trays and expansion modules is complete, as described in the Sun StorageTek 6140 Array Getting Started Guide.

    5. Connect the primary host bus adapter for each local host to an available port in Zone 1 of FC Switch 1.

      a) Review the host to FC switch connection illustration.

      Note: The cables can be connected to any available port in the proper zone of the FC switch.

    6. Connect the secondary host bus adapter for each local host to an available port in Zone 2 of FC Switch 2.

      Note: See the illustration in step 5 if necessary.

    7. Connect controller port A1 on the storage array to an available port in Zone 1 of FC switch 1.

      a) Review the Storage Array to FC switch connection illustration.

    8. Connect controller port B1 on the storage array to an available port in Zone 2 of FC switch 2.

      Note: See the illustration in step 7 if necessary.

    9. Connect controller port A2 on the storage array to an available port in Zone 3 of FC switch 1.

      Note: See the illustration in step 7 if necessary.

    10. Connect controller port B2 on the storage array to an available port in Zone 4 of FC switch 2.

      Note: See the illustration in step 7 if necessary.

    11. Is the secondary/remote site cabling complete?

      • No - Repeat step 1 through step 10 for the secondary/remote site.
      • Yes - Go to step 12.
    12. Complete the fabric environment for FC switch 1 by connecting an FC cable between the uplink ports on Switch 1A and 1B.

      a) Review the host to FC switch fabric connection illustration.

    13. Repeat step 12 for FC Switch 2A and 2B to complete the fabric environment for FC switch2.

      Note: See the illustration in step 12 if necessary.

    14. Repeat step 5 through step 11 for any additional storage arrays that exist in the same cabinet that will be using the Remote Replication option.

    15. Locate the Ethernet connector ports for controller "A" and controller "B".

      a) View the Ethernet cable connection illustration.

    16. Connect an Ethernet cable to each controller for both arrays.

    17. Connect the other end to the site LAN.

    18. Power up all devices in the following order: array expansion units first, RAID array units second, FC switches third and finally hosts at both the local and remote sites.

    19. If this is a new configuration proceed to the "Updating the Inventory" section to complete the procedure. If this is an existing configuration proceed to the "Verifying the Storage Array Modules" section to complete the procedure.

  • Campus Configuration

    This configuration consists of one FC switch and fabric at each end. The configuration is not fully redundant and the switches and fabric can be a single point of failure. A FC switch failure does not usually result in data loss, but it does affect data availability.

    View the Campus Configuration illustration.

    Note: Start the installation at the primary/local site and repeat these steps for the secondary/remote site when instructed to. In the following procedure, FC switch 1 represents FC switch 1A for the primary/local site, and FC switch 1B for the secondary/remote site.

    After the two FC switches are properly zoned, complete the following procedure to set up the Campus Configuration for the Remote Replication option.

    Cabling the Configuration

    1. Is the Remote Replication option being added to an existing 6140 storage array configuration?

      • Yes - Stop all I/O activity from all hosts before proceeding to step 3.
      • No - This is a new storage array installation, proceed to step 4.
    2. Ensure that host port 4 from controller "A" and "B" of each array is unused on each array on which the Remote Replication option will be configured.

    3. Power down all storage arrays, hosts, FC switches and all other equipment in the storage array environment.

    4. Ensure that the cabling between all controller trays and expansion modules is complete, as described in the Sun StorageTek 6140 Array Getting Started Guide.

    5. Connect the primary host bus adapter for each host at this site to an available port in Zone 1 of FC Switch 1.

      a) Review the host to FC switch connection illustration.

      Note: The cables can be connected to any available port in the proper zone of the FC switch.

    6. Connect the secondary host bus adapter for each host at this site to an available port in Zone 2 of FC Switch 1.

      Note: See the illustration in step 5 if necessary.

    7. Connect controller port A1 on the storage array to an available port in Zone 1 of FC Switch 1.

      a) Review the Storage Array to FC switch connection illustration.

    8. Connect controller port B1 on the storage array to an available port in Zone 2 of FC Switch 1.

      Note: See the illustration in step 7 if necessary.

    9. Connect controller port A2 on the storage array to an available port in Zone 3 of FC Switch 1.

      Note: See the illustration in step 7 if necessary.

    10. Connect controller port B2 on the storage array to an available port in Zone 4 of FC Switch 1.

      Note: See the illustration in step 7 if necessary.

    11. Is the secondary/remote site cabling complete?

      • No - Repeat step 1 through step 10 for the secondary/remote site.
      • Yes - Go to step 12.
    12. Complete the Fabric 1 by connecting Switch 1A and 1B.

      a) Review the host to FC switch fabric connection illustration.

    13. Repeat step 5 through step 11 for any additional storage arrays that exist in the same cabinet that will be using the Remote Replication option.

    14. Locate the Ethernet connector ports for controller "A" and controller "B".

      a) View the Ethernet cable connection illustration.

    15. Connect an Ethernet cable to each controller for both arrays.

    16. Connect the other end to the site LAN.

    17. Power up all devices in the following order: array expansion units first, RAID array units second, FC switches third and finally hosts at both the local and remote sites.

    18. If this is a new configuration proceed to the "Updating the Inventory" section to complete the procedure. If this is an existing configuration proceed to the "Verifying the Storage Array Modules" section to complete the procedure.

  • Intra-Site Configuration

    Since there are only two switches in the Intra-Site Configuration, it is similar to the Campus Configuration. Because all hosts and storage arrays are in proximity of both FC switches, full redundancy of the data path can be obtained. But the Intra-Site Configuration creates a single point of failure if a disaster affects the entire site. The Intra-Site Configuration is used in environments where a long distance fabric is not required.

    View the Intra-Site Configuration illustration.

    After the two FC switches are properly zoned, complete the following procedure to set up the Campus Configuration for the Remote Replication option.

    Cabling the Configuration

    1. Is the Remote Replication option being added to an existing 6140 storage array configuration?

      • Yes - Stop all I/O activity from all hosts before proceeding to step 3.
      • No - This is a new storage array installation, proceed to step 4.
    2. Ensure that host port 4 from controller "A" and "B" is unused on each array on which the Remote Replication option will be configured.

    3. Power down all storage arrays, hosts, FC switches and all other equipment in the storage array environment.

    4. Ensure that the cabling between all controller trays and expansion modules is complete, as described in the Sun StorageTek 6140 Array Getting Started Guide.

    5. Connect the primary host bus adapter for each host at this site to an available port in Zone 1 of FC Switch 1.

      a) Review the host to FC switch connection illustration.

      Note: The cables can be connected to any available port in the proper zone of the FC switch.

    6. Connect the secondary host bus adapter for each host at this site to an available port in Zone A of FC Switch 2.

      a) Review the host to FC switch connection illustration.

      Note: The cables can be connected to any available port in the proper zone of the FC switch.

    7. Connect controller port A1 of the primary storage array to an available port in Zone 1 of FC Switch 1.

      a) Review the Storage Array to FC switch connection illustration.

    8. Connect controller port B1 of the primary storage array to an available port in Zone A of FC Switch 2.

      Note: See the illustration in step 7 if necessary.

    9. Connect controller port A2 of the primary storage array to an available port in Zone 2 of FC Switch 1.

      Note: See the illustration in step 7 if necessary.

    10. Connect controller port B2 of the primary storage array to an available port in Zone B of FC Switch 2.

      Note: See the illustration in step 7 if necessary.

    11. Connect controller port A1 of the secondary storage array to an available port in Zone 1 of FC Switch 1.

      a) Review the Storage Array to FC switch connection illustration.

    12. Connect controller port B1 of the secondary storage array to an available port in Zone A of FC Switch 2.

      Note: See the illustration in step 11 if necessary.

    13. Connect controller port A2 of the secondary storage array to an available port in Zone 2 of FC Switch 1.

      Note: See the illustration in step 11 if necessary.

    14. Connect controller port B2 of the secondary storage array to an available port in Zone B of FC Switch 2.

      Note: See the illustration in step 11 if necessary.

    15. Repeat step 5 through step 14 for any additional storage arrays that exist in the same cabinet that will be using the Remote Replication option.

    16. Locate the Ethernet connector ports for controller "A" and controller "B".

      a) View the Ethernet cable connection illustration.

    17. Connect an Ethernet cable to each controller for both arrays.

    18. Connect the other end to the site LAN.

    19. Power up all devices in the following order: array expansion units first, RAID array units second, FC switches third and finally hosts.

    20. If this is a new configuration proceed to the "Updating the Inventory" section to complete the procedure. If this is an existing configuration proceed to the "Verifying the Storage Array Modules" section to complete the procedure.

    Updating the Inventory

    1. The new storage array modules will need to be discovered to update the inventory.

      a) Discover the new tray.

      b) At the Discovery window, enter the IP address of the new storage array modules into the "IP List" input box.

      Note: If necessary refer to the Sun StorageTek 6140 Array Getting Started Guide for detailed instructions on how to initially set up an IP address for an array.

      c) Select the "Start Discovery" button to execute the discovery.

    2. After the Discovery has completed the Agent will need to be run.

      a) Run the Agent.

      b) At the Agent Summary window, select the box under the Add Agent column for the appropriate host that the new tray is attached to.

      c) Select the "Run Agent" button to execute the Agent.

    Verifying the Storage Array Modules

    1. The Device Details of each storage array module will need to be checked to confirm the State is "Enabled" and the Status is "OK" for all of the FRUs before attempting to create the replication sets.

      a) Review the Device Details.

      b) At the Devices window, select the appropriate name of the new array module from under the Name column.

      c) At the Device Details window, select the FRUs "jump to" at the left top of the screen or scroll down to the FRUs section.

      d) From the left column under FRUs, select each FRU type to verify that the State is "Enabled" and the Status is "OK".

      e) If any of the FRUs are not "Enabled" and "OK" proceed to the FRU removal/replacement procedures. If necessary contact your Sun Service provider.

    2. Repeat step 1 for any other storage array modules that were added or powered up.

    Creating the Remote Replication Sets

    1. Return to the Sun Web Console and use the Sun StorageTek 6140 Configuration Service to create the remote replication sets.