Lenovo Flex System FC5022 16Gb SAN Scalable Switches

The Lenovo Flex System™ FC5022 16Gb SAN Scalable Switch offerings are Gen 5 Fibre Channel (FC) embedded modules for Lenovo Flex System. With up to 48 ports that operate at 16 and 8 Gbps FC speeds, each module provides up to 28 internal ports to compute nodes through the Flex System midplane and up to 20 external SFP+ ports.

The FC5022 SAN switch modules deliver unmatched scalability and flexibility for Flex System users wanting to connect directly into 8 or 16 Gbps FC storage or to an upstream storage area network (SAN). The FC5022 can be configured in the Access Gateway mode using NPIV for simple upstream connectivity or in the Full Fabric more for more advance switching as a part of the larger Fibre Channel fabric.

The switch offers end-to-end 16 Gb with backwards compatibility to 8 Gb and 4 Gb to the SAN connectivity. Monitoring and management are simplified using end-to-end Brocade tools, such as Web Tools and Brocade SANnav management software.

The following figure shows the switch module.

Figure 1. Lenovo Flex System FC5022 16 Gb SAN Scalable Switch

Only the FC5022 provides up to 48 FC ports in an embedded form factor which provides Flex System a unique differentiation in the market, including the following:

• Increased I/O density: Support for 64 Gbps per compute node with only a pair of FC5022 switches can help clients reduce costs on hardware, utility costs and management or operational costs with fewer devices.
• Greater reliability: When used with 4-port FC mezzanine adapters, the 28 internal ports enable increased solution availability with greater path redundancy from the ASICs to the modules for no single point of failure.
• Multi-chassis scalability: The 20 external SFP+ ports allow for scaling up to 18 chassis without the use of external FC switches, such as FC top-of-rack (ToR) switches, thereby greatly reducing the overall cost of the Flex System solution.

The part numbers to order the switch and optional upgrades are shown in the following table.

The part numbers for the switches include the following items:

• One Flex System FC5022 16 Gb SAN Scalable Switch (12-port or 24-port, or 24-port with ESB)
• Two 16 Gb SFP+ optical transceivers (included with 24-port 16 Gb SAN Scalable Switch, part number 00Y3324)
• Documentation package

The part numbers for the Features on Demand upgrades include the following items:

• Features on Demand Activation Flyer
• Upgrade authorization letter

The switch does not include a serial management cable, however, Flex System Management Serial Access Cable, part number 90Y9338, is supported and contains two cables, a mini-USB-to-RJ45 serial cable and a mini-USB-to-DB9 serial cable, either of which can be used to connect to the switch locally for configuration tasks and firmware updates.

The FC5022 12-port and 24-port ESB SAN switch come without SFP+ media, which must be ordered separately to provide outside connectivity. The FC5022 24-port SAN switch (part number 00Y3324) comes standard with two Brocade 16 Gb SFP+ transceivers. Additional SFP+ can be ordered, if required.

The following table lists the supported SFP+ options.

* When using ELW SFPs over distances over 10 km, the Extended Fabric feature is required on a SAN switch to drive the maximum bandwidth over the extended links. The Extended Fabric feature is included in the FC5022 ESB switch module (part number 90Y9356). The ELW SFPs are supported on the FC5022 switch modules (part numbers 88Y6374 and 00Y3324) with the addition of the Extended Fabric license.

The following table provides a feature comparison by model for Flex System FC5022 switches.

With Brocade's Dynamic Ports on Demand (DPOD) feature, ports are licensed in one of two methods: as they come online or as selected by the administrator. With the 16 Gb SAN switch, the first 12 ports reporting (on a first-come, first-served basis) on boot-up are assigned licenses. These 12 ports can be any combination of external or internal Fibre Channel (FC) ports. After all port licenses have been assigned, you can manually move those licenses from one port to another. Because this is dynamic, no defined ports are reserved except ports 0 and 29. The 24-port 16 Gb SAN switches have the same behavior; the only difference is the number of ports, which is 24.

The following table shows the total number of port licenses on the switch after applying compatible port upgrades.

Note: A maximum of one upgrade of each type (one Upgrade 1 and one Upgrade 2) is supported per one switch module. Upgrade 1 and Upgrade 2 can be applied independently of each other.

* With the dual-port FC adapters installed in compute nodes, up to 34 ports (14 internal, 20 external) can be utilized. The remaining 14 internal ports require use of the 4-port FC adapters in the server's ITE.

The switches offer the following key benefits:

• Exceptional price/performance for growing SAN workloads

  The FC5022 16 Gbps switch delivers exceptional price/performance for growing SAN workloads through a combination of market-leading 1600 MB/sec throughput per port and an affordable high-density, 12-port to 48-port form factor.

• Enhanced server performance while using 16 Gb Gen 5 FC technology

  Using 16 Gb FC adapters on the server and the FC5022 modules can help achieve the following server enhancements, even if 8 Gb FC storage is used:

  • Up to 30-50% better virtual machine density and higher number of concurrent users due to increased storage bandwidth
  • Up to 20-40% fewer servers required to support the workload specified
  • Twice lower number and higher speed of inter-switch links required in scalable SANs
  • Higher reliability and availability of services due to fewer number of components used to build the solution
  • Twice faster access to the business critical data
  • Lower acquisition costs due to fewer number of systems and components
  • Shorten ROI time frame and decrease overall TCO with the efficient utilization of server resources and lower power, cooling, and management costs

  See Lenovo Press paper “The Benefits of 16 Gb Fibre Channel in IBM Flex System Solutions” for details: https://lenovopress.com/redp4921

• Superior scalability for internal and external ports that reduces costs and increases availability

  The FC5022 16 Gb switch is the only switch that provides up to 28 internal server facing FC ports, which allows the Flex System chassis to scale to 28 compute nodes in a single chassis (when using double density half-width compute nodes) that lowers the overall per-server cost of the solution. These 28 internal ports also enable greater path redundancy for ITEs using the 4-port FC mezzanine adapters. Additionally, the FC5022 offers an industry leading 20 external SFP+ ports that allows for multi-chassis scalability up to 18 chassis without the use of external FC switches, thereby greatly reducing the overall cost of the Flex Solution.

• Accelerating fabric deployment and serviceability with Brocade ClearLink and Fabric Vision

  Brocade ClearLink is a feature supported by the FC5022 16 Gb Switch that enables administrators to quickly identify and isolate 16 Gbps optic, port, and cable problems, reducing fabric deployment and diagnostic times. Brocade Fabric Vision Technology offers innovative diagnostic, monitoring, and management capabilities to help administrators avoid problems, maximize application performance, and reduce operational costs.

• A building block for virtualized, private cloud storage

  The FC5022 16 Gb Switch supports multi-tenancy in cloud environments through VM-aware end-to-end visibility and monitoring, Quality of Service (QoS), and fabric-based advanced zoning features. The FC5022 enables secure long distance extensions to virtual private or hybrid clouds with dark fiber support, as well as in-flight encryption and data compression.

• Seamless integration with the existing Brocade fabric in Full Fabric mode

  The FC5022 switch in Full Fabric mode provides native support for the advanced fabric features of the Brocade SAN fabric.

• Simplified interconnect to existing SAN environments with Brocade Access gateway (NPIV) operational mode

  All models of the FC5022 16 Gb Switch can be deployed as an Access Gateway, which simplifies fabric topologies and heterogeneous fabric connectivity. Access Gateway mode utilizes N_Port ID Virtualization (NPIV) switch standards to present physical and virtual servers directly to the core of SAN fabrics. This makes it transparent to the SAN fabric, greatly reducing management of the network edge. The FC5022 Scalable Switch in Access Gateway mode can connect servers to NPIV-enabled SAN fabrics, including Brocade or Cisco SAN fabrics.

• Maximizing investments

  To help optimize technology investments, Lenovo offers a single point of serviceability backed by industry-renowned education, support, and training. In addition, the Lenovo 16/8 Gbps SAN Scalable Switch is in the ServerProven® program, ensuring compatibility among a variety of Lenovo and partner products.

The FC5022 16 Gb Switches have the following features and specifications:

• Internal ports
  • 28 internal full-duplex 16/8 Gb FC ports
  • Internal ports operate as F_ports (fabric ports) in native mode or in access gateway mode
  • Two internal full-duplex 1 GbE ports connected to the chassis management module
  • Support for the 2-port and 4-port FC adapter cards
• External ports
  • 20 external ports for 16 Gb or 8 Gb SFP+ transceivers supporting 4 Gb, 8 Gb, and 16 Gb port speeds (supported SFP+ modules are listed in Table 2). Ports are auto-sensing and activated with the Dynamic Ports on Demand feature.
  • External ports can operate as F_ports (fabric ports) or E_ports (expansion ports) in native mode or as N_ports NPIV (node ports) in Access Gateway mode
  • One external 1 GbE port (1000BASE-T) with RJ-45 connector for switch configuration and management (IPv4 and IPv6 support)
  • One RS-232 serial port (mini-USB connector) that provides an additional means to configure the switch module
• Access Gateway mode (N_Port ID Virtualization - NPIV) support
• Mirror Port (M-Port) allows you to mirror traffic to an external port between a specific host and target
• Power-on self-test diagnostics and status reporting
• Inter-Switch Link (ISL) Trunking (optional, included with the 24-port ESB model), which allows up to eight ports (at 16, 8, or 4 Gbps speeds) to combine to form a single, logical ISL with a speed of up to 128 Gbps (256 Gbps full duplex) for optimal bandwidth utilization, automatic path failover, and load balancing
• Fabric OS (FOS) version 7.0.x or higher, which delivers distributed intelligence throughout the network and enables a wide range of value-added applications, such as Advanced Web Tools and Advanced Fabric Services (on certain models)
• Supports up to 768 Gbps end-to-end full-duplex aggregated bandwidth
• 420 million frames switch per second, 0.7 microseconds latency
• 8192 buffers for up to 3750 km extended distance at 4 Gbps FC (Extended Fabrics license required)
• In-flight 64 Gbps FC compression and decompression support on up to two external ports (no license required)
• In-flight 32 Gbps encryption and decryption on up to two external ports (no license required)
• 48 Virtual Channels (VCs) per port
• Fabric scalability of up to 239 switches in Full Fabric mode
• Port mirroring to monitor ingress or egress traffic from any port within the switch
• Two I2C connections able to interface to redundant management modules
• Hot pluggable switches in the chassis and SFP+ optical transceivers in the switches
• Single fuse circuit
• Four temperature sensors
• One internal real-time clock
• Managed with Web Tools
• Supports up to 128 domains in Native mode and Interoperability mode
• Full fabric switch mode may be changed to or from Access Gateway mode
• Nondisruptive code load in Native mode and Access Gateway (NPIV) mode
• 255 NPIV N_port logins per physical port
• D_port support on external ports (16Gbps SFP+ only)
• Class 2 and Class 3 frames Class of Service
• Registered State Change Notification (RSCN)
• FTP support for firmware upgrades
• SNMP/MIB monitoring functionality contained within the Ethernet Control MIB-II (RFC1213-MIB)
• UUID put into MIB structure
• End-to-end optics and link validation
• Ability to send switch events and syslogs to the Chassis Management Module (CMM)
• Traps identify cold start, warm start, link up/link down, and authentication failure events
• Support for IPv4 and IPv6 on the management ports
• Advanced SAN Fabric Services
  • Bottleneck Detection
  • Dynamic Fabric Provisioning (DFP)
  • Dynamic Path Selection (DPS)
  • Enhanced BB credit recovery
  • FDMI
  • Frame Redirection
  • Frame-based Trunking
  • FSPF
  • IPoFC
  • Management Server
  • NPIV
  • NTP v3
  • Port Fencing
  • Reliable Commit Service (RCS)
  • Simple Name Server (SNS)

• Software management
  • HTTPS
  • SNMP v1/v3 (FE MIB, FC Management MIB)
  • SSH
  • Auditing
  • Syslog
  • APM
  • Command Line Interface (CLI)
  • SMI-S compliant
  • Administrative Domains
• Security management
  • AES-GCM-256 encryption on ISLs
  • DH-CHAP (between switches and end devices)
  • FCAP switch authentication
  • FIPS 140-2 L2-compliant
  • HTTPS
  • IPsec
  • IP filtering
  • LDAP with IPv6
  • Port Binding
  • RADIUS
  • User-defined Role-Based Access Control (RBAC)
  • Secure Copy (SCP)
  • Secure RPC
  • SFTP
  • SSH v2
  • SSL
  • Switch Binding
  • Trusted Switch
• Diagnostics
  • D_Port offline diagnostics (16 Gbps optics only)
    • Electrical/optical loopback
    • Link traffic/latency/distance
  • POST and embedded online/offline diagnostics
    • Environmental monitoring
    • FCping
    • Pathinfo (FC traceroute)
    • Frame viewer
    • Non-disruptive daemon restart
    • Port mirroring
    • Optics health monitoring
    • Power monitoring
    • RAS trace logging
    • Rolling Reboot Detection (RRD)

Flex System FC5022 switches come standard with the following software features:

• Full Fabric mode: Enables high performance 16 Gb or 8 Gb fabric switching
• Access Gateway mode: Leverages NPIV to connect to any fabric without adding switch domains to reduce management complexity
• Dynamic Path Selection: Enables exchange-based load balancing across multiple Inter-Switch Links for superior performance
• Advanced Zoning: Segments a SAN into virtual private SANs to increase security and availability
• Server Application Optimization: Allows VM QoS, authentication, and monitoring from SAN through adapter to VM and associated virtualized application

The switch supports the following FC standards:

• FC-AL-2 INCITS 332: 1999
• FC-GS-5 ANSI INCITS 427 (includes the following):
  • FC-GS-4 ANSI INCITS 387: 2004
• FC-IFR INCITS 1745-D, revision 1.03 (under development)
• FC-SW-4 INCITS 418:2006 (includes the following):
  • FC-SW-3 INCITS 384: 2004
• FC-VI INCITS 357: 2002
• FC-TAPE INCITS TR-24: 1999
• FC-DA INCITS TR-36: 2004 (includes the following):
  • FC-FLA INCITS TR-20: 1998
  • FC-PLDA INCIT S TR-19: 1998
• FC-MI-2 ANSI/INCITS TR-39-2005
• FC-PI INCITS 352: 2002
• FC-PI-2 INCITS 404: 2005
• FC-PI-4 INCITS 1647-D, revision 7.1 (under development)
• FC-PI-5 INCITS 479: 2011
• FC-FS-2 ANSI/INCITS 424:2006 (includes the following):
  • FC-FS INCITS 373: 2003
• FC-LS INCITS 433: 2007
• FC-BB-3 INCITS 414: 2006 (includes the following):
• FC-BB-2 INCITS 372: 2003
• FC-SB-3 INCITS 374: 2003 (replaces FC-SB ANSI X3.271: 1996; FC-SB-2 INCITS 374: 2001)
• RFC 2625 IP and ARP Over FC
• RFC 2837 Fabric Element MIB
• MIB-FA INCITS TR-32: 2003
• FCP-2 INCITS 350: 2003 (replaces FCP ANSI X3.269: 1996)
• SNIA Storage Management Initiative Specification (SMI-S) Version 1.2 (includes the following):
  • SNIA Storage Management Initiative Specification (SMI-S) Version 1.03 ISO standard IS24775-2006. Replaces (ANSI INCITS 388: 2004)
  • SNIA Storage Management Initiative Specification (SMI-S) Version 1.1.0
  • SNIA Storage Management Initiative Specification (SMI-S) Version 1.2.0

The switches are installed in switch bays in the rear of the Flex System chassis, as shown in the following figure. Switches are normally installed in pairs since ports on the I/O adapter cards installed in the compute nodes are routed to two switch bays for redundancy and performance.

Figure 2. Location of the switch bays in the Flex System chassis

The following table shows compatibility information for the FC5022 and Flex System chassis.

The Flex System FC5022 16Gb SAN Scalable Switches can be installed in bays 1, 2, 3, and 4 of the Flex System chassis. A supported adapter card must be installed in a corresponding slot of the compute node (slot 1 when switches are installed in bays 1 and 2 or slot 2 when switches are in bays 3 and 4).

With compute nodes that have an integrated dual-port 10 GbE network interface controller (NIC) these switches can only be installed in bays 3 and 4 because integrated NIC ports are routed to bays 1 and 2 with a specialized periscope connector and the FC adapter card cannot be installed in the slot 1. When needed, however, the periscope connector can be replaced with an FC adapter card, in which case the integrated NIC will be disabled and FC switches can be used in bays 1 and 2.

The following table shows the connections between dual-port and 4-port FC adapters installed in the compute nodes to the switch bays in the chassis with Flex System FC5022 16 Gb SAN Scalable Switches.

The following figure shows the front panel of the Lenovo Flex System FC5022 16Gb SAN Scalable Switches.

Figure 3. Front panel of the Lenovo Flex System FC5022 16Gb SAN Scalable Switches

The front panel contains the following components:

• LEDs that display the status of the switch module and the fabric:
  • The OK LED indicates that the switch module has passed the power-on self-test (POST) with no critical faults and is operational.
  • The blue Identify LED can be used to identify the switch physically, by illuminating via the management software.
  • The Error LED (switch module error) indicates that the switch module has failed the POST or detected an operational fault.
• One mini-USB RS-232 console port that provides an additional means to configure the switch module. This mini-USB-style connector enables connection of a special serial cable (cable is optional and it is not included with the switch; see the part number information section for details).
• One 1 Gb Ethernet RJ-45 port for switch configuration and management
• 20 external SFP+ port connectors to attach SFP+ modules for 16 Gb, 8 Gb or 4 Gb connections to external FC devices
• An FC link error LED and an FC Tx/Rx LED for each external port on the switch

The following table lists the cables required for the switch.

Table 9. FC5022 cabling requirements

Lenovo offers optional Brocade SANnav™ Management Portal and SANnav Global View software license subscriptions that provide comprehensive visibility into the SAN environment, allow administrators to quickly identify, isolate, and correct problems, and accelerate administrative tasks by simplifying and automating workflows.

SANnav Management Portal is a next-generation SAN management application with a simple browser-based user interface (UI) and with a focus on streamlining common workflows, such as configuration, zoning, deployment, monitoring, troubleshooting, reporting, and analytics.

SANnav Management Portal supports all Brocade SAN switches and platforms that run the Fabric OS® version 7.4 or above, including Lenovo B300, B6505, B6510, DB610S, DB620S, DB400D, DB720S, DB800D, Brocade Directors, and FC5022.

With SANnav Global View, administrators can quickly visualize the health, performance, and inventory of multiple SANnav Management Portal instances using a simple, intelligent dashboard and can easily navigate from a global view down to local environments to investigate points of interest. SANnav Global View is designed to manage up to 20 SANnav Management Portal instances.

For more information, refer to the SANnav Management Portal documentation:
http://www.broadcom.com/products/fibre-channel-networking/software/sannav-management-portal#documentation

The following table lists ordering information for the optional SANnav Management Portal and SANnav Global View management tools. After a client has an active SANnav license, Lenovo offers a “license extension/renewal”. This offering provides our clients the flexible to extend their subscription down to a specific end date. This allows clients the ability to align to your company’s budget or align with warranty of your FC SAN switches/directors. Please engage directly with your Lenovo sales representative for more details.

The FC5022 switches carry a 1-year, customer-replaceable unit (CRU) limited warranty. When installed in a chassis, these switches assume the chassis base warranty and any warranty service upgrade.

The approximate dimensions and weight of the switch are as follows:

• Height: 30 mm (1.2 in.)
• Width: 401 mm (15.8 in.)
• Depth: 317 mm (12.5 in.)
• Weight: 3.2 kg (7.1 lb)

The shipping dimensions and weight (approximate) of the switch are as follows:

• Height: 114 mm (4.5 in.)
• Width: 508 mm (20.0 in.)
• Depth: 432 mm (17.0 in.)
• Weight: 3.6 kg (8.1 lb)

The FC5022 swithces are supported in the following environment:

• Temperature
  • Operating: 0°C to 35°C (32°F to 95°F)
  • Non-operating: 5°C to 45°C (41°F to 113°F)
• Altitude
  • Up to 3,000 m (10,000 ft) above sea level
• Humidity
  • Operating: 20% to 80%, noncondensing at 29°C
  • Non-operating: 8% to 80%, noncondensing at 38°C

The switch conforms to the following standards:

• US: UL, CB, TUV reports and certificates per EN60950-1 2001 / IEC60950-1 2001
• Canada: CSA C22.2 No. 950 or 60950
• Germany: TUV/VDE IEC 950/EN 60950 (TUV component report & IEC60950 CB Report and Certificate)
• FCC - Title 47 CFR Part 15, Class A
• Canada - ICES-003
• Australia/New Zealand - C-Tick - AS/NZS CISPR 22:2006
• CE Mark - EN55022:2006+A1:2007 and EN55024:1998+A1:2001+A2:2003
• VCCI Class A - Japan VCCI 2009
• Korea’s EMC with KCC marking (previously MIC marking)
• MIC Notice No. 1996-78 (Korea)
• CISPR 22 Class A
• Taiwan BSMI – CNS 13438
• Turkey Communiqué No. 2004/9 and No. 2004/22
• Saudi Arabia – EMC.CVG, 28 October 2002
• China – GB 9524:1998

Lenovo offers the ThinkSystem DE Series and ThinkSystem DM Series external storage systems for high-performance storage. See the DE Series and DM Series product guides for specific controller models, expansion enclosures and configuration options:

• ThinkSystem DE Series Storage
  https://lenovopress.com/storage/thinksystem/de-series#rt=product-guide
• ThinkSystem DM Series Storage
  https://lenovopress.com/storage/thinksystem/dm-series#rt=product-guide
• ThinkSystem DG Series Storage
  https://lenovopress.com/storage/thinksystem/dg-series#rt=product-guide

Lenovo offers the ThinkSystem DB Series of Fibre Channel SAN switches for high-performance storage expansion. See the DB Series product guides for models and configuration options:

• ThinkSystem DB Series SAN Switches:
  https://lenovopress.com/storage/switches/rack#rt=product-guide

The following table lists the external backup options that are offered by Lenovo.

For more information, see the list of Product Guides in the Backup units category:
https://lenovopress.com/servers/options/backup

For more information, see the following Lenovo Flex System FC5022 16Gb SAN Switches product publications:

• Flex System Information Center for the FC5022 switches

Other documents:

• US Announcement Letter for the 16Gb SAN and 24-port ESB SAN switches
  http://ibm.com/common/ssi/cgi-bin/ssialias?infotype=dd&subtype=ca&&htmlfid=897/ENUS112-053
• US Announcement Letter for the 16Gb 24-port SAN switch
  http://ibm.com/common/ssi/cgi-bin/ssialias?infotype=dd&subtype=ca&&htmlfid=897/ENUS112-139
• US Announcement Letter for the Features on Demand upgrades
  http://ibm.com/common/ssi/cgi-bin/ssialias?infotype=dd&subtype=ca&&htmlfid=897/ENUS112-185
• Flex System Enterprise Chassis Product Guide
  http://lenovopress.com/tips0865
• The Benefits of 16 Gb Fibre Channel in Flex System Solutions
  http://lenovopress.com/redp4921
• Lenovo Flex System Products and Technology, SG24-8255
  http://lenovopress.com/sg248255
• Flex System Interoperability Guide
  http://lenovopress.com/fsig