NeXtScale System M5 with Water Cool Technology (E5-2600 v4)

The NeXtScale Water Cool Technology (WCT) system is the next generation of dense computing. It is an open, flexible, and simple data center solution for users of technical computing, grid deployments, analytics workloads, and large-scale cloud and virtualization infrastructures.

The NeXtScale n1200 WCT enclosure and NeXtScale nx360 M5 WCT server are designed to optimize density and performance within typical data center infrastructure limits. The 6U NeXtScale n1200 WCT enclosure fits in a standard 19-inch rack and up to 12 nx360 M5 WCT servers, on 6 WCT compute trays, can be installed into the enclosure. The nx360 M5 WCT is now based on Intel Xeon E5-2600 v4 processors.

The NeXtScale Water Cool Technology solution is designed to operate by using warm water, up to 45°C (113°F). Chillers are not needed for most customers, meaning even greater savings and a lower total cost of ownership (TCO).

The NeXtScale nx360 M5 WCT server is shown in the following figure.

Figure 1. Two NeXtScale nx360 M5 WCT servers on the Compute Tray that provides water cooling

The nx360 M5 WCT server and n1200 WCT enclosure with direct water cooling provide the ultimate in data center cooling efficiencies and performance. You can obtain upwards of 40% energy savings in data center expenses with the reduced need for air conditioning and air chillers. Direct water cooling means that the processors installed in the servers can enable the Intel Turbo Boost performance feature more often to further increase processor performance.

NeXtScale System M5 Water Cool Technology (WCT) offering is a dense platform from Lenovo that achieves maximum performance with innovative warm-water cooling functionality. The NeXtScale WCT system includes a dense chassis, two half wide compute nodes on the WCT Compute Tray, all fitting in a standard rack. With NeXtScale WCT, Lenovo drives increased compute density, performance, and cooling efficiency for High Performance Computing and other workloads that require dense compute performance, such as Cloud, Grid, and Analytics.

Perhaps the most notable feature of WCT products is direct water cooling. Direct water cooling is achieved by circulating the cooling water directly through cold plates that contact the CPU thermal case, DIMMs, and other high-heat-producing components in the server.

One of the main advantages of direct water cooling is the water can be relatively warm and still be very effective, as water conducts heat much more effectively than air. Depending on the server configuration, 85 - 90% of the heat is removed by water cooling; the rest can easily be managed by a standard computer room air conditioner. With allowable inlet temperatures for the water being as high as 45°C (113°F), in many cases the water can be cooled by using ambient air and chilled water and a heat exchanger is not required.

The rear view of the nx360 M5 WCT with Intel Xeon E5-2600 v4 processors is shown in the following figure.

Figure 2. Rear view of the nx360 M5 WCT server showing the water inlet and outlet

Designed to industry-standards, NeXtScale Systems are general-purpose platforms that are designed to give customers a flexible IT infrastructure. Customized solutions can be configured to provide an application-appropriate platform with a choice of servers, networking switches, adapters, and racks.

NeXtScale nx360 M5 WCT servers provide a dense, flexible solution with a low TCO. The half-wide, dual-socket NeXtScale nx360 M5 server is designed for data centers that require high performance but are constrained by floor space. By taking up less physical space in the data center, the NeXtScale server enhances density and supports the Intel Xeon processor E5-2600 v4 series up to 145 W and 22-core processors, thus providing more performance per server. The nx360 M5 compute node contains only essential components in the base architecture to provide a cost-optimized platform.

The NeXtScale n1200 WCT Enclosure is an efficient, 6U, 12-node chassis with no built-in networking or switching capabilities; therefore, it requires no chassis-level management. Sensibly designed to provide shared, high-efficiency power and cooling for housed servers, the n1200 WCT enclosure is designed to scale with your business needs.

Scalability and performance

The NeXtScale n1200 WCT chassis and the NeXtScale nx360 M5 WCT server offer the following features to boost performance, improve scalability, and reduce costs:

• Up to 12 compute nodes, each with two of the latest Xeon v4 processors, 16 DIMMs, and three PCIe slots, in 6U of rack space. It is a highly dense, scalable, and price-optimized offering.
• The Intel Xeon processor E5-2600 v4 product family improves productivity by offering superior system performance with 22-core processors, core speeds up to 3.5 GHz, L3 cache sizes up to 55 MB, DDR4 memory speeds up to 2400 MHz, and QPI interconnect links of up to 9.6 GTps.
• Two processors, up to 44 cores, and 88 threads maximize the concurrent execution of multi-threaded applications.
• Intelligent and adaptive system performance with Intel Turbo Boost Technology 2.0 allows CPU cores to run at maximum speeds during peak workloads by temporarily going beyond processor TDP.
• By providing better cooling than possible with air cooling, WTC servers optimize Turbo Boost 2.0 enablement. With water cooling, it may be possible to operate the processors in continuous Turbo mode.
• Intel Hyper-Threading Technology boosts performance for multi-threaded applications by enabling simultaneous multi-threading within each processor core, up to two threads per core.
• Intel Advanced Vector Extensions 2 (AVX2) doubles the number of floating-point operations per second (FLOPS) per clock cycle, enables 256 bit integer operation, and provides more instructions to improve performance for compute-intensive technical and scientific applications.
• A total of 16 DIMMs of registered 2400 MHz DDR4 ECC memory provide speed, high availability, and a memory capacity of up to 512 GB.
• Two useable PCIe slots internal to the nx360 M5, a full-height half-length x16 PCIe Gen 3 slot and a mezzanine LOM Generation 2 (ML2) slot, which is also x16 PCIe Gen 3.
• Two useable PCIe slots internal to the nx360 M5, a full-height half-length x16 PCIe Gen 3 slot and a mezzanine LOM Generation 2 (ML2) slot, which is also x16 PCIe Gen 3. These can be used for EDR InfiniBand or Intel’s new Omni-Path Architecture (OPA) fabric, delivering ultra-high performance connectivity.
• Supports mezzanine LOM Generation 2 (ML2) cards for 40 Gb Ethernet and FDR InfiniBand that offer network performance in the smallest footprint.
• PCI Express 3.0 I/O expansion capabilities almost double (1.97x) the useable lane bandwidth compared with PCI Express 2.0.
• With Intel Integrated I/O Technology, the PCI Express 3.0 controller is integrated into the Intel Xeon processor E5 family, which reduces I/O latency and increases overall system performance.

Manageability and security

The following powerful systems management features simplify local and remote management of the nx360 M5 WCT:

• The server includes an Integrated Management Module II (IMM2) to monitor server availability and perform remote management.
• The first standard 1 Gbps Ethernet port can be shared between the operating system and IMM2 for remote management or can be dedicated to the IMM2. The second standard Ethernet port provides 1 Gbps Ethernet connectivity.
• IMM2 functionality can be enhanced with optional Features on Demand upgrades. The first upgrade enables a browser based interface; the second upgrade adds remote console and media functionality.
• An integrated industry-standard Unified Extensible Firmware Interface (UEFI) enables improved setup, configuration, and updates and simplifies error handling.
• Integrated Trusted Platform Module (TPM) 1.2 support enables advanced cryptographic functions, such as digital signatures and remote attestation.
• Intel Trusted Execution Technology provides enhanced security through hardware-based resistance to malicious software attacks, which allows the application to run in its own isolated space that is protected from all other software that is running on a system.
• The Intel Execute Disable Bit function can prevent certain classes of malicious buffer overflow attacks when combined with a supporting operating system.
• The n1200 WCT chassis includes drip sensors that monitor the inlet and outlet manifold quick connect couplers; leaks are reported via the Fan and Power Controller (FPC).

Energy efficiency

NeXtScale System offers the following energy efficiency features to save energy, reduce operational costs, increase energy availability, and contribute to a green environment:

• Water cooling eliminates power that is drawn by cooling fans in the chassis and dramatically reduces the required air movement in the server room, which also saves power. Savings as much as 40% are possible in the data center due to the reduced need for air conditioning.

• Water chillers may not be required with a WCT solution. Chillers are a major expense for most geographies and can be reduced or even eliminated because the water temperature can now be 45°C instead of 18°C in an air-cooled environment.

• 85-90% heat recovery is possible with the WCT design. Heat energy absorbed may be reused for heating buildings in the winter for further operating expense savings.

• The processors and other microelectronics are run at lower temperatures because they are water cooled, which uses less power.
• Support is available for S3 standby power states in the processor.
• Shared 80 Plus Platinum power supplies ensure energy efficiency.
• The Intel Xeon processor E5-2600 v4 product family offers better performance over the previous generation while fitting into the similar TDP limits. These processors have their voltage regulators in the processor die (as opposed to externally); therefore, although the TDP numbers increased as compared to the v3 products, overall system power consumption is reduced.
• Intel Intelligent Power Capability can power on and off individual processor elements as needed to reduce power draw.
• Low-voltage Intel Xeon processors draw less energy to satisfy the demands of power and thermally constrained data centers and telecommunication environments.
• Low-voltage 1.2 V DDR4 memory DIMMs use up to 20% less energy, compared to 1.35 V DDR3 DIMMs.
• There are power monitoring and power capping capabilities through the FPC in the chassis

Availability and serviceability

NeXtScale n1200 WCT chassis and the nx360 M5 WCT server provide the following features to simplify serviceability and increase system uptime:

• The NeXtScale n1200 chassis supports N+N and N+1 power policies for its six power supplies, which means greater system uptime.
• The power supplies are hot-swappable.
• Toolless cover removal provides easy access to upgrades and serviceable parts, such as adapters and memory.
• Predictive Failure Analysis (PFA) detects when system components (processors, memory, and PCI devices) operate outside of standard thresholds and generates proactive alerts in advance of possible failure, which increases uptime.
• The built-in IMM2 continuously monitors system parameters, triggers alerts, and performs recovering actions if there are failures to minimize downtime.
• The IMM2 offers optional remote management capability and can enable remote keyboard, video, and mouse (KVM) control and remote media for the server.
• There is a three-year customer replaceable unit and onsite limited warranty, with next business day 9x5 coverage. Optional warranty upgrades and extensions are available.
• With water cooling, system fans are not required; only small power supply fans operate. This results in significantly reduced noise levels on the data center floor, a significant benefit to personnel having to work on site.

The front of the nx360 M5 WCT server is shown in the following figure.

Figure 3. Front view of NeXtScale nx360 M5 WCT server.

The following figure shows the locations of key components inside the server.

Figure 4. Inside view of the NeXtScale nx360 M5 WCT

The compute nodes are installed in the NeXtScale n1200 WCT enclosure, as shown in the following figure.

Figure 5. Front view of the NeXtScale n1200 WCT enclosure

The rear of the enclosure contains the power supplies, cooling water manifolds, and the Fan and Power Controller, as shown in the following figure.

Figure 6. Rear view of the NeXtScale n1200 WCT enclosure

The following table lists the standard specifications of the NeXtScale nx360 M5 WCT compute.

The nx360 M5 servers are shipped with the following items:

• Statement of Limited Warranty
• Important Notices
• Documentation flyer that contains the Installation and Service Guide

The following table lists the standard specifications of the NeXtScale n1200 WCT enclosure.

There are no standard models; all NeXtScale nx360 M5 WCT servers must be configured by using the configure-to-order (CTO) process. The NeXtScale nx360 M5 WCT machine type is 5467.

There are no standard models; all NeXtScale n1200 WCT chassis must be configured by using the CTO process. The machine type is 5468.

The water manifold a separate machine type 5469.

The chassis ships with the following items:

• Rail kit
• Four detachable chassis lift handles
• One Console breakout cable (also known as a KVM Dongle)

The n1200 provides shared high-efficiency power supplies. As with BladeCenter® and Flex System®, the NeXtScale System compute nodes connect to a midplane. However, this connection is for power and control only; the midplane does not provide any I/O connectivity.

The nx360 M5 WCT supports the processor options that are listed in the following table.

* Processor detail: Model, core count, core speed, L3 cache, memory speed, and TDP power.

TruDDR4 Memory from Lenovo uses the highest quality components that are sourced from Tier 1 DRAM suppliers and only memory that meets the strict requirements of Lenovo is selected. It is compatibility tested and tuned on every System x server to maximize performance and reliability. TruDDR4 Memory has a unique signature that is programmed into the DIMM that enables Lenovo servers to verify whether the memory installed is qualified or supported. Because TruDDR4 Memory is authenticated, certain extended memory performance features can be enabled to extend performance over industry standards.

The NeXtScale nx360 M5 WCT supports up to 8 TruDDR Memory DIMMs when one processor is installed and up to 16 TruDDR Memory DIMMs when two processors are installed. Each processor has four memory channels, and there are two DIMMs per memory channel (2 DPC). LRDIMMs and UDIMMs currently are not supported.

With Intel Xeon E5-2600 v4 processors, the server supports 2400 MHz memory.

The supported memory that is available for the nx360 M5 WCT server is listed in the following table.

In the nx360 M5 WCT, the maximum memory channel speed is the lower of the following two values:

• Speed of the processor memory channels
• Speed of the memory DIMM

Memory operates at 2400 MHz per channel, with 1 or 2 DIMMs per channel (DPC), in the NeXtScale nx360 M5 WCT.

The following memory protection technologies are supported:

• ECC
• Chipkill (only available with x4 memory – eg. 1Rx4, 2Rx4, and 4Rx4)

The NeXtScale nx360 M5 WCT server supports a single drive in the location otherwise occupied by the ML2 adapter. Supported drives are listed in the following table. The table also lists the drive cage that is required to mount the drive in the server.

The drive is connected via a cable to the SATA port on the system board as shown in the Locations of key components and connectors section.

The nx360 M5 WCT does not support internal tape drives.

The server does not support an internal optical drive option, however, you can connect an external USB optical drive. See http://support.lenovo.com/en/documents/pd011281 for information about available external optical drives from Lenovo.

The nx360 M5 WCT offers the following I/O expansion options:

• One PCIe 3.0 x16 ML2 adapter slot (optional, front accessible)
• One PCIe 3.0 x16 full-height half-length slot (optional, front accessible)

Notes:

• Each slot requires a riser card, as listed in the following table.
• The ML2 slot is not available if an internal drive is installed

The front accessible slots are shown in the following figure.

Figure 7. Optional front accessible PCIe slots

The ordering information for optional riser cards for the two slots is listed in the following table.

Table 6. Riser card options

The nx360 M5 WCT provides two Gigabit Ethernet ports standard, with the following features:

• Broadcom BCM5717 Gigabit Ethernet controller
• TCP/IP Offload Engine (TOE) support
• Wake on LAN support
• Receive side Scaling (RSS) and Transmit side Scaling (TSS) support
• MSI and MSI-X capability (up to five MSI-X vectors)
• VLAN tag support (IEEE 802.1Q)
• Layer 2 priority encoding (IEEE 802.1p)
• Link aggregation (IEEE 802.3ad)
• Full-duplex flow control (IEEE 802.3x)
• IP, TCP, and UDP checksum offload (hardware based) on Tx/Rx over IPv4/IPv6
• Hardware TCP segmentation offload over IPv4/IPv6
• Jumbo frame support
• NIC Teaming (Load Balancing and Failover)
• One port that is shared with IMM2 by using the Network Controller-Sideband Interface (NC-SI)

The nx360 M5 server supports a Mezzanine LOM Generation 2 (ML2) adapter with a dedicated slot at the front of the server, as shown in the previous figure. The usage of an ML2 adapter also requires the installation of the ML2 riser card. The riser card and supported adapter is listed in the following table.

The Mellanox ConnectX-3 Pro 40GbE / FDR IB VPI ML2 adapter has the following features:

• Two QSFP ports that support FDR-14 InfiniBand or 40 Gb Ethernet
• Mezzanine LOM Generation 2 (ML2) form factor
• Support for InfiniBand FDR speeds of up to 56 Gbps (auto-negotiation FDR-10, DDR, and SDR)
• Support for Virtual Protocol Interconnect (VPI), which enables one adapter for InfiniBand and 10/40 Gb Ethernet. Supports three configurations:
  • 2 ports InfiniBand
  • 2 ports Ethernet
  • 1 port InfiniBand and 1 port Ethernet
• SR-IOV support; 16 virtual functions that are supported by KVM and Hyper-V (OS-dependent) up to a maximum of 127 virtual functions that are supported by the adapter
• Enables Low Latency RDMA over 40 Gb Ethernet (supported with non-virtualized and SR-IOV enabled virtualized servers);latency as low as 1 ?s
• Microsoft VMQ/VMware NetQueue support
• Sub 1 µs InfiniBand MPI ping latency
• Support for QSFP to SFP+ for 10 Gb Ethernet support
• Traffic steering across multiple cores
• Legacy and UEFI PXE network boot support (Ethernet mode only)
• Offers NVGRE hardware offloads
• Offers VXLAN hardware offloads

The supported network adapters for use in the standard full-height half-length PCIe slot are listed in the following table. The use of an adapter in this slot also requires the installation of the PCIe riser card.

The nx360 M5 WCT server currently does not support storage host bus adapters.

The nx360 M5 WCT server currently does not support High IOPS SSD adapters.

The nx360 M5 WCT server currently does not support GPUs.

The NeXtScale n1200 WCT enclosure supports up to six redundant hot-plug power supplies, which provides N+N or N+1 redundancy. Power policies with no redundancy also are supported. These power supplies are either 80 PLUS Platinum or Titanium certified to allow for the best efficiency values of your data center. The following table lists the supported power supplies.

Table 9. Power supplies

The power supply options have the following features:

• Supports N+N or N+1 Power Redundancy, or Non-redundant power configurations to support higher density
• Power management controller and configured through the Fan and Power Controller
• Integrated 2500 RPM fan
• 80 PLUS Platinum or Titanium certified
• Built-in overload and surge protection

900 W power supply specifications:

• Supports dual-range voltage: 100 - 240 V
• 100 - 127 (nominal) V AC; 50 or 60 Hz; 6.8 A (maximum)
• 200 - 240 (nominal) V AC; 50 or 60 Hz; 5.0 A (maximum)

1300 W power supply specifications:

• Supports high-range voltage only: 200 - 240 V
• 200 - 240 (nominal) V AC; 50 or 60 Hz; 6.9 A (maximum)

The nx360 M5 WCT server does not support integrated virtualization.

The nx360 M5 WCT provides local console access through the KVM connector at the front of the server. A console breakout cable is used with this connector, which provides a VGA port, two USB ports, and a DB9 serial port. The cable is shown in the following figure.

Figure 8. Console breakout cable

One console breakout cable is shipped with the NeXtScale n1200 WCT enclosure. Additional cables can be ordered per the following table.

Table 10. Console breakout cable

To aid with problem determination, the server includes light path diagnostics, which is a set of LEDs on the front of the server and inside the server that show you which component is failing. The LEDs are shown in the following figure.

Figure 9. Power button and system LEDs (some front panel perforations will not be present on the production model)

When an error occurs, the system error LED lights up. Review the logs through the web interface of the IMMv2 (see the "Remote server management" section). If needed, power off the server and remove it from the enclosure. Then, press and hold the power button to activate the system board LEDs. The LED next to the failed component lights up.

The server contains an Integrated Management Module II (IMM2), which provides advanced service-processor control, monitoring, and an alerting function. If an environmental condition exceeds a threshold or if a system component fails, the IMM2 lights LEDs to help you diagnose the problem, records the error in the event log, and alerts you about the problem. The server includes IMM2 Basic and can be upgraded to IMM2 Standard and IMM2 Advanced with Feature on Demand (FoD) licenses.

IMM2 Basic has the following features:

• Industry-standard interfaces and protocols
• Intelligent Platform Management Interface (IPMI) Version 2.0
• Common Information Model (CIM)
• Advanced Predictive Failure Analysis (PFA) support
• Continuous health monitoring
• Shared Ethernet connection
• Domain Name System (DNS) server support
• Dynamic Host Configuration Protocol (DHCP) support
• Embedded Dynamic System Analysis (DSA)
• LAN over USB for in-band communications to the IMM
• Serial over LAN
• Remote power control
• Server console serial redirection

IMM2 Standard (as enabled by using the Feature on Demand software license key using part number 90Y3900) has the following features in addition to the IMM2 Basic features:

• Remote access through a secure web console
• Access to server vital product data (VPD)
• Automatic notification and alerts
• Continuous health monitoring and control
• Email alerts
• Syslog logging support
• Enhanced user authority levels
• Event logs that are time stamped, saved on the IMM, and that can be attached to email alerts
• OS watchdogs
• Remote configuration through Advanced Settings Utility (ASU)
• Remote firmware updating
• User authentication using a secure connection to a Lightweight Directory Access Protocol (LDAP) server

IMM2 Advanced (as enabled by using the Feature on Demand software license key using part number 90Y3901) adds the following features on top of those of IMM Standard:

• Remotely viewing video with graphics resolutions up to 1600x1200 at 75 Hz with up to 23 bits per pixel color depths, regardless of the system state
• Remotely accessing the server by using the keyboard and mouse from a remote client
• Mapping the CD or DVD drive, diskette drive, and USB flash drive on a remote client, and mapping ISO and diskette image files as virtual drives that are available for use by the server
• Uploading a diskette image to the IMM memory and mapping it to the server as a virtual drive

The blue-screen capture feature captures the video display contents before the IMM restarts the server when the IMM detects an operating system hang condition. A system administrator can use the blue-screen capture to assist in determining the cause of the hang condition.

The following table lists the remote management options.

Note: The IMM2 Advanced upgrade requires the IMM2 Standard upgrade.

Table 11. Remote management options

The nx360 M5 provides two Ethernet ports standard, one of which (port 1) is configured in UEFI by default to be shared between the operating system and the IMM2. In shared mode, this port enables you to connect remotely to the IMM2 to perform systems management functions. The following figure shows the location of the ports.

Figure 10. IMM port (some front panel perforations will not be present on the production model)

The NeXtScale n1200 WCT Enclosure offers a remote management capability through the FPC, which is at the back of the enclosure, as shown in the following figure.

Figure 11. Fan and Power Controller

The Fan and Power Controller has one external RJ45 port, which provides a 10/100 Mbps Ethernet connection for browser-based remote control.

The port provides the following interfaces:

• An HTTP (web browser) interface for remote management
• An IPMI interface to the IMM in each server
• An IPMI interface to higher managers, such as xCAT

The module provides the following functions:

• Power supply redundancy and over-subscription configuration
• Power capping/saving configuration
• Power restore policy
• Acoustic mode setting
• Configuration/log export to USB (a USB port is provided inside the module)
• IMM remote reset or Server remote reseat (AC cycle)
• Status monitor: Power consumption, node status, power supply status, and fan status
• Network configuration

The FPC also includes a USB key that is housed inside the unit. The USB key stores the event log for the FPC plus power, cooling, and network configuration data.

The server supports the following operating systems:

• Microsoft Windows Server 2012
• Microsoft Windows Server 2012 R2
• Microsoft Windows Server 2016
• Red Hat Enterprise Linux 6.6 (32-bit)
• Red Hat Enterprise Linux 6.6 (64-bit) including KVM
• Red Hat Enterprise Linux 7.1 (64-bit) including KVM
• SUSE Linux Enterprise Server 11 32-bit SP4
• SUSE Linux Enterprise Server 11 64-bit SP4
• SUSE Linux Enterprise Server 11 64-bit with Xen SP4
• SUSE Linux Enterprise Server 12 64-bit
• SUSE Linux Enterprise Server 12 with Xen
• VMware ESXi 6.0
• VMware ESXi 5.5

For the latest information about the specific versions and service levels that are supported and any other prerequisites, see the Operating System Interoperability Guide, http://lenovopress.com/osig

The NeXtScale nx360 M5 WCT compute tray features the following dimensions:

• Width: 432 mm (17.0 in.)
• Height: 41.0 mm (1.6 in.)
• Depth: 659 mm (25.9 in.)
• Weight (two servers on each compute tray):13.3 kg (29.3 lb)

The NeXtScale n1200 WCT enclosure features the following dimensions:

• Width: 447 mm (17.6 in.)
• Height: 262.2 mm (10.3 in.)
• Depth : 915 mm (36.0 in.)
• Weight:
  • Fully configured: 122.4 kg (270 lb) (not including the weight of the manifold)
  • Empty chassis: approximately 38 kg (84 lb) (including water manifold section)

Supported environment

The NeXtScale nx360 M5 WCT compute node complies with ASHRAE class A3 specifications. The node supports the following environments when it is powered on:

• Temperature: 5°C - 40°C (41°F - 104°F) up to 950 m (3,117 ft)
• Above 950m, de-rated maximum air temperature 1°C/175 m
• Humidity, non-condensing: -12°C dew point (10.4°F) and 8% - 85% relative humidity
• Maximum dew point: 24°C (75°F)
• Maximum altitude: 3050 m (10,000 ft) and 5°C - 28°C (41°F - 82°F)

The minimum humidity level for class A3 is the higher (more moisture) of the -12°C (10.4°F) dew point and the 8% relative humidity. These intersect at approximately 25°C (77°F). Below this intersection (approximately 25°C or 77°F), the dew point (-12°C or 10.4°F) represents the minimum moisture level, while above it relative humidity (8%) is the minimum.

Moisture levels lower than 0.5°C (32°F) dew point, but not lower -10 °C (14°F) dew point or 8% relative humidity, can be accepted if appropriate control measures are implemented to limit the generation of static electricity on personnel and equipment in the data center. All personnel and mobile furnishings and equipment must be connected to ground through an appropriate static control system.

The following items are considered the minimum requirements:

• All conductive flooring, conductive footwear on all personnel that go into the data center, and all mobile furnishings and equipment must be made of conductive or static dissipative materials.
• During maintenance on any hardware, a properly functioning wrist strap must be used by any personnel who come into contact with IT equipment.

To adhere to ASHRAE Class A3, Temperature: 36°C - 40°C (96.8°F - 104°F) with relaxed support, consider the following points:

• A support cloud like workload with no performance degradation is acceptable (Turbo-Off).
• Under no circumstance can any combination of worst case workload and configuration result in system shutdown or design exposure at 40°C (104°F).
• The worst case workload ( such as Linpack and Turbo-On) might have performance degradation.

The following specific component restrictions for the Intel Xeon Processor E5-2697 v3 and E5-2698A v3 :

• Temperature: 5°C - 35°C (41°F - 95°F)
• Altitude: 0 - 950 m (3,117 ft).

Cooling water requirements

The water that is required to initially fill the system side cooling loop must be reasonably clean and bacteria-free water (less than 100 colony forming units [CFU]/ml), such as demineralized water, reverse osmosis water, deionized water, or distilled water. The water must be filtered with an in-line 50 micron filter. The water must be treated with antibiological and anticorrosion measures. The following requirements must be met:

• Minimum flow rate: 6 liters per minute
• Inlet water temperature :18° - 45°C (18°C - 35°C for Intel Xeon E5-2698A v3)

Electrical requirements

The system operates at the following electrical specification:

• 100 - 127 (nominal) V AC; 50 Hz or 60 Hz; 6.8 A
• 200 - 240 (nominal) V AC; 50 Hz or 60 Hz; 5.0 A
• Input kilovolt-amperes (kVA) (approximately):
  • Minimum configuration: 0.1 kVA
  • Maximum configuration: 6.0 kVA

BTU output

The system generates the following heat load:

• Minimum configuration: 341 Btu/hr (100 watts)
• Maximum configuration: 20,471 Btu/hr (6,000 watts)

Noise level: 7.0 bels (idle)

The server conforms to the following international standards:

• FCC - Verified to comply with Part 15 of the FCC Rules, Class A
• Canada ICES-003, issue 5, Class A
• UL/IEC 60950-1
• CSA C22.2 No. 60950-1
• NOM-019
• Argentina IEC60950-1
• Japan VCCI, Class A
• IEC 60950-1 (CB Certificate and CB Test Report)
• China CCC GB4943.1, GB9254, Class A, and GB17625.1
• Taiwan BSMI CNS13438, Class A; CNS14336-1
• Australia/New Zealand AS/NZS CISPR 22, Class A; AS/NZS 60950.1
• Korea KN22, Class A, KN24
• Russia/GOST ME01, IEC-60950-1, GOST R 51318.22, and GOST R 51318.24,
• GOST R 51317.3.2, GOST R 51317.3.3
• IEC 60950-1 (CB Certificate and CB Test Report)
• CE Mark (EN55022 Class A, EN60950-1, EN55024, and EN61000-3-2,
• EN61000-3-3)
• CISPR 22, Class A
• TUV-GS (EN60950-1/IEC 60950-1, and EK1-ITB2000)

The system has a three-year customer-replaceable unit (CRU) and onsite (for field-replaceable units (FRUs) only) limited warranty with standard call center support during normal business hours and 9x5 Next Business Day Parts Delivered.

Also available are Lenovo Services warranty maintenance upgrades and post-warranty maintenance agreements, with a predefined scope of services, including service hours, response time, term of service, and service agreement terms and conditions.

Lenovo warranty service upgrade offerings are region-specific. Not all warranty service upgrades are available in every region. For more information about Lenovo warranty service upgrade offerings that are available in your region, go to the Data Center Advisor and Configurator website http://dcsc.lenovo.com, then do the following:

1. In the Customize a Model box in the middle of the page, select the Services option in the Customization Option dropdown menu
2. Enter the machine type & model of the system
3. From the search results, you can click either Deployment Services or Support Services to view the offerings

The following table explains warranty service definitions in more detail.

The following Lenovo warranty service upgrades are available:

• Warranty and maintenance service upgrades:
  • Three, four, or five years of 9x5 or 24x7 service coverage
  • Parts delivered or technician installed parts from next business day to 4 or 2 hours
  • Committed repair service
  • Warranty extension of up to 5 years
  • Post warranty extensions
• Committed Repair Service

  Committed Repair Services enhances the level of Warranty Service Upgrade or Post Warranty/Maintenance Service offering associated with the selected systems. Offerings vary and are available in select countries.

  • Priority handling to meet defined time frames to restore the failing machine to good working condition
  • 24x7x6 committed repair: Service performed 24 hours per day, 7 days per week, within 6 hours
• YourDrive YourData

  Lenovo’s YourDrive YourData service is a multi-drive retention offering that ensures your data is always under your control, regardless of the number of drives that are installed in your Lenovo server. In the unlikely event of a drive failure, you retain possession of your drive while Lenovo replaces the failed drive part. Your data stays safely on your premises, in your hands. The YourDrive YourData service can be purchased in convenient bundles with Lenovo warranty upgrades and extensions.

• Microcode Support

  Keeping microcode current helps prevent hardware failures and security exposure. There are two levels of service: analysis of the installed base and analysis and update where required. Offerings vary by region and can be bundled with other warranty upgrades and extensions.

• Enterprise Software Support

  Lenovo Enterprise Server Software Support can help you troubleshoot your entire server software stack. Choose support for server operating systems from Microsoft, Red Hat, SUSE, and VMware; Microsoft server applications; or both operating systems and applications. Support staff can help answer troubleshooting and diagnostic questions, address product compatibility and interoperability issues, isolate causes of problems, report defects to software vendors, and more.

  In addition, you can access hardware “how to” support for System x servers. Staff can help resolve hardware problems not covered under warranty, refer you to the right documentation and publications, provide corrective service information for known defects, and transfer you to a hardware support call center if needed.

• Hardware Installation Services

  Lenovo experts can seamlessly manage the physical installation of your server, storage, or networking hardware. Working at a time convenient for you (business hours or off shift), the technician will unpack and inspect the systems on your site, install options, mount in a rack cabinet, connect to power and network, check and update firmware to the latest levels, verify operation, and dispose of the packaging, allowing your team to focus on other priorities. Your new systems will be configured and ready for your software installation.

The NeXtScale n1200 WCT enclosure is supported in the following racks:

• 42U 1100 mm Enterprise V2 Deep Dynamic Rack
• 42U 1100 mm Dynamic Enterprise V2 Expansion Rack

For more information, see the list of Lenovo Press Product Guides in the Rack cabinets and options category:
http://lenovopress.com/systemx/rack

The following table lists the supported KVM consoles, keyboards, and KVM switches.

For more information, see the list of Product Guides in the KVM Switches and Consoles category:
http://lenovopress.com/servers/options/kvm

The server supports the top-of-rack Ethernet switches that are listed in the following table.

Table 14. Top-of-rack switches

For more information, see the list of Product Guides in the Top-of-rack switches categories:

• 1 Gb Ethernet switches: http://lenovopress.com/networking/tor/1gb?rt=product-guide
• 10 Gb Ethernet switches: http://lenovopress.com/networking/tor/10gb?rt=product-guide
• 40 Gb Ethernet switches: http://lenovopress.com/networking/tor/40gb?rt=product-guide

Additional edge switches are offered as part of the Intelligent Cluster™ program, as listed in the following table.

Table 15. Switches in the Intelligent Cluster program

The following table lists the uninterruptible power supply (UPS) units that are offered by Lenovo.

† Only available in China and the Asia Pacific market.

For more information, see the list of Product Guides in the UPS category:
https://lenovopress.com/servers/options/ups

The following table lists the power distribution units (PDUs) that are offered by Lenovo.

For more information, see the Lenovo Press documents in the PDU category:
https://lenovopress.com/servers/options/pdu

Lenovo Financial Services reinforces Lenovo’s commitment to deliver pioneering products and services that are recognized for their quality, excellence, and trustworthiness. Lenovo Financial Services offers financing solutions and services that complement your technology solution anywhere in the world.

We are dedicated to delivering a positive finance experience for customers like you who want to maximize your purchase power by obtaining the technology you need today, protect against technology obsolescence, and preserve your capital for other uses.

We work with businesses, non-profit organizations, governments and educational institutions to finance their entire technology solution. We focus on making it easy to do business with us. Our highly experienced team of finance professionals operates in a work culture that emphasizes the importance of providing outstanding customer service. Our systems, processes and flexible policies support our goal of providing customers with a positive experience.

We finance your entire solution. Unlike others, we allow you to bundle everything you need from hardware and software to service contracts, installation costs, training fees, and sales tax. If you decide weeks or months later to add to your solution, we can consolidate everything into a single invoice.

Our Premier Client services provide large accounts with special handling services to ensure these complex transactions are serviced properly. As a premier client, you have a dedicated finance specialist who manages your account through its life, from first invoice through asset return or purchase. This specialist develops an in-depth understanding of your invoice and payment requirements. For you, this dedication provides a high-quality, easy, and positive financing experience.

For more information, see these resources:

• NeXtScale System home page
  https://www3.lenovo.com/us/en/data-center/servers/high-density/NeXtScale-System-M5/p/77XS7DS7D11
• NeXtScale nx360 M5 WCT and n1200 WCT Installation and Service Guide
  https://support.lenovo.com/docs/UM103548
• Power Configurator
  https://support.lenovo.com/documents/LNVO-PWRCONF
• Power planning documents
  https://support.lenovo.com/documents/LNVO-POWINF
• xREF - System x Reference
  http://lenovopress.com/xref