Power8 hardware technical deep dive workshop

POWER8 Hardware Enhancements and
Update
July 9, 2014

Student Guide & Workshop & Internal Training & Confidential Update Daily
https://goo.gl/VVmVZ0
© 2014 International Business Machines Corporation 2
Competitive Positioning Power vs. Oracle Systems 2 http://ouo.io/DH476
Competitive Positioning Power vs. Oracle Systems 1 http://ouo.io/HpEK0
KVM on Power -- Open Virtualization Choice for Linux http://ouo.io/sSB89
Power Hardware and System Software Announcement Overview http://ouo.io/8rqfXm
Power Systems Management - PowerVC http://ouo.io/A0clE
POWER8 Hardware Announcements and Enhancements 1 http://ouo.io/Lvy0At
POWER8 Hardware Announcements and Enhancements 2 http://ouo.io/m6Zoj9
POWER8 Hardware Deep Dive Technical Presentation http://ouo.io/hyAP3P
POWER8 Hardware Enhancements and Update http://ouo.io/M41Xh
POWER8 Proof-of-Technology http://ouo.io/mF5Kh
Virtualization differences of Power VM, Power KVM and VMware http://ouo.io/KfLNVM
Win the Battle Against x86! Arm Yourself with the IBM POWER8 Playbook http://ouo.io/hRoW6

Agenda
Power S814 July Announcement Edward Liu
POWER8 Processor and I/O Enhancements Mark Olson
Corsa and FPGA Overview Robert Sherwood
IBM Rackswitches – MTM Transitions Pramodh Mallipatna
3© 2014 International Business Machines Corporation

POWER S814 July Announcement
Revolutionizing how IT is created and consumed
Edward Liu
Offering Manager

5
Power Systems
S822L
Power Systems
S812L
•1-socket, 2U
•Up to 12 cores POWER 8
•512 GB memory
•6 PCI Gen3 siot
•Linux only
•Up to One CAPI support
•PowerVM or PowerKVM
•2-socket, 2U
•Up to 24 cores POWER8
•1 TB memory
•9 PCI Gen3 slot
•Linux only
•Up to 2 CAPI support
•PowerVM or PowerKVM
•2-socket, 2U
•1 TB memory
•9 PCIe Gen 3
•AIX & Linux
•PowerVM
Power Systems
S822
1 & 2 Sockets
Power Systems
S814
•1-socket, 4U
•512 GB memory
•7 PCIe Gen 3
•AIX, IBM i, Linux
•PowerVM
Power Systems
S824
Power Systems: Innovation to put data to work
•2-socket, 4U
•1 TB memory
•11 PCIe Gen 3
•AIX, IBM i, Linux
•PowerVM
POWER Scale-out Systems - Created for New Workloads &
Enhanced Core Values
 Provide efficient consolidation of business workloads
 Designed for demanding environments where uptime is
critical and downtime is costly
 Deliver a higher value, more secure, and more reliable
platform than competitors
• Processor and Memory
– Up to 12-core POWER8 processor card
– Up to 8 Simultaneous Multi Thread per core
– Transactional Memory
– Java Code Optimization w/HW Assist
• I/O innovation
– PCIe Gen3
– Coherent Accelerator Processor Interface
• RAS
– RAID 0, 5, 6, 10 in the base
– Concurrent maintenance PCIe Gen3 slots
– Standard redundant power/cooling
New
4-core
© 2014 International Business Machines Corporation

6
The New 4-core Power S814
• 1 socket, 4 EIA units with 4, 6
or 8 core processor card, 16-
512GB memory
• Standard, split, and high perf
RAID backplanes
•PowerVM virtualization
•AIX, IBM i, RHEL, SUSE OS
Highlights
• Highly secure and scalable architecture providing a stable
database and middleware platform for efficient deployment of
business processing and mission critical applications
• Ideal for mid-sized business customers consolidating UNIX, IBM i
and Linux workloads
•The new Power S814 4-core POWER8 processor offering with IBM i
P05 pricing tier ( while S814 6-core and 8-core with IBM i P10
pricing tier ), small tier AIX and Linux pricing as roadmap to 4-core
Power 720 and address market low cost pricing requirement.

Include IBM i Solution Edition and CBU support

Limited I/O support

no feature code I/O drawers like #5887 and no
future PCIe expansion drawer. (Fibre Channel
attached drawers/SANs supported.)

Max of 8 (June) or 10 (July) storage bays

Support only HHD 139G & 283G and SSD 387G
drives (#ELDT and #ELDU available at July 25th)
Open Technology Server for
mid-sized business solutions

7
POWER 720 and
Power S814
Power 720 Power S814
Processor Offerings
POWER 7
4-core 3.6 GHz
6-core 3.6 GHz
8 core 3.6 GHz
POWER8
4-core and 6-core 3.02 GHz
8-core 3.72 GHz ( Rack only)
Memory Features
8 / 16 / 32 / 64GB DDR2
8 to 512GB
4-core (16GB DDR3 max 64GB )
6-or 8-core (16 / 32 / 64GB DDR3)
16 to 512GB
OS Support
AIX V7.1, V6.1
IBM i 6.1. 7.1, 7.2
Linux RHEL 6.4,
SLES 11 SP2
AIX V7.1, V6.1
IBM i 7.1, 7.2
Linux RHEL 6.5, 7
SLES 11
HDD/SSD Bays in system unit
HDD/SSD Bays in system unit
Standard 6SFF or 8 SFF
4-core: 8SFF
6 -or 8-core :Standard: 12 SFF or
18 SFF
PCIe Slots
(low profile)
Ten Gen2 slots:
Five x8, One x4 and 4 LP x8*
Np Hot swap
No CAPI capable
Seven Gen3 slots:
Two x16 and Five x8 (one x8 PCIe slot must
contain a 4-port 1Gb Ethernet LAN)
Hot swap
CAPI capable – max 1
Integrated
SAS Controller
Standard: JBOD, RAID 0,1,10
Optional: 175MB cache & RAID 5 & 6
Standard JBOD, RAID 0,5,6,10
Optional: 7200MB#
cache
& Easy Tier function
Ethernet Adapter
In one PCIe Slot
Quad 10/100/1000 Quad 10/100/1000
PCIe I/O Drawers Max 2 PCIe Gen1 Drawers n/a (SOD Gen3)
Storage Drawer Max 14 EXP24S 6-or 8-core only: Max 24 EXP24S
Electrical Power
Tower : 100 to 127AV or
200V to 240V AC
Rack 200V to 240V AC
Tower : 100 to 127V AC or
200V to 240V AC
Rack 200V to 240V AC
Redundant Power and Cooling Optional Standard
EnergyScale
Active Thermal Power Management
Dynamic Energy Save & Capping
Warranty 3 Years
# 1.8GB write cache with compression up to 7.2 GB effective
* 4 LP slots required optional PCIe raiser card which takes a GX++ slot
• Highly secure and scalable
architecture providing a stable
database and middleware platform
for efficient deployment of
business processing and mission
critical applications
• Ideal for mid-sized business
customers consolidating UNIX, IBM
i and Linux workloads

8
S814 list price summary
* Due to the memory module limitation of 4-core configuration, 2x16GB RAM price is higher than 32GB
+20%
+39%

POWER8 Processor and I/O Enhancements
Mark Olson
Power Systems WW Product
Management

4-core S814

4-core 1S4U Scale-out System (June)
Power S814
 Form Factor: 4U or Tower
 Single Socket
 Cores: 4 (3.0 GHz)
 Memory: Up to 64 GB
 Slots: 7 PCIe Gen3 Full-high (Hotplug)
 Ethernet: 4-port 1 Gbt in PCIe slot
 Integrated ports: USB (4/5), Serial (1), HMC (2)
 Internal Storage
 DVD
 8 SFF Bays * -- Split Backplane: 4 + 4
 or 8 SFF Bays * with Easy Tier with 7GB write cache
 Hypervisor: PowerVM
 OS: AIX, IBM i (P05 software tier), Linux
3 Yr Warranty
* Physically 12 bays or 18 bays are present, but usage of a max of 8 drives (SSD or HDD or mix) is supported,
Note 10 June announcement was for 8 drives and 15 July announcement increased to 10 drives.

4-core 1S4U Scale-out System (July)
Power S814
 Form Factor: 4U or Tower
 Single Socket
 Cores: 4 (3.0 GHz)
 Memory: Up to 64 GB
 Slots: 7 PCIe Gen3 Full-high (Hotplug)
 Ethernet: 4-port 1 Gbt or 2-port 10/1 Gbt in PCIe slot
 Integrated ports: USB (4/5), Serial (1), HMC (2)
 Internal Storage
 DVD
 10 SFF Bays * -- Split Backplane: 5 + 5
 or 10 SFF Bays * with Easy Tier with 7GB write cache
 Hypervisor: PowerVM
 OS: AIX, IBM i (P05 software tier), Linux
3 Yr Warranty
* Physically 12 bays or 18 bays are present, but usage of a max of 10 drives (SSD or HDD or mix) is supported,
Note 10 June announcement was for 8 drives and 15 July announcement increased to 10 drives.
Also not split back plane can also be split 4+6 as well as 5+5

4-Core Power S814
Four-core server for AIX, IBM i and Linux.
 Especially interesting to IBM i clients because of its P05 software tier
 3 GHz cores
 Like the POWER7 4-core offering – no feature code I/O drawers like #5887 and
no future PCIe expansion drawer. (Fibre Channel attached drawers/SANs
supported.)
 Like the POWER7 4-core – 64GB memory maximum. 4-core POWER8 uses only
16GB memory features
 Max of ten SFF-3 drives in system unit (SSD or disk or mix) -- POWER7 4-core
maximum is eight. POWER8 4-core is 25% more drives as of July.
 Supports 15k 139/146GB and 15k 283/300GB disk drives and supporting 387GB
SSD. Not supporting other drive sizes.
4-core S814 offers better price/performance than 4-core 720 and higher function, but
the absolute price of S814 4-core option higher than 720 4-core

Power 720 Power System S814
Processor POWER7+ POWER8
Sockets 1 1
Cores 4 4
Maximum Memory* 64 GB @ 1066 MHz 64 GB @ 1600 MHz
Memory Cache No Yes
Memory DRAM Spare No Yes
System unit PCIe slots 6 PCIe Gen2 FH
Opt 4 PCIe Gen2 LP 7 PCIe Gen3 FH
PCIe Hot Plug Support No Yes
Ethernet ports in required
PCIe adapter 4-port 1 Gbt (in x4 slot)
4-port 1 Gbt (x8 Slot)
or
2-port 10/1 Gbt (x8 slot) *
SAS bays in system unit 6 or 8 SFF-1 bays 10** SFF-3 bays
Integrated write cache Optional 175 MB Optional effectively 7GB
Easy Tier Support No (IBM i can use OS integrated capability) Yes (AIX/Linux) IBM i can use OS
integrated capability
Integrated split backplane* Yes ( 3 + 3 ) But not supported
by IBM i
Yes ( 5 + 5 ) note zero write
cache for SAS controller
Bay for SAS tape drive in
System unit 1 HH bay No HH bay
4U Scale-out Comparison – 4-core
* with latest microcode level in adapter available late August
** Physically more than 10 SAS bays, but a max of 10 drives (July) supported. Could split 4+6 if desired.

CPW
S824 (1 or 2 socket)
 6-core 3.8 GHz 72,000
 12-core 3.8 GHz 130,000
 8-core 4.1 GHz 94,500
 16-core 4.1 GHz 173,500
 12-core 1-socket not offered
 24-core 3.5 GHz 230,500
S814 (1 socket)
 4-core 3.0 GHz 39,500
 6-core 3.0 GHz 59,500
 8-core 3.7 GHz 85,500
740 POWER7+ (1 or 2 socket)
 6-core 4.2 GHz 49,000
 12-core 4.2 GHz 91,700
 8-core 3.6 GHz 56,300
 16-core 3.6 GHz 106,500
 8-core 4.2 GHz 64,500
 16-core 4.2 GHz 120,000
720 POWER7+ (1 socket)
 4-core 3.6 GHz 28,400
 6-core 3.6 GHz 42,400
 8-core 3.6 GHz 56,300
+40%

rPerf (with SMT8)
 6-core 3.8 GHz 120.8
 12-core 3.8 GHz 235.6
 8-core 4.1 GHz 166.0
 16-core 4.1 GHz 323.6
 12-core 1-socket not offered
 24-core 3.5 GHz 421.8
S814 (1 socket)
 4-core 3.0 GHz 66.9
 6-core 3.0 GHz 97.5
 8-core 3.7 GHz 143.9
 6-core 3.8 GHz 120.8
 12-core 3.8 GHz 235.6
 10-core 3.4 GHz 177.8
 20-core 3.4 GHz 346.7

Processor Activation Features
S814 S824 S822 S812L S822L
8286-41A 8286-42A 8284-22A 8247-21L 8247-22L
Processor DCM
Charge activate
No-charge activate
#EPXK
4c 3.02 GHz
#EPYK
#EPZK
#EPXE
6c 3.89 GHz
#EPYE
-
#EPX1
6c 3.89 GHz
#EPY1
-
#ELPD
10c 3.42 GHz
--
#ELAD
#ELPD
10c 3.42 GHz
--
#ELAD
Processor DCM
Charge activate
No-charge activate
#EPX0
6c 3.02 GHz
#EPY0
#EPZ0
#EPXF
8c 4.15 GHz
#EPYF
-
#EPXD
10c 3.42 GHz
#EPYD
-
#ELP3
12c 3.02 GHz
--
#ELA3
#ELP4
12c 3.02 GHz
--
#ELA4
Processor DCM
Charge activate
No-charge activate
#EPX6
8c 3.72 GHZ
#EPY6
#EPZ6
#EPXH
12c 3.52 GHz
#EPYH
-
100% of processor cores are activated.
No-charge activations used with IBM i solution editions or with Linux-only models
#2319 factory deconfiguration is supported.
New 10 June

IBM i Solution Editions
Prices are USA suggested list prices and are subject to change without notice. Reseller prices may vary.
#4927
For qualified sales of new servers with participating ISVs
Minimum size deal required
Registration/Approval of deal required prior to installation
6-core or 8-core Power 8S14
• 5 no charge processor core
activations
• IBM i users @ only $70
• 1 IBM Service voucher
• Unlimited users for IBM i Access
Family
• Reduced price development tools
#4928
4-core Power 8S14
• 3 no charge processor core
activations
• IBM i users @ only $70
• 1 IBM Service voucher
• Unlimited users for IBM i Access
Family
• Reduced price development tools
New 10 June
Same as for POWER7+

CBU for i -- Power S814
Offering for IBM i
HA/DR
environments
Prerequisites
New server order
Primary server must be a POWER7 720, 740, 750 or
POWER8 S814, S824 with equal or higher IBM i
software tier.
Must purchase minimum of one IBM i processor
license entitlement for new CBU server
Registration of primary system and CBU is required
prior to CBU order being manufactured
#0444
Primary for 6/8-core (P10) = Power 720,
740, 750, S824 or S814 (a P10 or P20)
-----------------------------------------
Primary for 4-core (P05) = Power 720,
S814 ( a P05 or P10 )
IBM i processor license
entitlement
IBM i user entitlements
Offering Advantages
Temporary transfer of unused IBM i
processor license entitlement
from primary to CBU server
Temporary transfer of unused IBM i
user license entitlements
Note: no lower-priced hardware or lower
priced IBM i licensing – savings is in
transferability. Can not transfer user
entitlements from primary servers
which have no user entitlements.
Temporary transfers
CBU Power S814
See S814 sales manual for more details
New 10 June
Same as for POWER7+ except
no POWER6 as primary

Memory Card for 4-core Power S814
Card capacity: 16 GB … feature code #EM8B
(no other memory features supported on 4-core)
Up to 4 Cards --- Max 64GB
1600 MHz
Memory Sparing - RAS improvement vs POWER7+
Plugs into backplane (no riser card)
4-core usage announced 10 June

4-core S814 Storage Backplanes
Op-panel
DVD
Backplanes provide
 High performance integrated SAS controller(s) built on IBM industry
leading PCIe Gen3 SAS adapter technology
 All include RAID 0, 1, 5, 6, 10. Plus hot spare capability
 Split backplane option with zero-write cache controllers
Make sure performance ok without write cache
 Easy Tier® function* (AIX/Linux)
 10** SAS bays for 2.5-inch (SFF) HDD or SSD
 One DVD bay
* With dual IOA, expanded function backplane with write cache for AIX/LInux
** Physically more SAS bays are present, but only 10 bays are supported
4-core announced 10 June with
full set of backplane features

Availability plan:
- eConfig 15 July
- GA Sept
4-core S814: 4U Storage Backplane Options
Must select one 
10* SFF SAS bays
1 SAS controller
No write cache
RAID-0,1,5,6,10
DVD bay
10* SFF SAS bays
Dual SAS controllers
7.2**GB cache
RAID-0,1,5,6,10
DVD bay
Easy Tier function
Base
Expanded
Function *
5+5* SFF SAS bays
2 SAS controllers
No write cache
RAID-0,1,5,6,10
DVD bay
Split
* Physically more than 10 SAS bays are present, but use of max of 10 are supported.
Also note the split backplane could be split 6+4 in addition to 5+5.
** 1.8GB physical write cache provides up to 7.2GB effectively with compression
4U server
Staged
availability
4-core announced 10 June

S814 / S824

PCIe Slots & Expanded Function Backplane for 4U
4U
1S 4U 2S 4U
Total PCIe slots
(all hot swap)
7 11
Required* LAN adapter (available for client
use) 1 1
PCIe slots after required* LAN adapter
6 10
However if use high performance,
expanded function backplane AND DECIDE
NOT TO USE #EJ0Z
6 without EJ0Z 10 without EJ0Z
PCIe slots after required* LAN and if using
high performance backplane 5 with EJ0Z 9 with EJ0Z
• PCIe slots are all Gen3 slots
• 4U are all full high
• There is no PCI expansion drawer announced. There is an SOD.
* required for IBM Manufacturing
July 2014 news:
optional #EJ0Z

General
Scale-out
server info

Additional Scale-out Server AIX Support
On August 29, 2014,
AIX 7.1 Technology Level (TL) 1 Service Pack (SP) 10, or later,
AIX 7.1 TL 2 SP 5, or later, AIX 6.1 TL 7 SP 10, or later, and
AIX 6.1 TL 8 SP 5, or later,
will extend support for the following IBM Power Systems:
 IBM Power System S822 Server (8284-22A)

Additional Scale-out Server VIOS Support
On August 29, 2014,
VIOS 2.2.2.5, or later, and
VIOS 2.2.1.9, or later
will extend support for the following IBM Power Systems:
IBM Power System S822 Server (8284-22A)
IBM Power System S812L Server (8247-21L)
IBM Power System S822L Server (8247-22L)

SOD for PCIe3 Expansion Drawers
The following information is not publically announced and
is shared only for sales planning purposes. If sharing
with clients, it needs to be under non-disclosure
 PCIe drawer for Scale-out server attachment is not planned for
2014 announce
 A drawer will connect to server using two x16 PCIe slots
Note this future drawer is for PCIe slots. The POWER8 servers already have support for
the EXP24S disk/SSD only drawer.
Unannounced and subject to change
Repeating information shared in April – no change

Dual port 10GBase-T RJ45 ports - Ethernet NIC traffic
Ports default to auto negotiate the highest speed:
10Gb (10GBaseT), 1Gb (1000BaseT) or 100Mb (100BaseT) full duplex.
Port's configuration are independent of the one other, but both ports owned
by one partitions or one VIOS
CAT-6A cabling supported
NIM/Linux Install support announced July 2014 (planned GA 29 Aug)
PCIe2 2-port 10/1GbE BaseT RJ45 Adapter
Supported on POWER8 Systems
Operating System support:
AIX 6.1 & AIX 7.1 or later
IBM i via VIOS
Linux
RHEL 6 or later
SLES 11 or later
PowerKVM Host
VIOS
#EN0W (FH) / #EN0X (LP)
CCIN 2CC4
Only $950
Plus inexpensive cabling
Prices are USA list prices and are subject to change. Reseller prices may vary.

PCIe2 4-Port (10Gb+1GbE) Copper SFP+RJ45 Adapter
#EN0V (FH) / #EN0U (LP)
CCIN 2CC3
IBM i via VIOS
Linux
RHEL 6 or later
SLES 11 or later
PowerKVM Host
VIOS
Quad ports: Two 10GbE Copper SFP+ optical Plus Two 1GbE RJ45
Ethernet NIC traffic
10Gb Copper SFP+ ports does not include transceiver – transceivers provided with active
twinax cables for up to 5m cable distance (Cables = #EN01, #EN02, #EN03)
RJ45 are 1Gb or 100Mb and use CAT-5 or CAT-6A UTP cabling
Port's configuration are independent of the one other, but all four ports owned by one
partitions or one VIOS
NIM/Linux install support announced July 2014 (planned GA 29 Aug)
Only $1200

PCIe2 4-Port (10Gb+1GbE) SR+RJ45 Adapter
#EN0S (FH) / #EN0T (LP)
CCIN 2CC3
IBM i via VIOS
Linux
RHEL 6 or later
SLES 11 or later
PowerKVM Host
VIOS
Quad ports: Two 10GbE SR optical Plus Two 1GbE RJ45
Ethernet NIC traffic
10Gb SR ports include optical transceiver for up to 100m cable distance
RJ45 are 1Gb or 100Mb and use CAT-5 or CAT-6A UTP cabling
Port's configuration are independent of the one other, but all four ports owned by one
partitions or one VIOS
NIM/Linux Install support announced July 2014 (planned GA 29 Aug)
Only $1600
SR transceivers not
shown in picture, but
would be included in
shipment

AIX NIM and Linux Network Install Support 29 August
Lack of current function fixed with microcode change to the three adapters:
 PCIe2 2-port 10/1GbE BaseT RJ45 Adapter
 PCIe2 4-Port (10Gb+1GbE) Copper SFP+RJ45 Adapter
 PCIe2 4-Port (10Gb+1GbE) SR+RJ45 Adapter
Fix planned to be available 29 August 2014
Newly shipped above adapters will have the fix loaded on the adapter by that
time (end August).
Already shipped adapters will need to have the clients download the fix from
IBM and apply to the adapter to gain the function
For PCIe2 4-Port (10Gb+1GbE) SR+RJ45 Adapter (#EN0S, #EN0T) and
PCIe2 4-Port (10Gb+1GbE) SFP+ Copper+RJ45 Adapter (#EN0U, #EN0V)
the latest level of adapter microcode, level 20100130, or later, is required.
For PCIe2 LP 2-port 10/1GbE BaseT RJ45 Adapter (#EN0W, #EN0X, and
#EL3Z) the latest level of adapter microcode, level 30080130, or later is
required.
For download: http://www-933.ibm.com/eserver/support/fixes/fixcentral

Additional Config Option for “base” Ethernet
For Scale-out servers:
Before July annc: Must include a 4-port 1Gb Ethernet Adapter (#5899 or #5260)
After July annc with 29 Aug 29 ship dates
 For AIX/Linux/VIOS: Must include either one 4-port 1Gb Ethernet adapter
(#5899/5260) or one 2-port 10/1Gb Ethernet adapter (#EN0W, #EN0X, #EL3Z)
 For IBM i: no change, must include a 4-port 1Gb Ethernet Adapter (#5899 or #5260)
(#EN0W IBM i support through VIOS, can not be LAN console)
4-port 1Gb 2-port 10/1Gb
Feat code #5899, 5260 #EN0W, EN0X, EL3Z
NIC 1Gb 10GBase-T
speed 1Gb or 100Mb or 10Mb 10Gb or 1Gb or 100Mb
NIM, Linux install Yes Yes *
ports RJ45 RJ45
cabling CAT5/6 CAT6A
List price on S814/S822 $315 $950
USA list prices. Subject to change without notice. Reseller prices may vary.
* with latest fixes planned 29 August

#5289/5290 2-port Async Adapter Update
 The above adapter was announced as supported in the April 2014
announcement. However in mid May, testing found a problem which
requires the adapter to not be supported on POWER8 servers. (The
problem is an adapter problem, but the problem fortunately does not occur
when used in the POWER6/7/7+ servers or their I/O drawers.)
 As a result we will not be shipping any POWER8 servers which have a
#5289/5290 adapter in their configuration and we will be removing
#5289/#5290 from the POWER8 product structure. eConfig will be updated
as soon as possible, but as of today still shows these adapters as valid
options.
 If you have a POWER8 proposal which uses one of these adapters, you
should re-run the configuration without the adapter. No change is required for
POWER6/7/7+ servers.
 We are working to replace #5289/5290 with a future similar product, but it’s
not ready to announce as of June.
 Interim to that future product, if you need async ports:
 For AIX/LInux ... The 4-port Async card #5785/#5277 is was announced/supported
on the POWER8 on 10 June.
 For IBM i ... The #2893/2894 communications adapter was always supported, but
was made orderable for the POWER8 server on 10 June. If IBM i 7.2, consider a
WAN over LAN option.
As of 13 June
July announce:
#EN27/#EN28 2-port Async Adapter announced
Equivalent to #5289/5290 – same function, same everything
(except is supported on POWER8 servers)
#EN27/EN28 support not announced on POWER7/POWER7+
servers. Continue to use #5289/5290 on POWER7+ servers

CNA = Converged Network Adapter
 Fibre Channel over Ethernet (FCoE) and NIC traffic simultaneously
 NIC = Network Interface Card
 “Like 3 cards in one” …
 A 2-port 10Gb Ethernet NIC card
 A 2-port 8Gb Fibre Channel Card
 A 2-port 1Gb Ethernet NIC card
 Save by buying one card vs 2 or 3 cards – lower price
 Save up 2 PCIe slots … 66% reduction !!!
4-port 10GbE CNA (NIC/FCoE) & 1GbE Adapter
#EN0M – full high
#EN0N – low profile
2 ports 10GbE CNA
2 ports 1GbE NIC only
For POWER8 Scale-out server
10Gb optical Fibre LR ports
New 15 July 2014
Long Range optical fibre
Very similar to
#EN0H/EN0J/EL3B – optical SR
#EN0K/EN0L/EL3C – copper twinax
LR = long range optical fiber
Up to 10 km (NIC)
Not announced on POWER7+ servers
Max 300m if using FCoE
Transceiver included in #EN0M/EN0N

POWER8 PCIe Adapters Adds: June 2014
June Additions
Communications 2-port Async/Bisync (IBM i) #2893, #2894 Add orderable
Communications 4-port Async (AIX / Linux) #5277, #5785 Add support & order
Graphics 3D graphics for RHEL7 #EC42, #EC41 Linux REH7 only

POWER8 PCIe Adapters Adds: July 2014
July Additions
Ethernet NIC 2-port 1GbE RJ45 #5767, #5281
Ethernet NIC 2-port 1GbE SX optical #5768, #5274
Ethernet NIC 4-port 1Gbe RJ45 #5717, #5271
Ethernet NIC 1-port 10GbE SR optical #5769, #5275
Ethernet NIC & FCoE 2-port 10GbE SR optical #5708, #5270
Ethernet NIC & FCoE 4-port 10GbE+1GbE Copper Twinax+RJ45 #EN0K, #EN0L, #EL3C
Ethernet NIC & FCoE 4-port 10GbE+1GbE LR+RJ45 #EN0M, #EN0N NEW adapter
Ethernet NIC & RoCE 2-port 10GbE Copper twinax #EC28, #EC27, #EL27
Fibre Channel 2-port 4Gb #5774, #5276, #EL09
SAS RAID 2-port 380MB cache PCIe1 HDD/SSD #5805 Add support only
SAS RAID 3-port large cache PCIe2 HDD/SSD #5913 Add support only
SAS RAID 3-port large cache PCIe2 HDD/SSD #ESA3 Add support only
Communications 2-port Async (AIX / IBM i / Linux ) #EN27, #EN28
NEW
Replace 5289/5290

POWER8 PCIe Adapters Adds: June/July 2014
June Additions
Communications 2-port Async/Bisync (IBM i) #2893, #2894 Add orderable
Communications 4-port Async (AIX / Linux) #5277, #5785 Add support & order
Graphics 3D graphics for RHEL7 #EC42, #EC41 Linux REH7 only
July Additions
Ethernet NIC & FCoE 4-port 10GbE+1GbE LR+RJ45 #EN0M, #EN0N NEW adapter
SAS RAID 2-port 380MB cache PCIe1 HDD/SSD #5805 Add support only
SAS RAID 3-port large cache PCIe2 HDD/SSD #5913 Add support only
SAS RAID 3-port large cache PCIe2 HDD/SSD #ESA3 Add support only
Communications 2-port Async (AIX / IBM i / Linux ) #EN27, #EN28
NEW
Replace 5289/5290

POWER8 PCIe Adapters as of July (page 1)
Ethernet NIC 2-port 10GbE 10GBase-T RJ45 #EN0W, #EN0X, #EL3Z
Ethernet NIC & FCoE (CNA) 4-port 10GbE+1GbE SR+RJ45 #EN0H, #EN0J, #EL3B
Ethernet NIC 4-port 10GbE+1GbE SR optical #EN0S, #EN0T
Ethernet NIC 4-port 10GbE+1GbE Copper twinax #EN0U, #EN0V
Ethernet NIC & RoCE 2-port 10GbE SR optical #EC29, #EC30, #EL2Z
Ethernet NIC 2-port 10GbE SR optical iSCSI TOE #5744, #5280
Ethernet NIC 2-port 10GbE SR optical #5284, #5287, #EL2P
Ethernet NIC 1-port 10GbE LR optical (IBM i native) #5772
Ethernet NIC & OpenOnload 2-port 10GbE Copper twinax #EL39, #EC2J, #EC2G
Ethernet NIC & RoCE 2-port 40GbE QSFP+ #EC3A, #EC3B
Ethernet NIC & FCoE 4-port 10GbE+1GbE LR+RJ45 #EN0M, #EN0N
w/ NIM
w/ NIM
w/ NIM
* Late change to drop. See details in following chart
Jul

Fibre Channel 2-port 8Gb #5735, #5273, #EL2N
Fibre Channel 4-port 8Gb (FH) #5729
Fibre Channel 4-port 8Gb (LP) #EN0Y
Fibre Channel 2-port 16Gb #EN0A, #EN0B
Communications 1-port Bisync (IBM i) #EN13, #EN14
Communications 2-port Async/Bisync (IBM i) #2893, #2894
Communications 4-port Async (AIX / Linux) #5277, #5785
Communications 2-port Async RS232 5289/5290 replace #EN27, #EN28
SAS RAID 4-port no-cache PCIe3 for SSD/HDD #EJ0J, #EJ0M, #EL3B
SAS Tape/DVD 4-port tape/DVD PCIe3 #EJ10, #EJ11, #EL60
SAS RAID 4-port huge-cache PCIe3 for SSD/HDD #EJ0L
SAS RAID/Tape/DVD 2-port no-cache PCIe1 for HDD #5901, #5278, #EL10
SAS RAID 2-port 380MB cache PCIe1 HDD/SSD #5805
SAS RAID 3-port large cache PCIe2 HDD/SSD #5913
SAS RAID 3-port large cache PCIe2 HDD/SSD #ESA3
Jun
Jul
Jul
Jul

Infiniband (IB) 2-port QDR IB SR optical #5285, #5283
Graphics 2D graphics for general use #5748, #5269
Graphics 3D graphics for RHEL7 #EC42, #EC41
Encryption Crypto Coprocessor 4765-001 #4807
USB 4-port USB-3 #EC45, #EC46
Programmable FPGA PCIe3 FPGA Accelerator #EJ12, #EJ13
Jun

PCIe Adapters NOT Supported: July 2014
Ethernet NIC 2-port 10GbE copper twinax #5288, #5286 old
Ethernet NIC 1-port 10GbE CX4 #5732, #5272 Old
Ethernet NIC 4-port 10GbE+1GbE Copper twinax+ RJ45 #5745, #5279 Old
Ethernet NIC 2-port 10GbE Copper twinax #EL3A, #EC2K, #EC2H Use OpenOnload
Fibre Channel 1-port 4Gb #5773
Old, use 8Gb or if
must, use 2-port 4Gb
Communications 2-port Async RS232 5/2014 add to list #5289, #5290 Use EN27/EN28
SAS RAID 2-port 380MB cache PCIe1 HDD/SSD #5903
Use PCIe3, or use
#59805 if you must
SAS RAID 2-port zero cache PCIe2 SSD #ESA1, #ESA2, #EL2K Use PCIe3 EJ0J/M
USB 4-port USB-2 #2728 Old, use USB-3
SSD on PCIe card 4-slot 1.8-inch SSD on SAS adapter #2053, #2054, 2055 Use controller in
storage backplaneFlash on card Flash Adapter 90 #ES09
Much shorter list of “not supported” adapters now

Integrated Ports on the System Unit
No port feature codes (except 4U SAS ports) 4U 2U
USB-3 with full client usage
2 front
2 rear
2 front,
2 rear
USB-2 primarily IBM use, limited client use supported*.
Ports off Service Processor card 2* rear 2 rear
HMC ports - 1Gb Ethernet RJ45 2 rear 2 rear
Serial / System port - RJ45 ** 1 rear 1 rear
2 SAS ports with high performance, dual IOA controller
storage backplane on 2-socket servers – can attach one
EXP24S drawer
2 rear
Mandatory #EJ0Z
feature. Ports take a
PCIe slot
2 rear
No feat code. Ports
do not take a PCIe
slot
* For IBM i Unlike POWER7 or POWER6, IBM i communication to UPS is NOT via the serial port on POWER8
server. POWER8 connection to UPS for IBM i is over the USB-2 ports off the service processor card. A
converter cable #ECCF should be used to convert USB port to 9-pin D-Shell connector which can be connected to
the UPS cable. The cable can be attached after the server is powered up and running. Once the cable is plugged
in, the service processor to which the USB-2 ports are attached senses the cable and its integrated cable type ID
information and then sets the USB-2 port up for UPS communications.
** For AIX/Linux For attaching serial devices like a Async console which doesn’t have a RJ45 interface. Just
like on POWER7/POWER7+, use #3930 converter cable to provide a 9-pin D-Shell connector.
Depending on country, #ECCF availability varies

ECCF Cable Details
Late breaking news in late May 2014. Testing/approvals by different certification organizations
around the world for the #ECCF cable didl not support a 10 June 2014 GA. Functionally the cable
has been tested and is ready for GA. However, cables have to be approved by different
organizations with different standards around the world. We project to have
certifications/approvals in place for this cable on the following schedule.
18 June Canada/USA
25 June Australia/Japan
9 July European Union
16 July remainder of the world except Korea/Taiwan
6 Aug Korea/Taiwan
The above projections are our current best estimates and are subject to change.
The UPS communication does NOT impact the ability of a 9910 UPS to provide power to the server.
But the cable allows status information to be provided to the , the server, alerting it to the fact its
electrical power is coming from a UPS. Assuming you‘ve set up your server to do so, it can more
gracefully shut down if the UPS batteries are running out before regular power sources are
restored. This is the only UPS communication mechanism for IBM i. AIX/Linux can alternatively
implement an Ethernet-based option where UPS-provided appliction code runs on the server and
talks to the UPS.
The cable can be attached without booting the server.

POWER7+
EXP30 Ultra
Drawer

SSD Refreshed in EXP30 Ultra Drawer
New 1.8-inch SSD feature codes: #ES0J/ES0K and #ESRJ/ESRK
New CCIN 59BE
Same 387GB capacity as existing SSD features
Newer eMLC3 technology, a little faster than eMLC2 SSD (#ES02/ES04)
Almost 20% LOWER LIST PRICE than eMLC2 1.8-inch SSD
Can intermix eMLC2 and eMLC3 SSD in the same EXP30 drawer (#EDR1
or #5888) and can mix in the same array
Differs physically from previous features. New features require a carrier
#EB2W to fit into EXP30 bay. Each SSD needs one carrier. Six pack
SSD features need six #EB2W. Previous SSD included a carrier already
NOT used in POWER8 servers
June 10 annc

Reminder:
the April 30th
hardware deepdive pitch on
Scale-out servers and other April content has
been updated w/ fixes & add’l content.
Do you have the “update4” version?
Posted on SSI / PartnerWorld
 IBMers: http://w3.ibm.com/sales/support/ShowDoc.wss?
docid=SGDF097039N48949N97&node=brands,B5000|brands,B5Y00|
clientset,IA (http://w3.ibm.com/sales/support/ShowDoc.wss?
docid=SGDF097039N48949N97&node=brands,B5000%7Cbrands,B5Y00%
7Cclientset,IA)
 IBM Business Partners:
http://www.ibm.com/partnerworld/wps/servlet/ContentHandler/SGDF0970
39N48949N97

Thanks !

Corsa and FPGA Overview
Robert Sherwood
Product Offering Manager, IBM

Corsa 5 A7
 Altera Stratix V PCIE Gen 3 card
 Supports both PCIe I/O & CAPI models
 Initial offering with Z gzip use case for JAVA
 Dual 10 GB (lower latency internal PHY)
 Not currently supported on Power
 8 GB DDR3 1600 SDRAM
 Full Card Level RAS
 Partial Reconfiguration
Attributes
 FPGA base accelerator card
 PCIe gen3 x8, ranges between 25W & 40W depending on application
 ~21W for gzip application
 Follows Altera Stratix roadmap
PCIe base I/O adaptor
 JAVA 7.1 gzip acceleration use case
 Single root I/O virtualization, 15 virtual functions
Future support for Power Server CAPI
 Coherent Accelerator Processor Interface
OS Support
 AIX 7.1
Software/Firmware Support
 eFW 8.1
RAS
 Evaluation in progress of existing device driver features
 This application not reprogammable by customers
Energy Efficiency / Power Management
 FPGA thermals are use-case dependent
Certifications
 FCC Class A
 Environmental Support TBD (pending compliance test)
 Acoustic Category – TBD (pending thermal eval)
Corsa PCI-E FPGA JAVA gzip adapter
PoC Ready May 2013, general use case
Transparent zlib HW acceleration integrated into JAVA 7.1
Driving PCIe Tuleta AIX attach 2Q14 JAVA use case
Future RPQ: Driving PCIe Tuleta RHEL 6.6 attach JAVA use case

Custom
Hardware
Application
POWER8
CAPP
Coherence Bus
PSL
FPGA or ASIC
Customizable Hardware
Application Accelerator
• Specific system SW, middleware, or user application
• Written to durable interface provided by PSL
POWER8
PCIe Gen 3
Transport for encapsulated messages
Processor Service Layer (PSL)
• Present robust, durable interfaces to applications
• Offload complexity / content from CAPP
Virtual Addressing
• Accelerator can work with same memory addresses that the
processors use
• Pointers de-referenced same as the host application
• Removes OS & device driver overhead
Hardware Managed Cache Coherence
• Enables the accelerator to participate in “Locks” as a normal
thread Lowers Latency over IO communication model
POWER8 CAPI (Coherent Accelerator Processor Interface)

Processor Enablement
CAPP
PCIe
Power Processor
CAPI over
PCIe
Coherently Attached
Device
 Coherent Attached Processor Proxy (CAPP) in processor
– Unit on processor that extends coherency to an attached device
– On processor directory responds on behalf of off-chip device
(Filtering snoops)
 Coherency protocol tunneled over standard PCIe
– Eliminates the need for special I/Os and protocol logic
• CAPI utilizes standard Posted Write and Non-posted Reads
– Reduces the complexity and bandwidth requirements of the
attached device
 Enables attached device to be a peer to the processor
– Simplifies programming model between application
– Enables device to use same effective address as application
running in processor
– Eliminates the cumbersome I/O Device Driver requirements
• Pinned memory not required

Coherent Accelerator Processor Interface (CAPI) Overview
CAPP PCIe
Power Processor
FPGA
Functionn
Function0
Function1
Function2
CAPI
IBM Supplied POWER
Service Layer
Typical I/O Model Flow
Flow with a Coherent Model
Shared Mem.
Notify Accelerator
Shared Mem.
Notify Accelerator AccelerationAcceleration Shared Memory
Completion
Shared Memory
Completion
DD CallDD Call Copy or Pin
Source Data
Copy or Pin
Source Data
MMIO Notify
Accelerator
MMIO Notify
Accelerator AccelerationAcceleration Poll / Int
Completion
Poll / Int
Completion
Copy or Unpin
Result Data
Copy or Unpin
Result Data
Ret. From DD
Completion
Ret. From DD
Completion
Advantages of Coherent Attachment Over I/O Attachment
 Virtual Addressing & Data Caching
– Shared Memory
– Lower latency for highly referenced data
 Easier, More Natural Programming Model
– Traditional thread level programming
– Long latency of I/O typically requires
restructuring of application
 Enables Applications Not Possible on I/O
– Pointer chasing, etc…
Actual feature(s)
Interface logic

IBM PowerLinux FPGA Development Kit (RPQ 8A2158)
• Provides a platform which allows programmers to develop OpenCL code which targets IBM
PowerLinux processors and accelerator cards with Altera FPGAs
• Utilizes the Nallatech “Power OpenCL Development Kit” PN: P385-A72-SYSP-01 with an IBM
PowerLinux 7R2.
• The Nallatech Power OpenCL Development Kit includes
- PCIe-385 Card PN: P385-A72-0813P-81 w/CCR (A7 Card)
- USB Blaster II (UB2) Development and debug Card PN NT101-0563-03
- Altera Quartus II DKE License
- Altera OpenCL SDK
- Altera provided Power Linux device driver
• The IBM PowerLinux FPGA Development Kit also includes 8 hours of on site IBM Lab Services
expertise
• The kit requires a separate purchase of an IBM PowerLinux 7R2 server (8246-L2D with 4.2GHz
processors)
• To order the IBM PowerLinux FPGA Development Kit
– Order the PowerLinux 7R2
– Order and Apply RPQ 8A2158 to the PowerLinux 7R2
– Order the Nallatech Power OpenCL Development Kit directly from Nallatech
– Call IBM Lab Services to schedule installation and set up.

IBM GZIP Acceleration Adapter (EJ13)
• Corsa card with GZIP compression/decompression
• Useful for customers running workloads which require frequent GZIP compression and
decompression such as WebSphere
• Customers running JAVA/Util/GZIP will also see significant performance improvements
• Feature is particularly effective for workloads requiring transfer of large buffers
• Utilizing this adapter can reduce both the storage requirements and congestion in a
customer’s environment
68
68

Field-Programmable Gate Arrays (FPGAs)
Hardware-back Java compression APIs
Work sent to custom card firmware rather than
the CPU.
Not only does it run faster on the card, but it
frees up the CPU to do other things.
Benchmarking Liberty Power Linux shows high
performance extensible log (HPEL) engine
writes compressed logs as quick as
uncompressed© 2014 International Business Machines Corporation 69

Store your Data - Power Data Compression and IBM Java 7R1
** IDC: The Digital Universe in 2020: Big Data, Bigger Digital Shadows, and Biggest Growth in the Far East
With IBM Java 7R1 :
Java application to compress files using java.util.zip.GZIPOutputStream class
Up to 91% reduction in CPU time using zEDC hardware versus zlib software
Up to 74% reduction in Elapsed time (not shown)
Compression ratio up-to ~5x
Every day over 2000 petabytes of data are created
• Between 2005 to 2020, the digital universe will grow by 300x, going
from 130 to 40,000 exa-bytes**
• 80% of world's data was created in last two years alone
(Controlled measurement environment, results may vary)
What is it?
 zEDC Express is an IO
adapter that does high
performance industry
standard compression
 Applications can use
zEDC via industry
standard APIs (zlib and
Java)
 Raw throughput up to 1 GB/s
per zEDC Express Hardware
Adapter
HW Exploit of FPGA Compression on POWER
70

IBM Rackswitches
MTM Transitions
Pramodh Mallipatna
Networking Products

7272
SND Switch OEM-out to Power - MTM Transitions
Name MTM Current MTM New
IBM RackSwitch G8264 1455-64C 7120-64C
IBM RackSwitch G8124E 1455-24E 7120-24E
IBM RackSwitch G8052 1455-48E 7120-48E
IBM RackSwitch G7028 1455-24L 7120-24L
IBM RackSwitch G8264T 1455-48T 7120-48T
IBM RackSwitch G8264CS 1455-64F 7120-64F
IBM RackSwitch G8316 1611-16E 7120-16E
7 current MTMs will be withdrawn from Power WTAAS; Announced 05/13 with Effective
Date 07/31.
7 MTMs will be re-introduced in 2 stages.
• Stage 1: 4 MTMs to be re-released.
• G8264, G8124W, G8052, G7028 - Announce 08/12; GA 09/01
• Stage 2: 3 MTMs to be re-released
• G8264T, G8264CS, G8316 - Announce & GA TBD (GCOIM align).

73
Thank You
Merci
Grazie
Graci
as
Obrigado
Danke
Japanese
English
French
Russian
German
Italian
Spanish
Brazilian
PortugueseArabic
Traditional
Chinese
Simplified Chinese
Hindi
Tamil
Thai
Korean

Power8 hardware technical deep dive workshop

More Related Content

Viewers also liked (19)

Similar to Power8 hardware technical deep dive workshop (20)

More from solarisyougood (20)

Recently uploaded (20)

Power8 hardware technical deep dive workshop

Editor's Notes