System x Power Development
IBM x3850 X5 Energy Efficiency Leadership
Ted Howard
5/4/2011
System x Power Development
x3850 X5 Energy Efficiency Leadership
ƒ x3850 Has Demonstrated Leadership With Energy Consumption
and Efficiency Performance Over The Predecessor Product and
Major Competitors
ƒ Summarize Power Hardware That Helped Enable This
Differentiation
ƒ Discuss System Implementation, Design Challenges and
Tradeoffs, and Supplier Interaction
ƒ Provide Comparison Data
2
5/4/2011
System x Power Development
x3850 X5: Internal view
• Scalable 4-socket 4U server
• 8, 6, or 4-core Intel Xeon 7500 CPU’s
• 64 Dimms, 1066MHz DDR3
• 8 HD’s, or 2 eXFlash Packs
• 7 PCIe Gen2 slots
• 2 PS’s 3U (1975W / 875W)
• 6 Fan’s
Scalable
•x3850 4U + MAX5 1U Î 96 Dimms
•8-socket, x3850 4U + x3850 4U
3
5/4/2011
System x Power Development
eX5 is the top performer for business critical applications
x3850 X5
œ TPC-C:
#1 highest ever 4-socket score
œ TPC-H:
#1 world record price performance
#1 highest ever 4-socket score
œ SPECvirt:
#1 world record score with 8S
œ SPECjEnterprise:
#1 single node x86
œ SAP-SD:
#1 8-socket score
Top Performance Across Enterprise Workloads
4
5/4/2011
System x Power Development
Power Subsystem Design Focus
Cost
Space
Requirements
Non-Competitive
5
Competitive
Efficiency
(Schedule)
Leadership
5/4/2011
System x Power Development
Ghidorah Power Subsystem
ƒ Power Supply
– 1975W / 875W (230Vac / 115Vac)
– 3U Form factor
(120mm H x 125mm W x 200mm L)
• Density 15.5W/cuin (Useable Space)
– Rear Access, Orthogonal Docking
– System 120mm Fan Embedded
– N+N = 2 PS
(Redundant at High Line)
– Single Main 12V Output (162A / 72A dc)
• Auxiliary Voltages (3.3Vco 200mA and 5Vco 300mA)
– C13/14 AC Inlet
– Equivalent Cost $/W To Athena
6
5/4/2011
System x Power Development
7
5/4/2011
System x Power Development
ƒ Ghidorah Comparison
PS Efficiency - Comparison to Athena
Efficiency (%)
100
95
90
85
80
75
70
10
20
30
40
50
60
70
80
90
100
Load (%)
1440W
8
1975W
5/4/2011
System x Power Development
Ghidorah Power Subsystem
ƒ Power Supply
PS Design
•
•
•
•
•
Optimized Efficiency For Redundant Operating Range
Focused For Significant Improvement At Light Load
(10A to 30A)
Dual Secondary Converters, Shedding One At Light Load
Reduces Bulk Voltage At Light Load
Reduced No Load PS ‘On’ Power By 59%, 44W Î 18W
Enhanced Light Load / Operating Load Efficiency
•
•
•
9
10% Load, +16% Eff. Improvement Over Athena
20% Load, +6% Eff. Over Athena
30% Load, +4% Eff. Over Athena
5/4/2011
System x Power Development
Ghidorah Power Subsystem
ƒ Power Supply
– Allowed System To Reduce Fan Count To 6 Total,
Less Than Other System Competitors
– 230V Efficiency
Load
(Avg of 50 PS's)
– 115V Efficiency
(Avg of 50 PS's)
10
Load
10%
20% 50%
100%
Peak 40%
91.7
93.7 94.1 91.9
94.1%
10%
20% 45%
Peak 25%
89.8
92.1 90.6
92.1%
5/4/2011
System x Power Development
11
5/4/2011
System x Power Development
12
5/4/2011
System x Power Development
Ghidorah Power Subsystem
ƒ Ghidorah CPU Vcore Efficiency - Peak 92.1%
CPU Vcore Regulator Efficiency
EffInd
95
93
Efficiency (%)
91
89
87
85
83
81
79
77
75
0
10
20
30
40
50
60
70
80
90
100 110 120 130
Io A)
13
5/4/2011
System x Power Development
Ghidorah Power Subsystem
ƒ Ghidorah CPU Vcache Efficiency - Peak 92.2%
CPU3_Vcache Regulator Efficiency Pass4
EffInd3.3VPowMsrd
95
93
91
Efficiency (%)
89
87
85
83
81
79
77
75
0.000
10.000
20.000
30.000
40.000
50.000
60.000
Io A)
14
5/4/2011
System x Power Development
Ghidorah Power Subsystem
ƒ Ghidorah Memory VDimm Efficiency - Peak 92.8%
(SIT)
95.00%
90.00%
Efficiency
85.00%
80.00%
Grimlock 3 Phase
Grimlock 2 Phases
75.00%
70.00%
65.00%
60.00%
0
10
20
30
40
50
60
70
80
90
100
110
Load Current(A)
15
5/4/2011
System x Power Development
Ghidorah Power Subsystem
ƒ Voltage DC/DC Regulators - Improved Efficiencies Ghidorah Over Athena
– Memory Vddq (At 1.5V)
• +5% Over Athena At 1.8V,
92.8% Å 88%
• Additionally Optimized At Operating Range, Light Load
– CPU Vcore (At 1.2V)
• +4% Over Athena,
92.1% Å 88%
• Additionally Optimize At Operating Range, Light Load
• Resolved Space Challenges
– Developed New Inductor 220nH In 11mmx7mm Footprint For Ghidorah Space Limitations
– Added Holes In I/O Planar To Accommodate Heat Sink
• PCB Etch Added To Minimize Distribution Loss, and Efficiency Loss
– Implemented Static Phase Shedding
• MEM Vddq 3ph Î 2ph Based On Type and Number of Dimm’s
• CPU Vcore PSI# (CPU’s 2, 3, 4)
ƒ Voltage Regulators – Significant Cost Improvements Over Athena
16
5/4/2011
System x Power Development
Willingness of Suppliers To Improve / Brainstorm / Partnership
ƒ Significantly Improved PS Efficiency Pass2 BBFV Æ Pass4 SIT
ƒ Resolved PS Mechanical Challenge – Telescopic Connector
– Hard Work, Multiple Passes
ƒ Significantly Improved PS No-Load ‘On’ Wattage
ƒ Added Static Phase Shedding for CPUVcore and MemVddq, (Late At SIT
Pass4)
ƒ Moved From Pass1 Coupled Inductor To Discrete Inductor, w/Slower Fsw
ƒ Selected Technologies (Topologies) Significantly Improved Over Predecessor
Product
ƒ Defined Targeted Operating Points and Tradeoffs For Peak Efficiency
17
5/4/2011
System x Power Development
Base System IDLE Power Comparisons
Ghidorah
Athena
ƒ 2x130W CPUs, 4x2GB Dimms
ƒ 2x130W CPUs, 8x2GB Dimms
– 211Wac
ƒ 2x95W CPUs, 8x2GB Dimms
– 218Wac
ƒ Base Configuration 2CPU Idle
(95W/105W/130W)
– 210-218Wac
– 373Wac
ƒ 2x80W CPUs, 8x2GB Dimms
– 378Wac
ƒ 1x80W CPU, 8x2GB Dimms
– 347Wac
160Wac Reduction - Base System Idle 2CPU Operating Cost Savings
18
•
160Wac x 24Hrs x 365 Days x 1/1000 = 1402kWh/Yr Î $140/Yr
(at $0.10/kWh)
•
Data Center Total Savings x2
Î $280/Yr
5/4/2011
System x Power Development
PS Efficiency Comparison To Competition
Efficiency (%)
2PS IBM / 4PS Competitor 'A' For 2000W System Load
(Fully Redundant)
100
90
80
70
0
10
20
30
40
50
60
70
80
90
Load (%)
'A' 1200W Platinum
•
•
•
19
IBM 1975W
'A' 1200W Silver
IBM PS/System Better At Idle and Operating Load Range
Penalty For 4PS Scalability
Significant Disadvantage For Silver PS
5/4/2011
100
System x Power Development
PS Efficiency Comparison – IBM vs. Competitor ‘A’
Efficiency (%)
1PS Efficiency Comparison To Each Individual Max. Design Load
100
95
90
85
80
75
0
10
20
30
40
50
60
70
80
90
100
Load (%)
'A' 1200W Platinum
•
•
20
IBM 1975W
'A' 1200W Silver
IBM PS Design More Optimized At Light Load, and Redundant
Operating Range Below 50% PS Load, Compared To Competitor
A’s Best
Competitor ‘A’ Offers High Efficient and Low Efficient PS Option
5/4/2011
System x Power Development
PS Efficiency Comparison
Efficiency (%)
1PS Efficiency Comparison To 1200W System Load
100
95
90
85
80
75
0
10
20
30
40
50
60
70
80
90
100
Load (%)
'A' 1200W Platinum
•
21
IBM 1975W
'A' 1200W Silver
IBM 1975W Performance Equivalent Over 1200W System Load
Range, To Competitor A’s Best, Even With Larger Capacity
5/4/2011
System x Power Development
System Consumption – Medium Configuration
AC Wattage
4x130W CPUs, 32x16Gb Memory Dimms
1300
1100
900
700
500
300
1194
1141 1106
579
1093
658
530
526
Idle 2PS/1PS
MpX 2PS/1PS
Idle 4PS/2PS
MpX 4PS/2PS
System Configuration
'A' Silver 1200W
•
•
•
22
IBM 1975W
Significant IBM Advantage Across All Configurations, Compared To
Competitor ‘A’ Silver PS (Delivered With Our System)
Idle Savings (53W – 128W)
Operating MPx (35W – 101W)
5/4/2011
System x Power Development
System Consumption – Light Configuration
AC Wattage
4x95W CPUs, 8x4Gb Memory Dimms
800
598
600
430
400
673
553
553
517
391
380
200
Idle 2PS/1PS
MpX 2PS/1PS
Idle 4PS/2PS
MpX 4PS/2PS
Configuration
'A' Silver 1200W
•
•
•
23
IBM 1975W
Significant IBM Advantage Across All Configurations, Compared To
Silver PS (Delivered With Our System)
Idle Savings (50W – 126W)
Operating MPx (45W – 120W)
5/4/2011
System x Power Development
Energy Efficiency / Consumption Leadership
ƒ PS Efficiency Leadership
ƒ System Power Consumption Leadership
ƒ Significant Reduction In System Idle Power
ƒ DC/DC Memory and CPU Power Consumption Leadership
ƒ Resultant Estimated Customer Operating Savings
– Comparing 2PS IBM / 4PS Silver Competitor (Most Common Redundant
Configuration)
• 125Wac x 24Hrs x 365 Days x 1/1000 = 1095kWh/Yr Î $110 / Yr
• Data Center Savings x2
– Significant Idle Power Savings (160W) From Athena
24
Î $220 / Yr
Î $280 / Yr
5/4/2011
System x Power Development
Acknowledgements:
ƒ Trung Nguyen - Power Procurement
ƒ Nick Celenza - Power Development
ƒ Kevin Linen - Power Development
ƒ DongHong Li - Power Development
ƒ Ellis O’Neal - Power Development
ƒ Dipak Tailor - Power Development
ƒ Ted Howard - Power Development
ƒ Alfred Burress - Mgr. Power Development
ƒ Michelle Brunk - Marketing
25
5/4/2011
System x Power Development
Ghidorah Power Subsystem
Questions or Discussion?
Thank You
Ted Howard
[email protected]
(919)254-2611
26
5/4/2011