3/8/2010
Intel in High Density Data Centers and
Cloud Computing
Nam Thieu
National Sales Manager, MNC and Channel
1
Legal Disclaimer
•
•
•
•
•
•
•
•
•
Intel may make changes to specifications and product descriptions at any time, without notice.
Performance tests and ratings are measured using specific computer systems and/or components and reflect the
approximate performance of Intel products as measured by those tests. Any difference in system hardware or
software design or configuration may affect actual performance. Buyers should consult other sources of
information to evaluate the performance of systems or components they are considering purchasing. For more
information on performance tests and on the performance of Intel products, visit Intel Performance Benchmark
Limitations
Intel does not control or audit the design or implementation of third party benchmarks or Web sites referenced in
this document. Intel encourages all of its customers to visit the referenced Web sites or others where similar
performance benchmarks are reported and confirm whether the referenced benchmarks are accurate and reflect
performance of systems available for purchase.
Intel processor numbers are not a measure of performance. Processor numbers differentiate features within each
processor family, not across different processor families. See www.intel.com/products/processor_number for
details.
Intel, processors, chipsets, and desktop boards may contain design defects or errors known as errata, which may
cause the product to deviate from published specifications. Current characterized errata are available on request.
Intel Virtualization Technology requires a computer system with a processor, chipset, BIOS, virtual machine
monitor (VMM) and applications enabled for virtualization technology. Functionality, performance or other
virtualization technology benefits will vary depending on hardware and software configurations. Virtualization
technology-enabled BIOS and VMM applications are currently in development.
64-bit computing on Intel architecture requires a computer system with a processor, chipset, BIOS, operating
system, device drivers and applications enabled for Intel® 64 architecture. Performance will vary depending on
your hardware and software configurations. Consult with your system vendor for more information.
Intel, Intel Xeon, Intel Core microarchitecture, and the Intel logo are trademarks or registered trademarks of Intel
Corporation or its subsidiaries in the United States and other countries.
© 2008 Standard Performance Evaluation Corporation (SPEC) logo is reprinted with permission
2
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
1
3/8/2010
Petabytes per month
A Rapidly Evolving Internet
Explosion in
IP Traffic1
Richer Services,
Dynamic Apps
Proliferation of
Devices
55K
11K
2008
2013
Requiring More Infrastructure
Apple picks NC
for $1B Data
Center
June 2009
Amazon Building
Large Data Center
in Oregon
Study: Datacenter
Supply at an
All-Time Low
Nov 2008
May 2009
1 Source: Cisco, 2009
3
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
Internet and Cloud Datacenters
Requirements
• Massive scale
• Customized solutions
• Multi-tenancy
• Low TCO
Cloud datacenters require extreme efficiency to maximize datacenter
use and lower TCO while maintaining performance and SLAs
4
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
2
3/8/2010
Internet and Cloud Datacenters
Require Low TCO and Extreme Efficiency
Efficiency and
performance gains
derived from:
• Optimized servers and
platform components
• Improved power
management and reduced
power consumption
• More efficient virtualization
• Software tuning
• Datacenter level
optimizations
Source: Intel internal analysis, 2008 of 3 yr TCO
5
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
Intel Optimization Strategy
Optimized
Silicon
Optimized
Technologies
Scalable
Software
Optimized
Systems
Datacenter
Optimization
\
Intel focused on innovating and optimizing
for cloud & internet datacenters
6
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
3
3/8/2010
Comparing TCO Optimization Areas
Theoretical ROI Estimates of Datacenter Optimizations –
5000 Server Deployment
10% PUE
Improvement
Specify World
Class Power
Supplies
Select High
Performance CPUs
That Allow 20%
Fewer Servers
Could save:
Could save:
~ $600K
in power & cooling
~ $1M
Could save:
in power & cooling
~ $800K
~ $3M
in power & cooling
In CAPEX
Choosing the right CPU may be the
most critical optimization
Source: Intel internal analysis; refer to backup for detailed info on calculations
7
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
Intel® Xeon® 5500-based Servers
Optimized for the Cloud
 Up to 125% higher compute
performance
 Automated power states
 ~50% lower idle power
 Higher operating temperature
Workload 1
 Up to 2X virtualization
performance
 Enhanced I/O virtualization
Workload 2
App
App
OS
OS
VMM
HW
Workload 1
App
OS
App
OS
VMM
HW
App
OS
VMM
HW
Workload 2
App
OS
VMM
HW
† Up to 125% higher compute performance, 50% idle power, and up to 2X virtualization performance are based on comparison to
previous generation 5400 series. Lower cooling cost based on Intel internal analysis (January 2009). For detailed calculations,
configurations and assumptions refer to the legal information slide in backup.
8
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
4
3/8/2010
Intel® Xeon® 5500 Processor
Unleashing Performance for Internet Apps While
Achieving New Levels of Energy Efficiency
More Compute
Power
Faster
MySQL
1.7X
Xeon
5400
1.5X
1.0
1.0
Xeon
5500
Xeon
5400
Idle and Peak Power Reductions†
400
Xeon
5500
SPECint*
_rate_base_2006
SysBench, 100K
Rows
Greater Java
Performance
More HTTP
Requests
12%
300
50%
200
1.7X
1.0
Xeon
5400
0
1.0
Xeon
5500
SPECjvm*2008
100
2.5X
Xeon
5400
2006
2007
Peak Powerunder load (W)
Xeon
5500
2009
Idle Power (W)
SPECweb*2008
More Capacity, Performance, Power Efficiency
for Service Providers
9
† Source: Published/submitted/approved results June 1,2009. See backup for additional details
Performance tests and ratings are measured using specific computer systems and/or components and reflect the approximate perf ormance of
Intel products as measured by those tests. Any difference in system hardware or software design or configuration may affect actual
performance. Buyers should consult other sources of information to evaluate the performance of systems or components they are considering
purchasing. For more information on performance tests and on the performance of Intel products, visit
http://www.intel.com/performance/resources/limits.htm
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
Value of Transitioning to New Platform
• Operates Korea’s #1 search portal
• 1 billion page views per day
• Leading online game portal, Hangame*
IT Challenges
• Use optimal platform for high traffic
• Reliability required for 24/7 operation
• Improve service performance
Solution
• Intel® Xeon® 5500 series platform
Results
• Over 40% improvement in throughput1
• Over 300% reduction in response time 1
• See NHN video on use of Intel Xeon
5500 series:
• Leading Japanese telco
• Introduced Cloud Server Service
IT Challenges
• Offer highly reliable cloud service
• Increase rack density
Solution
• Intel® Xeon® 5570 platform,
Intel® Virtualization Technology,
Intel® Intelligent Power Technology
Results
• Increase rack density about 40%1
• Ability to expand outsourcing business
due to high performance of virtualized
servers
• Full case study:
http://www.intel.com/references/audiovideo.htm
http://communities.intel.com/docs/DOC-4051
1 Compared to previous generation servers
Customer savings and results are specific to the customer, its business goals and the configuration of its enterprise environment.
Differences in business goals, software design, infrastructure or configuration may affect actual results.
10
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
5
3/8/2010
Intel Optimization Strategy
Optimized
Silicon
Optimized
Technologies
Scalable
Software
Optimized
Systems
Datacenter
Optimization
\
Intel focused on innovating and optimizing
for cloud & internet datacenters
11
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
Extreme Efficiency: Power Management
2. Increase Rack Density:
1. Power Monitoring:
Enable higher density with power
capping
Real-time power consumption
Avoid datacenter hotspots
Thermal / Power aware scheduling
4. Business Continuity:
3. Power Savings:
Prolong operation during DC outage
Workload based power-tuning
Workload
Pre cap
power
Pre cap
perf
Post Cap
power
Post cap
perf
Power
Cpu intsv
Io intsv
Memory
Workload
Characterization
Mix / real
Mass policy push of lower power state
Pre outage
Post outage
Multiple Usages Drive Need for New Solutions
12
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
6
3/8/2010
Power Management Technologies
Intel® Intelligent
Power Node Manager
Intel® Dynamic Power Data
Center Manager
• Monitors and reports system power
• Scales Intel Node Manager functions
to rack level
• Caps system power to policy
• Dynamically adjusts P & T-states
Intel
Node
Manager
Tylersburg
• Aggregates data and reports trends
• Dynamically adjusts power caps
BMC
PSU
13
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
Data Center Power Management
Monitor and Control
Server Power
1
• Report system level power
• User-defined input to
control individual SERVER
power consumption
Manage and Coordinate
at the Data Center Level
3
Control total
power dissipation
in each ROW
(e.g., 95kW due
to CRAC)
power used by
2 Control
each RACK (e.g. 6kW
due to circuit breaker)
Intel driving dynamic power
management capabilities at all levels
14
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
7
3/8/2010
World Class Power Management
Solutions
Broad Industry Support and Growing Adoption For
Intel® Node Manager
End Users
OEM, ODM & Console Providers
15
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
Reducing Power Consumption,
Increasing Density
IT Challenges
• Increase compute density
• Manage power consumption
• Increase # of servers per rack
• Reduce costs of power/cooling
#1 search engine in China
IT Challenges
• Maximize # of servers per rack
• Optimize power utilization given power
constraints
Solution
• Intel® Xeon 5500 series platform, plus
Intel® Node Manager
Solution
• Intel Xeon 5500 series, plus Intel Node
Manager and Data Center Manager
Results
• 35% energy savings1
• 50% more servers into existing rack
using same power envelope1
Results
• 40%+ increase in rack density
• Maintain needed performance levels
• Improve power mgmt/consumption
• Full case study:
• Full case study:
http://communities.intel.com/docs/DOC-4230
http://communities.intel.com/docs/DOC-4230
1 Compared to previous generation servers
Customer savings and results are specific to the customer, its business goals and the configuration of its enterprise environment. Differences in business goals, software design,
infrastructure or configuration may affect actual results.
16
Baidu case study - http://communities.intel.com/servlet/JiveServlet/previewBody/1492-102-1-1723/Node%20Manager%20Baidu%20POC%20WhitePaper%20-%20External.pdf
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
8
3/8/2010
The Role of Virtualization
Prior Innovations
…Cloud Advances
Binary Translation
Near Native Performance
and Scalability
Performance Increases with
Virtualization Optimizations
Clustering Technology
Higher Availability
Homogeneous Resource Pools
Continuous Availability
Virtualization Instructions
Rules based resource
allocation
Consolidation & VM Migration
Virtualization Enables Flexible Elasticity
17
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
Intel® Virtualization Technology
A Platform of Virtualization Technologies
Intel® Virtualization Technology
Intel® VT-x
Intel® VT For Directed I/O
(Intel® VT-d)
Processor
Performance with Page
Table Optimizations
Flexibility in Live
Migration
Intel® VT For Connectivity
(Intel® VT-c)
Chipset
I/O Performance Through
Direct Assignment
Memory Protection
Network
Over 2x Throughput Gains
on 10GbE1
Offload Routine I/O Tasks
Intel hardware optimizations are enabling
all virtualization use models
1 Source Intel: Throughput measures receive side (Rx) I/O performance of 10GbE LAN.
18
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
9
3/8/2010
Intel® Xeon® Processors 5500 Series on Xen
Ideal for Virtualized Cloud Architectures
Virtualization Performance
on vConsolidate
SLES 11 RC1 (Xen 3.3.1)
• Up to 2.12X higher
performance with Xen
†
virtualization
Intel Xeon Processor X5460 (Quad-Core, 12M L2, 3.16GHz)
Intel Xeon Processor X5570 (Quad-core, 8M L3, 2.93GHz)
3
Relative Performance
Higher is better
3
3
• ~40% lower roundtrip
†
virtualization latency
2.12
2
1
2
CSU's
2
1.00
1
0
• End-to-end hardware
virtualization advantage
0
Xeon X5460 (3.16GHz) Xeon X5570 (2.93GHz)
Higher performance means
supporting more VM’s per server
Source: Intel measured results Q2 2009. See backup for system configuration details
19
Performance tests and ratings are measured using specific computer systems and/or components and reflect the approximate performance of Intel products as measured by
those tests. Any difference in system hardware or software design or configuration may affect actual performance. Buyers should consult other sources of information to evaluate
the performance of systems or components they are considering purchasing. For more information on performance tests and on the performance of Intel products, visit
http://www.intel.com/performance/resources/limits.htm
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
Intel Optimization Strategy
Optimized
Silicon
Optimized
Technologies
Scalable
Software
Optimized
Systems
Datacenter
Optimization
\
Intel focused on innovating and optimizing
for cloud & internet datacenters
20
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
10
3/8/2010
Scalable Software
Intel Software Tools
Intel Software Consulting
• Removing bottlenecks
• Training
• Optimizing for power efficiency
http://software.intel.com/en-us/intel-sdp-home/
Cloud Computing Development
• Open Cirrus™ Cloud Computing Testbed
• Reference architecture development
• Technology integration for Cloud Operating Environments
DCMI = Data Center Manageability Interface
•
•
•
•
•
Simplify management for large datacenters
Increase interoperability across vendors, platforms
Boost consistency and reliability for server scale
DCMI v1.0 published June 2008
Endorsed by Dell, FSC, HP, MSFT, Rackable, Verari, ZT
www.intel.com/technology/product/DCMI
21
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
Building a Cloud Environment
So many options. So little time.
Lower cost
More agile
More capacity
Servers
Storage
Security
Network
Support
Power
Availability
Cooling
Lock-in
HW mgmt
Standards
Cloud SW
Applications
Starting from a known design
would simplify the design process
22
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
11
3/8/2010
Intel® Cloud Builder Program
A Starting Point from Which to Build a Cloud Solution
Intel
HW Blueprints
Integrated solution
Software
Reference
Architecture
White Papers
ISV
Cloud SW Stack
Webinar/
Training
Test Bed
For more information: http://communities.intel.com/docs/DOC-4292
23
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
Intel Optimization Strategy
Optimized
Silicon
Optimized
Technologies
Scalable
Software
Optimized
Systems
Datacenter
Optimization
\
Intel focused on innovating and optimizing
for cloud & internet datacenters
24
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
12
3/8/2010
Broadest Range of Optimized Systems
Containers
Optimized Racks
Dense 1S/2S
Servers
Micro Servers
25
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
Balanced Platform Technologies
Compute
Intel® Xeon® 5500 platform
with enhanced compute
and I/O virtualization
Result:
Workload agility
Simpler and lower cost
Performance for on-demand scalability
Network
10Gb Ethernet with
built-in support for
unified fabric
Storage
Open platforms and
performance
breakthroughs (SSDs)
26
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
13
3/8/2010
Platform Optimizations
Board Optimizations
• Fewer components
• Less shadowing = better airflow
• High efficiency voltage regulators
Impact
• Reduce power consumption
• <60W idle power
• Leadership SPECpower result1
†
Intel® S5500WB
(Willowbrook)
Network Optimizations
• Unified networking
• Eliminate switches/cables
• Scalable with multi-core CPUs
Impact2
Intel® 10GbE
• Up to 10X increase IO bandwidth
• >5X port count reduction
• Up to 4.5X power per Gb reduction
Solid State Drives
• Lower power consumption
• No moving parts
• Dramatic performance increases
Impact2
Intel® X25-M SSDs
• Up to 46X lower power
• Lower TCO (fewer drives)
• Up to 6X read perf
improvement
1 Source: spec.org postings as of July 15, 2009
2 Based on Intel internal results. Actual results may vary significantly based on workload and product configurations. See backup
for more details on the results.
27
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
Achieving Performance, Power & Space
Savings with Intel® Solid State Drives
Company: Leading provider of on-demand software to telco, cable and hospitality
operators, including video on demand for Telco IPTV operators
IT
•
•
•
Challenges
Optimizing number of video streams per server
Video quality to end user over IP network
Reduce total watts used per server
Solution
• Intel® Xeon 5500 series platform
• Intel® Solid-State Drives
Results1
• 9 Gb/s of network throughput at less than 20% CPU utilization
• Achieve same throughput in 75% less space and about 75% less power
• Full case study: http://communities.intel.com/docs/DOC-4230
1 Compared to previous generation Intel Xeon 5400 servers and standard HDDs
Customer savings and results are specific to the customer, its business goals and the configuration of its enterprise environment.
Differences in business goals, software design, infrastructure or configuration may affect actual results.
28
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
14
3/8/2010
Intel Optimization Strategy
Optimized
Silicon
Optimized
Technologies
Scalable
Software
Optimized
Systems
Datacenter
Optimization
\
Intel focused on innovating and optimizing
for cloud & internet datacenters
29
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
Value of Data Center Optimization
Assumptions
5 Mw IT load
$0.10/kW-hr
7x24 operation
•
•
Typical data center: PUE 2.0
10 Mw purchase from utility
$8.8 million annual power bill
•
•
Best in class: PUE 1.4
7 Mw purchase from utility
$6.1 million annual power bill
Net Savings of $2.7 million annually
through increased efficiency
Source: Intel internal analysis, 2009
30
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
15
3/8/2010
Driving Datacenter Efficiency
Operating Temp
Manageability
Compute Density
Power Delivery
PUE Methodology
Containers
Intel focused on advancing datacenter efficiencies
in multiple areas of the datacenter
31
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
Summary
• Intel addressing the needs of “hyper-scale” Internet and cloud
datacenters via optimization
• Silicon, server boards & systems, technologies, software solutions, power
management, datacenter level optimizations
• Intel® Xeon® 5500 processor series ideal foundation for
Internet and cloud computing
• Talk with Intel on the specific needs of your infrastructure and
how to take advantage of Intel’s optimized products and
technologies
32
* Other names and brands may be claimed as the property of others.
Copyright © 2009, Intel Corporation.
16
3/8/2010
33
17