Infrastructure Solution for Cloud and
Virtualization
Choosing a density strategy
Implementing a high density environment
Maximizing the efficiency benefit
Anticipating the dynamic data center
Data Center of The Future Workshop
Hanoi – 2 March 2010
Ho Chi Minh City – 4 March 2010
All content in this presentation is protected – © 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
Agenda
● Virtualization
● Virtualization Myths
● Current Issues and challenges
● Design Strategy
● Implementing a virtualized environment
● How APC can help you
● Reliability
● Chilled Water Plant and High Density
● Professional Consulting
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
1
APC Data Center Value Proposition
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
Implementing a virtualized environment
Spectrum of solutions for entire density spectrum
Blanking
panels
Rear Air
containment
Supplemental
cooling
InRow™
cooling
Quick,
least expensive
Hot aisle
containment
Modular power
distribution
Best
efficiency
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
2
Virtualization’s efficiency effects
OVERALL
efficiency
Watts
IN
Large entitlement
in physical
infrastructure
Physical
infrastructure
efficiency (DCiE)
Physical
Infrastructure
Useful
computing
Watts
IN
IT
IT
watts
IT
watts
Useful
computing
Useful
computing
IT efficiency =
Watts
IN
IT
watts
IT efficiency goes UP because of
optimized utilization of server
capacity
DCiE goes DOWN because of underloading
(idle capacity) of power and cooling
equipment
© 2009 APC by Schneider Electric
Goes up a little, but
held back because of
big DCiE efficiency
drop
Core | Virtualization-Consolidation | Rev 0
Another way to look at fixed losses
DCiE = 33%
DCiE = 50%
Pre-virtualization: 100 kW of servers
Fan Fan
motors
100kW
motors
Servers
10083%
kW
Servers
100 kW
50%
50%
FIXED
LOSS
Post-virtualization: 50 kW of servers
Servers
Total power
consumption
reduced
Fan Fan
motors 50 kW
motors
100kW
33%
kW
(no100
change)
… by server reduction
67%
FIXED
LOSS
67% reduction
server powerbill
results
56%
Totalinelectric
isin smaller,
electric bill savings
but the
same FIXED LOSS is now a greater
portion of a smaller pie
50% reduction in server power results
in only 25% electric bill savings
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
3
Scalable infrastructure minimizes waste
Minimize the inefficiency of oversizing during consolidation and re-growth
and be prepared for higher densities to come
Power/cooling
Capacity
Virtualized
Load
Virtualized
Original
Load
Load
Virtualized
Virtualized
Load
Load
Scale DOWN
Load
Load
Rack density
Load
Scale UP
Scalable power and cooling results in better DCiE
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
Total System Solutions – Rack to Row to Room to Building
Data Center Physical Infrastructure
IT
floor
The “white space”
Covering all levels of
power, cooling, rack
systems, security,
management that
support the IT equipment
Our complete end-to-end view has profound
implications for AVAILABILITY and EFFICIENCY
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
4
Challenges converging on data centers
● IT density is increasing, and is outstripping the capabilities of
traditional power and cooling infrastructure
● Centralization of distributed data centers
● Virtualization and on-demand computing
● Design & build cycle time needs to be faster and more predictable
● Volatile business climate requires exceptional
data center agility to keep pace
● IT technology changes offer significant business
advantage to “early adopters”
● Energy efficiency is now a global issue
● Data centers are in the spotlight due to high energy usage that
continues to increase
● Energy cost and availability are affecting the bottom line
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
Why Schneider?
1
2
BROAD
EXPERTISE
RELATIONSHIPS
Intellectual capital in all
data center support systems
Completing the circle of
industry touch-points that
make it happen
3
THOUGHT
LEADERSHIP
Our ideas steer
the industry
Total breadth and depth that is
unmatched in our industry
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
5
1
Why Schneider?
Broad expertise
1
2
3
4
Rack-row-room-building
Our products
Our partners
End-to-end, wrap-around portfolio enables
holistic design for highest availability and efficiency
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
Broad expertise:
Power
Best-in-class, scalable/modular high-efficiency UPS systems
Symmetra MegaWatt
96.7% efficient as low as 60% load
Rack-row-room-building
power distribution
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
MGE Galaxy/EPS
Up to 98% efficient
Energy-efficient transformers
Energy savings payback in a
reasonable period
6
Broad expertise:
InRoom™
Cooling
InRowTM
Room, Row, Containment, and “hybrid”
● Room cooling
● Precision perimeter cooling
Hot-aisle containment (“HAC”)
● Row cooling – Close-coupled cooling™
● Targeted local cooling for high density areas
● Variable fan speed for increased efficiency
Matches fan speed to server demand
● Containment of airflow
● Eliminates air mixing
Rack air containment (“RAC”)
Further improves efficiency and capacity
● Hybrid cooling environments
● Optimize efficiency while meeting variable density
requirements
● Agility of drop-in “pod” for fast upgrades
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
Broad expertise:
Rack Systems
● Universal compatibility
● Compatible with Cisco Unified
Computing System (UCS) blade
applications
● Flexible solutions
 Increase deployment speed
● Highest efficiency
● Optimized airflow cable management
and racks
 Scalable components
 Supports evolving IT technologies
MANAGEMENT advantage:
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
• Up to four metered clients
• Zero-U vertical space
7
How APC Can Help You
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
Broad expertise:
Services
● Spanning the data center life cycle
● Analysis
● Assessment
● Planning and consulting
● Design
● Architecture/engineering support
● Project management
•
•
•
•
•
•
The human element
that ties it all together
Equipment sourcing & scheduling
Construction
Installation
Assembly and start-up
Commissioning
Integration
● Operations, maintenance and repair
● Remote monitoring: Building automation, IT floor, power quality, security
● Training
● Asset planning
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
8
FAULT TOLERANT
A SYSTEM THAT SEAMLESSLY TRANSFERS
TO A STANDBY SYSTEM FOLLOWING A
SUBSYSTEM FAILURE
THIS PREVENTS DISRUPTION OF THE
SUPPLY & THEREFORE AN OUTAGE
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
Design Considerations
Concurrent Maintainability
A system that allows maintenance of the
equipment / components within the system
without any disruption of the supply
The level of reliability during the maintenance
is reduced as a result of shutting down the
equipment / components
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
9
Uptime Institute Tier Rating – How reliable is your
data center?
Multiple active power and cooling distribution paths,
redundant components, fault tolerant, 99.995%
availability.
Tier 4
Tier 3
Multiple power and cooling distribution paths, but
only one path active, redundant components,
concurrently maintainable, 99.982% availability.
Tier 2
Single path for power and cooling distribution,
redundant components, 99.741% availability.
Tier 1
Single path for power and cooling distribution, no
redundant components, 99.671% availability
In general, International Banks, Financial Institutions, ISP, Hosting Sites, etc, will require
at least a Tier 3 infrastructure.
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
Overall Electrical Infrastructure
SER A
SER B
SER A
SER B
20th
19th
SER A
SER B
18th
Trading Floor
MER
17th
SER A
SER B
16th
SER A
SER B
15th
SER A
SER B
SER A
SER B
SER A
SER B
MEP A / UPS A
Generator
A
Mains A
13th
12th
Generator Supply
UPS Supply
Mains Supply
Generator Supply
Generator
B
Mains B
Landlord
Generator
© 2009 APC by Schneider Electric
14th
MEP B / UPS B
Core | Virtualization-Consolidation | Rev 0
10
Overall Electrical Infrastructure
SER A
SER B
20th
SER A
SER B
19th
SER A
SER B
18th
Trading Floor
MER
17th
SER A
SER B
16th
SER A
SER B
15th
SER A
SER B
SER A
SER B
13th
SER A
SER B
12th
MEP A / UPS A
14th
MEP B / UPS B
Generator
A
Generator Supply
UPS Supply
Landlord
Mains A
Mains Supply
Generator Supply
Landlord
Generator
© 2009 APC by Schneider Electric
Generator
B
Landlord
Mains B
Core | Virtualization-Consolidation | Rev 0
Overall Electrical Infrastructure
SER A
SER B
SER A
SER B
20th
19th
SER A
SER B
18th
Trading Floor
MER
17th
SER A
SER B
16th
SER A
SER B
15th
SER A
SER B
SER A
SER B
SER A
SER B
MEP A / UPS A
Generator
A
Mains A
Landlord
Generator
© 2009 APC by Schneider Electric
14th
MEP B / UPS B
13th
12th
Generator Supply
UPS Supply
Landlord Mains Supply
Generator Supply
Generator
B
Landlord
Mains B
Core | Virtualization-Consolidation | Rev 0
11
Overall Air-Con Infrastructure
Landlord
Essential
Chiller Plant
Tenant Chiller
Plant
SER A & B
20th
SER A & B
Trading Floor
19th
Trading Floor
SER A & B
18th
MER
17th
SER A & B
16th
SER A & B
15th
SER A & B
MEP A / UPS A
SER A & B
14th
MEP B / UPS B
SER A & B
13th
12th
Tenant Chiller Supply
District
Cooling
Plant
© 2009 APC by Schneider Electric
District Cooling Plant
Landlord Essential Chiller
Core | Virtualization-Consolidation | Rev 0
The Mechanical Space – Chilled Water
Plant
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
12
Loss of Chilled Water – Temperature Rise in the
Data Centre
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
Server Thermal Management System
● The system ensures that
Servers are not damaged
due to fast changes in
environmental conditions
● Changes in temperature
should be less than 5OC
over 60 mins
● Typically the first warning
level for server is issued at
55OC.
● Typically the second and
critical level is at 65OC
● The difference between
the inside of server and
Data Centre is 30-35OC.
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
13
Temperature Increase Over Time vs Density per
Cabinet
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
5kW/Rack At Normal Operation
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
14
5kW/Rack 2 minutes after Mains Power Failure
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
5kW/Rack 4 minutes after Mains Power Failure
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
15
12 Min. Ramp Up of Chillers and Power Failure Recovery
1400 W/m2
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
Design a Thermal Buffer – Thermal Ride
Through
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
16
Schematic Development – We can design for
thermal ride through…..
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
How Professional Consulting can help you
● Inception / Preparation
● M&E Feasibility Study to house Mission Critical Applications/Facilities.
● Independent Peer Review of M&E designs
● Reliability and Single Points of Failure /Gap Studies/Analysis
● Building Inspection for feasibility of implementing a mission critical facility
● Design
● Performance Design Documentation
● Concept Design, Schematic design with plant and infrastructure requirements.
Services and systems integration
● Acquire and Implement
● Operation
● Commissioning, heat load IST and validation
● CFD analysis
Inception
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
Prepare
Design
Acquire and
Operation
Implement
17
Demand For Data Center Assessments
● Companies focusing on energy costs
● Desire to cut power and cooling costs in the Data Center
● Energy to run the Data Center costing more than the equipment
● Density in the Data Center is still increasing
● Economic woes = do more with less in the Data Center
● Assessment services provide data driven recommendations to
•Solve existing problems by making recommendations
•Extend life of current IT equipment
● Utilities providing incentives to reduce energy consumption
● Offering rebates/incentives for efficiency gains/assessments
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
Assessment Services Applications
 Facility consolidation
 Facility
expansions/upgrades
 Optimize the
● Increase capacity
● Maximize utilization
● Improve efficiency
 Facility evaluation
 Catalog, analyze and

evaluate the existing
infrastructure
Recommend
industry best
practices to optimize
the
existing facility
© 2009 APC by Schneider Electric

infrastructure
for server
consolidation,
high density
deployment
or virtualization
Lower the operating
costs through
increased
efficiencies
Core | Virtualization-Consolidation | Rev 0
18
Assessment Services Benefits
Industry Experienced Customized Report
Professionals
The customized report
Professional Services
Consultants integrate a
knowledge of industry
best practices with
practical, data center
experience in
assessment and
analysis
provides solution
options, to optimize
the existing physical
infrastructure and to
plan for the future
Vendor Agnostic
.
Baseline Existing
Facility
Provide an updated
summary of the
existing power,
cooling and
facilities
infrastructure
© 2009 APC by Schneider Electric
The assessment and
analysis are vendor
agnostic and product
neutral. The report
recommends the best
solution for the
customer without
vendor or product
bias
Core | Virtualization-Consolidation | Rev 0
Data Center Electrical Efficiency Assessment
● Measures actual Data Center
power flows
● Break out of IT power
consumption from total Data
Center power consumption
● Calculates a Data Center’s PUE
(Power Usage Effectiveness)
● Estimated efficiency gains made
by implementing
recommendations
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
19
Data Center Power and Cooling Assessment
● Provides a comprehensive Data
Center power and cooling
assessment report
● Evaluates existing environmental
conditions
● Measures Data Center electrical
infrastructure loads
● Quantifies present temperature
conditions using thermal imaging
● Identifies shortfalls in the
electrical and cooling provisions
that can be used in assessing
present and future requirements.
● Delivers a one-line diagram
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
● Recommends ways to optimize
infrastructure utilization
Data Center Cooling Analysis using
Computational Fluid Dynamics
● Provides a 3-D computation fluid
dynamics model of the
temperature and airflow
conditions in a Data Center
● Delivers a predictive impact
analysis of new high density
loads
● Recommends ways to optimize
the cooling infrastructure
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
20
Virtualization and consolidation
Summary
What density strategy
should I choose when
virtualizing my servers?
A spectrum of possibilities exists, each having a
different set of consequences. The most common
strategy chosen is to consolidate the postvirtualized servers.
How do I implement a
high density
environment?
A variety of solutions are offered that align with
high density deployment strategies. pods are the
most common solution chosen. Closely-coupled
hot and cold air streams allow for predictable and
efficient cooling.
Have I maximized my
virtualization efficiency
benefit?
Virtualization is fully leveraged when power and
cooling are right-sized to the post-virtualization
load. In addition, predictable row-based, closecoupled cooling deployments further increase
data center efficiency.
White
paper
118
© 2009 APC by Schneider Electric
Core | Virtualization-Consolidation | Rev 0
21