La forza di un ecosistema per
l'innovazione Open Power
Roma 26 Maggio 2015
Daniele Isidori
Power Technical Manager Italy
[email protected]
Agenda
Ore 10:00 - 12.00 Perchè Linux è Power
Strategia Power Systems
Il contributo IBM all’Open Source
OpenPOWER Foundation
OpenSource database
L’esperienza di 2ndQuadrant
12.00 - 13.00 : Tecnologie di virtualizzazione a confronto
Offering
PowerVM, PowerKVM-Kimchi, VMWare
Vantaggi e differenze
Confronto x86 vs Power
13:00: Pranzo
14:00 - 15:15: Cloud & Analytics on Power
OpenStack, PowerVC
Soluzioni Analytics on Power
DB2 Blu on Linux on Power
15:15 : Break
15:30 - 16.30: Demo Live
Demo PowerVC
Creazione partizione Linux
Virtualizzazione via PowerVM, KVM,
Mobility
Gestione Virtualizzatore OpenSource: Kimchi
16:30 -17.00: Chiusura Q&A
2
IBM Power8 and the Linux Ecosystem
Daniele Isidori
Power Technical Manager Italy
IBM Systems
[email protected]
Agenda
• Why Linux is strategic for customers
• The Linux on Power strategies
• Fundamentals of Getting Started
4
Linux:
5
Clients continue the shift to Linux as operating system
Linux OS Servers % of Total Market
(estimate by revenue)
+15%
2010
2014
Source: IBM Internal Estimates
Linux is now 35% of the market, 15 point gain in
the past 4 years
In Linux Foundation surveys, 87% claim to have
added Linux in the past year, and 82% plan to add
more in 2015.
Why are clients embracing Linux?
– It offers choice of hardware
– Not controlled by a single vendor
– Runs on cheap hardware
– More secure than Windows
– Availability Applications (including open
source)
– Availability of skills
13% Power
6
Where are Clients running Linux?
Server Workloads with the
Highest Linux OS Growth
(2010-2014)
Availability of Open Source applications and tools
makes Linux a logical choice for Web Serving
Linux Foundation surveys show that Linux is the
primary platform for private Cloud deployments
ISVs are embracing Linux because it offers:
– Availability of Open Source development
tools
– No hardware vendor control
– Availability of skills
– Growing marketing opportunity
Source: IBM Internal Estimates
7
What's going on in the UNIX market?
And how has that changed customers?
I clienti stanno cambiando le priorità quando acquistano
#3: Performance
#3: TCO
#2: Standardization
#2: Differentiation
#1: TCA
#1: Benchmarks
Unix Market Priorities
Linux Market Priorities
The Technologist's Challenge: provide value-add in a standard's-based market
with KVM, OpenStack, Linux, open source middleware, etc...
The Seller's Challenge: find “annuity opportunities” – recurring multiples,
prove once to enable repeat buying
8
Linux Trend
http://www.linuxfoundation.org/news-media/infographics/largest-linux-user-trends-2014
Linux for Mission-Critical Workloads (2013)
http://www.linuxfoundation.org/infographics/2013-enterprise-end-user-report
© 2014 International Business Machines Corporation
Enterprises choices for Big Data (2012)
http://www.linuxfoundation.org/news-media/infographics/2012-enterprise-end-user-report
9
Linux Trend
Linux for Cloud (2013)
https://clt.vtc.edu.hk/what-happens-online-in-60-seconds/
© 2014 International Business Machines Corporation
10
Open Source & OpenPower :
11
Are these trends related? What links IBM and Open Source?
Eclipse
See Rational...
Apache
. See IBM HTTP Server...
Apache Hadoop
. See Big Insights...
Linux… “The future is open” (2003)
Apache UIMA
IBM top five contributor for OpenPower foundation..
. See Watson...
IBM has partecipated to Linux kernel to support new
POWER8 features.
KVM
5 Client Centers @Bejing, New York, Austin, Montpellier,...
. See Power8...
OpenStack
. See Cloud Management...
1 bilion US $ investment on Linux and Open Source Stack
© 2014 International Business Machines Corporation
12
Open Source Trend
Diffusion and interest
Business dimension
2M projects by 2014; x2 in last 2y.
OpenSource Venture investments:
+80% between 2011 and 2012
140% increase in interest
purchasing open source software
OpenSource means free*?
~2B$ in open source sales in 2013
57% of companies using open
source will collaborate with
competitors.
41% of people plan to deploy open
source solution in 1-2 years.
http://blog.gogrid.com/2014/04/08/2014-year-open-source/
© 2014 International Business Machines Corporation
* “free is free only if your time has no value”
13
The rise of
Performance
&
of leading POWER architecture
Broadens the capability and
performance of POWER
Collaboration
Open Development
across multiple thought leaders
OpenPOWER enables greater
innovation through open software
and open hardware
August 2013 (announced OpenPower)
1. Create ecosystem
2. Make POWER IP licensable to members
3. Open POWER Firmware to members
Context: Growing trend among datacenter operators
who design their own hardware, instead of buying
© 2014 International Business Machines Corporation
Collaborative development model
drives collective thought leadership,
across multiple disciplines
-
Members can build custom servers
(custom-tuned for specific applications)
Members can provide feedback to the ecosystem,
influencing future developments
-
Innovation injected into the community
Innovation available for POWER customers
14
OpenPower Trend
© 2014 International Business Machines Corporation
http://openpowerfoundation.org/industry-coverage/the-openpower-summit-infographic/
15
Implementation / HPC / Research
System / Software / Integration
Only 1 year
+ 100 member
I/O / Storage / Acceleration
Boards / Systems
Chip / SOC
16
Complete member list at www.openpowerfoundation.org
OpenPOWER Innovation
Open Standard introduced on Power8
Native PCI-Express 3.0 Support, replacing proprietary GX/Bridge
Support for PowerKVM Hypervisor
Transport Layer for CAPI protocol
17
OpenPOWER Summit Hardware Announcement (3/2015)
Chuanghe 1S/1U POWER8 server
Collaborators: Chuanghe
Cirrascale RM4950
Collaborators: Cirrascale, NVIDIA
Zoom 2S/2U POWER8 System Planar &
Memory Riser
Collaborators: Zoom Netcom, Byosoft, Unisource
Virtex 7 CAPI-based Adapter Kit
Collaborators: Convey, Xilinx
TYAN TN71-BP012
Collaborators: Tyan, Mellanox
Suzhou PowerCore CP1 mechanical sample
Collaborators: POWERCORE
IBM Memory Technology Innovation Utilizing
Altera FPGAs
Collaborators: IBM, Altera
Open server specification and Open Compute
motherboard mock-up
Collaborators: Rackspace
IBM 2U/2S POWER8/NVIDIA GPU Server “Firestone”
Collaborators: IBM, Wistron,
NVIDIA, Mellanox
Mellanox ConnectX-4 CAPI-adapter
Collaborators: Mellanox
Inspur 2S/2U server
Collaborators: Inspur
More details available at http://openpowersummit2015.tumblr.com/factsheet
18
OpenPOWER Foundation
Cloud Ecosystem
Founded in 1998
Founder of OpenStack
9 datacenters
300.000 Customers WW
#1 hosting for Internet Retailers
#1 hosting OpenStack private cloud
Founded in 1999
17 Data Centers (1st biggest WW)
180.000 Physical Servers
700.000 Customers WW
#1 Internet Hosting in Europe (#3 WW)
Source:
http://labs.runabove.com/power8/
Aaron Sullivan (Director Infrastructure Strategy)
shows off Rackspace POWER8 OpenCompute
Form Factor Planar
© 2014 International Business Machines Corporation
20
Cloud Ecosystem
Coming soon: POWER8 Bare Metal as a Service
3 Fixed Configurations + SDD, deployed < 30 mins
Suitable for:
Big data & Analytics for optimal cost/performance
Optimized e-commerce & content management
Hybrid Cloud & Bluemix integration
Cloud service provider & database services
© 2014 International Business Machines Corporation
TYAN TN71-BP012 Collaborator: Tyan, Mellanox
With planned availability second quarter 2015, the TYAN
TN71-BP012 servers are designed for large scale cloud
deployments and follow Tyan’s highly successful
OpenPOWER customer reference system introduced in
October 2014. IBM will be among the first to deploy the new
servers as part of its SoftLayer infrastructure, utilizing them
for a new bare metal service offering.
21
Linux on Power8 : colpo d’occhio sull’ ecosistema
Superior Cloud
Cloud
Economics
New. SoftLayer – POWER-based Bare
Metal offerings
New. Red Hat in LE
mode, RHEV
New. Rackspace joins the
OpenPOWER Foundation
New. Veristorm
open source
Hadoop offering
New. Docker for
Power Systems
113 members
OpenSource focus
Cognos BI already
available (BE); BI and
TM1 coming (LE)
SPSS Modeler and
Analytics coming (LE)
Update: OpenStack
HEAT and Chef
Server for Power
IBM Hadoop solutions:
BigInsights and
Veristorm
IBM MobileFirst
Platform Foundation 6.3
BPM Advanced 8.5.5
Business Monitor 8.5.5
WebSphere Application
Server 8.5.5.3
© 2014 International Business Machines Corporation
New. DB2 with BLU
Acceleration
Update: SAP HANA
Ramp-Up program
New. Bluemix with Power for
SOE/SOR integration
Middleware
Big Data & Analytics
Open Innovation
Reliable Messaging
Caching
WebSphere Extreme
Scale 8.6.0.6
WebSphere MQ 8.0.0.1
WebSphere MQ MFT Ed 7
22
22
Bi-Endian… so what? (Relevant only for ISVs)
BE Systems (examples)
System z
System p
SPARC
Macintosh
LE Systems (examples)
Intel
VAX/VMS
PCI Adapter cards
Most of x86/Linux applications with no platform specific
dependencies written in scripting or interpretive
languages will run as is on Power. C/C++ will only
need a recompile.
Most x86/Linux applications, with no platform specific
dependencies written in C/C++, will only need a
recompile
Estimated <5% of Linux applications from any
platform written in C/C++ will require source code
changes. Use available tools and resources to
analyze source code and update code as needed
© 2014 International Business Machines Corporation
23
Perché Linux è Power :
24
Power paradigm:
same technology excellence for scale-up and scale-out systems
Systems of Record
Structured data from operational systems
20% of all data generated
Design point is “purposeful”:
Enterprise / Mission-Critical workloads
(OLTP, ERP, SAP, Big Data, Analytics…)
Design Goals: “consolidate”
Consistency, Availability, Reliability, Security
Extreme performance (throughput per core)
>> Less Operational Costs
>> Less Licenses Costs
© 2014 International Business Machines Corporation
Systems of Engagement
Data that “connects” companies with their
customers, partners and employees
80% of all data generated
Design point:
SMB, Computing Grids, Cloud
Design Goals: “distribute”
TCA, Standardization (at cost of under-utilization)
Performance (throughput per node)
>> Affordable acquisition costs
>> Affordable incremental costs
25
Power8 – innovation for today
4X
5X
4X
26
Understanding the impact of “more threads”
Intel HyperThreading: 2 x Threads per Core
Power Simultaneous Multi-Threading: 1 / 2 / 4 / 8 x Threads per Core
+ 1.6 times single thread performance of Power7+
27
Understanding the impact of “more bandwidth”
Data is here (Disks)
Processors are here
96 MB L3 cache
128 MB L4 cache
230GB/s-410 GB/s
sustained memory
bandwidth
28
Performance comparisons
PowerEdge R730 (2U) Xeon E52699v3 18-Core 2.3GHz (2ch/36co)
Dell: Rpe2 28,172
Power System S822L (2U)
POWER8 3.02GHz (4ch/24co)
IBM: Rpe2 47,327
Price-Performance (EjOPS/$)
0.6
0.5
0.4
0.3
0.56
0.4
0.2
0.1
0
Power S822L
HP DL380p IvB (2s)
36 cores ma: -68% Performace !!!
29
Scheda Tecnica: Gartner parla chiaro………
Why POWER has such good reputation
119
120
Downtime
Virtualization Vulnerabilities
(hours per year)
80
61
60
40
22
20
KVM
Sun LDoms
Sun
LDoms
Hyper-V
Hyper-V
Source: National Vulnerability Database, http://nvd.nist.gov/
PowerVM
PowerVM
What is the cost of downtime?
*Source: ITIC 2009 Global Server Hardware & Server OS Reliability Survey Results,
July 7, 2009. Fully paper is available at ibm.com/aix
Windows Server 2003 x86
KVM
Windows Server 2008 x86
Xen
Xen
Red Hat Enterprise Linux x86
VMWare
Vmware
HP UX 11/ HP Integrity
0
Apple MAC
0
HP UX 11/ PA RISC
1
Sun Solaris / SPARC
2
IBM AIX POWER
Number of reported
security vulnerabilities
100
30
Power8 – innovating for tomorrow
31
CAPI Technology
CAPI
PCI
PCI
Non-CAPI
Accelerator
Accelerator
Core
P8
Core
Memory
Memory
CAPI Advantages :
• Use standard PCIe3 bus
For each I/O: 40X Fewer Instructions with CAPI
• Accelerator has direct access to Memory
500 vs. 20,000 instructions
• Same address Space
• No more data-copy needed
• Simplify programming for application
Ok chiaro Linux è Power :
1.
2.
3.
4.
Miglior Processore
Migliori Performance
Migliore Tecnologia
Ecc…
….ma costerà il doppio di x86…..
33
LINUX: Alfa Romeo o Ferrari??
$26,203
Dell PowerEdge R730
Dubbi???............
34
$24,241
POWER p822L
IBM Power 822L pricing comparison ($US)
Comparable TCA
Linux on Intel
Haswell + KVM
Vs.
Linux on
POWER8 + KVM
Server list price*
-3-year warranty, on-site
Virtualization
- 2 sockets, 3 yr. 9x5 sub./supp.
Linux OS list price
- RHEL, 2 sockets, unlimited
guests, 9x5, 3 yr. sub./ supp.
Total list price:
(Total cost of acquisition)
Server model
Processor / cores
Configuration
Dell PowerEdge
R730
Dell PowerEdge
R730
(32-core, 64GB)
(36-core, 64GB)
$23,403
$26,203
IBM Power
822L
(24-core, 64GB)
$24,241
$14,708
$17,508
$16,754
$2,998
$ 2,998
$2,998
KVM for Red Hat on x86 (RHEV)
KVM for Red Hat on x86 (RHEV)
KVM for Linux on Power (PowerKVM)
$5,697
$5,697
$4,489
Red Hat subscription and Red Hat
support
Red Hat subscription and Red Hat
support
Red Hat subscription and IBM
support
$23,403
$26,203
$24,241
Dell R730
Dell R730
IBM Power 822L
Two 2.3 GHz , E5-2698, 16-core
Haswell processors
Two 2.3 GHz , E5-2699, 18-core,
Haswell processors
Two 3.0 GHz, 12-core
POWER8 processors
64 GB memory, 2 x 300GB 15k HDD, 10 Gb two port
* Based on US pricing for Power S822L and Gartner Competitive Profiles pricing for Dell as of January 6, 2015
Same memory, HDD, NIC
35
Guest VM
Types
Linux KVM Hypervisor
Optimized for POWER
Phyp Firmware - Hypervisor
Firmware
OPAL Firmware
Hardware Abstraction
Boot services
Standalone Diagnostics
Hardware
P6, P7, P8 Hardware
PowerSystem S822L
Power 8 Linux only Hardware
Stack 100% Open
Host
Software
VIO Server
IO Virtualization
PowerSystem S822L
36
Linux on Power : è realtà
37
PowerKVM… so what?.......Cloud……
Success story at OVH
OVH was Founded 1999
#1 Internet Hosting in Europe (#3 WW)
17 Data Centers (1st biggest WW)
180.000 Physical Servers
700.000 Customers WW
© 2014 International Business Machines Corporation
38
Coherently Attached Protocol Interface (CAPI)… so what?
……Analytics
Identical hardware with 2 different paths to data
40TB Power vs 24TB Intel
12x less energy
6x less space
3x lower price
24:1 consolidation
© 2014 International Business Machines Corporation
infrastructure consolidation savings vs. Intel Xeon for in-memory data
http://techstacks.io/tech/redis
IBM Confidential
39
Open Source Ecosystem: Relational Databases
https://www304.ibm.com/partnerworld/wps/servlet/download/DownloadServlet?id=LQPehnUMv8eiPCA$cnt&
attachmentName=ibm_power_systems_solution_for_postgresql.pdf
https://www.flamingspork.com/blog/2014/06/03/1-million-sql-queries-per-second-mysql-5-7-on-power8/
© 2014 International Business Machines Corporation
40
Open Source Ecosystem: Turbo LAMP
Con l'acronimo LAMP si intende la piattaforma di sviluppo per applicazioni web che si basa sul:
Linux
Apache
MySQL
Php
PHP represents 40% of the web.
Zend is the Enterprise PHP Framework
created by Zeev Suraski and Andi
Gutsman (founders of PHP3).
https://www.zend.com/topics/overview_on_php.pdf
In the application space, J2EE is more
mission-critical and ERP oriented
© 2014 International Business Machines Corporation
41
+
(Sharing experience on some simple benchmark)
I got the
Power !!
(Thomas Vondra)
http://blog.pgaddict.com/posts/performance-since-postgresql-7-4-to-9-4-pgbench
(Sebastien Chabrolles)
42
43