1 2 Document Identifier: DSP-IS0501 3 Date: 2014-06-25 4 Version: 1.0.1a 5 6 Software Defined Data Center (SDDC) Definition A White Paper from the OSDDC Incubator Information for Work-in-Progress version: IMPORTANT: This document is not a standard. It does not necessarily reflect the views of the DMTF or all of its members. Because this document is a Work in Progress, it may still change, perhaps profoundly. This document is available for public review and comment until superseded. Provide any comments through the DMTF Feedback Portal: http://www.dmtf.org/standards/feedback 7 Document Type: White Paper 8 Document Status: Work in Progress 9 Document Language: en-US Software Defined Data Center (SDDC) Definition DSP-IS0501 10 11 Copyright Notice 12 Copyright © 2014 Distributed Management Task Force, Inc. (DMTF). All rights reserved. 13 14 15 16 DMTF is a not-for-profit association of industry members dedicated to promoting enterprise and systems management and interoperability. Members and non-members may reproduce DMTF specifications and documents, provided that correct attribution is given. As DMTF specifications may be revised from time to time, the particular version and release date should always be noted. 17 18 19 20 21 22 23 24 25 26 27 28 29 Implementation of certain elements of this standard or proposed standard may be subject to third party patent rights, including provisional patent rights (herein "patent rights"). DMTF makes no representations to users of the standard as to the existence of such rights, and is not responsible to recognize, disclose, or identify any or all such third party patent right, owners or claimants, nor for any incomplete or inaccurate identification or disclosure of such rights, owners or claimants. DMTF shall have no liability to any party, in any manner or circumstance, under any legal theory whatsoever, for failure to recognize, disclose, or identify any such third party patent rights, or for such party’s reliance on the standard or incorporation thereof in its product, protocols or testing procedures. DMTF shall have no liability to any party implementing such standard, whether such implementation is foreseeable or not, nor to any patent owner or claimant, and shall have no liability or responsibility for costs or losses incurred if a standard is withdrawn or modified after publication, and shall be indemnified and held harmless by any party implementing the standard from any and all claims of infringement by a patent owner for such implementations. 30 31 32 For information about patents held by third-parties which have notified the DMTF that, in their opinion, such patent may relate to or impact implementations of DMTF standards, visit http://www.dmtf.org/about/policies/disclosures.php. 2 Work in Progress Version 1.0.1a DSP-IS0501 Software Defined Data Center (SDDC) Definition 33 CONTENTS 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 Foreword ....................................................................................................................................................... 5 1 Executive summary ............................................................................................................................... 6 1.1 Introduction ................................................................................................................................. 6 2 SDDC technology and functionality ....................................................................................................... 7 2.1 SDDC virtualization, Cloud and relationships ............................................................................. 7 2.2 Server virtualization .................................................................................................................... 9 2.3 Software-defined network ........................................................................................................... 9 2.4 Software-defined storage ............................................................................................................ 9 2.4.1 Attributes of software-defined storage ......................................................................... 10 2.4.2 Necessary Software Defined Storage Functionality .................................................... 10 2.5 Data center abstraction layer .................................................................................................... 11 2.6 Applications/services and SDDC .............................................................................................. 12 3 Barriers to SDDC adoption .................................................................................................................. 13 3.1 General requirements ............................................................................................................... 13 3.2 Authorization and authentication requirements ........................................................................ 13 3.3 Privacy and security requirements ............................................................................................ 14 3.4 Audit, verification, and regulatory requirements ....................................................................... 14 4 Standards activity ................................................................................................................................ 14 4.1 DMTF standards work............................................................................................................... 14 4.1.1 Open SDDC Incubator ................................................................................................. 15 4.1.2 Virtualization Management .......................................................................................... 15 4.1.3 Cloud Management...................................................................................................... 15 4.2 Other related work .................................................................................................................... 16 4.2.1 OASIS - Cloud Application Management for Platforms (CAMP) ................................. 16 4.2.2 OASIS - Topology and Orchestration Specification for Cloud Applications (TOSCA) ...................................................................................................................... 16 4.2.3 SNIA - Cloud Data Management Interface (CDMI) ..................................................... 17 4.2.4 ETSI/ISG – Network Function Virtualization (NFV) ..................................................... 17 4.2.5 IETF/IRTF .................................................................................................................... 17 4.2.6 Open Networking Foundation (ONF) ........................................................................... 18 4.2.7 Open DayLight (ODL) .................................................................................................. 18 4.2.8 Open Data Center Alliance (ODCA) ............................................................................ 18 4.2.9 Storage Network Industry Association (SNIA) ............................................................. 18 5 Conclusion ........................................................................................................................................... 19 6 References .......................................................................................................................................... 19 7 Bibliography ......................................................................................................................................... 19 8 Glossary .............................................................................................................................................. 19 ANNEX A (informative) Change log .......................................................................................................... 22 Version 1.0.1a Work in Progress 3 Software Defined Data Center (SDDC) Definition DSP-IS0501 73 Figures 74 75 76 Figure 1 – Software Defined Data Center architecture ................................................................................. 9 Figure 2 – Data center abstraction layer ..................................................................................................... 12 77 Tables 78 79 Table 1 – Glossary of terms ........................................................................................................................ 19 4 Work in Progress Version 1.0.1a DSP-IS0501 Software Defined Data Center (SDDC) Definition 80 Foreword 81 82 The Software Defined Data Center (SDDC) Definition (DSP-IS0501) was prepared by the Open Software Defined Data Center (OSDDC) Incubator. 83 84 85 The goal of the OSDDC Incubator is to develop SDDC use cases, reference architectures and requirements based on real world customer requirements. Based on these inputs the Incubator will develop a set of whitepapers and set of recommendations for industry standardization for the SDDC. 86 The work coming out of this incubator will result in: 87 1) A clear definition and scope of the SDDC concept. 88 2) New work items to existing chartered working groups. 89 3) Expanded scope to existing chartered groups 90 4) Creation of new working groups, if needed. 91 92 DMTF is a not-for-profit association of industry members dedicated to promoting enterprise and systems management and interoperability. For information about the DMTF, see http://www.dmtf.org. 93 Acknowledgments 94 The DMTF acknowledges the following individuals for their contributions to this document: 95 Ali, Ghazanfar - ZTE Corporation 96 Black, David - EMC 97 Bumpus, Winston - VMWare, Inc. 98 Carlson, Mark – DMTF Fellow 99 Dolin, Rob - Microsoft Corporation 100 Khasnabish, Bhumip – ZTE 101 Leung, John - Intel 102 McDonald, Alex - NetApp 103 Ronco, Enrico - Telecom Italia 104 Snelling, David - Fujitsu 105 Shah, Hemal - Broadcom 106 Wells, Eric - Hitachi, Ltd. 107 Wheeler, Jeff - Huawei 108 Zhdankin, Alex - Cisco Version 1.0.1a Work in Progress 5 Software Defined Data Center (SDDC) Definition Software Defined Data Center (SDDC) Definition 109 110 1 Executive summary 111 112 1.1 Introduction The virtualization and cloud industry continue their evolution with the most recent settling point being the 113 ‘Software Defined Data Center (SDDC)’. 114 115 116 117 118 119 While the SDDC is an evolutionary result of virtualization and cloud computing technologies, the term itself (SDDC) was only coined recently. The reader should find it interesting that the initial definition did not declare the emergence of the ‘Software Defined Cloud’ but rather the ‘Software Defined Data Center’. 120 121 122 123 To date, the SDDC has been defined in many ways. The following examples are a few of the more prevalent (and realistic) definitions gleaned from the large list of resources used for this paper: “A software-defined data center (SDDC) is a data storage facility in which all elements of the infrastructure – networking, storage, CPU and security – are virtualized and delivered as a service. Deployment, provisioning, configuration and the operation, monitoring and automation of the entire infrastructure is abstracted from hardware and implemented in software.” 124 125 126 127 128 DSP-IS0501 Another: 129 130 “SDDC is the phrase used to refer to a data center where the entire infrastructure is virtualized and delivered as a service.” 131 132 133 134 135 Regardless of the definition, it is clear that the move to the SDDC is the major technology shift of this decade. While other definitions have been proposed by various vendors and standards development organizations (SDOs), they all have similar, if not identical, intent or wording. Very few definitions of an SDDC actually offer any substantial or comprehensive information that a person seeking to understand just what exactly an SDDC is would find useful. 136 137 The balance of this paper will present evidence that there is a major difference between cloud computing and an SDDC and that each is a separate collection of technologies, products, and services. 138 1.2 139 140 The SDDC domain is proof of the continuing evolution of virtualization through cloud computing into SDDC technologies. 141 142 143 144 145 146 Cloud computing was the new operational model for IT Services built upon foundational and fundamental virtualization technologies. While cloud computing uses virtualization technologies and/or converged Infrastructure as a Service (IaaS) approaches, it is still focused on the delivery and consumption of IT Services. SDDC, as the next phase in the evolution of this entire technology domain, promises to deliver more intelligent services, better management solutions and value on top of these commodity and standardized hardware platforms. 147 148 149 An SDDC is a data center or cloud computing infrastructure in which all elements of the infrastructure including networking, storage, compute, and security, are virtualized and delivered as a service to the consumer. An SDDC infrastructure is abstracted from the entire underlying physical infrastructure (and 6 SDDC definition Work in Progress Version 1.0.1a DSP-IS0501 Software Defined Data Center (SDDC) Definition 150 151 even the virtual infrastructure in some cases). This abstraction enables programmatic and automated provisioning, deployment, configuration, and management of the SDDC. 152 2 SDDC technology and functionality 153 154 155 156 157 158 SDDC incorporates and is heavily dependent upon the use of topologies that abstract, pool, and automate the use of the virtualized resources. Virtualization technologies can be thought of as a commodity, or common resources when integrated and used by SDDC. The focus on industry standardized management models and application programming interfaces (APIs) provides this level of abstraction. Various vendors and SDOs are championing their respective offerings into the new SDDC community. 159 The SDDC should be: 160 Standardized- at the API and functional model aspects initially 161 Holistic- by using the abstractions from the hardware layer provided by the SDDC functionality 162 Adaptive- with elasticity being more directed and rooted by and in the Business logic 163 Automated- in provisioning, configuration, operational and run-time management aspects 164 Core SDDC features and functionalities include: 165 Abstraction of compute, network, and storage resources 166 Virtualization of network resources and services 167 Image automation and library support for templates 168 Topology automation and standardization 169 Virtualization of object, block and file storage 170 171 Topology centric services for traditional ‘edge’ features like security, IDS / HIDS, AAA, Firewall, Load balancing and so on 172 2.1 SDDC virtualization, Cloud and relationships 173 174 175 Virtualization is central to the SDDC. The four major building blocks that virtualization delivers are: network virtualization, CPU virtualization, memory virtualization, and to a lesser agreed upon service, storage virtualization. Note that ‘Software Defined xxx’ is not the same as ‘virtualized xxx’; for example: 176 A virtual network is not the same as a software defined network (SDN); 177 A virtual CPU is not the same as a Software Defined CPU; 178 Virtual memory is not the same as SD Memory; and 179 Virtual storage is not the same as SD Storage. 180 There are three primary components to Virtualization that carry over to the SDDC: 181 182 183 1. Storage Virtualization – enables the pooling of physical storage facilities and devices from various physical networked devices into what appears to be a single storage pool managed by a centralized management service/console. 184 185 186 187 2. Compute Virtualization (or server virtualization) - incorporates the masking, or abstracting of the underlying collection of physical server resources from the end user/consumer. This concept includes the abstracting of the number and identity of physical servers, associated processors, memory and operating systems. The abstraction allows the complexity of the underlying Version 1.0.1a Work in Progress 7 Software Defined Data Center (SDDC) Definition 188 189 DSP-IS0501 infrastructure to be hidden from the user/consumer though this complexity is still required to be managed by someone, most likely the provider. 190 191 192 193 194 195 196 3. Network Virtualization - represents the most difficult of all areas contributing to the SDDC solutions. The virtualization of network resources combines the available network resources (services, bandwidth, LAN, WAN, VLANs, Security, etc.) into a resource pool that provides subsets of the whole to virtual machines as the physical networks provide these to physical servers. The use of network virtualization in Cloud and SDDC is lagging the other two primary areas largely due to the complexity, vendor proprietary technologies, various standards and methods in place today in physical network environments. 197 198 199 Control of the SDDC is automated by software. Management of the SDDC is different than management of the physical Data Center. A business logic layer is required to integrate and translate application requirements, SLAs, policies, and other legacy considerations. 200 SDDC differs from Cloud and Virtualization in these ways: 201 202 203 204 205 SDDC is not defined nor is it focused on a standardized IT solution. Aspects of Cloud and Virtualization are standardized with cross-SDO work driving them as well. Only the DMTF currently has a focus on SDDC as an SDO. Various consortia and forums are beginning to discuss the needs for a standardized approach but there are none of these in a position of creating or driving an SDDC to a national or international standard and specification. 206 207 208 SDDC builds upon the successes of Server Virtualization, broadening the individual components of the Data Center (DC) that have been virtualized, and envisioning a unified control console/management solution. 209 210 211 Cloud is a relatively new IT operational model (and marketing model) focusing on the delivery and consumption of IT Services. Even the underlying complexities of the physical and virtualized environments are abstracted from the consumer (as in PaaS and SaaS today). 212 213 214 SDDC extends this operational model by further refining and expanding upon the three traditional delivery models of cloud computing; that is, infrastructure, platform, and software as a service (IaaS, PaaS and SaaS respectively). 215 SDDC does not simplify the complexity or management of the physical DC environment. 216 217 218 219 220 The physical Data Center (pDC) will still be the major underlying component for any virtualized, Cloud or SDDC solution, regardless of vendor. The pDC will still be required as the basis for the virtualized and Cloud services. The provider, carrier or intermediary will still have all of the complexity of managing and operating the pDC as they do today. An SDDC, however, may enable more efficient usage of pDC. 221 222 Many of the improvements brought about by the focus on Cloud and SDDC are actually taking place in the physical data center infrastructure like data center fabric. 223 224 225 The physical hardware underlying the SDDC and Cloud is becoming ‘commoditized’ by processor and network equipment manufacturers that allow for faster and simpler Cloud and SDDC environments that can be managed by centralized tools. 226 227 The use of IaaS, PaaS and SaaS has led to a need for greater operational efficiencies and a more abstract management software layer than can be provided by Cloud. 228 229 De facto vendors in Cloud are looking to provide SDDC with a greater scope than the scope of services that can be delivered by Cloud. 230 231 SDDC does indeed compete in the traditional sense with PaaS and SaaS and will do more so as consumers adopt further Private and Hybrid Clouds. 232 233 Cloud cannot deliver on the promise of full mobility and BYOD (bring-your-own-device), whereas SDDC can for any enterprise consumer. 8 Work in Progress Version 1.0.1a DSP-IS0501 Software Defined Data Center (SDDC) Definition 234 Figure 1 – Software Defined Data Center architecture 235 236 237 238 239 An SDDC architecture defines data center resources in terms of software. Specifically, it releases compute, network, and storage from hardware limitations and increases service agility. This can be considered an evolution from server virtualization to complete virtualization of the data center. 240 2.2 241 242 243 Server virtualization releases CPU and memory from the limitations of underlying physical hardware. As a standard infrastructure technology, server virtualization is the basis of the SDDC, which extends the same principles to all infrastructure services. 244 2.3 245 246 247 248 In a software-defined network (SDN), the network control plane is moved from the switch to the software running on a server. This improves programmability, efficiency, and extensibility. There has been much technical development and implementation of SDN. This paper does not delve into the details of this vibrant software-defined component. 249 2.4 250 251 252 253 Software-defined storage (SDS) is an ecosystem of products that decouples software from underlying storage network hardware. This software makes visible all physical and virtual resources and enables programmability and automated provisioning based on consumption or need. SDS separates the control plane from the data plane and dynamically leverages heterogeneity of storage to respond to changing Server virtualization Software-defined network Software-defined storage Version 1.0.1a Work in Progress 9 Software Defined Data Center (SDDC) Definition DSP-IS0501 254 255 workload demands. The SDS enables the publishing of storage service catalogs and enables resources to be provisioned on-demand and consumed according to policy. 256 257 258 259 In many respects, SDS is more about packaging and how IT users think about and design data centers. Storage has been largely software defined for more than a decade: the vast majority of storage features have been designed and delivered as software components within a specific storage-optimized environment. 260 2.4.1 261 The following attributes of SDS are typically seen in the market: Attributes of software-defined storage 262 263 May allow customers to “build it themselves,” providing their own commodity hardware to create a solution with the provided software. 264 265 May work with either arbitrary hardware or may also enhance the existing functions of specialized hardware. 266 May also enable the scale-out of storage (not just the scale up typical of big storage boxes). 267 Nearly always includes the pooling of storage and other resources. 268 May allow for the building of the storage and data services “solution” incrementally. 269 Incorporates management automation. 270 Includes a self-service interface for users. 271 272 273 Includes a form of service level management that allows for the tagging of metadata to drive the type of storage and data services applied. The granularity may be large to start, but is expected to move to a finer grained service level capability over time. 274 Allows administrators to set policy for managing the storage and data services. 275 Enables the disaggregation of storage and data services. 276 277 278 The SNIA definition of SDS allows for both proprietary and heterogeneous platforms. What is necessary to meet the SNIA definition is that the platform offers a self-service interface for provisioning and managing virtual instances of itself. 279 2.4.2 280 281 Because many storage offerings today have already been abstracted and virtualized, what capabilities should be offered to claim the title of Software Defined Storage? 282 Software Defined Storage should include: Necessary Software Defined Storage Functionality 283 284 Automation – Simplified management that reduces the cost of maintaining the storage infrastructure. 285 286 Standard Interfaces – APIs for the management, provisioning and maintenance of storage devices and services. 287 288 Virtualized Data Path – Block, File, and Object interfaces that support applications written to these interfaces. 289 290 Scalability – Seamless ability to scale the storage infrastructure without disruption to availability or performance. 291 292 293 Ideally, SDS offerings allow applications and data producers to manage the treatment of their data by the storage infrastructure without the need for intervention from storage administrators, without explicit provisioning operations, and with automatic service level management. In addition, data services should 10 Work in Progress Version 1.0.1a DSP-IS0501 294 295 Software Defined Data Center (SDDC) Definition be able to be deployed dynamically and policies should be used to maintain service levels and match the requirements with capabilities. Metadata should be used to 296 express requirements 297 control the data services 298 express service level capabilities 299 2.5 300 301 302 303 304 Data centers are complex as they contain a wide variety of devices (compute, storage, networks, power management, etc.) and often these devices are from multiple vendors. There is no standard and consistent mechanism for managing all the devices or even classes of devices. Devices are often managed by using vendor proprietary solutions. The data center abstraction layer (DAL) provides a set of standards to abstract this complexity: 305 Data center abstraction layer Increased cost. 306 307 308 Increased people cost due to added complexity that result in the need to spend more on training. As a result the IT budget shifts from vendor spend into system integrators and inhouse staff. 309 310 Management applications and skills need to be updated every time a new device/vendor is brought in. 311 312 Higher operational cost due to inconsistent management technologies, standards, and different security/application models. 313 314 Higher chance for errors and downtime due to the inconsistencies listed above, which impact the ability to automate. 315 Less Agility: 316 317 – Fewer choices in hardware due to high cost of entry for new independent hardware vendors (IHVs) to compete with existing proprietary ecosystems. 318 319 – Onboarding a new device requires updating management applications and processes, which reduces the agility in onboarding new devices and vendors. 320 321 322 323 – Inconsistent management technologies results in a complex and tightly coupled data center architecture. Any change in one layer or one element often requires changes in multiple other layers/elements. This results in an environment where change cannot be done rapidly. 324 325 – Hinders the ability to manage the fabric and the data center as a single entity. Becomes hard to orchestrate change across heterogeneous environment. 326 327 328 The DAL name was inspired by HAL (the Hardware Abstraction Layer). Twenty years ago, the industry got together to solve a very common problem: “How do we abstract the hardware layer from the application and services that the OS provides?” 329 330 331 332 333 334 The idea was to define the elements that should be abstracted, and then develop the necessary protocols and standards to manage and interact with these elements. After new elements plug in to HAL, the OS layer would know how to deal with them. The HAL provided a consistent interface for the operating system and applications to interface with the hardware devices without worrying about which provider the devices came from. This reduced the overall cost of PCs and also provided great agility/choice in selection of hardware devices. 335 336 The HAL is the right abstraction when working with a single PC or a single server. Thinking around the same lines as HAL, we should do the same thing with the data center. We should abstract the elements Version 1.0.1a Work in Progress 11 Software Defined Data Center (SDDC) Definition 337 338 DSP-IS0501 in the data center and make them available as a set of standards resources to the software-defined layers in the SDDC. DAL in essence is “abstracting the underlying resources in the context of a data center”. 339 Figure 2 – Data center abstraction layer 340 341 The DAL approach enables 342 devices to participate in data center management by implementing standard interfaces, 343 344 345 higher level management applications to manage devices in a data center in a consistent manner (using DMTF standards based protocol (such as WS-MAN) and a consistent model (such as CIM)) and without requiring any device-specific changes in management applications. 346 2.6 Applications/services and SDDC 347 348 349 One of the more difficult functional challenges that SDDC is inheriting from Cloud is the area of ‘Applications’. The main areas of difficulty challenging users, vendors, and providers in respect to applications and SDDC are as follows: 350 351 352 353 Mobility - The introduction of application mobility by the Cloud. Applications are moved between systems, hosts, racks, chassis, pods, sites, and geographies with their Virtual Machine context in order to provide application and resource scaling and elasticity. In order to address these issues the SDDC providers and consumers will have to: 354 355 – modify the underlying application code directly adding the capabilities for state management across the physical and virtual resources; or 356 357 358 – provide synthetic socket calls that directly intercept the applications communications with the SDDC and redirect to appropriate code allowing the necessary resources and services for applications mobility; or 359 360 361 362 – add ‘shims’ or proxy layers between the applications and the stock/standardized socket calls that the applications use. These shims or proxies will filter the appropriate information to and from the applications and underlying virtual resources to provide fundamental applications mobility in an SDDC environment. 363 364 365 Common APIs - The lack of common application to SDDC or application to Cloud APIs. Most APIs coming from SDOs today are focused on fundamental IaaS enablement and management, and are not providing application to SDDC capabilities. 366 367 Interoperability and Federation - The inability today for an application to seamlessly operate across multiple Cloud or SDDC environments using necessary resources from each. In order to 12 Work in Progress Version 1.0.1a DSP-IS0501 368 369 Software Defined Data Center (SDDC) Definition accomplish this feature today in Clouds the provider must implement a wide range of applications and management solutions. 370 371 372 373 Standardization - The lack of standardized means to provide for application creation and use of ‘mashups’ in the Cloud or SDDC environments. In order to run natively in any SDDC the application will have to be more of a composite of other applications than a silo of a single fork or tree of code. 374 375 While the use of SDDC is supposed to free up the application layer from the hardware layer, the SDDC does introduce both new and complex functionality for the application layer. 376 3 Barriers to SDDC adoption 377 378 There are many barriers to the adoption of SDDC in the current virtualization and Cloud industry by providers, brokers, and consumers. A few of the key ones are listed in this section. 379 3.1 380 381 382 383 The existing base of custom and/or expensive and complex monitoring and management software on both the provider and consumer sites. There is a complete industry built around management solutions for existing data centers including certifications (CCIE, MCSE, etc.,) and compliance/conformance solutions. General requirements 384 385 386 Industry and global standards for physical DCs that extend to the equipment penetration point of the consumer. It is very difficult to parse this responsibility if the logical/virtual/SDDC topology does not align up with the physical or virtual. 387 388 389 390 Specialized hardware costs and deployments are understood as value-add. Solutions like Fiber Channel for SANs. Providers are not going to be willing to abandon their current infrastructure components if they do not natively support SDDC for the promise of market share or revenue that might be a long time in coming. 391 392 393 394 The necessary isolation of workloads, users, and services, as well as logical and virtual devices provided by today’s current implementations. This level of intelligence and service will be abstracted out to the software layer if the SDDC pundits have their way. The likelihood of this happening quickly is not a viable assumption. 395 396 397 Support for multi-tenancy to the hardware level. Because SDDC will not have a control or management plane that affects/effects the hardware level, SDDC will struggle to establish and maintain the level of isolation and security that an existing pDC afford today. 398 399 400 401 There is not a one-for-one mapping of the features and functionality provided by the virtualization and Cloud domains into the SDDC domain. SDDC is not lockstep marching with Cloud, but diverges at even the initial stages. Cloud computing did not require a serious look at applications or software reengineering but SDDC does if the SDDC is to be used optimally. 402 3.2 403 404 In this section we discuss authorization and authentication requirements for SDDC. The following are some of the major topics. Authorization and authentication requirements 405 406 Data, content, and media authenticity: Association and identification of data to its owner (user, enterprise consumer, service provider, location, etc.) and access privileges. 407 Role-based and privilege-based access to video surveillance content and alarm notifications. 408 409 Perimeter security of the virtualized data center operations and real-time insight into security issues to the provider and to the enterprises using their services. Version 1.0.1a Work in Progress 13 Software Defined Data Center (SDDC) Definition DSP-IS0501 410 Business-hours-based security monitoring of provider assets. 411 412 413 Control for customers during self service - ability for customers to maintain effective control of their workloads even though the protection mechanisms and even the locations of workloads may not be known to customers. 414 415 Protection of virtual machines, network traffic, actual/residual data, and other resources of a tenant against unauthorized access by another tenant. 416 3.3 Privacy and security requirements 417 418 419 In this section we discuss privacy and security requirements for SDDC. The main concern here is the management of the life cycle of data, including data privacy and security while in use, in motion, or at rest within a virtualized infrastructure environment. 420 421 422 Data while in use: (a) Isolation of data while in use by the computing resources, and (b) Management of the data usage based on access privileges of the users, enterprise consumer, and service providers. 423 424 425 Data in motion: Restriction of the data transmission across geographical boundaries based on government regulations or enterprise policies and configurations defined during self-service setup. 426 427 428 429 430 3.4 Data at rest (monitoring and management): (a) Data isolation in a multitenant environment to protect against side attack (across tenants) or admin attacks; (b) Data migration managed as defined by enterprise/government policies; (c) Deletion, loss/leakage, and location of data.Audit, verification, and regulatory requirements 431 432 In this section we discuss audit, verification, and regulatory (both domestic and international) requirements for SDDC. The following points need consideration beyond the traditional requirements: 433 434 435 436 437 438 Governance, risk, and compliance: (a) Clear certification and accreditation guidelines; (b) Clear e-discovery guidelines; (c) Virtualization audit assurance and log sensitivity management; (d) Need for clarity on how the NIST SP 800-53-style control guides (http://csrc.nist.gov/publications/nistpubs/800-53A-rev1/sp800-53A-rev1-final.pdf) can work in virtualized environment; (e) Need of clear guidelines for privacy, and lawful interception in the virtualized service environment. 439 Backup and recovery of information (import/export across multiple service providers). 440 441 Business continuity and disaster recovery: How to maintain continuity of operations by having redundancy: (a) within the same provider, and (b) across multiple service providers? 442 4 Standards activity 443 4.1 444 445 446 447 DMTF standards enable effective management of IT environments through well-defined interfaces that collectively deliver complete management capabilities. DMTF standard interfaces are critical to enabling interoperability among multi-vendor IT infrastructures, and systems and network management including cloud computing, virtualization, desktop, network, servers and storage. 448 449 Some of the key DMTF standards and initiatives that will enable the new SDDC paradigm are described below. 14 DMTF standards work Work in Progress Version 1.0.1a DSP-IS0501 Software Defined Data Center (SDDC) Definition 450 4.1.1 Open SDDC Incubator 451 452 453 The DMTF is the only SDO currently that is focusing on developing initial management models for the SDDC marketplace. The DMTF recently launched its ‘SDDC Incubator’ with the charter of directing all future work in the DMTF for SDDC. 454 4.1.2 455 456 DMTF’s Virtualization Management (VMAN) initiative includes a set of specifications and profiles that address the management life cycle of a heterogeneous virtualized environment. 457 4.1.3 458 459 Technologies like cloud computing and virtualization are rapidly being adopted by enterprise IT managers to better deliver services to their customers, lower IT costs, and improve operational efficiencies. 460 461 462 463 DMTF's Cloud Management Initiative is focused on developing interoperable cloud infrastructure management standards and promoting adoption of those standards in the industry. The work of DMTF working groups promoted by the Cloud Management Initiative is focused on achieving interoperable cloud infrastructure management between cloud service providers and their consumers and developers. 464 Cloud Infrastructure Management Interface (CIMI) 465 466 467 468 469 CIMI is a self-service interface for infrastructure clouds, allowing users to dynamically provision, configure, and administer their cloud usage with a high-level interface that greatly simplifies cloud systems management. The specification standardizes interactions between cloud environments to achieve interoperable cloud infrastructure management between service providers and their consumers and developers, enabling users to manage their cloud infrastructure use easily and without complexity. 470 Open Virtualization Format (OVF) 471 472 473 474 475 476 477 478 The OVF specification provides a standard format for packaging and describing virtual machines and applications for deployment across heterogeneous virtualization platforms, OVF was adopted by the [4] American National Standards Institute in August 2010. OVF was adopted as an International Standard in August 2011 by the Joint Technical Committee 1 (JTC 1) of the International Organization for [1] Standardization (ISO), and the International Electrotechnical Commission (IEC). In January 2013, DMTF released the second version of the standard, OVF 2.0, which applies to emerging cloud use cases and provides important developments from OVF 1.0 including improved network configuration support and package encryption capabilities for safe delivery. 479 Web-Based Enterprise Management (WBEM) 480 481 482 483 484 485 486 487 488 WBEM defines protocols for the interaction between systems management infrastructure components implementing CIM, a concept of DMTF management profiles, that allows defining the behavior of the elements defined in the CIM Schema, the CIM Query Language (CQL) and other specifications needed for the interoperability of CIM Infrastructure Common (CIM) – The CIM Schema is a conceptual schema that defines how the managed elements in an IT environment (for instance computers or storage area networks) are represented as a common set of objects and relationships between them. CIM is extensible in order to allow product specific extensions to the common definition of these managed elements. CIM uses a model based upon UML to define the CIM Schema. CIM is the basis for most of the other DMTF standards. 489 Configuration Management Database Federation (CMDBf) 490 491 CMDBf facilitates the sharing of information between configuration management databases (CMDBs) and other management data repositories (MDRs). The CMDBf standard enables organizations to federate and Virtualization Management Cloud Management Version 1.0.1a Work in Progress 15 Software Defined Data Center (SDDC) Definition DSP-IS0501 492 493 access information from complex, multi-vendor infrastructures, simplifying the process of managing related configuration data stored in multiple CMDBs and MDRs. 494 Systems Management Architecture for Server Hardware (SMASH) 495 496 497 498 499 500 501 502 503 504 DMTF's SMASH standards are a suite of specifications that deliver architectural semantics, industry standard protocols and profiles to unify the management of the data center. The SMASH Server Management (SM) Command Line Protocol (CLP) specification enables simple and intuitive management of heterogeneous servers in the data center. SMASH takes full advantage of the DMTF's Web Services for Management (WS-Management) specification - delivering standards-based Web services management for server environments. Both provide server management independent of machine state, operating system state, server system topology or access method, facilitating local and remote management of server hardware. SMASH also includes the SM Managed Element Addressing Specification, SM CLP-to-CIM Mapping Specification, SM CLP Discovery Specification, SM Profiles, as well as a SM CLP Architecture White Paper. 505 4.2 506 507 All standards-related work in the SDDC arena is so new that there is nothing to report other than the formation of the DMTF OSDDC Incubator. Work in other SDOs is purely focused on SDN, not SDDC. 508 4.2.1 509 510 511 512 The OASIS CAMP advances an interoperable protocol that cloud implementers can use to package and deploy their applications. CAMP defines interfaces for self-service provisioning, monitoring, and control. Based on REST, CAMP is expected to foster an ecosystem of common tools, plug-ins, libraries, and frameworks, which will allow vendors to offer greater value-add. 513 Common CAMP use cases include: Other related work OASIS - Cloud Application Management for Platforms (CAMP) 514 moving on-premises applications to the cloud (private or public) 515 redeploying applications across cloud platforms from multiple vendors 516 517 4.2.2 518 519 520 521 522 523 The TOSCA TC substantially enhances the portability of cloud applications and the IT services that comprise them running on complex software and hardware infrastructure. The IT application and service level of abstraction in TOSCA will also provide essential support to the continued evolution of cloud computing. For example, TOSCA would enable essential application and service life cycle management support, e.g., deployment, scaling, patching, etc., in Software Defined Environments (SDE), such as Software Defined Data Centers (SDDC) and Software Defined Networks (SDN). 524 525 526 527 528 TOSCA facilitates this goal by enabling the interoperable description of application and infrastructure cloud services, the relationships between parts of the service, and the operational behavior of these services (e.g., deploy, patch, shutdown) independent of the supplier creating the service, and any particular cloud provider or hosting technology. TOSCA enables the association of that higher-level operational behavior with cloud infrastructure management. 529 530 531 532 TOSCA models integrate the collective knowledge of application and infrastructure experts, and enable the expression of application requirements independently from IaaS- and PaaS-style platform capabilities. Thus, TOSCA enables an ecosystem where cloud service providers can compete and differentiate to add value to applications in a software-defined environment. 533 534 These capabilities greatly facilitate much higher levels of cloud service/solution portability, the continuous delivery of applications (DevOps) across their life cycle without lock-in, including: 16 OASIS - Topology and Orchestration Specification for Cloud Applications (TOSCA) Work in Progress Version 1.0.1a DSP-IS0501 Software Defined Data Center (SDDC) Definition 535 Portable deployment to any compliant cloud 536 Easier migration of existing applications to the cloud 537 538 Flexible selection and movement of applications between different cloud providers and cloud platform technologies 539 Dynamic, multi-cloud provider applications 540 4.2.3 541 542 543 544 The SNIA Cloud Data Management Interface (CDMI) is an ISO/IEC standard that enables cloud solution vendors to meet the growing need of interoperability for data stored in the cloud. The CDMI standard is applicable to all types of clouds – private, public, and hybrid. There are currently more than 20 products that meet the CDMI specification. 545 546 CDMI provides end users with the ability to control the destiny of their data and ensure hassle-free data access, data protection, and data migration from one cloud service to another. 547 Metadata in CDMI 548 549 550 551 552 553 The Cloud Data Management Interface (CDMI) uses many different types of metadata, including HTTP metadata, data system metadata, user metadata, and storage system metadata. To address the requirements of enterprise applications and the data managed by them, this use of metadata allows CDMI to deliver simplicity through a standard interface. CDMI leverages previous SNIA standards, such as the eXtensible Access Method (XAM), for metadata on each data element. In particular, XAM has metadata that drives retention data services useful in compliance and eDiscovery. 554 555 556 557 558 CDMI’s use of metadata extends from individual data elements and can apply to containers of data, as well. Thus, any data placed into a container essentially inherits the data system metadata of the container into which it was placed. When creating a new container within an existing container, the new container would similarly inherit the metadata settings of its parent container. Of course, the data system metadata can be overridden at the container or individual data element level, as desired. 559 560 561 562 563 The extension of metadata to managing containers, not just data, enables a reduction in the number of paradigms for managing the components of storage – a significant cost savings. By supporting metadata in a cloud storage interface standard and proscribing how the storage and data system metadata is interpreted to meet the requirements of the data, the simplicity required by the cloud storage paradigm is maintained, while still addressing the requirements of enterprise applications and their data. 564 4.2.4 565 566 567 568 569 570 571 The first use case of ETSI/ISG NFV discusses NFV Infrastructure as a Service (NFVIaaS), which may have a lot of similarity with SDDC. The NFVI includes compute, networking, and storage infrastructure in virtualized forms. NFVIaaS calls for combining and interconnecting network as a service (NaaS), and other compute/storage Infrastructure as a Service (IaaS) in order to provide virtual network function (VNF) to the network administrators. The VNFs from different administrative domains can be interconnected and clustered for developing an end-to-end service. The NFV use case document is available at the following URL: 572 http://www.etsi.org/deliver/etsi_gs/NFV/001_099/001/01.01.01_60/gs_NFV001v010101p.pdf. 573 4.2.5 574 575 576 There are a few IETF and IRTF working/research groups (WGs/RGs) and drafts that discuss Virtual Data Center (VDC). The concept of VDC and the service that can be offered by using VDC are very similar to the SDDC concept that we discuss here in this paper. SNIA - Cloud Data Management Interface (CDMI) ETSI/ISG – Network Function Virtualization (NFV) IETF/IRTF Version 1.0.1a Work in Progress 17 Software Defined Data Center (SDDC) Definition DSP-IS0501 577 578 579 The NVO3 (Network Virtualization Overlays/Over-Layer-3) Working Group (WG) focuses on developing interoperable solution for traffic isolation, address independence, and virtual machine (VM) migration in Data Center Virtual Private Network (DCVPN). 580 581 582 583 DCVPN is defined as a VPN that is viable across a scaling range of a few thousand VMs to several million VMs running on more than 100,000 physical servers. DCVPN supports several million endpoints and hundreds of thousands of VPNs within a single administrative domain. Further details about IETF NVO3 activities can be found at http://datatracker.ietf.org/wg/nvo3/charter/. 584 585 586 The SCIM (System for Cross-domain Identity Management) WG is developing the core schema and interfaces based on HTTP and REST for creating, reading, searching, modifying, and deleting user identities and identity-related objects across administrative domains. 587 588 589 590 Initial focus areas of the SCIM WG are developing a core schema definition, a set of operations for creation, modification, and deletion of users, schema discovery, read and search, bulk operations, and mapping between the inetOrgPerson LDAP object class (RFC 2798) and the SCIM schema. Further details on IETF SCIM activities can be found at http://datatracker.ietf.org/wg/scim/charter/. 591 592 593 594 595 The SDN (Software-Defined Networking) Research Group (RG) is currently focusing on developing definition and taxonomy for SDN. Future work may include a study of model scalability and applicability, multi-layer programmability and feedback control system, network description languages, abstractions, interfaces and compilers, and security-related aspects of SDN. Further details about IRTF SDN activities can be found at https://irtf.org/sdnrg. 596 4.2.6 597 598 ONF has developed a southbound interface (SBI; south of the controller) called OpenFlow™ in order to enable remote programming of the flow forwarding. 599 600 Currently ONF is focusing on Software-Defined Networking (SDN) related issues especially the concepts, frameworks, and architecture. 601 602 603 The network segmentation, multi-path multi-tenancy support, and security-related activities of the Forwarding Abstraction WG, Northbound Interface (NBI) WG, Configuration and Management WG, Layer 4-7 Services DG, and Security DG may be very helpful for open SDDCs and their interconnections. 604 4.2.7 605 606 607 608 609 ODL focuses on control and programmability of the abstracted network functions and entities. The objective is to develop northbound interfaces (NBIs) for gathering network intelligence including performing analytics, and then use the controller to orchestrate adaptive new rules throughout the network for efficient automated operations. Detailed technical overview of ODL initiatives is available at http://www.opendaylight.org/project/technical-overview. 610 611 ODL supports OpenFlow and other protocols as SBIs, and released Base (Enterprise), Virtualization, and Service Provider editions of the software packages (http://www.opendaylight.org/software). 612 4.2.8 613 614 615 ODCA initiatives and activities are focused on developing open, interoperable solutions for secure cloud federation, automation of cloud infrastructure, common management, and transparency of cloud service delivery. 616 4.2.9 617 In this section we discuss SNIA (http://www.snia.org/) initiatives and current work related to SDDC. 18 Open Networking Foundation (ONF) Open DayLight (ODL) Open Data Center Alliance (ODCA) Storage Network Industry Association (SNIA) Work in Progress Version 1.0.1a DSP-IS0501 Software Defined Data Center (SDDC) Definition 618 5 Conclusion 619 620 621 622 623 624 To realize an SDDC, data center resources, such as compute, network, and storage, are expressed as software. They also need to have certain characteristics, such as multi-tenancy; rapid resource provisioning; elastic scaling; policy-driven resource management; shared infrastructure; instrumentation; and self-service, accounting, and auditing. This ultimately entails a programmable infrastructure that enables valuable resources to be automatically cataloged, commissioned, decommissioned, repurposed, and repositioned. 625 6 References 626 627 S. Karavettil et al, “Security Framework for Virtualized Data Center Services, IETF discussion draft (http://tools.ietf.org/id/draft-karavettil-vdcs-security-framework-05.txt), June 2013. 628 7 Bibliography 629 630 8 Glossary Table 1 – Glossary of terms 631 Acronym or Phrase Definition Explanation AAA Authentication, Authorization, and Auditing API Application Programming Interface Block storage BYOD Bring Your Own Device Cloud Cloud Computing Fiber Channel File storage The three major areas of concern in system security Firewall IaaS Infrastructure as a Service An interface used by an application program to request services. The term API is usually used to denote interfaces between applications and the software components that compose the operating environment (e.g., operating system, file system, volume manager, device drivers, etc.) Source: http://www.snia.org/education/dictionary/ a Version 1.0.1a Work in Progress 19 Software Defined Data Center (SDDC) Definition Acronym or Phrase IDS HIDS DSP-IS0501 Definition Explanation Intrusion Detection System Storage organized and allocated in blocks of fixed size. Host Intrusion Detection Systems The policy of permitting employees to bring personally owned mobile devices (laptops, tablets, and smart phones) to their workplace, and to use those devices to access privileged company information and applications Source: http://en.wikipedia.org/wiki/Bring_your_o wn_device LAN Local Area Network A high-speed LAN technology, most commonly used for SAN’s. Load Balancing Metadata Network Attached Storage A device, often implemented in software, to control data flows between two or more networks. Firewalls typically reject network traffic that does not originate from trusted address and/or ports and thus provides a degree of isolation between networks. PaaS Platform as a Service A system used to detect unauthorized access to resources. pDC Physical Data Center An IDS specifically designed to protect host systems. SaaS Software as a Service SAN Storage Area Network NAS Object storage SDDC 20 A mechanism used to distribute demands for resources amongst those available. Usually used in reference to processing resources but may be applied to any resource. Software Defined Data Center SDN Software Defined Network SDO Standards Development Organization SDS Software Defined Storage Work in Progress Version 1.0.1a DSP-IS0501 Acronym or Phrase Software Defined Data Center (SDDC) Definition Definition Explanation Virtual Appliance VLAN Virtual LAN WAN Wide area network A storage system consisting of storage elements, storage devices, computer systems, and/or appliances, plus all control software, communicating over a network. Source: http://www.snia.org/education/dictionary/ s#storage_area_network Copyright Version 1.0.1a SNIA http://www.snia.org/education/dictio nary/s Wikipedia Creative Commons AttributionSharealike 3.0 Unported License Work in Progress 21 Software Defined Data Center (SDDC) Definition DSP-IS0501 ANNEX A (informative) 632 633 634 635 Change log 636 Date Author Comments 2014-03-07 Hemal Shah Initial draft 2014-04-03 Winston Bumpus Added DMTF Standards 2014-06-13 Working Session Merged updates and comments – Draft 9 2014-06-19 Bhumip Khasnabish Added requirements and SDO overviews 2014-06-24 Eric Wells Glossary & formatting 2014-06-25 Version 1.0.1a Work in Progress 637 22 Work in Progress Version 1.0.1a
© Copyright 2026 Paperzz