Dovetail ---compliance and certification Hongbo tian OPNFV Value

Dovetail
---compliance and certification
Hongbo tian
OPNFV Value Proposition(s)
•
Exploring what is OPNFV? (Ongoing by the OPNFV community)
•
Identified value propositions
– Driving consensus on NFV-ready platform
– Identifying telco needs/critical gaps in upstream communities
– Platform interoperability assurance
•
Compliance/verification program (CVP) describes plan to test/measure
these
CVP/testing value proposition(s)
•
Service Providers:
– Reduces testing load
– Shortcut for RFPs
•
Vendors
– Defines low bar(s) for OPNFV support
• Meaningful, but not exclusive
– Could be different for different classes of product
•
Organization
– Clearly articulates meaning of the brand/value proposition
Jan 2016
3
Scope and goals of CVP of Dovetail certification
•
alignment with the overall OPNFV
projects for hardware, NFV platform, and
NFV applications.
•
To measure the community on the
maturity and capability of the OPNFV
•
define and provide a set of OPNFV
related validation criteria that will provide
input for the evaluation of the use of
OPNFV trademarks.
Dovetail certification
Jan 2016
4
OPNFV compliance and certification options
•
Self-certification
– Vendor conduct certification test and provide the test report to C&C.
•
OPNFV lab certification
– certification test conducted by OPNFV lab and provide the test report to C&C.
– “OPNFV lab” is an authorized OPNFV member test lab (such as UNH,
CableLabs, BII, etc.)
– start with OPNFV members who are actively developing the certification.
•
3rd party Lab certification
– Certification test conducted by authorized 3rd lab and provide the test report to
C&C.
– “3rd party lab” is an OPNFV non-member lab (such as EANTC).
– might expand to include them in the future
Jan 2016
5
Approach for CVP
•
Incrementally define qualification criteria that establish the foundations to
measure:
– the ability to utilize the OPNFV platform,
– how the platform itself should behave,
– how applications may be deployed on the platform.
•
From the start point
Jan 2016
6
Start point in Colorado release
•
Minimum viable products for(MVP) C release (working in progress, need to
work with C&C together)
– Hardware platform
• Installer setup plus basic test(vPing)
– Software platform
• Functional testing, not performance
• Start with Functest/Yardstick, add capabilities
– IPv6 Overlays, Service Function Chaining, Layer3 VPN
– Basic cloud functions (under discussion)
•
And release after
– MANO(D release)
– more
Jan 2016
7
Test plan
MANO
MANO
New test cases
Start point
IPV6/SFC/L3VPN
VNFI+ VIM
Basic test cases
basic openstack/ODL scenario
functional test
Release C
Jan 2016
Extended basic test cases
Extend test cases
based on D release
Extended start point
Release D
Release E
8
OPNFV compliance and certification framework
Board Member
SPC(strategic plan
committee)
TSC
C&C
Labs, vendors
dovetail
functest
yardstick
etc
9
Jan 2016
Procedures flow(work flow)
•
C&C will define the objective and
governance guideline
•
Dovetail can implement the objective
•
Dovetail focuses on
–
–
Jan 2016
Formalize test plans, test case and
scripts
Create additional automation/scripts
to fill the gap
10
Dovetail deliverables and organization
•
Deliverable:
– Compliance and Certification criteria
– Compliance and Certification Test case selection and creation
•
Basing on Uses case,function and feature recommendation from C&C.
– Compliance and Certification Test Scripts for the test case
•
•
From OPNFV test projects
Maybe dovetail self developed scripts
– ??
•
Organization
– Follow common open source practices,
– Committer and contributors
– More suggestion?
Jan 2016
11
Ways for dovetail management
•
Git and Gerrit
–
–
–
–
–
•
Dovetail project description
Dovetail user guide, i.e., the certification test plan
Document for certification use case/test case selection criteria
Documents for all use cases/test cases and their description used for certification
Scripts that validate the specified use case/test case
Jira: Task for the dovetail
– Task list
– Question and Answer
•
Slides on wiki
– Project home
– For communication: meeting, summit and so on
Jan 2016
12
How to choose test case: criteria
•
Recommended by OPNFV community, including the customers from C&C,
technical recommendations from OPNFV projects, etc.
•
Test case based on the use cases
•
Functional test case only
•
No performance test now
Jan 2016
13
External Collaboration mechanism
•
Who Dovetail should collaborate with and how? E.g
–
–
–
–
Jan 2016
Plugfest
Upstream
Standard organization, e.g ETSI
Community
14