Model Interchange Working Group (MIWG)
Interchange Testing Roadmap
Draft
January 16, 2012
http://www.omgwiki.org/model-interchange
Sanford Friedenthal
MIWG Chair
[email protected]
Roadmap Goals
• Extend interchange testing to address
– additional functionality of UML and SysML
– additional profiles (SoaML and UPDM)
– additional versions (UML 2.4.1, SysML 1.3)
– operational testing (e.g., industrial strength)
– other testing (e.g., diagram interchange)
• Conduct in most efficient and timely manner
01-16-2012
2
Approach
• Define what test cases are needed
• Define release schedule that sequences the test cases
• Agree on updated testing process
– Create diagram from reference diagram, generate xmi
export, transform to canonical XMI, and validate against
reference canonical XMI
– Vendors should also import both the reference canonical
XMI and the reference non-canonical XMI file and recreate
diagram and validate against the reference diagram
• Unresolved as to whether vendors should import, one, the other or
both. Need vendor input.
• Do vendors want to commit to canonical XMI as the standard
interchange format?
•01-16-2012
Execute test cases based on participant level of commitment
3
MIWG Roadmap
•
•
•
•
•
•
•
Initial Test Suite (Test Cases 1-16)
SoaML Test Cases
Additional UML 2.3 Test Cases
Additional SysML 1.2 Test Cases
UPDM Test Cases
UML 2.4.1/ SysML 1.3 / XMI 2.4.1 Test Cases
Industrial Strength Test Cases
01-16-2012
4
Initial Test Suite
December, 2011
UML 2.3/ SysML 1.2 / XMI 2.1
Test Case 1 - Basic Class Modeling
Test Case 2 - Advanced Class Modeling
Test Case 3 - Profile Definition and Application
Test Case 4 – Simple Activity (including fUML execution)
Test Case 5 – Activity (including fUML execution)
Test Case 6 – Composite Structure
Test Case 7 – State Machines
Test Case 8 – Use Cases
Test Case 9 – Interactions
Test Case 10 – SysML Blocks
Test Case 11 – SysML Requirements
Test Case 12 – SysML + UML Intermediate activities
Test Case 13 – Instances
Test Case 14 – SysML Parametrics
Test Case 15 – Advanced Activities
Test Case 16 – SysML Allocations
Approximately 60% of UML and SysML Coverage
01-16-2012
5
UML/SysML
Not Tested by Initial Test Suite
UML Classes Unused
AcceptCallAction
ActionExecutionSpecification
ActionInputPin
AddVariableValueAction
AnyReceiveEvent
Artifact
BroadcastSignalAction
CentralBufferNode
ClassifierTemplateParameter
ClearStructuralFeatureAction
ClearVariableAction
Collaboration
CollaborationUse
CombinedFragment
CommunicationPath
Component
ComponentRealization
ConnectableElementTemplateParameter
ConsiderIgnoreFragment
Continuation
CreateLinkObjectAction
DataStoreNode
Deployment
DeploymentSpecification
01-16-2012
Device
Duration
DurationConstraint
DurationInterval
DurationObservation
ElementImport
ExecutionEnvironment
Expression
FunctionBehavior
Gate
GeneralOrdering
InformationItem
InteractionConstraint
InteractionOperand
InteractionUse
Interval
IntervalConstraint
LiteralNull
Manifestation
Node
OccurrenceSpecification
OpaqueAction
OperationTemplateParameter
ParameterSet
PartDecomposition
ProtocolConformance
QualifierValue
ReadIsClassifiedObjectAction
ReadLinkObjectEndAction
ReadLinkObjectEndQualifierAction
ReadVariableAction
ReclassifyObjectAction
RedefinableTemplateSignature
ReduceAction
RemoveStructuralFeatureValueAction
RemoveVariableValueAction
ReplyAction
SendObjectAction
SendSignalAction
SequenceNode
StartClassifierBehaviorAction
StartObjectBehaviorAction
StateInvariant
StringExpression
Substitution
TemplateBinding
TemplateParameter
TemplateParameterSubstitution
TemplateSignature
TimeConstraint
TimeEvent
TimeExpression
TimeInterval
TimeObservation
UnmarshallAction
ValuePin
Variable
SysML Stereotypes Unused
AllocateActivityPartitio
n
Conform
ConnectorProperty
ControlOperator
Copy
Discrete
DistributedProperty
NoBuffer
Optional
Overwrite
ParticipantProperty
Probability
Problem
Rate
TestCase
View
Viewpoint
6
Follow-on Test Cases
SoaML
UML 2.3/ SoaML 1.0 / XMI 2.1
Test Case 17 – Service Contracts
–
ServiceContract, MessageType, Participant, ServicesArchitecture, Consumer/Provider,
Attachment?
Test Case B – Service Interfaces
–
ServiceInterface, MessageType, Participant, ServicesArchitecture, Service/Request,
ServiceChannel, Attachment?
Test Case C – Multi-Party Service Contracts
–
ServiceContract, MessageType, Participant, ServiceArchitecture, Agent?
Test Case D – Capabilities
- Capability, ServiceInterface, Participant, Expose, Service
Test Case E – Milestones
–
Milestone
Test Case F – Categorization
–
Catalog, Category, FreeFormDescriptor, FreeFormValue, CategoryValue,
Categorization
01-16-2012
7
Follow-on Test Cases
UML Additional Functionality
UML 2.3 / XMI 2.1
Test Case A – Component Diagram
Test Case B – Timing Diagram
Test Case C – Interaction Overview Diagram
Test Case D – Collaboration (integrate with SoaML??)
Test Case E – Deployment Diagram
Test Case F – Information Flow
01-16-2012
8
Follow-on Test Cases
SysML Additional Functionality
UML 2.3/ SysML 1.2 / XMI 2.1
Test Case A – SysML View/Viewpoint
–
view, viewpoint, conform
Test Case B – SysML Requirements
–
test case, copy, problem
Test Case C – SysML Properties
–
distributed property, value property
Test Case D – SysML Internal Block Diagram-advanced
–
connector property, participant property
Test Case E – SysML Advanced Activities
–
Rate, Optional, Overwrite, NoBuffer, Discrete, AllocateActivityPartition, ControlOperator
01-16-2012
9
Follow-on Test Cases
UPDM
UML 2.3/ SysML 2.2 / UPDM 2.1/ XMI 2.1
Initial Conditions – Ensure Existing Test Cases 1-16 with UPDM Profile Applied
Test Case A – Additional Functionality
Test Case B – Additional Functionality
….
Test Case M – Additional Functionality
Test Case N – SAR Model
01-16-2012
10
Follow-on Test Cases
UML / SysML Version Updates
UML 2.4.1 / SysML 1.3 / XMI 2.4.1
Test Case 1 – Class Diagram (start early and validate Validator 2.4.1)
Test Case 2-16 – Update previous test cases 2-16 and rerun
Test Case N – Backward compatibility test cases?
Test Case N+1 – UML Interactions
Test Case N+2 – SysML Ports and Flows
01-16-2012
11
Follow-on Test Cases
Industrial Strength Test Case
UML 2.3 / SysML 1.2 / XMI 2.4.1
Test Case A – Roundtrip
Test Case B – Delta XMI
Test Case C – Size and performance
Test Case D - Federated model with remote references
01-16-2012
12
Industrial Strength Use Case
for Model Interchange
01-16-2012
S. Friedenthal
11/12/11
13
Other Interchange Testing
• Diagram Interchange starting 2013 ?
01-16-2012
14
NIST Validator Roadmap
•
•
•
•
•
•
•
UML 2.2
UML 2.3
UML 2.4.1
SysML 1.2
SysML 1.3
SoaML 1
UPDM 2.0
01-16-2012
15
MIWG Testing Process
Canonical XMI - Process
01-16-2012
17