Automatic Test Suite For
AVAYA Communication
Project by Yaniv Levy
Guided by Dr. Nissim Tzuri
Mr. Mordechai Goldis
Agenda
•
•
•
•
•
•
•
•
•
•
About Avaya
Alpha tests today
Motivation
Tools
System structure
IGMP snooping test
Policy test
Running the tests
Results
A glance to the future
2
Avaya Communication
Avaya provides solutions in the
following areas:
• Converged Voice and Data Networks
• Customer Relationship Management
• Unified Communication
• Israel – Data Networks (Lannet)
3
Avaya’s Devices
4
Alpha Tests Today
• Three Types of Test:
– Thorough Tests
– Sanity Tests
– Setups of real life scenarios
• All test are done manually
• All test are repeated for each
version
• Many versions and features require
large, qualified manpower
5
Motivation
• Accelerating the verification of a
new version
• Overnight running
• Improve the defect reproducing
capabilities
• Free more time for special tests
• Systematic tests improve qualityno human factor
6
Motivation – Test Times
Test Name
Full cyclemanual
Automatic
Sanity cycle
manual
Automatic
BUG closing.
2
2
2
2
RIP I test.
2
Auto
0.5
Auto
RIP II test.
2
Auto
0.5
Auto
OSPF test
Redistribute
test.
3
Auto
0.5
Auto
2
Auto
0.5
Auto
Multi
protocol test.
2 + setup
2 + setup
2 + setup
2 + setup
2
2
0.5
0.5
ARP test.
2.5
Auto
0.5
Auto
TOTAL
17.5
6
7
4.5
VRRP test.
7
Tools
• Visual Basic
• Tool Command language
• ProComm Scripts
• Ixia – Traffic Generator
8
Tools
9
The Ixia system
•
•
•
•
IxExplorer – windows-based software
Create and transmit packet and streams
Control all the data parameters
Statistic counters (frames received\sent etc.)
• Capture Buffer
• Tcl – programming language
-
Provides full access to the Ixia hardware platform.
Faster then the GUI application (IxExplorer)
Configurations can be sent to the hardware through the
network.
10
System Structure
Tests
Database
MMI
TCL Packeges
Test Executer
Tests
Set
Tests
TestsSet
Set
Device
Controller
RS
232
Results and
Logs
11
IGMP Snooping
• Multicast Traffic applications
• Creating Multicast Groups
– IGMP queries
– IGMP reports
• Layer 2 handling of Multicast traffic –
learning and filtering (Router ports ,Client
Ports)
12
IGMP Snooping Tests
•
•
•
•
•
•
•
•
Basic Filtering
New group filtering delay
New clients and router to an existing group
Recognizing router ports
Two Groups with the same MAC Address
Timeouts (client timeout, router timeout)
UC, MC and BC between groups
Topology changes
13
IGMP Snooping Basic Flow
• Transmit IGMP Query and Reports
• Transmit Multicast Data streams
• Check filtering and time intervals
• Make relevant changes
• Recheck filtering and time intervals
14
Policy -
QoS & Access Control
• What is Policy?
– Each routed packet is assigned a
policy and gets the right QoS from
the router .
(Critical for voice application - IP Phone)
– Enforcing Security at the edge of the network
15
Policy Rules Example
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
! policy list configuration !----------------------------ip access-list-name 100 "list #100"
ip access-list 100 10 deny-and-notify ip 192.168.16.0 0.0.0.255 any
ip access-list 100 20 deny ip any 192.168.16.0 0.0.0.255
ip access-list 100 30 permit ip host 1.10.0.10 192.168.16.0 0.0.0.255
ip access-list 100 40 fwd5 ip any 1.10.0.0 0.0.0.255
ip access-list 100 50 permit ip 1.10.1.0 0.0.0.255 any
ip access-list 100 60 deny ip host 131.131.113.10 any
ip access-list 100 70 fwd1 ip host 131.131.113.1 host 1.20.1.1
ip access-list 100 80 deny ip host 131.131.113.1 host 1.20.1.1
ip access-list 100 90 deny-and-notify ip 131.131.113.1 0.0.15.254 any
!
access-group 100
!
set qos policy-source local
16
Policy – Packet Handling Flowchart
First
Matching
Rule
Deny &
Notify
Discard
Send Trap
Deny
Discard
17
Permit
Forward
0-7
Forward
(use trust)
Forward
With the
Priority
QoS Support with Policy Management
1. The QoS information is read from the packet
2. The information is processed locally according to the
defined policy rules
3. The IEEE 802.1p priority is assigned
MAC
DA
MAC
SA
802.1p
Tag
IP
SA
IP
DA
Diff Serv/
ToS
TCP/
TCP/
UDP
UDP
SourceIP DestIP
Policy Rules
18
Access Control with Policy Management
Access
control based on
•Source IP Address
•Destination IP Address
•Protocol type
•UDP/TCP Port
•Any combination of the above
MAC
DA
MAC
SA
IP
SA
802.1p
Tag
IP
DA
Diff
Serv/
ToS
TCP/
UDP
SourceIP
Permit
Policy Rules
Deny
19
TCP/
UDP
DestIP
Policy Tests
• General test IP based including Access
Control and QOS
• Protocol Based Policy Test
• Trust rules Tests
20
Policy Tests –General Flow
• Download policy and Layer 3 configuration
to device.
• Transmit streams
• Verify that all streams passed
• Activate policy
• Transmit streams
• Verify results according to policy
21
MMI
• Centralize all user controls (Device, Traffic
Generator, Tests)
• Provide debug and reproducing capabilities
• History maintenance
22
MMI- Environmental Parameters
23
MMI-Device Under Test Configuration
24
MMI- Traffic Generator Configuration
25
MMI- Test Selection
26
MMI- Test Selection
27
MMI- Test Selection
28
Results
•
•
•
•
•
•
•
•
•
•
•
SUMMARY of IGMP Snooping:
IGMP Snooping Client Timeouts and Router Timeouts Test PASSED
IGMP Snooping Group filtering Delay Time Test PASSED
IGMP Snooping Zero filtering Delay Time Test PASSED
IGMP Snooping Special Address Filtering Test PASSED
IGMP Snooping 2 groups with the same MAC Test PASSED
IGMP Snooping Learning Max MC Groups Test FAILED
IGMP Snooping Learning Behavior Test PASSED
IGMP Snooping UC,BC & MC streams between ports Test PASSED
IGMP Snooping Toppology changes igmp snooping Test FAILED
IGMP Snooping Resets Test FAILED
•
•
•
•
•
•
•
•
•
NUMBER of SUBTOPICS: 10
PASSED: 7
FAILED: 3
********** END of TEST: IGMP Snooping FAILED **********
SUMMARY of The Session:
IGMP Snooping FAILED
>>>>>>>>>>End time: Monday - 17,Jun 2002 02:29:11 PM
TOTAL TEST DURATION: 01:15:54 seconds
TOTAL TESTS: 1 TOTAL PASSED: 0 TOTAL FAILED: 1
29
A Glance To The Future
• Support all Device Families (P130 , P480
and future families)
• Implementing more test
• Adding other test types (Setups , multi
feature)
• Improve Self Learning Capabilities
(mapping ports , learning the stack)
• Integrate the system in preliminary
development stages
30
THE
END
31