Application Software Testing and
Distribution Strategies
Presented by:
Cindi Popek, Jones Day
Carol Creagan, Baker Hostetler
Richard Harris, Freshfields Bruckhaus Deringer
Moderator:
David Carlson, Kraft & Kennedy, Inc.
Agenda
Introductions
Establishingg Standards & Best Practices
Organization & Process
Application Integration & Distribution
Testing & Quality Assurance
Maintenance & Operations
Today’s Panel
Cindi Popek
Carol Creagan
2300 Attorneys
y
31 Offices
Cleveland, OH
600 Attorneys
10 Offices
Cleveland, OH
Richard Harris
2500 Attorneys
27 Offices
New York, NY
Distribution Evolves
Where We Started
Logon scripts
Basic tool for software updates
Limited reporting – status
Maturity
Enterprise desktop management systems
Advanced scripting
Hardware agnostic
Trends
y
Dynamic
Desktop
Separation of operating system and applications
Supporting
pp
g multiple
p pplatforms
Virtualization
VIRTUALIZATION
VIRTUALIZATION
VIRTUALIZATION
Vendors
Establishing Standards & Best Practices
IS Operations Framework
How we get new things into the environment
How did we arrive here – a little history
Consistency
Format, approach and application
Fundamentals
EMS supports standardization
Secure the desktop. No local administrators!
Replicate all packages to all locations
Establish a regular reboot/release schedule
Organization & Process
IS Operations Framework
Project Management
Project Portfolio
Release Management
Transition from Project Management to Operations
Operations
The things we do every day to support and care for our
environment
Organization & Process
Application Lifecycle
Ownership - Business & Technical
Requirements
Integration & Packaging
Testing/QA
Distribution
Support & Maintain
Retire
Organization & Process
R l andd Responsibilities
Roles
R
ibiliti
Functional / Business Owner
Configuration,
– many titimes bbecomes
C fi
ti ffeatures,
t
ffunctions
ti
the subject matter expert for the application
Define Integration points – application matrix
Create and own test criteria
Application / Technical Owner
Architecture, configuration and installation of server
software
Collaborate with Functional Owner to support
pp deliveryy of
features and functions
Application Integration & Distribution
What do we need to move forward?
Critical Information – Vendor, Version, Keys
Who, What & When?
Documentation
Communication
p
q
Dependencies/Prerequisites
User Impact
Application Integration & Distribution
Integration and packaging considerations
Architectural design
Web application (ActiveX)
2 or 3-tier applications
A li ti server, fil
li t
Application
file server, ffatt client
Platform
Desktop,
D kt Citrix,
Cit i Web-based
W bb d
Native MSI vs. Repackaged executable
Vi t li i applications
li ti
Virtualizing
Application Integration & Distribution
Packager needs good all around knowledge
g g environments
Virtual machines are ideal packaging
Define packaging standards
Script snippets
Package naming convention
Rollup package updates into master package
Testing & Quality Assurance
Consider 3 types of testing
Unit testing
Basic functions - open, create, save, print
Critical functions - based on business requirements
I t
ti ffunctions
ti
t t th
tifi d iintegration
t
ti points
i t
Integration
- tests
the id
identified
User acceptance testing
Meeting
the needs
the bbusiness
sponsor
M ti th
d off th
i
Performance testing
Benchmarking to validate adequate performance /
scalability
Testing & Quality Assurance
Define Test Team
Help Desk/Trainers/Subject Matter Experts/Dedicated
QA Team
Formal test scripts
Provided by both business & technical Sponsors
Can be used for automated testingg and load testingg ((if
needed)
Document and review results
Pre-pilots and pilots
Maintenance & Operations
Deployment/Monitoring
Out of hours is less disruptive (Wake On LAN)
Block user interaction until deployment is complete
Monitor deployments in real-time
Utilize staff in other times zones
Streamline/automate issue follow up
Analyze deployment results
Record issues and workarounds
Maintenance & Operations
When Problems Occur
Widespread problems overwhelm helpdesk quickly
Have experts standing by to troubleshoot
Communication is key
Follow the plan
Regular updates
Set expectations
Carefully weigh the options for correcting
Incident report
Major problems are major lessons!
Final Thoughts
Developing and following standards is key!
Understand the environment and packages you deploy
Testing and issue tracking reduces deployment
headaches
Communication is essential for all phases
Every distribution is an opportunity to build experience
Questions?
Cindi Popek
Carol Creagan
Richard Harris
David Carlson
[email protected]
[email protected]
richard harris@freshfields com
[email protected]
[email protected]