R12 Upgrade at The
Wendy’s Company
Barbara Wheeler – VP, Enterprise Solutions
Brian Cardin - Director, Enterprise Solutions
August 23, 2013
© 2013 Oldemark LLC
The Wendy’s Company
The Wendy’s Company is the 3rd largest hamburger quick service
restaurant chain in the US, with 6500 company and franchised locations.
First Comes Love…
2008
3
Second Comes Marriage…
2009
4
Then Comes…SEPARATION!
2011
5
Then Comes the Final Papers!
2012
6
Project Guiding Principles
• Minimum Cost
• No additional Oracle licenses
• Technical upgrade – no BPR, utilize functionality/change process
where software dictates
• Utilize internal team with minimal contractors
• Minimize risk to the business
• Ability to convert back to 11i within hours should an issue be
encountered during cutover
• Fast refresh of test environments – hours as opposed to days
• Perform infrastructure refresh
• End of life o/s and hardware upgrade
7
Wendy’s 11.5.10 Environment
•
EBS – Financials (GL, AP, AR, FA, PA, PN), HCM (HR, PR, OIC, CWB), OM,
Adv Pric
•
HPT, OBI, Sabrix, EiS Reporting, Demantra, Oracle Transportation
Management, various other custom and 3rd party applications
•
•
Single instance
•
3 Database Nodes – RAC, 3 Concurrent Managers, 2 App Servers, EMC Storage
•
O/S level 4.7OEL, 32 bit
Non-Prd – Pre-Production similar to PRD, 4 additional Dev/Test
environments
8
Non-EBS Application Impact
• Sabrix – reconfiguring to align with EB Tax
• Discoverer – upgrade from 10.1.2.2 to 10.1.2.55.26
• EiS Reporting for Payroll and HR – upgrade from 7.0.0 to 8.0.0
• SOA (utilized with OTM Integrations) – upgrade from 10g to 11g
9
Infrastructure Improvements
•
Production
• New database and CM servers
• Upgraded O/S to OEL5.6 and app level to 64-bit
• Consolidated footprint – 3 servers to 2 more powerful servers –
licensing remained intact
• App servers remained as is
• Performed rolling O/S upgrade
• Non-Production
• Utilized Snapclone capability on the disk array to perform clones
• Decreased cloning from days to hours
• R12 instances resided on same HW as 11i
10
Project Team
Office Consolidation – project to take place in Ohio
•
New Business Users – still learning process and system
•
Staffing in Ohio to replace Oracle IT Team not relocating from ATL
•
Staff Augmentation where necessary
•
AP - due to large number of changes between versions
•
Sabrix/EB Tax – contracted with vendor to help with integrations and additional
configurations
•
OBI – contracted with consulting firm to assist with integrations
•
SOA – contracted with consulting firm to assist with changes from 10g to 11g
•
Payroll/HR – staff augmentation to assist with workload of testing - many internal and
3rd party integrations, EiS upgrade, visibility of payroll accuracy
11
•
Development
Challenges
•
Business Team
•
•
IT Team
•
•
•
Co-location, new to Wendy’s, new to Wendy’s configuration, experience level
Competing projects
•
Transportation Management – go live Jan, 2013
•
Performance Management – go live Feb, 2013
Other challenges
•
12
New to Wendy’s – new to process, new to Oracle EBS, new leadership, new to
project methodologies
Higher level of PRD support for 11.5.10 during project
Test & Deployment Plan
• DBA’s performed entire upgrade process (end-to-end) 8 times
• Formal business process testing performed in 4 different cycles
• CRP1
• CRP2
• CRP3
• UAT
13
Test & Deployment Plan
Production deployment incorporated the Business with a detailed Cutover
strategy
Activity
P4 Close
System Shutdown
PreValidation - Prep/Build Instance
Validations - pre upgrade
Technical Upgrade
3rd Party Apps Sync/Patching/Migrations
IT Team PreValidation - Configs/Table Counts
Validations - post upgrade
Processing Critical Jobs
key transactional processes- live data test
System Available
14
M
on
Tu
e
W
ed
Th
r
Fr
i
Sa
t
Su
n
M
on
Cutover / Deployment Summary
R12 Upgrade Command Central
Around the clock for
72 hours…
15
Implementation Gotcha’s
• AP Navigation and utilization/enabling of Hot Keys
• Unaccounted Payments –
• 11i Processed Payment subsequently Cancelled in R12
• Data fix required to enable Accounting
• AP Close Performance
• EBTax consultant – important if use 3rd party Sales/Use Tax Engine
• ADI Journal form errors
• Concurrent Requests – not visible by users with shared
responsibilities
• Scheduled Jobs should be rescheduled as best practice
16
Fun Facts
Technical & Configuration Changes
•
Upgrade from 11i to 12.1.1 - executed 145,000 jobs
•
Upgrade from 12.1.1 to 12.1.3 - executed approx. 20,000 jobs
•
Post patching - over 100 updates applied
•
Overall, 4 days around the clock processing and monitoring with heavy manual configurations, etc.,
200+ hours, and over 100 activities in the DBA project plan
•
136 configurations applied to 22 modules elapsing over 70 man hours
Testing
17
•
Almost 2000 test scenarios were executed in multiple test phases over a 6 month period
•
Over 200 people involved (Business & IT)
•
Over 400 issues were identified and resolved over the course of the project
QUESTIONS?
© 2013 Oldemark LLC