Dev/Ops Cooperation at the Worst Possible Times Michael T. Nygard

When the Fur Flies
Dev/Ops Cooperation at the Worst Possible Times
Michael T. Nygard
© 2010 N6 Consulting, LLC. All Rights Reserved.
Tuesday, October 5, 2010
About The Speaker
Application Developer/Architect – 20 years
Web Developer – 15 years
IT Operations – 7 years
Tuesday, October 5, 2010
Reaching Across the Aisle
Tuesday, October 5, 2010
Reaching Across the Aisle
Tuesday, October 5, 2010
Reaching Across the Aisle
Tuesday, October 5, 2010
“Web Site”
Tuesday, October 5, 2010
“Web Site”
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Online Store
Order Management
Content Creation
Payment & Fraud
Online Store
Tuesday, October 5, 2010
Online Store
Tuesday, October 5, 2010
Akamai
LB
LB
web1
...
web6
...
image1
image3
LB
LB
app1
app2
app12
LoadManager
LoadManager
Request
Handler
Request
Handler
Request
Handler
Request
Handler
Request
Handler
Request
Handler
Request
Handler
Request
Handler
Request
Handler
...
db1
Tuesday, October 5, 2010
search1
Request
Handler
search12
...
db2
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
“Web Site”
Tuesday, October 5, 2010
£
app12
Tuesday, October 5, 2010
app12
db1
Tuesday, October 5, 2010
app12
eth0 eth1
sw01
Tuesday, October 5, 2010
eth2
db1
eth3
sw02
eth0 eth1
mon-sw
eth2
eth3
When in doubt,
biopsy something.
Tuesday, October 5, 2010
Tuesday, October 5, 2010
app1
app11
app12
eth0 eth1 eth2 eth3
eth0 eth1 eth2 eth3
...
eth0 eth1 eth2 eth3
sw01
Tuesday, October 5, 2010
sw02
mon-sw
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Short Term ℞
Tuesday, October 5, 2010
Stop It.
Tuesday, October 5, 2010
Long Term ℞
Tuesday, October 5, 2010
Seriously,
stop it.
Tuesday, October 5, 2010
Lessons?
Shared understanding
Concrete language
Collaboration across boundaries
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Organization Design
Tuesday, October 5, 2010
Organization Design
Change
Requests
Defect
Reports
Development
Tuesday, October 5, 2010
Operations
Organization Design
Change
Requests
Defect
Reports
Development
Tuesday, October 5, 2010
Operations
Organization Design
Change
Requests
Defect
Reports
Development
Tuesday, October 5, 2010
Operations
Organization Design
Change
Requests
Defect
Reports
Development Operations
Tuesday, October 5, 2010
Organization Design
Backlog
Change
Requests
Defect
Reports
Development Operations
Tuesday, October 5, 2010
Organization Design
Backlog
Change
Requests
Defect
Reports
Development Operations
Tuesday, October 5, 2010
Refuse
Can’tTo Understand
They Wouldn’t
!
Tuesday, October 5, 2010
They Wouldn’t Understand
!
Tuesday, October 5, 2010
They Wouldn’t Understand
why the build broke.
Tuesday, October 5, 2010
They Wouldn’t Understand
how to tune a
connection pool.
Tuesday, October 5, 2010
They Wouldn’t Understand
that a good day is deleting
more code than I write.
Tuesday, October 5, 2010
They Wouldn’t Understand
that high CPU utilization
doesn’t always mean a
problem.
Tuesday, October 5, 2010
They Wouldn’t Understand
we get those alerts all the
time.
Tuesday, October 5, 2010
They Wouldn’t Understand
what load average really
means.
Tuesday, October 5, 2010
They Wouldn’t Understand
how to read a revenue
forecast
Tuesday, October 5, 2010
They Wouldn’t Understand
the difference between
revenue and gross margin
Tuesday, October 5, 2010
They Wouldn’t Understand
!
Tuesday, October 5, 2010
False
Accountability
Tuesday, October 5, 2010
Other Suspicious Characters
“100% Pure Java”™ Developers
All-I-Need-Is-Unix Admins
Function Point Project Managers
Tuesday, October 5, 2010
The Big Red Button
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
1 month scheduled for
load testing. Extended to
3 months.
7x12 conference calls
Redefined success (down
from 25000 concurrent
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Success!
Ship it!
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Perimeter
Defences
Tuesday, October 5, 2010
Mean
Time
Between
Horrifying
Discoveries
Tuesday, October 5, 2010
Tuesday, October 5, 2010
What Went Right?
Dev & Ops collaboration
Shared views and information
Speed of change
Heroic efforts both challenged and elevated
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Schrödinger’s Manager
permanence of quick
fixes.
show chart of hacks and
their longevity.
rolling restart & my
grandfather’s axe.
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Seeds Sown In Trauma Bear Twisted Fruit
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Tuesday, October 5, 2010
Michael T. Nygard
[email protected]
@mtnygard
© 2010 N6 Consulting, LLC. All Rights Reserved.
Tuesday, October 5, 2010