Scaling Cloud Foundry From
One Team to Entire Enterprise
Parag Doshi, Pivotal
Patrick Huber, Humana
Agenda
•  Introduction
•  Humana - Digital Experience Center (DEC)
•  Humana - CF Enterprise Initiative
•  Consideration for Scaling CF in Enterprises
•  Platform Maturity Model
•  Value Drivers of CF - 5 S’s
•  Humana’s Approach to Scaling CF
•  Operations & Application Teams’ Enablement
•  Conclusion
Humana Digital Experience Center (DEC)
Humana DEC - History
•  The DEC is an acceleration center at Humana which
specializes in rapid application development of quality tested
software using modern development practices.
•  Uses Pivotal Cloud Foundry to deliver highly scalable cloud
native applications.
Humana DEC - Products Shipped
Humana – CF Enterprise Initiative
• 
• 
• 
• 
Quality as a Feature - Through our efforts to promote quality we expanded our
Application Lifecycle Management platform, TFS, we noticed an increase in quality
of delivery but still had challenges with provisioning, scaling and managing
application runtimes.
History of Success - We looked to the success of the DEC and realized Cloud
Foundry could be the platform of choice for application runtime.
Gather Support - A pitch was made to senior leadership to push forward with
expansion of the existing PCF installation and make it generally available to the
enterprise. The Cloud Foundry certification process was a big win to avoid vendor
lock-in concerns.
Build and Learn - Working with Pivotal during a Dojo immersion session, we
established goals and set forth building our future platform.
Considerations For Scaling CF in Enterprises
• 
DR Topology
• 
Capacity Planning
• 
Charge Back model
• 
Centralized Log Management & Application Monitoring
• 
Pipeline for Automated Platform updates & Application CI/CD Integration
• 
Changing IT Roles & Team Structure
Platform Maturity Model
Cloud
Friendly
Platform
Cloud
Ready
Platform
Cloud
Resilient
Platform
Cloud
Native
Platform
Manual Install of PCF
APM Integration w/ the
platform
Automated pipeline for
installs and upgrades
Critical CVE updated
within 48 hours
Scattered Metrics
DR Strategy in place
Highly self-sufficient
Cloud Ops team
No DR Strategy
Chargeback model in
place
DR (active-active or
active-passive)
implemented
‘Single pane of glass’
metrics
3 R’s of Security
(Rotate, Repave,
Repair) in place
Latest Platform Version
Zero touch CI/CD
pipeline integrated w/
the platform
Platform Versions
N-2, N-3
App Teams
Onboarding in place
Scattered Log
Management
Log Management
solution integrated w/
the platform
Value (ROI) Drivers of CF - 5 S’s
SPEED AND
AGILITY
STABILITY
ROI
SCALABILITY
SAVINGS
SECURITY
Platform Maturity Model - Speed & Stability
Cloud
Friendly
Platform
Cloud
Ready
Platform
Cloud
Resilient
Platform
Cloud
Native
Platform
Manual Install of PCF
APM Integration w/ the
platform
Automated pipeline for
installs and upgrades
Critical CVE updated
within 48 hours
Scattered Metrics
DR Strategy in place
Highly self-sufficient
Cloud Ops team
No DR Strategy
Chargeback model in
place
DR (active-active or
active-passive)
implemented
‘Single pane of glass’
metrics
3 R’s of Security
(Rotate, Repave,
Repair) in place
Latest Platform Version
Zero touch CI/CD
pipeline integrated w/
the platform
Platform Versions
N-2, N-3
App Teams
Onboarding in place
Scattered Log
Management
Log Management
solution integrated w/
the platform
Platform Maturity Model - Security & Scalability
Cloud
Friendly
Platform
Cloud
Ready
Platform
Cloud
Resilient
Platform
Cloud
Native
Platform
Manual Install of PCF
APM Integration w/ the
platform
Automated pipeline for
installs and upgrades
Critical CVE updated
within 48 hours
Scattered Metrics
DR Strategy in place
Highly self-sufficient
Cloud Ops team
No DR Strategy
Chargeback model in
place
DR (active-active or
active-passive)
implemented
‘Single pane of glass’
metrics
3 R’s of Security
(Rotate, Repave,
Repair) in place
Latest Platform Version
Zero touch CI/CD
pipeline integrated w/
the platform
Platform Versions
N-2, N-3
App Teams
Onboarding in place
Scattered Log
Management
Log Management
solution integrated w/
the platform
Platform Maturity Model - Humana’s Approach
Cloud
Ready
Platform
Cloud
Friendly
Platform
Cloud
Resilient
Platform
Cloud
Native
Platform
Manual Install of PCF
APM Integration w/ the
platform
Automated pipeline for
installs and upgrades
Critical CVE updated
within 48 hours
Scattered Metrics
DR Strategy in place
Highly self-sufficient
Cloud Ops team
No DR Strategy
Chargeback model in
place
DR (active-active or
active-passive)
implemented
‘Single pane of glass’
metrics
3 R’s of Security
(Rotate, Repave,
Repair) in place
Latest Platform Version
Zero touch CI/CD
pipeline integrated w/
the platform
Platform Versions
N-2, N-3
App Teams
Onboarding in place
Scattered Log
Management
Log Management
solution integrated w/
the platform
implemented
planned
Humana - Cross Datacenter Architecture
cfops
cfops
QA Foundation DC1
Prod Foundation DC1
active
active
load balancer
load balancer
firewall
firewall
failover
failover
load balancer
firewall
passive
Prod Foundation DC2
replicate
load balancer
firewall
passive
QA Foundation DC2
replicate
Humana - Data Center Architecture
internet : .com
prod cluster
resource pool 1
firewall
load balancer
ops
mgr
prod /23
network
bosh
resource pool 2
osh
ert
tile
osh
ert
tile
resource pool 3
osh
ert
tile
prod
datastores
Routed
Backbone
qa cluster
resource pool 1
ops
mgr
bosh
resource pool 2
osh
ert
osh
ert
resource pool 3
osh
ert
qa /23
network
firewall
load balancer
intranet: .local
tile
tile
tile
qa
datastores
Humana- Capacity Planning
Monitor to Understand Capacity
PCF AZ 1 / Resource Pool
Resource Pool 1 / Cluster
Minimum 3 hosts per cluster
JMX
Tile
Dynatrace JMX Plugin
Measure Metrics Looking for
(LETS):
●  Latency
●  Errors
●  Traffic
●  Saturation
scale up by adding more hosts at 30%
Humana - Charge Back & Pricing
Measures used to calculate Monthly Charge
Back
● 
● 
● 
● 
App Instance Count
Service Instance Count
RAM
Disk
How We Measure
●  Sample Usage Continually
●  Bill based on the MAX used that
month
All Multiplied by Max Utilization % so you don’t
over provision (ex: 70%)
Features of Model
●  Allows app owners to pay only for what they use.
●  Fits most contract models based on maximum utilization.
●  Allows for future expansion to smaller or larger billing windows for enterprises with
legacy models to modern models. (Daily, Monthly, Yearly, Continually)
Humana - Platform Teams & Product Teams
Product Team 1
Product Team 2
Org Manager
Org Manager
Firewall or Vanity
URL
Product Team 3
Org Manager
Product Team 4
Product Team 5
Org Manager
Org Manager
Pivotal Cloud Foundry
Platform Team
Platform Product Owner
Infrastructure Engineer
Direct Access
Infrastructure Tickets
Infrastructure Team
Relationships
VSphere
Humana - Future State Roadmap
• 
Automate Foundation Upgrades with Concourse
• 
Zero Trust with Software Defined Networks (SDN) with Policy and simplify
application firewall requests
• 
Global Server Load Balancing (GSLB)
• 
Look to reduce number of foundations and make DR “Active / Active” and simplify
app deployments
• 
Consolidate Business Metrics for Leadership
• 
Splunk Integration
Operations & Application Teams’ Enablement
Customer’s
Operations
Journey
PCFS
Start working on the platform
Ingrain operations practices in my
Scale operating the platform with my team
with Pivotal at my location
team, with Pivotal’s help at my location
at my location
Stand Up The Platform
Pivotal Platform Dojo
Customer’s
Applications
Journeys
Operate The Platform — “Day 2”
Operate The Platform At Scale
Pivotal Operations Engineering Service
Cloud Native Operations Service
Start an immersive experience with
Ingrain methodologies and practices within
Scale performing methodologies and
Pivotal at a Pivotal office
my team, with Pivotal’s and/or Partner’s help
at my location
practices with my team at my location
with help from a Pivotal-certified Partner
Labs
Replatform
applications
New
application
development
process
Immersive
Technical
Education
Platform
Acceleration Lab
Modernize First
Legacy App(s)
Pivotal Labs App
Transformation
Project
Develop Custom Application
Traditional Pivotal Labs Project
Execute App Transformation Plan
Construct And Begin Enterprise
App Transformation Plan
Establish Culture & Train New
Leaders
Execute App Transformation Plan
Execute App Transformation Plan
Execute App Transformation Plan
Leverage New Culture At
Scale
Conclusion
• 
It’s a Journey.
• 
Different Tools in the toolbox - choose what works for your
enterprise.
• 
Realize Cloud Foundry’s promise: Developer Productivity,
Operator Efficiency.
• 
Have fun!
Thank You!
$100DISCOUNTCODE:S1P_EVENT_CFS100