CSA (Waverley) Ltd Response to NHS Blood and Transplant For the Provision of: Data Centre Consolidation through Virtualisation Project Within NHSBT’s Data Centres Tender Reference Number: NHSBT0361/IT/KD Commoditised IT Hardware and Software – IT Infrastructure Hardware Under the terms of OGC Buying Solutions Framework Agreement Title: RM 721/Lot 2 1 Document Control Revision Information Revision 1.0 Replaces 0.0 Revision Details 1.0 Initial Population Authors Role Jon Leary Area Sales Manager Jon Chamberlain Project Manager Darron Edwards Solution Architect Effective From 29 Jul. 17 2 Document Distribution and Contact Details Name Organisation Role Email Phone Darron Edwards CSA Waverley Design Consultant [email protected] 07872 600431 Jon Leary CSA Waverley Area Sales Manager [email protected] 07967 011489 Jon Chamberlain CSA Waverley Project Manager [email protected] 01628 850615 Contact for all enquiries: Jon Leary – Area Sales Manager CSA Waverley limited Holtspur Lane Wooburn Green Bucks HP10 0AB T 01628 851044 / M 07967 011489 [email protected] CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 2 3 Glossary of Terms NHS Blood and Transplant – Hereafter referred to as ‘NHSBT’ or ‘the customer’ CSA Waverley ltd – hereafter referred to as ‘CSA’, ‘CSA Waverley’ or ‘Waverley’ Converged Infrastructure – HP terminology to describe agile, easy to manage datacentre services IO – Input Output operations WAN – Wide Area Network DR – Disaster Recovery BC – Business Continuity RPO- Recovery Point Objective RTO – Recovery Time Objective SCOM – Microsoft System Centre Operations Manager HPIC – Hewlett Packard Insight Control HPSIM – Hewlett Packard Systems Insight Manager CMC – Centralised Management Console VMM – Virtual Machine Management HA – High Availability DRS – Distributed Resource Scheduler CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 3 4 Contents 1 2 3 4 5 6 7 Document Control .......................................................................................... 2 Document Distribution and Contact Details ........................................................ 2 Glossary of Terms .......................................................................................... 3 Contents ....................................................................................................... 4 Introduction .................................................................................................. 6 Understanding the Requirement ....................................................................... 6 Management Summary ................................................................................... 7 7.1 CSA Waverley Company Overview........................................................... 7 7.2 Partnership with NHSBT ......................................................................... 8 7.3 Partnership with HP ............................................................................... 8 7.4 Partnership with VMware ....................................................................... 9 7.5 CSA Waverley Services Overview ............................................................ 9 7.6 Benefits to NHSBT from Partnering with CSA Waverley ............................ 10 8 Response to Requirements Catalogue ............................................................. 11 9 Pricing Matrix............................................................................................... 14 10 Solution Overview ........................................................................................ 20 10.1 Solution Deliverables ........................................................................... 20 11 Solution Components .................................................................................... 21 11.1 Overview ........................................................................................... 21 11.2 Capacity Planning ............................................................................... 21 11.3 Solution Architecture ........................................................................... 21 11.4 Server Platform .................................................................................. 23 11.5 Virtualisation Platform ......................................................................... 24 11.6 Shared Storage Arrays ........................................................................ 25 11.7 Networking Services ............................................................................ 26 11.8 Networking Resilience.......................................................................... 27 11.9 Geographic Resilience and High Availability ............................................ 28 11.9.1 Geographic Resilience ....................................................................... 28 11.9.2 VMware HA and DRS ........................................................................ 29 11.9.3 P4000 Multi-Site Configuration .......................................................... 29 11.9.4 Server Availability ............................................................................ 30 11.9.5 Networking Resilience....................................................................... 30 11.10 Management Platform ......................................................................... 31 11.10.1 vCenter Server ................................................................................ 31 11.10.2 SAN Management ............................................................................ 31 11.10.3 Network Management ....................................................................... 32 11.10.4 Hardware Management ..................................................................... 32 11.11 Integration to Symantec NetBackup for Backup and Recovery .................. 32 11.12 Rack Specification and Diagram ............................................................ 33 11.12.1 Service and Maintenance Access ........................................................ 33 11.13 Rack layout ........................................................................................ 34 11.14 Rack Power Utilisation Indications ......................................................... 35 12 Assumptions ................................................................................................ 35 CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 4 12.1 Physical Access ................................................................................... 35 12.2 Working Hours .................................................................................... 35 12.3 Health and Safety ............................................................................... 35 12.4 Environmental .................................................................................... 36 12.5 Network Routing, Addressing and Name Services .................................... 36 12.6 Authenticated User Access ................................................................... 36 12.7 Waverley Delivered Training ................................................................. 36 12.8 Vendor Training .................................................................................. 37 13 Work Packages, Implementation Plan -Draft .................................................... 37 13.1 Project Implementation ....................................................................... 37 13.1.1 Outline Work Package Definitions ....................................................... 37 13.1.2 Outline Project Schedule (Project Plan) ............................................... 44 14 Standard Transparency Clause ....................................................................... 45 14.1 15.1 Background ................................................................................ 45 14.2 Supplementary Terms ......................................................................... 46 14.3 15.3 Approval ..................................................................................... 46 15 Supplier Response Information ...................................................................... 47 15.1 16.1 Responding to the tender ............................................................. 47 16 References .................................................................................................. 47 Appendix A. Project Staff CV’s .......................................................................... 50 CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 5 5 Introduction CSA Waverley is pleased to submit a response for the NHSBT Data Centre through Virtualisation project; we believe our proposal meets the requirement in full. If successful we will engage with NHSBT via an initial project workshop to ensure that we fully understand and agree the Design and Implementation requirements, thus ensuring that the implementation is performed to NHSBT expectations and best practice guidelines. 6 Understanding the Requirement NHSBT wish to deploy a solution to virtualise the existing server estate of some 220 servers in line with the internal IT strategy of HP servers, HP P4000 SAN, VMware virtualisation software and Symantec backup solution. As well as providing the usual benefits from a virtualised environment of reduced costs, improved service levels, adoption of “Green IT policies” this solution will provide NHSBT with excellent geographical resilience, enabling NHSBT to continue operation in the event of a complete loss of one Data Centre. It would appear that the solution is required quickly, hence we have reserved all stock at HP Distribution for delivery within 10 days following award of contract if successful. CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 6 7 Management Summary We believe that our proposal provides NHSBT with a very competitively priced solution that meets and exceeds the requirements defined in this ITQ, we meet every requirement identified and we exceed these by offering a strategic partner relationship with NHSBT. We will bring together the commitment from HP and VMware to ensure the success of this project delivered between all partners. We will deliver the project ourselves, with our own fully accredited personnel who are experienced in the delivery of large, complex NHS IT projects, during 2011 we have delivered two very similar projects at Medway NHS Foundation Trust and the Royal Free Hampstead NHS Trust, each project was around £750,000 and each delivered on time to a fixed price. The deliverables for each project were almost identical to the requirements of NHSBT with dual site locations, HP servers, HP P4000 multi-site SAN and VMware virtualisation platform. We understand that this project will effectively be in two phases with the initial implementation phase followed by the virtualisation of application services, we will work with NHSBT throughout both phases to ensure a “low-risk” thorough migration to the new infrastructure is achieved. Following the migration we will continue to partner with NHSBT to ensure the infrastructure is maintained and enhanced to provide optimum service, we would encourage quarterly review and planning meetings to enhance this. Our full project costs for the provision of all identified requirements can be summarised as: £826,158.81, excluding VAT £991,390.57, including VAT @ 20% All equipment will be available from UK stock within 10 days from submission of this proposal. 7.1 CSA Waverley Company Overview Founded in 1983; initially providing the infrastructure to the NHS to support the “Exeter System” application, Waverley has remained focused on delivering Infrastructure projects to the whole Public Sector and beyond. We are financially stable with no borrowings. Waverley has in depth knowledge and experience of delivering I.T. infrastructure solutions. We have an installed customer base in excess of 500 installations and we provide support services on over 750 server and storage solution implementations. Some of our largest, most critical installations are at Connecting for Health, Medway Hospital NHS Foundation Trust, Bio products laboratory, Suffolk Coastal District Council, West Suffolk NHS Trust, The Royal Free NHS Trust, The Royal Brompton and Harefield NHS Trust, The Oxford Radcliffe Hospitals NHS Trust, Guy’s & St Thomas’ NHS Trust and CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 7 Kensington, Chelsea and Westminster PCT where we provide managed services on the critical servers. Waverley has been appointed to several Public Sector frameworks over the years (including current inclusion on the NHS ASCC framework); we were appointed to the Buying Solutions Framework RM721/lot 2 in March 2010 year and have already had much success from this. 7.2 Partnership with NHSBT Waverley has a long established relationship with the English and Welsh Blood Services dating back to 1992, we would like to offer our services on a strategic partnership level with NHSBT whereby ensuring continuity of service and enabling NHSBT to achieve the most from the deployment of the IT Infrastructure over a long period of time. We worked with the Trace consortium back in 1992 to migrate the Trace application running “mumps” on PDP11 servers to MSM on HP-UNIX, we continued to provide support and maintenance services until 1999. We were also shortlisted with Abbott Laboratories in the mid 90’s for the replacement of the national system at NHSBT (then NBA) Over the last 18 months we worked with Bio Products Laboratory to deliver a full virtualisation Infrastructure project and are currently shortlisted in the Backup and Disaster Recovery procurement. Working with NHSBT we recently designed the infrastructure for the Col23 National Files Server environment. We are currently implementing the I.T Infrastructure to support the Welsh Blood Service National system, this is based upon HP DL380’s / P4000 SAN and we are working with MAK Systems. We understand the culture and the critical operation of NHSBT and will ensure our products and services meet the demanding standards required to operate in this environment and hope to operate in a strategic manner with NHSBT. 7.3 Partnership with HP Since 1989 we have been exclusively an HP Gold partner, we have HP specialist accreditations in the following technology areas: Converged Infrastructure Storage Solutions Industry standard Servers (ISS) Virtualisation (VMware) Data Centre Solutions HP Consultancy Services We are also a leading supplier of HP Support and Maintenance contracts CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 8 We have a very close working relationship with the HP NHS Account Management team, who will support our proposal to NHSBT. HP Account Manager – James Clark HP NHS Business Manager – Peter Thackery We also have a dedicated channel partner account team within HP, this team is able to assist with all aspects of pre and post sales activities; in particular we have escalation management processes in place to ensure that the delivery of an order is escalated through the system as required. 7.4 Partnership with VMware Waverley has been accredited as a VMware Partner for 7 years; we have a very large installed base of NHS clients using VMware ESX and have recently implemented two large VMware projects at Medway NHS Trust and The Royal Free Hampstead NHS Trust. We have extensive VMware knowledge and experience within our technical services team. Again we have the full support and commitment from the VMware NHS Account team responsible for the NHDSBT account: 7.5 Isolin Fitzpatrick Internal Sales - Healthcare Team - UK Public Services Mark Roscoe Healthcare Account Manager CSA Waverley Services Overview CSA Waverley is recognised as being a very customer focused organisation, in particular our support and technical services organisation is motivated by customer satisfaction. We also have significant experience in delivering data centre, desktop products and services to large and demanding organisations such as Connecting for Health where we provide business services based upon software solutions and service deployment, for CFH these include: Data Centre Design (IT Infrastructure) Asset management CMDB Supply chain management Desktop Imaging and deployment Managed print service Disaster recovery service WEEE disposal and compliance Service Desk CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 9 7.6 Benefits to NHSBT from Partnering with CSA Waverley Waverley is a specialist infrastructure supplier with 28 years of experience in delivering large scale IT projects. We have reserved all of the required products and they are available within a 10 day delivery following an award of contract. We have the required HP and VMware accreditations to deliver this Project. We will bring continuity of service to NHSBT and will ensure that the relationship with all parties (HP, VMware) is coordinated. We have the experience required, having delivered many Projects using the same products, HP DLX80, P4000, VMware. The Physical to Virtual (P2V) migration process is critical to the successful, timely and non-disruptive success of this project; we have extensive experience of this process and recently worked with BPL to achieve a successful project migration. We are a Buying Solutions Prime Contractor and will not subcontract any work associated with this bid. Waverley has an excellent understanding of the organisational culture and working practices within NHSBT and as such we believe we offer a good fit as a strategic long term partner. Waverley has the capacity and the capability to deliver this project to schedule. Our implementation methodology will minimise any risk to NHSBT; providing skills transfer and training throughout the installation process. We will partner with NHSBT over the long term to ensure that maximum benefits are derived from the new Infrastructure; this includes strategic and regular planning of future upgrades and product enhancements, probably by quarterly onsite reviews focussed on the existing Implementation and ensuring it is optimised. We will have a full account management team, including a dedicated Project Manager assigned to the project and for the provision of on-going customer support. Full documentation will be provided as part of our delivery. CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 10 8 Response to Requirements Catalogue Fitness for purpose including quality - Compliance with technical or output based specification (10% section total – 3.3% per question)) Please confirm your bid meets or exceeds technical and functional capacity of the specification stated in section 3. If there are any discrepancies please specify them clearly and provide supporting performance metrics. Our bid exactly meets the requirements as stated in this ITT; we fully understand the business and technical requirements and can confirm that this is the best design available to meet the requirements. NHSBT would like the opportunity to review the CVs of employees who may deliver professional services to NHSBT. NHSBT may wish to interview the employees and if appropriate reject employees. Please confirm if this is acceptable? Confirmed this is acceptable; please see Appendix A where CV’s of proposed project staff are listed, two of the team have already worked on previous projects with NHSBT. Please confirm the warranty & service arrangements for the products ordered in any resultant contract? Please state how warranty issues are addressed. As defined in the requirements with warranty being delivered by the manufacturer – All Hardware and Software proposed has been upgraded to 5Y warranty with 24 x 7 x 4 hour SLA from the default 3Y standard warranty (listed below). HP Hardware & Software standard manufacture warranty DL580 Server includes 3-Year Parts, 3-Year Labour, 3-Year Onsite support with 9x5 Next Business Day response. P4000 SAN Solutions include 3-Year Hardware & Software, 9x5 Next Business Day response. VMware 5y support and software updates ( 1Y plus 4Y) We would also encourage NHSBT to participate in quarterly planning and review meetings with us, these could also be used to identify and plan firmware and software updates as required: there would be no charge for this service. HP and VMware would also participate as required. CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 11 Fitness for purpose including quality - After sales service (5%) What is your process for logging calls if there is a problem? Support delivery will be provided by HP with calls logged by telephone or email; calls may also be logged directly with HP Service Desk. AS HP SIM is to be implemented extensively throughout the Infrastructure the facility to for the monitored Infrastructure to proactively log hardware fault calls with HP will be enabled. CSA Waverley Support Desk will assist with pre-diagnosis, advice and escalation if required. Support calls and service delivery is operational 24 x 7. Delivery - Delivery date and delivery period (20%) When would you be able to supply and deliver all of the required components and kit to an NHSBT site? Please note this is a UK site. Waverley has worked with HP on the administration of this component list to ensure that it is Correct, Current, and to manage a timely delivery to NHSBT, should we be successful then we can confirm delivery within 10 days of award of contract. Environmental – Packaging (Information only) Can you please state how much carbon is produced and energy consumed in the manufacture and delivery of the required hardware? It has not been possible to identify this detail in relation to the specific products in this proposal, HP has provided us with a copy of “HP Standard 011 General Specification for the Environment” document, this is 105 pages in content, rather than embed or enclose this we can provide it as requested. Further information can be located via the following link: http://www.hp.com/hpinfo/globalcitizenship/09gcreport/enviro/desi gn/packaging.html Environmental – Disposal (Information only) What process do you have for dealing with kit that is end of life and what is the cost for it? We are able to dispose of EOL kit and provide an eco-friendly, secure and cost efficient disposal route for computer, IT & office equipment, WEEE and E-waste. There may be an opportunity to “buy-back” some of the redundant servers following virtualisation, we have had an early discussion with HP regarding this and have the following offer: 2 x DL360 G7’s - £500 each (£1,000) 22 x DL380 G5’s - £100 each (£2,200) 3 x ML370 G5’s - £175 each (£525) 29 x DL360 G5’s - £175 Each (£5,075) 2 x DL580 G5’s - £800 Each (£1,600) 4 x DL380 G6’s - £325 each (£1,300) Total = £11,700 estimated product value CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 12 We would also need to consider transport and processing: Packing and transport will be charged at approximately £1,119 based requiring a full truck load and packing onto pallets from one location. Processing for the 62 units with a resale value = £1,200 Recycling = £650 Total cost estimate = £2,969 Therefore the NET value would equal approximately £8,731 There is not much of a demand for servers less than G4. Alternatively for disposal of any IT equipment we partner with a specialist company Seek-IT to deliver this service. A typical full 42u rack disposal costs around £250 plus any data destruction certification. It may be possible to Buy-Back some of the redundant NHSBT equipment on an ad-hoc basis during the course of this project; this will depend upon availability of the redundant kit as to the BuyBack price achieved. We will work with NHSBT during the course of the project to dispose, recycle and Buy-Back kit as required. Lifecycle costs (65%) Please confirm pricing provided is fixed (including expenses) and that there are no other costs associated with this tender that has not been specified. Please note if there is a delivery charge this should be stated. Confirmed, pricing is fixed, no other costs and no delivery charge. CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 13 9 Pricing Matrix Part Code Description 643086-B21 HP DL580R07 (E7) CTO Chassis 4 643086-B21/B19 HP DL580R07 (E7) CTO Chassis 4 643067-L21 HP E7-4870 DL580 G7 2P FIO Kit 4 643067-B21 HP E7-4870 DL580 G7 Kit 8 643067-B21/0D1 Factory integrated 8 604506-B21 HP 8GB 2Rx4 PC3L-10600R-9 Kit 64 604506-B21/0D1 Factory integrated 64 412648-B21 HP NC360T PCIe Dp Gigabit Server Adapter 4 412648-B21/0D1 Factory integrated 4 580387-B21 HP 4GB SDHC Flash Media Kit 4 580387-B21/0D1 Factory integrated 4 614203-B21 HP NC552SFP 10GbE 2P Svr Adapter 8 614203-B21/0D1 HP NC552SFP 10GbE 2P Svr Adapter 8 578322-B21 HP 1200W CS Plat Ht Plg Pwr Supply Kit 16 578322-B21/0D1 Factory integrated 16 605183-B21 MS WS08 R2 DataCnt4CPU FIO Npi Eng SW 4 HA110A5 HP 5y Support Plus 24 SVC 1 HA110A5/65V Microsoft OS and Apps Support 4 HA110A5/7G6 ProLiant Server DL58x HW Supp 4 TC278AAE HP IC ML/DL/BL Bundle E-LTU 24x7 SW 4 HA110A5 HP 5y Support Plus 24 SVC 1 HA110A5/4YD HP IC ML-DL-BL SW Sup 4 643086-B21 HP DL580R07 (E7) CTO Chassis 3 643086-B21/B19 HP DL580R07 (E7) CTO Chassis 3 CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD QTY Unit Price Total Price (£) Page 14 643067-L21 HP E7-4870 DL580 G7 2P FIO Kit 3 643067-B21 HP E7-4870 DL580 G7 Kit 6 643067-B21/0D1 Factory integrated 6 604506-B21 HP 8GB 2Rx4 PC3L-10600R-9 Kit 48 604506-B21/0D1 Factory integrated 48 412648-B21 HP NC360T PCIe Dp Gigabit Server Adapter 3 412648-B21/0D1 Factory integrated 3 580387-B21 HP 4GB SDHC Flash Media Kit 3 580387-B21/0D1 Factory integrated 3 614203-B21 HP NC552SFP 10GbE 2P Svr Adapter 6 614203-B21/0D1 HP NC552SFP 10GbE 2P Svr Adapter 6 578322-B21 HP 1200W CS Plat Ht Plg Pwr Supply Kit 12 578322-B21/0D1 Factory integrated 12 605183-B21 MS WS08 R2 DataCnt4CPU FIO Npi Eng SW 3 HA110A5 HP 5y Support Plus 24 SVC 1 HA110A5/65V Microsoft OS and Apps Support 3 HA110A5/7G6 ProLiant Server DL58x HW Supp 3 TC278AAE HP IC ML/DL/BL Bundle E-LTU 24x7 SW 3 HA110A5 HP 5y Support Plus 24 SVC 1 HA110A5/4YD HP IC ML-DL-BL SW Sup 3 J9150A HP X132 10G SFP+ LC SR Transceiver 2 J9281B HP X242 10G SFP+ SFP+ 1m DAC Cable 2 J9306A HP 1500W PoE+ zl Power Supply 4 J9306A/ACC UK English Local EMEA 4 J9532A HP 5412-92G-PoE+-2XG v2 zl Swch w Pm SW 2 J9532A/ACC HP E5412-92G-PoE+/2XG v2 zl Swch w Pm 2 HA110A5 HP 5y Support Plus 24 SVC 1 HA110A5/2T6 HP 5412zl Switch w/Prem SW JW Support 2 CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 15 J9538A HP 8-port 10GbE SFP+ v2 zl Module 487658-B21 HP BLc SFP+ 7m 10GbE Copper Cable BQ889A HP P4500 G2 28.8TB SAS Multi-site SAN 3 HA110A5 HP 5y Support Plus 24 SVC 1 HA110A5/8W8 LH Multi-site Soln JW Supp 3 AF534A HP Intelligent Mod PDU 32a Intl Kit 1 248929-B21 HP Rack 10000 Series Carbon Baying Kit 2 383982-B21 HP 600W Rack Top Cable Mgmt Tray 8 383984-B21 HP Rack Top Cable Mgmt Tray Bridge 2 578322-B21 HP 1200W CS Plat Ht Plg Pwr Supply Kit 2 AF054A HP 10642 G2 Sidepanel Kit 2 AF071A HP 100pk Carbt 1U Universal Filler Panel 1 487658-B21 HP BLc SFP+ 7m 10GbE Copper Cable 8 468332-B21 HP NC522SFP Dual Port 10GbE Svr Adptr 8 643086-B21 HP DL580R07 (E7) CTO Chassis 4 643086-B21/B19 HP DL580R07 (E7) CTO Chassis 4 643067-L21 HP E7-4870 DL580 G7 2P FIO Kit 4 643067-B21 HP E7-4870 DL580 G7 Kit 8 643067-B21/0D1 Factory integrated 8 604506-B21 HP 8GB 2Rx4 PC3L-10600R-9 Kit 64 604506-B21/0D1 Factory integrated 64 412648-B21 HP NC360T PCIe Dp Gigabit Server Adapter 4 412648-B21/0D1 Factory integrated 4 580387-B21 HP 4GB SDHC Flash Media Kit 4 580387-B21/0D1 Factory integrated 4 614203-B21 HP NC552SFP 10GbE 2P Svr Adapter 8 614203-B21/0D1 HP NC552SFP 10GbE 2P Svr Adapter 8 578322-B21 HP 1200W CS Plat Ht Plg Pwr Supply Kit CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD 4 14 16 Page 16 578322-B21/0D1 Factory integrated 605183-B21 MS WS08 R2 DataCnt4CPU FIO Npi Eng SW 4 HA110A5 HP 5y Support Plus 24 SVC 1 HA110A5/65V Microsoft OS and Apps Support 4 HA110A5/7G6 ProLiant Server DL58x HW Supp 4 TC278AAE HP IC ML/DL/BL Bundle E-LTU 24x7 SW 4 HA110A5 HP 5y Support Plus 24 SVC 1 HA110A5/4YD HP IC ML-DL-BL SW Sup 4 643086-B21 HP DL580R07 (E7) CTO Chassis 3 643086-B21/B19 HP DL580R07 (E7) CTO Chassis 3 643067-L21 HP E7-4870 DL580 G7 2P FIO Kit 3 643067-B21 HP E7-4870 DL580 G7 Kit 6 643067-B21/0D1 Factory integrated 6 604506-B21 HP 8GB 2Rx4 PC3L-10600R-9 Kit 48 604506-B21/0D1 Factory integrated 48 412648-B21 HP NC360T PCIe Dp Gigabit Server Adapter 3 412648-B21/0D1 Factory integrated 3 580387-B21 HP 4GB SDHC Flash Media Kit 3 580387-B21/0D1 Factory integrated 3 614203-B21 HP NC552SFP 10GbE 2P Svr Adapter 6 614203-B21/0D1 HP NC552SFP 10GbE 2P Svr Adapter 6 578322-B21 HP 1200W CS Plat Ht Plg Pwr Supply Kit 12 578322-B21/0D1 Factory integrated 12 605183-B21 MS WS08 R2 DataCnt4CPU FIO Npi Eng SW 3 HA110A5 HP 5y Support Plus 24 SVC 1 HA110A5/65V Microsoft OS and Apps Support 3 HA110A5/7G6 ProLiant Server DL58x HW Supp 3 TC278AAE HP IC ML/DL/BL Bundle E-LTU 24x7 SW 3 CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD 16 Page 17 HA110A5 HP 5y Support Plus 24 SVC 1 HA110A5/4YD HP IC ML-DL-BL SW Sup 3 J9150A HP X132 10G SFP+ LC SR Transceiver 2 J9281B HP X242 10G SFP+ SFP+ 1m DAC Cable 2 J9306A HP 1500W PoE+ zl Power Supply 4 J9306A/ACC UK English Local EMEA 4 J9532A HP 5412-92G-PoE+-2XG v2 zl Swch w Pm SW 2 J9532A/ACC HP E5412-92G-PoE+/2XG v2 zl Swch w Pm 2 HA110A5 HP 5y Support Plus 24 SVC 1 HA110A5/2T6 HP 5412zl Switch w/Prem SW JW Support 2 J9538A HP 8-port 10GbE SFP+ v2 zl Module 4 487658-B21 HP BLc SFP+ 7m 10GbE Copper Cable BQ889A HP P4500 G2 28.8TB SAS Multi-site SAN 3 HA110A5 HP 5y Support Plus 24 SVC 1 HA110A5/8W8 LH Multi-site Soln JW Supp 3 AF534A HP Intelligent Mod PDU 32a Intl Kit 1 TC290BAE VMw vSphere Ent+ 32P 3yr 24x7 E-LTU 1 TD454AAE VMw vSphere Ent+ 1P 3yr9x5 E-LTU HA107A5 HP 5y 24x7 SW Support 1 HA107A5/2UF VMw vSph Ent Plus 32 P SW Sup 1 HA107A5/66H VMW vSphere EPlus 1P Support 24 578322-B21 HP 1200W CS Plat Ht Plg Pwr Supply Kit 2 AF002A HP Universal Rack 10642 G2 Shock Rack 8 AF002A BASE RACKING 8 AF534A HP Intelligent Mod PDU 32a Intl Kit 16 AF534A/0D1 Factory integrated 16 AF074A HP Rack Grounding Kit 8 AF074A/0D1 Factory integrated 8 CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD 14 24 Page 18 Not applicable 60 x days Professional Services for Installation 60 Total Price: £826,158.81 Please complete the table below for any other costs that apply. Description Mandatory / Optional Cost (£) None Please complete the table below for the TOTAL pricing. Please provide the total pricing of the bid Total Cost (£) Hardware + Software + Services + any other MANDATORY costs £826,158.81 CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 19 10 Solution Overview We propose a server, storage and LAN switch solution to support the requirements of NHSBT for performance, availability and environmental understanding. The solution developed for NHSBT is referred by HP terminology as ‘Converged Infrastructure’ or more broadly as the ‘Private Cloud’. These terms simply imply an agile infrastructure that can respond to change quickly is adaptable for changing service types and has the capability to run any service from any location. Options for all aspects of the project have been evaluated against the following criteria: Fit for Purpose Environmental Lifecycle Costs Ease of Use Ease of expansion 10.1 Solution Deliverables A Server Hardware Platform, based on HP DL580G7, for Virtual Services A Software Platform, based on VMware vSphere Enterprise Plus Edition, to run Virtual Servers A ‘Back End’ Networking Platform, based on HP E5400zl switches, for VMware management and iSCSI SAN traffic A Virtualised SAN Platform, based on HP P4000G2 LeftHand SAN, to provide shared disk services to the virtual server estate Server components to upgrade existing DL580 systems Resource Project Management Design and Architect Services Implementation Services Hands On Training Services Hardware and Software Maintenance Services CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 20 11 Solution Components 11.1 Overview CSA Waverley has a good understanding of NHSBT and the current x86 server estate. CSA Waverley has been engaged with NHSBT for the past 2 years as a trusted advisor, providing consulting services for solutions architecture, capacity planning and troubleshooting. 11.2 Capacity Planning A VMware Capacity Planner audit has been performed across the candidate servers to develop the specification of the host systems hardware. The target planning scenario parameters defined the end state host systems to be no more than 40% utilised. This defined a dual site solution with capacity to run all services without performance impact on either site should a DR event occur. 11.3 Solution Architecture The solution is a dual site, active/active, VMware HA and DRS configuration enabling any virtual server service to run from either location (subject to spanned and routed networking connectivity). An equal number of server, storage and network devices will be deployed to each location providing symmetrical compute and data resources. Hardware devices will be divided across 4 separate rack units to accommodate for power breaker events and to load balance the power and cooling requirements across facility resources. It is understood that NHSBT is engaging with BT OpenReach to upgrade existing WAN connections to multiple 10GbE links. We will use these links to provide SAN replication, VMware management and virtual server migration services. NHSBT may also use these links for production and backup purposes subject to a network review with Cable + Wireless. CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 21 CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 22 11.4 Server Platform NHSBT has chosen to enhance its investment in HP Proliant Servers with new DL580 G7 systems for new virtual server resources. The ProLiant DL580 G7 server is an enterprise class, 4 socket server designed for maximum scalability and high availability. Based upon the latest industry standard processing, memory, I/O and networking technologies, the ProLiant DL580 G7 provides the highest levels of performance demanded by todays compute intensive applications. Unparalleled high availability features, including hot-plug and redundant components, guarantee maximum uptime. HP Integrated Lights-Out 3 (iLO3) technology allows remote administration from a standard web browser without ever having to visit the server. Innovative features, such as the ability to access processors, memory, hard drives, and power supplies while the unit remains secured in the rack, enable rapid response to service events, radically decreasing overall IT costs and server downtime. HP's 4S architecture, inbuilt advanced reliability and scalability features make DL580 G7 a perfect platform for virtualization and consolidation solutions. Each Server is specified with 4 x 10 core Intel E7-487 CPUs and 128GB RAM The total compute power of the solution is: o 1120 Logical CPUS o 1344GHz CPU o 1792GB RAM Each server has 80 logical CPUs and just 16 of the available 64 memory DIMM slots used, allowing for future growth of virtual machines The 4 on-board 1GbE NICs are supplemented with a 2-port 1GbE and 2 x 2-port 10GbE PCI-e NIC cards to allow a high flexibility in deploying networking services with adapter resilience Each server has 4 power supplies operating in a load-balanced and failover configuration The servers will boot the hypervisor from an included SDHC card CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 23 11.5 Virtualisation Platform We propose VMware vSphere 5 Enterprise Plus Edition as it provides the required level of features and functionality that NHSBT requires. It provides a strategic consolidation solution, protecting business-critical applications against planned and unplanned downtime, providing superior application availability and power management. Note: NHSBT may choose to deploy on VMware vSphere 4.1 should a platform review determine that the risk in opting for the latest hypervisor variant is too great. VMware vSphere comprises a number of components that transform industry standard hardware into a shared, main-frame like resilient environment with built in service level controls for all applications. The components of VMware vSphere are classified into: Infrastructure services - These components comprehensively virtualize server, storage and network resources, aggregate them and allocate them precisely on demand to applications based on business priority. Application services - These are components that provide built in service level controls to all applications running on the vSphere platform, regardless of application type or operating system. CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 24 11.6 Shared Storage Arrays NHSBT has already made a large investment in HP P4000 LeftHand SAN solutions for other projects within the organisation so knows the capabilities well. HP P4000 G2 SANs, representing a virtualized pool of storage resources, deliver enterprise SAN functionality that enhances virtual environments, simplifies management, and reduces costs. Easy to deploy, scale and maintain, HP P4000 G2 SANs ensure that critical business data remain available. The innovative approach to storage provides a unique data protection level across the entire SAN, reducing vulnerability without driving up costs the way traditional SANs can. The inclusive licensing model and simple capacity/performance upgrades avoids unpredictable costs as the environment evolves. For this project, the HP P4500G2 SAN storage solution is deployed as a number of separate storage systems to deliver high speed, high capacity shared disk services to the host servers. Each location is specified with 12 hardware storage systems and 144 x 600GB 15K rpm disk drives. The storage nodes will be configured for hardware RAID5 and all data LUNs striped across all disks, in all nodes. The storage cluster has sufficient capacity to enable all presented disk LUNs to be further protected with Network RAID 10 (all data blocks will be copied twice, to different nodes, protecting against node failure). All data LUNs will be replicated between locations to enable business continuity with minimal failover impact to the Trust. The SAN will have over 60TB usable (assuming all data is replicated and protected with Network RAID 10+2), delivering approximately 20,000 IOPs. All storage within the array is thin provisioned, allowing for systems growth without over allocating data storage before it is required. To maintain high performance the SAN will be divided into 2 clusters of 12 systems each, in line with best practices and recommendations from HP subject matter experts. CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 25 A SAN Failover Manager virtual machine will be deployed to the nominated primary datacentre for the control of cluster quorum. This special SAN manager process will ensure that the SAN clusters remain operational (in the primary location) in the event of full cross-site replication link failure. Ideally, a third site is preferred to run this virtual machine storage system and could be deployed to the Filton location if the iSCSI VLAN could be routed there. Having the FOM in a 3rd location mitigates against full site failure preventing the SAN from continuous operation, provided the cluster has 3 operational managers it remains active. 11.7 Networking Services HP E5400zl Intelligent Edge switches have been specified to provide iSCSI connections for P4000 G2 Storage Systems and server 10Gbps cards, and 1Gbps connections for server management NICs. These chassis based devices are scalable for additional services as required with additional 24-port 1Gbps or 8-port 10Gbps blades. These devices provide the ideal platform for the high performance requirements of iSCSI with a 1 Tbps crossbar switching fabric providing intra-module and inter-module switching with 585.6 million pps throughput on the purpose-built ProVision ASICs. Each 10Gbps module has 36MB of port buffers, and the 1Gbps module has 144MB of port buffers ensuring that iSCSI traffic is not throttled. The switches are to be used for ‘Back End’ services for iSCSI, VMware management including vMotion and server remote management through iLO. Distributed Trunking will be implemented, a link aggregation technique where two or more links across two switches are aggregated together to form a trunk. This feature CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 26 overcomes the limitation in IEEE 802.3ad that specifies all links of a trunk have to be from a single switch. Distributed Trunking improves resiliency and load balancing in a Layer 2 network. For each downstream server, it sees the aggregated links as coming from a single switch, which makes any servers that support standard IEEE 802.3ad interoperate with DT. DT offers load balancing of traffic over multiple physical links. From the server to the switch, the traffic is balanced according to the load-balancing scheme configured on the server NIC. From the switch to the server, traffic is balanced according to the MAC destination address (DA) and source address (SA) pair. For switch-to-switch DT, traffic is balanced according to the trunking mechanism such a MAC, IP, or L4 addresses. 11.8 Networking Resilience The network element of the solution is highly available with server and storage NICs connecting to both of the included chassis, and where multiple connections exist to separate blades in the switch chassis. CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 27 Resilience for the WAN links is by diverse routed 10Gbps links provided by BT WaveStream. The networking configuration features Distributed Trunking to maintain active use of both links. 11.9 Geographic Resilience and High Availability 11.9.1 Geographic Resilience The solution has a symmetrical build with equal quantities and sized server, storage and networking components in each datacentre location. The solution is sized to accommodate the 220 candidate servers with a run-time loading of 40% resource utilisation across the entire estate. This will allow for ALL services to operate from a single datacentre should a DR event occur. The hardware and software components of the solution provide the mechanics to achieve an environment state whereby any guest virtual server can run from any location and CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 28 seamlessly migrate between host servers and across locations without loss of disk connectivity or end user access. 11.9.2 VMware HA and DRS The solution is designed to provide high availability for all services virtualised into the environment. The VMware cluster will automatically restart services from a failed host system (HA) across the surviving members of the cluster. This may be controlled further with DRS determining which host systems are best suited to restart those services on. VMware HA VMware DRS 11.9.3 P4000 Multi-Site Configuration The SAN provides high availability for shared disk resources by presenting a logical, single connection point for host servers across both datacentres. 1 2 3 4 A ‘Multi-Site’ configuration with Network RAID10 ensures that all data blocks, and presented disks are available in both locations. In the diagram systems 1 and 3 are placed in DC1 with systems 2 and 4 placed in DC2. CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 29 When combined with VMware vMotion, the SAN topology enables a virtualised server to seamlessly move from one datacentre to the other without loss of disk connectivity or impact on production availability. 11.9.4 Server Availability The server configurations have high availability designed in with redundant power supplies and cooling fans. All LAN and SAN connections will be teamed across NIC chips and PCI-e cards to provide networking resilience. 11.9.5 Networking Resilience The network element of the solution is highly available with server and storage NICs connecting to both of the included chassis, and where multiple connections exist to separate blades in the switch chassis. Resilience for the WAN links is by diverse routed 10Gbps links provided by BT WaveStream. The networking configuration features Multiple Instance Spanning Tree to maintain active use of both links and prefers individual VLAN traffic to a specified MST Instance. CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 30 11.10 Management Platform A centralised management solution for the infrastructure will enable the support teams to have sight of all components from hardware, through applications to service levels available from a single operating console. We propose to deploy all the relevant point product tools to manage each of the solution components and integrate them where this is possible. The management tools may be deployed to physical or virtual server assets and will be defined during the project initiation phase. 11.10.1 vCenter Server A new VMware vCenter server will be deployed as a virtual machine, to allow the management and configuration of the new servers. This system will manage the entire virtual environment and be highly available due to the solution architecture. 11.10.2 SAN Management The P4500 Central Management Console (CMC) is a ‘thick’ client application, loaded onto management workstations. A single management group will be created for the control, provisioning and performance monitoring of the SAN clusters. The CMC has a built-in Best Practises Analyser to ensure a good configuration is maintained for the SAN. Built-in Performance Monitoring enables a deep dive view into storage operations and traffic flows from the host ports to individual disk drives. The CMC will be integrated into VMware vCenter with the HP Insight Control for vCenter Storage Module to get a detailed view of the SAN platform and allow provisioning of shared disk resources directly from the VMware management tool. CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 31 11.10.3 Network Management HP PCM, a Microsoft Windows-based network management solution for managing HP Networking devices, is a free software package that will be deployed to a defined management station. It provides all the basic tools needed to handle a network effectively, designed for small to medium-sized businesses that want to monitor basic device health, capture and browse SNMP and syslog events, and map network devices. 11.10.4 Hardware Management NHSBT already has an HP Insight Control solution in place. Within the scope of the project CSA Waverley will identify upgrades required for this to support the new environment (or deploy a new instance if requested). HPIC will be configured to monitor, alert and report on the hardware server, storage and network platforms. Key features of the Insight Control platform we wish to make use of are: Virtual Machine Management o VMM integrates into VMware vCenter to provide view and management capabilities of virtual machines from within the HPIC application Power Management o HPIC Power Management provides a view, reporting and alerting from individual hardware devices, through rack to entire datacentres for power consumption Remote Support Advanced o This is the comprehensive remote support software product in the HP Insight Remote Support software portfolio. Ideal for use in mid-sized to large IT environments, it provides comprehensive remote support, including fault diagnostics, pre-failure advisories, warranty, and service status 11.11 Integration to Symantec NetBackup for Backup and Recovery As NHSBT already has an investment in Symantec NetBackup you will need to install VMware agents (available under your capacity based licensing model) to support the backup and recovery of virtual machines. Key features required of the solution would be: Rapid backup and recovery De-duplication of data Multiple recovery points Data on disk – eliminate physical tape Full server and file/db level recovery Replicated for HA/DR/BC purposes As the time taken for backups becomes an increasing burden the implementation of a NetBackup Appliance for each datacentre location and multiple media servers would allow more backup jobs to be completed in parallel. These, intelligent, storage units provide for accelerated, de-duplicated backup of target systems to disk based backup devices. Replication between units to the second datacentre will provide a robust recovery mechanism surviving a DR event. CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 32 11.12 Rack Specification and Diagram The solution has all new hardware components located in new HP 10000G2 series racks at both datacentre locations. However, an interim racking solution may be required should insufficient space be available on project implementation, until such time as physical servers have been virtualised and then the solution may be re-racked in final positions. Please note that should the facilities power feeds remain at 16A then the expandability of other devices into the new racks may be limited. The power monitoring solution included in this project will alert to power constraints. 11.12.1 Service and Maintenance Access In the front of the rack, a clearance of 48 in. (1219 mm) is required; this applies to individual rack installations as well as when aligning rack rows so that the front doors are facing each other. In the rear of the rack, a clearance of 30 in. (762 mm) is required to provide space for servicing the rack. CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 33 11.13 Rack layout CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 34 11.14 Rack Power Utilisation Indications Rack 1 – 3 x HP DL580 G7 servers as VMware ESXi hosts, operational utilisation @ 80% (assuming DR event) 1.6KVA, leaving approximately 2KVA for additional equipment (3 more ESXi hosts) Rack 2 – 4 x HP DL580 G7 servers as VMware ESXi hosts, operational utilisation @ 80% (assuming DR event) 2.2KVA, leaving approximately 1.4KVA for additional equipment (2 more ESXi hosts) Rack 3 – 6 x HP P4000 G2 Storage Systems, HP E5400zl switch 2.1KVA, leaving approximately 1.5KVA for additional equipment (4 more P4000 storage systems) Rack 4 – 6 x HP P4000 G2 Storage Systems, HP E5400zl switch 2.1KVA, leaving approximately 1.5KVA for additional equipment (4 more P4000 storage systems) 12 Assumptions 12.1 Physical Access Subject to a detailed site survey for each location, adequate physical access exists to enable the movement of components to their end-point locations and load bearing trolleys (or other carrying equipment) are available for use. 12.2 Working Hours It is expected that the implementation of the solution hardware and software, along with full configuration is completed during normal office business hours of 9:00am to 5:30pm. Some in scope tasks may be required outside of these hours and sufficient notice will be given to ensure the timely completion of these activities. 12.3 Health and Safety All employees of CSA Waverley Ltd. will adhere to the Health and Safety policies in place at NHSBT premises. A copy of our Health and Safety Policy document is available on request. An assessment and method statement for any works in a hazardous area will be made. Any issues regarding Health and Safety will be flagged to the Project Manager for escalation. CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 35 12.4 Environmental As indicated in the solution detail sufficient environmental resources must be in place in each computer room location for Power, Cooling, Floor Space and Maintenance Access. Power Supply/Cable Note: It is understood that each room has 16A ‘commando’ feeds. The solution has 32A Power Distribution Units, power tails will be used to convert the incoming power connections. A strict policy of device addition to racks will be required so as not to overload the 16A circuits. This may be viewed within HPIC for each rack and controlled by the management capability of the PDUs themselves. 12.5 Network Routing, Addressing and Name Services The solution design document will indicate the number of network IP addresses required along with all entries required in DNS. It is expected that for full systems functionality, availability and manageability that server, storage and management networks are routable. Cross site WAN links will be used solely for data replication, VMware management and virtual machine migration VLANs. Extended use of these links to production or backup services would be subject to a networking review with Cable + Wireless, as it is likely that Cisco proprietary protocols are in use for production services and the HP Networking devices use industry standard (IEEE and IETF) protocols only. Should additional services be required across these links then a compatibility mode of operation will need to be identified and implemented. 12.6 Authenticated User Access The implementation of the solution management tools will require user/service accounts with elevated privileges in NHSBT domain. We request that a management administrative account also be created for our implementation team’s use and as a remote connection point for on-going support. Training and Skills Transfer 12.7 Waverley Delivered Training Throughout the Implementation of the project Waverley will work with the NHSBT staff to ensure that skills are transferred to NHSBT in a manner that enables NHSBT to be competent in running the Infrastructure In addition to the ‘Hands On’ training given throughout the implementation of the solution CSA Waverley can provide classroom based training to cover the following topics: Solution Overview Hardware Components VMware Software Configuration CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 36 Management Tool Operations Maintenance Updates Failover Operations It is expected that this training would take place on the solution prior to or just after Acceptance Testing has been performed. The instructor will use the solution documentation, user and maintenance guides as reference material. We offer this training as a 3 day activity which can be included in the 60 Implementation days or as an additional requirement, for up to 6 candidates per instance for £2500. 12.8 Vendor Training Should formal vendor classroom training be required we can arrange this. 13 Work Packages, Implementation Plan -Draft 13.1 Project Implementation The following presents a summary of the Scope of Works to be completed and the various work packages defined for a successful completion of the Data Centre Consolidation through Virtualisation Project as defined in our proposal to support your ITQ reference NHSBT0361/IT/KD. . In summary the key deliverables that this document relates to are: 1. 2. 3. 4. 5. HP E5400zl ‘back end’ Network LAN switching HP DL580 G7 ESXi Server Environment P4500 Multi-Site SAN Design and Implementation of VMware Environment Project Management provided by Waverley throughout Implementation 13.1.1 Outline Work Package Definitions Work Package Project Initiation and Planning Requirement Deliverables To ensure that there is a firm and accepted foundation to the held project prior to commencement of any work To ensure the project scope, Trust To initialise and plan the CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Project Management documentation produced, issued and authorised: approach and timescales are understood and signed off by the Project kick-off meeting Project Initiation Document (PID) Project Plan Page 37 project Quality Plan Communication Plan Design workshop(s) to To determine the quality techniques, requirements and standards to be applied and the responsibilities for achieving the required quality levels To determine the means and frequency of communication for the project Technical Design and Planning To confirm the technical requirements and expectations To review and confirm the solution design and configuration Issue site pack to gather agree and review the following The implementation approach Dependencies, prerequisites and responsibilities Site pack (Handover documentation) Acceptance requirements, planning and testing High level design document produced Site survey reports build information Site Surveys Agree acceptance criteria On site survey to ensure that the location has no delivery or published and agreed health and safety issues( to be undertaken within 1 week of order) To ensure the location has the correct power, air supply conditions and network connections for the installation CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 38 Work Package Switching Installation Requirement Install HP E5400zl switches with blade Deliverables rack - cable and label equipment modules Configure HA resilient connections to outreach distribution Check and update firmware versions for all components functionality to support diverse fibre links and Installation of the switches to Physical connection between switches Test resilience Plan for distribution and edge devices migration Work Package ProLiant Server VMware and Physical Platform Installation Requirement Install Servers to Racks, cable power and Deliverables rack - cable and label equipment networking Ready Servers for OS Installation of the servers to Check and update firmware versions for servers and all components Physical connection of the servers to the iSCSI SAN infrastructure Physically connect the Ethernet for Virtual Machines to the core network switches Work Package P4500 hardware Implementation Requirement Prepare for P4500 Installation Commission P4500 Deliverables Install P4500 nodes into rack infrastructure CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Attach P4500 nodes to the new Page 39 hardware iSCSI network switches Configure P4500 network parameters including IP address configuration Node name and DNS configuration Network load balancing configuration Initial configuration completed from engineer laptop Install HP P4500 Central Management Console client application on included management server and vCenter server Check Storage Node for firmware levels BIOS, RAID Controller, Disk Expander SAN IQ level SAN IQ Patches Create P4500 Storage Cluster including Define new P4500 Management Group Define new P4500 Sites Add P4500 storage nodes to the new clusters Configure SNMP and e-mail alerting CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Present storage to servers Page 40 Work Package VMware ESX Cluster Build Requirement Ensure environment is ready to accept view Install iSCSI Initiator Install MPIO Framework Install P4500 Device Specific Module Present storage to servers Deliverables Install VMware ESXi 4.1 to SD card in all ESX hosts VMware from server, network and storage Configure IP, DNS, NTP and locale settings Installation of vCenter Server to defined virtual machine Create new cluster Add all new ESX hosts to the new cluster Create vmfs data stores for virtual machines Configure virtual switches, VLANs and networks to support the requirements of the trust Configure VMware Update Manager to scan new hosts Work Package Physical to Virtual Migration Requirement Develop migration plan and methodology Migration of Phase 1 Deliverables Defined process for the migration of physical server assets to virtual machines CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 41 systems Time on site to perform server migrations (detail to be defined by the PID) Work Package Infrastructure management Requirement Install the HP System Insight Manager (SIM) Deliverables System Insight Manager solution throughout all components Install HP Remote Integrate VMware vCenter Integrate P4000 CMC Verify Latest version of Insight manager components installed Support Advanced Install and configure the HP Integrate CMC, vCenter and HP SIM for server and storage (P4000) management Test that SIM is receiving alerts and forwarding emails for servers, storage and networking Integrate the Remote Support component and verify connectivity to HP Work Package Training Requirement Skills transfer throughout the Deliverables unable to release staff for this, so: Following Implementation Classroom Classroom training onsite for all support staff Implementation will be minimal as the Trust are Document installation Using implemented Infrastructure as hands on training methodology Infrastructure Documentation to be used as training schedule based Training onsite for CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 42 all members of the Medway Trust support teams At the end of the training staff will be competent in the operation of the hardware and VMware solution Work Package Project Management Delivery Requirement A single point of contact to manage the end Deliverables Manage project delivery including: to end delivery of the project Skills Transfer Requirement Risk management and reporting Issue management and reporting Regular Highlight reports Progress meetings/ calls as required Quality plan Clear communication plan Work Package Management of project issues and escalation Project and stage planning Management of project risks Carry out dedicated skills transfer session Deliverables Waverley consultant to provide skills transfer as required during the implementation process Acceptance Testing Handover Documentation Acceptance testing as per agreed plan Publish Handover documentation Complete and sign-off acceptance test plan HP P4500 configuration documentation Logical SAN Visio diagram Updated Site Pack CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 43 Project Closure Confirmation that all Acceptance test plan report Project closure agreed: The original objectives for Waverley’s involvement in the project have been checked against the PID Follow-on actions and recommendations determined Project Closure Meeting End project report provided, if products have been delivered /approved an agreement reached to close the project Formal agreement that the project is closed required 13.1.2 Outline Project Schedule (Project Plan) Start Date Works Resources Day1 Project Initiation Waverley Design and Implementation Team Design Review Days 3 NHSBT Project Manager NHSBT IT Server Support Teams Prior to delivery Site Surveys Waverley Team 1 Network Installation and configuration Waverley Team 5 - 10 Hardware Installation (Servers/Storage/Networks) Waverley Team 4 ESX Cluster Build Waverley Team 10 NHSBT Team Acceptance Testing Waverley Team 5 NHSBT Team Physical to Virtual Migrations Waverley Team CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD To be defined Page 44 NHSBT Team Documentation of Infrastructure Waverley Team Project Management Waverley Project Manager Project Sign Off Waverley Design and Project Manager 10 5 - 10 1 NHSBT Project Manager 14 Standard Transparency Clause 14.1 15.1 Background To meet the expectations of the Treasury Restrictions and Cabinet Office Transparency and Reporting guidelines we intend to publish all contracts in full over an estimated £10,000 in value on a public accessed web site [email protected] For ICT related products and services this is applicable from July 2010 and from Jan 2011 all contracts (over £10,000 in value). The following is an extract from the Transparency – Publication of Tender Guidance Notes prepared September 2010 which provides useful background information. ‘Government has set out the need for greater transparency across its operations to enable the public to hold public bodies and politicians to account. This includes commitments relating to public expenditure, intended to help achieve better value for money. As part of the transparency agenda, Government has made the following commitments with regard to procurement and contracting: All new central government ICT contracts over the value of £10,000 to be published in full online from July 2010. All new central government tender documents for contracts over £10,000 to be published on a single website from September 2010, with this information to be made available to the public free of charge. New items of central government spending over £25,000 to published online from November 2010. All new central government contracts to be published in full from January 2011. Suppliers and those organisations looking to bid for public sector contracts should be aware that if they are awarded a new Government contract, the resulting contract CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 45 between the supplier and Government will be published. In some circumstances, limited redactions will be made to some contracts before they are published in order to comply with existing law and for the protection of national security.’ 14.2 Supplementary Terms The following supplementary terms will apply to any resultant contract. 1. The parties acknowledge that, except for any information which is exempt from disclosure in accordance with the provisions of the Freedom of Information Act (FOIA), the content of this Agreement is not Confidential Information. NHS Blood and Transplant (The Authority) shall be responsible for determining in its absolute discretion whether any of the content of the Agreement is exempt from disclosure in accordance with the provisions of the FOIA. 2. Notwithstanding any other term of this Agreement, the Contractor hereby gives his consent for the Authority to publish the Agreement in its entirety, including from time to time agreed changes to the Agreement, to the general public. 3. (i) The Authority may consult with the Contractor to inform its decision regarding any exemptions but the Authority shall have the final decision in its absolute discretion. (ii) The Contractor shall assist and cooperate with the Authority to enable the Authority to publish this Agreement 14.3 15.3 Approval Therefore we seek your confirmation you are in full agreement with the clauses listed under 1-3 and ask that you complete and return this form below (as part of your tender response). Please identify to the Authority any contract areas that you wish to mark for protection. Note: all such requests will be subject to review and approval by the Authority. We have reviewed the confidentiality clauses 1-3 and provide you with the approval to publish if appropriate any resultant contract. Areas marked for protection are listed below. For and on behalf of CSA Waverley Authorised Signatory Name / Title within company District Sales Manager Date 12/10/2011 CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 46 15 Supplier Response Information 15.1 16.1 Responding to the tender Please provide confirmation of acceptance of the terms and conditions of this invitation to tender document and all terms referred to herein. ACCEPTED Please provide confirmation of acceptance of the additional transparency terms listed in section 4. And sign where appropriate. ACCEPTED Please provide itemised pricing that cross matches the kit list in section 2. Please also provide a total price figure. PROVIDED Please provide a written response to the requirements catalogue in section 3. PROVIDED 16 References REFERENCES AND EXPERIENCE Name of Organisation Bio Products Laboratory Contact Name Mike Ramsay Job Title IT Infrastructure Manager Address Bio Products Laboratory Dagger Lane Elstree Herts WD6 3BX UK Date April 2010 to March 2011 Email [email protected] Tel/Fax Number 020 8957 2200 Nature of Contract Implementation of Virtualisation project based upon HP DL380 servers, VMware and HP P4000 SAN. Dual Computer room. Project encompassed: Design, Implementation, P2V migrations, Training, Skills Transfer, and Documentation. CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 47 REFERENCES AND EXPERIENCE Name of Organisation Medway NHS Trust Contact Name Mark Bishop Job Title IT Infrastructure Manager Address Windmill Road Gillingham Kent ME7 5NY Date March 2011 to Present Email [email protected] Tel/Fax Number 01634 833700 Nature of Contract Large scale Infrastructure refresh comprising of HP C7000 blades, P4000 SAN (21 Nodes), HP A Class core switches, Symantec NetBackup. Project encompassed: Design, Implementation, P2V migrations, Training, Skills Transfer, and Documentation. CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 48 REFERENCES AND EXPERIENCE Name of Organisation The Royal Free Hampstead NHS Trust Contact Name Roy Cranford Job Title Assistant Director of Information Systems Address The Royal Free Hospital Lower Ground Floor, IT Dept., Fleet Road, Hampstead, LONDON NW3 2QG Date December 2010 to Present Email [email protected] Tel/Fax Number 0207 794 0500 Nature of Contract Large scale Infrastructure refresh comprising of 4 x C7000 blades, P4000 SAN (16 Nodes) HP Data Protector and D2D backup. Project encompassed: Design, Implementation, P2V migrations, Training, Skills Transfer, and Documentation. CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 49 Project Staff CV’s 1.0 Rob Hertz – Project Implementation Key Skills: HP AIS – Blade Systems 2008 AIS - HP Proliant 2008 AIS – StorageWorks 2008 ASE- Proliant 2008 ASE – HP StorageWorks 2008 ASP - HP Proliant 2008 VMware & Citrix VCP – VMware Certified Professional 3 VCP – VMware Certified Professional 4 VTSP – VMware Technical Sales Professional 4 Networking HP AIS – ProCurve 2009 CCNA – Cisco Certified Network Associate CCDA - Cisco Certified Design Associate Microsoft Microsoft MCSE– Windows 2003 Microsoft Certified Systems Engineer Microsoft Server NT4, 2000, 2003 and 2008 training and experience Microsoft Networking and DNS training and experience Microsoft Exchange 5.5, 2000, 2003, 2007 and 2010 training and experience EDUCATION 3 CSE's grade 1-3 GCSE Maths CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 50 City & Guilds Maths & Communications BTEC National Diploma Engineering BTEC National Diploma in Computer Studies Full clean UK driving licence SKILLS SUMMARY My key skills lie in designing, architecting and implementing complex server, storage, enterprise backup and virtualisation solutions. My key technology areas are HP Storage and servers, VMware virtualisation, enterprise backup solutions. I also have a thorough understanding of disaster recovery and business continuity in enterprise environments. PROFESSIONAL ACCREDITATIONS & SKILLS HP AIS – Blade Systems Solutions 2010 AIS – HP Proliant 2008 AIS – StorageWorks 2008 ASE– Proliant 2008 ASE– HP StorageWorks 2008 ASP– HP Proliant 2008 VMware & Citrix VCP – VMware Certified Professional 3 VCP – VMware Certified Professional 4 VTSP – VMware Technical Sales Professional 4 Networking HP AIS – ProCurve 2009 CCNA – Cisco Certified Network Associate CCDA – Cisco Certified Design Associate Microsoft Microsoft MCSE– Windows 2003 Microsoft Certified Systems Engineer Microsoft Server NT4, 2000, 2003 and 2008 training and experience Microsoft Exchange 5.5, 2000, 2003, 2007 and 2010 training and experience Other Extensive HP9000 HP-UX training and experience Extensive Microsoft Clustering experience Extensive knowledge of most backup vendors (Backup Exec, NetBackup, Evault D2D, Symantec PureDisk, Data Protector) CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 51 CAREER Current Role I have worked for CSA Waverley for over 10 years in the Technical Services Team. I have strong knowledge and experience HP 9000 Unix systems and have been involved in numerous HP9000 implementations. Over the last 8 years I have been primarily involved in the design, implementation and support of HP Proliant Servers and Storage Systems and providing VMware virtualisation Solutions. I have been involved in a great number of installations from planning stage to integration on site. The projects range from HP Proliant server installations, Windows AD migrations, exchange cluster installations and migrations, HP EVA & MSA storage installations and upgrades and a great number of VMware ESX installations and migrations. CSA Waverley Ltd – Technical Services Consultant – (September 1998 – Present) Hewlett Packard Ltd – Response Centre Engineer (September 1997 – August 2008) Computer Sciences Corp. – Systems Support Engineer – (Dec 1989 – August 1997) PERSONAL QUALITIES I have over 20 years’ experience within the IT and communications sector. I bring a wealth of technical expertise, strategic awareness, professionalism and distinct personality to any role. I am hard working and bring a proactive and adaptable approach to any team. I am confident leading and driving a team and, equally, happy in a group dynamic, contributing and communicating effectively. I enjoy building strong relationships with all I work with. With wide ranging technical expertise and experience to draw upon, I overcome challenges with a tenacious and logical approach and a calm, level-headed attitude, always keeping the wider strategy in mind. 2.0 Jonathan Chamberlain – Project Manager 1. WORK HISTORY Sep’09 - Present Service Account Manager @ CSA Waverley Ltd CSA Waverley is a specialist provider of end-to-end IT infrastructure support, services and solutions with over 25 years’ experience in the NHS, public and private sectors. CSA Waverley’s ethos is service excellence and we deliver everything from infrastructure refresh projects to data centre, desktop and bespoke support solutions as well as asset CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 52 lifecycle management, www.csawaverley.com single service and outsourced managed services. My responsibilities fall into 3 main areas. Firstly I provide Service Account Management based on ITIL principles to several of our largest customers, who have expansive and multi-layered managed framework IT service contracts, acting as their primary daily contact for day-to-day management. Secondly, I provide Project Management and Coordination expertise based on PRINCE2 principles for projects ranging from simple equipment delivery and installations through to large multi-site data and service migrations. Finally, I have responsibility for managing the day-to-day activities and providing line management to the Sales Order Processing and Administration teams internally. My role reports directly into the Managing Director, although I have strong interfaces with the Sales and Technical Support teams too Main Tasks & Responsibilities: First point of contact for, and daily management of our largest customers’ framework contracts, handling all areas of delivering IT Service Management products defined within them Responsibility for collation of all customer Management Information on a monthly basis, and formally presenting this at regular service reviews, as well as owning any and all issues raised through to resolution In conjunction with the Sales Director, defining and pricing of all Service Management products that underpin CSA Waverley’s external service offerings Project Management and Coordination activities as and when required. Recent examples include a new Server, Storage and Backup solution/refresh/virtualisation project for an NHS Trust, and a multi Data Centre equipment, service and data migration project for an NHS shared service Ensure that work within the office based Administration team is completed within KPI’s and objectives that I set and manage to meet departmental goals and wider business objectives Training, development and regular review of individuals within the team, as well as all new starters to it Accountable for the Sales Order Processing function, and responsible for defining process and system improvement suggestions to it to the Managing Director Oct’01 – Sep’09 Supply Chain Management 3rd Party Manager @ Affiniti, a Kingston Communications business (Formerly Omnetica Ltd, and Siemens Network Systems Ltd) Directly responsible for an administration team of 6 people, my department was accountable for quoting, ordering and administering all 3rd Party maintenance business for Affiniti’s customers, where onsite engineer, hardware or TAC services could not be provided in-house. This touched around 70% of the customer base, managing some CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 53 £26m of repeat annual maintenance business across dozens of global manufacturers, support providers & partners. My role reported to the Development Manager. Main Tasks & Responsibilities: Managed the objectives and KPI’s for the 3 rd Party support team Training, development and regular review of the team, and new starters Escalation point for team, as well as enquiries from both internal and external customers, and 3rd Party support providers/manufacturers Deputising for the Development Manager is his absence, and assisting with tasks related to support contract base integrity, process control & reporting Producing month end maintenance reporting to Kingston Group at director level, as well as regular ad-hoc reporting in support of Bid Managers, Account Managers, Service Delivery, Network Support and Go-to-Market teams as required Managed several more complex maintenance contracts, including accurate capture of end user contracted support base and associated invoicing Created, and managed monthly renewal schedule check process that initiated the formal Business renewal process, where end users’ support contracts, manufacturer end of life, SLA’s, spares, engineer availability and 3rd Party support pricing were all reviewed For the final 3 year with Affiniti, I was one of several key business stakeholders involved with the internal migration to a common set of systems and processes throughout the business, following Kingston’s purchase of Omnetica in 2004 Apr’00 - Oct’01 Software Services Co-ordinator @ Siemens Network Systems Ltd Quoting, ordering and internally administering end user support for 3 rd Party software Ensured customers had access to software updates as per their maintenance contracts, either via internet or physical shipments Compiling software release bulletins of information around new releases and functionality, end of life support and security alerts/vulnerabilities Dealing with all internal & external software queries Mar’99 – Apr’00 Software Licence & Database Administrator @ Bull Information Systems Assisting customers and internal sales managers with information, selection and acquisition of Microsoft licences and software Assisting the Year 2000 Compliance project management team with maintaining internal database of end users records, corresponding with manufacturers and suppliers, producing reports & scheduling/liaising with field engineers Jul’97 – Mar’99 Various short & long term temporary agency placements in Exeter, including Salestrac Ltd, West Country Tourist Board, London & Manchester Assurance, Exeter Citizens Advice Bureau CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 54 2. OTHER SKILLS & QUALIFICATIONS Feb’11 APMG International PRINCE2 Registered Practitioner The above is an Industry wide, Internationally recognised qualification that demonstrates best practise in Project Management Oct’10 ISEB Foundation Certificate in IT Service Management v3 Upgrade of existing ITIL & IT Service Management best practise to current certified level Jun’07 ISEB Foundation Certificate in IT Service Management v2 The above demonstrates an understanding of ITIL Service Support and Service Delivery principles, and best practice in IT Service Management Feb’03 – Dec’03 Chartered Management Institute Level 3 Certificate in Management Designed to support the development of 1 st line managers, the Herts Management Development Programme run by Carlton Stewart resulted in the successful attainment of the above qualification in January 2004 Topics covered include; managing information and communicating for results, customer focus, planning & change, introduction to quality management, using & controlling resources, developing yourself as a supervisor, staffing & selection, developing people and planning work, improving the performance of your team Other Excellent understanding of the workings of operational customer/supplier relationships, having several years’ experience of being both a customer and a supplier at the same time. Developed excellent base of contacts within industry through working relationships Specialist experience of quoting for, purchasing and governance of 3rd Party support, requiring knowledge and understanding of underpinning manufacturer contracts and pricing models, the underlying SLA’s and pricing provided to external customers Exposure to both public and private sector businesses, from large, global financial and retail institutions, through to SME’s, to channel based distributors and service partners, right through to local government and NHS bodies. This has provided a revealing insight into the everyday challenges experienced by a variety of sizes and types of business, allowing greater understanding of the solutions required to progress CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 55 Several years working within a high pressure environment, where a high rate of constant change, innovation and development is the norm, and delivering a positive customer experience is the key goal 3. EDUCATION Lancaster University 1994-1997 June 1997: BA (Hons) Human Geography, Class II(ii) Hemel Hempstead School, 1987-1994 June 1994: A Level Geography (A), Mathematics (B), General Studies (B), Physics (C) June 1991 & 1992: 8 GCSE’s at Grade A & B CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 56 3.0 Darron Edwards – Technical Design Current Position Senior Solutions Consultant, CSA Waverley Personal Details Date of Birth: 21 April 1969 Status: Married Driving License: Full PROFESSIONAL PROFILE Pre-Sales and Post Sales Consultancy and Delivery Architect, implement and support Enterprise Infrastructure solutions for single and multi-site projects. I provide design, project and implementation skills for: High Availability, Disaster Recovery and Business Continuity VMware vSphere HP BladeSystem, HP Proliant x64 systems, HP Integrity ia64 systems Enterprise Storage solutions: HP StorageWorks Enterprise Virtual Arrays, HP P4000 Arrays (formerly LeftHand) HP P2000 Arrays, HP 3PAR Arrays Fibre Channel and iSCSI SAN infrastructures Enterprise backup solutions: Tape Library, D2D and VTL library Symantec Backup Exec, Symantec NetBackup HP Data Protector, Seagate i365 eVault Microsoft Exchange and SQL high availability solutions Recent Major Projects: Design and Implement a dual site high availability (DR) VMware solution for 2 Fire Services with HP P4500 SAN and Proliant DL servers. The solution includes cross site backup to provide resilient data protection. The solution allows the Services to implement Shared Services and improve the availability and resilience of all IT hardware platforms. Design and Implement a dual site Business Continuity VMware solution to Bio Products Laboratory (NHSBT) with HP P4500 SAN and Proliant DL servers. The solution has allowed the customer to provide high availability to critical systems in the production of blood plasma products. Design and Implement a dual site Business Continuity solution to West Suffolk Hospitals NHS Trust with HP EVA SAN and Proliant DL servers. The solution supports SQL and File serving clusters and a medium sized VMware estate. The solution allows the Trust to operate all IT services from a single room providing the hospital with resilience in the event of critical power failure. CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 57 4.0 Chris Hall Key Technological Experience Virtualisation/Infrastructure Engineer Windows Server – NT 3.51 through to Windows 2008 Windows 2000, 2003 & 2008 Clustering (physical & virtual) VMware ESX Server 2.5, 3.5 & vSphere 4.x VMware Server, vCenter, P2V, HA & DRS etc. HP Proliant & Dell PowerEdge server hardware HP Blade technologies including Virtual Connect ITIL V3 Foundation certified Career History CSA WAVERLEY LTD, High Wycombe 2011 – Present Virtualisation Engineer Responsible for servicing Waverley accounts with system integration services and support as per formal Service Level Agreements that have been established with our customers. Consult on projects and deliver virtualisation solutions to the customers’ requirements and timeframes, implement supporting infrastructure such as HP networks and SAN (iSCSI & fibre) storage along with any required management applications. Provide documentation of the newly implemented service and give training where necessary. REED ELSEVIER, Oxford 2005 - 2011 Consulting Systems Engineer Worked closely with Reed Elsevier’s internal customers to provide IT architectural advice and robust reliable solutions in line with business and IT strategy. Managed projects from conception through to implementation. Matrix management of project teams and successful delivery of support documentation. Design authority on multiple projects, including the design and transition into production of a new virtualisation environment which I also CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 58 managed and supported: Host to approximately 1100 virtual servers Hosted on VMware vSphere 4.1 (54 hosts) Migration of 300 physical servers into virtual guests Led the implementation of a new enterprise tax calculation and reporting system. This resulted in SOX compliance, more resilient, faster and reliable servers, and networks with full disaster recovery. Drove the on-going improvement of a customer facing web application used by authors to submit articles to the journals, published for reviewers and editors to access: Comprises of nearly 300 IIS, file and SQL (deployed on clusters) servers Containing over 5000 databases 2003 -2005 Managed successful project to create business and disaster recovery plans by creating a second environment at the DR location. ELSEVIER, Oxford Senior Microsoft Systems Engineer Designed and delivered virtualisation of servers in order to cut operational and infrastructure costs. Played an influential role in the successful improvement of relationships between the business units and IT by improved processes and adherence to SLAs. 1999 - 2002 DIGITAL ISLAND INC. London and USA Microsoft Implementation Team Leader Spearheaded the development and growth of the Microsoft implementation team, supporting the European region. Liaised and coordinated activities with US counterparts. Responsible for the health, wealth and performance of the local team members. Developed successful professional partnerships with several key customers. 1998 - 1999 COMPUTER FUTURES LTD, London Windows NT Roll out/migration (contract) 1993-1997 ELI LILLY & CO, Basingstoke Help Desk Support (contract) CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 59 LOFGREN (UK) LTD, Oxford Systems Engineer Production of servers, workstations and PC’s for home and business use. Installation, configuration and support of a variety of Microsoft environments, ranging from DOS through Windows. West Kent College of Further Education (1986 – 1987) Education Tunbridge Wells Grammar School for Boys (1980 – 1986) CSA Waverley Response to NHSBT ITT NHSBT0361/IT/KD Page 60
© Copyright 2026 Paperzz