Slide Deck Here
Transcription
Slide Deck Here
Independent Electricity System Operator Rapid Migration of Big Data - Oracle DB using IBM Enterprise Storage Tools © 2012 IBM Corporation Presented by: Sajid Rizvi, Oracle Database Consultant / IT Architect IBM GBS Customer Representative: Noel Sabandal, Architecture and Quality Assurance Lead IESO Contributions Mark Bunn, Lead IT ArchitectIESO account - IBM GBS 2 2 © 2012 IBM Corporation IESO – Rapid Migration of Big Data Business Context 3 © 2012 IBM Corporation Application (MDM/R) processes at a Glance Smart Meter Entity (SME) - IESO On March 28, 2007, the Independent Electricity System Operator (IESO) was designated as the SME by Ontario Regulation 393/07 under the Ontario Electricity Act. Responsible for the operation of a central meter data repository the Meter Data Management and Repository (MDM/R) Smart meters installed across Ontario : 4.77M Active SDP/meters enrolled in MDM/R : 4.48M Processing intervals and register reads daily over : 107M Projected upon enrolment of all SDP/meters : 120M Delivering Billing responses daily : 133K Shared Service for 71 Local Distribution Companies (LDCs) and 9 LDC Authorized Agents 4 © 2012 IBM Corporation Operational Challenges 5 CPU utilization reaches 100% No more CPU can be added due to hardware limitation SAN storage utilization reaching maximum capacity No more SAN can be added to the existing infrastructure RMAN Backup execution time taking over 8 hours for full Backup RMAN run time increases with data growth hitting application performance. Additional test environment required Unable to add SAN and Server to the current infrastructure Test Environment refresh from Production takes 18 hours using RMAN Restore causing delays in testing activities. Fast Refresh option unavailable on current infrastructure Disaster Recovery RPO and RTO not meeting business requirement DR needs to be un-squished and CPU memory borrowed. © 2012 IBM Corporation Infrastructure Upgrade Objectives Rapid Migration of Production and all other testing environments to new Infrastructure Provision production size test environment without production down time Improve Performance with upgraded Power system and Storage Instant Recovery in case of failure Improve Backup process reducing load on Production Meet Disaster Recovery RPO and RTO. 6 © 2012 IBM Corporation IESO – Rapid Migration of Big Data Technical Context 7 © 2012 IBM Corporation Migration Challenges 45 TB of Production and DR Oracle Database environments to be migrated from Old to New infrastructure during one weekend outage. Long testing cycles for Functional, Performance and User acceptance tests requiring multiple cut over from Production. DR environment to be tested as Independent primary Production first followed by conversion to DR environment during Parallel run. A parallel run of one month to be performed on old and new production Two Production like test environments to be cut over before Production. Multiple cut over required to run latest input files to compare old and new production environments. Multiple iterations of a test cycle to be done using Oracle Flash Copy 8 © 2012 IBM Corporation Migrating 45 TB Storage (Oracle Databases) within a 12 hour maintenance window. Design and build 9 new environments on the new infrastructure Initial creation/restore of large Oracle database from tape RMAN backup took 14 hours (not including the logistics of tape movement) How is it possible for us to synchronize this enormous OLTP Database fast enough to allow a seamless transition to the new infrastructure? Need to synchronize the database at minimum twice for parallel testing and for production cutover Need to be able to repeat the synchronization at short notice to allow for rapid recovery of testing an cutover testing or cutover 9 © 2012 IBM Corporation Existing Environment Challenges 10 Upgrade and Migration Bendfits SAN Storage reaching its maximum capacity and Database size continues to grow Mix of Solid State & IBM DS8870 System Storage with Easy Tier feature to automatically optimize performance Continuous performance degradation with increased volume. RMAN backup conflicting with application processing Gold Tier Storage added with Flash drive using Easy Tier and IBM Flash Memory. CPU and Memory capacity maxed out on frame and no new CPU power can be added Increased CPU and Memory with new P7 Frames and DS8870 SVC Storage Additional test environments required for Performance and volume testing New Production size environment for Performance test added to the frame. RMAN Backup execution time taking over 8 hours affecting application performance New Backup server added to off load RMAN backup from Production using IBM Flash copy & Oracle RMAN Removed impact to Production completely Test Environment refresh from Production takes 18 hours using RMAN Restore. IBM FlashCopy with Oracle RMAN Restore to reduce database Restore window to 4 hours Application performance slowness. Unable to process expected volumes within allotted window. With upgraded state of the art hardware and Oracle changes, the application performance increased Enhanced Disaster Recover capability and other services to address LDCs’ evolving requirements New Disaster Recovery Environment with RTO of 6 hours compare to 24 hours in old environment © 2012 IBM Corporation 11 11 © 2012 IBM Corporation 12 12 © 2012 IBM Corporation 13 © 2012 IBM Corporation 14 © 2012 IBM Corporation 15 © 2012 IBM Corporation 16 © 2012 IBM Corporation IESO – Rapid Migration of Big Data Flash Copy 17 © 2012 IBM Corporation IBM Flash Copy for Oracle Database FlashCopy runs at block level and across all LUNS Consistency Groups required for Flash copy Operation (Data+Index & FRA) Works well with file system, ASM over multiple LUNs or a mixture of both ASM and file system – DATA consistency group contains data and index files – FRA consistency group contains Redo logs, Archivelogs and Flashback logs FlashCopy must be performed in two stages, Data Consistency followed by FRA. 18 © 2012 IBM Corporation 19 © 2012 IBM Corporation IESO Big Data Migration Storage Tier 20 © 2012 IBM Corporation Storage Tiers TIER 21 Description Proposed Solution TIER 0 Ultra High Performance. Meet QoS for High End Mission Critical applications < 2ms Avg Response Time > 1000 Avg IOPS/LUN DS8870 with SSD TIER 1 High Performance and/or Availability. Drive up utilization of high-ended storage subsystems and still maintain performance Q0S objectives For low capacity requirements smaller less powerful devices may meet tier definition < 12ms Avg Response Time 120 Avg IOPS/LUN DS8870 with 300GB 15,000 rpm Disk drive set in RAID5/RAID10 arrays. TIER 2 Medium Performance and/or Availability. Revenue generating applications. Meet QoS for non-mission critical Applications For low capacity requirements smaller less powerful devices may meet tier definition < 12ms Avg Response Time 80 Avg IOPS/LUN Not Used. TIER 3 Low Performance and/or Availability. Non-Mission critical applications. Archiving. < 10sec Avg Response Time 50 Avg IOPS/LUN DS8870 with 3TB 7.2K Disk drive set in RAID5. TIER4 Long term retention, backup. Client data recovery from Tape TS35 © 2012 IBM Corporation Oracle Backup comparison before and after Migration PROCESS ENVIRONMENT FREQUENCY EXECUTION TIME Weekly 10 hours Moved to BKP Moved to BKP New Backup server Daily 5 hours New Backup Daily 20 Minutes Old Production RMAN Full Backup New Production Flash Copy Backup 22 22 © 2012 IBM Corporation Infrastructure Upgrade Objectives Rapid Migration of Production and all other testing environments to new Infrastructure Provision production size test environment without production down time Improve Performance with upgraded Power system and Storage Instant Recovery in case of failure Improve Backup process reducing load on Production Meet Disaster Recovery RPO and RTO. 23 © 2012 IBM Corporation Call to Action IBM Announces New DS8880 • To get more Info on DS8880, click here. www.ibm.com/DS8000 • To learn more about this migration or to see the brand new DS8880 just announced this week, please stop by and visit IBM at Booth # 1301 at Oracle Open World 2015. You can meet our presenters and see the new hardware system. 24 © 2012 IBM Corporation Thanks to Vishal Verma Khurram Shiraz Jack Gao 25 © 2012 IBM Corporation Contacts Sajid Rizvi – [email protected] Mark Bunn - [email protected] Noel Sabandal - [email protected] 26 © 2012 IBM Corporation Thank You 27 © 2012 IBM Corporation