SysSel
Transcription
SysSel
The Management School Lancaster University MSc in E-Business & Innovation (EBIN) 1 SysSel How To Select Your New Computer System: Pitfalls & Proven Methods Slides See back of booklet. 2 Selected Contact Details & References For System Selection Projects 1. Package, system, supplier and outsourcing evaluations and selections. Technology/IT procurement including contract negotiation. Martin Tate, IT Evaluation www.itevaluation.co.uk [email protected] 2. Providers of Prince project management method and SSADM systems analysis & design method. [Formerly CCTA.] The UK Office of Government Commerce (OGC) www.ogc.gov.uk 3. Purchasing & Supply Management Model from the Chartered Institute of Purchasing & Supply CIPS www.cips.org 4. Directory of suppliers and software in book and online form. mi IT software directory. Computing mi (part of VNU) www.computingmi.co.uk 5. Commercial service supplying details of potential systems. Their staff ask for a system profile and send details from those registered. [Caution this is not comprehensive, as IT vendors pay to register their products.] The Computer Users Information Service www.cuis.co.uk 6. Erling S. Andersen, Kristoffer V. Grude and Tor Haug Goal Directed Project Management: Effective Techniques and Strategies Kogan Page (Jun 2004) ISBN: 0749441860 7. Benjamin B Tregoe & Charles H Kepner The New Rational Manager: An Updated Edition for a New World (available via the KT website) Management text on problem analysis, decision analysis and situation appraisal. Covers scoring techniques (including weighted attribute) for formal, rational decision-making within organisations. Kepner-Tregoe, Inc (worldwide) www.kepner-tregoe.com Kepner Tregoe Ltd (UK) [email protected] 8. Nathan Hollander Guide to Software Package Evaluation and Selection: The R2ISC Method Amacom (Jun 2000) ISBN: 0814405533 Copyright © 2007 Martin Tate All rights reserved. No part may be reproduced without the prior permission of the publisher. The Management School - Lancaster University 3 SysSel Origins & Heritage Of The Method This section shows the originators of the various aspects of this method. See the prior section for contact addresses of the organisations mentioned. 3.1 OGC – standards in UK government IT • Prince project management, including project board (PB) and project sponsor. 3.2 Kepner/Tregoe – formal decision-making techniques • Mandatory requirements. • Scoring techniques (part of). 3.3 LBMS – methods & CASE tools (Learmonth Burchett Management Systems Ltd, now part of Computer Associates). • Original Tasklist for LBMS Package Evaluation (method created in 1988). • Scoring techniques (part of). 3.4 IT Evaluation – further development/application of method • Integration of Responsibility Chart into method. • Method of scoping by ‘triage’. • Techniques for contacting suppliers for feasibility costings. • Techniques for incorporating and presenting best practice to the user before interviews, including the ‘Aunt Sally’ or ‘Straw Man’ RDD. • Creation of scoring definitions. • Use of key project documents as attachments to contract. • All formats shown, including advanced use of word processor & spreadsheet for document generation or automation, plus mass email for RFI. • Use of PC packages, tablet note-taking, CASE tools, product databases and projectors (with live models) to aid team productivity and meeting effectiveness. Use of customer relationship management system for calls, email shots & project history log. • Visualisation techniques such as charts to show value for money or fit of shortlist. • Links between this evaluation/procurement method and IT service management. Ref: SysSel-How-To-Select-Your-New-Computer-System.doc 12-Feb-2007 How To Select Your New Computer System: Pitfalls & Proven Methods Page 2 The Management School - Lancaster University 4 Reference Material – Selected Example Formats 4.1 Example RDD (Table Of Contents) SysSel This illustrates one part of the Requirements Definition Document format (RDD). It also shows some examples of ‘standard’ requirements. These would usually be included in the RDD, whether or not they were explicitly requested during requirements definition interviews. Ref: SysSel-How-To-Select-Your-New-Computer-System.doc 12-Feb-2007 How To Select Your New Computer System: Pitfalls & Proven Methods Page 3 The Management School - Lancaster University 4.2 SysSel Example RDD (Prime List of Requirements) This illustrates the main Requirements Definition Document (RDD) format, and typical wording of requirements. Ref: SysSel-How-To-Select-Your-New-Computer-System.doc 12-Feb-2007 How To Select Your New Computer System: Pitfalls & Proven Methods Page 4 The Management School - Lancaster University 4.3 SysSel Example RFI Example of the sort of form emailed to system suppliers, for them to ‘turn round’ - complete and send back. Ref: SysSel-How-To-Select-Your-New-Computer-System.doc 12-Feb-2007 How To Select Your New Computer System: Pitfalls & Proven Methods Page 5 The Management School - Lancaster University 4.4 SysSel Example Definitions These record the basis for allocating points. There is one such form per scored requirement. Ref: SysSel-How-To-Select-Your-New-Computer-System.doc 12-Feb-2007 How To Select Your New Computer System: Pitfalls & Proven Methods Page 6 The Management School - Lancaster University 4.5 SysSel Example Scoring Spreadsheet – Format System + Supplier Evaluation Shortlist After Responses To Requirements Document Categ Requirement Title Customer/Supp Customer & Supplier Details Customer/Supp Grouping Contacts Customer/Supp Hold Company Registration & VAT Numbers Customer/Supp Contract Quotations Status, Version & Re-Use Customer/Supp Secure Order Form Customer/Supp Levels of Bill of Material Customer/Supp Notice Of New & Changed Tenders Customer/Supp Customer Contribution & Profitability Customer/Supp Customer Changes Own Account Information Customer/Supp Total Sales/Marketing Customer Price List Sales/Marketing Telephone Scripts Sales/Marketing Reports On Main Sales Measures Sales/Marketing Cost of Campaign Sales/Marketing Total Tech & Design Staff-To-Service Expertise Matrix, With Controls Tech & Design Drill Down & Drill Across Tech & Design Screen Prints Tech & Design Archiving & Retrieval Tech & Design Fax From Desktop Tech & Design Contribute To ISO 9002 Tech & Design Report Generator Tech & Design Total Supplier Consid Soundness Of Supplier Supplier Consid Reference Sites Supplier Consid Training Available from Author Supplier Consid Relationship With 3rd-Party Help Desk Supplier Consid Relevant Data Migration Experience Supplier Consid Formal Implementation Method Supplier Consid Total Grand Total Ref: SysSel-How-To-Select-Your-New-Computer-System.doc 12-Feb-2007 Nbr Wgt 5 0081 3 0082 2 0083 1 0084 5 0085 3 0086 4 0087 2 0088 4 0089 0090 0091 0092 0093 4 1 5 2 0094 0095 0096 0097 0098 0099 0100 5 2 5 4 3 4 2 0101 0102 0103 0104 0105 0106 4 3 4 3 4 3 IT Evaluation - A Division Of Decision Evaluation Ltd Perfect Package A Package B Max MatchA Fit Xtd Fit % MatchB Fit Xtd Fit % 15 100% 10 15 3 2 67% 6 6 9 2 67% 2 67% 0 4 6 0 0% 2 67% 0 2 3 0 0% 2 67% 10 15 100% 15 2 67% 3 0 6 9 0 0% 2 67% 8 12 100% 12 2 67% 3 2 4 6 1 33% 2 67% 4 12 100% 12 1 33% 3 45 71 87 52% 82% 8 12 12 2 67% 3 100% 0 3 100% 3 0 0% 3 10 10 15 2 67% 2 67% 4 6 100% 6 2 67% 3 22 31 36 61% 86% 15 100% 10 15 3 2 67% 6 100% 4 6 3 2 67% 5 10 15 1 33% 2 67% 8 8 12 2 67% 2 67% 6 6 9 2 67% 2 67% 8 12 100% 12 2 67% 3 2 4 6 1 33% 2 67% 50 54 75 67% 72% 12 100% 8 12 3 2 67% 9 100% 3 9 3 1 33% 12 100% 4 12 3 1 33% 9 100% 3 9 3 1 33% 0 12 100% 12 0 0% 3 9 100% 3 9 3 1 33% 51 33 52% 63 81% 261 168 64% 189 72% How To Select Your New Computer System: Pitfalls & Proven Methods Page 7 The Management School - Lancaster University 4.6 SysSel Example Scoring Spreadsheet – Notes Example of scoring mechanism. The list of requirements is extracted from the Requirements Definition Document - usually the Table Of Contents. This example shows two systems, but there would be more columns for more candidates. There would also be many more rows, with more categories and more entries per category. • Note the weight (Wgt) reflects the importance of the requirement. Recommended range for weight is 1-5. • The score (Match) reflects the degree of fit - for each candidate system. Recommended range for match is 0-3. • The multiplication of weight times score magnifies the gap between systems of different capabilities - ‘rewarding’ packages that are strong in important areas. Note the column for Perfect score (weight x 3). This is used to calculate & show maximum points. It means the spreadsheet can show fit as a ‘percentage perfection’ at Requirement, Sub-Total & Grand Total levels. These index numbers become highly significant (usually the most significant numbers) during decision-making. Ref: SysSel-How-To-Select-Your-New-Computer-System.doc 12-Feb-2007 How To Select Your New Computer System: Pitfalls & Proven Methods Page 8 The Management School - Lancaster University 4.7 SysSel Example Negotiation Agenda See actions below at General Meeting Notes System Selection Method - Example Of Negotiation Agenda Nego Priority Ref Request Calc Method A. Costs & Terms 0 Must 005 Verify/update scope of supply esp number of users Scope 0 Must 006 Attachments to contract (A) Risk CoPQ 4 Could 007 Attachments to contract (B) Risk CoPQ 0 Must 011 Price: software - discuss Supplier supply of Oracle 10G Discount RDBMS licenses, at attractive rate 0 Must 012 Confirm Microsoft Project interface in standard package Risk costing 0 Must 013 Project budget: clarify Windows CALs Avoided cost 0 Must 014 Price: software - overseas payroll Risk 0 Must 015 Price: software - 'Possible Reduction For Types Of User' - see 'CostsV2.doc' p7 Discount £10,000 0 Must 016 Price: software - user licensing type 0 Must 018 Price: pay for users in blocks as system installed Lower license count Interest earned 0 Must 019 Price: pay for modules as system installed Interest earned £500 0 Must 020 Price: software - phased *module* cost - option to buy Discount *future* modules at agreed price, if buy before Apr 2008 0 Must 021 Cost for extra users (c50-75) in two years after initial implementation Discount Affected Hrs/We Users ek/User Est Value Open N/a £2,000 N/a BATNA Worst None Rework in 24 hours Yes confirmed no Supplier changes to 'CostsV2.doc' subject to later discussion about Project Reporting Users Attachments to contract must include: (a) RDD (b) scores (c) linking Delist supplier - must definitions agree - requirement 0372 Attachments to contract *may* include: (1) this list updated with Excluded from contract agreements (2) demonstration outline Must agree Agreed in principle - normally covered in standard contract 'warranty clause' Don’t bother No need Buy separately Supplier interested in supplying? Explore, as part of this overall discussion - may be bonus business - agree version / no of processors Formality - confirm Microsoft Project interface is included in standard Pay extra system & therefore current costing List price from Oracle Confirm no changes to AM costing document Monday 17/10/05 Best 10% discount Agreed Inc Customer Resp'y Supplier prefer to supply - will be included in bundled price Heavy discount - asked - Free verbal agreement Yes confirmed - interface included in standard system (but not Microsoft Project itself) Reassurance awaited as to whether Customer need Windows CALs Massive cost to buy to run application Windows CALs Subsidised CALs CBT AM to check Clarify jurisdictions available & costs per country Confirm what is available Clearly priced with PLC discount CBT PO to check Clarify facilities available to Project Reporting & Field Service users - Not usable assess number of main users replaced Unsuitable Clearly priced with discounted user cost Not feasible - everyone needs document management so cannot use these reduced-function users £50,000 Clarify position re concurrent user licensing as option Named users Named Concurrent Not a pricing option - named users only £25,000 Year One - possibly BTL users only In full upfront In full upfront Pay just before needed Year One - no international packs - countries added as needed - see In full upfront 'CostsV2.doc' p7 In full upfront Pay just before needed CBT - Supplier UK Financial Year is December - beware constraints on revenue recognition rules - if conditions or 6 months out cannot count in figures - therefore if commitment beyond June 2006 Supplier have to book two projects (Heywood + Dorking) - AM to cost (x + y) > Extra countries already not priced on a 'buy once' basis pay when needed £10,000 Discuss future module pricing - not covered in 'CostsV2.doc' p8 assume BTL lead & Dorking gap possible Same as current deal See 018 £48,000 Discuss future pricing - see 'CostsV2.doc' p8 No agreement incremental user cost only As quoted (already discounted) Further discount of 5% Supplier agreed to extend to 'before Apr 2008' - note discount already built in to figures for blocks of users normally average £2,400 per user £37,100 N/a Undetermined - risks unexpected costs No agreement - risk of monopoly pricing - BTL need most modules No agreement calculated risk monopoly pricing No CALs needed When negotiating such an expensive & high-risk purchase, it is best to agree with the others in the negotiation team the concessions you seek (and are prepared to trade). Many items come from analysing the package scores for deficiencies. Note the small font prevents the document being read upside-down by the package supplier’s negotiator! The right-hand column records agreements during the meeting. Ref: SysSel-How-To-Select-Your-New-Computer-System.doc 12-Feb-2007 How To Select Your New Computer System: Pitfalls & Proven Methods Page 9 The Management School - Lancaster University Example Responsibility Chart rd oa (S rs lie pp Su re s wa ier pl rd up Ha S ge am ka Te ac n /P io em at st nt e am Sy Te em n pl tio Im tia s or go vis Ne Ad nt s gm or vis Mn Ad ge IT an s Ch ee iew rv te In am Te n io at er alu ag Ev an tM ec or oj ns Pr po tS ec B) oj (P Pr tB ec oj Pr ) MT Authorise project Determine scope Study feasibility inc cost Establish phasing Study best practice (desk search) Capture requirements (interviews) Document requirements (RDD/SoUR) Weight requirements Trawl marketplace Evaluate longlist (RFI) Review longlisting & select shortlist Visit shortlist (RDD/SoUR) Score for fit Analyse gaps Review eval & select demos Demonstrate preferred system(s) Check reference sites Negotiate terms Agree contract Install system am Te 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 X – Executes the work D – Takes decision solely/ultimately d – Takes decision jointly P – Manages progress T – Transfer of information/knowledge C – Must be consulted I – Must be informed eg copy documents A – Available to advise S – Provides support eg technique/documentation nt gm Mn or ni Se Proj Responsibility 4.8 SysSel D I I I C D C D I I I X X C d D X C I I d C C C d C I C C C I I C I I I C C I I C P P d P P P P P P D A P P P A C X P P C I I I I C C X X T C T S S S X X X S X X S S S T S S S S I T S S S T I I I I C A I I I X C A X A A A A I C C I C C A I X C C C C I I I S This is typical, but an example. Responsibilities will differ on different projects. In a live project, this role/responsibility matrix would be backed up by a list (or matrix) of people in each group (such as the PB). Alternatively, the columns might be named individuals. Ref: SysSel-How-To-Select-Your-New-Computer-System.doc 12-Feb-2007 How To Select Your New Computer System: Pitfalls & Proven Methods Page 10 © 12-Feb-07 Decision Evaluation Ltd +44 (0) 1772 752704 Guest Lecture at EBIN 15-Feb-07 © Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk How To Select Your New Computer System: Pitfalls & Proven Methods Martin Tate, IT Evaluation A Division Of Decision Evaluation Ltd +44 (0) 1772 752704 [email protected] “Ensuring clients buy IT that fits.” Impartiality, knowledge, method, reliability & savings on: • IT system reviews; • IT strategy; • IT supplier evaluation & system selection. Bacup Shoe | Biwater | Bombardier | Broadways Stampings | Business Link | Castrol | Connexions (Careers Service) Corporate Credit | DaimlerChrysler | Department for Work and Pensions (DWP) | Devil's Guide Galloway's Society For The Blind | Gateshead MBC | Halo Retail | Homestead CSL | Hotels & GH Association I Love My | Kelland | Lancashire Fire & Rescue Service | Lancaster University Management School Learning and Skills Council (LSC) | LEGO | M6 Papers | Nottingham City Council | Pearson | Pinacl Communication Red Box Design Group | RNIB | Royal & SunAlliance | Svenska Cellulosa Aktiebolaget | Travelodge | Turtle Wax Context Business (strategy, objectives, resources) Business/IT alignment, IT strategy, ecommerce strategy Programme & project management Risk management © Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk Scoping Project approach Project scope Current items IT procurement Requirements New system IT Service Management Quality & security management 3 Note slide numbers in lower corner, for questions and reference. © 12-Feb-07 Decision Evaluation Ltd +44 (0) 1772 752704 Long + shortlist Acquire © Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk Requiremts Startup Evaluation Method - Processes 4 Responsibility Chart (RRM) Proj Responsibility Proj Responsibility © Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk w ie l rd pp Ha a Suliers Te geupp mn a o ka e S i ac war ersTeat r /P ard pplin lu o u a ge em H agetSatiEv m na st a kn am a Te ac e M Sy e /Pm on t T i c emle at st p nt onamje e or i SIym em iatn Tero ns pl Im oitatio P ors po g s r ot S s isovi t Neeg v N c AdAd je B) nt t ros gm n Psor s (P Mngm vi or rd d ge n T A I vsis oa an M Ch e ) Awdee t B g ITrvie jec s SMT an te In ro am ee Ch P Te w m ( n e ea io i at rv r T alu te ge t Ev In na n m m a nt Mg orTea jec ns roM oPr ioon ni ctaStp Se Pvraojleu (PB) ager E ard an o tB M ) ec t T oj c SM Pr oje m ( or a Prnt Te ons p gm tS Mn or ec ni B) oj Se (P Pr rd oa ) tB ec MT oj (S Pr am Te nt gm Mn or ni Se 1X –XExecutes Authorise project the work – Executes the work D – Takes decision solely/ultimately 2d –DTakes Determine scope decision jointly – Takes decision solely/ultimately P – Manages progress – Takes decision jointly 3T –dTransfer Study feasibility inc cost of information/knowledge C – Must be consulted – beManages progress 4I – P Establish phasing Must informed eg copy documents A – Available to advise of information/knowledge – Transfer 5S –TProvides Study best practice (desk search) support eg technique/documentation C – Must be consulted 1 Authorise project D C C 6 Capture requirements (interviews) I – Must scope be informed eg copy documents 2 Determine I D C (RDD/SoUR) 37 Study feasibility inc cost I C d ADocument – Available torequirements advise 4 Establish phasing I D C – Provides support eg technique/documentation 8 SWeight requirements 5 Study best practice (desk search) I I 69 requirements (interviews) I C Trawl marketplace 1 Capture Authorise project 7 Document requirements (RDD/SoUR) I C 10 Evaluate longlist Determine scope(RFI) 82 Weight requirements X C 9 Trawl marketplace 11 Review longlisting & select shortlist I 10 Evaluate longlist (RFI) I 12 Review Visit shortlist (RDD/SoUR) 11 longlisting & select shortlist X C 12 shortlistfor (RDD/SoUR) I 13 Visit Score fit 13 Score for fit I 14 Analyse Analyse 14 gaps gaps I 15 Review eval & select demos X C 15 Review eval & select demos 16 Demonstrate preferred system(s) C C C 17 reference sites preferred system(s) I I 16 Check Demonstrate 18 Negotiate terms I I 17 Agree Check reference sites 19 contract d d C 20 system D C 18 Install Negotiate terms 19 Agree contract 20 Install system Note slide numbers in lower corner, for questions and reference. P P d P P P P P P D A P P P A C X P P C I I I I DC C I X X T C T S S S X X X S X X S S S T S S S S I T S S S T C D I C I C C A I I I I I X C A X A A A P P C C I C C A I X C C C C A I I I I S 5 © 12-Feb-07 Decision Evaluation Ltd +44 (0) 1772 752704 System Selection Process - Why & defensible decision Predictable timescale Thorough end-user involvement © Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk Rational • Helps acceptance & change management Driven by requirements, not ‘politics’ More complete facts available before buy Top down approach Understanding of impact 6 Process strengths Management of risks © Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk Avoid poor fit & ‘package’ modifications Informality often loses control Must compare systems to requirements Consultation & control throughout Rigour deters unscrupulous vendors Strong contract as free by-product 7 Note slide numbers in lower corner, for questions and reference. © 12-Feb-07 Decision Evaluation Ltd +44 (0) 1772 752704 The Principles That Underpin of change curve (=> redundancy) Management attention curve Management by exception © Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk Cost • Progressive shortlisting / police by exception Stakeholders Model-building to test requirements Rational decision-making – ‘evidence’ Project & management effectiveness 8 Effort/Money Per Feature © Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk Cost Of Change Curve Analysis Design Construction Testing --- Project Progress --- > Installation 9 Note slide numbers in lower corner, for questions and reference. © 12-Feb-07 Decision Evaluation Ltd +44 (0) 1772 752704 Management Attention Curve Poor MAC Decisions: scale & number © Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk Effective MAC 10 Levels Of Need © Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk • • • • • • Objectives of project & system Type of Users reached by ICT system Major business Functions, could be automated by system Project coverage (beyond ICT processing) Features of ICT system Supplier criteria such as support Objectives Scope (Coverage) Users Functional Req’ts System Features Project Supplier Criteria 11 Note slide numbers in lower corner, for questions and reference. © 12-Feb-07 Decision Evaluation Ltd +44 (0) 1772 752704 Scoping Process X X X © Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X Outside scope X In X X Just Out X X X X X X X X X X X X X 12 Procurement Process – Summary Project start-up • Scope, finance, phasing © Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk Interviews for requirements definition Agree RDD • Revise Requirements Definition Document Market-place trawl • Usually after requirements Shortlisting • By Request For Information (RFI) 13 Note slide numbers in lower corner, for questions and reference. © 12-Feb-07 Decision Evaluation Ltd +44 (0) 1772 752704 Process – Summary (B) Evaluation • Including visits by evaluation team © Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk Scoring of candidates • Possibly internal systems Demonstrations & reference sites Selection, negotiations & contract Installation • Post-implementation & benefits reviews 14 Specs! Cartoon from ‘The Fanatics Guide to Computers’. Copyright © Roland Fiddy, 1991, 1994. Used by permission of Exley Publications Ltd. Note slide numbers in lower corner, for questions and reference. © 12-Feb-07 Decision Evaluation Ltd +44 (0) 1772 752704 Scoring To Pick A Winner Package + Supplier Evaluation (Gna) Shortlist After Responses To Requirements Document Nbr Wgt 0081 5 0082 3 0083 2 0084 1 0085 5 0086 3 0087 4 2 0088 0089 4 Categ Requirement Title Customer/Supp Customer & Supplier Details Customer/Supp Grouping Contacts Customer/Supp Hold Company Registration & VAT Numbers Customer/Supp Contract Quotations Status, Version & Re-Use Customer/Supp Secure Order Form Customer/Supp Levels of Bill of Material Customer/Supp Notice Of New & Changed Tenders Customer/Supp Customer Contribution & Profitability Customer/Supp Customer Changes Own Account Information Customer/Supp Total Sales/Marketing Customer Price List Sales/Marketing Telephone Scripts Sales/Marketing Reports On Main Sales Measures Sales/Marketing Cost of Campaign Sales/Marketing Total Tech & Design Staff-To-Service Expertise Matrix, With Controls Tech & Design Drill Down & Drill Across Tech & Design Screen Prints Tech & Design Archiving & Retrieval Tech & Design Fax From Desktop Tech & Design Contribute To ISO 9002 Tech & Design Report Generator Tech & Design Total Supplier Consid Soundness Of Supplier Supplier Consid Reference Sites Supplier Consid Training Available from Author Supplier Consid Relationship With 3rd-Party Help Desk Supplier Consid Relevant Data Migration Experience Supplier Consid Formal Implementation Method Supplier Consid Total 0090 0091 0092 0093 4 1 5 2 0094 0095 0096 0097 0098 0099 0100 5 2 5 4 3 4 2 0101 0102 0103 0104 0105 0106 4 3 4 3 4 3 IT Evaluation Ltd Perfect Package A Package B Max MatchA Fit Xtd Fit % MatchB Fit Xtd Fit % 15 3 15 100% 2 10 67% 9 2 6 67% 2 6 67% 6 0 0 0% 2 4 67% 3 0 0 0% 2 2 67% 15 2 10 67% 3 15 100% 9 0 0 0% 2 6 67% 12 2 8 67% 3 12 100% 2 4 6 1 33% 2 67% 12 1 4 33% 3 12 100% 87 52% 82% 45 71 12 2 8 67% 3 12 100% 3 0 0 0% 3 3 100% 15 2 10 67% 2 10 67% 6 2 4 67% 3 6 100% 36 61% 86% 22 31 15 3 15 100% 2 10 67% 6 4 6 3 100% 2 67% 15 1 5 33% 2 10 67% 8 8 12 2 67% 2 67% 9 2 6 67% 2 6 67% 12 2 8 67% 3 12 100% 2 4 6 1 33% 2 67% 75 67% 72% 50 54 12 3 12 100% 2 8 67% 9 3 9 100% 1 3 33% 12 3 12 100% 1 4 33% 9 3 9 100% 1 3 33% 0 12 12 0 0% 3 100% 9 3 9 100% 1 3 33% 63 81% 52% 51 33 Grand Total 261 168 Evaluation Products 64% (E) Shortlist Shortlist After Responses To Requirements Document E-Learning Package Scoring Spreadsheet © Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk (A) Requirements/criteria (A.2) ToC for titles Categ Requirement Title Event Mgmt Manage resource inc allocation to course present'ns Event Mgmt Course venues inc external conference hotels Event Mgmt Cancel event registration inc waiting lists & billing Event Mgmt Optimise resource usage Event Mgmt Student/instructor meals/refreshments/dietary needs Event Mgmt Management reports such as division performance Event Mgmt Skills matrix - Lecturer/Presenter/Instructor Event Mgmt Track student progress inc assignments, test results Event Mgmt Pre-course learning pack Event Mgmt Total Global Multiple user time zones on 1 central system Global User interaction in their preferred language Global Customer downloads courseware in preferred format Global Digital rights management (DRM) - piracy protection Global Total Tech & Design Define user profiles with personalisation Tech & Design Comply with AICC, IEEE, IMS & ADL SCORM Tech & Design Load courseware from tools eg AuthorWare, P'Point Tech & Design Support downloadable formats inc MP3 & WAV Tech & Design Support streaming formats inc RM Tech & Design Integrate with HR systems Tech & Design Budgets (cross-charge) & revenue targets (ext sales) Tech & Design Total Supplier Consid Soundness Of Supplier Supplier Consid Reference Sites Supplier Consid Training Available from Author Supplier Consid Relationship With 3rd-Party Help Desk Supplier Consid Relevant Data Migration Experience Supplier Consid Formal Implementation Method Supplier Consid Total Grand Total Nbr Wgt 0081 5 0082 3 0083 2 0084 1 0085 5 0086 3 0087 4 0088 2 0089 4 0090 0091 0092 0093 4 1 5 2 0094 0095 0096 0097 0098 0099 0100 5 2 5 4 3 4 2 0101 0102 0103 0104 0105 0106 4 3 4 3 4 3 IT Evaluation Ltd Perfect Package A Package B Max MatchA Fit Xtd Fit % MatchB Fit Xtd Fit % 15 3 100% 2 67% 15 10 9 2 67% 2 67% 6 6 6 0 0% 2 67% 0 4 3 0 0% 2 67% 0 2 15 2 67% 3 100% 10 15 9 0 0% 2 67% 0 6 12 2 67% 3 100% 8 12 6 1 33% 2 67% 2 4 12 1 33% 3 100% 4 12 87 52% 82% 45 71 12 2 67% 3 100% 8 12 3 0 0% 3 100% 0 3 15 2 67% 2 67% 10 10 6 2 67% 3 100% 4 6 36 61% 86% 22 31 15 3 100% 2 67% 15 10 6 3 100% 2 67% 6 4 15 1 33% 2 67% 5 10 12 2 67% 2 67% 8 8 9 2 67% 2 67% 6 6 12 2 67% 3 100% 8 12 6 1 33% 2 67% 2 4 75 67% 72% 50 54 12 3 100% 2 67% 12 8 9 3 100% 1 33% 9 3 12 3 100% 1 33% 12 4 9 3 100% 1 33% 9 3 12 0 0% 3 100% 0 12 9 3 100% 1 33% 9 3 63 81% 52% 51 33 261 168 64% 72% (D) Shortlisting via RFI Reverse engineering to prompt interviewees Package + Supplier Evaluation 189 189 (C) Process for weighting [0-5] 72% (B) List – input to weighting (H) Scores & weights combined Name Appointments: Automatic Letter Confirming Appointment Issues Ease of generating letter, including name & address details Extent of support for picture data 0 1 2 3 Text & code data supported Text & code data supported Use additional software to display image such as map Use built-in facility to display image such as map (G) Definitions – performance needed for given score – one sheet per requirement – one entry for each score awarded (F) Process for scoring [0-3] Note A, G & H become attachments to contract Note slide numbers in lower corner, for questions and reference. 17 Agresso IFS Note slide numbers in lower corner, for questions and reference. 250 200 75 25 IT Supplier Considerations £1,750 IT Technical Interface £1,500 Environment Management Information £1,250 Financials – CIS Financials £1,000 International System Considerations Perfect Prj/Contract Mngmt & Acctng PCMA £750 Document Management Time Recording £500 Procurement £250 Resource Management Human Resources Capability Points (Fit) © Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk £- Sales & Marketing Information © Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk © 12-Feb-07 Decision Evaluation Ltd +44 (0) 1772 752704 Shortlisting With Capability/Value 275 Agresso 225 COINS 175 150 CSI SAP 125 100 Diagonal SAP 50 IFS Ramesys 0 Mid-Point Cost (Software Only, £K) £2,000 18 After Detailed Evaluation 400 350 300 250 200 150 100 50 0 19 © 12-Feb-07 Decision Evaluation Ltd +44 (0) 1772 752704 The Human/Customer Dimension Not just a ‘buying experience’ © Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk Supports organisational & cultural change • • • • • • Empowering – recognises operational requirements Structured approach collects ‘invisible’ knowledge Active listening – captures aspirations at all levels Intolerant of mis-matched systems – reduces stress Liberates & motivates staff Holistic solution creates optimum working environment Selection not distorted by dominant personalities • Decision makers get peace-of-mind • IT gets buy-in Organisation can suceed where others fail 20 References © Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk See Handouts • GDPM • NRM • KT • CIPS • OGC (CCTA) • RISC 23 Note slide numbers in lower corner, for questions and reference.