After - RCOST
Transcription
After - RCOST
ESE @ Uniroma2.DISP and relationships with UMDCS and other ESE Groups UoSannio.LHC.Vic – Symposium - 5 April 2004 Outline Overview ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Reading ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾ Going back to my involvement with Vic: My basic views of research before and after. ¾ ESE research since ¾Academic relationships ¾Industry relationships, and ESE Research for the Future ¾ Conclusions ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 2 Going back in time Overview ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia I had the opportunity to introduce myself to Vic in the year 1986. It was the very beginning of October, Monday the 6th or Tuesday the 7th, 3:30 P.M. at UMDCS College Park, while on my return trip from the UoUrbana “Allerton Annual Conference”. I was 1 month less than 39 Y.O. My main concerns, in that age, were: (i) Structural analysis for restructuring software programs, and, from one year, (ii) Distributed Software Fault-tolerance. ¾Reading ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Reading T. Starting from October 1987, hosted by CRIAI (Langella, Fadini, and Imperia), Vic gave talks that constituted an opportunity to learn, to have research opinions and inputs from, and meet Vic one or more times per year per several days in Italy. ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 3 1986 @ UMDCS (1d) Overview Vic’s People: {Dieter Rombach} ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 My 1st stage in Maryland begun on October 1989 and lasted 4 months. I was again at UMDCS on 1991-92, and hence on 1995-96. In total 18 months, more or less. ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Reading ¾Companies ¾Further research details ¾SMMLC 1989-90 @ UMDCS (4m) ++ Vic’s People: {Lionel Briand, Gianluigi Caldiera, Marku Oivo, Carolyn Seaman et al.} 1991-92 @ UMDCS (1-2m) ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions ++ Vic’s People: {++ Finsiel people, Scandinavians, Forrest Shull et al.} ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 4 1989-92 @ UMDCS (6m) RESULTS ACM ToSEM, 1992 A Reference Architecture for the Component Factory VICTOR R. BASILI GIANLUIGI CALDIERA University of Maryland and GIOVANNI CANTONE Università di Napoli UoSannio.LHC.Vic – Symposium - 5 April 2004 Overview 1992 @ UMDCS (Continued) ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 Many people passing through or moving ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Reading ¾Companies ¾Further research details Network ¾SMMLC ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 6 1993 Overview Rombach moved from College Park to Kaiserslautern ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After International Workshop on The Experimental Paradigm in Software Engineering Dagstuhl, Germany, 1992 ¾Academia ¾Reading ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ISERN ¾Reading T. ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 7 1992-94 @URMTV Overview Back to previous topics ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Reading ¾Companies ¾Further research details ¾SMMLC - RT software - Structural analysis of distributed messagingonly software. NATO ASI School on Real Time Computing, 1992 Book: Real Time Computing , NATO ASI, Series on Computer and Systems Science,1994 ¾WATMM ¾UML FP ¾Reading T. - Process vs. product in Sw. industry ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 8 1995-96@UMDCS Overview ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Reading ¾Companies ¾Further research details ¾SMMLC ¾WATMM (Continued) UMDCS ‘95: An Intercontinental Port for SE Researchers People from almost all Countries present as students or professors, or coming as frequent visitors, short term visitors, talk givers, etc.: Markku Oivo, Jeffery Ross, Dieter Romback, Sandro Morasca, Mehdi Jazayeri, Yong-Me Kim, Walcelio Melo, Zhijun Zhang, Giuseppe F. Calavaro, Jyrki Kontio, Forrest Shull, Filippo Lanubile, Khaled El Emam, Robert B. Hendrick, Manuel Mendosa, Gianluigi Caldiera, Lionel Briand, Carolyn Seaman, Marvin Zelkowitz et al. ¾UML FP ¾Reading T. ¾Conclusions Major companies: Motorola, Hughes, … ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 9 1995-96@UMDCS Overview ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 Research at UMDCS concerned many topics, including: Organizational and Process Improvement ¾After ¾Academia ¾Reading ¾Companies ¾Further research details ¾SMMLC ¾WATMM Carolyn B. Seaman and Victor R. Basili, OPT: An Approach to Organizational and Process Improvement, position paper presented at the AAAI Symposium on Computational Organizational Design, March 1994. ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 10 1995-96@UMDCS (My work) Sw. Process vs. Sw. Product B LC (INVESTMENTS' RETURN RATE) DIRECT CO STS Pay -back point De cline Mat urit y Early-Maturity Ex pansion Introduction PRO FITS Embryonic - De Marco - SEI IDEAL - SEL QIP Time INVESTMENTS' RECO VERY UoSannio.LHC.Vic – Symposium - 5 April 2004 11 1995-96@UMDCS Overview ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 (Continued) One of work whose development I had the opportunity to observe ♣? ♣ Frameworks Experiment Where they observing for viewing some pre-existent & general logical truth? NO! Where they looking for some partial truth, a local truth, the one that was right there, in those frameworks, from the point of view of the researcher (yes,but) on behalf of software constructors? YES Where they affected by the Galilean frustration for not viewing the universal truth in their observations? NO! ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Reading ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks That type of work apparently excited rather frustrated them! UoSannio.LHC.Vic – Symposium - 5 April 2004 12 1995-96@UMDCS (Continued) Overview One paper whose development I had the opportunity to observe ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Reading Victor R. Basili The Role of Experimentation in Software Engineering: Past, Current, and Future Keynote Address ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP 18th International Conference on Software Engineering (ICSE 18), Berlin, Germany, March 25-29, 1996. ¾Reading T. ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 13 1995-96@UMDCS (Continued) Based on those observations: Overview ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 Question Are those works following the classic scientific experimental path? ¾1992..1994 ¾1995..1996 ¾After ¾Academia Chritopher Clausius ¾Reading ¾Companies ? ¾Further research details ¾SMMLC ¾WATMM ¾UML FP Tycho Brahe Galileo Galilei Isaac Newton ¾Reading T. ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 14 1995-96@UMDCS (Continued) Overview ¾Outline Empiricism?! (?! Whoa !?) ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Reading Who will perform in the role of Orazio Grassi? ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 15 After (Rome) Let me see what they have been doing Overview ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Reading ¾Companies ¾Further research details ¾SMMLC Relationships ¾Outline Companies Rome TV Academia ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 16 After (Topics, Experiments, Papers) Overview ¾Outline Rome TV ¾Going Back Sw. Tech. Eval. ¾1986 JSM WA Tech. Evaluation ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 Sw. Measurement LC ¾After ¾Academia Academia ¾Reading ¾Further research details ¾WATMM Paolo Donzelli JSEKE FP x UML Sw 2004 ¾Companies ¾SMMLC WMRC Book Ch. Empirical CR work with students ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 17 Journal of Software Maintenance: Research and Practice Volume 12, Issue 1 , Pages 47 - 78 Research Paper Measure-driven processes and architecture for the empirical evaluation of software technology Giovanni Cantone * email: Giovanni Cantone ([email protected]) Abstract This paper reports on an on-going project undertaken within the University of Rome at Tor Vergata to automate the business processes of a class of administrative organizations. The experience gained and the lessons learned, while performing in the role of Innovation-driver, are abstracted and presented. In the context of this experience with process re-engineering, the paper compares the utility of empirically investigating software technology transfer with the reuse of technology measurement models possibly available. The paper also discusses the roles played by various environmental factors - technology, experimentation and measurements, an organization's business objectives, and other organizational issues, including the expected benefits and costs - in the empirical investigation of software technology transfer. The paper concludes by presenting a short case study and three lessons learned. Copyright © 2000 John Wiley & Sons, Ltd. UoSannio.LHC.Vic – Symposium - 5 April 2004 JSEKE 10 (5) 2000 Production and Maintenance of GoalOriented Software Measurement Models GIOVANNI CANTONE and PAOLO DONZELLI Università di Roma Tor Vergata UoSannio.LHC.Vic – Symposium - 5 April 2004 After (Relationships, Papers) Companies Overview Results ¾Outline ¾Going Back ¾1986 Rome TV ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Reading OUN E. Sw. Mgt. White Book ISERN ¾Companies ¾Further research details ¾SMMLC Academia UCLM UMDCS WWR LSO UKl ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 20 After (Relationships, Papers) Companies Overview ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 Rome TV ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Reading ¾Companies ¾Further research details Bari ESERNET ¾SMMLC ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks EC ESE UoSannio.LHC.Vic – Symposium - 5 April 2004 21 After (Topics, Relationships, Experiments, Papers) Overview ¾Outline FP Analysis for UML Sw ¾Going Back Companies Maintainability M??x04 ¾1986 ¾1989 .. 1990 Rome TV ¾1992..1994 ¾1995..1996 EvDrSwEval ¾After USannio ¾Academia ¾Reading ISERN ESERNET ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP UCLM ¾Reading T. ¾Conclusions Maintainability Metrics03 UMDCS ESEIW03 Rd.Rd. Reading ESE Book UML ISESE02 PDS Rd. Fmk. ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 ESE Book CRvsFT UKl ISESE04 22 After (Code Reading Experiments) Overview Rd. Rd. Code Reading for Error Detection ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Reading ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 After (Code Reading Experiments) Overview Rd. Rd. Code Reading for Error Detection ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Reading ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 Sannio Overview After (Experiments, Relationships) Rd. Rd. Code Reading for Error Detection ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Reading ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 After (Code Reading Paper) Overview ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 Rd. Rd. Code Reading for E.D. Empirical Methods and Studies in Software Engineering Experiences from ESERNET ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Reading ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP Series: Lecture Notes in Computer Science, Vol. 2765 Conradi, Reidar; Wang, Alf Inge (Eds.) 2003, VIII, 279 p. Also available online., Softcover ISBN: 3-540-40672-7 ¾Reading T. ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 After ( Code Reading: Paper) Overview Rd. Rd. Code Reading for Error Detection ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After Draft Effectiveness and Detection Rate of Code Reading and Functional Testing with Event-Driven Object-Oriented Software ¾Academia ¾Reading ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks Giovanni Cantone, and Ziad A. Abdulnabi After (Experiments, Relationships) BN Overview ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Reading ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks Rd. Rd. UML Reading for Defect Detection After (Experiments, Paper) Overview ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 Rd. Rd. UML Reading for Defect Detection Empirical Methods and Studies in Software Engineering Experiences from ESERNET ¾After ¾Academia ¾Reading ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks Series: Lecture Notes in Computer Science, Vol. 2765 Conradi, Reidar; Wang, Alf Inge (Eds.) 2003, VIII, 279 p. Also available online., Softcover ISBN: 3-540-40672-7 UCLM, Spain @ URM2After Overview ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Reading ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks Rd. Rd. Maintainability of UML Sw. ( Experiments, Relationships) After ( Maintainability: Paper) Overview Rd. Rd. Maintainability of UML Sw. ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Reading ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks METRICS03 Building UML Class Diagram Maintainability Prediction Models Based on Early Metrics M. Genero, M. Piattini, A. Manso, and G. Cantone UKl, Germany Overview Rd. After ( Experiments, Relationships, Paper) Rd. Framework Reading for Defect Detection ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ISESE04 Comparing Code Reading Techniques applied to Object-oriented Software Frameworks with regard to Effectiveness and Defect Detection Rate ¾Reading ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks Zeiad Abdelnabi, Giovanni Cantone, Marcus Ciolkowski, and Dieter Rombach After (Industrial relationships, Experiments, Papers) Overview Finsiel Companies ¾Outline ¾Going Back ¾1986 Datamat Rational ¾1989 .. 1990 Alenia Spazio MBDA Rome TV ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Reading ¾Companies ¾Further research details ISESE03 PDS Maintainability ESERNET Book M??x04 ISESE04 ¾SMMLC ¾WATMM ¾UML FP ¾Reading T. ESEIW04 D FT S ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 33 After Overview ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After Further Research Details ¾Academia ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Future ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 34 After (Topic & Paper: Software Measurement Model Life Cycle) Overview ¾Outline JSEKE 10 (5) 2000 ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia Production and Maintenance of Goal-Oriented Software Measurement Models ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP GIOVANNI CANTONE and PAOLO DONZELLI Università di Roma Tor Vergata ¾Future ¾Conclusions ¾Thanks • Paolo Donzelli is now with UMDCS as a Research Associate UoSannio.LHC.Vic – Symposium - 5 April 2004 35 After (Topic: Software Measurement Model Life Cycle) Overview ¾Outline ¾Going Back ¾1986 M M d is p o s a l / r e t ir e m e n t h ig h e r le v e l g o a ls M M to b e re wo rk e d c o n t e x t c h a r a c t e r is t ic s c o m p e t it o r s ' b e h a v io u r e x t e r n a l e n v ir o n m e n t Set G o a ls M M I d e n ti fi c a ti o n M M A c c r e d i ta ti o n g o a ls fe e d b a c k o n M M U t ilit y c o n t e x t c h a r a c t e r is t ic s e x p e r t s ' o p in io n s Set G o a l -o r i e n te d S o l u ti o n -H y p o th e se s ¾1989 .. 1990 M M A p p l i c a ti o n ¾1992..1994 G -S H s ¾1995..1996 ¾After ¾Academia M M u s e r g u id e D a t a u s a g e / in t e r p r e t a t io n g u id e c o n t e x t c h a r a c t e r is t ic s e x p e r t s 'o p in io n s e n t it ie s ' c h a r a c t e r is t ic s M M r e q u ir e m e n t s ¾Companies ¾Further research details M M C r e a t io n M M A c c e p ta n c e g o a ls s u b -M M s re q u ire m e n t s M M -S H s su b -M M C r e a ti o n u n v a lid MM sub MMs M M D e fi n i ti o n ¾UML FP ¾Future N o n - a c c e p te d M M Set M M -o r i e n te d S o l u ti o n H y p o th e se s ¾SMMLC ¾WATMM A c c e p te d M M V a lid M M MM M M V a l i d a ti o n ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 36 After (UMDCS-based References: Software Measurement Model Overview ¾Outline Life Cycle) SMMLC: JSEKE Vol. 10 N0. 5 (2000), ©WSPC •with Paolo Donzelli (now with UMDCS) ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Future ¾Conclusions Briand, L. C., Morasca, S., Basili, V. R., “Goal-Driven Definition of Product Metrics Based on Properties”, University of Maryland - Technical Report CS-TR-3346, 1994 Briand, L. C., Differding C. M., and Rombach, H. D., “Practical Guidelines for Measurement-Based Process Improvement”, Software Process Improvement and Practice Journal, Vol. 2, 1997. Basili V. R.: “The Experience Factory: packaging Software Experiences”, In Proceedings of the NASA Goddard Space Flight Center’s 14th Annual Software Engineering Workshop, Greenbelt, MD, 1989. Basili, V. R., Caldiera, G., and Rombach, H. D., “The Experience Factory”, Encyclopedia of Software Engineering, Wiley&Sons Inc., 1994 Basili V. R., Selby R. W., and Hutchens D. H.: “Experimentation in Software Engineering”, IEEE TSE, July 1986 Basili V. R.: “The Role of Experimentation in Software Engineering: Past, Current and Future”, in Proceedings of the 18th ICSE. IEEE Computer Society Press, 1996 ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 37 After (Topic: Software Measurement Model Life Cycle) M higher level goals Overview ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 context characteristics competitors' behavior external environment Set Goals MM Identification ¾1995..1996 ¾After ¾Academia ¾Companies ¾Further research details context characteristics experts' opinions Set Goal-oriented Solution-Hypotheses ¾SMMLC ¾WATMM ¾UML FP ¾Future ¾Conclusions G-SHs MM Requirements ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 38 After (Topic: Software Measurement Model Life Cycle) Overview ¾Outline ¾Going Back context characteristics MM requirements experts 'opinions entities' characteristics ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After MM-oriented Solution Hypotheses Setting ¾WATMM sub-MMs requirements sub-MM Creation ¾Companies ¾SMMLC Non - accepted MM MM-SHs ¾Academia ¾Further research details MM Creation MM Definition sub MMs invalid MM MM MM Validation ¾UML FP ¾Future ¾Conclusions Valid MM ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 39 After (Topic: Software Measurement Model Life Cycle) Overview MM disposal / retirement ¾Outline ¾Going Back MM to rework ¾1986 ¾1989 .. 1990 ¾1992..1994 goals ¾1995..1996 ¾After ¾Academia ¾Companies ¾Further research details MM Accreditation MM user guide feedback on MM Utility MM Application Data usage / interpretation guide Non - accepted MM Accepted MM MM Acceptance Experiments ¾SMMLC ¾WATMM Valid MM ¾UML FP ¾Future ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 40 After (Topic: Software Measurement Model Life Cycle) Overview ¾Outline ¾Going Back Table 6 – EXAMPLE: Goal-oriented Solution Hypotheses (Measurement Plan) for Project Sub Goal2 MM Item Description Set of MMs MM1 estimates the delivery time since the beginning of the project (management tool) ¾1986 ¾1989 .. 1990 MM1 ¾1992..1994 ¾1995..1996 ¾After ¾Academia MM2 characterizes at which extend software reuse is applied (long-term learning tool) MM2 MM3 MM3 monitors project delay during development (realtime data-sensing tool) ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Future Details for MM1 MM1 requirements Nature: predictive Scale type and unit: Ratio, month User oriented MM aspects: MM tolerance +/- 10%; MM input represented by object-oriented Requirements; MM takes into consideration aspects such as the product type (e.g. real-time, legacy, etc.) and the expected requirements instability; MM has to be computer supported ………………… ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 41 After (Topic: Software Measurement Model Life Cycle) Overview Table 7 - Goal-based templates for MM-oriented SHs Aspect Guidelines Attribute Properties Mathematical properties that characterize the attribute. They represent an intuitive understanding of the attribute and are therefore independent from any specific product and goal. ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 They should not be contradictory and should hold for the desired measure scale (specified by the MM requirements) ¾1995..1996 ¾After ¾Academia Characters of the entity that are relevant for the attribute and that the model has to capture should be chosen by considering the MM nature (Goal Facet: Purpose), the available knowledge about the entity (Goal Facets: Context and Object), and the MM user-oriented aspects (Goal Facets: Viewpoint). Entity Model ¾Companies ¾Further research details … ¾SMMLC ¾WATMM ¾UML FP ¾Future ¾Conclusions ¾Thanks Mapping Function (Scale and Unit) The link between the empirical and the formal world has to reflect the MM potential user (Goal Facet: Point of View), previous experience, adopted formalisms for the entity (Goal Facet: Context and Object). ………………… UoSannio.LHC.Vic – Symposium - 5 April 2004 42 After (Topic: Software Measurement Model Life Cycle) Higher Level Goals PROJECT ORGANIZATION Overview Set Goals ¾Outline Technical Management ¾Going Back Execution plans Projects feedback Goals ¾1986 ¾1989 .. 1990 Goal-related SHs EXPERIENCE FACTORY Development ¾1992..1994 Synthesis & Package ¾WATMM Accredited MMs, MMs to be disposed, MMs to be rew orked Analyze MMs to rew ork Acceptance Support Accreditation ¾UML FP Feedback on MMs performance ¾Future Products to release, Intermediate artifacts ¾Conclusions ¾Thanks Projects user guides Data usage guides Empirical Relational Systems, MMs to rew ork Experience Base MMs MM ¾SMMLC Set Goal-related SHs Application ¾Further research details Valid MMs, Attributes experts' & ¾Companies context's data ¾Academia MMs reqs MM Creation Goals ¾After External Environment ¾1995..1996 Software Products UoSannio.LHC.Vic – Symposium - 5 April 2004 43 After (Topic: Technology Evaluation) Further Research Details (Continued) Overview ¾Outline ¾Going Back ¾1986 Technology Evaluation ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Companies ¾Further research details W Workflow Automation Technology Experiments for Evaluating Workflow Automation Technology with Fabrizio Fusco, Italy Administration ¾SMMLC ¾WATMM ¾UML FP ¾Future ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 44 After (Technology Evaluation) Further Research Details (Continued) Overview ¾Outline ¾Going Back Paper ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP Inspection, Measurement & Testing Models, Measures and Learning Organizations for Software Technologies ¾Future Giovanni Cantone, Luigi Cantone and Paolo Donzelli ¾Conclusions WMRC © 2000, pp. 136-148 ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 After (Topic & Paper: Function Point Count of UML Sw.) Overview Further Research Details (Continued) ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 Conversion Model and Pilot Study ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Companies M??X04 SMEF04 In collaboration with Giuseppe Calavaro, and Davide Pace ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Future An UMDCS related reference Caldiera, G., Antoniol, G., Fiutem, R., and Lokan, C., “Definition and Experimental Evaluation of Function Points for Object Oriented Systems”, Proceedings IEEE METRICS-98, 1998 ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 46 After Overview Further Research Details (Continued) ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia Function Points and UML: State of the Art and Evaluation Model ¾Companies ¾Further research details A collaboration between people from: ¾SMMLC ¾WATMM ¾UML FP ¾Future ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 After Further Research Details (Continued) Overview FP Counting vs. UML Diagrams ¾Outline Class Diagram ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 Use cases Diagram ¾1995..1996 ¾After Data Functions count ¾Academia ¾Companies Unadjusted Function Point ¾Further research details ¾SMMLC ¾WATMM Transactional Functions count Identifying Identifying the count type Evaluating Value of Adjustment Factor Application system bound ¾UML FP ¾Future ¾Conclusions Function Point count Sequence Diagram ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 After Overview Further Research Details (Continued) ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 Use Case Diagram : Generalisation of Actors ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP Us er S y s tem A dm inis trator ¾Future ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 After Overview Further Research Details (Continued) Impact of Use Case Diagram: ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ρ3: Generalisations of Use cases Detecting Transactional Functions (TF) Candidate Use cases, which inherit relations with Actors (through other Use cases), for some Transactional Functions. ¾After ¾Academia ¾Companies User Validate User ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Future ¾Conclusions Check Password Retinal Scan Warning: In derived Use cases, Transactional Functions should not be counted if already counted in the ascendant Use case. ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 After Overview Further Research Details (Continued) Impact of Use Case Diagram: Dependencies ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 <<include>> ¾1992..1994 Validate User ¾1995..1996 ¾After ¾Academia User Place Order ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Future ¾Conclusions <<extend>> ρ5: Place Rush Order Candidate Extension and Inclusion Use cases for Transactional Functions. In fact, they could depend, directly or indirectly, on a Use case interacting with an Actor, and hence interact with the application’s external world through such a Use case. ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 After Overview ¾Outline ¾Going Back Further Research Details (Continued) Impact of Class Diagram. Detecting Data Functions: Aggregations ¾1986 Solution I of IV An Aggregation is an Association ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Companies ¾Further research details < < entity>> A << entity> > B ¾SMMLC ¾WATMM ¾UML FP Logi cal Fi le Logical File ¾Future ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 After Overview ¾Outline ¾Going Back Further Research Details (Continued) Impact of Class Diagram. Detecting Data Functions: Aggregations Solution II of IV ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Companies ¾Further research details ¾SMMLC ρ11.II: Evaluate each class in the relationship as a separate Logical File (see ρ10) < < entity > > A < < entity > > B ¾WATMM ¾UML FP ¾Future Logi c al Fi le Logic al File ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 After Overview ¾Outline ¾Going Back Further Research Details (Continued) Impact of Class Diagram. Detecting Data Functions: Generalisations ¾1986 Solution III of III ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ρ13.III: Count each class-path from the root super-class to leaf subclasses as 1 Logical File. ¾Academia ¾Companies ¾Further research details < < entity > > A Logical File Logic al File ¾SMMLC ¾WATMM ¾UML FP ¾Future < < entity > > B < < enti ty > > C ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 After Overview Further Research Details (Continued) Impact of Sequence Diagram: ¾Outline Input Pattern (EIP) ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 : BeginningActor : Control : Boundary Message1(ArgumentList1) : Entity Message2( ArgumentList2) Message3( ArgumentList3) ¾After ¾Academia ¾Companies ... ... ... ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Future ¾Conclusions EIP might include: • One or more <<Entity>> objects, each receiving messages from the Control object; • One or more <<Boundary> objects, each receiving messages from actors and sending messages to <<Control>> objects; • One or more actors, each sending messages to <<Boundary> objects. ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 After Overview ¾Outline ¾Going Back Further Research Details (Continued) The “URMTV-FPA” tool ¾1986 ¾1989 .. 1990 ¾1992..1994 • ¾1995..1996 ¾After ¾Academia ¾Companies ¾Further research details ¾SMMLC ¾WATMM • • • A wizard inside Rational Rose™ Heuristic algorithm Flexible and parametric Customisable – Documentation – Reporting ¾UML FP ¾Future ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 After Overview Further Research Details (Continued) ¾Outline Class Analysis ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After • • ¾Academia ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Future ¾Conclusions • • • Class Information Analysis for: – Attributes – Generalisations – Associations – Aggregations Heuristic Algorithm Documentation Browse ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 After Overview ¾Outline Further Research Details (Continued) Sequence Analysis ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After • ¾Academia ¾Companies • ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Future ¾Conclusions • • • Sequence Diagram information Transactional Functions as sequence of messages Heuristic Algorithm Documentation Browse ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 After (Function Point Count of UML Sw.) Further Research Details (Continued) Overview ¾Outline ¾Going Back ¾1986 Function Point Count of UML Software ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Future ¾Conclusions W Function Point Count Automation Experiments for Comparing Expert-Counted and Model-Counted Function Points for UML Documented Analysis and Design Software with Giuseppe Calavaro (IBM-Rational), Davide Pace (URM2) And Italsiel people. ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 59 After: Organization Overview Empirical Software Engineering International Week, 2003 5 International ESE events in the Roman Castles. ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Future ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 60 After: Organization Overview Empirical Software Engineering International Week, 2003 5 International ESE events in the Roman Castles. ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Future ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 61 After: Organization Overview Empirical Software Engineering International Week, 2003 5 International ESE events in the Roman Castles. ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Future ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 62 What about future? Overview ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 Software construction is changing, because of COTS and frameworks. This also has an impact on software architecture. The computation model is changing too, because of network computing. The need for open software is also growing. ¾1995..1996 ¾After ¾Academia ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Future Our future ESE work should face those concepts: software architecture, network computing, security, dependability, components, frameworks. Not all software companies and practitioners are ready for such a change or nor understand how much great is the help that empiricism can give them. ¾Conclusions ¾Thanks Are we ready for? UoSannio.LHC.Vic – Symposium - 5 April 2004 63 What about future? (Continued) Overview ¾Outline ¾Going Back ¾1986 Basili V. R., and R. Selby, Comparing the effectiveness of software testing strategies, IEEE TSE, December 1987 In two years it will be the 20th anniversary of such a fundamental paper. ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Companies ¾Further research details ¾SMMLC ¾WATMM It is my opinion that we should organize a specific meeting aimed to raison about results concerning the application of different testing techniques to different products, processes, programming paradigms, and software architectures from the points of view of scientists and practitioners. Is there any candidate for hosting such a very focused meeting? ¾UML FP ¾Future ¾Conclusions Of course, I am ready to host that meeting in Rome in 2006! The very end of December included! ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 64 Conclusions Overview ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After The opportunity of meeting Vic eventually changed the vision that I had about research. ¾Academia ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP My work with him changed my whole mode of operation as a researcher. ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 65 Thanks Overview ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions Thanks Vic for coaching, tutoring, mentoring, and eventually giving us the opportunity of “discovering” empiricism ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 66 Thanks for putting all of us together Overview ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks ISERN Annual Meeting Roman Castles, 4 October 2003 UoSannio.LHC.Vic – Symposium - 5 April 2004 67 … for joining Overview ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 68 … for sharing Overview ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 69 … for being as you are Overview ¾Outline ¾Going Back ¾1986 ¾1989 .. 1990 ¾1992..1994 ¾1995..1996 ¾After ¾Academia ¾Companies ¾Further research details ¾SMMLC ¾WATMM ¾UML FP ¾Reading T. ¾Conclusions ¾Thanks UoSannio.LHC.Vic – Symposium - 5 April 2004 70