annual report - Fraunhofer IOSB - Fraunhofer
Transcription
annual report - Fraunhofer IOSB - Fraunhofer
Fraunhofer IOSB Annual Report 2013 / 2014 F r a u n h o f e r I n s t i t u t e o f O p t r o n i c s , S y s t e m T e c h n o l o g i e s a n d I m a g e E x p l o i tat i o n Tablesort S y s t e m t e c h n i k u n d B i l d a u s w e r t u n g I OS B F r a u n h o f e r s t r a SS e 1 76131 Karlsruhe w w w. i o s b . f r a u n h o f e r . d e indigo - Studio für Werbefotografie Fraunhofer-Institut für Optronik, ANNUAL REPORT 2013 / 2014 ANNUAL REPORT 2013/2014 Preface Prof. Dr.-Ing. habil. Jürgen Beyerer Dear Sir or Madam, When faced with a technical problem for which there are established solutions, technologies or sophisticated products, one only has to find the right supplier and a competent integrator capable of solving the task cost-effectively and reliably. If, however, a technical problem arises, for which a standard solution – let alone a suitable approach – has not yet been identified, and for the solution of which the latest research results or even new research activities are required, then, Fraunhofer with its many specialized institutes, is the right address. Fraunhofer IOSB is the first port of call for the fields of • optronics, • systems engineering, and • image analysis. With its extensive portfolio of competencies, IOSB is Europe’s leading center of excellence in these areas. But scientific and technical skills alone are not sufficient to guarantee the success of an application-oriented research institute. To be a successful innovator also takes an intimate knowledge of the industries and markets for which innovations with commercial value are to be created. Our scientific and technical competencies in the sectors and markets we serve cover the following five business segments: • Automation • Energy, water and environment • Automated visual inspection • Security, and • Defense With the numerous positive results in 2013 we again demonstrated our ability to meet the challenges presented by these fields of activity. All of IOSB’s sites have undergone an outstanding commercial and scientific evolution, both in terms of quality and quantity. Personnel levels, budget, and business project volume, as well as economic results have reached record levels. The prospects for 2014 are also highly promising. An important challenge for 2014 is to establish a professorship for Optronics at the Faculty of Electrical Engineering and Information Technology of KIT. Prof. Dr. Maurus Tacke, who represented this field at IOSB, commenced his well-deserved retirement on May 1, 2013. He has been succeeded in the management of the field of Photonics and Optoelectronic Systems, comprising the departments of Signatorics, Optronics, Scene Analysis, and Object Recognition by Dr. Reinhard Ebert. With the Chair of Optronics, the cooperation with KIT will be institutionalized with another faculty important for IOSB in addition to our existing collaboration with Informatics. Although this new professorship has already been under discussion and in preparation for some time, the motto “good things come to those who wait“ applies here: As all parties are working towards a common goal, we are hoping to be able to achieve this aim, which is of great significance to IOSB, before the end of this year. As every year, we want to provide our readers with as comprehensive an insight into the work of our research departments as possible with this annual report. Because of the numerous exciting topics covered by the research and development work carried out by our capable staff, we cannot do more here than offer a brief glimpse into our activities. Our special thanks goes to our partners and clients in business, in government and in the ministries, and to all the sponsors and advisors of IOSB. The support and cooperation of the federal ministries of Education and Research (BMBF) and of Defense (BMVg) are vital in enabling us to carry out our activities. Our gratitude also extends to the employees of IOSB and their excellent work. Their expertise, skills, diligence and academic motivation is the cornerstone of our institute’s success. Dear readers, this report aims to provide you with an overview of IOSB, with a few deeper insights into typical projects and examples of our research work. We hope that we have succeeded in striking a good balance that makes for interesting reading and we would welcome your comments. Karlsruhe, Ettlingen, Illmenau and Lemgo, May 2014 Prof. Dr.-Ing. habil. Jürgen Beyerer Contents P reface 2 B u si n ess U n its C o n te n ts 4 A u tomatio n Bernard, T.: the i n stit u te i n profile The Institute in Profile Organization Chart 26 6 10 Model-based optimization of a complex biological production process28 Schick, A.: A research factory for industrial automation 1 2 Gesture-based Quality Assurance 30 Usländer, T.: CIIT new construction 14 Towards ProVis 4.0: Production monitoring and control in light of Industrie 4.0 IT security lab for industrial control systems 16 32 Flatt, H.: Highly available communication34 C o n tact O ffice C hi n a 18 E n er g y, Water a n d E n viro n me n t T he I n stit u t E i n F ig u res 19 36 Nicolai, S.: Intelligent Distribution Grid & Energy Storage: iosb i n F ra u n hofer a l l ia n ces 20 SmartRegion Pellworm 38 Rauschenbach, T.: iosb i n F ra u n hofer Gro u ps 23 Small Hydropower Plants: Assessment of Climate Protection Potential and Improvement through F ra u n hofer - G ese l l schaft 2 4 Locations25 Smart Technologies TRIDEC – Early Warning Systems Architecture Names , dates , eve n ts 116 40 Chaves, F.: A dvisor y B oard 117 S cie n tific P u blicatio n s 142 Frühberger, P.: V er n issa g e n 2 0 1 3 158 MicroLab E ditoria l Notes 159 Vieth, K.-U.: A ddresses 160 GrapeSort – Optical sorting of grapes to improve A u tomated V is u al I n spectio n 42 44 46 quality and the removal of foreign objects48 Taphanel, M.: CCT Sensor – Towards high-speed 3D sensing50 Schwarz, A.: Directional reflectance measurements with a robot-based goniometer52 Höfer, S.: Thermal Infrared Deflectometry 54 D epartme n ts P ortfolios D efe n se 56 C ore C ompete n ce O ptro n ics 80 Sprung, D.: Optical Turbulence – Atmospheric impact on Optronics (OPT) 82 imaging and wave propagation: Basic research Signatorics (SIG) 84 and applications58 Visual Inspection Systems (SPR) 86 Eberle, B.: C ore C ompete n ce S y stem tech n olo g ies First Results of a New Eye-Safe 3D-Laser-Radar APD Line Scanner 88 60 Tchouchenkov, I.: Energy (NRG) 90 Heterogeneous reconnaissance data: task-oriented Water and Mobile Systems (WMS) 92 acquisition, distributed exploitation and interactive Information Management and Production Control (ILT) 94 utilization 62 96 Systems for Measurement, Control and Diagnosis MODISSA – a test bed for “Mobile Distributed Situation Awareness” Fraunhofer Application Center Industrial Automation INA Hebel, M.: 64 (MRD)98 Secure Communication Architectures (SKA) Middelmann, W.: 100 Approval of trial capabilities: A real-time airborne C ore C ompete n ce I ma g e e x ploitatio n multi- and hyperspectral sensor system in an interoperable environment 102 66 Interactive Analysis and Diagnosis (IAD) 104 Interoperability and Assistance Systems (IAS) 106 Object Recognition (OBJ) 108 Scene Analysis (SZA) 110 Grasemann, G.: Video Exploitation Systems (VID) 112 MobSC – Mobile Situation Center for the Variable Image Acquisition and Processing (VBV) S ec u rit y 68 Eisele, Ch.: AlGaN detectors for observation of UV emitters Management of Complex Crisis Situations 70 72 Research Group Streicher, A.: INTUITEL Intelligent Tutoring Interface for Technology Enhanced Learning 74 Monari, E.: Patient-tracking for epilepsy monitoring 76 Jakoby, A.: CyphWay – The one device for secure communication 78 Contents_2 114 the institute in profile Objectives IOSB’s mission is the same as that of the Fraunhofer-Gesellschaft: Research of practical utility lies at the heart of all activities pursued by the Fraunhofer-Gesellschaft. With its research the IOSB seeks to further technology-driven innovation; with market analysis it seeks to further application-driven innovation; and in cooperation with partners from research and industry it supports innovation in society and industry. What makes the institute special is that it combines core know-how in optronics, system technologies and image exploitation with application know-how gained through an extensive dialog with its partners. Short portrait Established on January 01, 2010, the Fraunhofer Institute of Optronics, System Technologies and Image Exploitation IOSB grew to become Europe’s largest research institute in the field of image acquisition, processing and analysis. IOSB’s other areas of activity are control and automation technology, and information and knowledge management. IOSB has four locations in Germany: Karlsruhe, Ettlingen, Ilmenau and Lemgo (highlighted on the map of the Fraunhofer Gesellschaft on page 33), as well as a representative office in Beijing. The three core competencies of Optronics, System Technologies and Image Exploitation give the institute its distinctive profile. Optronics covers the interface region between electromagnetic radiation and electronic signals. It deals with converting information about the appearance of the environment and the objects it contains into electrical signals and – conversely – electrical signals into optical images. Image processing covers conditioning and real-time processing of, and automatic and interactive information extraction from images and videos. System integration, which represents a cross-section of expertise and is essential for responding to difficult, comprehensive issues with integrated solutions, may, at first sight, appear to be our most abstract field of research. System integration covers everything that is required for analysis, gaining an understanding of, modeling, development, and controlling complex systems. 6 1 The departments of IOSB and their relation to the core competencies optronics, image exploitation and system technologies. Optronics OPT:Optronics SIG: Signatorics SPR: Visual Inspection Systems System technologies NRG: Energy WMS: Water and Mobile Systems ILT: Information Management and Production Control INA: Fraunhofer Application Center Industrial Automation Figure 1 MRD: Systems for Measurement, Lemgo Peking Control and Diagnosis SKA: Secure Communication Karlsruhe Ettlingen Ilmenau Director Division Photonics Advanced System Tech- Fraunhofer Applica- Beijing Representative Prof. Dr.-Ing. habil. and Optronic nology (AST) Branch tion Center Industrial Office of IOSB Jürgen Beyerer Systems of Fraunhofer IOSB Automation INA Head of division Head of AST Head of department Head of IAS: Interoperability and Dr. rer. nat. Prof. Dr.-Ing. habil. Prof. Dr.-Ing. representative office Reinhard Ebert Thomas Rauschenbach Jürgen Jasperneite Dipl.-Ing. Hong Mu OBJ: Object Recognition Architectures Image exploitation IAD: Interactive Analysis and Diagnosis Departments: SPR, ILT, MRD, SKA, Departments: IAD, IAS, VID, VBV Departments: OPT, SIG, OBJ, SZA NRG, WMS Assistance Systems Department: SZA: Scene Analysis INA VID: Video Exploitation Systems VBV: Variable Image Acqui- The key of IOSB are fourteen departments and a research group, which represents building sition and Processing (Research Group) blocks the link to the Chair for Interactive Real-Time Systems of the Institute of Anthropomatics at the Faculty of Informatics of KIT. The Competence Triangle in Figure 1 illustrates the share of core competencies contributed by each of IOSB’s departments. With their various key areas, the departments of IOSB cover the entire process chain from signal acquisition through signal analysis to integration into operational systems. In practical use, systems interact with their environment. This, too, is reflected by the activities of IOSB, which cover all degrees of freedom required for effective system design. The problems on which IOSB focuses in its research and development work usually require the integration of a range of different scientific disciplines. This awareness forms the basis for the allocation of our departments within the competence triangle in Figure 1. The abundance of our expertise gives us a great bandwidth of achievable goals. While finding solutions to our tasks requires sophisticated technologies to deal with the various subproblems, the creation of value and benefit requires a well-organized interplay of powerful components in a coherent whole. 7 the institute in profile In order to leverage this potential, profound expertise in automation technology, system architecture, software engineering, network engineering, information and knowledge management, interoperability technologies and, not least, a systematic design of humanmachine systems is required. Typical for problems beyond a certain degree of difficulty and complexity is that optimal solutions are not merely automatisms but rather man-machine systems, in which – in addition to hardware and software – the organization into an overall process is crucial. Convincing examples of systems from IOSB include the image and video analysis system ABUL and VABUL for the LUNA unmanned reconnaissance aircraft, several of which are in use in the German Armed Forces and now also in the Swiss Air Force; the RecceMan® system, which provides efficient interactive object recognition in aerial photographs and has also been taken into operation as a valuable tool by the German Armed Forces; and the control system ProVis.Agent®, which is being used very successfully in automobile production at Daimler AG, in particular in the Bremen and Wörth factories. In industrial quality inspection, large numbers of our sorting systems are working reliably, for example, in glass recycling plants. Our partner Binder+Co was awarded the Austrian State Prize for Innovation for this system. Complementary to its research and development activities, IOSB has systems evaluation and assessment capabilities. An example is IOSB’s thermal range model software package TRM 4, with which the performance of the overall system consisting of vision device and observer is determined quantitatively. Based on the knowledge of all components and associated human capabilities, this system considers technical features and laboratory measurements to perform assessments. With its neutral evaluation competence, IOSB supports clients in planning and developing components and systems, in concept development and planning of facilities, and in procurement. Our business units bring together the expertise of IOSB towards the markets. As well as requiring scientific and technology skills, best-of-class solutions need also need in-depth industry knowledge. The five business units are listed alphabetically in Figure 2. Developing 2 Business Units of IOSB. 8 3 Organization chart May 2014. dynamically, they provide specific solutions, services and products tailored to the needs of their specific markets. The departments participate in the business units according to the allocation of their activities to the markets. Of great importance for IOSB are its close ties with the Karlsruhe Institute of Technology (KIT), which complements its research capabilities. With the Chair for Interactive Real-Time Systems at the Institute for Anthropomatics of the Faculty of Informatics, consulting activities of university chairs at IOSB, membership of university professors in the Board of Trustees, lecturing by IOSB staff and more, cooperation with the KIT is already multi-faceted. An intensified collaboration with KIT in the research work at the Ettlingen site to sustainably integrate the entire range of IOSB’s activities in the science region of Karlsruhe is also being planned. To this end a Chair in Optronics is to be established at the Faculty of Electrical Engineering and Information Technology of KIT. At IOSB’s Ilmenau and Lemgo sites the cooperation with the Technical University of Ilmenau and the University of East Westphalia Lippe has also been strengthened through professorships and is proving highly fruitful. 9 overview Director Prof. Dr.-Ing. habil. Organization Chart Deputies to the Director Dr. rer. nat. Reinhard Ebert Jürgen Beyerer Dr. rer. nat. Jürgen Geisler Dr.-Ing. Olaf Sauer Optronics System technologies 10 Head of department OPT Optronics Dr. rer. nat. Dipl.-Chem. Helge Bürsing Phone +49 7243 992-446 Head of department NRG Energy Dr.-Ing. Peter Bretschneider Phone +49 3677 461-102 Head of department INA Fraunhofer Application Center Industrial Automation Prof. Dr.-Ing. Jürgen Jasperneite Phone +49 5261 702-572 Head of department SIG Signatorics Dr. rer. nat. Karin Stein Phone +49 7243 992-114 Head of department WMS Water and Mobile Systems Prof. Dr.-Ing. habil. Thomas Rauschenbach Phone +49 3677 461-124 Head of department MRD Systems for Measurement, Control and Diagnosis Dr.-Ing. Michael Heizmann Phone +49 721 6091-329 Head of department SPR Visual Inspection Systems Prof. Dr.-Ing. Thomas Längle Phone +49 721 6091-212 Head of department ILT Information Management and Production Control Dr.-Ing. Thomas Usländer Phone +49 721 6091-480 Head of department SKA Secure Communication Architectures Dipl.-Inform. Thomas Kresken Phone +49 721 6091-273 Image exploitation Division: Photonics and Optronic Systems Head of department IAD Interactive Analysis and Diagnosis Dr. rer. nat. Elisabeth Peinsipp-Byma Phone +49 721 6091-393 Strategy and Innovation Management Dr. Gunnar Brink Phone +49 721 6091-640 Head of department SZA Scene Analysis Dr.-Ing. Karsten Schulz Phone +49 7243 992-106 Head of division Dr. rer. nat. Reinhard Ebert Public Relations Dipl.-Ing. Sibylle Wirth Phone +49 721 6091-300 Phone +49 7243 992-140 [email protected] Head of department IAS Interoperability and Assistance Systems Dr.-Ing. Rainer Schönbein Phone +49 721 6091-248 Head of department VID Video Exploitation Systems Dr.-Ing. Markus Müller Phone +49 721 6091-250 Assigned departments Optronics Dr. rer. nat. Dipl.-Chem. Helge Bürsing Signatorics Dr. rer. nat. Karin Stein Commercial and Technical Management Dipl.-Kaufm. Siegbert Böckle Phone +49 721 6091-350 Object Recognition Dr. rer. nat. Michael Arens Scene Analysis Dr.-Ing. Karsten Schulz Head of department OBJ Object Recognition Dr. rer. nat. Michael Arens Phone +49 7243 992-147 Group manager VBV Variable Image Acquisition and Processing (Research Group) Dr. rer. nat. Alexey Pak Phone +49 721 608-45912 Representative Office China, Beijing Dipl.-Ing. Hong Mu Phone +86 10 65900 621 11 Welcome to the Factory of the Future A research factory for industrial automation A research factory is a manufacturing system, which is flexible and resource-efficient as well as adaptive to humans and can therefore be operated intuitively. It is a highly complex system consisting of technical components that even incorporate intelligence. We firmly believe that we will have smart factories soon. The paradigm of “Internet of Things” is making inroads on all areas of daily life: Whether in the home, in cars, or in production, embedded systems are rapidly becoming our daily companions. Coffee makers, toasters, and even plants can “have their own voice” and be responsive. This hidden computer systems, which are connected to the Internet are working to make users’ lives easier. In future production systems the plants control themselves and work pieces are able to advise the production system how they have to be processed. This makes production much more flexible and allowing mass customization. As part of the German government’s high-tech strategy the trend of merging production technology with information technology has been termed “Industry 4.0” – the fourth industrial revolution. The technological platform at the core of Industry 4.0 is the Internet of Things (IOT), which largely eliminates the distinction between the virtual and the real world. Since 2005 we have been working specifically on ICT-based automation technologies to realize the factory of the future. In 2014, as we continue to pursue the same objective, the proven research and demonstration platform “Lemgo Modellfabrik” is evolving into an intelligent factory of the future. 12 With a consistently modular design concept in terms of mechatronics, automation, and software, the most important characteristics of a Research Factory – such as adaptability, plug-and-play capability and ease of use – are demonstrated with augmented reality methods. Located on the campus of the Ostwestfalen-Lippe University of Applied Sciences, the Research Factory will be both demonstration facility and learning environment for students of industrial and electrical engineering as well as of computer science. Small and medium-sized producing companies will have the opportunity of benefit from a batch production and training their personnel. On a floor area of 2000 m², intelligent automation solutions will be explored, developed and tested here. The research factory for Industry 4.0 technologies is an initiative of the Fraunhofer IOSB-INA and the OWL University of Applied Sciences Our research factory – Nestled in the CIIT Research Campus. 13 Groundbreaking A Westphalian success story: Research Center CIIT in Lemgo is expanding It is a success story made in OWL. Industry leaders from the world of electrical engineering are partnering with research institutions. Dedicated private investors provide the necessary capital. The CENTRUM INDUSTRIAL IT (CIIT) in Lemgo is the home of the Fraunhofer Application Center for Industrial Automation and Germany’s first Science-to-Business center in the field of industrial automation. Built in 2010 on the campus of OWL University, the research center is now, four years later, being extended to twice its former size. The CIIT has globally established itself as a high-tech research center. Technology companies and research institutes, who carry out research work in the field of IT-based automation, here work under a single roof. Adjacent and connected to CIIT’s existing premises right on the campus of OWL University, a new building is being erected, increasing the total area to 10,000 square meters. The new building is to be inaugurated in mid-2015. The Fraunhofer Application Center for Industrial Automation (IOSB-INA) can now significantly expand its floorspace. The CIIT partners, too, are getting more space for work and research. Flexible project areas that are available for short- and medium-term rental will also be available. 14 On March 20, 2014 around 150 invited guests celebrated the groundbreaking ceremony for the CIIT extension. Among the guests was Svenja Schulze, Minister for Innovation, Science and Research of North Rhine-Westphalia, which presented the CIIT with the “Place of Progress” award for exceptional cooperation between industry and science. This award is presented to institutions in North Rhine-Westphalia that unite economic, ecological and social innovation and enable progress for society. Minister Svenja Schulze praised the longterm interdisciplinary cooperation within the CIIT. “Science and industry are pulling together here – permanently, head to head and under one single roof. A venture from which both benefit”, said Schulze in her speech. The extension also symbolizes the growth of the network that has developed around the CIIT. Numerous research projects, dual degree opportunities, graduate school and the award of a prize for young researchers demonstrate the fruitfulness of the close cooperation between industry, research institutes and universities in Lemgo. 15 IT security lab for industrial control systems IOSB establishes an IT security lab for industrial control systems in 2014, which specializes in net-working and the application of Internet technologies in the factory of the future (Industrie 4.0). This IT security lab combines IOSB’s expertise in automation, control and IT security. It thus enables IOSB to provide its customers with tailored solutions from a single source. In order to support consulting and development services, the IT security lab provides IOSB’s customers an opportunity to carry out security investigations around new security technologies for networked industrial control systems. Particular aspects of this lab are the protection of networked cyber physical systems (CPS) by applying security technologies promulgated by the »Internet of Things« community. IOSB experts focus on the analysis of security threats, the identification of vulnerabilities in production networks, and the development of solutions that allow the operator to observe the security state of its assets (security monitoring, gaining overview of the situation).This IT security lab comprises its own industrial automation systems with integrated equipment from different manufacturers. Security research and the testing of new security technologies and products can be carried out in an integrated real environment. Security investigations are executed in the classical multi-level IT system automation pyramid ranging from the field Contact: Dipl.-Inform. Birger Krägelin Phone +49 721-6091-454 [email protected] 16 VGB Power Tech GmbH Germany. device level up to manufacturing execution systems (MES) and enterprise resource planning (ERP), as well as in networked CPS environment possibly relying upon virtualized, distributed data storage systems. The latter case tends to be a typical Industrie 4.0 environment, which typically relies upon cloud technologies, implemented as private or public cloud or both. Here, security, privacy and trust aspects need particular attention. Furthermore, the secure local automation systems at IOSB Karlsruhe are connected to further labs residing at other locations of IOSB (Lemgo, Ilmenau) so that multi-site supply chain settings can be demonstrated. As it is set-up as a high security lab it allows the IOSB scientists to study special attack techniques and dangerous malicious programs. Further the development of new methods to identify vulnerabilities (penetration testing, vulnerability testing) is carried out. The IT security lab for industrial control systems is well connected nationally and internationally and leverages close cooperation networks between experts from academia and industry. The IOSB activities are involved in the high-tech strategy of the federal government (Industrie 4.0) and in standardization processes for Industrial IT security technology. IT 17 1 Contact Office China, Beijing 1 The Thuringian Minister President Christine Lieberknecht, Professor Thomas Rauschenbach (Fraunhofer IOSB-AST) and Professor Li as well as Science Minister Christoph Matschie (from right) at the handover of “C-Watch” in Beijing. Many German companies have discovered China as an attractive market for itself. However, these companies often need local partners also in applied research. Due to a long-term cooperation with several research institutes and industrial partners in China, Fraunhofer IOSB established a representative office in Beijing as early as in 1996. The focus of the representative office is the initiation of research activities focused in the areas of environment and energy. Especially in the field of water supply and water resource management Fraunhofer IOSB is involved in many R&D projects in China. 2013 was one of the most successful years since the establishment of the representative office. Under the presence of prime minister of the state of Thuringia Christine Lieberknecht and minister Christoph Matschie the underwater vehicle „C-Watch“ was delivered to the Dipl.-Ing. Mu Hong Chinese customer, China Agriculture University (CAU) in May 2013. A second vehicle will be Phone +86 10 65900 621 transferred to the Nanjing Hydraulic Research Institute in 2014. Fax +86 10 65900 619 [email protected] As part of the funding program „International Partnerships for Sustainable Technologies and Services for Climate Protection and the Environment“ (CLIENT), the research project „HAPPI“ Fraunhofer Representative (Small Hydropower Plants: Assessment of Climate Protection Potential and Improvement by Office Beijing Smart Technologies) could be successfully started. As a third major water project, the EU Representative for Production project INAPRO (Innovative model and demonstration based water management for resource and Information Technologies efficiency in integrated multitrophic agriculture and aquaculture system) could be initiated. Unit 0610 Landmark Tower II 8 North Dongsanhuan Road Offside the water sector, an industrial project with Volkswagen Group China and Fraunhofer Chaoyang District IWU has to be mentioned, addressing several issues in electric mobility. Beyond, a consulting 100004 Beijing, PR China project in the field of cable harness production started together with the Beijing Research Institute of Telemetry (BRIT). Contacting us in Germany Prof. Dr.-Ing. habil. Furthermore, the exchange of scientists between China and Germany could be strengthened: Thomas Rauschenbach Nine Chinese visiting scholars of the China Agriculture University and the Yellow Sea Fishery Phone +49 3677 461-124 Research Institute could be welcomed to Germany within the EU personnel exchange fund thomas.rauschenbach@ „Marie Curie Actions“. iosb-ast.fraunhofer.de 18 The InstitutE in Figures The development of IOSB Funding* continues to be positive and we are expanding organically. Especially pleasing is the substantial growth in our returns from private enterprise in 2013. Aside from the peak in 2012, which was due to exceptional Business expenses investments, the IOSB grows steadily. In addition to our permanent staff we also engaged 175 student assistants and interns. * The diagram does not include research and business Staff activities concerning defense. Annotation: The chart “business expenses 2009“ shows only the figures for IITB without FOM. 19 Alliances iosb in Fraunhofer alliances Fraunhofer AutoMOBILE Production Alliance Business areas: •Production research for electromobility Carmakers, their suppliers, and those equipping the automotive industry, represent a decisive •Methodological competence economic factor in Germany. Significant changes to the entire concept of mobility are ultim- (logistics, planning, quality ately being driven by global trends, such as dwindling natural resources, an increasing need for assurance) mobility, urbanization and megacities. In addition, German carmakers and their suppliers are •Vehicle body facing increasingly tough competition as the trend towards low-cost vehicles takes hold. •Powertrain •Electrical/electronic systems The Fraunhofer Alliance pools the expertise of 18 institutes, who collectively provide the German •Interior automotive industry with a competent single-source partner for its research and development •Assembly/vehicle final assembly needs. The complementary effect achieved by combining the individual institutes‘ key areas of research, makes it possible to generate rapid, integrated and sustainable innovations along the entire process chain of vehicle manufacturing – from the planning stage right through to the finished vehicle. The Alliance tackles the challenges posed by environmental policies (reducing fuel consumption and CO2; electromobility; cutting material consumption) while taking full Contact at IOSB: account of commercial imperatives (ongoing pressure to cut costs). Dr.-Ing. Olaf Sauer Fraunhofer Embedded Systems Alliance Business areas: •Materials and components •Numerical and experimental Fraunhofer Embedded Systems Alliance: Complex technological products generally contain embedded systems: computers that monitor, regulate and control various functions. Embedded systems are very much at the heart of high-tech devices in the automotive industry, in mechan- methods •Electronics and control technology ical and plant engineering, in medical technology or in home electronics. •Systems The complexity and capabilities of these systems have grown to such an extent in the course Deputy Spokesperson of alliance: of their technological development that they are now beyond the competencies of any one Prof. Dr.-Ing. Jürgen Jasperneite field. In response, Fraunhofer has created the Embedded Systems Alliance, bringing together the expertise of those Fraunhofer Institutes whose combined competencies in the fields of information technology, electronics and engineering cover the entire spectrum of embedded Contact at IOSB: systems. Prof. Dr.-Ing. Andreas Wenzel 20 Fraunhofer Energy Alliance Business areas: •Renewable energy sources •Energy-efficiency technologies In the Fraunhofer Energy Alliance eighteen Fraunhofer Institutes join their expertise in energy •Buildings and components technologies and energy research, with the aim to give research and development from one •Intelligent energy nets hand to industry and energy economy. •Energy storage and micro-energy systems The alliance co-operates with the Fraunhofer networks Microenergy Technology, Wind Energy, Direct-Ethanol-Fuelcell and Smart Grids. Deputy Spokesperson of alliance: Dr.-Ing. Peter Bretschneider The Alliance’s work is chiefly focused on: Renewable energy sources (solar energy, biomass, wind power); energy-efficient technologies (fuel cells, combined heat and power (CHP) systems and gas delivery, building-service technologies, power electronics); buildings and components (low-energy-houses, building energy technology); smart grids (p.e. systemtechnological grid integration of distributed generators; electrical energy storage and micro-energy systems Contact at IOSB: (lithium battery technology, fuel-cell systems) and energy management solutions. Dr.-Ing. Peter Bretschneider Fraunhofer Food Chain Management Alliance Thematic areas: •Food chemistry •Food packaging technology The Fraunhofer »Food Chain Management« Alliance is a platform that merges the expertise of •Logistics 12 Institutes. It aims at introducing latest scientific know-how in new products and solutions of •Microsystem technology this field by means of mutual projects. Food Chain Management has an enormous economic significance. Therefore new approaches in food safety, microelectronics and logistics, which can easily be integrated in the entire food chain and exhibit an added value as high as possible at low costs are the main objective. Contact at IOSB: The alliance acts as a competent contact partner and problem solver, both for industrial Dipl.-Ing., Dipl.-Wirt. Ing. partners and SMEs as well as institutional funding organizations on a national, European and Henning Schulte global level. Prof. Dr.-Ing. Thomas Längle Fraunhofer Vision Alliance Business areas: •Industrial image processing •Automated visual inspection The Fraunhofer Vision Alliance combines the expertise of institutes in the field of automated •3-D surveying visual inspection and image processing. •Thermography •X-ray inspection The main office in Erlangen serves as the initial point of contact for customers. This office is •Surface inspection also responsible for the coordination of joint projects. The institutes cooperating in the Vision •Medical engineering Alliance offer services relating to applications of innovative sensors, from terahertz radiation •Safety engineering over the visual spectrum and infrared to x-ray, the associated handling, and the evaluation of •Traffic engineering the sensor data. Their work focuses particularly on optical sensing and automated inspection •Terahertz imaging processes for quality assurance. Contact at IOSB: Dr.-Ing. Michael Heizmann Prof. Dr.-Ing. Thomas Längle 21 Fraunhofer Water Systems Alliance Business areas: •Urban/periurban water management systems In the Fraunhofer Water Systems Alliance (SysWasser) eleven Fraunhofer Institutes have been pooling their expertise in the research and development of effective water infrastructure •Processes and systems for the supply with drinking and service water systems and technology. •Wastewater treatment processes The alliance’s objective is to take sustainable solutions for water catchment, infrastructure, •Integrated water resource and systems and wastewater treatment and adapt them for use in practical applications on a national and international level, taking into consideration the relevant social, economic and environmental implications. management (IWRM) •Analysis and evalutation of water-economic systems The use of an integrated, systemic approach linking the energy, waste management and Contact at IOSB: agricultural sectors will contribute towards a more efficient and environmentally compatible Prof. Dr.-Ing. habil. usage of water as a life-essential resource. Thomas Rauschenbach Fraunhofer Space Alliance Business areas: •Communication and Navigation •Materials and Processes Bringing together 13 institutes, the Fraunhofer Space Alliance conducts applied research in the •Energy and Electronics field of industrial space technology. Weather forecasts, navigation, real-time transmission for •Surfaces and Optical Systems satellite TV or global Internet access – space industry applications and services have become an •Protection Technology and indispensable part of daily life, underpinning the importance of space technology for a modern industrialized society. In the Fraunhofer Space Alliance, the institutes pool their technological Reliabilty •Sensor systems and Analysis expertise in order to provide the industry and funding agencies such as the European Space Agency (ESA) and the European Commission with a central contact. Fraunhofer acts as systems provider, developing a wide range of top-quality components, integrating them into an overall system and delivering that system to the customer. The sheer technological variety of the participating institutes enables the Fraunhofer Space Alliance to offer its customers a unique range of services. Its business units are Communication and Contact at IOSB: Navigation, Materials and Processes, Energy and Electronics, Surfaces and Optical Systems, Dr. rer. nat. Dipl.-Phys. Karin Stein Protection Technology and Reliability and Sensor Systems and Analysis. Dipl.-Ing.(FH) Caroline Schweitzer 22 Alliances_3 iosb in Fraunhofer Groups Fraunhofer Information and Business areas: Communication Technology Group •Digital media •E-Business As the largest ICT research group in Europe, the Fraunhofer Information and Communication •E-Government Technology Group serves as a one-stop shop for industrial customers and media enterprises •Communication systems •Energy and Sustainability The strengths of the member institutes are pooled strategically and marketed jointly. This net- •Medicine work makes it possible to translate application-oriented research into customized, integrated •Production solutions for a specific sector: •Security • tailored IT solutions •Financial service provider • competent consulting on technological issues •Automotive • pre-competitive research for new products and services Regular economy summits unite the right partners from industry and research. The Fraunhofer Information and Communication Technology Group evolves strategies and visions for mediumterm priority research areas, providing its member institutes with assistance in the transfer of technology and the marketing of their research activities. The ICT Group also publishes the Contact at IOSB: economy magazine »InnoVisions«, which is available at the kiosk. Prof. Dr.-Ing. habil. Jürgen Beyerer Fraunhofer Group for Defense and Security Business areas: •Security research •Protection and deterrence This group has been formed by Fraunhofer institutes as a means of coordinating their research •Reconnaissance and surveillance activities and defining common goals in the area of »Defense and Security«. •Explosives and safety engineering The chief objective of the group is to agree on common strategies vis-à-vis government funding •Decision-making support for agencies and to promote collaboration with these institutions and with the defense industry. government and industry Furthermore, the members of the group intend to align their research strategies with the •Localization and communication requirements of the projected unification of European defense and security policy. •Image processing The group aims to maintain its traditional combination of research fields with civil and military applications, because it represents a valuable source of innovation and technological progress, to the benefit of all parties. It will continue to exploit this factor as a competitive advantage in both markets. The member institutes of the group, which engage in both civil and defense research, thus have an important role to play in the transfer of knowledge. They ensure that any significant breakthrough in research funded by non-military sources will be used to benefit Contact at IOSB: defense technology, and vice versa. Prof. Dr.-Ing. habil. Jürgen Beyerer Fraunhofer Group for Production Business areas: •Product development •Manufacturing technologies The Fraunhofer Group for Production is a cooperative venture by a number of Fraunhofer •Manufacturing systems Institutes, created with the aim of collaborating on production-oriented research and deve- •Production processes lopment in order to be able to offer customers in the manufacturing, commercial and service •Production organization sectors comprehensive single-source solutions derived from the pooling of the wide-ranging •Logistics expertise and experience of the individual institutes. The Fraunhofer Group for Production makes use of the latest findings in industrial engineering and information science to offer a Contact at IOSB: range of services that covers the entire product life cycle or value chain. Dr.-Ing. Olaf Sauer 23 Fraunhofer-Gesellschaft R e se a rc h of pra cti ca l u ti l i ty l i e s a t th e h eart of al l ac ti v i ti es purs ued by the Fr a unhof e r- Ge s e l l s c h a ft. Fo u n d e d i n 1 9 4 9, the res earc h organi z ati on underta k e s a pplie d re s e a rch th a t d ri v e s e co n o mi c dev el opment and s erv es the wi der b e ne f it of soc ie ty . I ts s e rv i ce s a re s o l i c i te d by c us tomers and c ontrac tual partn e r s in indust r y , th e s e rv i ce s e c to r a n d p u bl i c admi ni s trati on. At present, the Fraunhofer-Gesellschaft maintains 67 institutes and research units. The majority of the more than 23,000 staff are qualified scientists and engineers, who work with an annual research budget of 2 billion euros. Of this sum, more than 1.7 billion euros is generated through contract research. More than 70 percent of the Fraunhofer-Gesellschaft’s contract research revenue is derived from contracts with industry and from publicly financed research projects. Almost 30 percent is contributed by the German federal and Länder governments in the form of base funding, enabling the institutes to work ahead on solutions to problems that will not become acutely relevant to industry and society until five or ten years from now. International collaborations with excellent research partners and innovative companies around the world ensure direct access to regions of the greatest importance to present and future scientific progress and economic development. With its clearly defined mission of application-oriented research and its focus on key technologies of relevance to the future, the Fraunhofer-Gesellschaft plays a prominent role in the German and European innovation process. Applied research has a knock-on effect that extends beyond the direct benefits perceived by the customer: Through their research and development work, the Fraunhofer Institutes help to reinforce the competitive strength of the economy in their local region, and throughout Germany and Europe. They do so by promoting innovation, strengthening the technological base, improving the acceptance of new technologies, and helping to train the urgently needed future generation of scientists and engineers. As an employer, the Fraunhofer-Gesellschaft offers its staff the opportunity to develop the professional and personal skills that will allow them to take up positions of responsibility within their institute, at universities, in industry and in society. Students who choose to work on projects at the Fraunhofer Institutes have excellent prospects of starting and developing a career in industry by virtue of the practical training and experience they have acquired. The Fraunhofer-Gesellschaft is a recognized non-profit organization that takes its name from Joseph von Fraunhofer (1787–1826), the illustrious Munich researcher, inventor and more at: entrepreneur. www.fraunhofer.de 24 l o c at i o n s Locations of the Fraunhofer institutes in Germany more at: www.standortkarte.fraunhofer.de 25 B u s i n e ss U n i t Automation Spokesperson technology. Industrial ICT has to fulfill high standards, which Dr.-Ing. Michael Heizmann result from competitive production costs, high equipment Phone +49 721 6091-329 availability, required product quality and guaranteed delivery times. Mechanical engineers, computer scientists and automation experts must therefore cooperate more closely than ever to meet future requirements. That is what the team of the Automation Business Unit stands for. To date, ICT in production technology has been based on the architectural model of the automation pyramid. Owing to increasing ICT support on all hierarchical levels of the factory, however, there seems to be a new trend according to which the information flow in factories follows a new ”reference model of industrial information technology”. This model takes Business Unit Development account of three dimensions of information flow, namely Dr.-Ing. Olaf Sauer vertical and horizontal integration, and integration spanning Phone +49 721 6091-477 the entire life cycle of production equipment. When it comes to enabling shop-floor-related ICT systems to communicate consistently within the three aforementioned dimensions, for example, it is necessary to connect them systematically with the systems of the digital factory (life cycle dimension) and with automation technology on the control and field levels (vertical integration). To this end, it is indispensable to use unified, general syntax and semantics. Specifically, the activities of the Automation Business Unit Real-time ICT for complex manufacturing processes focus on the following areas: Automation technology is a key factor for the competitive- 1) Production monitoring and control technology and MES: ness of the German manufacturing industry. Automation Monitoring and control systems become increasingly – and particularly industrial information technology – also important for transparent and safe production. We plays a major role in the current debate about cyber-physical consider control technology to be a fundamental part of systems and the Internet of Things: Information and commu- today’s manufacturing execution systems. nication technology (ICT) penetrates all devices, machinery 2) Adaptive information technology: Adaptivity is one of the and equipment in production, on all hierarchical levels, key requirements for the factory of the future – not just in ranging from sensors and machine components, machines physical terms, but increasingly in terms of software, too. and their controls to interlinked plants and their visualization Our current activities in the field of Secure Plug&Work are across operations by means of monitoring and control ground-breaking in this respect. 26 3) Industrial Smart Grids: We deal with the challenge of • Network-based data loggers for process and system diagnosis energy management in manufacturing operations. To this • Autonomous robot platforms end, our specialists make use of the principles of smart • Intelligent Energy Systems research platform at the sub- grids, including the integration with the smart grids of institute of Advanced System Technology (IOSB-AST) energy providers. We combine our expertise in energy • ICT energy laboratory at the sub-institute of Advanced management and suppliers’ energy data management with System Technology (IOSB-AST) long-term experience in monitoring production plants on behalf of energy consumers. References / product highlights 4) Process intelligence and quality improvement: We use state-of-the-art monitoring and control technology as well • ProVis.Agent® integrated monitoring, control and reporting as condition monitoring to improve plant performance and system for car body, paint and assembly shops of the availability in the process and manufacturing industry. Bremen and Wörth plants of Daimler AG 5) Industrial communication: It is our vision to create an internet for machines and “things” in general in manufacturing, making real-time information available on all levels of a distributed automation system in the required • Integration platform in the press shop of the Bremen plant of Daimler AG • ProVis.Agent® monitoring and control system for Thyssen Krupp Steel AG, Duisburg quality and allowing devices to be integrated on the basis • Various interoperability tools based on CAEX and OPC UA of standardized Plug&Work principles. • ProDaMi: suite containing data mining tools for decision 6) Robot systems: This area focuses on activities relating the control of autonomous and partly autonomous robots and vehicles, acting as individuals, in groups and in cooperation with human beings. support in manufacturing • Condition monitoring for Bayer Technology Services GmbH, Leverkusen • PROFINET single-chip solution for Phoenix Contact, Blomberg and Siemens AG, Nürnberg Equipment / laboratory facilities • Various projects relating to Industry 4.0 • Model factory at the Fraunhofer Application Center Industrial Automation (IOSB INA) in Lemgo • ProVis test bed • Automation test bed including PLCs, communication, and monitoring and control systems • Tools for online fine planning and scheduling for discrete manufacturing (ProVis.APS) • OPC and OPC UA simulation • AutomationML™ test center • Virtual commissioning laboratory including PLCs, WinMOD, and Delmia Automation • Test installation to demonstrate interoperability and adaptivity • Design and simulation tools for engineering and testing micro-electronic IPs in the field of real-time communication 27 S y s t e ms f o r M e a s u r e m e n t , Control and Diagnosis www.iosb . frau n h o fer.d e / M R D Model-based optimization of a complex biological production process T he produc t ion o f b u l k a n d fi n e c h e m i c a l s bas ed on renewabl e res ourc es has gai ned i nc reas i ng i mpor t ance i n re c e nt y e a r s a s “ wh i te b i o te c h n o l o g y“ . Surfac tants whi c h, for the mos t part, are c urrentl y manuf act ure d indust r ia lly fro m p e tro ch e m i c a l ra w m ateri al s , are a potenti al produc t of the us e of bi otec hnological p roduc t ion m e th o d s . O n e k n o wn e xa m p l e of mi c robi al s urfac tants i s rhamnol i pi ds from the bact er ium P se udom ona s a e ru g i n o s a . R h a m n o l i p i d s can be produc ed on the bas i s of renewabl e res ourc es such as ve ge t a ble oils o r s u g a r. T h e y a re ch a ra c te riz ed by thei r good env i ronmental s us tai nabi l i ty and bi od egr adab ilit y a nd e x c e l l e n t s u rfa c ta n t p ro p e rti e s. A s i gnifi c ant reas on as to why bi otec hnol ogi c al l y p roduced rha m nolipids ca n n o t y e t c o mp e te wi th s yntheti c s urfac tants on the market i s the rel ati v el y l ow product yie lds. A pproa ch e s u s e d s o fa r to o p ti m i z e the produc ti on of bi os urfac tants are l argel y bas ed on heur ist ic p roc e sse s, pa r t i cu l a rl y wi th re g a rd to th e rhamnol i pi d c reator Ps eudomonas aerugi nos a. The ai m of t he p roje c t w a s t he re fo re to a tta i n o p ti mi ze d proc es s management s trategi es by us i ng an i nterdi sciplinar y com bina t ion of a d v a n ce d p ro c e s s co n tro l , bi ol ogi c al proc es s tec hnol ogy and mol ec ul ar bi ol ogi c al m et hods i n o rd e r t o m a k e i t p o s s i b l e t o p ro d u c e s u r f a c t a n t s f ro m re n e w a b l e re s o u rc e s i n a n e c o n o m i c a l a n d s u s t a ina ble w a y. Results Figure 1 shows the reactions and interactions for forming Pseudomonas aeruginosa (biomass) and the products mono-rhamnolipid and di-rhamnolipid. The biomass is in large part formed from glycerol and fatty acid. Nitrogen is also required for its formation along with the trace elements phosphorus, sulfur and iron. As shown in Figure 1, the sunflower oil that is added is cleaved into glycerol and fatty acid by using lipase as a catalyst. Lipase, in turn, is formed by using glycerol, fatty acid and nitrogen and under the catalytic effect of the biomass. Mono-rhamnolipid is also formed from glycerol and fatty acid under the catalytic effect of the biomass. A part of the mono-rhamnolipid reacts with glycerol and fatty acid to make di-rhamnolipid. As a by-product, polysaccharide is formed from glycerol and fatty acid. State variables of the model are firstly the concentration of biomass, sunflower oil, lipase, glycerol, fatty acid, mono-rhamnolipid, di-rhamnolipid, polysaccharide, nitrate and carbon dioxide. Another state variable is the concentration of C4-HSL (HSL = homoserine lactone), Contact: which is a measure of quorum sensing. The bacterium Pseudomonas aeruginosa uses Dr. Thomas Bernard quorum sensing to control the secretion of the rhamnolipids. Phone +49 721 6091-360 [email protected] 28 Business Unit Automation 1 2 1 Process for creating biosurfactants. 2 Using a model-based oil feed strategy results in greater product formation (blue line). By using the chemical equations and the reaction kinetics, a non-linear dynamic model of the Shown in comparison with the process has been developed. In total, the model consists of 11 common, highly non-linear standard batch process (grey line). and coupled differential equations. The model contains 38 parameters, 8 of these parameters were determined experimentally, 22 parameter values were taken from literature or from databases or derived from balance equations. The remaining 8 parameters were fitted based Project execution on measured timings of the bioprocess. A specific numerical sensitivity analysis was also per- Dr.-Ing. Christian Kühnert, formed to obtain a prioritization of the parameters. The results of the sensitivity analysis were Dipl.-Ing. Markus Vogelbacher clearly visualized using a Hinton diagram. By using this approach, five parameters out of the 38 parameters were identified as having the greatest influence on the defined quality indices when varied. The selected parameters were then optimized in the form of an algorithm, which minimizes the deviation of the simulated processes from the measured data. Based on the model, optimized process control strategies were investigated to significantly increase the rhamnolipid production rate. As can be seen in Figure 2, the model-based oil supply strategy results in a significantly higher product formation. Funding The work is funded by the Baden-Württemberg Stiftung in the “Environmental Technology Literature Research“ program. [1] Henkel, M.; Schmidberger, A.; Kühnert, C.; Beuker, J.; Bernard, T.; Schwartz, T.; Syldatk, C.; Hausmann, R.: Kinetic modeling of the time course of N-butyryl-homoserine lactone concentration during batch cultivations of Pseudomonas aeruginosa PAO1. Journal Applied Microbiology and Biotechnology, SpringerVerlag Berlin Heidelberg 2013. DOI 10.1007/s00253-013-5024-5 Project Partners Prof. Dr. Rudolf Hausmann, University of Hohenheim, Subinstitution Bioprocess Engineering, Institute of Food Science and Biotechnology, Garbenstrasse 25, D-70599 Stuttgart Marius Henkel, Karlsruhe Institute of Technology (KIT), Institute of Process Engineering in Life Sciences, Section II: Technical Biology, 76131 Karlsruhe Anke Schmidberger, Dr. Thomas Schwartz, Karlsruhe Institute of Technology (KIT), Institute of Functional Interfaces, 76344 Eggenstein-Leopoldshafen [2] Henkel, M.; Schmidberger, A.; Kühnert, C.; Schwartz, T.; Bernard, T.; Syldatk, C.; Hausmann, R.: A model for rhamnolipid production with Pseudomonas aeruginosa: Development of optimized biotechnological processes. In: DECHEMA Conference Biosurfactants – Challenges and perspectives, 16–17.05.2013, DECHEMA-Haus, Frankfurt am Main Business Unit Automation 29 I n t e r a c t i v e A n a ly s i s and Diagnosis w ww.ios b . frau n h o fer.d e / IA D 1 Gesture-based Quality Assurance Intuitive interaction for industrial environments N e x t - ge ne r a t io n h u m a n -c o mp u te r i n te ra cti on offers i ntui ti v e c ontrol ev en for c ompl ex s y s tems. In t his project, we applied our vision-based gesture recognition technologies to a challenging industrial application area . Toge t he r wi th th e B M W G ro u p i n La n ds hut, we i mprov ed thei r qual i ty as s uranc e proc es s for paint ed bumpers by directly marking errors with gesture interaction. This saves production time while simultaneously re duc ing e r ror s a n d i mp ro vi n g wo rk i n g co ndi ti ons . Task Quality assurance is an integral part of production as it ensures that products meet company standards and customer expectations. Like most elements of current production systems, quality assurance is tightly integrated into the IT infrastructure, and every finding must be documented. While various systems are linked with sophisticated data exchange interfaces, the human-computer interface is often less than perfect, as it forces workers to use mouse and keyboard to insert data into input masks. This is not how humans naturally interact and therefore suboptimal. The BMW Group noticed that there is potential for improvement regarding the interaction between workers and computers, in particular in industrial environments. As a test case, they chose one of their factories in Landshut where painted bumpers are produced (Figure 1). After production, these bumpers are visually inspected by workers to ensure the expected high quality. Their findings must then be entered into a terminal that cannot be accessed from the actual inspection area. Even though this terminal already uses modern touchscreen technology, there are several drawbacks: Workers must leave their workplace to go to the terminal. This costs valuable production time and requires that workers shift their focus from their actual work. Furthermore, workers must remember the precise location of errors, which can lead to imprecise input, in particular in cases of multiple errors. Therefore, the BMW Group decided to apply the human-computer interaction technologies of the Fraunhofer IOSB to their quality assurance process to allow for a more direct control through intuitive gestures. Result Contact: The Fraunhofer IOSB develops technologies for SmartRooms – intelligent environments that Dipl.-Inform. Alexander Schick perceive their interiors and react to people. The goal is to provide natural and intuitive ways Phone +49 721 6091-620 of interacting with computers, for example through gestures. These technologies were applied [email protected] to the use case of the BMW Group to improve the quality assurance process. 30 Business Unit Automation 3 The current system perceives both workers and bumpers in real-time. In particular, it recognizes 1 Quality assurance process at gestures and relates them to the currently inspected bumper. If an error was found, workers BMW Plant Landshut. can now simply point at them, in much the way they would when interacting with a colleague. 2 3D reconstruction and The system recognizes and interprets these gestures and automatically records the pointed-at gesture interaction. error locations in the quality assurance system. If no errors were found, a simple swipe gesture 3 Integration into the quality over the bumper documents it as error-free. This improves the quality of the documentation assurance system. because workers can precisely point at the errors in front of them. It also saves time because workers are not required to leave their inspection area. Customer Project description This project was commissioned by The system is based on the technologies developed in the SmartControlRoom at Fraunhofer the BMW Plant Landshut. IOSB. Two depth sensors placed near the ceiling view the whole inspection area from above. This ensures that the inspection process is not disrupted by additional hardware that is in the way of workers. The sensor data is then combined into a coherent 3D reconstruction and both Project execution workers and bumpers are detected (Figure 2). The bumper recognition is based on a CAD model Two departments united their and can be applied to arbitrary parts by simply changing the model. Gesture recognition gives expertise for this project. Alexander information about the arms in 3D and gestures can be directly linked to the bumpers. This Schick (IAD) implemented the vision- enables workers to simply mark error locations by pointing at them. To allow for a seamless based gesture recognition and object integration into the existing quality assurance system ANABEL, our system was designed as a tracking. Todor Dimitrov (ILT) inte- gesture device that acts as an additional input modality (Figure 3). Both the installation of the grated these modules into the qua- hardware and the integration into the existing system did not disrupt the current process, but lity assurance system of the BMW smoothly blended into the existing environment. Group. Dr.-Ing. Olaf Sauer supported this project during all phases, A prototype system was from acquisition to completion. installed in the BMW Plant Landshut for an evaluation period of two months. The reactions of the workers were positive as they saw a direct improvement of their work. In addition, they enjoyed the system, as gesture interaction can be much more pleasant and enjoyable than traditional interfaces. 2 Literature [1]Schick, A.; Sauer, O.: wt Werkstattstechnik online, Ausgabe 9-2013, S. 731-732 [2]Schick, A.; Sauer, O.: QZ Qualität und Zuverlässigkeit, Ausgabe QZ 11/2013, S. 48-50 Business Unit Automation 31 I n f o r m at i o n M a n a g e m e n t and Production Control www.iosb . frau n h o fer.d e / ILT 1 Towards ProVis 4.0: Production monitoring and control in light of Industrie 4.0 The advent of the ”Inter net of Things and Services” in automation technology and industrial production has shifted the technological discussion towards the use of Inter net technology in all its facets, ranging from Inter net protocols, data description languages (for example XML in the form of AutomationML) to serviceoriented architectures (SOA, probably in the form of OPC-UA) or lightweight Web services for online interaction with “smart” devices, such as sensors, actuators, or so-called cyber-physical systems (CPS) in general. T his t re nd – in G e rma n y p ro m o te d b y th e Indus tri e 4.0 i ni ti ati v e – wi l l al s o affec t thos e func ti ons t hat are com m only c la s s ifi e d a s M a n u fa c tu ri n g E xec uti on Sy s tems (M ES). The F raunhofer I O SB produc tion suit e P roV is c ont a ins a n M E S co re c o mp o n e n t, whi c h prov i des moni tori ng and c ontrol func ti ons for discret e m a nuf a c t ur ing p ro ce s s e s . T h i s h a s b e e n s u c c es s ful l y depl oy ed, operated and mai ntai ned for more t han 25 ye a r s a t t he c a r a n d tru c k ma n u fa c tu ri n g pl ants of D ai ml er A G i n Bremen and Wörth. I t al s o monit or s and controls soaking pit plants of ThyssenKrupp Steel Europe AG in Duisburg. Due to its architecture, based on an agent-based software platform, it is already well positioned to migrate towards the arising technological tre nds dom ina te d b y I n te r n e t te ch n o l o g y. The ProVis production suite In its current version, the ProVis suite provides the following functions and classifies them according to their architectural position (see figure): • ProVis.Kernel: The kernel provides functions to convert several input/output formats and protocols (Integra, OPC, OPC-UA, MMS, etc.) and to send manufacturing information about the current and next shift to the relevant manufacturing equipment. It also contains a dedicated engineering tool. • ProVis.Agent®: This core component includes functions to monitor all production-relevant data in real time and to process and aggregate these data, for example to provide status information about production facilities and to generate shift-specific reports. All of these functions are driven by a flexible, configurable production time scheme. • ProVis.Visu®: This is the visualization component for all production-relevant data and all inferred information. Visualization can be configured either manually with a graphical editor or using templates and an automatic data import mechanism such as AutomationML. Contact: • ProVis.Paula: This component allows users to retrieve aggregated information through a highly- Dr.-Ing. Thomas Usländer configurable, modular Web-based analysis and reporting tool. It can be used, for example, Phone +49 721-6091-480 to efficiently calculate key performance indicators (KPIs) and to get a quick overview of current [email protected] and estimated shift-specific piece numbers and related disturbances in the production process. 32 Business Unit Automation 2 3 1 Control room of the press shop at Daimler AG, Bremen. Emerging Trends 2 ProVis Development Team Following current market trends and customer needs additional requirements shall be fulfilled of IOSB. by MES: 3 ProVis.APS in a multi-display • MES shall automatically support vertical integration to shop-floor level based on environment of IOSB. engineering principles, such as plug-and-produce. • MES shall integrate universal engineering tools based on standard data exchange formats, such as AutomationML. • MES shall be open and support horizontal integration of components and functions – possibly provided by multiple software vendors – through standardized interfaces. • MES shall support various communication interfaces according to international and enterprise-specific standards. • MES shall be scalable and enable decentralized self-organization of production systems. • Information produced by MES shall be provided to users in tailored form through role-specific interfaces, including mobile devices and innovative gesture-based interaction. • MES shall be connected to a Digital Factory Repository and shall rely upon its production plant information. • MES shall integrate energy monitoring and energy management functions that are, on one hand, dedicated to the production site itself and on the other linked to the energy manage- References: ProVis Production Suite: http://www.iosb.fraunhofer.de/ servlet/is/18359/ ment systems of energy suppliers inside or outside the enterprise to pave the way towards Industrial Smart Grids. • MES shall incorporate facility management services related to the production site building and infrastructure, for example to optimize the use of energy resources such as electricity, Industrie 4.0: http://www.iosb.fraunhofer.de/ servlet/is/24313/ heat or compressed air. • MES shall support simulation functions to allow its use as a production assistant. Internet of Things: • MES shall be enhanced with flexible resource scheduling functions as currently provided http://www.iosb.fraunhofer.de/ mainly by separate systems, such as ProVis.APS, the Advanced Planning and Scheduling servlet/is/29600/ Systems for Shop-Floor Production of Fraunhofer IOSB. However, all of these additional functions will be used and accepted by automation and production technicians only if industrial core requirements such as security, robustness, reliability and real-time capability are guaranteed. An in-depth look at these requirements and trends quickly reveal that a “ProVis 4.0” that takes on board trends and paradigms of “Industrie 4.0” will comprise an open, scalable, secure, and flexible development and engineering platform and that this platform shall provide MES core functions as standard services. Furthermore, it shall support and leverage multi-vendor production systems-ofsystems. Fraunhofer IOSB will perform this development work as an active partner in various standardization bodies (IEC, VDI, DIN). Literature [1]Frey, C.; Heizmann, M.; Jasperneite, J.; Niggemann, O.; Sauer, O.; Schleipen, M.; Usländer, T.; Voit, M. (Fraunhofer IOSB): IKT in der Fabrik der Zukunft - Beitrag der Industriellen Informations- und Kommunikationstechnik zu Industrie 4.0. atp edition 56(4), 2014 Business Unit Automation 33 F r a u n h o f e r App l i c a t i o n C e n t e r I n d u s t r i a l A u t o m at i o n www.iosb . frau n h o fer.d e / INA 1 Highly available communication Seamless Redundancy solutions for networked technical systems I n t he c our se o f th e fo u rth i n d u s tri a l re v ol uti on, produc ti on proc es s es are i nc reas i ngl y automat ed. This m e a ns t ha t m a ch i n e mo d u l e s a n d e v e n i ndi v i dual dev i c es are c onnec ted wi th eac h other and exchange d a t a c onst a nt ly . T h e a i m i s to d e v e l o p i ntel l i gent fac tori es , i n whi c h i nformati on about the cur rent p roc e ss, m a int e n a n c e i n te rva l s fo r i n d i v i d u al dev i c es , and produc t s tatus i s av ai l abl e at any gi v en t im e in a ddit ion t o t he u s u a l p ro ce s s co n tro l . I n s h ort: The fac tory i s to be c ompl etel y trans parent. Contact: 2 Fraunhofer Application Center Industrial Automation INA Dr.-Ing. Holger Flatt Due to the ever-increasing volume of data and network connectivity in technical systems the Phone +49 5261 94290-31 role of communication technology – which is responsible for smooth data transmission – has [email protected] grown. The main requirements for data transmission in automation technology networks 34 Business Unit Automation 3 consist of fast, reliable and time-synchronous communication. It is also important that no 1 The RedBox – a prototype by data is lost. Reliable cabling and topologies are essential. The most common solution is the Yacoub Automation and IOSB-INA. ring topology, in which data is transmitted through two separate, independent lines, so that 2 The RedBox can connect HSR- a transmission is guaranteed even if one line is damaged. In this type of ring topology, two and PRP-networks with each data packets normally arrive at the recipient. These packets must undergo a redundancy other. check, which deletes duplicates. Redundancy mechanisms must be provided by the network 3 Dual-board solution used as at all levels of the factory – from the field level to the control center – to ensure the required RedBox hardware platform. uninterrupted process operation. To provide a redundancy platform for highly available communication in Ethernet networks, Partners which use various different topologies, two redundancy protocols have been defined in Yacoub Automation GmbH standard IEC 62439-3: PRP (PRP: Parallel Redundancy Protocol), and HSR (High Availability Seamless Redundancy). Several vendors have already brought solutions to market that are based on PRP or HSR. Research projects are now facing the challenge of developing a solution that can be used for both protocols. In a BMWi-funded project with Berlin-based company Yacoub Automation GmbH, IOSB INA has tackled this challenge. The aim was to create a redundancy solution that can be switched between standard Ethernet devices to integrate them into PRP/HSR networks. According to the requirements, IOSB INA has developed a RedBox (redundancy box) that can be integrated in an HSR network as well as a PRP network, or can connect networks of both types with each other. With this solution users can use the RedBox flexibly according to their requirements. These protocols were implemented on an FPGA platform. The time-critical parts of the implementation have been realized completely in hardware. To avoid the usual costs for the implementation of a network component with the described functionality, a low-cost FPGA variant (Altera Cyclone IV) was combined with a high-performance switch ASIC (Marvell FireFox). These two components are linked through an MII interface and provide four ports for connecting end nodes. In measurements on sample configurations (PROFINET controllers and devices, Meinberg master clock, etc.) interoperability with other manufacturers’ RedBoxes and support for time synchronization standard IEEE 1588 could be identified. To further develop the solution and gain a market advantage, IOSB INA and Yacoub Automation GmbH have decided to initiate a follow-up project, the aim of which is to make the RedBox useable in hazardous areas. This adds several new requirements for the hardware: A RedBox for hazardous areas must be optimized to ensure a very high level of safety, which should be maintained even in the rare event of a malfuction. It must not ignite even if several technical faults occur in the device at the same time. Furthermore, its energy usage must be optimized to meet the stringent requirements for approval for use in hazardous areas. By complying with current safety standards for explosion-protected areas, the solution of IOSB INA can be used in many other industries and application scenarios. Literature [1] Flatt, H.; Jasperneite, J.; Rauchfuß, J.: Ein FPGA-Ansatz zur Anwendung von PRP/HSR-Redundanzprotokollen mit IEEE 1588 Zeitsynchronisation in der Automatisierungstechnik. In: Jahreskolloquium Kommunikation in der Automation - KommA, Magdeburg, Germany, Nov 2013 [2] Flatt, H.; Jasperneite, J.; Dennstedt, D.; Hung, T. D.: Mapping of PRP / HSR Redundancy Protocols onto a Configurable FPGA/CPU Based Architecture. In: IEEE International Conference on Embedded Computer Systems: Architectures, Modeling and Simulation (SAMOS XIII), S. 121-128, Samos, Greece, Jul 2013 [3] Rauchfuß, J.; Flatt, H.: Hochverfügbare Kommunikation in Automatisierungsnetzen - Realisierung einer stoßfreien Redundanz, SPS-Magazin, Sonderausgabe zur Hannover Messe, TeDo-Verlag GmbH, 2013, S. 104-105 Business Unit Automation 35 B u s i n e ss U n i t Energy, Water and Environment Spokesperson modeling, and systems analysis to knowledge-based process Prof. Dr.-Ing. habil. optimization with a wide range of methods and sophisticated Thomas Rauschenbach algorithms. An example for this is the energy market solution Phone +49 3677 461-124 EMS-EDM PROPHET® that supports utility companies and system operators with varied and complex tasks in a liberalized market environment. In the fields of water management as well as environmental information and early-warning systems our business unit offers customized ICT applications for the private and public sectors. The objective is to provide integrated solutions that are flexible and can also adapt to individual constraints, such as those of service oriented architectures (SOA) and standard interfaces of the “Internet of Things and Services”. Beside the close collaboration with industry, the business unit sees itself as a technology driver for future Deputy Spokesperson topics of intelligent energy systems and Integrated Water Dr.-Ing. Thomas Usländer Resources Management (IWRM) in numerous national and Phone +49 721 6091-480 international research projects. Markets The target groups of the business unit Energy, Water and Environment range from utility companies through communal water suppliers to governmental institutions, with a current focus on the German and European market. This business unit draws on international research projects and projects with industrial partners in Portugal, China, Mongolia and Turkey, as well as on European research projects in the fields of Mission and vision environmental risk management, early warning systems and environmental monitoring. In the medium term the impor- The nexus of sustainable and affordable energy, secure access tance of international markets for this business unit will grow. to clean drinking water and effective environmental protection Impulses are expected not only from Asia and the Middle East, must be better understood and managed through the provision but also from the USA, where a contract for the optimization of tools, models and methodologies to exchange and process of the hydropower plants at the Columbia River was acquired data. This is fundamental for the development of solutions from Bonneville Power Administration (BPA) in 2012. meeting the needs of future markets. Fraunhofer IOSB offers integrated ICT systems, consulting services, and development The market of innovative environmental information systems of prototypes to industrial clients and public authorities that is served by the product suite WaterFrame®, which is installed approach the problem from a holistic point of view. They in many German federal states (Länder) for communal and cover the whole spectrum from sensor systems, systems governmental use. WaterFrame® is being extended according 36 to customer needs to support standards of the Open Geospatial Consortium (OGC) compliant with the requirements • Thematic information system for the Integrated Rhine Program of European spatial data infrastructures (INSPIRE). It is complemented by WebGenesis® for knowledge- and Web-based References information systems. • ABB AG • AHK GmbH, Freiburg The business unit’s portfolio is complemented by its know-how • Beijing Water Authority in the field of maritime system technology, which is special- • Bonneville Power Administration (BPA) ized in the guidance of underwater vehicles for automated • BTC AG inspection of underwater infrastructures and for water quality • Disy Informationssysteme GmbH, Karlsruhe monitoring. • DONG Energy Germany • Ministries of the Environment and Federal State Agencies Laboratory and test facilities of Baden-Wuerttemberg (LUBW) / Rhineland-Palatinate / Thuringia (TLUG) / Bavaria (LfU) ICT Energy Lab: energy and energy data management, • natGAS AG virtual power plants, operational management of island and • Nanjing Hydraulic research Institute area networks • Spacebel, Belgium Intelligent energy systems research platform: micro grids, • Stadtwerke Bielefeld GmbH operational management strategies, storage management, • Stadtwerke Marburg GmbH automated metering, intelligent distribution networks, • SWE Energy GmbH & SWE grid GmbH electric mobility • TenneT TSO GmbH Maritime systems research platform: 250 m³ water volume, • The German Federal Institute of Hydrology (BfG) lorry access capability, energy and data interface, rail system for object placement Environment sensor network INSENSUM: air, ground and water monitoring, open interfaces as well as mobile applications according to the Sensor Web Enablement (SWE) initiative of the Open Geospatial Consortium (OGC) Product highlights • EMS-EDM PROPHET® – energy and energy data management • HydroDyn – network simulation solution for water and gas • WaterDemand – water supply forecasting • WebGenesis® / WaterFrame® – environmental information system for government agencies (environmental portal, specialized information offers, information systems for ground water, surface water and drinking water) 37 Energy www.iosb . frau n h o fer.d e / ? 1 4 5 9 3 1 INTELLIGENT DISTRIBUTION GRID & ENERGY STORAGE: SmartRegion Pellworm T he polic y obje c ti ve s o f th e e n e rg y tra n si ti on i n Germany are v ery ambi ti ous : thus , 80 perc ent of t he e le c t r ic it y powe r n e e d s b y 2 0 5 0 s h o u l d c ome from renewabl e energy s ourc es . The North Sea island P e llw or m a lre a d y re a ch e d th i s v a l u e a n d i s therefore a s ui tabl e pl ac e as a pi l ot regi on for a power syst em wit h e ne r gy st o ra g e s a n d a n e xtre me l y h i gh proporti on of di s tri buted power generati on from biom ass, p hot ov olt a ic s a n d wi n d . A l l th e s e co mp onents need a s ophi s ti c ated c ontrol and management syst em conne c t ing distri b u te d g e n e ra ti o n , e n e rg y s torages and a fl ex i bl e demand. I n addi ti on, c ros s -di sciplinar y topic s suc h a s h e a t g e n e ra ti o n ca n co n ti n u e to pl ay an i mportant rol e. Sponsored by: Goals The project “SmartRegion Pellworm”, sponsored by the BMU and BMWi, is one of the projects of the lighthouse “battery storage in distribution grids” of the funding initiative “energy storage” of the federal government and includes as a central element the building up and operation of such a smart grid. Hybrid storage is used to map the different fields of application of storage systems. In addition to two stationary storage facilities with different technologies (li-ion battery and redox-flow battery) there are also unidirectional storage systems, e.g. electric storage stoves, heat pumps, and the biogas plant on the island. Within the framework of this project comprehensive analysis of present and future business models of hybrid storage systems are performed for market, grid and local supply. The experience gained during realization and operation should feed into the analysis of transferability of the Pellworm approach to other distribution grids and the investigation of business models. Realization Contact: The task of Fraunhofer IOSB Advanced System Technology (AST) includes the question of the Advanced System Technology (AST) optimal operational management of hybrid storage systems for various use cases. Therefore Branch of Fraunhofer IOSB an extensive analysis of measurement data of the energy system is being conducted, and all Dipl.-Ing. Steffen Nicolai relevant electric and thermic components are being modelled and integrated in optimization Phone +49 3677 461-112 models of the particular operational management strategies. [email protected] 3 8 Business Unit Energy, Water and Environment 2 3 1 Redox-Flow-Battery (container left), power electronics (container center) and lithium-ion battery (container right). 2 Hybrid power plant. 3 Solar park. 4 Integrated energy management system in real market framework. Partners consortium manager 4 Gustav Klein GmbH Based on examined business models all objective functions of the relative operational manage- Fraunhofer UMSICHT ment will be created. Thereby, both financial and technical restrictions of the energy system Fachhochschule Westküste must be regarded, including data from customers and feed-in, current grid condition and also RWTH Aachen IFHT exogenous influences, such as meteorological data and different special conditions, such as Saft Batterien GmbH feed-in management. A special challenge is the combination of different, partly opposing Schleswig-Holstein Netz AG objective functions for operational management. Mapping of various chronological levels of operational management is possible because of a multi-stage optimization approach. Project execution Dipl.-Ing. Steffen Nicolai The core of the operational management solution is the energy management system EMS- Dipl.-Ing. (FH) Sebastian Flemming EDM PROPHET ®. Here the implementation of the operational management strategies in the form of optimization models takes place. During the startup phase the basic functions of the operational management solution are tested. These functions build the basis for the complex Literature operational management strategies in the demonstration phase. [1] Nicolai, S.; Koopmann, S.; Wasowicz, B.; Bretschneider, P.: “Hierarchical Management of a hybrid storage system - Project SmartRegion Pellworm” – IRES 2013, Berlin, November 2013 Evaluation Evaluation of various relevant parameters of the energy system, with and without being actively influenced by the different operational management strategies, provides an essential statement of functionality of the operational management strategy. Through different scenarios the operational management was evaluated using quality factors. The presentation of all proportionate influences of the requirements of the business models and the specifications of the grid management attracts special attention during the analysis. Another main focus of the analysis will be the detailed view on the behavior of the complete system in special situations. [2] Koopmann, S.; Pollok, T.; Wasowicz, B.; Nicolai, S.; Schnettler, A.: “Evaluation of business cases for a hybrid storage system in the SmartRegion Pellworm” – Kraftwerk Batterie RWTH Aachen, Februar 2013 Business Unit Energy, Water and Environment 39 W a t e r a n d M o b i l e S y s t e ms www.iosb . frau n h o fer.d e / ? 1 4 9 9 4 www.ha p p i s h p . c o m 1 Small Hydropower Plants: Assessment of Climate Protection Potential and Improvement through Smart Technologies C hina a im s t o re d u ce th e u s e o f fi re wo o d and other fuel s by drawi ng el ec tri c al power from s ma ll hydrop o w e r plants (SHP) to create a climate-friendly energy infrastructure. By 2014 over a thousand small hydropower plants will be installed in 24 provinces as to substitute fuel-powered plants (Small Hydropower Substituting Fuel – SHSF). Although this sounds a lot it is worth noting that, for example Bavaria alone has more than 3600 SHPs (smaller than 100 kW). In Austria there are more than 2800 SHPs, providing about nine percent of Austria’s electricity demand and supplying about 1.7 million households (more than 50 percent of Austrian households) with electricity. At over 90 percent the availability of these SHPs is fairly good. There is still a considerable potential for SHP development in the EU: Less than half of the potential – about 44 TWh/a – ha been tapped to date leaving more than 50 TWh/a that can be brought online in the future (1). The reduced use of fossil fuels resulting from the use of hydropower is offset by the latter’s impact on water ecology, channel flow, socio-economics, and aquatic ecosystems. These issues are given a low priority in China. Often these multi-objective problems influence each other. Sponsored by: Research objectives The German-Chinese research project HAPPI (Small Hydropower Plants: Assessment of Climate Protection Potential and Improvement by Smart Technologies) aims to develop an evaluation method for planning, construction, and operation of small hydropower plants, focusing on at least three main aspects: first, ecological effects, such as the protection of climate, nature Chinese project partner: and water, i.e. impacts on flora and fauna, landscape and watercourses, and land use; second, economical effects, such as cost-efficiency, network infrastructure and proximity to costumers, realization periods, and location and constructional optimization; and – last but not least – social effects, such as improved infrastructure, employment, influence on the development potential of rural settlement, poverty reduction and resettlement. Contact: Advanced System Technology (AST) Work packages Branch of Fraunhofer IOSB Together with six partners, three of which are small and medium-sized enterprises (SMEs), Prof. Dr. Thomas Rauschenbach Fraunhofer IOSB defined 15 working packages to achieve the following research objectives: Phone +49 3677 461-124 environmental sustainability analysis (1), climatic sustainability analysis (2), socio-economical thomas.rauschenbach@ iosb-ast.fraunhofer.de (1)Source: http://dev02.semaforce.eu/fileadmin/esha_files/documents/publications/2013/SHPRoadmap_FINAL_Public.pdf 4 0 Business Unit Energy, Water and Environment 2 3 sustainability analysis (3), hydrological modeling and CO2 balancing (4), hydraulic system and 1 Oldest small hydro power location optimization (5), geotechnology and structural hydraulic engineering (6), control and plant in China with German management strategies (7), energy management strategies (8), financing strategies and technology from the 1920s. operator models (9), monitoring system (10), integrated planning guide (11), automatic cascade 2 HAPPI model regions in China operation (12), ex post evaluation of the sustainability aspects (13), feasibility evaluation (14), (red and blue dots). and participation processes and capacity building (15). 3 Work packages. Perspectives In addition to tapping the ecological benefits and optimize the use of the unexploited energy Partners potential of hydropower – especially in China – HAPPI aims to achieve economic benefits through Advanced System Technology know-how-transfer, patents and the export of engineering services and facility delivery. Goals (AST) Branch of Fraunhofer IOSB, of the project are the development and application of new policies for small hydro power plants Fraunhofer Institute for Systems with a focus on socio-economic and ecological sustainability and taking into account climate and Innovation Research ISI, change and land use. Further aims include the development of advanced planning guidelines for University of Kassel, hydroelectric power plants (selected optimal power plant sites, civil engineering and hydraulic G.U.B. Ingenieur AG optimization, support with obtaining regulatory approval), a new application of control and Umwelt- und Ingenieurtechnik energy management strategies for small hydro power plants (individually and in coordination) Dresden GmbH, and the integration of small hydropower plants in regional and national power distribution grids. Ingenieurgesellschaft Processing the results will therefore focus on the following goals: Prof. Dr. Sieker mbH, • Employment of models for location evaluation and design of energy-optimized hydropower G.M.F. mbH - Gesellschaft für plants from a hydrologic, hydraulic, ecological and economic perspective Meß- und Filtertechnik mbH • Coordinated control of SHP and integration into the power grid • Application of dimensioning processes for an optimized structural design of hydroelectric installations in largely modular architecture Project execution Prof. Dr. Thomas Rauschenbach • Implementation of ecological design concepts at for dams, hydraulic conduits and the application of fish-friendly power plant technology on inland waterways Dr.-Ing. Divas Karimanzira Dr.-Ing. Peter Bretschneider • Training in the use of the developed quality management tools and assurance of health protection and occupational safety at the construction site • Consulting services for developing marketable company structures for the operation and cost-effectiveness of utility companies • Development and application of financing and operator models tailored to the legal and social circumstances in China. Project description Name: Small Hydropower Plants: Assessment of Climate Protection Potential and Improvement by Smart Technologies; Work packages: project management (consortium manager), controlling and management strategies, energy management strategies, automatic cascade operation Life span: 01.02.2013 – 31.01.2016; Tags: Small Hydropower Plants, China, automatic cascade operation, energy management strategies, multiple criteria optimization Literature [1]Karimanzira, D.; Rauschenbach, T.; Mu, H.: Management of cascaded reservoirs in the beijiang river basin: A pilot project. In Integrated Water Resources Management (IWRM) 2012, Karlsruhe, Germany, 2012 [2] Mu, H.; Rauschenbach, T.; Karimanzira, D.: Modeling and control of bi-directional water flow with application to the Taihu Lake basin. Global Perspective on Engineering Management, 2013 Business Unit Energy, Water and Environment 41 I n f o r m at i o n M a n a g e m e n t and Production Control 1 Examples for the forward and www.iosb . frau n h o fer.d e / ILT backward simulation of the propagation of tsunami waves. Top: simulation results for a hypothetical event in the eastern Mediterranean Bottom: retrospective simulation of the real Tohoku tsunami event on 11th March 2011. Both events are displayed on the globe and on a map. ©2011: GFZ. TRIDEC – Early Warning Systems Architecture Ts una m is w re a k h a vo c a n d ca u s e e n o rm o u s ec onomi c damage wi th a hi gh l os s of l i v es i n c oas tal regions. To be e ff e c t iv e a ts u n a mi e a rl y wa r n i n g s ys tem mus t be abl e to ac qui re and reac t to s ens or s i gna ls w it hin fe w m inut e s. E x i s ti n g wa r n i n g s y s te m s re qui re ex tens i v e s oftware engi neeri ng to i nc orporate new sensor s a nd da t a source s a s we l l a s mo d e l s to c o mpute the l i kel y propagati on of the ts unami . What issues are to be solved The integrated EU FP7 project TRIDEC focused on new approaches and technologies for intelligent geo-information management in collaborative, complex and critical decision processes in earth management. The key objective was to develop a software architecture for a tsunami early warning system to equip existing and future Tsunami Warning Centers around the Mediterranean Sea. The TRIDEC architecture had to facilitate the integration of new sensors and models, and to support real-time processing of data streams. The typical data sources not only include sensors on land and sea, but also unconventional sensors, such as streams of tweets with eyewitness accounts. The early warning systems have to integrate data sources from multiple nations of the Mediterranean region and be customizable for decision-makers with local or specific emergency plans and defined warning dissemination processes. At the same time scientists need to be able to improve the underlying rules, models and computations without relying on extensive help from IT experts. Description of the solution All components of the TRIDEC architecture were conceived, designed and implemented to be suited to integrate a multitude of heterogeneous services and software tools, data and information sources. From the domain experts’ point of view this means that they can leverage all relevant information in order to provide adequate and timely support to decision-makers. Description of methods and processes The main objective of TRIDEC presented a number of challenges, such as the task of examining, adopting and adapting a large number of state-of-the-art systems and components as well as Contact: contributing to a diversity of emerging innovative ICT technologies. Some challenges concerned Dipl.-Inform. Fernando Chaves the integration of existing warning systems (system-of-systems architecture) and the design Phone +49 721-6091-509 of a scalable and resilient communication infrastructure based on a message-oriented middle- fernando.chaves-salamanca@ ware (MOM). Another set of challenges was concerned with the management of large and iosb.fraunhofer.de dynamically increasing volumes of data and information as well as data fusion processes and 4 2 Business Unit Energy, Water and Environment 2 Innova Rig, an innovative drilling plant for scientific research, serving as a testbed for the TRIDEC Use case “Drilling”. 3 Early detection of critical events and the impact of the commence- ©2011: GFZ. ment time of counter actions on the crisis development. ©2011: TDE. the management of metadata on different semantic levels. Further effort went into the design Project execution and implementation of Decision Support Services, including an ontology based on the SSN Dipl.-Inform. Ulrich Bügel Ontology of OGC and W3C, federated Semantic Registries for registering (over MOM) meta- Dr.-Ing. Siegbert Kunz data about crisis-relevant objects, a workflow and rule engine, a rule editor for Decision Tables, Dipl.-Inform. Jürgen Moßgraber and a number of standards-based interfaces for connecting all these different components. Dipl.-Inform. Felix Riedel Dipl.-Inform. Manfred Schenk Further IOSB projects on Early Warning Systems Dr. Kym Watson EO2HEAVEN (Earth Observation and ENVironmental modeling for the mitigation of HEAlth risks) Dr. Andrea Zielinski was co-funded by the European Commission under FP7, Grant Agreement 244100. IOSB led the work on the architecture of a Spatial Information Infrastructure, which formed the basis for warning systems in the area of environmental impact on health. Case studies investigated the effects of air pollution in Saxony and Durban and the risk of cholera outbreaks in Uganda. See www.eo2heaven.org. Literature INCA (Integrated Nowcasting through Comprehensive Analysis) was co-funded by the European Commission with the InterReg IVb Programm. IOSB developed an early landslide detection and warning system (ELDEWAS) that incorporates dynamic nowcasting data and merges them with static geological data for certain regions (for Burgenland in Austria for instance) in order to gain short-term predictions for the danger of landslide events. See [2]Moßgraber, J. et al: The Seven Main Challenges of an Early Warning System Architecture; ISCRAM 2013, Baden-Baden www.iosb.fraunhofer.de/?40945 Figures and technical data TRIDEC (Collaborative, Complex and Critical Decision-Support in Evolving Crises) Coordinator: Geoforschungszentrum Potsdam Duration: 9/2010-10/2013 Budget: ≈ 8.9 million € Principal/partner TRIDEC was co-funded by the European Commission under FP7 (Seventh Framework Programme), Grant Agreement 258723 [1] Wächter, J. et.al: TRIDEC Systemof-Systems, Choreography of largescale concurrent tasks in Natural Crisis Management; ISADS 2013, Mexico City [3]Chaves, F. et al: Semantic Registries for Heterogeneous Sensor Networks – Bridging the semantic gap for collaborative crisis management; WebS 2013, Prague, Czech Republic [4]Riedel, F. et al: Workflows and Decision Tables for Flexible Early Warning Systems; ISCRAM 2012, Vancouver, Canada [5]Zielinski, A. et al: Social Media Text Mining and Network Analysis for Decision Support in Natural Crisis Management; ISCRAM 2013, Baden-Baden Business Unit Energy, Water and Environment 43 B u s i n e ss U n i t Automated Visual Inspection Spokesperson Prof. Dr.-Ing. Thomas Längle Phone +49 721 6091-212 assurance and / or increasing productivity in real time that come into play when “seeing” is the solution of choice. “Seeing” in this context refers not only to what the human eye is capable of, but also includes the entire electromagnetic spectrum from UV to IR as encountered in the natural and technical world. The technical solutions offered cover a broad service portfolio, ranging from feasibility studies to process developments, practical validation up to and including demonBusiness Unit Development strators and productive systems that can be used at the Dipl.-Ing., Dipl.-Wirt. Ing. customer’s site. Henning Schulte Phone +49 721 6091-275 Markets “Seeing” relevant information forms the basis for our solutions. In a technical respect, this generally comprises image acquisition using line scan or area array cameras and image analysis in real time. Whether the task is to rapidly monitor a large number of moving parts while sorting bulk goods (in order to separate desirable parts from undesirable ones), detect changes in the reflective properties or the texture of a surface (which are indicative of product defects or process Mission and vision defects) or classify objects or object groups (to detect divergences from specifications), we are able to offer tailored Replacing the five human senses with a wide range of technical solutions to our partners and customers. sensors is something we do on a daily basis. This is especially true when it comes to acquiring more accurate information or Whenever the task is to “sort” large quantities of parts doing so faster than humanly possible; or if we want to use (e.g. bulk goods) in the material flow and in real time or a technical device to replace or assist a person performing a verifying the compliance of complex individual parts with given task. specifications – whether in terms of color, shape or other “visible” properties – our solutions are put into practice. The In the Inspection and Visual Inspection business unit, Fraunhofer solutions we develop are used in recycling glass or enriching IOSB gathers all activities in the field of sensor technology, minerals to the same extent that they are used in sorting tea, image analysis and signal processing for the purpose of quality coffee and other foods. 44 In the field of surface inspection, we not only detect changes References / product highlights in the structure, but also convert sensor data using photometric stereo or deflectometry into 3D data in order to reach conclusions relating to part topography. These methods are used to evaluate both glossy and mat surfaces. Sometimes “taking a look inside parts” or simply “seeing through them” • Binder+Co AG: Systems for sorting recycling glass; recognizes heat-resistant glass containing lead • SALUS Haus GmbH & Co. KG: Systems for sorting tea and herbs; color, size and debris sorting is helpful when it comes to recognizing constituents or diver- • PETKUS Technologie GmbH: Sorting of seed gences. If light can be used to make them visible or the mate- • Uhlmann GmbH: Blister inspection rials being searched for have specific reflective properties, we • GREIWING logistics for you GmbH: Sorting system for find them. We also offer solutions for special problems such as “seeing” vibrations from far away, “seeing” in an adverse environment (e.g. in deep-sea environments) or recognizing objects for identification purposes. plastic granulates • Zwiesel Kristallglas AG: Inspection of glass lenses for occlusions and air bubbles • Eti Maden General Directorate: System for sorting materials (colemanite) Equipment, lab and test facilities • De Beers UK Limited: Systems for finding diamonds • Sliding tables with a variety of lighting facilities for image acquisition • Experimental systems for sorting bulk goods (each equipped with a camera and blow-out unit) in various configurations as a belt sorter, channel sorter, sorter with chute and freefall sorting • Measurement stations for inspecting surfaces, e.g. photometric stereo or deflectometry • Measuring devices for 3D inspection • Test systems for transparent materials • Multispectral workbench • Lab equipment for characterizing materials • Microscopic image acquisition stations • Test lab with lighting technology • Fully-automatic BRDF measuring station • Experimental systems for underwater inspection 45 S y s t e ms f o r M e a s u r e m e n t , Control and Diagnosis www.iosb . frau n h o fer.d e / M R D 1 MicroLab M ic rosc opic ins p e cti o n s ys te m s a re g e tti ng more and more i mportant i n as s uri ng qual i ty of i nd ust r ially p roduc e d good s . W i th i ts n e wl y b u i l t u p mi c ros c opy l aboratory (M i c roL ab) F raunhofer I O SB i s t aking a n e w a pproa c h. Va ri o u s m i c ro s co p e s a re c ombi ned wi th s tandard automati on c omponents , s uc h as robot s, p osit ioning st a g e s a n d i l l u m i n a ti o n c o mp onents , to real i z e automati c i ndus tri al i ns pec ti on. M i croLab is e quippe d w it h ve rs a ti l e o p ti ca l mi cro s co p es whi c h prov i de a wi de range of s ens ors for c ombi ne d usage. C ur re nt ly Mic ro L a b c o n ta i n s a m a c ro s co pi c dev i c e wi th different i l l umi nati on c omponents , a research m ic rosc ope w it h U V i l l u mi n a ti o n , a wh i t e-l i ght i nterferometer and a 3D rec ons truc ti ng autofocussing s y st e m , w hic h a l s o ca n b e u s e d fo r ro u g h nes s meas urements . Automation The key role in automation in MicroLab is played by a six-axis industrial robot. The robot, which is connected to a central control unit that interacts with additional sensors, places various specimen onto the microscopic devices in an exactly defined position. The inspection system therefore exactly knows about the overall condition of a currently running inspection process. It can intelligently influence this running process to optimize throughput, for example using all inspection devices in parallel. It can also prioritize specific specimen, giving it a decisive advantage over industrial assembly lines, which can handle goods only sequentially. General applications MicroLab deliberately uses standard industrial automation components. These can be combined at will to realize customer-driven inspection systems for visual inspection and quality assurance analysis. The different sensor components with their diverse properties can be used to examine the properties of a large number of different specimens, such as completeness of electronic components or roughness of iron, steel or other industrially produced materials. The combination of multiple microscopes brings inspection tasks to a new level, allowing specimens to be inspected by multiple sensors with a range of characteristics within one automation process. The gathered information can then be used as input for multi-sensor fusion. To provide a clearer idea of microscopic dimensions, figure 2 illustrates these using a real-life example. Inspection of a technical sample can be seen in figure 3. The microscopic devices are further used to acquire ground truth information. This is extremely Contact: important when constructing new sensor components in order to back up the measurement M.Sc. Peter Frühberger results. Another reason our customers like the MicroLab concept is its modular construction. It Phone +49 721 6091-314 is quite easy to integrate components of MicroLab into existing quality assurance systems. The [email protected] long-term knowledge of IOSB in the field of image processing is of high value in the context of 4 6 Business Unit Automated Visual Inspection 2 3 MicroLab. Established methods of image processing, ranging from image fusion to photometric 1 MicroLab in action. stereo, are transferred to the microscopic dimensions. The integration of such established 2 3D surface profile of a methods is the basis of providing modular microscopic inspection systems for industrial 2 Euro coin. purposes. 3 Measurement of a metallic surface. MicroLab in research and education 4 Graphical user interface (GUI) MicroLab, with its multiple sensors, delivers great possibilities for research and education. Over for visual interaction. the past year several research projects were conducted with the help of MicroLab equipment. 5 Installation: Microscope next One highlight was the implementation of a novel approach for instrumenting a microscope to eye tracker and running with gaze-based interaction. software. Finding important regions and focal planes within a microscopic process can be seen as a 6 Image Fusion Process – an visual search task. Our research combined advanced image processing algorithms – highly image series and a depth map encapsulated and easy to use – with a state-of-the-art human-machine interface to realize the are used as input for generating operators’ tasks, such as focusing, image analysis, and synthetic image enhancement driven a synthetic image that is in focus by gaze-based interaction. Figures 4 and 5 show the installation together with the developed everywhere. graphical user interface. As the depth of field becomes quite small at higher levels of magnification it is important to compute a synthetically enhanced image that has all visually selected focal planes in focus at Project execution once. To achieve this, the software creates a depth map in the background which, together M. Sc. Peter Frühberger, with the recorded image series, provides the input for the image fusion algorithm. Figure 6 Dr.-Ing. Stefan Werling, gives an overview of the overall fusion Dr.-Ing. Michael Heizmann Outlook and future Although conceived only recently, MicroLab has already established itself as a contact point for a wide range of applications. Within the last year it was used to measure a variety of technical surfaces, such as CMOS sensors. It was also used to gain detailed reflectance information to better understand properties of industrial materials and to reconstruct bidirectional reflectance distribution functions (BRDF). Furthermore, the automation component has been integrated into the overall system, and methods of interaction with microscope devices have been developed and implemented. MicroLab will be presented at CeBIT 2014. 4 5 Business Unit Automated Visual Inspection 6 47 V i s u a l I n sp e c t i o n S y s t e ms www.iosb . frau n h o fer.d e / S P R GrapeSort – Optical sorting of grapes to improve quality and the removal of foreign objects D r ink ing a nd e n j o y i n g a g l a s s o f wi n e i s u s ual l y taken for granted. F or a wi nemaker, i t i s by no m eans a m a t t e r of c our s e to p ro d u c e q u a l i ty wi n e, c ons i deri ng c l i mate c hange and the v ari abi l i ty of w eat her. R e c e nt ly , diff e re n c e s i n g ra p e ri p e n e s s o f up to 40 degree O ec hs l e (°O e) hav e been rec orded on a single g r a pe v ine . T hi s p re s e n ts a c h a l l e n g e : G ra pe harv es ti ng i s bec omi ng i nc reas i ngl y automated, and a lt hough i m prov e d c ont i n u o u s l y , th e m a c h i n e s u s e d c annot as s es s grape qual i ty i n the way that a human har vest er ca n. S e le c t ion o f ma ch i n e -h a rve s te d g ra pes by thei r degree of ri penes s has therefore bec ome a n issue, toge t he r w it h th e s e p a ra ti o n o f fo re i g n o bj ec ts , whi c h hav e a negati v e i nfl uenc e on the wi ne’s f lavor. Task Grape sorting machines from a handful of companies have already been on the market for a few years. These are able to remove foreign objects, such as leaves, stems, and bugs. Some are also able to detect botrytis – a mold that affects both white and red grapes. These machines have not established themselves in the wine community because their sorting quality, software and hardware operation, and cleaning procedures do not meet wine makers’ requirements. Due to these drawbacks we applied for a ZIM (The Central Innovation Program – Zentrales Innovationsprogramm Mittelstand) research project of the BMWI (Federal Ministry of Economics and Technology – Bundesministerium für Wirtschaft und Technologie). IOSB’s tasks in the research project are: --Analyzing grapes using hyperspectral imaging in the wave band of 400 to 2500 nm --Implementing results of the analysis in the sorting machine --Sorting grapes by different ripeness parameters, such as degree Oechsle, acidity, and nitrogen content --Removal of foreign objects, such as bugs, stems, wire fragments, leaves, and wood --User-friendly graphical user interface IOSB’s project partners focus on: --Definition of sorting criteria and preparation of grapes for sorting tests --Laboratory analysis of the grapes Contact: --Wine-making from the sorted grapes, and wine tasting Dr. rer. nat. Kai-Uwe Vieth --Improvement of air-based sorting unit, and reduction of air consumption Phone +49 721 6091-279 --Improvement of material transport [email protected] --Hygienic design 4 8 Business Unit Automated Visual Inspection 1 2 1 Valve block equipped with 112 nozzles to separate different qualities. 2 Experimental sorter equipped with a camera box, a light- Description of project status quo ing unit, a conveyor belt and Grapes of types Pinot Noir, Pinot Blanc, and Riesling have been used during the harvest season a valve block. of 2012 to acquire short-wave infrared (SWIR) hyperspectral image data and red-green-blue (RGB) images. Hyperspectral image data yield a full spectrum within the SWIR band for each pixel, i.e. from 1000 to 2500 nm. Following preprocessing the data was analyzed using multi- Partners variate data analysis. The aim was to correlate the hyperspectral data with the laboratory data The application for the ZIM provided by the project’s wine experts, Hochschule Geisenheim. Based on the analysis, charac- research project was submitted teristics were selected for use in classification. To achieve good classification results during the in cooperation with Hochschule 2013 harvest season, the software was adapted and the sensor hardware was matched to the Geisenheim University and two task. The resulting hardware consisted of two line scan cameras that were used in parallel: one industrial partners: ARMBRUSTER sensitive in the visible range, the other in the infrared range. The latter was equipped with a Kelterei-Technologie GmbH and special filter. In addition the incident light was extended into the visible range to correspond Ingenieurbüro Waidelich. with the measured wave band. Project execution In preparation for the experiments in October 2013, the software was extended with a function Dr. rer. nat. Kai-Uwe Vieth, for recording sorting results and to offer several possibilities of teaching it the different grape Dipl.-Inform. Christian Negara, qualities, especially using only the visible spectral range or a mixture of visible and infrared Dipl.-Inform. Bettina Otten, spectrum. Dipl.-Ing. Erich Enderle, Petra Riegel, Matthias Schwartz In October 2013 many experiments on both red and white grapes to detect foreign objects, mold, and ripeness degree were performed with the adapted sorter prototype at Hochschule Geisenheim University (see Figure 2). In addition, a large corpus of hyperspectral data in the range from 400 to 2500 nm was acquired for further analysis with the aim of improving the sorting system that will be used in the next harvest season in 2014. Intermediate results We achieved very good results in the removal of foreign objects and botrytis-afflicted grapes, both red and white. Regarding quality parameters such as degree of ripeness a classification was possible but the degree of discrimination has yet to be improved. Funding This project was financed by The Central Innovation Program (Zentrales Innovationsprogramm Mittelstand) research project of the Federal Ministry of Economics and Technology (Bundesministerium für Wirtschaft und Technologie). Literature [1]Lafontaine, M.; Freund, M.; Vieth, K.-U.; Negara, C.: Automatic fruit sorting by non-destructive determination of quality parameters using visible/near infrared to improve wine quality: I. Red wine production. NIR news 24(8), pp. 6-8, 2013 [2]Negara, C.; Vieth, K.-U.; Lafontaine, M.; Freund, M.: Automatic fruit sorting by non-destructive determination of quality parameters using visible/near infrared to improve wine quality: II. Regression Analysis. NIR news 25(1), pp. 4-6, 2014 Business Unit Automated Visual Inspection 49 V i s u a l I n sp e c t i o n S y s t e ms www.iosb . frau n h o fer.d e / S P R 1 CCT Sensor – Towards high-speed 3D sensing M ic rosc opic 3D s e n s i n g i s a n e s ta b l i s h e d tool i n qual i ty c ontrol . H owev er, there i s s ti l l a l ac k of inlineca pa ble m e a su ri n g d e v i ce s . D u e to s p e e d l i mi tati ons mos t of the av ai l abl e 3D s ens ors are for l a bor at or y u se only . One typ e o f 3 D s e n s o r, wh i ch us es the c hromati c c onfoc al pri nc i pl e, i s al ready av ailable as h igh- spe e d v e r s i o n wi th m o re th a n 5 0 ,0 0 0 meas urements per s ec ond. H owev er, i t i s a poi nt s ensor w hich re quire s a 2D s ca n to co v e r a n o b j e c t s urfac e. The s tep from poi nt to l i ne s c an s ens or i s technically cha lle nging, e s p e ci a l l y if th e me a s u re me n t s peed s houl d remai n the s ame. W i thi n thi s proj ec t a m ult is pe c t r a l c a m e r a a p p ro a ch wa s d e ve l o p e d , whi c h has the potenti al of enabl i ng c utti ng-edge m easur ing s pe e ds. T hus, t h e ch ro m a ti c c o n fo c a l tri a ngul ati on (C C T) s ens or i s wel l s ui ted for i nl i ne appl i c at ions. Task The technical problem in a nutshell: The chromatic confocal principle for 3D measurements encodes different surface heights by unique wavelengths. The optics of chromatic sensors split up a white light source into its monochromatic wavelengths. Additionally, each wavelength is focused at a different distance from the sensor. If an object surface is located within the measurement range, a single wavelength is focused while the others are out of focus. The measurement itself is carried out by spectral analysis of the reflected light using a spectrometer. The reflected light spectrum shows a characteristic peak at the wavelength that is currently focused. Due to the confocal optics, wavelengths which are out of focus are blocked. The 3D information is obtained by mapping the peak wavelength to the corresponding height value. A technical problem arises by changing over from a point sensor to a line scan sensor. Each measuring spot requires its own spectrometer and this causes a huge gain in data traffic. Typically, a spectrometer necessary for a point sensor consists of 1000 pixels. A line scan sensor with 2000 measurement spots causes data traffic of two million pixels per measurement (2000 pixel per spot times 1000 pixel per spectrometer). This amount of data causes a bottleneck and significantly slows down the measurement speed. The way to enable high-speed measurements is to avoid high data traffic. Results At the Fraunhofer IOSB a solution has been developed by replacing the spectrometer with a Contact: multispectral camera. Compared with an ordinary RGB color camera, a multispectral camera Dipl.-Ing. Miro Taphanel consisting of more than three spectral channels equipped with customized filters. The task Phone +49 721 6091-389 of the spectrometer within the chromatic sensor principle is to measure the wavelength of [email protected] monochromatic light. The developed multispectral camera uses six optimized interference 5 0 Business Unit Automated Visual Inspection 2 3 1 Example measurement with stitching artefacts utilizing the multispectral camera approach. filters for this task. At the CONTROL 2013 fair an implementation of the camera with a filter 2 CCT optics without filter wheel was demonstrated. With six filters the number of pixels per measurement drops from wheel. two million down to twelve thousand, using the same numbers as in the previous example. 3 Characteristic rainbow colors on the object surface. The purpose of this multispectral camera is to speed up chromatic confocal line scan sensors. 4 Lens design with improved A new optical sensor design was developed, which is optimized for 3D line scan sensing. measurement performance. This chromatic confocal triangulation (CCT) sensor, in combination with the developed multispectral camera shows promising results. With this concept microscopic high-speed 3D sensing becomes feasible. Project execution Dipl.-Ing. Miro Taphanel, Project description Prof. Dr.-Ing. Thomas Längle To realize a multispectral camera with custom transmission characteristics the technology of interference filters was used. The spectral transmission characteristic of interference filters can be controlled by adjusting layer thicknesses. Each filter consists of a stack of thin films with alternating high and low refractive index. Based on a physical model of the 3D measurement system the filters of the multispectral camera were optimized by finding the best-suited thin film filter stacks. In cooperation with the Fraunhofer Institute for Surface Engineering and Thin Films IST the filters were manufactured and mounted on a filter wheel. Additionally, CCT sensor optics were set up to proof the concept for 3D sensing. Current research focuses on shrinking the filters to pixel size to avoid the slow filter wheel. With these competences the Fraunhofer IOSB will have the ability to set up a 3D sensor with cutting-edge measurement speed. According to the state of the art in camera technology a microscopic 3D sensor with more than 50,000 measurement lines per second becomes feasible. Typically, a measurement line consists of 2000 adjacent measurement spots. Literature [1] Taphanel, M.; Hovestreydt, B.; Beyerer, J. “Speed-up chromatic sensors by optimized optical filters”, Proc. SPIE Vol 8788. pp. 87880S87880S-10 (2013) 4 [2] Taphanel, M.; Beyerer, J. “Fast 3D in-line sensor for specular and diffuse surfaces combining the chromatic confocal and triangulation principle”, Instrumentation and Measurement Technology Conference, pp. 1072 -1077 (2012) Business Unit Automated Visual Inspection 51 S i g n at o r i c s www.iosb . frau n h o fer.d e / S IG 1 Directional reflectance measurements with a robot-based goniometer Optical reflections on surfaces are of great interest for a wide range of applications. There are many technical and scientific examples of the use of reflections. Automated imaging-based inspection and machine vision sy st e m s ca n fi n d d e fe c ts o r c o n s pi c uous features , for ex ampl e by detec ti ng c hange o f opt ical re f le c t a nc e c omp a re d to fa u l t-fre e wo rk p iec es . Bec aus e the human ey e i s v ery s ens i ti v e, s l i ght c h anges in re f le c t ion f rom o p ti ca l p a i n ts a n d co a ti ngs are readi l y s potted by c us tomers . Remote s ens i n g needs d e t a ile d k now l e d g e o f th e re fl e cta n ce o f n atural materi al s for a meani ngful ex ami nati on of hy pe r spect r al s a t e llit e da t a . Fu rth e rm o re , c o mp u te r s c i enc e us es s urfac e refl ec tanc e model s to des i gn realist ic 3 D sc e ne s. T he m a gnit ude o f o p ti ca l re fl e cti o n fro m s urfac es of opaque and trans parent obj ec ts i s i nfl uenc ed by t he s u r f a c e m a t e r i a l ’s o p t i c a l p r o p e r t i e s a n d a c t u a l g e o m e t r i c a l s t r u c t u r e ( r o u g h n e s s a n d g r a n u l a r i t y ) . A b s o l u t e l y f la t s u rfa ce s re fl e ct l i g h t d i re cti onal l y , l i ke a mi rror, whereas mat s urfac es s c atter l i gh t int o all d ire c t ions. Re a l s u rfa c e s re fl e ct th e i n c i d e nt l i ght more or l es s around the i deal refl ec ti on di rec tion. The for m of t his re fl e c ti o n l o b e d e p e n d s to a large ex tent on the l i ght’s i nc i dent angl e, but al s o – be cause of d ispe r sion – on i ts wa ve l e n g th . Task Reflections on surfaces are characterized with the help of the Bidirectional Reflectance Distribution Function (BRDF), which describes the amount of reflected light in each direction as a function of the incident angle and wavelength of the light. The measurement of the BRDF characteristics with high spatial and spectral resolution presents a major challenge. This task is best performed with an automated setup to achieve the necessary precision and reproducibility. Some national institutes of metrology, such as the Physikalisch-Technischen Bundesanstalt (PTB) in Brunswick have constructed such a setup and use it for highly accurate BRDF measurements of reference standards. Other setups are available in other institutions (e.g. ONERA, Toulouse) or can be bought from commercial companies (e.g. surface optics, USA). All setups are optimized for special purposes and have some limitations in certain cases, i.e. in their spectral Contact: range, measurement spot diameter or sample type. Commissioned by the Wehrtechnische Dr.-Ing. Dipl.-Phys. Dienststelle 52 and with financial support from the German MOD a robot-based BRDF Alexander Schwarz goniometer was developed and built at the IOSB to perform measurements in the visible and Phone +49 7243 992-103 infrared spectral range. The lighting unit was designed such as to be able to also measure the [email protected] retro reflex signal from the sample. 5 2 Business Unit Automated Visual Inspection 2 3 Optical setup 1 BRDF goniometer with robot, turntable and sample. With the goniometer at the IOSB the BRDF of samples can be measured automatically. The 2 Spatial reflectance distribu- setup consists of two main parts: an industrial robot from KUKA, mounted headfirst on a tion of a sample. framework and a height-adjustable turntable directly under the hanging robot. A movable 3 Roof of a car. mechanical semi-circular guide rail integrated in the table carries the lighting unit. The angle of the semi-circular guide rail is controlled by the robot to obtain the required incident angles between 0° and 90°. Project execution Dipl.-Ing. (FH) Michael Kremer, The sample is fixed on the turntable, which is also controlled by the robot. All incident azimuth Dipl.-Inform. Dipl.-Ing. (BA) angles can be realized by turning the table, on which samples of different sizes and thicknesses Martina Richter, can be mounted. Because the sample is in a horizontal position, bulk solids and liquids can also Dr.-Ing. Dipl.-Phys. be measured. Alexander Schwarz At the end of the robot arm an optical sensor (e.g. a photo diode or camera) is mounted to detect the reflected light. During the measurement the robot moves the sensor around the sample along a hemispherical plane such that the sensor traverses all required reflection angles. At each measurement position the robot stops and reflection data are collected. Because the correct mechanical adjustment of all components is indispensable to guarantee accurate measurement values, the robot was calibrated absolute mechanically to reach a repeat positional accuracy of 0.1 mm. The complete measurement procedure is controlled by two PCs. One of these controls the movements of the robot, the turntable and the semi-circular guide rail; the other controls the lighting unit and the sensor and handles the measurement data. All angles, changes and adaptations of the measurement procedure can be realized easily with parameterized software. The illuminating light source is a thermal emitter (e.g. a halogen lamp). Alternatively, lasers with different wavelengths can be used. Calibration is done with the help of reference standards such as a Spectralon plate. Results With this goniometer setup BRDF measurements in the visible and near-infra-red (NIR) spectral range have been successfully performed. The reflectance distribution of highly reflecting, glossy and mat samples has been measured and characterized precisely. To visualize the optical material properties measurement results can be presented in different ways: BRDF and reflection lobe in 2D or 3D. Business Unit Automated Visual Inspection 53 Research Group V a r i a b l e Im a g e A c q u i s i t i o n a n d P r o c e ss i n g w ww.ios b . frau n h o fer.d e / V B V 1 Thermal Infrared Deflectometry New insights into specular surfaces D e f le c t om e t r y i s a re l i a b l e m e th o d o f c o ntac t-free, opti c al meas urement of a s urfac e s hape. I t provides h ighly a c c ur a t e s u rfa c e s l o p e i n fo rma ti o n , whi c h i s the meas urement parameter that mos t c l os ely resem b le s t he hum a n p e rc e p ti o n o f s p e cu l a r s u rfac es and, as s uc h, enabl es an obj ec ti v e ev al uati on. A simple deflectometric sensor can be assembled with off-the-shelf components. It consists of a monitor, which displays a series of code patterns, and a camera that observes the reflection of these patterns in the test surface. The visible distortion of these patterns characterizes the shape of the surface. As a consequence of this working principle, the conventional deflectometry is limited to specular surfaces such as mirrors, polished surfaces, or glossy coatings, which exhibit a reflection primarily in the visible light spectrum. One way to partially overcome this restriction is to use longer wavelengths, since the optical properties of materials are usually wavelength-dependent. The long-wave infrared (LWIR) spectrum in particular has beneficial properties for deflectometry, notably a higher reflectivity of most surfaces. This effect is especially pronounced with metals and enables the deflectometric inspection of raw metal or machined metal parts. In visible light unpolished metals usually exhibit a dull reflection, which blurs the image, whereas in the LWIR spectrum they display near mirror-like reflectivity. Other materials that benefit from the change of spectrum are transparent materials such as glass or several plastics [2]. In the visible spectrum interference effects, such as multiple inner reflections or a visible background behind the translucent object, prohibit an undisturbed deflectometric measurement. In the LWIR spectrum, however, many of these materials appear opaque so that the predominant primary reflection allows for a deflectometric measurement of the surface. While cameras for this spectrum are readily available, the suitable technology for creating the necessary code patterns is not. Contact: Dipl.-Inform. Sebastian Höfer Phone +49 721 608 45915 [email protected] 5 4 Business Unit Automated Visual Inspection 2 3 1 Laboratory setup for infrareddeflectometry: A laser generates thermal patterns on a projection surface, while a thermal camera observes the reflection of the patterns. 2 , 3 Result after decoding a deflectometric measurement. The Variable Image Acquisition and Processing (VBV) Research Group of the Fraunhofer IOSB in cooperation with the Vision and Fusion Lab (IES) at the Karlsruhe Institute for Technology (KIT) is developing such methods of pattern generation that are necessary for deflectometry in the LWIR spectrum. The developed methods range from static patterns and arrays of thermal elements to spatial and temporal variable patterns generated with laser light [1]. The novel pattern-generation techniques necessitate the adaptation of the coding methods from the visible to the thermal infrared spectrum. Promising results have been achieved by using a powerful laser to generate large-scale, dynamic patterns. The laser creates heat patterns on a projection surface, which then serves as the pattern display for the deflectometric code sequence (Fig. 1). This setup allows for the deflectometric inspection of raw metal surfaces, which are difficult to handle with optical inspection methods in the visible light [3]. Current research focuses on the use of static patterns, which represent a simple way of code pattern generation but require a more sophisticated evaluation of the data. In addition, an adaptation of the methods and algorithms for the evaluation and 3D reconstruction of deflectometric data developed at the Fraunhofer IOSB for the LWIR spectrum is required. With a complete processing chain for the acquisition and evaluation of deflectometric data in the thermal infrared spectrum, the deflectometry can be extended to a whole range of new surface materials. Its ability of inspecting raw metal surfaces enables its application in earlier stages of a manufacturing process and can save costs due to an earlier detection of defects before further processing. Literature [1] Beyerer, J.; Heizmann, M.; Werling, S.: “Konzept zur Erzeugung eines räumlich und / oder zeitlich veränderbaren thermischen Strahlungsmusters”, European Patent EP 10191409.1 , 11 (2009) [2]Höfer, S.; Roschani, M.; Werling, S.; Beyerer, J.: “Verfahren und Vorrichtung zur Inspektion von Glasoberflächen”, XXV. Messtechnisches Symposium des Arbeitskreises der Hochschullehrer für Messtechnik e.V., S. 127-138 (2011) [3] Höfer, S.; Werling, S.; Beyerer, J.: “Thermal pattern generation for infrared deflectometry.” Proceedings SENSOR 2013: 785-790 (2013) Business Unit Automated Visual Inspection 55 B u s i n e ss U n i t Defense Spokesperson Content Dr. rer. nat. Michael Arens Phone +49 7243 992-147 The IOSB’s core competency lies in research into optronic systems for human and computer vision, real-time processing and analysis of imagery, and full-motion video as well as the necessary information and communication technology for the use of images in network-enabled operations. Of special significance for the German armed forces is our research and technology work in the following areas: • Design, evaluation and protection of existing and future optical and optronic sensor systems: daylight and night vision, hyperspectral sensing, laser-based sensors and protection against laser threats. Coordinator • Warning sensors, propagation of light through the Dr. rer. nat. Jürgen Geisler atmosphere, signatorics for reconnaissance and protection, Phone +49 721 6091-262 concepts for and evaluation of camouflage, concealment or +49 7243 992-109 and deception. • Network-enabled interoperable real-time processing and analysis of imagery for purposes ranging from wide-area imaging reconnaissance to target detection in weapon platforms, including human-system-integration. • Computer assisted object and situation recognition and image-based methods for object tracking and target handoff. • System architectures for networked simulation and generation of terrain and building models for simulator-based Mission training. For the benefit of Germany’s defence as part of Europe and The research and technology activity of business unit Defence NATO the Fraunhofer IOSB supports the German ministry is carried out in three tiers: of defence and its subordinate authorities as well as the • To support the ability of the German ministry of defence defence industry with applied research and technology on (GMOD) and its subordinate authorities for analysis and the areas of imaging with optronic systems, image and signal evaluation of defence-related technologies the IOSB analysis, and architectures for simulation and information conducts basic research that is funded by the GMOD in systems. Rapid transfer of our research results in order to the long term. enhance the ability of the armed forces and to protect our soldiers is our prime objective. • Based on this research the institute conducts technology projects of the GMOD with a medium-term horizon and specific objectives. 56 Reference solutions • Finally projects with the defence industry lead to solutions for the forces. These projects are carried out in close coordination with the GMOD to ensure the independent role of the IOSB as consulting entity for the governement. • ABUL – Full-motion video exploitation system for reconnaissance and surveillance (air, land, and sea) • RecceMan®: Interactive recognition assistance for aerial and satellite imagery reconnaissance • i2exrep for reporting in image-based reconnaissance International cooperations based either on bilateral agree- • SAR-Tutor for image analysis training ments, with contracts from the European Defence Agency • Computer-Aided Interactive Performance Evaluation Tool (EDA), or common research activities in the context of NATO’s Science & Technology Organization (NATO STO) are continuously flanking our national defence research work. CARPET for camouflage assessment • OMSIS: Onboard Infrared Ship signature Management system • Digital Map Table To the extent that military security classification does not prevent this, the R&T in business unit Defence is incorporated into the IOSB’s applied research for civil purposes performed by the other four units in order to achieve the highest benefit • CSD – Coalition Shared Data Server and clients for interoperable data and information distribution • Predicition tool for thermal imaging based on a Thermal Range Model (TRM 4) for all application areas. • Environment measurement system for characterization of Equipment, and lab and test facilities • GERTICO: Infrastructure for federated simulators atmospheric effects • Environment simulation (e. g. for camouflage assessment) • Adaptive optics • Bidirectional reflectance analysis of materials • Airborne platform for imaging radiometrics (AirSIG) • Observer performance evaluation • Assessment of visual and infrared imaging systems • Optronic countermeasures • Femtosecond laser lab • Human-computer interaction for image analysis (eye gaze, gesture) • Testbed for network-enabled imaging reconnaissance • Federation of simulators • Distributed Network Battlelab (DNBL) • SAR simulation (CohRaS®: Coherent Ray-tracing based SAR-Simulator) • Reconnaissance and surveillance with mobile sensor swarms • Serious gaming for image analysis training • Airborne multisensor platform (VIS, LWIR and hyperspectral) 57 S i g n at o r i c s www.iosb . frau n h o fer.d e / S IG 1 Optical Turbulence – Atmospheric impact on imaging and wave propagation: Basic research and applications E le c t ro- opt ic a l a n d i m a g i n g s ys te m s a re us ed i n many mi l i tary fi el ds , e.g. war ni ng, rec onnai s s a nce and ta r ge t a c quisit i o n . De s i g n a n d va l i d a ti o n of mi l i tary s y s tems hav e to take ac c ount of meteorol ogical cond it ions. E nv iron m e n ta l c o n d i ti o n s h a ve to be c ons i dered for appl i c ati on, effi c i enc y and us e on diff erent p la t f or m s in t he o p e ra ti o n a re a . T h e y a re d etermi ned by c l i mati c i mpac t, weather c ondi ti ons , and int er action w it h t he e a rth ’s s u rfa ce . C h a ra cte ri z ati on, quantifi c ati on, and c orrec ti on proc edures of atmospher ic i nf lue nc e s a re i n d i s p e n s a b l e . C l i m a ti c i mp ac ts determi ne the c hoi c e of the s pec tral range (UV up t o IR) f or a n opt im um us e o f e l e c tro -o p ti c a l s y s te m s. Atmospheric phenomena like diffraction, refraction, aerosol scattering and absorption, and turbulence influence wave propagation of electro-optical and imaging systems. Basic research at the Signatorics department of the Fraunhofer IOSB is focused on optical turbulence in the lower atmospheric boundary layer, quantifying the impact of the turbulent atmosphere on wave propagation. Optical turbulence may result in a strong degradation in imaging quality, making tasks such as detection, classification and identification difficult or even impossible. Because the atmosphere experiences turbulence almost continuously, correction procedures for compensation of turbulence are investigated. This report gives an overview of the basic research and applications dealing with atmospheric corrections regarding the influence of optical turbulence on electro-optical systems as part of the ATLIMIS (Atmospheric Limitations of Military Systems) project. Optical turbulence is described by the structure function parameter of the refractive index of air, Cn², and is caused by temperature and humidity fluctuations in the atmosphere. These are created by thermal (interaction with the earth surface by heating and cooling) and mechanical forces (wind shear) or evaporation. Project description Contact: The basic research focuses on field trials investigating the spatial and temporal resolution of Dr. Detlev Sprung optical turbulence in the lower atmospheric boundary layer, in which most of the electro-optical Phone +49 7243 992-164 systems are operated. These experimental trials, with time periods from several weeks up [email protected] to several years, are performed in different climatic conditions, including deserts, moderate 58 Business Unit Defense 2 3 central European, arctic, and sub-tropical. Regarding the influence of the earth surface, typical 1 Example of a diel cycle of the land covers, including sea surfaces at different temperatures, various rural agricultural sites, vertical distribution of optical and urban areas are investigated. Besides these experiments under typical atmospheric turbulence (Cn²). The color coding conditions, the project focuses on the long-term experiment VerTurM (Vertical Turbulence represents the strength of the Measurements) in which the vertical distribution of the optical turbulence up to a height of optical turbulence (dark red cor- 400 m is investigated with various complementary instruments. This long-term experiment responds to strong turbulence). has been set up on the site of the WTD 91 (Technical Centre of Weapons and Ammunition 2 Comparison of vertical pro- of the German Armed Forces) in Meppen (north-western Germany) since June 2009. A diel files of optical turbulence (Cn²) cycle of the vertical distribution of the optical turbulence for one typical day in summer is measured during the VerTurM presented in Fig. 1. A high variability of optical turbulence can be identified. Measured vertical experiment (dots) and the calcu- profiles are analyzed with respect to the meteorological conditions. Diurnal and seasonal lations using the Tatarskii model effects are investigated. Regarding standard meteorological data a prediction model of the (line) for a daytime case (12:00 vertical distribution of turbulence should be derived regarding standard meteorological data CET, red) and a nighttime case and therefore the efficiency of electro-optical systems in the lower atmospheric boundary (21:00 CET, blue). layer should be improved. Results from existing models (e.g. Tatarskii, Fig. 2) deviate strongly 3 Schematics of turbulence from the measurements, especially at stable atmospheric conditions at night. compensation of an adaptive optics system. All measured optical turbulence data are stored in a database maintained at the Signatorics department. Here the measured turbulence data can be combined with the performance properties of electro-optical systems, allowing the operating instruments to be characterized regarding specific measurement sites and times (meteorological conditions). The results of the experimental work on optical turbulence are also used for model validation and for the correction, improvement and prediction of performance of electro-optical and imaging systems. For practical applications software tools are developed to compensate turbulence for use of the data in imaging systems. Using adaptive optics, systems are implemented for measuring and correcting fast wavefront distortions (Fig. 3). The project also covers laser applications for urban environments. Sponsor The research and application on optical turbulence are part of the project ATLIMIS (Atmospheric Limitations of Military Systems, No. E/UR1M/9A265/AF170), commissioned and sponsored by the WTD91 (Technical Centre of Weapons and Ammunition) of the German Armed Forces and embedded in the business segment defense. Project execution Dr. rer. nat. Karin Stein, Dr. Detlev Sprung, Dr. Peter Grossmann, Erik Sucher Literature [1] Sprung, D.; Grossmann, P.; Sucher, E.; Stein, K.: Stability and height dependant variations of the structure function parameters in the lower atmospheric boundary layer investigated from measurements of the long-term experiment VerTurM (vertical turbulence measurements), SPIE Remote Sensing, 8178-08, Prague, 2011 [2]Sprung, D.; Grossmann, P.; Sucher, E.: Investigation of seasonal and diurnal cycles on the height dependence of optical turbulence in the lower atmospheric boundary layer, SPIE Optics and Photonics, 8719-19, San Diego, 2012 [3]Gladysz, S.; Stein, K.; Sucher, E.; Sprung, D.: Measuring non-Kolmogorov turbulence, SPIE Remote Sensing, 8890-40, Dresden, 2013 Business Unit Defense 59 Op t r o n i c s www.iosb . frau n h o fer.d e / O P T 1 FIRST RESULTS OF A NEW EYE-SAFE 3D-LASER-RADAR APD LINE SCANNER I n a non- c oope ra ti v e e n vi ro n me n t, i m a g i n g 3D l as er radar s ens ors offer a uni que potenti al c ompared t o p a ssiv e se nsor s re g a rd i n g ta s k s l i k e s u rve i l l anc e, detec ti on of s mal l obj ec ts , rec onnai s s anc e, c l as s if icat ion, p rot e c t ion, obs ta c l e a v o i d a n c e , p o s i ti o n i n g, terrai n model i ng, depth s oundi ng, autonomous na vigat ion, a ut om a t ic obje c t re co g n i ti o n , a n d o b j e ct trac ki ng. Empl oy i ng s c anni ng l as er s y s tems i t was pro ven t hat l a se r r a da r se n s o rs o ffe r th e c a p a b i l i ty o f automati c data ev al uati on. Thei r outs tandi ng perform ance is o w e d t o t he f a ct th a t l a s e r ra n g e d e p th res ol uti on i s i ndependent of the s ens or’s di s tanc e to the t ar get . I n c ont r a st t o p a s s i ve s e n s o rs , fo r wh i ch there ex i s t no rel i abl e obj ec t rec ogni ti on al gori thms , the m ain d iff ic ult y in int ro d u c i n g o p e ra ti o n a l l a s e r radar s y s tems i s owed to the l ac k of adequate s ens ors . Two-dimensional scanning systems suffer from the drawback of spatial resolution, when, for a given field of view (FOV), a high image update rate is necessary. Tasks demanding reliable resolution of small objects, especially at long ranges in real time, can be fulfilled only by sensors consisting of detector arrays. The detector is the heart of an imaging 3D sensor system and ensures sufficient frame rates and a high spatial resolution for tasks such as detection or classification. Increasing efforts have been made throughout the world to develop 3D detectors based on one- or two-dimensional arrays. Detector development focuses on avalanche photo detectors (APD) operated in the Geiger mode (GAPD) or in the linear (non-Geiger) mode. GAPDs offer the advantage of higher sensitivity, but there are also some negative effects using GAPDs in laser radar: First, dark counts generated by thermal noise can cause false alarms. Second, GAPDs experience a dead time in which the detector element does not work after detecting a photon. The dead time typically varies from 10 ns to 1 µs and depends on the detector material and on the design of the quenching electronics. Thus usually only one echo can be detected in Geiger mode. In linear mode multiple successive echoes can be detected within a short range. Contact: Dr. rer. nat. Dipl. Phys. Bernd Eberle Phone +49 7243 992-132 [email protected] 60 Business Unit Defense 2 3 1 View of the 3D line detector camera (left) and the laser source (right) equipped with lenses. 2 Visual impression of the environmental surrounding of Here we present first results for a recently developed 3D imaging laser radar sensor, working in the laboratory. The distance to the short-wave infrared (SWIR) band at 1.5 µm. It consists of a novel Cadmium Mercury Tellu- the high building on the left ride (CMT) linear detector array with 384 x 1 APD elements at a pitch of 25 µm, developed by side of the scene is 270 m. AIM Infrarot Module GmbH. The APD elements were designed to work in linear (non-Geiger) 3 Depth image of the measured mode. Each pixel is capable of providing time of flight measurement, and – due to its linear scene composed of processed detection mode – allowing the detection of three successive echoes. The digital read-out data, coded in false colors. integrated circuit (ROIC) was designed to offer a principal depth resolution of 60 cm. Using additional electronic processing on the ROIC a depth resolution of 15 cm was attained. The ROIC delivers the time-of-flight (TOF) data for the whole flashed area all at once; for test Partners purposes an intensity mode is available. The maximum read-out rate is 4 kHz. In cooperation with WTD 81, AIM Infrarot Module GmbH, The 3D laser radar system was set up in a laboratory from which the surrounding environment EADS Deutschland GmbH could be accessed. The sensor head, consisting of 3D sensor and laser source as well as a SWIR CASSIDIAN camera to monitor the laser beam, were mounted on a horizontally scanning rotation stage. This scan direction was attributed to the fact that the 3D sensor was mounted with the detector line in the vertically direction. Trying to realize an FOV of around five degrees for the present test purposes, we chose a commercial SWIR lens with an f-number of 100/1.4 as receiver optics for the 3D laser range camera. To suppress background radiation, a bandpass filter of 80 nm width was mounted in the back of that lens. In the absence of a kilohertz-laser system we used a Q-switched 20 Hz OPO laser from Quantel (Big Sky CFR 400 Laser Series) with an output power of 70 mJ at the wavelength of 1.57 µm. The transmitter optics, developed by EADS Deutschland GmbH Cassidian, was designed to fit the linear FOV of the receiver. The whole experimental set-up was operated by a home-build computer control unit, which controlled triggering of 3D camera, laser and scanning unit, as well as providing data recording and real-time visualization of the measured range data. During data acquisition each of the three echoes was visualized in real time on the monitor of the control computer. Literature [1] Eberle, B.; Kern, T.; Hammer, M.; Schwanke, U.; Nowak, H.: OPTRO 2014, Paris, FR, Paper No. 2956200 “Performance of a new eye-safe 3D laser radar APD line scanner” Business Unit Defense 61 Interoperability and Ass i s t a n c e S y s t e ms www.iosb . frau n h o fer.d e / IA S 1 Heterogeneous reconnaissance data: task-oriented acquisition, distributed exploitation and interactive utilization R e c onna issa nc e s ys te m s m u s t b e a d a p ta b l e and s c al abl e to meet the ti me and s pac e requi rement s of a re c onna issa nc e m i s s i o n . S i tu a ti o n d e p e n d e nt different i nformati on s ourc es mus t be uti l i z ed – not only t o ca r v e out diff e re n t a s p e cts , b u t a l s o to v e r ify the gathered i nformati on by l i nki ng them i n ti me and space. T he e x ploit a t io n m u s t ta k e p l a c e ti me l y and al l as pec ts of the rec onnai s s anc e tas k mus t be c on sidered. R e sult s of t he e x p l o i ta ti o n mu s t b e d i s s e m i nated ti mel y and i n s tandardi z ed formats to the request or s. A system of this kind needs special mechanisms for interoperability. In addition to interlinking, the cooperation of systems and users with various competencies at a technical, logical and semantic level play a vital role to achieve a consistent workflow. To provide a solution to these problems a distributed experimental system-of-systems for videobased reconnaissance was set up at Fraunhofer IOSB. Closely cooperation with potential users and participation in realistic exercise scenarios assure quality and applicability of the whole system group as well as the single system components. The so-called ExBA group of interlinked systems, then, is a heterogeneous system-of-systems consisting of a range of different sensors and of components for sensor management, communication and analysis, interactive visualization, and automated and manual processing of data and information. This solution offers standardized interfaces to other systems, which can be integrated into the reconnaissance workflow. Department IAS has developed a system called AMFIS for managing and evaluating heterogeneous sensors, which can be stationary or mounted on heterogeneous sensor carriers in a homogenized ground control station within a complex parallel reconnaissance application. For this purpose a distributed modular architecture was developed, allowing a quick and efficient adaptation of the system to varying demands or the need for special sensors. The Contact: parallel control of different sensor carriers was integrated and tested on the ground, in the Dr.-Ing. Igor Tchouchenkov air and on water. To achieve technical and semantic interoperability, the system contains Phone +49 721 6091-552 communication components for transferring reconnaissance data in STANAG 4609 as an igor.tchouchenkov@ integrative system interface and supports additional information exchange systems, such as iosb.fraunhofer.de XMPP and Coalition Shared Data (CSD), which is a STANAG 4559 implementation. 62 Business Unit Defense 2 1 Interactive image exploitation. 2 A distributed experimental Department VID has developed ABUL, a modular system for assisting the exploitation process system-of-systems for video- for unmanned aerial vehicles. Thereby, ABUL provides real-time optimized features for online based reconnaissance (ExBA). surveillance and reconnaissance as well as functionalities valuable for offline reconnaissance tasks. Key features of the system include video processing algorithms for stabilizing and improving the video image, for detecting moving and stationary objects, and for generating Project execution geo-referenced mosaics or stereo images etc. ABUL is flexible in adapting to different sensors Dipl.-Geophys. Ralf Eck (IAD) and data. Interoperability is a main focus of the development. STANAG 4609 video data with Dipl.-Inform. Norbert Heinze (VID) encoded metadata is processed in real time. Interface to the CSD enables dissemination of Dipl.-Wirt.-Ing. FH Florian Segor (IAS) the exploitation products. Dipl.-Inform. Christian Zaschke (IAS) The software for Digital Situation Table (DigLT) was developed by department IAD to connect heterogeneous reconnaissance, tactical and spatial data from multiple sources, such as ZGeoBw, OpenStreetMap and CSD, and allows role-based visualization and interaction. Since the different roles in ISR use different hardware, the software also supports mobile devices, normal PC workstations, digital situation table and video walls. These devices support different modes of interaction, such as touch input with finger, mouse and keyboard, and 3D gestures. The software can specifically adapt the spatial data for the resolution of the display of the device used without a delay. The result is a visualization optimized for every device and its interaction with the spatial data. The information hub in ExBA is a CSD Server. The CSD stores and disseminates data based on a standardized interface, metadata model and data formats. The other ExBA systems store and retrieve data from the server over client applications. Systems from other vendors and providers that respect the standards (STANAGs) the CSD is based on can easily be connected to ExBA through this concept. This allows the integration of ExBA functionality into a bigger surveillance and reconnaissance architecture. By sharing information within ExBA and with other units and organizations, situation awareness can be enhanced. The ExBA was successfully tested within the scope of the “Unified Greding” experiment. The integrative system reconnaissance data was provided by the AMFIS sensors and by external sensor carriers and were broadcasted live to the ABUL video exploitation system and to the map-based visualization with DigLT. The data was then evaluated, used for situation representation and analysis and archived. All relevant primary data as well as reconnaissance results were stored in standardized formats in a CSD server. Fraunhofer IOSB thanks the WTD81 for financing research and support in the “Unified Greding” experiment. Business Unit Defense 63 Ob j e c t R e c o g n i t i o n www.iosb . frau n h o fer.d e / O B J Laser scanner Pa n / t i lt u n i t 360° camera 1 MODISSA – a test bed for “Mobile Distributed Situation Awareness” I n t he ne a r f ut u re , v e h i c l e s wi l l b e e q u i pped wi th a v ari ety of s ens ors , c omputers , and c ommu nicat ion s y st e m s, f or e x a m p l e to i mp l e me n t d ri ve r as s i s tanc e func ti ons . O n the c i v i l i an market, thi s dev elopm ent i s la r ge ly dr iv e n b y a g ro wi n g i n te re s t i n safety and c omfort. A ddi ti onal l y , the mi l i tary has an i n creasing d e m a nd f or situ a ti o n -a wa re n e s s c a p a b i l i ti es i n thei r v ehi c l es . Thes e trends hav e bec ome wel l es tablished i n t he sc ie nt if i c c o mmu n i ty. H o we v e r, c u rrent res earc h on thes e topi c s i s often hampered by th e lack of a n a de qua t e , c o n fi g u ra b l e te s ti n g a n d d e mons trati on pl atform. Task A versatile research vehicle is needed that provides testing and analysis functionalities for a wide range of sensors and various operating scenarios. Depending on the investigated scenario such a vehicle can even play different roles, for example a leader or follower in a convoy, a single vehicle in traffic, or a command and control vehicle. Example applications for its sensors are obstacle detection and avoidance, traffic monitoring, acquisition of 3D data, change detection, as well as target location, target tracking, target designation and target handoff between vehicles. It is even possible to simulate a network of multiple vehicles and their interaction. The MODISSA platform MODISSA (Mobile Distributed Situation Awareness) is the IOSB’s realization of an experimental platform for hardware evaluation and software development in the above contexts of automotive safety, security, and military applications. It is based on a Volkswagen van VW T5 that has been equipped with a broad range of sensors and contains hardware for complete raw data capture, real-time data analysis, and immediate data visualization on in-car displays (Figure 1). The VW van carries several sensors on a roof rack, and a power supply as well as operational electronics inside. The sensor configuration can be adapted to the needs of the respective study. The electronics, including several PCs, are located in a rack behind the driver’s seat. A row of passenger seats behind it is arranged for people operating the system or watching real-time processing demonstrations. The power for the sensor system is provided by four high-capacity Li-ion batteries that are stored in a box in the back of the van. This power Contact: system has sufficient capacity for several hours of independent operation. Dr. rer. nat. Marcus Hebel Phone +49 7243 992-323 Control of the sensors and data acquisition are performed by PCs in a rack inside the van. [email protected] Three types of PCs are included: A control PC, several recording PCs, and a powerful process- 64 Business Unit Defense 2 1 The MODISSA platform enables mobile sensor data acquisition, sensor data analysis and mobile demonstrations. 2 Mobile 3D model acquisition with the MODISSA platform. The data acquired with two Velodyne laser scanners (red and green for visualization) constitute highly accurate 3D representations of the vehicle’s vicinity. 3D data can be accumulated for wide area models and can be fused with imagery acquired with the ing PC. For georeferencing and time synchronization, an Applanix inertial navigation system camera sensors of the MODISSA is built into the van. Its IMU (Inertial Measurement Unit) is mounted on the same mounting platform. plate as the main sensors to minimize errors caused by the plate’s elasticity. GPS antennas are positioned on the roof near the front and back of the vehicle. Participants The sensors are mounted on plates fastened to two cross bars of a standard roof rack. The Dr. rer. nat. Michael Arens, current sensor configuration includes two rotating Velodyne laser scanners, an omnidirectional Dr.-Ing. Christoph Bodensteiner camera, and two cameras on a pan-tilt unit (one visual-range camera and one microbolometer Dipl.-Inform. Marvin Gordon, infrared camera). The laser scanners are located ahead of both roof rack bars over the front Dr. rer. nat. Marcus Hebel, corners of the vehicle roof, and are positioned on a wedge with a 25 degree angle to the Dr. rer. nat. Wolfgang Hübner, horizontal, sloping to the front outside at a 45 degree angle. This configuration guarantees a Dipl.-Phys. Simon Lemaire, good coverage of the roadway in front of the car and allows scanning of building facades Dr. rer. nat. Volker Schatz, alongside and behind it (Figure 2). A vertical plate between the laser scanners serves to Dipl.-Ing. Clemens Scherer shield these from mutual direct laser radiation. The omnidirectional imaging system is directly fastened to the roof rack bar near the back of the vehicle, and the pan-tilt unit is located in the center of the vehicle between the rack bars to reduce interference with the two laser scanners. Conclusion and Outlook An initial version of the MODISSA platform has been realized. Currently implemented applications include data acquisition and interaction paradigms with the sensors, such as looking around through the roof-mounted omnidirectional sensor with a head-mounted display when sitting inside the car. We are currently realizing more encompassing applications on the MODISSA platform, such as pedestrian detection, target detection and target handoff applications, as well as wide-area 3D model acquisition. Business Unit Defense 65 S c e n e A n a ly s i s www.iosb . frau n h o fer.d e / S Z A 1 Approval of trial capabilities: A real-time airborne multi- and hyperspectral sensor system in an interoperable environment Moder n mission characteristics require the use of advanced imaging sensors in reconnaissance. In particular, h igh spa t ia l a n d s p e ctra l re s o l u ti o n i m a g i n g prov i des promi s i ng data for a v ari ety of tas ks . Thes e include the c la ssif ic a t io n a n d d e te c ti o n o f o b j e cts of mi l i tary rel ev anc e, s uc h as c amoufl aged uni ts or i mprovised e x plosiv e de v ic e s (I E Ds ). E s p e c i a l l y i n a s y mmetri c warfare wi th hi ghl y mobi l e forc es , i ntel l i genc e, sur veill a nc e a nd re c on n a i s s a n c e (I S R ) n e e d s to b e av ai l abl e c l os e to real -ti me. Thi s demands the us e of un m anned a e r ia l v e hic le s (U AV s ) i n co mb i n a ti o n wi t h downl i nk c apabi l i ty and the i ntegrati on i n an i nteroper able e nv ironm e nt . System overview In cooperation with OHB System-AG and GEOSYSTEMS GmbH the Fraunhofer IOSB developed a multi- and hyperspectral sensor system, which is integrated in a wing pod for ease of installation and calibration. It is designed for the real-time acquisition and analysis of hyperspectral data. The main component is a Specim AISA Eagle II hyperspectral sensor, covering the visible and near-infrared (VNIR) spectral range with a spectral resolution up to 1.2 nm and 1024 pixel across track, leading to a ground sampling distance below 1 m at typical flight altitudes. The push broom characteristic of the hyperspectral sensor demands an inertial navigation system (INS) for rectification and georeferencing of the image data. Additional sensors are a high-resolution RGB (HR-RGB) frame camera and a thermal imaging camera. For online application, the data is preselected, compressed and transmitted to the ground control station (GCS) by an existing system in a second wing pod. The final result after data processing in the GCS is a hyperspectral orthorectified GeoTIFF, which is filed in the ERDAS APOLLO geographical information system. APOLLO allows remote access to the data and offers web-based analysis tools. Furthermore, the system is integrated in a Coalition Shared Contact: Database (CSD). Collected data and achieved results can be put in CSD for exchange with Dr. rer. nat. Dipl.-Math. other units. Wolfgang Middelmann Phone +49 7243 992-133 wolfgang.middelmann@ iosb.fraunhofer.de 66 Business Unit Defense 2 3 1 Multisensor pod mounted on Stemme S-10. 2 Camouflage nets detected in hyperspectral data. 3 Landcover map created with semiautomatic classification algorithms. System benefits Partners Capturing hyperspectral data in spectral bands of visible light as well as near- and mid- WTD81 / OHB System Ag infrared opens up new opportunities for differentiating materials. Different materials, such as minerals and vegetation, possess different spectral absorption and reflection bands. They can be identified using these spectra. This can be used for automatic target Project execution detection or the creation of land cover maps containing not only types of use (i.e. man- Dipl.-Ing. Andreas Lenz, made objects, vegetation) but gives information about the specific material. In the case Dipl.-Phys. Hendrik Schilling, of environmental monitoring, important factors include vegetation state (damaged forests), Dipl.-Inform. Dominik Perpeet, or material properties (environmental pollution). Dipl.-Math. techn. Wolfgang Groß, Dipl.-Ing. (FH) Eckehard Bernstein, The field trial Dipl.-Inform. Gisela Häufel, Within the context of the opening of the “Zentrum für Interoperabilität, NetOpFü und Dipl.-Inform. Sebastian Wuttke, Simulation“ (ZINS, Center for Interoperability, Network-Centric Warfare and Simulation) Dr.-Ing. Karsten Schulz at the WTD 81 in Greding, a military scenario simulating the evacuation of an embassy was performed. In preparing the evacuation, routes had to be planned to allow safe access to the embassy. Our system’s task was reconnaissance of the surrounding area for mission preparation, in particular the creation of maps as well as the detection of possible sources of danger. Before the actual evacuation took place, a complete dataset of the whole base area was collected. The data were transferred to the ground control station during acquisition, giving a first impression of the situation around the embassy. In post processing, the radiometric and geometric correction on hyperspectral data was carried out. Target detection algorithms were used to identify possible sources of danger. A group of camouflaged targets could be identified in the southern part of the base. An image, highlighting these targets and giving their position was created. Furthermore, hyperspectral classification algorithms were used to create precise and up-to-date maps, which can be used for route planning. All results were put into the CSD so that they could be accessed by all participating units. Literature [1]Schilling, H.; Lenz, A.; Gross, W.; Perpeet, D.; Wuttke, S.; Middelmann, W.: “Concept and integration of an on-line quasioperational airborne hyperspectral remote sensing system”, Proc. SPIE 8897, Electro-Optical Remote Sensing, Photonic Technologies, and Applications VII; Military Applications in Hyperspectral Imaging and High Spatial Resolution Sensing, 88970V (October 22, 2013) Business Unit Defense 67 B u s i n e ss U n i t Security Spokesperson Considering that new technologies are being discussed in Dr.-Ing. Markus Müller controversial manner with respect to conflicting aspects of Phone +49 721 6091-250 security needs and the need for freedom, particularly if they are associated with surveillance, IOSB pursues the notion of “Privacy by Design”, which requires that privacy criteria are already accounted for during the design of the system. Furthermore the protection of industrial installations and production capabilities against cyber-attacks in the context of the “Industry 4.0“ paradigm is an uprising task for which IOSB has already set up working groups and projects. The range of services spans from studies (e.g. for evaluation) to the realization of experimental systems or prototypes and in individual cases up to and including system development. Business Unit Development In typical projects the security researchers of Fraunhofer IOSB Dr.-Ing. Andreas Meissner support customers in their efforts to improve their competitive Phone +49 721 6091-402 position, addressing challenges previously thought too difficult with new product generations featuring innovations from the cutting edge of research. Markets The business unit Security serves customers from the private and public sector. The former includes, among others, security technology providers, security service providers and operators of properties with critical security profiles. IOSB serves official bodies at the federal, state and municipal level in the public sector, particularly official bodies and emergency services, Mission which aim to identify and evaluate new technologies in order The business unit Security focuses on the security needs of to fulfill their duties. people, companies and official bodies, which wish to protect against natural and intentionally planned hazards, and com- IOSB is available as a partner for specialized small and medium- prises a broad range of interlinked competencies that deal sized companies for the development of product innovations with sensor sphere optronic aspects as well as multimodal and considers itself to be a research resource for companies, surveillance robotics (on land, at sea and in the air), the which would also like to benefit from new scientific results development of ultra-modern analytical methods, the sup- without maintaining their own research department. Scientists port of interoperable standards for the real-time exchange from the business unit Security often take on demanding sub- of information for risk detection and management as well tasks in large projects on behalf of large companies. System as assistance in the situational analysis and human machine integrators integrate IOSB developments in their systems, for interaction in situation centers. example based on licenses. 68 Prior to or after acquisition of their contracts, security service Equipment, laboratory and test facilities providers and IOSB discuss the possibilities for further increase • Comprehensive laboratory equipment for capturing the in the efficiency and/or effectiveness of their work by means of entire image processing chain, from sensors through using new technologies; if necessary, IOSB involves industrial analysis to interoperable information exchange partners for commercial development and 24/7 support of the systems. Providers of novel high-tech products, which want to offer their own customers assurance with respect to their performance claims, commission IOSB with lab evaluation and benchmarking tests, on the basis of which absolute and/or relative conclusions relating to performance can be drawn. • Innovative, powerful sensors, such as eye-safe gated viewing lasers, two-color infrared sensors, multi- and hyperspectral sensors, and remotely-sited laser vibrometry systems • Distributed test setups for multi-camera tracking and privacy-compliant video analysis in public spaces • Multimodal sensor platforms: Experimental robotics on land, IOSB experts offer consultation to companies or official bodies, at sea and in the air, and associated ground control stations which are preparing large invitations to tender for security (stationary and in vehicles) for mission planning and control systems, particularly when it comes to the issue of relevant in heterogeneous deployment networks new technologies. This particularly includes the evaluation • A “Smart Control Room“ lab as a “perceptual room“ of technologies with respect to their suitability for certain • Mobile Control Center – a truck-based experimental objectives. platform for on-site situation management support Companies that intend to resort to publicly funded research References and product features projects in order to enhance their portfolio receive assistance • Fraunhofer IOSB as strategic partner for security research and by IOSB when it comes to identifying suitable funding programs and preparing a proposal. During the course of a project, IOSB acts as a research partner. Furthermore IOSB finds funding programs and suitable partners from industry for users in search of new technologies for their fields of activity. technology of the German federation of security services (BDSW) • Armasuisse / Swiss Confederation: UAV-based systems for border surveillance • Various event organizers: Providing security at major events with IOSB sensors and sensor carriers • Fraunhofer-wide management and coordination of large scale project SENEKA – sensor network with mobile robots In a technological respect and according to the overall research proposition of Fraunhofer IOSB, methods and systems for image exploitation are a core area, which are for example for disaster management • Federal Ministry of Education and Research (BMBF): Systems for water quality monitoring developed for property surveillance in both indoor and outdoor • Federal Ministry of Education and Research (BMBF): Video areas. With its competencies, IOSB handles the entire chain assisted systems for detecting conspicuous movement from sensor-sphere data acquisition, sensor carriers and their patterns, attacks and assaults, and abandoned luggage automatic control for surveillance missions, analysis on an • European Union (EU): Systems for identifying victims of automatic or human-machine basis, multi sensor fusion, and natural disasters and searching for missing persons situation analysis up to and including the use of information • European Union (EU): Systems for offshore monitoring acquired in this manner for higher-level management support. System design in compliance with privacy protection is an explicit topic of research and part of the consulting portfolio of the business unit Security. (detection of illegal border crossings and, smuggling of people, weapons, and drugs) • European Union (EU): Systems for the protection of critical infrastructures and utility networks 69 S i g n at o r i c s www.iosb . frau n h o fer.d e / S IG 1 AlGaN detectors for observation of UV emitters M a ny a pplic a t i o n s , wh e th e r c i vi l i a n o r mi l i tary , c al l for s ens ors whi c h are s ens i ti v e to ul trav i o let ( UV) ra dia t ion. N ot a b l e e xa m p l e s i n c l u d e mo n i tori ng of UV emi tters i n water treatment fac i l i ti es an d in UV cur ing proc e sse s . Fu rth e r c i vi l i a n e x a m p l e s i nc l ude moni tori ng of pl as ma proc es s es , parti c l e measurem ent sy st e m s a nd sp e c tro s co p y . A m i l i ta ry a p p l i c ati on of s pec ifi c i nteres t i s mi s s i l e approac h war ni ng syst em s (MAW S ) w or k in g i n th e U V-C s p e c tra l b a n d (240 nm – 280 nm). Detectors commonly used in industrial applications are based on silicon (Si) or silicon carbide (SiC). When very high sensitivity is required, photomultiplier-based systems present a possible alternative. Often, additional optical filters are needed to meet spectral requirements. The sensitivity of these detectors usually decreases constantly under heavy illumination due to degradation of detector or filter materials. Since March 2011 detectors based on aluminum gallium nitride (AlGaN) have been developed in a joint project between Fraunhofer Institutes IAF, IOSB, IPM, ISIT and IFAM. These novel detectors are intended to overcome the weaknesses of Si and SiC. The project is funded through a Fraunhofer internal grant. Photodiodes and line sensors are epitaxially grown at the Institute for Applied Solid State Physics (IAF), while integration and hybridization of the detectors is performed at the Institute for Silicon Technology (ISIT). The Institutes for Physical Measurement Techniques (IPM), Manufacturing Technology and Advanced Materials (IFAM) and of Optronics, System Technologies and Image Exploitation (IOSB) develop applications and prototype systems based on these detectors. Electro-optical properties of AlxGa1-xN (0<x<1) are determined by the ratio of aluminum to gallium. The cutoff wavelength decreases from 365 nm (GaN) to 210 nm (AlN) with increasing Al content. This allows the detectors to be spectrally optimized for a given application. Inclusion of an additional layer with higher Al content – and therefore shorter cutoff wavelength – during epitaxial growth of the detectors, results in narrow-band sensitivity (minimum bandwidth of approx. 10 nm) without the use of external filters. This additional layer can be used as a second active layer yielding a detector with two distinct spectral channels. Contact: Dr. rer. nat. Dipl.-Phys. Christian Eisele Phone +49 7243 992-177 [email protected] 70 Business Unit Security 2 1 Demonstrator of a scanning line camera based on AlGaN line sensors. 2 Scenery in different spectral bands, visual (left), complete UV Electro-optical characteristics of the detectors manufactured so far are comparable with the band (center) and UV-C (right). best values published for AlGaN detectors and with the maximum values of SiC and Si detectors. UV images were taken with our Detectors for different sub-bands of the ultraviolet spectrum – UV-A (320 - 365 nm), UV-B camera demonstrator. (280 - 315 nm) and UV-C (240 - 280 nm) – have been produced. Work at Fraunhofer IOSB focuses on imaging applications using these detectors. To investigate Partners the potential of the AlGaN technology we are developing a scanning camera system with the Fraunhofer IAF, IPM, IFAM, ISIT AlGaN line arrays supplied by IAF and ISIT. Fig. 1 shows the demonstrator of this system, which is currently operated by an external data acquisition system. Fig. 2 shows an image of a scene taken in the visible spectral range (left), in the complete UV range (center) and in UV-C (right). Project execution Both UV images were taken with our camera. A deuterium lamp (200 - 400 nm) is located in Dr. rer. nat. Dipl.-Phys. Christian Eisele, the center of the images. Dipl.-Ing. (FH) Dirk Seiffer One potential application of the line sensors is its use in sorting machines. The ability to match the detector’s spectral sensitivity to the investigated material, and the potential of having a second channel that is sensitive at another band within the same sensor (dual color capability) may simplify system design and improve system performance. Further possible applications are remote sensing from airborne platforms, for example with the aim of detecting oil spills on the sea surface, or monitoring combustion or plasma processes. Our focus is on a possible deployment of the UV-C detectors as part of a civilian missile approach warning system. Compared to the photocathode systems currently used in military systems, the new solution promises robustness of the semiconductor sensor, small size, comparatively low cost, low weight and the inherent insensitivity to the solar background beyond 280 nm, which reduces the need for external filters. In addition, the aforementioned inclusion of a second channel with a different spectral sensitivity could facilitate a rough determination of the distance to the missile and estimation of time-to-impact. There are many imaging applications for which AlGaN sensors appear to be well suited. For low-light scenarios, further improvements of the sensors are, however, necessary. Future research will therefore include feasibility studies on AlGaN-based avalanche photodiodes. An improved version of our (scanning) line camera and the development of focal plane arrays are further tasks we will pursue. Business Unit Security 71 I n t e r a c t i v e A n a ly s i s and Diagnosis w ww.iosb . frau n h o fer.d e / IA D 1 MobSC – Mobile Situation Center for the Management of Complex Crisis Situations I n sudde n c r isis s i tu a ti o n s th e re i s a l wa ys the need of rapi d dec i s i ons bas ed on a huge amount of inf or m ation f rom diff ere n t ta s k s a n d s o u rc e s . T h e M obSC of F raunhofer I O SB i s an ex peri mental pl atform f or t he i nt e r a c t iv e ha n d l i n g o f s u c h i n fo rma ti o n b y a c ombi ned team. I t i s a c l us ter wi th ergonomi c di splay and i nt e r a c t ion de v i c e s c o mb i n e d wi th h i g h -p erformanc e work pl ac es . F eaturi ng energy and c l i mate f acilit ies a s w e ll a s broa d b a n d co mmu n i ca ti o n , i t i s abl e to work c ompl etel y autonomous l y . Fraunhofer IOSB has been working on team workspaces for many years, using large horizontal and vertical displays with gesture interaction, fovea tablets™ for detailed views and selection, other mobile devices and conventional work stations. They set up a combined working landscape for heterogeneous teams and individual specialists for dedicated tasks. The Mobile Situation Center realizes this working environment within a medium-size truck (Figure 1) that is able to work completely autonomously due to its own power 2 supply, triple climate system and several information interfaces to the environment. Figure 2 shows the architecture of the complete system. All calculations are performed in an on-board processing center in a separated room. The core system for the interaction is the digital situation table, which is located in the center of the room and based on a 42 inch multitouch display with camera-based gesture control. On the front wall, four 46 inch panels set up the wall display realized as one virtual display with quad HD resolution and two Microsoft Kinect® devices for the gesture control. Optionally tablet systems and workstations can be used. In addition to the interaction control systems there are several subsystems for different tasks: the CSD (Coalition Shared Database) system is an IOSB product for specialized access control Contact: to security-relevant information. The ABUL system supports automatic and interactive image Dr.-Ing. Gunther Grasemann and video analysis, especially for security applications such as screening, tracking, and change Phone +49 721 6091-441 detection. The INSENSUM system is a meteorological measuring and analyzing system for gunther.grasemann@ incorporating weather information, such as temperature, wind and humidity, as well as their iosb.fraunhofer.de history and prognosis. 72 Business Unit Security 3 4 An external subsystem interfaced with a standard network connection is the IOSB AMFIS 1 MobSC carrier system. systems for the control of mobile sensor carriers such as UAVs and UGVs for cameras and 2 MobSC system architecture. special sensors (e.g. chemical or nuclear). 3 Change detection with the subsystem ABUL. The Mobile Situation Center can be used for the management of crisis situations or for 4 Demonstration of the MobSC. supporting situation awareness in critical environments such as mass events or congresses. The following example shows how the change detection works. Steady and UAV-based cameras deliver live streams to the MobSC for successive monitoring of the area. These Project execution streams are normally shown on the wall display. In addition, the ABUL system uses one of Dr.-Ing. Gunther Grasemann them to create a geo-referenced mosaic of the area (Figure 3). At fixed intervals (e.g. every Dr.-Ing. Andreas Meißner 30 minutes), a new mosaic is created and can be used for automatic and interactive change Dr.-Ing. Siegbert Kunz detection. In Figure 3 the red square marks an object which the automatic component of Dr. rer. nat. Elisabeth Peinsipp-Byma ABUL has detected as new at this position since the last monitoring flight and which might Dipl.-Wirt.-Ing. FH Florian Segor be dangerous (e.g. explosive (IED) or toxic). Dr.-Ing. Igor Tchouchenkov Dipl.-Ing. Christian Teutsch The current mosaic is displayed on the digital situation table as a geo-referenced overlay on the airborne image of the area. The combined team in the MobSC can select any suitable view of the sensor signals on the displays to support them in the decision of how to handle the current situation. For this purpose the immediate history at the current position can be reconstructed with video sequences from the database on the CSD. In addition, the INSENSUM system delivers the current weather conditions together with the weather history and forecast. This can be provided as a condensed view of a wind rose (Figure 3). For access to the respective sensor data, OGC conform services, such as the SOS (Sensor Observation Service) or the WMS (Web Map Service) are provided for request and delivery of the wind rose as an overlay image. The displayed information can be very important for the decision of whether or not to evacuate an area or a certain building. Finally, the stored video sequences can be helpful in supporting the search for a suspicious person who may have deposited the object and be on their way to other serious actions. The experimental Mobile Situation Center shows that it is possible to integrate sensing, analysis and interactive display tools with high-performance capabilities in a small, mobile platform that can be ready for operation within a couple of minutes and offers nearly the full set of functions, residential interaction capabilities and measuring and analyzing subsystems available and suitable for the respective tasks. Fraunhofer IOSB has held several exhibitions in the last years, including the Security 2012 fair in Essen, the ISCRAM 2013 in Baden-Baden and the internal cluster workshop of the Innovation Cluster “Future Urban Security“ in Freiburg (Figure 4). Business Unit Security 73 Interoperability and Ass i s t a n c e S y s t e ms www.iosb . frau n h o fer.d e / IA S INTUITEL Intelligent Tutoring Interface for Technology Enhanced Learning The worldwide increase of knowledge has led to an information-based society, where a single individual is no longer capable of completely knowing and thoroughly understanding a significant part of the available knowledge in a given field. Teaching is necessary to acquire knowledge and skills for life-long lear ning (L3), e it he r in sc hoo l , a t u n i v e rs i ty o r a t th e workpl ac e. H owev er, human tutors and s ui tabl e teac hi ng m at er ial a re e x pe nsiv e re s o u rc e s th a t mi g h t n o t b e av ai l abl e for al l domai ns and at al l ti mes . I ntel l i gent t ut or ing s y st e m s ( IT S ) try to o v e rc o me th i s b o ttl e nec k. Therefore, us er adaptabi l i ty i s a key requi rement , since l e a r ning is uniq u e a n d tu to ri a l fe e d b a c k h as to be gi v en ac c ordi ng to the i ndi v i dual progres s and prof ile o f a st ude nt . T h e p re s e n te d I T S s y s te m tries to fi nd a l ev el s ui tabl e for the i ndi v i dual l ear ner, thus reducing t he ov e r a l l co mp l e x i ty o f th e l e a r n i n g proc es s . Objectives The objective of the EU-project “Intelligent Tutoring Interface for Technology Enhanced Learning” (INTUITEL, www.intuitel.eu) is to enhance state-of-the-art e-learning content and learning management systems (LMS). The INTUITEL framework can be integrated into existing e-learning systems and will then provide additional functionality. An INTUITEL-enabled system adapts itself in response to the learners, monitors their progress and behavior, combines this with didactic and domain-specific knowledge and, by automated reasoning, deduces optimal guidance and feedback. In particular, it finds an optimal sequence of course modules for the student w.r.t. a pre-specified reference path in the presence of incomplete information and concurrent learning paths. Project overview INTUITEL is an interdisciplinary project joined by a consortium of twelve international partners from pedagogics, education and IT technology. The Fraunhofer IOSB contributes with its expertise in technology, e-learning and knowledge transfer. As established experts in image Contact: exploitation the institute brings in learning content for a radar image interpretation course Dipl.-Inf. Alexander Streicher as testing ground as well its state-of-the-art learning management system Crayons®. The Phone +49 721 6091-277 experience of the Fraunhofer IOSB in semantic web technologies is a main pillar of the auto- [email protected] matic reasoning and deduction capabilities of the intelligent part of INTUITEL. 74 Business Unit Security 1 2 1 INTUITEL System Overall Architecture. 2 Wilhelm Busch: Lehrer Lämpel (aus Max und Moritz). The architecture of INTUITEL is organized in five main areas: (i) a lightweight interface to LMS; Project execution (ii) a semantic learning object model (SLOM) specification for learning content interoperability; Dipl.-Inform. (FH) Anton Berger, (iii) pedagogical and domain models to describe didactical concepts as well as domain knowl- M.Sc. Ehm Kannegieser, edge; (iv) the backend with a model that monitors the learner’s progress and the reasoning Dipl.-Math. Can Özmen, engine; (v) a communication layer which handles internal and external messaging. Dipl.-Phys. Wolfgang Roller, Dipl.-Inf. Alexander Streicher, In INTUITEL, learning goals will be defined according to the desired competency, which will M.Sc. D. Szentes, be mapped to the available content, thereby providing means for companies and educational Dr. Andrea Zielinski organizations to better manage their collective knowledge. At the same time, high flexibility to choose a learning pathway is maintained by offering system-driven and learner-directed navigation tools, thereby increasing the empowerment of teachers and learners and fostering the acquisition of methodological knowledge. By interpreting the learner’s responses INTUITEL will automatically determine his position within a cognitive map for the particular learning content. The INTUITEL-enabled LMS then plays the role of a pedagogically skilled teacher, transparently guiding the learner towards the required competencies. Positive and goal-oriented feedback messages will provide important advice to learners in their learning experience. Furthermore, by providing the cognitive position also as a feedback, INTUITEL will enable the learners to establish an intuitive model of their current learning effort and therefore also enhance their metacognitive skills. Several market-leading LMS, including the Open Source platforms Moodle and ILIAS, will be equipped and tested with the technology to achieve these pedagogical goals. The involvement of several project partners in commercial e-learning activities and other project partners in university e-learning activities will ensure the testing and evaluation of the pedagogical and technical aspects of INTUITEL under realistic conditions. Acknowledgements The research leading to these results has received funding from the European Union‘s Seventh Framework Programme (FP7/2007-2013) under grant agreement n° 318496. Literature [1] Swertz, C.; Schmölz, A.; Forstner, A.; Heberle, F.; Henning, P.; Streicher, A.: A Pedagogical Ontology as a Playground in Adaptive Elearning Environments. In Matthias Horbach (Ed.): Lecture Notes in Informatics (LNI), INFORMATIK 2013: 43. Jahrestagung der Gesellschaft für Informatik. Proceedings. Köllen Druck+Verlag. 2013 [2] Swertz, C.; Schmölz, A.; Forstner, A.; Streicher, A.: Adaptive Learning Environments as Serious Games. In Mafalda Carmo (Ed.), Proceedings of the International Conference on Education and New Developments 2013 (pp. 175–180). 2013 Business Unit Security 75 V i d e o E x p l o i t a t i o n S y s t e ms www.iosb . frau n h o fer.d e / VI D 1 Patient-tracking for epilepsy monitoring When security technology helps fight diseases E p i l e p s y m o n i t o r i n g i s v i t a l i n t h e a c c u r a t e d i a g n o s i s o f u n c o n t ro l l e d s e i z u re s a n d i n p re p a r a t i o n f o r e p i le psy sur ge r y. T h e e p i l e p s y m o n i to ri n g uni t (EM U) i s where c onti nuous v i deo EEGs are perform ed. The vide o re c ords t h e p a ti e n t’s p h y s i ca l a cti vi t y , i nc l udi ng s ei z ures and what happens i n the moment s bef ore a nd a f t e r se iz u re . S i mu l ta n e o u s l y wi th th e v i deo rec ordi ng, the EEG rec ords brai n ac ti v i ty . Both video and E E G inf or m a t io n a l l o w p h ys i ci a n s to p i n p o i nt the ty pe of s ei z ure that i s oc c urri ng and prec i s el y l ocat e t he sourc e . On t he o n e h a n d i t i s n e c e s s a ry to keep the pati ent as c l os e as pos s i bl e i n the foc us of the video to se e a lso, f o r e xa m p l e , s ma l l mu s c l e twi tc hes ; on the other hand the pati ent s houl d al s o have t he fre e dom t o m o v e a ro u n d i n th e p a ti e n t ro om. For t his pur pos e to d a y ’s v i d e o E E G s y s te m s us e pan-ti l t-z oom c ameras that are manual l y c ontrolled by m e dic a l st a ff , wh o a re u s u a l l y i n ch a rg e of c onti nuous l y c ontrol l i ng the c amera to keep the pat ient in fo c us w hile a t th e s a me ti m e o b s e rv i n g E E G ac ti v i ty for di agnos i s . H owev er, manual c amera c on t rol and vide o m onit or in g o v e r a l o n g e r p e ri o d o f ti me i s ex haus ti ng and l owers operator’s attenti on. To ov e rc om e t h i s p ro b l e m , a n i n n o va ti v e a utomated pati ent trac ki ng s y s tem has been des i gned an d develope d t oge t he r wi th N I HO N K O H DE N , wh i c h c ons i s ts of a two-c amera s etup c onnec ted to the F ra unhof er I O S B A ut oTr a c k ® p a ti e n t tra c k i n g s o ftwa re. The system concept The AutoTrack® software is responsible for real-time processing of video streams from all cameras available for monitoring as well as for automatic camera control. The typical camera setup consists of two cameras: a static overview camera and a pan-tilt-zoom camera. The static wide-angle camera provides an overview of the entire monitoring room, while the pan-tilt-zoom camera is used for active high-resolution patient observation. Both camera streams are processed independently by dedicated video processing modules, which Contact: Dr.-Ing. Eduardo Monari Phone +49 721 6091-411 [email protected] 76 Business Unit Security are able to detect and localize the observed patient. Manual Camera Control (GUI) Visualization AutoTrack System Core (3D position multi-camera tracking and ptz camera control) Camera Control API ptz camera control Video Analytics VideoAnalytics VideoAnalytics multi-feature patient detection & 3D-localization Optional additional camera 2 3 1 MXT badge – a visual tag developed by the Fraunhofer IOSB. 2 AutoTrack system concept. 3 AutoTrack prototype user interface. Detection is performed based on color appearance features and by the use of visual tags Principal / Project partner (IOSB MXT badges), which are fixed to the monitored patient’s clothes. MXT badges (Fig. 1) Nihon Kohden Europe GmbH are defined visual patterns which can be identified and localized in image data reliably and very quickly, even under adverse lighting conditions (e.g. low light, low contrast, or low resolution). Project execution One unique feature of the AutoTrack system is its ability to track the patient in the monitoring M.Sc. Sascha Voth room in 3D space, instead of tracking in video (pixel coordinates) only. This approach allows Dr.-Ing. Eduardo Monari ® a higher scalability of both the camera network and camera mounting positions. Since the images from each camera are processed by independent video processing modules, and position information is exchanged between modules based on a common 3D coordinate system, camera control can be performed by any available camera in the network. Furthermore, MXT badges can be identified by an integrated code (ID number). These IDs are used to distinguish between patients in the same monitoring room and to avoid mix-ups during automated tracking. From prototyping to product In 2013 the AutoTrack® system prototype has been evaluated by medical technicians at Heidelberg University Hospital (Universitätsklinik Heidelberg). After proof of concept and user-oriented software optimization the AutoTrack® software has been presented to the public and end-users at the MEDICA Düsseldorf Trade Fair, and at the AES (Annual Meeting of the American Epilepsy Society) in Washington D.C. with big success and very positive market feedback. In the near future integration of the AutoTrack® software into Nihon Kohden EEG products is planned. Business Unit Security 77 S e c u r e C o mm u n i c a t i o n Architectures www.iosb . frau n h o fer.d e / S K A CyphWay – The one device for secure communication T he use of m ob i l e te rm i n a l s s u c h a s n o te b ooks , tabl et PC s , and s martphones are of i nc reas i ng s i gnif icance toda y . U sua lly th e s e e ffi ci e n t te rmi n a l s p ro v i de i mmedi ate ac c es s to the I nter net and to an organ izat ions’ i nt r a ne t . In pa rti c u l a r th ro u g h th e i r mu l tif unc ti onal i ty tabl et PC s and s martphones are bec omi ng a lucr ativ e t a r ge t of in d u s tri a l e s p i o n a g e . A cc o rd i ng to a s urv ey on i ndus tri al es pi onage c onduc ted by Cor por at e Tr ust in 2012 [ 1 ] th e i n c re a s i n g u s e o f ta b l et PC s and s martphones i s , at 63.7 perc ent, ranked num ber 1 in development efforts, thereby presenting an increasing risk of know-how leakage for German enterprises. The security of several of these terminals is, however, highly controversial. To ensure data security, various cryptographic methods are used. Since these terminals are used to output data to humans via a user interface, a continuous encryption of the transmitted data is not possible. Leakage of any single item of data cannot, therefore, be fully prevented. However, the loss of control over a large set of sensitive data is much more problematic than the loss of single data sets. This may occur, for example, if the used encryption keys are obtained by an adversary. This is where CyphWay, developed at Fraunhofer IOSB, comes in. CyphWay protects keys through encryption. Decrypted keys are available only within specially developed, trusted hardware modules that are separate from the mobile device. These modules also perform the task of encrypting and decrypting the data and keys. CyphWay has a modular structure and permits the use of different communication media, such as USB or Bluetooth. It can therefore be used within different scenarios and for different terminals – from smartphones to desktops, for data clouds to end-to-end communication – without the need for intermediate servers. CyphWay can be easily adapted to new requirements, such as new methods or data security requirements, by simply customizing its modules. An intelligent key management system (part of which has been published in [2]) prevents data being decrypted when a mobile terminal is attacked. Combining safety-critical components (i.e. the encryption and decryption functions), and the key management system in a trusted hardware crypto module guarantees the best possible protection of sensitive data. Contact: Dr. rer. nat. Andreas Jakoby Phone +49 721 6091-534 [email protected] 78 Business Unit Security 1 2 1 Encryption of a data record. 2 Visionary design of CyphWays. CyphWay consists of the three following components: Project execution 1. the trusted hardware crypto module Dr. rer. nat. Andreas Jakoby, 2. the communication module Dimitri Helwig 3. the integration module The integration module is implemented directly on the terminal. Depending on the terminal’s design and capacity the communication module, too, can be implemented on the terminal. The trusted hardware crypto module, in contrast, must be physically separate from the terminal. To verify authorization, users have to authenticate themselves at both devices – the terminal and CyphWay. Message encryption consists of the following steps (see Figure 1): 1. The terminal sends the unencrypted data to CyphWay (using protective mechanisms of the appropriate near-field communication channel) 2. Using the key management system CyphWay determines the required key. 3. The data is encrypted on the trusted hardware crypto module. 4. CyphWay sends the encrypted data to the terminal. 5. The terminal sends the encrypted data to its destination using the appropriate wide-field communication channel. Decryption takes place in the same way Secure end-to-end communication, for example via SMS, e-mail, or online chat The data sets are encrypted by sender’s CyphWay before transmission and decrypted by the recipient’s CyphWay after receipt of the data. All data traffic between the terminals is encrypted. The integrated key management system ensures that only authorized receivers can decrypt these messages. Eavesdropping on the communication is therefore doomed to fail. Secure data storage in the cloud Data encrypted with CyphWay can be stored in the cloud. The encryption protects these data from access by unauthorized parties. As in the previous use case the integrated key management system guarantees that only authorized parties can decrypt the data. Sensitive information can therefore be provided for authorized persons even if senders and recipients are not active at the same time. Literature [1] CORPORATE TRUST, “STUDIE: Industriespionage 2012,“ 2012. [2] Jakoby, A.; Müller, W.; Vagts, H.: “Protecting Sensitive Law Enforcement Agencies Data - Data Security in the Cloud,“ in International Conference on Cyber Warfare and Security (ICCWS 2014), West Lafayette, Indiana, USA, 2014. Business Unit Security 79 Core Competence Optronics Core Competence Optronics Optronics (OPT) substitute for real-life scenes. Using a computer process the templates are degraded to the extent that the resulting image most closely resembles the image that the thermal imaging Competencies and portfolio device being simulated would show of the scene. The Department of Optronics (OPT) develops methods for New device concepts are being analyzed and assessed with experimental and model-based performance evaluation and for IOSB_SITOS(S). For this purpose 3D scenes (simulation model optimization of passive and active optronic systems. Laboratory IOSB_SITOS(D) for dynamic applications) are also generated, evaluation systems are being developed for infrared detector and visual simulations to evaluate the performance of imaging mosaics, thermal imaging equipment, image intensifier tubes sensors conducted. and laser sensors, taking into account perturbation and hardening. Theoretical work related to novel evaluation methods The use of laser sensors is often limited by the safety require- and variables have resulted, among other innovations, in new ments associated with laser equipment. To estimate the hazard analytical range models and imaging simulation models. range of the laser sensor, the degree of reflection of the laser radiation from the investigated object must also be known. Our thermal range model IOSB_TRM4 allows a calculation of Both modeling and numerical calculation of the reflection the performance of scanning and rigid thermal imaging devices, behavior of laser radiation on surfaces that are subject to and cameras in the NIR and SWIR spectral range. IOSB_TRM4 is statistical fluctuations – such as water surfaces – present being continually adapted to current requirements and equipped a particular challenge. For this purpose the dynamic water with new features: Currently it is being extended for thermal surface model IOSB_WOM has been developed. bolometer cameras. Novel sensing methods and components are being developed For image simulation of IR sensors in static applications, the and implemented in laboratory samples. They include gated simulation model SITOS(S) has been developed. This can be viewing cameras and laser radars with heterodyne detection used to simulate real-life scenes from a thermal imaging device. for determining 2D and 3D laser reflection signatures, and 2D The simulation uses high-quality IR image templates as a vibration signatures for target classification over long distances. 1 82 Core Competence Optronics 2 Head of department: Dr. rer. nat. Dipl.-Chem. Helge Bürsing Phone +49 7243 992-446 [email protected] www.iosb.fraunhofer.de/OPT To obtain the 2D vibration signature, the laser beam scans 1 , 2 Gated-viewing exposure the target in X and Y direction. For each measuring point a of a ship, using the sliding-gate frequency analysis is performed. If the target vibrates (e.g. a technique in Figure 2. running drive unit) a micro Doppler shift is imprinted onto the 3 Dual-color image processing laser beam. This allows vibrating targets to be located through (MW, medium-wave; LW, long- partial obstructions (vegetation, fog, camouflage nets, etc.) to wave). analyze their vibration behavior. From the findings conclusions 4 Image simulation for evalua- about the motorization of the objects can be drawn and their tion of IR camera performance. geometric shape partially reconstructed. In addition, concepts for the protection from laser radiation are being developed for optronic sensors, with a particular focus on protection against laser dazzling. 3 Projects • Laser radar demonstrators and methods for target classification • Use of laser vibrometry for remote diagnosis of mechanical structures • Analytical calculation, modeling (IOSB_TRM4), and experimental verification of the range performance of imaging sensor systems (passive and active) in the spectral range from UV to thermal infrared for military and civilian tasks • Experimental performance evaluation of passive and active optronic sensors • 3D scene generation and image simulation for performance 4 evaluation of imaging sensors (IOSB_SITOS(D)) • Eye protection against laser radiation (protection from dazzle and injury) • Influence of and protection from laser radiation on optronic sensors • Propagation phenomena of ultra-short laser pulses (femtoseconds) in atmosphere and in optical materials • Investigations on the use of laser radiation in maritime environments using a water surface model IOSB_WOM • Development of laser safety concepts Core Competence Optronics 83 Signatorics (SIG) Competences and Portfolio The competences of the department SIGNATORICS Within the department, research is also being carried out on (SIGNATORIK – SIG) focus on the following areas: the use of warning sensors in the civilian settings. On the one hand, research projects in the area of signature management • Warning sensor technology conduce to change and/or reduction of the owned signature • Signature management and thus to the reduction of discoverability. On the other • Environmental limitation hand, possible adverse camouflage and deception measures are also being evaluated. Both, ground- and air-based meas- The activities comprise, amongst others, performance urement methods are developed and deployed in aircrafts optimization of electro-optical technology in the atmospheric and helicopters within the scope of complex field trials over environment (from ultraviolet to the infrared spectrum), land and sea. Relevant material and system properties are as well as development and improvement of signature identified with the help of innovative laboratory and field management measures. measurement systems and are used in numerical simulations for signature evaluation. One of the core research themes within the field of warning sensor technology, beside the characterization of the envi- An essential subtopic within all research areas of the depart- ronment and the backgrounds, is information gathering on ment is the analysis of atmospheric effects on electro-optical the signatures of potential threats. Warning sensor systems systems. As far as suppression of environmental effects is are developed for diverse threat scenarios. concerned, the department makes use of a comprehensive database on limiting factors, like atmospheric refraction and turbulence, acquired over the past years. These measurements are the basis for evaluation of atmospheric effects on sensors, 1 with the objective of achieving optimum compensation for such effects. 84 Core Competence Optronics Head of department: Dr. rer. nat. Karin Stein Phone +49 7243 992-114 [email protected] www.iosb.fraunhofer.de/SIG 1 Holographic wavefront sensor assembly. 2 MWIR radiance distribution (color-coded) of a research vessel. 3 High-performance spectroWork within the department focuses on the following meter assembly. topics: • Innovative warning sensor technology for the military and civilian sectors • Designing sensors for satellite-based monitoring systems • Measurement of atmospheric parameters and development of corresponding compensation methods 2 • Application of adaptive optics and software-based methods for image correction • Development, testing, and evaluation of multi-spectral signature management approaches and deception measures • Laboratory experiments and field trials in maritime and terrestrial environments with passive and active sensors • Identification of optical properties of materials within the full spectral range • Design of analytical models and numerical simulations for radiation transport and propagation processes in maritime and terrestrial scenarios 3 Core Competence Optronics 85 Visual Inspection Systems (SPR) Competences and portfolio The Visual Inspection Systems (SPR) department develops The department operates an image exploitation center and a and delivers systems for automatic visual inspection tasks cross-application multi-sensor lab with experimental apparatus in industry. The main areas of application are currently the for process clarification as well as development systems for a automatic sorting of bulk goods in recycling, mining and the variety of application areas. On the “multispectral workbench”, food industry (e.g. waste glass, metals, gold, diamonds, tea, materials can be inspected within the frequency range from herbs, coffee, grains, and seed), the inspection of surfaces ultraviolet (UV) up to and including near infrared (NIR) in order to for defects (e.g. paint coat inspection), the inspection and obtain optimal decision-making criteria for the inspection task. characterization of transparent materials of all shapes (e.g. Such “hyperspectral imaging” experience is directly linked to the flat glass, headlight glass, and sunroofs), color measurement work group for multispectral data analysis coordinated by SPR. of granulates and inspection of blister packs. Projects and products All these applications are characterized by the fact that the inspection is performed at high throughput rates inline with the higher-level process, which thus calls for high-performance image exploitation systems. The imaging sensors are used for high-resolution line scan cameras of various types (color, grayscale, UV, and imaging NIR), 3D area array scanners or laser scanners. The image acquisition equipment is individually tailored to the specific task at hand, making particular use of folded beam paths and LED flash illumination. • VisioChromHR: Image exploitation system for automatic inspection of tablet blisters • Clarity: Image exploitation system for automatic sorting of waste glass shards • ClarityHR: Image exploitation system for automatic sorting of heat-resistant glass • ClarityLead: Image exploitation system for automatic sorting of lead-containing glass • Minexx: Image exploitation system for automatic sorting The system platform for solving application tasks consists of standard PCs based on the PCIexpress bus under the Windows 7 and Windows embedded OS. The system’s high processing power is achieved with specially developed plug-in cards for the PCIexpress bus. Together with a real-time system of algorithms for the capture and exploitation of images, this platform is at the core of the delivered application systems. of minerals • GemStar: Image exploitation system for automatic detection of diamonds in granulated rock • FoodControlHR: High-resolution image exploitation system for automatic purification of tea, herbs and dried vegetables • CoffeeControl: Double-sided image exploitation system for automatic sorting of coffee • WheatControl: Image exploitation system for automatically The department’s products are used in industrial applications around the world. Partnered companies are responsible for marketing and service. In some cases, however, the department develops directly for end users and takes care of installation and service in the process. 86 Core Competence Optronics cleaning grains • GranuControl: Image exploitation system for automatic sorting of plastic granulates • SpotInspect: Image exploitation system for automatically detecting contamination in a material flow Head of department: Prof. Dr.-Ing. Thomas Längle Phone +49 721 6091-212 [email protected] www.iosb.fraunhofer.de/SPR • Purity: Image exploitation system for detecting defects as air bubbles or inclusions in arbitrarily-shaped transparent materials (e.g. flat glass, curved glass, lentils, or granulate) • Purity tension: Image exploitation system for detecting defects and measuring tension in arbitrarily-shaped transparent materials • MultiScan: Image exploitation system for automatic detec- • Sliding tables with a variety of different lighting fixtures for image acquisition • Experimental systems for sorting bulk goods (each equipped with a camera and blow-off device) in various configurations as a belt sorter, sorter with chute and free-fall sorting • Measurement stations for inspecting surfaces • Measurement setup for 3D inspection tion of defects and for evaluating texture, color and luster • Test system for transparent materials of industrial goods (e.g. tiles, base plates, coated steel belt, • Multispectral workbench (240 – 2500 nm) or copper laminates) • Lab equipment for material characterization • ColorControl: Image exploitation system for automatically • Sorting container for fast prototype production identifying the color of granular products (e.g. synthetic granules) The methods used for image exploitation permit evaluation of shape, texture, color, luster, material signature and 3D Infrastructure and equipment characteristics of the specimens. Image exploitation systems for industrial visual inspection are application-specific or customer-specific. This is why almost all research projects start with the question of whether the respective task can be solved at all using an image exploitation system. After that, the limits of the recognition capacity are determined. Eventually, an estimation of the resource requirement for system realization is performed. Satisfactory answers to these questions can be obtained only through experiments, which tend to be costly and time-consuming. The image exploitation center and the cross-application multi-sensor lab of the IOSB were set up for the purpose of experimental procedure clarification with, if applicable, the involvement of other IOSB departments and the KIT research group. The image exploitation center and the multi-sensor lab offer numerous facilities for image acquisition and exploitation. In addition to cameras and lighting equipment, they include: Core Competence Optronics 87 Core Competence System technologies Core Competence System technologies Energy (NRG) Expertise and portfolio The German and European energy supply is facing major EMS-EDM PROPHET® - Development challenges: Renewable energy is only one aspect of the • Software solution EMS-EDM PROPHET® current structural changes to the energy system. Energy • Implementation of forecast and optimization methods efficiency and cross-cutting issues such as electric mobility, • Support of market regulations (MaBiS, KoV IV) power analyzes, forecasts, virtual power plants and energy • Open, cross-system IT architecture storage are gaining importance through the interconnected • Scalable, high performance client/server development european power system. Fraunhofer IOSB-AST, department energy, has in all these areas extensive knowledge which is Energy systems applied in various projects over fifteen years. • Grid simulation and network planning • Smart grids In the industrial sector, the software solution EMS-EDM • Optimal system management and adaptive grid protection PROPHET is successfully represented in the German and • Grid integration, energy storage and e-mobility Turkish energy market by major partners such as Compello • Safe IT infrastructures for smart grids ® GmbH and BTC AG. Here topics such as energy and energy data management are at the forefront. In 2013 EMS-EDM Energy business and system analysis PROPHET became certified by TÜV within a project with • Liberalized energy markets and business models Dow Olefinverbund GmbH. • Market processes and communication ® • Smart metering In energy research, more foreward-looking issues like demand • Energy economic analysis response and demand side management, energy storages, • Development of forecast and optimization methods wind power forecast technologies or the integration of renewable energy into the power grid are explored. Energy technology components and equipment • System engineering and small producer The department energy consists of five working groups: • Components for efficient energy usage EMS-EDM PROPHET® - Engineering • Decentralized energy storages / grid protection components • Project management • Automation device / safe IT components • Demand and feed-in forecast • Procurement optimization in liberalized markets • Optimization of energy processes • Accounting grid and network utilization management 9 0 C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s Head of department: Dr.-Ing. Peter Bretschneider Phone +49 3677 461-102 [email protected] www.iosb.fraunhofer.de/AST 1 Smart charging methods for E-Mobility. 2 SuperGrid - meshed HVDC Tasks and projects grids in Western Europe and North Africa. • ADELE ING - Adiabatic compressed-air energy storage (CAES) for electricity supply (BMWi, Energy Storage Funding Initiative) • Energy storage study for medium and low voltage power grids (Thuringia energy and GreenTech-Agentur (ThEGA) • Gesteuertes Laden 3.0 managed by BMW AG (BMWi) • Smart Region Pellworm managed by E.ON Hanse AG (BMU, Energy Storage Funding Initiative) 1 • ICT energy lab - research and development platform for analysis and development of IuK technologies for centralized and decentralized intelligent energy supply systems and training center for EMS-EDM PROPHET® • EMS-EDM PROPHET® - energy management with forecast and optimization as well as energy data management for liberalized energy markets • SuperGrid - The future power highway - analysis of a meshed high-voltage direct current transmission grid in Western Europe and North Africa (Fraunhofer Society) • Hybrid urban energy storage - regional grid balancing with virtual energy storages (Fraunhofer Society) • Demand analysis energy storage (BAES, BMWi) • sMobiliTy - development of a cloud-based system and 2 service platform for electric mobility (BMWi) • REM 2030 - Regional Eco Mobility 2030 (Baden-Württemberg, Fraunhofer Society) • EBUS - Implementation of an e-mobility concept in the Thuringian tramway cities, including vehicle technology, infrastructure and energy supply, Working group 2: Concept study for a town-wide power supply system for the operation of electric buses in Thuringia (Ministry of Construction, State Development and Transportation) • EnEff:Stadt / EnEff:Wärme - Concomitant research (BMWi) C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s 91 Water and Mobile Systems (WMS) Expertise and portfolio The department water and mobile systems is engaged in the field of holistic and integrated consideration of water supply • Modeling, simulation and optimization of surface water systems systems, the development of embedded systems, assistance • Flash flood warning systems systems, and autonomously driven land and underwater • Water demand forecast vehicles. The department is split into three working groups: Tasks and Projects Embedded systems • Integration of embedded systems • Embedded control and regulation systems • System design and modules for autonomous vehicles • Hardware integration • AVATARES: autonomous test platform for proving and evaluating driver assistance systems (ARIES Ingeniería Y Systemas S.A.) • ServiceAssist software adaptation: maintenance software • Guiding systems for vehicles for electric wheelchair systems (Otto Bock mobility • Maintenance and diagnostic systems Solutions GmbH) • Sensor data fusion and simulation • Z60 controller hardware: development of a mechatronic concept to test and evaluate new additional operating sys- Water supply and wastewater treatment • Drinking water abstraction • Drinking water treatment • Drinking water distribution tems for wheelchairs (Otto Bock Mobility Solutions GmbH) • OTHELLO: development of a mobile household assistant for people with limited mobility • KLARA: development of a personal handling assistance to • Reservoir and dam systems support tasks like grabbing, giving and depositing of low • Wastewater collection weights through semi-autonomous functions • Wastewater treatment • Sludge treatment • Recycling of wastewater • Test software for ultrasonic device: special real-time software for inspection systems to characterize ultrasonic transmitters • SYTECH: Wiring loom fabrication: consulting project about automation solutions for flexible fabrication of wiring looms Maritime systems and surface water • Additional Bluetooth module: concept and implementation • Simulation and guiding software for underwater vehicles of a module which can be integrated into the control unit • Design, engineering and construction of underwater of a wheelchair to control electronic devices (Otto Bock vehicles and compression-proof modules • Virtual test environment for simulation of mobile systems and evaluation of vehicle guidance strategies • Control functions for the automated inspection of underwater infrastructure, sea cables and pipelines 9 2 C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s Mobility Solutions GmbH) • Maritime systems and surface water • HAPPI: small hydro power plant – evaluation of the potential of climate protection and improvement by intelligent technology Head of department: Prof. Dr.-Ing. habil. Thomas Rauschenbach Phone +49 3677 461-124 [email protected] www.iosb.fraunhofer.de/AST 1 Module based guidance systems for autonomous vehicles. 2 Mission of the TIETEK AUV. • 4D project DeDAvE: development of a deep-dive-able autonomous underwater vehicle for exploration • INAPRO: innovative model- and demonstration-based water management for resource efficiency in integrated multi-trophic agriculture and aquaculture systems • MoMo II: Integrated Water Resources Management for Central Asia: Model Region Mongolia (FONA – Research for Sustainable Development, BMBF) 1 • ABB Mina Abdullah (Industry) • Market survey - Twenty20 - Partnership for Innovation (BMBF) • EDIT - Pilot system for online monitoring of waterborne pathogens • ZIM-ASWA - development of a autarkic system solution for water and wastewater treatment with on-line process control in lightweight construction (BMWi) • ZIM-REWANET - intelligent automation solution for a resource efficient water supply network management and high-level tank management in drinking water supply systems (BMWi) 2 C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s 93 Information Management and Production Control (ILT) The objective of the department Information Management semantic annotation) and the fusion of heterogeneous sensor and Production Control (ILT) is to develop components and data to meaningful technical information and decision support complete solutions for the design, operation and maintenance (“Fusion4Decision”) enrich our products. of complex information, control and test systems. Our focus lies on the application domains of environment, health, risk In national and international projects we are responsible for management, resource efficiency, production and security. the systematic and moderated requirements analysis as well as for the specification and realization of service-oriented and On the basis of agile methods in requirements analysis, sys- event-driven architectures (SOA/EDA). tem design and recognized architectural and communication standards, we implement open, innovative, and customized We develop thematic applications and connect them to inte- software solutions, encompassing and driving new para- grated environmental information systems. Our software frame- digms of the “Internet of Things and Services” as well as work WaterFrame® renders data sources accessible and inte- “Industrie 4.0”. grates geographical information system (GIS) components as well as innovative geostatistical methods. WaterFrame® provides We analyze the suitability of modeling and communication support in generating thematic maps, diagrams and reports. methods for: With the ProVis production suite we realize production control • Complex manufacturing processes and facilities system components and integrated solutions according to (e.g. AutomationML and OPC-UA) • Environmental sensors and models (SensorML) functional requirements of MES (Manufacturing Execution • Environmental observations (geospatial standards of the Systems). The functions offered by ProVis range from monitoring and managing production facilities up to engineering Open Geospatial Consortium OGC) control rooms and the processes of manufacturing control and We model customers’ domain-specific knowledge with onto- fine-granular scheduling. This allows us to deploy production logies (Web Ontology Language OWL). We couple simulators control systems in automotive production sites and the steel and models on the basis of the High-Level Architecture HLA. industry (soaking pit plants), including the engineering and Our information management system “WebGenesis ” supports automatic configuration of these systems and development the ontology-driven generation of Web-based information tools for Web-based analysis and reporting systems. ® systems and Web portals with complex cross-linking of knowledge elements, problem-specific information analysis We develop and run test systems for selected de-facto stand- and personalized user interaction. ards such as Foundation Fieldbus, AutomationML, and HLA. Our objective is to promote the adoption of standards in the Our research results regarding smart services for the efficient market and to support interoperability in open systems. We search and retrieval in heterogeneous data sets (“big data”), therefore actively participate in the relevant standardization the extraction of knowledge with data mining methods (incl. bodies in VDI/VDE, DKE, DIN, IEC and OGC. 9 4 C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s Head of department: Dr.-Ing. Thomas Usländer Phone +49 721 6091-480 [email protected] www.iosb.fraunhofer.de/ILT Products • WebGenesis® – Web-based information and knowledge • Environmental Sensor Network INSENSUM management solutions for applications in the environment, Dr.-Ing. Siegbert Kunz traffic and automation sectors and for the documentation Phone +49 721 6091-600 of research projects [email protected] • WaterFrame – Java framework for the development of ® • Fieldbus Foundation conformance test center thematic applications and environmental information Dipl.-Ing. Michael Theis systems Phone +49 721 6091-321 • Fusion4Decision – service pattern and software platform for sensor data fusion and decision support based on OGC [email protected] • AutomationML test center standards Dr.-Ing. Miriam Schleipen • ProVis.Agent /Visu – agent-based production control ® Phone +49 721 6091-382 ® and visualization system for managing and monitoring automated production facilities [email protected] • HLA simulation test center • ProVis.Paula –production and plant data evaluation system Dipl.-Inform. Reinhard Herzog with data mining components Phone +49-721-6091-294 • ProVis.APS – Web-based fine-granular scheduling system [email protected] for continuous optimization of manufacturing schedules • AutomationML test system – Web-based conformance testing of AutomationML descriptions, available online at http://amltest.iosb.fraunhofer.de • GERTICO – Modeling and service infrastructure for coupled 1 Environment portal and envi- simulators based on HLA • SRL – Simulation Resource Library for the documentation of simulation tools and models • Network Calculus – methodology for the performance ronmental information systems. 1 evaluation of communication networks • ProVis – integration and test facility Dipl.-Inform. Gerhard Sutschet Phone +49 721 6091-370 [email protected] • WaterFrame®– integration and test facility Dipl.-Ing. Jörg Stumpp Phone +49 721 6091-259 [email protected] Hintergrundbild: Rainer Sturm / pixelio.de Infrastructure C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s 95 Fraunhofer Application Center Industrial Automation (INA) Competencies and portfolio The Fraunhofer Application Centre for Industrial Automation The Fraunhofer Application Centre for Industrial Automation (INA) in Lemgo, which was founded in fall 2009 in the center is a research institution in the BMBF-Edge Cluster “Intelligent of East Westphalia-Lippe, one of the most important regions Technical Systems East Westphalia-Lippe it´s OWL”, which is in the German engineering industry, pursues ambitiously currently the largest project in the field of Industry 4.0. its research vision: “an Internet for Machinery”, in which real-time information in all levels of an automation system is Research and development available and can be used by assistance systems for diagnosis and optimization. In this Internet for machinery devices and The Fraunhofer Application Center Industrial Automation services should be integrated easily by using the plug-and-play implements publicly funded research projects, works in the principle. Hardware and software are clearly separated and area of bilateral contract research, develops software and functions and data are distributed – a cloud for automation hardware prototypes and designs test and hedging solutions. emerges. Microelectronics, software technics and system engineering in conjunction with application knowledge from Areas of application are industrial IT, automation techniques, the automation provide the core competencies. Thus, imme- the machinery and equipment manufacturing and related diately applicable results for IT-based automation products sectors. and systems can be offered. Target groups are producers of hardware and software for automation, machine and plant Currently our work is based on the following priorities: manufactures and operators of technical systems. There the main focus of the INA lies on the provision of required system Cognitive processes for the automation: engineering for automation, to be able to capture, connect and intelligently process information easily. This includes In this working group, the development and use of computer the microelectronic implementation of embedded system models to support the life cycle of complex automation functions. systems is the focus of our activities. Since 2010 INA is a partner of the Centrum Industrial IT (CIIT). This includes per example: The CIIT, which is based on the Campus of the University of Applied Science East Westphalia-Lippe, is Germany’s • Data collection in distributed systems first Science-to-Business Center in the field of automation • Modeling of technical systems (machine learning) technologies. Under the motto “Where IT meets Automation” • Real-time forecast of technical systems with the goal of science and industry has established an open partner network self-configuration, -diagnosis and -optimization, condition and develop technologies for future IT-based automation monitoring techniques under one roof. 9 6 C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s Head of department: Deputy Head of department: Prof. Dr.-Ing. Jürgen Jasperneite Prof. Dr. rer. nat. Oliver Niggemann Phone +49 5261 702-572 Phone +49 5261 702-5969 [email protected] [email protected] www.iosb-ina.fraunhofer.de www.iosb-ina.fraunhofer.de Embedded Systems for the automation focuses on the mapping of all information-processing procedures and information- and communication-technologies This field summarizes our capabilities and activities in the from the control level up to the sensor. It is a hybrid technical development of innovative automation technologies, which process, ie the plant contains both - continuous and discrete are integrated by our partners in their products. process elements. This offers an ideal proving ground for the testing and validation of innovative technologies and products, • IP core development (VHDL, Verilog) for system-on-chip solutions (ASIC, FPGA), including verification • Intelligent networking, for example, based on real time Ethernet and Industrial Wireless as well as for their interaction. Since the end of 2013 the Lemgo Model Factory is part of the German-wide first intersite production network, which includes plant in Karlsruhe and Ilmenau. • Middleware solutions (e.g. OPC-UA) • Design and implementation of embedded real-time systems Lemgo Model Factory (LMF) In the CIIT, Fraunhofer Application Centre together with its partner institute InIT – Institute for Industrial IT of the University of Applied Science OWL, operates the Lemgo Model Factory (LMF), as a research platform for IT-based automation. The complexity of design, commissioning and operation of technical systems increases due to increasingly higher demands. Therefore design, commissioning and operation of technical systems become time-consuming and error-prone. The automation technology in use today lack mechanisms for self-configuration, self-optimization and selfdiagnosis, ability to face this progress and to suitable support the people. The impact of industrial IT in making technical systems in production processes more intelligent can already can be seen in the Lemgo Model Factory. The Model Factory is a production plant in the laboratory scale, in which real actuator, sensors, bus systems automation components and software of different vendors are implemented. The LMF C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s 97 Systems for Measurement, Control and Diagnosis (MRD) Competencies and Portfolio • Control and feedback control techniques --Model predictive and structure-variable control for appli- The acquisition and evaluation of sensory and other data plays a crucial role in many applications: in industry, sensory data, together with process models, establishes the basis for obtaining high-quality, universal functionality of products as well as facilitating an optimal productivity of production facilities. cations in process engineering, robotics, transportation and traffic engineering --Process control using data-driven models --Control using imaging sensors (visual servoing) • Data analysis for technical processes --Development, adaptation and application of methods for A full understanding of the processing chain – from data acquisition through processing and evaluation to optimization or feedback into the process, and always considering the classification, machine learning, and data mining --Generation of structure hypotheses, and analyses of causality dynamics and other characteristics of the process – is essential --Performance and condition monitoring also for other fields of application, such as environment --Anomaly detection processes, robotics, traffic and civil security. In this context the Systems of Measurement, Control and Diagnosis (MRD) department offers the following core competencies: --Diagnosis (e.g. to identify cause-effect relationships) • Information fusion --Multisensor fusion --Dynamic information fusion using heterogeneous sources • Modeling and simulation --Analytical, knowledge-based and data-driven modeling --Block-oriented and finite element models (e.g. using Matlab / Simulink, COMSOL) --Model reduction and parameter estimation (e.g. of finite element models for material and heat flows) --Modeling, simulation and image synthesis for imaging systems (e.g. under water, using deflectometry) --Applications in process engineering, ground water, biotechnology, automated visual inspection and robotics • Measurement and sensor techniques --Optical and imaging measurement techniques --Automated microscopy --Deflectometry and other image-based surface inspection methods --Tailored solutions for special applications of common measurement techniques (e.g. laser triangulation in pipes) 9 8 C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s (e.g. for environmental warning modules) --Fusion of image and geometry data (e.g. for pipe inspection, mobile robots, and surface inspection) • Robotics --Environment-interactive trajectory planning and manipulation, also in cooperation with humans --Simultaneous localization and mapping (SLAM), also using multiple sensory sources --Localization, path planning and control, also for cooperating mobile robots --Detection of (dynamic) obstacles --Control of complex kinematics in mobile robotics --Robot control based on ROS middleware • Image and signal processing --Real-time image and signal processing, suitable for industrial needs --Texture analysis Head of department: Dr.-Ing. Michael Heizmann Phone +49 721 6091-329 [email protected] www.iosb.fraunhofer.de/MRD --Defect detection on surfaces (e.g. using adapted features --Energy monitoring and optimization for home applications (e.g. coordination of heating and ventilation) and classification methods) --Generation of 3D data (e.g. using deflectometry, sidescan sonars, stereo cameras and other reconstruction methods) • Environment and resources --Quality control for water supply systems and waste water disposal --Processing of 3D data (measurement data and reconstruction results) --Early-warning systems for severe weather events (e.g. landslides) --Image processing for applications in robotics --Use of computer graphics for automated visual inspection --Multisensor inspection systems for water pipes and sewer ducts Applications and projects • Monitoring, control and optimization in process engineering (e.g. chemical and biotechnological processes) --Mass flux management (for water and soil) • Security --Security for drinking water supply (including sensor --Model-based control in process engineering (e.g. for glass drawing and biotechnological processes) --Tools for online process monitoring systems and management systems) --Surveillance of buildings and assets --Reconnaissance in emergencies (e.g. mapping and localiza- --Monitoring of wind energy plants tion for assistance robots; detection of victims • Quality and productivity assurance for process and and hazard sources) manufacturing engineering --Robot-based exploration --Optimization of production processes and products --Mine clearance in former conflict areas (e.g. for glass drawing processes and crop drying) --Tools for evaluating process and product data --Surface inspection (e.g. for painted, specular and textured surfaces) • Sensor systems 1 Deflectometric inspection of --Sensor development and adaptation for special applications (e.g. pipe inspection) --Image-based sensor systems for surface inspection a car body part. 1 --Systems for underwater applications --Automated microscopic inspection • Robot systems --Service robots (e.g. for home applications) --Mobile assistance and inspection robots --Applications of robotics in logistics and production --Robots for security applications --Agricultural robotics (e.g. for precision farming) --Processing of sensor data for unterwater robotics • Assistance systems --Assistance for efficient mobility (individual mobility and logistics) C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s 99 Secure Communication Architectures (SKA) For companies, communication services that function properly Cyber security are crucial to their survival. This includes globally networked Security is a continual process that is essential for maintaining locations, reliable, low-maintenance solutions, as well as the effectiveness of necessary technical measures. The loss of protected critical infrastructures for production, energy supply, sensitive corporate data to unauthorized parties and criminals and logistics. is currently one of the most serious security issues. For this reason we devote as much attention to attacks and vulnerable Our customers benefit from assured confidentiality and points as we do to holistic security management that is, authenticity in communication processes, comprehensive, accounting for company processes and statutory boundary individual solutions, reduction of investments through the conditions. use of standards, and low personnel levels for network and security management. Clearly-defined communication and Data protection in video surveillance interfaces between IT service providers and customers, and We address the need for privacy and data economy with between users and suppliers are a prerequisite for creating a solutions for monitoring the collection, processing and continual improvement process. dissemination of personal data. On a technical level our work ensures that personal data is used only for the intended Our work addresses the need for improved assurance of purpose within the surveillance system. privacy and data economy, and for support in collecting and processing personal data. We research and integrate solutions Watch over me! for technical monitoring and assuring that data in surveillance Modern video-supported surveillance systems are capable of systems is handled in accordance with the intended purpose. identifying and tracking persons or recognizing situations. We offer protection concepts for data management and Our current focus is on secure communication between processing. Our solution makes it possible to interactively mobile devices, suppression of unauthorized data loss, video alert the system through the use of gestures, so that affected surveillance in accordance with privacy-by-design principles, parties are able to interact with surveillance systems. We also usage control in video surveillance, secure parallel operation provide a video-based return channel from security personnel of IPv6 and IPv4, private cloud solutions for secure mobile to affected parties, which can be used to handle emergencies access, as well as consulting and auditing in accordance with in medical environments in particular. ISO/IEC 20000 by certified employees. Distributed usage control On behalf of the Fraunhofer-Gesellschaft, we are responsible Distributed usage control is a generalization of access control. for WAN communication at the Fraunhofer IOSB for over 150 Data can still be controlled once it has left your hands. In locations with more than 23,000 employees around the world, order to allow people to control the dissemination and usage who rely on our centralized range of services for IT security, of their data themselves, we conduct research for solutions e-mail, DNS and remote access. together with Fraunhofer IESE and TU Munich. In the process, 1 0 0 C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s Head of department: Dipl.-Inform. Thomas Kresken Phone +49 721 6091-273 [email protected] www.iosb.fraunhofer.de/SKA we establish the implementation of legal requirements on data -- Industrie 4.0: intrusion detection in production provenance and on the protection of intellectual property. -- KASTEL: IT security center of the BMBF -- PRECYSE: Prevention, protection and reaction to cyber An overview of our competences attacks to critical infrastructures -- CYSPA: European Cyber Space Alliance Information security -- Privacy and security in monitoring systems -- Confidentiality, authenticity and integrity of data -- Cloud services providing mobile access for authorities and communication organizations responsible for security -- Protection of critical infrastructures -- Creation of robust and secure cryptosystems -- Process-based security management in accordance with ISO/IEC 27000 -- Intrusion detection (IDS) and prevention (IPS) Identity protection and management -- Privacy-by-design and data protection in video surveillance -- Distributed usage control 1 User interaction with the -- Acceptance and usability of security and data protection solutions surveillance system enables -- Public key infrastructure (PKI) and planning of trust centers IT service management in accordance with transparency. 1 ISO/IEC 20000 -- Auditing and consulting Resources -- Cyber security lab -- IPv6 security lab -- Privacy-by-design video surveillance Tasks and projects -- Social media for companies – who is in control? -- Secure communication and data exchange between mobile end devices C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s 101 Core Competence Image exploitation Core Competence Image exploitation Interactive Analysis and Diagnosis (IAD) Profile and competencies The department Interactive Analysis and Diagnosis (IAD) and calculating large quantities of data. Humans, on the develops innovative interaction methods, smart environments other hand, are still superior to computers when it comes to and assistance systems with the aim of supporting people in recognizing and interpreting complex structures in images. various analysis tasks. The following solutions are currently provided: On one hand IAD is focused on the development of multimodal interaction within smart environments. The devel- Multimodal interaction oped interaction techniques apply mostly to video-based • Interaction with multi-display environments interaction methods which cover capturing and tracking of • Video-based posing and gesture recognition for human-machine interfaces persons, recognition of hand pose and pointing gestures, and analysis of activities within a certain environment using • Gaze-based interaction for video image analysis gaze-based interaction and speech. • Person tracking for interaction and building automation • Interaction techniques for mobile augmented-reality On the other hand IAD develops assistance systems, which support people in the process of decision-making. Application applications • Gesture-based interaction for industrial applications areas are diagnosis of technical systems, image interpretation, and intelligent surveillance systems. Our concepts take into Assistance systems account the strengths of both computer systems and humans. • Interactive and knowledge-based object recognition Computer systems are capable of rapidly saving, searching • Situation analysis for crisis management and security services • Setup of geodata infrastructure and software architectures 1 for surveillance systems • Optical measurement and vibration analysis applied to wind turbines The following products and projects are provided: • SmartControlRoom – An intelligent crisis center including innovative interaction • Gaze-based interaction for video image analysis • Digital Engineering Table DigET – Interactive decision support for industrial applications • Digital Map Table including Fovea-Tablett® – A multidisplay workspace for computer-supported collaborative work on geodata 104 Core Competence Image Exploitation Head of department: Dr. rer. nat. Elisabeth Peinsipp-Byma Phone +49 721 6091-393 [email protected] www.iosb.fraunhofer.de/IAD 1 SmartControlRoom. 2 Gesture controlled Digital Map Table. 3 Smart Video analysis. • RecceMan® – Interactive assistant for object identification • SiteAnalyst – Assistant for analyzing complex object arrangements • Maritime situation assessment for the detection of critical situations • ARtSENSE – Interaction techniques for mobile augmentedreality applications • Vibration analysis of wind turbines with long-distance 2 laser vibrometer • Image-based pitch angle analysis for wind turbines • MCMXT – Embedded system for 3D measurement tasks based on optical markers 3 Core Competence Image Exploitation 105 Interoperability and Assistance Systems (IAS) Competencies and portfolio The department Interoperability and Assistance Systems (IAS) The work includes the design, implementation and evaluation offers solutions to the market in which the interaction of of system solutions for interactive sensor data analysis, people with complex information systems plays the key role. knowledge creation and integration of knowledge into expert In a “system of systems” approach interoperability is vital. systems to support networked data analysis, the modeling of users, workflows and application domains, as well as compe- With research and development projects in the field of soft- tence management in distributed systems. Laboratory and field ware architecture for computer-based assistance systems experiments on demonstrators and operational systems are with a focus on dialog design and semantic interoperability, performed to optimize system performance and to evaluate we contribute to the technical and content networking of human-machine communication. In addition to developing systems. By designing dialogs that are adapted to the users basic system architectures that promote interoperability the and tasks we promote collaborative work using innovative department’s product range includes components for interactive multi-modal and multi-media interaction technologies. With image analysis, ontology-based specialist databases, network- ontology-based information systems, web services and intel- enabled information management systems, and training and ligent software agents the knowledge needed is distributed education systems. Compliance with and monitoring of national on time to the right people through suitable connections to and international software quality standards is an integral part personalized end-user devices in a layer-compliant granularity. of the development activities. Modern, technology-based learning environments and the use of “serious games” provide users with the required Our partners and clients include the German Federal Ministry decision-making abilities. Providers of knowledge-intensive of Defense (FMOD), Federal Office for equipment, information services will be supported in focusing on their core compe- technology and use of the Armed Forces (BAAINBw), tencies and creativity. the defense industry and the European Union. In various international cooperations experience in the field of imagebased reconnaissance and surveillance is exchanged. In our research we cooperate with universities, colleges and partner institutions. Applications are mainly in the fields of defense and civil security. 106 Core Competence Image Exploitation Head of department: Dr.-Ing. Rainer Schönbein Phone +49 721 6091-248 [email protected] www.iosb.fraunhofer.de/IAS 1 Interoperability. Projects and products Equipment • Image database – archiving system for the management • ISVA demonstrator – a hub for national and international of aerial and satellite images • Image data management system for aerial and satellite image analysis in the field of reconnaissance and surveillance • SAR Tutor – web-based training tool for SAR image analysis • Crayons – Web-based authoring and learning environment © • ViSAR – simulator for visualizing geometric radar effects • CSD/NSD Coalition/National Shared Database. Client-server system for distributing reconnaissance-relevant information secured networks in the field of reconnaissance and surveillance • SaLVe – radar image database center: a multi-sensor image data archive for remote sensing • AMFIS – reconnaissance and surveillance with miniature aircrafts in the sensor network (configurable ground control stations, various UAVs, UGVs and sensors) (requests, orders, messages, sensor data and products) in • A mobile ad-hoc sensor network (GPS, imaging and acoustic, 1 vibration, temperature, motion and light sensors) accordance with STANAG 4559 • MAJIIC – demonstration laboratory (restricted area): Multi- • ISAAC (ISr Artifact Access Client) Software Suite (.lib, .bat, sensor Aerospace-Ground Joint ISR Interoperability Coalition desk, .map, .web) for accessing CSD/NSD servers according to • DNBL – development laboratory (restricted area): Distributed STANAG 4559 (NSILI – NATO Standard ISR Library Interface) Network Battlelab Laboratory for certification and testing • ISVA – intelligent reconnaissance sensor combination for networking data, information, services and experts of components for networked intelligence gathering and reconnaissance • I2Exrep – database-supported form-based report generation for analysis of aerial and satellite images according to STANAG 3377/3596 and other reporting formats • DbEd – Data Tree Editor for creation and maintenance of the 1 reporting vocabulary used in image based reconnaissance • MAJIIC 2 – Multi-INT All-source Joint ISR Interoperability Coalition • AMFIS ground control station – Generic ground control station. AMFIS (reconnaissance and surveillance with miniature aircraft in sensor networks) for controlling and coordinating stationary and mobile sensors/sensor carriers, and for evaluating sensor data and situation reports Core Competence Image Exploitation 107 Object Recognition (OBJ) Expertise and Portfolio The department Object Recognition (Objekterkennung - OBJ) tion. The field of Heterogeneous Hardware Structures develops and evaluates algorithms for automatic object deals with the specification and combination of hardware detection and object tracking in sensor networks.The structures suitable for complex real-time vision systems. department’s activities range from the evaluation of video streams in the infrared and visual spectral band and the Especially with regard to military tracking systems, performance analysis of laser sensor data to the semantic description of evaluation is an essential topic. Based on years of experience a three-dimensional, dynamic environment via multi-sensory the field Tracking and Tracker Assessment deals with the data acquisition and automatic alerting in case of specifically development and design of evaluation schemes that interrelate defined occurrences. In addition, real-time implementations and evaluate both the performance ability of tracking algo- of the algorithms are evaluated on the basis of heterogeneous rithms and the risk analysis, while possible counter-measures hardware structures. are taken into account. The research work in the field of Object Recognition in Sen- The acquisition and analysis of 3D data is of increasing sor Networks is focused on the detection and representation importance in those application areas that require a high of objects in imagery data streams of interconnected mobile degree of automation and reliability of object recognition. sensors. In this context the technologies investigated include The department’s work in the field of Object Recognition aspect-independent descriptions of objects, the registration of in 3D Data is concerned with the development, optimization, sensor-generated images with three-dimensional context data, and evaluation of methods for 3D data analysis for use with and bandwidth-economical transfer of object information. established sensor techniques as well as prototypical hardware. In addition to object recognition, data acquired by theses sen- Video Content Analysis combines methods for the detection sors is used for detecting changes and for providing context and tracking of objects in video streams with algorithms for information for image exploitation. the conceptual description and analysis of the extracted quantitative information. The studies aim at devising systems Selected Projects for the semantic analysis of videos. This means that videos are not only analyzed quantitatively, but that the extracted • THS® - Target Handoff System information is associated with conceptual background knowl- • Semantic Video Analysis edge in order to draw conclusions from the visually perceived • MODISSA – Mobile Distributed Situation Awareness environment. • Change Detection in Lidar sensor data • VibroTrack – distant vibration measurement on running Machine vision algorithms extend from simple filtering functions up to complex analysis methods. Currently available hardware also varies with respect to computing performance, programming paradigms, architectures, and power consump108 Core Competence Image Exploitation wind turbines Head of department: Dr. rer. nat. Michael Arens Phone +49 7243 992-147 [email protected] www.iosb.fraunhofer.de/OBJ 1 Change detection based on 2 The project Semantic Video two aerial lidar scans: green Analysis aims at detecting, clas- color indicates manmade struc- sifying, and conceptually describ- tures present in both datasets, ing events and interrelations of whereas red and yellow color events in visually perceivable indicate vanished or added scenarios. structures, respectively. 1 2 Core Competence Image Exploitation 109 Scene Analysis (SZA) Core Competencies and Portfolio of transmission bandwidths to the generation of indications in both single and multiple images (change detection and Background of the department’s research activities is the change categorization). The common exploitation of data demand of intelligence and reconnaissance for the prompt from a multi-sensor platform (VIS, LWIR, Hyperspectral and availability of interpretation results with georeference. This LIDAR) is one of the key features of actual demonstrators includes both wide-ranging evaluation (screening) and local or future operational systems. Data fusion and information 3D scene reconstruction, required as a basis for decision making extraction capabilities are the core competencies for a success- in the context of military operations and disaster management. ful exploitation and are therefore one of the department’s A multitude of powerful airborne and spaceborne systems, main research activities. e.g., Heron, SAR-Lupe and TerraSAR-X, deliver data that can no longer be evaluated by humans due to its sheer volume Often a scene can be evaluated properly only if its spatial and the resulting work load. Automatic conditioning and extent can be determined. Therefore, the Scene Analysis processing of the data draws the analyzer’s attention to rele- department develops procedures for the automatic derivation vant sections, thereby also enabling the efficient processing of 3D descriptions of urban terrain based on the evaluation of large data volumes. For a fast and precise evaluation, the of multi-sensory image data acquired by spaceborne, airborne, analyzer needs assistance systems that are able to detect, or land-based reconnaissance systems. analyze and classify objects and scene changes. To utilize the efficiency of networked sensor systems, the The Scene Analysis department develops and studies methods method of interconnected sensor data evaluation must be for the automatic evaluation of multi-sensor image data in designed based on the “system of systems” concept. For reconnaissance networks. For this purpose efficient procedures this purpose, procedures are being developed which relate are being developed for segmentation, classification, scene the data of imaging sensors to a common reference frame. reconstruction, change detection, and fusion of a wide range The potential applications from the fusion of sensor data up of sensor data. The research focuses on to a real-time-generated overview of situations are being analyzed and adequate procedures realized. • Image interpretation • 3D object analysis Only few sensors can acquire evaluable image data, irrespec- • Cooperative data evaluation in sensor systems tively of the daytime or current weather conditions. The per- • Exploitation of Synthetic Aperture Radar (SAR) images formance of imaging radar systems, with a synthetic aperture (SAR) is hardly limited in this regard. Because of their phase- For processing large data volumes, the high-performance sys- preserving evaluation, interferometric SAR systems are able tems exploit the micro architecture of current workstations. In to capture the 3D shape of a scene. Furthermore, by using the scope of image interpretation the analysis of hyperspectral time series, minimal surface movements can be detected. SAR data is of particular importance. Here, methods for the extrac- images are difficult to interpret by a human due to the specific tion of relevant information take center stage. Applications mapping characteristics. Therefore, interpretation support is range from the pure reduction of data for a better utilization particularly valuable. SAR image analysis and simulation are 110 Core Competence Image Exploitation Head of department: Dr.-Ing. Karsten Schulz Phone +49 7243 992-106 [email protected] www.iosb.fraunhofer.de/SZA 1 Evaluation of hyperspectral sensor data. 2 View on an automatically therefore among the core competencies of the department, extracted model of the scene with a special focus on feature analysis, change detection „Vaihingen“ with buildings, and change categorization in SAR data. vegetation and terrain. ISPRS Benchmark: Research work focuses on the following core topics: www.isprs2012.org/abstract/1113.asp Image interpretation • Efficient screening procedures for the analysis of large 1 data volumes • Structural change detection • Analysis of hyperspectral image data • Fusion and exploitation of data from multi-sensor systems 3D object analysis • reconstruction of 3D objects from image sequences or laser scanner data • Automatic derivation of 3D building models from 3D point clouds • Image-aided navigation Cooperative data evaluation for networked sensor systems • Information fusion of sensor data and geo-information • Automatic georeferencing of image contents 2 1 • Preparation of sensor data showing urban terrain for simulation systems SAR image exploitation • Feature extraction and analysis, change detection and categorization • Simulation of SAR image signatures for interpretation assistance (CohRaSS: Coherent Raytracing-based SAR Simulator) • Determination of ground heaving or depression by means of time series • Model-based building reconstruction from interferometric SAR images Core Competence Image Exploitation 111 Video Exploitation Systems (VID) Competences and portfolio Tasks and projects Especially in image sequences pattern and situation recognition • ABUL – Automatic Image Exploitation for Uninhabited play a vital part in the fields of disaster management, criminal- Aircraft: Exploitation of video streams in ground control istics, homeland security, defense against terrorism, driving stations. Main systems: assistance, and industrial quality control. The complexity and --LUNA drone: UAV-based system for tactical purposes demands for robustness, reliability, and efficiency of the results are steadily increasing. (deployed by the German Bundeswehr in Afghanistan) --ADS-95 RANGER: UAV-based system for border surveillance --MiSAR: Exploitation of SAR image sequences The Video Exploitation Systems (VID) department is active in --HERON: NATO STANAG 4609 streaming test system the fields of automatic processing and exploitation of image --DNBL: Integrated system (connected with PPQ, Airbus signals in complex, mainly non-cooperative surroundings. The image data comes mainly from image acquisition sensors in multi-modal platforms (space, air, land, or water). VID Defence image exploitation system) for NATO exercises --SD9.4: Visualization and processing of STANAG 4609 video streams in the SD9.4 net as VM ware application develops and integrates software for image processing, fusion, and exploitation for autonomous and human-operated systems. • VABUL – Video Database ABUL: video database for the The main sensors to be exploited are visual-optical, infrared, Swiss Confederation SAR (Synthetic Aperture Radar), and others. A major aspect Interactive see-through augmented-reality device: of our work is the realization of components to be integrated augmented-reality device with integrated eye tracking into larger systems. In specific cases we can also develop the whole system. Further areas of expertise of the department include interoperability in heterogeneous networks and • NEST – Network Enabled Surveillance and Tracking: Open system architecture for multi-sensor property surveillance application domain knowledge. The use and performance profile of the developed software are measured by bench- • Federal Ministry of Education and Research (BMBF): marking and with test systems. Current activities include the Video-assisted systems for detecting conspicuous movement development of components for land vehicles, unpiloted patterns, attacks and assaults, and abandoned luggage air systems, autonomous land robots for surveillance, and security applications. Military applications – the exploitation of airborne and space-borne imagery – are also being developed. Another focus lies on developing new methods in the field of situational awareness and biometrical approaches. • Federal Ministry of Education and Research (BMBF): Videoassisted system for riot detection • Federal Ministry of Education and Research (BMBF): Person detection in forensic mass data • Federal Ministry of Defense (BMVg): Automatic camouflage assessment 112 Core Competence Image Exploitation Head of department: Dr.-Ing. Markus Müller Phone +49 721 6091-250 [email protected] www.iosb.fraunhofer.de/VID 1 Automatic Exploitation of Aerial and Satellite Image Data. 2 Pose and gaze estimation for mobile information systems. • Federal Ministry of Defense (BMVg): Robust tracking of moving objects from moving platforms in real-time Federal Ministry of Defense (BMVg): Image and image feature fusion (e.g. for automatic image stitching with high precision) • European Union (EU): System for offshore monitoring (detection of illegal border crossings and, smuggling of people, weapons, and drugs) 1 • European Union (EU): System for the detection of vehicle collisions • European Union (EU): Body identification assistance system 2 Core Competence Image Exploitation 113 Variable Image Acquisition and Processing (VBV) Research Group Competences and Research Topics and planning algorithms, this kind of approach paves the way for novel applications where traditional methods would fail or The Variable Image Acquisition and Processing (VBV) Research not be flexible enough. Group develops methods and systems for automated visual inspection that are based on variable image acquisition tech- Projects niques, or, more generally, exploit various kinds of heterogeneous information. Multiple theoretical and application-related • Situation analysis in maritime surveillance systems issues studied here in close cooperation with the other • Navigation of autonomous deep-sea vehicles departments of the IOSB and the Vision and Fusion Laboratory • Object classification in reconnaissance and surveillance via (Lehrstuhl für Interaktive Echtzeitsysteme – IES) of the Karlsruhe imaging sensors Institute of Technology (KIT) include: • Dynamic infrared pattern generation for deflectometric • Holistic systems theory-based modeling of image • Open adaptive modeling of the environment for artificial inspection acquisition and optimization of the evaluation process • Reproducible acquisition of optimal image series, for example by variation of illumination, focusing, camera position and optical filters • Fusion of data from the image series and from the other available information sources • Online control of the variable acquisition parameters (Active Vision) • Inspection and reconstruction of partially or fully specular surfaces cognitive systems • Probabilistic planning methods for deflectometric surface inspection • Optical signal pre-processing in spectroscopy and 3D shape measurement • Model reduction for non-linear and spatially distributed processes • Underwater Vision: acquisition and exploitation of underwater imagery • Interactive techniques for augmented reality environments • Detection of surface defects based on deflectometric The variability of image acquisition is crucial if a single image measurement data using wavelet analysis does not fully capture the features of interest of a studied • Person identification and face recognition in video data object or scene. The control system may then take multiple • Control of cyber-physical production systems images, adjusting the parameters – such as the camera’s posi- • Methods of face registration, 3D reconstruction, and super- tion or field of view (for example to improve visibility of the resolution in video data occluded objects) – or switching to different spectral bands. In • Methods of classification in hyper-spectral inspection combination with data fusion, this may provide a description • Planning and execution of maneuvers for autonomous quality that is hardly if at all achievable with other inspection vehicles in traffic methods. Facilitated by the availability of inexpensive camera • Analysis and generation of regular and statistical textures and manipulation systems and by the progress in modeling • Methods for specular 3D reconstruction 114 Core Competence Image Exploitation Head of department: Dr. rer. nat. Alexey Pak Phone +49 721 608-45912 [email protected] www.iosb.fraunhofer.de/VBV 1 Laboratory setup for infrared-deflectometry. 2 Deflectometric inspection in Robot / MiniCAVE laboratory. Infrastructure and equipment Robot laboratory: The laboratory’s industrial robot provides precise, automated, and reproducible adjustment of the image acquisition geometry. For example: illumination re-positioning allows very complex objects to be captured with a high degree of accuracy. In addition to traditional camera-based inspection, 1 the laboratory is used for the inspection of specular objects with a deflectometric sensor head. Infrared deflectometric laboratory: Certain diffuse surfaces (such as metal sheets used in auto bodies) are specular when observed in the thermal infrared spectrum allowing their accurate inspection for the presence of dents, waves, and irregularities using deflectometry. However, unlike thermal infrared cameras, long-wavelength imaging devices are not readily available. The laboratory hosts several prototypes of devices to generate fast thermal deflectometric pattern series. In particular, one prototype utilizes a powerful laser to “draw” a pattern on a moving plastic band. 2 MiniCAVE laboratory: Typically, the smaller the pattern projection screen, the longer a deflectometric inspection of a complex object takes. The radical way to increase the inspection area processed with a fixed camera-screen constellation is to completely enclose the object in a shell that serves as a screen. The MiniCAVE laboratory is equipped with digital projectors that enable a nearly complete coverage of the environment with encoding patterns (displayed on the walls and the ceiling). The research here is focused on calibration and measurement techniques in such environments and the associated advantages and challenges for the inspection tasks. Core Competence Image Exploitation 115 n a m e n , d a t e n , e r e i g n i ss e N a m e s , d at e s , e v e n t s Kuratorium Advisory Board F r aunho f e r I n s t it u t e of Opt r on ics, Sy stem Tech n olog ies a n d Ima g e Ex ploitati o n (D ecemb er 2 013) Dr. Fritz Merkle (Vorsitzender) OHB-System AG, Bremen Dr. Sven Olaf EADS Deutschland GmbH – Cassidian Electronics, Immenstaad MR Dr. Annerose Beck Sächsisches Staatsministerium für Wissenschaft und Kunst, Dresden Dr. Jörn Oprzynski Siemens AG, Karlsruhe Roland Bent Phoenix Contact GmbH & Co. KG, Blomberg Prof. Dr. Rüdiger Dillmann Karlsruher Institut für Technologie (KIT), Karlsruhe FZI Forschungszentrum Informatik, Karlsruhe Dr. Elmar Dorner SAP Research Center CEC, Karlsruhe Dipl.-Ing. Robert Fetter Thüringer Ministerium für Bildung, Wissenschaft u. Kultur, Erfurt Prof. Dr. Christian Heipke Leibniz Universität Hannover, Hannover RD Dr. Wolf Junker Bundesministerium für Bildung und Forschung, Bonn Prof. Dr. Helmut Klausing VDE e.V., Frankfurt MinR Peter Rothemund Wirtschaftministerium, Stuttgart Prof. Dr. Gert Siegle Hildesheim Marion Sielemann Bundesministerium der Verteidigung, Bonn Dr. Walter Stammler LFK-Lenkflugkörpersysteme GmbH, Unterschleißheim Prof. Dr. Christoph Stiller Karlsruher Institut für Technologie (KIT), Karlsruhe FZI Forschungszentrum Informatik, Karlsruhe MinR Norbert Michael Weber Bundesministerium der Verteidigung, Bonn Christoph Winterhalter ABB AG Forschungszentrum Deutschland, Ladenburg Gäste im Kuratorium: Dr. Rainer Kroth Diehl BGT Defence GmbH & Co. KG, Überlingen Dr. Norbert Kuschnerus Bayer Technology Services GmbH, Leverkusen Andreas Ernst Rheinmetall AG, Düsseldorf Dr. Thomas Steckenreiter Bayer Technology Services GmbH, Leverkusen Prof. Dr. Karl-Heinz Meisel Hochschule Karlsruhe – Technik und Wirtschaft, Karlsruhe Ständige Gäste im Kuratorium: Dr. Horst Nasko Technologiemanagement, München Dr. sc. techn. h.c. Dietrich Ernst Erlangen 117 n a m e n , d a t e n , e r e i g n i ss e N a m e s , d at e s , e v e n t s Internationale Gäste und Gastwissenschaftler International guests and visiting Scientists Qiucheng Li, PhD-Student, China Agriculture University Dr. Yaping Gao, Scientist at Yellow Fishery Research Beijing, China, 1.9.2012-31.8.2016 Institute, 26.2.-4.3.2013 Prof. Jihong Zhang, Yellow Fishery Research Institute, Dr. Eduard Santamaria, Post-Doc Stipendium, ERCIM 26.2.-4.3.2013 Fellowship, Universitat Politecnica de Catalunya, Spanien, Yellow Fishery Research Institute, Qingdao, 1.1.-31.5.2013 Italo Toselli, Italian citizen from the Italian Marine, ERCIM Prof. Daoliang Li, Head of China-EU Center for Information scholar (prior to that Naval Postgraduate School, Monterey, & Communication Technologies in Agriculture (CICTA), CA, USA), 1.9.2013-31.8.2014 16.1.-6.3.2013 Dr. Zhenbo Li, Scientist at Faculty for Information & Com- Toshimasa Iijima, Researcher, Industrial Research Institute munication Technologies in Agriculture, 16.1.-28.1.2013 Hokkaido Research Organization, http://www.hro.or.jp, Dr. Xinhu Chen, Scientist at Faculty for Information & Sapporo, Japan, research period abroad, 1.11.2013-31.3.2014 Communication Technologies in Agriculture, 16.1.-28.1.2013 Prof. Yaoguang Wei, Scientist at Faculty for Information & Herr S. Elbegbayan, Director of the water and wastewater Communication Technologies in Agriculture, 2.4.-6.6.2013 company of Darkhan, Mongolia, 21.11.-1.12.2013 Dr. Chunli Zhang, Scientist at Faculty for Information & Communication Technologies in Agriculture, 2.4.-6.6.2013 Mr. Benoit Mellier (FR), Mr. Ric Schleijpen (NL), Dr. Yingyi Chen, Scientist at Faculty for Information & Mr. Keith Naylor (GB), Mr. Neil Towning (GB), Communication Technologies in Agriculture, 15.7.-31.8.2013 Mr. Jan Bekkeng (NO), Mr. Anders Clausen (DK), Dr. Qui Ying, Scientist at Faculty for Information & Commu- NATO-Gruppe SCI-239, 17.-19.12.2013 nication Technologies in Agriculture, 15.7.-31.8.2013 China Agriculture University Beijing, China, Baena Galle, Doktorand, University of Barcelona and Royal Academy of the Sciences and Arts of Barcelona, Spanien, 1.2.2013-31.8.2013 118 Mitarbeit in Arbeitskreisen Working groups Counter - Improvised Explosive Device Multispektral (Multi Spectral) Ilja Kaufmann (Spokesperson), Thomas Längle (Spokesperson), Jan Bartelsen, Yvonne Fischer, Jürgen Geisler, Wolfgang Groß, Sebastian Bauer, Jürgen Beyerer, Carsten Dachsbacher, Klaus Jäger, Alexander Schwarz, Peter Solbrig Jörg-Detlef Eckhardt, Wolfgang Gross, Robin Gruna, Michael Heizmann, Matthias Michelsburg, Christian Negara, Health & Care Fernando Puente, Henning Schulte, Uwe Sörgel, Kym Watson (Spokesperson), Günter Struck, Kai-Uwe Vieth, Max Winkelmann Thomas Bernard, Yvonne Fischer, Michael Heizmann, Joris Ijsselmuiden, Andreas Jakoby, Ilja Kaufmann, Erik Krempel, Oberflächeninspektion (Surface Inspection) Kristian Kroschel, Andreas Meissner, Eduardo Monari, Markus Michael Heizmann (Spokesperson), Müller, Tanja Schultz, Rainer Stiefelhagen, Igor Tchouchenkov, Robin Gruna, Sebastian Höfer, Ilja Kaufmann, Thomas Längle, Michael Voit, Frank Weichert, Andreas Wenzel Wolfgang Melchert, Eduardo Monari, Thomas Müller, Christian Negara, Max-Gerd Retzlaff, Martina Richter, Maschinelles Lernen (Machine Learning) Matthias Richter, Masoud Roschani, Henning Schulte, Oliver Niggemann (Spokesperson), Alexander Schwarz, Miro Taphanel, Markus Vogelbacher, Christian Frey, Vladimir Hinze, Christian Kühnert, Stefan Werling, Mathias Ziebarth Fabian Müller, Matthias Richter, David Schaffranek, Andreas Wenzel, Sebastian Wuttke Mobile Endgeräte (Mobile Devices) Simon Lemaire (Spokesperson), Frank Pagel (Spokesperson), Björn Böttcher, Alexander Enderle, Peter Frühberger, Tianyi Guan, Marcus Hebel, Mario Kaufmann, Erik Krempel, Birger Krägelin, Siegbert Kunz, Christian Negara, Michael Okon, Daniel Szentes, Florian van de Camp, Hylke van der Schaaf 119 n a m e n , d a t e n , e r e i g n i ss e N a m e s , d at e s , e v e n t s Ehrungen und Preise Honors and Awards Highlight of the Journal of Optics (2012) was given to Stefanie Marcus Hebel was awarded Förderpreis Geoinformatik Dengler, Christian Kübel, Andreas Schwenke, Gunnar Ritt, 2013 for his dissertation: “Änderungsdetektion in urbanen Bernd Eberle for the publication “Near- and off-resonant optical Gebieten durch objektbasierte Analyse und schritthaltenden limiting properties of gold-silver alloy nanoparticles for intense Vergleich von Multi-Aspekt ALS-Daten“, The award was nanosecond laser pulses“. In: Journal of Optics, Vol. 14(7) given by Verein Runder Tisch GIS e.V., Technische Universität München, 10.4.2013 Eduard Santamaria, Igor Tchouchenkov, Rainer Schönbein, Florian Segor received Best Paper Award for the publication: Andrea Zielinski received Best Research Paper Award for her “Path Planning for Rapid Aerial Mapping with Unmanned publication: “Detecting Natural Disaster Events on Twitter Aircraft Systems“. The Eighth International Conference on across Languages“, 6th International Conference on Intelli- Systems (ICONS 2013), Spain, Seville, 27.1.-1.2.2013 gent Interactive Multimedia Systems and Services, Portugal, Sesimbra, 26.-28.6.2013 Jutta Hild, Elke Müller, Edmund Klaus, Elisabeth Peinsipp-Byma, Jürgen Beyerer were awarded Best Paper Award for the David Münch, Ann-Kristin Grosselfinger, Wolfgang Hübner, publication “Evaluating Multi-Modal Eye Gaze Interaction Michael Arens received Best Paper Award for their article for Moving Object Selection“. The Sixth International Confer- “Unconstrained Online Configuration of a Master-Slave ence on Advances in Computer-Human Interactions (ACHI), Camera System, 9th. International Conference on Computer France, Nice, 24.2.-1.3.2013 Vision Systems ICVS 2013, Russia, Saint Petersburg, 16.-18.7.2013 Jochen Meidow received the Hansa-Luftbild-Award 2013 for his article: “Efficient Multiple Loop Adjustment for Buren Scharaw received an honor by the Ministry Road, Computer Vision Tasks“ published in the journal “Photo- Transport, Construction and Urban Development Mongolia grammetrie – Fernerkundung – Geoinformation“ in the during the BMBF-delegation trip an, 2.9.2013 course of the 33rd Scientific-Technical Annual Conference of the German Society for Photogrammetry, Remote Sensing Jahanzaib Imtiaz, Ganesh Shrestha, Jürgen Jasperneite and Geoinformation of the Hansa Luftbild plc, represented received WIP Best Paper Award for their publication: “An by Dr. Paul Harfield (member of the board), Germany, Optimized OPC-UA Transport Profile to Bringing Bluetooth Freiburg, 28.2.2013 Low Energy Device into IP Networks“. The 18th IEEE Conference on Emerging Technologies and Factory Automation INNOVATIONSPREIS-IT (Innovation Prize-IT) under the patronage of the Ministry for Economics, Labour and Transport of Niedersachsen, BEST OF 2013, Solutions: Business software, EMS-EDM PROPHET®, 20.3.2013 Alexander Schick received the Industriepreis 2013 (Industry Pize 2013) in the category research & development for “Gesteninteraktion der Qualitätssicherung“ awarded by Huber Verlag für Neue Medien during the Hannover Messe 2013, 3.4.2013 120 (ETFA´2013), Italy, Cagliari, 10.-13.9.2013 Prof. Maurus Tacke from the NATO Research and Technology Organisation (NATO-RTO) was honored with the Von Kármán Medal for his impressive career, his dedication and his personal contribution to improving the research and technology cooperation between the NATO-States in the field of optronic. The Von Kármán Medal is the highest honor, which this committee awards. The Von Kármán Medal was conferred on Prof. Tacke in Vilnus during the Fall 2013 STB Symposium 18.-20.9.2013. Thomas Usländer, Arne J. Berre, Carlos Granell, Denis Havlik, José Lorenzo, Zoheir Sabeur, Stefano Modafferi received Best Scientific Paper Award for the publication: “The Future Internet Enablement of the Environment Informations Space“. ISESS 2013, Austria, Neusiedl am See, 9.-11.10.2013 Tobias Munz passed his exam as IT administator with distinction (“sehr gut“). He was awarded “BEST AZUBI“ by the Fraunhofer-Society. 121 n a m e n , d a t e n , e r e i g n i ss e N a m e s , d at e s , e v e n t s Besondere Veranstaltungen Special Events 21. Sitzung des Fachausschusses 3.51 »Bildverarbeitung in 1. Internationale Konferenz OCM 2013 der Mess- und Automatisierungstechnik« der VDI/VDE-GMA, »Optische Charakterisierung von Materialien«, Organisation und Leitung: Dr. M. Heizmann, Frankfurt a. M., IOSB, Karlsruhe, 6.-7.3.2013, 74 Teilnehmer 18.1.2013, 8 Teilnehmer Seminar »Sehen was andere nicht sehen«, Hector-Akademie, VDI Zukunftskongress Industrie 4.0 Leitung Dr. K. Stein, IOSB, Ettlingen 20.4.2013, 7 Teilnehmer Leistungsspektrum des GF Automatisierung Düsseldorf, 30.1.2013 8. Schul-Energie-Tag im Ilmkreis, Mitausrichter: AST Ilmenau, Goethe-Gymnasium Ilmenau, 24.4.2013, Exponat: Überall- Counter-IED Workshop, Fraunhofer IOSB, Organisation: kraftwerk / Wasserstoffauto (ca. 90 Teilnehmer: Schülerinnen / I. Kaufmann, Ettlingen, 29.-30.1.2013, ca. 40 Teilnehmer Schüler / Eltern / Lehrer aus Ilmenau und Umgebung) 47. Regelungstechnisches Kolloquium in Boppard, Ausrich- Girls’Day – Mädchen - Zukunftstag tung durch das Fraunhofer IOSB, organisatorische Leitung: Fraunhofer IOSB, Karlsruhe, Ilmenau, 25.4.2013, 40 Teilnehmer Dr. M. Heizmann, Boppard, 20.-22.2.2013, 33 Beiträge, ca. 200 Teilnehmer aus Hochschulen und Industrie 22. Sitzung des Fachausschusses 3.51 »Bildverarbeitung in der Mess- und Automatisierungstechnik« der VDI/VDE-GMA, Seminar »Sonne, Mond und Planeten«, Hector-Akademie, Organisation und Leitung: Dr. M. Heizmann Frankfurt a. M., Leitung: Dr. J. Krieg, IOSB, Ettlingen, 23. 2.2013, 7 Teilnehmer 26.4.2013, 11 Teilnehmer Seminar »Wie wird das Wetter gemacht«, Hector-Akademie, »IEEE International Conference on Robotics and Automation« Leitung: Dr. K. Stein, IOSB, Ettlingen, 2.3.2013, 7 Teilnehmer (ICRA2013), Mitarbeit bei der Koordination der Robot 16. SpectroNet Collaboration Forum, IOSB Karlsruhe, Karlsruhe, 6.-10.5.2013 Challenges: Dr. M. Heizmann, J. Petereit, T. Emter, 5.3.2013, 95 Teilnehmer Workshop »Where is the business in IoT?«, Leitung des Workshops: R. Herzog, Future Internet Assembly, Irland, Dublin, 8.-10.05.2013, 80 Teilnehmer 10th International Conference on Information Systems for Crisis Response and Management, ISCRAM 2013, Chair: Prof. Dr.-Ing. J. Beyerer, Co-Chair: Dr. T. Usländer, Baden-Baden, 12.-15.5.2013, ca. 300 Teilnehmer EMS-EDM PROPHET Anwendertage für Kunden von EMS-EDM PROPHET®, Ausrichter AST Ilmenau, Auerstedt, 4.-5.6.2013, 50 Teilnehmer 122 Regelungstechnisches Kolloquium in Boppard. VDI-Fachkonferenz: »Zustandsüberwachung und Optimierung«, Unified Greding (Messkampagne) 2013 fachliche Konferenzleitung: Prof. Dr.-Ing. habil. J. Beyerer, Wehrtechnische Dienststelle (WTD) 81, Greding, 23.-27.9.2013 inhaltliche Koordination der Konferenz: Dr. M. Heizmann, Karlsruhe, 12.-13.6.2013, ca. 45 Teilnehmer 23. Sitzung des Fachausschusses 3.51 »Bildverarbeitung in der Mess- und Automatisierungstechnik« der VDI/VDE-GMA, Workshops Nr. 2: »WIBAS 5.0: Vorstellung und Diskussion Neu- Organisation und Leitung: Dr. M. Heizmann, Frankfurt a. M., entwicklung Wasserrecht (u. a. Vorbereitung Datenmigration)«, 27.9.2013, 11 Teilnehmer Leitung des Workshops: T. Batz, 29. Fortbildungsveranstaltung Informationstechnik Wasser, Immissionsschutz, Boden, Abfall, Sitzung des EMS-EDM Produktbeirates, Ausrichter: Arbeitsschutz (WIBAS) des Ministeriums für Umwelt, Klima AST Ilmenau, Erfurt, 24.10.13, 12 Teilnehmer und Energiewirtschaft. Altensteig, 12.-13.7.2013, 30 Teilnehmer MAJIIC 2 MAJEX (Simulated Exercise) 2013 Veranstaltung gesamt: 114 Teilnehmer Niederlande, Den Haag, 28.10.2013-21.11.2013 Workshop: »Marktregularien«, Ausrichter: AST, Workshop »IT-Administration von EMS-EDM Prophet®«, AST Ilmenau, 23.7.2013, 10 Teilnehmer Ausrichter: AST Ilmenau, AST Ilmenau, 5.11.2013, 11 Teilnehmer Tutorial: »Exploiting Social Media for Natural Language Processing: Bridging the Gap between language-Centric and Seminar VS 10.05 »Videoüberwachung für Sicherheits- Real-World Applications«, 51st Annual Meeting of the asso- aufgaben« der Carl-Cranz-Gesellschaft e.V., Organisation ciation for Computational linguistics. Leitung des Tutorials: und Leitung: Dr.-Ing. G. Grasemann, Prof. Dr. S. Ponzetto, Dr. A. Zielinski, 3.-9.8.2013, Karlsruhe, 12.-14.11.2013, 6 Teilnehmer Bulgarien, Sofia, ca. 60 Teilnehmer Sehen, Verstehen, Vernetzen – Technologien des Fraunhofer MAROS 2013 – Maritime Robotik und Sensorik: IOSB für den Bedarf der Streitkräfte, Leitung / Organisation: »Design the Future 2025«, Ausrichter: AST Ilmenau, Prof. Dr.-Ing. habil. J. Beyerer, Dr. J. Geisler, Ilmenau, 9.-10.9.2013, 62 Teilnehmer Karlsruhe, 13.11.2013, 87 Teilnehmer 73. Sitzung des Fachausschusses 1.10 »Grundlagen Vortragsreihe: »Informationstechnologie“, Messsysteme« der VDI/VDE-GMA, Organisation und Leitung: Vorsitz: Prof. Dr. J. Jasperneite Dr. M. Heizmann, Maulburg, 16.9.2013, 9 Teilnehmer Vortragsreihe: »Produktion & Supply Chain“, Vorsitz: Dr. O. Sauer DAAD-Sommerschule »Sustainable Water Management« Kongress Industrie 4.0 – Flexibilisierung durch digitale, 2013, Mitausrichter: AST Ilmenau, AST Ilmenau und TU intelligente und agile Produktionsnetzwerke, Ilmenau, 16.-27.9.2013, 18 internationale Teilnehmer Stuttgart, 18.-19.11.2013, ca. 100 Teilnehmer IEEE Symposium on Precision Clock Synchronization for Industrie 4.0: Von der Strategie zur Praxis, Süddeutscher Verlag Measurement, Control and Communication (ISPCS´2013), Leistungsspektrum des GF Automatisierung Lemgo, 22.-27.9.2013, 150 internationale Teilnehmer Esslingen, 4.-5.12.2013 123 2013 2013 2013 2013 2013 2013 TriDec: Tsunami Early Warning System The TRIDEC-exhibit shows new developments in intelligent data processing for Crises Management based on two examples: a system for early discovery of impending incidents in drilling operations, not unusual at oil/natural gas boreholes, which have the potential to cause enormous damages to the environment, and the Tsunami Early Warning System for the Mediterranean and the Northeast Atlantic (under development). Visitors will be able to let the “Globe“ vibrate and see the seismological outcome. AquaBioTox: Online Monitoring of drinking water quality Water supply networks are constantly exposed to deliberate or accidental contamination. For the protection of public health there is significant interest in sensors and software systems to answer the following questions: Where is the source of the contamination? What impact will the contamination have on the water distribution network? Which measures are needed to contain the harm? This exhibit presents the online broadband sensor »Aquabiotox« and a simulation tool for the transport of ingredients in drinking water networks. SENEKA - Sensor Network with Mobile Robots for Disaster Management The SENEKA project idea aims to provide task forces and rescue teams with sensors and robots capable of forming dynamic networks, thereby significantly reducing the time required for the most important phases of disaster management when it comes to saving lives: reconnaissance of the disaster area and the search for victims and sources of danger. The SENEKA concept is particularly quick and efficient when it comes to exploring an unknown devastated area as the various sensors and robots distributed throughout the area are capable of networking with one another based on the situation (swarming), thereby enabling them to cooperatively complete complex reconnaissance and search missions. 124 2013 2013 2013 2013 2013 2013 Industrial Smart Grids Acquisition, monitoring and optimization of energy consumption are getting a central question in plant construction and mechanical engineering. An Industrial smart grid supports the operator of machines and plants to analyze and improve the system performance and efficiency continuously and to seek an optimum working point. An Industrial Smart grid supports a more uniform energy consumption by an active real-time load management as well as to improve the power quality by reducing harmonics. As a result energy costs will be reduced and the life-time of electronic equipment used in production lines will be extended. The demonstrator shows a technical process with a real-time energy management at the PLClevel and the data communication with the energy provider. Interactive Video Surveillance Interactive Video Surveillance systems enable communication with the monitored people. This can happen either via gesture recognition or by mobile devices. These new “active“ users aid the operator which now can react faster and more precisely. Important information is send to the security guards mobile devices, which improves reaction time and team coordination. Additional features become available for the supervised persons. They can receive navigation help and view which personal data is processed by the system. Next to these new features, we will also present the integration of some privacy protection principles, i.e., “Privacy by Design“ and “Privacy by Default“. These principles become increasingly important, as they are required in the proposal for the reform of the EU data protection reform. Gesture recognition in manufacturing For quality assurance, BMW checks all their bumpers and other painted parts multiple times. Currently, workers have to leave their workplace and enter the results into the quality assurance system after visual inspection. The Fraunhofer IOSB developed a gesture recognition system that can make this process more intuitive and efficient. Pointing gestures are now recognized at the place of inspection to directly tell the quality assurance system the location and type of the production error. The workers do not need to leave the place of inspection anymore and the whole process becomes faster and more intuitive. 125 2014 2014 2014 2014 2014 2014 CyphWay: The One Device for Secure Communication Her wide range of use makes tablets and smartphones to be a lucrative destination for espionage. The CyphWay - developed at the Fraunhofer IOSB - closes this vulnerability. The core of the CyphWays is a trusted hardware module. It encapsulates and protects the safety-critical components, such as the en- and decryption unit as well as key management. It ensures optimal protection of sensitive data. A communication module enables the connection of the trusted hardware module to the used terminal. Deflectometry Fraunhofer IOSB offers solutions, for measurements and assisted evaluations of painted surfaces. Basing on deflectometry, shape and waviness of surfaces will be analyzed. The FEM based measurement allows the direct, automated comparison with the CAD design as well as the detection of local surface defects. The manual, gesture based evaluation of the measured results and their documentation within the measurement protocol, complete the process. Indexed by gesture control, features are forwarded with position information to the testing system. The completed document contains the 3-D reconstruction and information which have been generated by additional interaction with the object. VibroTrack Vibrations are one main issue on the developing and maintenance of wind turbines. Laser vibrometry, based on doppler shift of light, is able to determine vibrations from a distance also on parts of the turbine, where no sensors have been integrated. Fraunhofer IOSB has developed a tracking system and an optimized laser vibrometer, which are able to even scan the moving rotor blades. An image processing system tracks and stabilizes the laser spot on the rotating blade. This allows for scanning the vibration characteristics of the whole blades under real operating conditions. MicroLab Fraunhofer IOSB combines in its newly arranged microscopy laboratory MikroLab several microscopic devices with different sensor properties each. This combination is achieved by instrumenting well-established automation systems to provide an automatized microscopic inspection. Thinking of quality assurance, microscopic inspection is getting more and more important. In order to preserve given installations a non-invasive way of integration must be followed. The measurement setup given demonstrates an experimental setup by using standard industrial components. 126 2014 2014 2014 2014 2014 2014 SpectralFinder: System for real-time distinction of materials The system developed by Fraunhofer IOSB uses hyperspectral data for the distinction of materials in real-time. While regular cameras capture colors in only three broad channels (red, green and blue), the system‘s hyperspectral videocamera has a spectral resolution of over 130 much finer channels. These allow distinction of chemically different but visually similar materials. Applications include mining operations, airborne evaluation of large areas and also, due to its video capabilities and efficient processing algorithms, moving objects at production lines. EO2HEAVEN: Man, Environment and Health A global challenge is to better understand the complex relationships between environmental factors, population exposure and their impact on human health. The exhibit builds on results of the FP7 projects ENVIROFI and EO2HEAVEN to demonstrate early warning systems (EWS’) in environmental health relating to air pollution and the water-borne disease cholera. The EWS’ for both decision makers and scientists use a GIS and Spatial Information Infrastructure based upon open standards for web-services. A mobile app to record health data in the field provides data to the EWS. SENEKA: Sensor Network with Mobile Robots for Disaster Management The SENEKA project idea aims to provide task forces and rescue teams with sensors and robots capable of dynamically forming demand-responsive networks, thereby significantly reducing the time and improving accuracy required for reconnaissance of the disaster area and the search for victims and sources of danger (e.g. gases). The ad-hoc nature of natural disasters (e.g. earthquakes), terrorist attacks and large-scale industrial accidents (e.g. in nuclear power plants) makes rapid, extensive, situation-specific reconnaissance and detection of victims and sources of danger essential for saving lives. NurseEye Video-based fall- and emergency detection contributes greatly to safety in hospitals and care facilities. Due to highly winding and vast campuses it is often complicated to provide fast and reliable help for those in need without technical support. The care sector comes with additional requirements on data protection and respect for privacy. With the video-pillar care we present novel concepts for emergency detection, alerting of care attendants as well as methods for data protection and acceptance of such technology by staff and patients. 127 n a m e n , d a t e n , e r e i g n i ss e N a m e s , d at e s , e v e n t s Messen und Fachausstellungen trade fairs and exhibitions E-world energy & water VfS Kongress Control 2013 2013 Leipzig, 9.-10.4.2013 Stuttgart, 14.-17.5.2013 Essen, 5.-7.2.2013 Exponat: Exponate: Exponat: --(1,e)-Gateway --CCT-Sensor --EMS-EDM PROPHET --Deflektometrie-Sensor Wasser Berlin 2013 Leipziger Buchmesse Berlin, 23.-26.4.2013 Cloudzone Leipzig, 14.-17.3.2013 Exponat: Karlsruhe, 15.-16.5.2013 Experteninterview zum Thema --BMBF-Stand: Touchscreen Exponate: Energiewende (Martin Käßler) Exponat MoMo --CyphWay --Cloud für sensible Daten HMI 2013 AFCEA Hannover, 8.-12.4.2013 Bonn Bad Godesberg, Jahresfachtagung der Ver- Exponate: 24.-25.4.2013 einigung des deutschen --SENEKA - Sensornetzwerk Exponate: Brandschutzes e.V. (vfdb) mit mobilen Robotern für das --ABUL Weimar, 27.-29.5.2013 Katastrophenmanagement --AMFiS Exponate: --AquaBioTox-Demonstrator II --A3GSim --SENEKA - Sensornetzwerk --Gestenbasierte Qualitäts- --(1,e)-Gateway mit mobilen Robotern für das --Blickbasierte Interaktion Katastrophenmanagement kontrolle --QUANJO TDS --TRIDEC - Tsunami Frühwarnsystem IT&Media Darmstadt, 24.-25.4.2013 1. Thüringer Exponate: Elektromobilitätstag --Energiedemonstrator --(1,e)-Gateway Erfurt, 7.6.2013 --Industrie 4.0: Virtual Fort --CyphWay Exponat: --NEST-FlughafenDemonstrator --sMobiliTy Knox (ProVis APS – Feinplanung aus der Cloud) --BMBF-Stand: Secure-Plugand-Work --Stand Fraunhofer-Allianz Energie: Bildschirmexponat »Die Welt der Energie in Zahlen« --Gemeinschaftsstand mit CIIT Partnern: Spitzencluster »Intelligente Technische Systeme OstWestfalenLippe, it’s OWL« 128 ISCRAM 2013 Baden-Baden, 12.-15.5.2013 Fachtagung Exponate: Produktionsmesstechnik --SENEKA - Sensornetzwerk Buchs, Schweiz, 3. – mit mobilen Robotern für das 4.9.2013 Katastrophenmanagement Exponat: --Mobiles Lagezentrum --AMFIS --INSENSUM Messstation --CCT Sensor VDMA Kongress VDE-ETG-Kongress 2013 „Intelligenter Produzieren“ Energietag Hannover, 16.-17.9.2013 Berlin, 5.-6.11.2013 Posterpräsentation: Automa- Posterausstellung der Abt. tisierung und Industrie 4.0 Energie MSV Brünn Medica 2013 Brünn, Tschechische Republik, Düsseldorf, 20.-23.11.2013 7.-11.10.2013 Exponat: Exponat: --AutoTrack --Bildschirmexponat »Die (Patienten-Tracking-System) Welt der Energie in Zahlen« AES 2013 It-sa Washington DC, USA, Nürnberg, 8.-10.10.2013 6.-13.12.2013 Exponate: Exponat: --(1,e)-Gateway --AutoTrack (Patienten- --CyphWay Tracking-System) --InfoVis --Cloud für sensible Daten INTERGEO Essen, 8.-10.10.2013 Exponate: --Wingpod --Beispiel zur Änderungsdetektion im Bergbau --Software zur Echtzeitklassifikation hyperspektraler Bildsequenzen ThEGA-Forum 2013 Arnstadt, 14.10.2013 Stand mit Präsentation der Abt. Energie 129 n a m e n , d a t e n , e r e i g n i ss e N a m e s , d at e s , e v e n t s Mitarbeit in Gremien Participation in Committees Adomeit, U.: Beyerer, J.: --Mitglied der NATO-Gruppe ET-080 »Exploitation of Human --Stellvertretender Vorsitzender des Fraunhofer-Verbundes für Signatures for Threat Determination« --Vorsitzender der NATO-Gruppe SET-ET-083 »Assessment and modelling the performance of digital night vision image fusion« Verteidigungs- und Sicherheitsforschung VVS --Mitglied des Kuratoriums des Forschungszentrums Informatik (FZI), Karlsruhe --Vorstandsmitglied des Kuratoriums der Hochschule Karlsruhe Agsten, M.: Technik und Wirtschaft --Mitglied VDE Arbeitskreis Smart Grids --Leitung des Technischen Forums der Firma inspectomation Ament, C.: --Mitglied acatech - Deutsche Akademie der Technikwissen- GmbH, Mannheim --Mitglied im Rat der Fakultät für Informatik und Automatisierung der TU Ilmenau --Gutachter des DAAD: Auswahl für Doktorandenprogramme schaften e.V., München und Berlin --Sprecher Themennetzwerk Sicherheit, acatech --Mitglied des Editorial Board der Zeitschrift »Information Fusion« Elsevier Arnoldt, A.: --gewähltes Mitglied im Beirat der VDI/VDE GMA --Mitglied und Vertreter der Abt. NRG des IOSB-AST im --Mitglied im wissenschaftlichen Beirat der Zeitschrift at – Fraunhofer-Netzwerk Windenergie --Mitglied im VDE/DKE Backendsysteme Automatisierungstechnik der GMA (VDI/VDE-Gesellschaft Mess- und Automatisierungstechnik) und der NAMUR (Interessengemeinschaft Prozessleittechnik der chemischen Batz, T.: --Mitglied der Gesellschaft für Informatik, Fachgruppe Datenbanksysteme --Mitglied der Gesellschaft für Informatik, Fachgruppe Requirements Engineering --Mitglied bei Gesellschaft für Projektmanagement (GPM) und pharmazeutischen Industrie) --Member of IEEE Computer Society --Member of IEEE Intelligent Transportation Systems --Member of Society for Industrial and Applied Mathematics (SIAM) --Member of The International Society for Optical Engineering (SPIE) Baumann, M.: --Mitglied im Industriearbeitskreis »Produktionslogistik für die variantenreiche Serienfertigung« --Mitglied der Deutschen Arbeitsgemeinschaft für Mustererkennung e.V. (DAGM) --Mitglied im VDE --Mitglied im Beirat der Deutschen Initiative für Netzwerk- Beyer, D.: information (DINI) --Mitarbeit im BITKOM --Mitglied im Beirat der Zeitschrift »Strategie und Technik« --Mitarbeit im IEA ECES Annex 26 »Electric Energy Storage - --Mitglied im Beirat der Zeitschrift »Europäische Sicherheit Future Energy Storage Demand« und Technik« --Mitglied in der Jury INNOVATIONSPREIS 2013, Initiative Mittelstand 2013, in den Kategorien E-Learning und Wissensmanagement 130 Bohn, S.: --Mitglied im Programmkomitee der Teilkonferenz: Crisis --Mitglied VDE Arbeitskreis »Smart Grids« Management – Information Systems, Humanitarian Logictics and IT-based Decision Support, Multikonferenz Wissen- Boldt, M.: schaftsinformatik, Paderborn, 26.-28.2.2014 --Session Chair for the SPIE Conference Session 2: »Infrastruc- --General Chair der OCM (International Conference on Optical Characterization of Materials), Karlsruhe, 6.-7.3.2013 --Robot Challenge Chair of the IEEE Conference on Robotics tures and Urban Areas II«, and Session 3 »GIS Education«, Conference: Earth Resources and Environmental Remote Sensing / GIS Applications IV and Automation (ICRA), Karlsruhe, 6.-11.5.2013 --Conference Chair of the ISCRAM 2013, 10th International Bretschneider, P.: Conference on Information Systems for Crisis Response and --stellv. Sprecher Fraunhofer-Allianz Energie Management, Baden-Baden, 12.-15.5.2013 --Koordinator im Netzwerk »Intelligente Energienetze« --Session Chair Conference EOM 106B Automated Visual Inspection, SPIE Optical Metrology, München, 13.-16.5.2013 --Konferenzleiter der vom VDI Wissensforum organisierten Konferenz Zustandsüberwachung und Optimierung, Karlsruhe, 12.-13.6.2013 --Mitglied im Programmausschuss der »8th Future Security«, Berlin, 17.-19.9.2013 --Mitglied im Programmkomitee des IEEE-Workshops »Sensor Data Fusion – Trends, Solutions Applications«, Bonn, 9.-11.10.2013 --Mitglied im Programmkomitee der FORMS/FORMAT (»Formal Methods for Automation and Safety in Railway and Automotive Systems«), Braunschweig, 30.9.-2.10.2014 --Mitglied im Netzwerk Windenergie --Mitglied im Fraunhofer-Netzwerk »Energiespeichersysteme und Netze« --Mitglied im GMA FA 5.14 »Computational Intelligence« (GI Fachgruppe Fuzzy-Systeme und Soft-Computing) --Mitglied im BDI-Arbeitskreis »IT für Energiemärkte der Zukunft« --Mitglied im Institut für Energiewirtschaftsrecht Jena --Mitglied im IEA ECES Annex 26 »Electric Energy Storage Future Energy Storage Demand« --Mitglied im Netzwerk Solarinput --wissenschaftlicher Leiter der Arbeitsgruppe Energiespeicher im Thüringer Netzwerk »Material innovativ Thüringen« --stellv. Vorstandsvorsitzender des Thüringer Erneuerbare Bernard, T.: Energien Netzwerk (ThEEN) --Mitglied im NAMUR-Arbeitskreis 2.2 »Prozessführung« --Stellvertretende Ombudsperson im IOSB zur Sicherung guter wissenschaftlicher Praxis Bulatov, D.: --Reviewer »Photogrammetrie – Fernerkundung – Geoinformation (PFG)« Bier, C.: --Reviewer »ISPRS-Journal of Photogrammetry« --Mitglied im DIN-Gremium Arbeitskreis »Normung« Bürsing, H.: Birkle, M.: --Wissenschaftlicher Beirat der IWRM (Integrated Water Resources Management)-Konferenz 2014 der Karlsruher Messeund Kongress GmbH (KMK), Karlsruhe, 19.-20.11.2014 --Mitglied NATO-Gruppe SCI-239 »Countermeasure Concepts Against Future IR/EO Threats« --Mitglied der NATO-Gruppe SCI-ET-264 »Protection of Military Systems from High Energy Laser (HEL) Attacks« 131 n a m e n , d a t e n , e r e i g n i ss e N a m e s , d at e s , e v e n t s Mitarbeit in Gremien Participation in Committees Carmer von, C.F.: Ebert, R.: --Mitglied in der NATO SET-144 Gruppe »Mitigation of ship --National Member NATO SET Panel Electro-Optical Susceptibility against Conventional and Asymmetric Threats« --Mitglied der NATO-SET-ET-082 »Naval Platform Protection in the EO/IR Domain« --Governmental Expert of EDA CapTech IAP03 »Optical Sensor Systems & Signal, Image Processing« --Co-Chair Symposium SPIE Security and Defence 2013, Dresden, 23.-26.9.2013 --Mitglied in der NATO SCI-224 Gruppe »ET on EO & IRCountermeasures against Anti-ship Missiles« --Mitarbeit CSSM WG 2 an IR Ship Signature Management Systems, DEU, NLD, CAN, NOR, BEL Eck, R.: --Mitglied im Fachbereich 2 »Dienste und Anwendungen« der Informationstechnischen Gesellschaft (ITG) im VDE Chaves, F.: Even, M.: --Vertreter des IOSB im Koordinierungsausschuss F+E IuK im --Mitglied NATO-RTO-SET-145 »Extraction of Geospatial Rahmen der Kooperation KEWA des Umweltministeriums Baden-Württemberg Intelligence Information from Space Borne SAR Sensors« --Reviewer IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Dimitrov, T.: --Mitarbeit im BITKOM AK Industrie 4.0 Fischer, Y.: --Technical Program Committee, CogSIMA, San Diego, USA, Dimmeler, A: 25.-28.2.2013 --Mitglied der NATO-Gruppe SCI-239 »Countermeasure Concepts against future IR/EO Threats« --Mitglied der NATO-Gruppe SET-190 »Phenomenology and Exploitation of Thermal Hyperspectral Sensing« Frey, C.: --Mitglied im VDI/VDE-GMA-Fachauschuss 5.14 »Computational Intelligence« --Mitglied bei EDA DUCAS »Detection in Urban scenario using Combined Airborne imaging Sensors« Gladysz, S.: --Mitglied in der NATO SET-165 Gruppe »Adaptive Optics for Dunau, P.: --Mitglied in der NATO SCI -212 Gruppe »Performance Criteria for Camouflage Systems derived from Operational Scenarios« Laser Beam Delivery and Passive and Active Imaging and Turbulence Mitigation« --Session Chair, Committee Member, »Adaptive Optics: Methods, Analysis and Applications« 23 - 27 Juni 2013, Arlington, USA Eberle, B.: --Reviewer »Optics Express« --Chairman der NATO-Gruppe SET-ET-198 »Visible Laser Dazzle – Effects and Protection« --Mitglied im »Team of Experts« zur Revision der STANAG 4495 »Eye Protection for the individual Soldier – Laser Protection« Grasemann, G.: --Arbeitskreis Video des Verbands für Sicherheitstechnik e.V. (VfS), Hamburg --Arbeitskreis Gebäudemanagement des Verbands für Sicherheitstechnik e.V. (VfS), Hamburg 132 Groß, W.: --Mitarbeit bei DEU - CHE Kooperation »Hyperspectral Imaging« --Mitarbeit bei DEU - ISR Kooperation »Hyperspectral Reconnaissance« --Organisatorische Leitung des Regelungstechnischen Kolloquiums in Boppard --Mitglied im Programmausschuss »International Conference on Optical Characterization of Materials« (OCM-2013), Hammer, H.: --Mitarbeit bei DEU - ISR Kooperation »Visual Processing, Multisensor Fusion & Exploitation for ISR Application« --Reviewer »GRSL – Geoscience and Remote Sensing Letters« Karlsruhe, 6.-7.3.2013 --Mitglied im Programmausschuss Konferenz »Automated Visual Inspection« der SPIE Optical Metrology 2013, München, 13.-16.5.2013 Hebel, M.: Herzog, R.: --Mitglied der Deutschen Gesellschaft für Photogrammetrie, --MSG-ET-035: Leitung der NATO Arbeitsgruppe Fernerkundung und Geoinformation e.V. (DGPF) »Development of High Level Architecture (HLA) Federation Compliance Test Tool« Heizmann, M.: --Stellvertretender Vorsitzender des Fachbeirats des Fachbereichs 3 »Fertigungsmesstechnik« der VDI/VDE-Gesellschaft Mess- und Automatisierungstechnik (GMA) seit 01/2012 --MSG-106: Mitarbeit in der NATO Arbeitsgruppe »Enhanced CAX architecture, design and methodology« --Mitarbeit in der Standards Working Group des Open Geospatial Consortium »Sensor Web for IoT SWG« --Leitung des Fachausschusses 3.51 »Bildverarbeitung in der Mess- und Automatisierungstechnik« der VDI/VDE- Hild, J.: Gesellschaft Mess- und Automatisierungstechnik (GMA) seit --Session Chair auf der DigitalWorld (ACHI), Nizza, Frankreich, 03/2006 24.2.-1.3.2014 --Leitung des Fachausschusses 1.10 »Grundlagen der Messsysteme« der VDI/VDE-Gesellschaft Mess- und Automa- Jacobi, M.: tisierungstechnik (GMA) seit 04/2011, Mitarbeit seit 11/2005 --Beirat VDI-GMA als Vertreter der Studenten und --Vertretung des Fraunhofer IOSB im Arbeitskreis der Jungingenieure des VDI Fraunhofer-Allianz Vision seit 06/2004 --Leitung des Arbeitskreises »Oberflächeninspektion« am Fraunhofer IOSB seit 10/2010 --Mitglied des Fachbeirats 1 »Grundlagen und Methoden der Mess- und Automatisierungstechnik« der VDI/VDEGesellschaft für Mess- und Automatisierungstechnik (GMA) Jakoby, A.: --Mitglied AG »Digital vernetztes Unternehmen« Initiative »Weiterentwicklung der IKT in Baden-Württemberg« --Mitglied Forschungsorientierte sektorale Themenplattform 3 der Polizei seit 01/2013 --Mitglied im wissenschaftlichen Beirat des Kooperativen Promotionskollegs „Entwurf und Architektur Eingebetteter Systeme (EAES)“ der Hochschule Pforzheim und der Universität Tübingen seit 12/2012 --Mitglied im VDI 133 n a m e n , d a t e n , e r e i g n i ss e N a m e s , d at e s , e v e n t s Mitarbeit in Gremien Participation in Committees Jasperneite, J.: Kresken, T.: --Co-Chair des Subcommittee on Information Technology --Mitglied Allianz für Cyber-Sicherheit in Industrial and Factory Automation (IES FA 5) in der IEEE --Mitglied Cyberforum e.V. Industrial Electronics Society --Mitglied der Fachredaktion der ATP (Automatisierungstechnische Praxis) --Mitglied VDI/VDE Gesellschaft Mess- und Krol, O.: --Stellvertreter des IOSB in der Fraunhofer-Allianz SysWasser --Vertreter des IOSB in der German Water Partnership Automatisierungstechnik (GMA) --Mitglied GMA-Fachausschuss 5.12 Echtzeitsysteme Kuntze, H.-B.: --Mitglied GMA-Fachausschuss 6.15 Zuverlässiger Betrieb --(Gründungs-) Mitglied des VDI-GMA-Fachausschusses 4.13 Ethernet-basierter Bussysteme in der industriellen Automatisierung (Leitung) --Mitglied GMA-Fachausschuss 7.21 »Industrie 4.0« - Begriffe, Referenzmodelle, Architekturkonzepte »Steuerung und Regelung von Robotern« --(Gründungs-) Mitglied im VDI/VDE-GMA-Fachausschuss 5.14 »Computational Intelligence« --Mitglied der Deutschen Gesellschaft für Robotik (DGR) --Vorstandmitglied OWL-Maschinenbau --stellvertretender Sprecher der Fraunhofer-Allianz Embedded Systems --IEEE Senior Member --Mitglied der IEEE Computer Society --Mitglied der IEEE Communications Society Kunz, S.: --Koordinator des EMV-Kompetenzverbundes Fraunhofer EMC --Mitglied in der Deutschen Gesellschaft für EMV Technologie e. V. (DEMVT) --Mitglied in der Deutschen Gesellschaft für Produktmanagement (GPM) Kaufmann, I.: --Mitglied der »Threat Detection Expert Community« der EDA Kühnert, C.: --Mitglied im VDI/VDE-GMA-Fachausschuss 5.14 Krägelin, B.: »Computational Intelligence« --Mitglied der Gesellschaft für Informatik --Mitglied der Fachgruppe »Arbeitsplatzsysteme« der Gesellschaft für Informatik Längle, T.: --Paritätische Kommission zum Leistungsentgelt am IOSB --Mitglied im VDI --Mitglied Personalentwicklungskonzept 2 am IOSB --Mitglied im Beirat der Deutschen Initiative für --Program Chair International Conference on Optical Netzwerkinformationen (DINI) Characterization of Materials (OCM 2013) in Karlsruhe --Mitglied Sprecherkreis IT-Sicherheitsbeauftragten der Fraunhofer-Gesellschaft Li, P.: --Mitglied der Studiengangkommission Ingenieurinformatik Krempel, E.: --Mitarbeit in ETCETERA - Workshop: Validation of Future Civil Security Technologies --Mitarbeit in ETCETERA – Workshop: Framework Conditions of Civil Security Technologies 134 --Mitglied der Stipendienkommission der chinesischen Regierung für chinesische Studenten --Beauftragter vom Rektor für den wissenschaftlichen Austausch China-Südasien Meidow, J.: Pfrommer, J.: --Mitglied der Deutschen Arbeitsgemeinschaft für Muster- --Mitarbeit im Fachausschuss 7.21 »Industrie 4.0« der VDI/VDE- erkennung e.V. (DAGM) Gesellschaft Mess- und Automatisierungstechnik (GMA) --Mitglied in der Deutschen Gesellschaft für Photogrammetrie und Fernerkundung (DGPF) --Mitglied im VDI --Mitglied NATO-SET-167 Gruppe »Navigation Sensors and Systems in GNSS Denied Environments« Pfützenreuter, T.: --Vertreter des IOSB-AST in der Gesellschaft für Maritime Technik e.V. --Vertreter des IOSB-AST im Subsea Monitoring Network --Mitarbeit bei DEU – SWE Kooperation »Navigation in Urban Terrain« --Reviewer »Photogrammetrie – Fernerkundung – Geoinformation (PFG)« Rauschenbach, T.: --Mitglied des VDI / VDE GMA-Fachausschuss 5.14 »Computational Intelligence« --Reviewer »Measurement Science and Technology« --Mitglied der Gesellschaft für Maritime Technik (GMT) --Reviewer »Information Fusion« --Mitglied im VDE --Reviewer ISPRS Workshop »CMRT13« --Mitglied IEEE, Oceanic Engineering Society --Reviewer Konferenz »Fusion 2013« --Mitglied Fraunhofer Allianz SysWasser --Mitglied der Foren bei German Water Partnership Meissner, A.: (Länderforen China und Vietnam) --Vertreter des Fraunhofer IOSB im BITKOM Arbeitskreis Öffentliche Sicherheit --Mitglied im Beirat des VfS - Verband für Sicherheitstechnik --Mitglied der ISCRAM Association (Information Systems for Repasi, E.: --Mitglied der NATO-Gruppe SET-084 »Simulation of Active Imaging Systems« Crisis Response and Management) Ritt, G.: Michaelsen, E.: --Co-Chair IAPR-TC7 (International Association for Pattern --Mitglied der NATO-Gruppe SET-198 »Visible Laser Dazzle – Effects and Protection« Recognition – Technical Committee 7, Remote Sensing and Mapping) --Associate Editor, Pattern Recognition Letters, Elsevier Verlag Roller, W.: --Mitglied BITKOM Arbeitskreis »Learning Solutions« --Mitglied im Institutsbildungsausschuss (IBA) des IOSB Middelmann, W.: --Mitarbeit bei DEU - CHE Kooperation »Hyperspectral Imaging« --Mitglied im Arbeitskreis» Personalentwicklungskonzept« (PEK) des IOSB --Mitarbeit bei Detection in Urban scenarios using Combined Airborne imaging Sensors (DUCAS), EDA-Projekt (European Defence Agency) PROJECT ARRANGEMENT No B0294 IAP3 GC Okon, M.: --Mitglied im Arbeitskreis Mess- und Automatisierungstechnik (GMA) im VDI Bezirksverein Karlsruhe 135 n a m e n , d a t e n , e r e i g n i ss e N a m e s , d at e s , e v e n t s Mitarbeit in Gremien Participation in Committees Sauer, O.: Schleipen, M.: --Leitung des Fachbereichs »Informationstechnik« in der --Mitarbeit in Arbeitsgruppe »DKE K941.0.2 AutomationML« VDI-Gesellschaft GPP --Leitung des VDI-GPL-Richtlinienausschusses »Digitaler Fabrikbetrieb« --Mitglied im VDI-GPL-Fachausschuss »Digitale Fabrik« --Mitglied im VDI-GPP-Fachausschuss »MES« --Mitglied des VDI-GPP-Richtlinienausschusses »Logische Schnittstelle MES-Maschine« --Mitglied in der VDA-ITA »Informationstechnologie für die Automobilindustrie« --Mitglied im CIRP »STC »O« Optimization of Manufacturing Systems« --Mitglied in der »OPC Foundation« --Mitglied des Automotive Engineering Netzwerks Südwest --Mitglied der smartFactoryKL der Deutschen Kommission Elektrotechnik Elektronik Informationstechnik --Mitarbeit im DIN AK 060-30-05-04 des Normenausschuss Maschinenbau (NAM, gepflegt durch den VDMA) --Mitarbeit im Fachausschuss 6.12 »Durchgängiges Engineering von Leitsystemen« der VDI/VDE-Gesellschaft Mess- und Automatisierungstechnik (GMA) --Mitarbeit in im Fachausschuss 7.21 »Industrie 4.0« der VDI/ VDE-Gesellschaft Mess- und Automatisierungstechnik (GMA) --Mitarbeit im Fachausschuss 142 »Manufacturing Execution Systems« der VDI-Gesellschaft Produkt- und Prozessgestaltung (GPP) --Mitarbeit in der Arbeitsgruppe »Digitaler Fabrikbetrieb« der VDI-Gesellschaft Fördertechnik Materialfluss Logistik (FML) --Vorstand Wirtschaftsstiftung Südwest --Mitarbeit in der IEC Working group 9 of SC 65E --Mitglied im VDI-Fachausschuss Modellierung und Simulation --Stellvertretende Vorsitzende der Arbeitsgruppe »Schnitt- --Mitglied im Fachbeirat Digitale Fabrik@Produktion stellen MES Maschinenebene« des Fachausschusses 142 --Erstansprechpartner des IOSB in der Innovationsallianz der »Manufacturing Execution Systems« der VDI-Gesellschaft Technologieregion Karlsruhe Produkt- und Prozessgestaltung (GPP) Scharaw, B.: Schönbein, R.: --Head of Section Central Asia, GWP --Mitglied der Deutschen Gesellschaft für Wehrtechnik e.V., -- Mitglied des wiss. Rates der Deutsch-Mongolischen Gesellschaft Bonn --Mitglied im Kharaa River Basin Administration --Mitglied der Human Factors and Ergonomics Society, Santa Schilling, H.: --Mitglied im Fachausschuss T 5.4 Anthropotechnik, Deutsche Monica, USA --Mitarbeit bei DEU - CHE Kooperation »Hyperspectral Imaging« --Mitarbeit bei Detection in Urban scenarios using Combined Airborne imaging Sensors (DUCAS), EDA-Projekt (European Gesellschaft für Luft- und Raumfahrt (DGLR) --Mitglied im Editorial Board of the International Journal On Advances in Systems and Measurements (IARIA Journals) --Mitglied im Programmausschuss ICONS Defence Agency) PROJECT ARRANGEMENT No B0294 IAP3 GC Schuchert, T.: --Mitglied der Deutschen Arbeitsgemeinschaft für Mustererkennung e.V. (DAGM) 136 Schulz, K.: Seiffer, D.: -- Conference Co-Chair for the SPIE Conference »Earth Resources --Mitwirkung in internationaler Arbeitsgruppe (SE, F, NL, UK) and Environmental Remote Sensing/GIS Applications«, RS08 --Session Chair for the SPIE Conference Session »Infrastructures and Urban Areas«, RS08 --Session Chair for the SPIE Conference Session »Environmental Monitoring II«, RS08 --Deutsch-Israelische Kooperation TA 17, Working Group 4, Hyperspectral Imaging TA 108.019 »Laser beam propagation and imaging through severe environments« --Mitglied in der NATO SET-143 Gruppe »Radar and Infrared Synergy for Military Situation Awareness« --Mitwirkung in der Arbeitsgruppe ALWS »Airbone Platform Effects On Laser Systems And Electro-Optical Warning Sensors« --Member of IEEE Geoscience and Remote Sensing Society --Mitglied NATO-RTO-SCI-248 »Vulnerability of NATO operations to current and future commercial space-based Synthetic Aperture Radar (SAR) sensors« --Mitglied NATO-RTO-SET-145 »Extraction of Geospatial Intelligence Information from Space Borne SAR Sensors« --Reviewer » Photogrammetrie – Fernerkundung – Geoinformation (PFG)« Sprung, D.: --Mitwirkung in der deutsch-israelischen Arbeitsgruppe SBMD »Satellite Based Missile Detection« --Mitwirkung in der Kooperation mit dem Kiepenheuer-Institut für Solarphysik (KIS), Freiburg, »Bestimmung der optischen Turbulenz am Observatorium VTT auf dem Teide / Teneriffa, Spanien« --Reviewer »Information Fusion« Elsevier --Mitwirkung in der deutsch-israelischen Arbeitsgruppe mit Schwarz, A.: --Mitwirkung in der deutsch-südafrikanischen Kooperation mit dem Soreq / Israel »Wind and turbulence measurements« --Mitglied in der NATO SCI -230 Gruppe »Advanced Materials, Systems and Evaluation Methods for Adaptive Camouflage « dem CSIR Südafrika »Determination of the vertical distribution of optical turbulence over savannah« Schweitzer, C.: Stein, K.: --Mitwirkung in der deutsch-israelischen Arbeitsgruppe SBMD --Chairman Konferenz »SPIE Remote Sensing« »Satellite Based Missile Detection« vom 23.-26.9.2013 in Dresden --Chairman der NATO-SET-143 Gruppe »Radar and Infrared Sander, J.: --Technical Program Committee der 16th International Conference on Information Fusion (Fusion 2013) Synergy for Military Situation Awareness« --Mitglied und Chairman der NATO SET-ET-082 »Naval Platform Protection in the EO/IR Domain«, vom 14.-18.10.2013, Niederlande, Den Haag Segor, F.: --Mitglied im Programmausschuss ICONS --Mitglied in der NATO SET-144 Gruppe »Mitigation of ship Electro-Optical Susceptibility against Conventional and Asymmetric Threats« --Mitwirkung in der deutsch-israelischen Arbeitsgruppe SBMD »Satellite Based Missile Detection« --International Advisory Board IAB von FOCUS, Schweden 137 n a m e n , d a t e n , e r e i g n i ss e N a m e s , d at e s , e v e n t s Mitarbeit in Gremien Participation in Committees Steusloff, H.: Thiele, A.: --Kurator des Heinz Nixdorf Instituts, Universität Paderborn --Reviewer »Photogrammetrie – Fernerkundung – --Vorsitzender des DIN-Präsidialausschusses SO-FIE (Forschung, Innovation, Entwicklung) --Vorsitzender des DIN-Präsidialausschusses FOCUS ICT --stellv. Vorsitzender der DKE (Deutsche Kommission Geoinformation (PFG)« --Reviewer IEEE Transactions on Geoscience and Remote Sensing (TGRS) --Reviewer IEEE Geoscience and Remote Sensing Letters (GRSL) Elektrotechnik Elektronik Informationstechnik) --Vorsitzender des DKE-Beraterkreises Technologie (BKT) Thomalla, C.: --Vorsitzender des DKE-Lenkungsausschusses »Elektromobilität« --Mitarbeit im DIN AK 060-30-05-04 Normenausschuss von DKE und DIN NAAutomobil --Vorsitzender der DKE-Fokusgruppe »Netzintegration Lastmanagement und dezentrale Energieerzeugung« (NeLDE) --stellv. Vorsitzender der Regionalkonferenz der TechnologieRegion Karlsruhe --Mitglied im Forschungsnetzwerk »Normung« des DIN --Mitglied im Technologieausschuss der IHK Karlsruhe Maschinenbau (NAM, gepflegt durch den VDMA), --Mitarbeit im MES D.A.C.H Verband e.V., Technik Gruppe UMCM --Mitglied im VDI/VDE-GMA Fachausschuss »5.23 XML in der Automation« --Mitglied in der Arbeitsgruppe »Logische Schnittstellen MES Maschinenebene« des VDI-KfIT, Fachausschuss 2.5.1 »MES« --Mitglied im Cercle de l’ILL, Straßburg --Mitglied im VDI --Member of the China Instrument and Control Society (CIS) --Mitglied in der Gesellschaft für Operations Research (GOR) --Mitglied der Gesellschaft für Informatik (GI) --IOSB-Beauftragter für das betriebliche Vorschlagswesen --Mitglied im Verein Deutscher Ingenieure (VDI) --Mitglied im Verband der Elektrotechnik Elektronik Informationstechnik e.V. (VDE) Tchouchenkov, I.: --Mitglied im Richtlinienausschuss VDI/VDE-GMA --Mitglied im Beirat des Fachausschusses »Informatik« der Fachgesellschaft GPP im VDI --Mitglied im Wirtschaftsrat Deutschland, Sektion KarlsruheBruchsal --Beiratsvorsitzender der IWRM (Integrated Water Resources Management)-Konferenz 2014 der Karlsruher Messe- und Kongress GmbH (KMK), Karlsruhe, 19.-20.11.2014 Usländer, T.: -- Mitglied im VDI/VDE-GMA Fachausschuss 7.21 »Industrie 4.0« - Begriffe, Referenzmodelle, Architekturkonzepte --Mitglied im VDI Fachausschuss »Ressourceneffizienz« --stimmberechtigter Vertreter der Fraunhofer-Gesellschaft im Technical Committee des Open Geospatial Consortium (OGC) --Vertreter der Fraunhofer-Gesellschaft im European Virtual Tacke, M.: --Mitglied RTB Research Technology Board --Mitglied Beirat ISL --Mitglied F&T Beirat des BMVg --Member SET- 136 STANDEX-Steering Committee Institute for Integrated Risk Management (EU-VRi) --Technical Representative des IOSB im Industriekonsortium Object Management Group (OMG) --Vertreter des IOSB im Koordinierungsausschuss F+E IuK im Rahmen der Kooperation MAF-UIS des Umweltministeriums Baden-Württemberg --Mitglied in der Arbeitsgruppe 5.11 »Computers and Environment« der International Federation for Information Processing (ifip) 138 Vieth, K.-U.: Westermann, D.: --Paritätische Kommission zum Leistungsentgelt am IOSB --Mitglied im CIGRE SG B4, HVADC and FACTS, Strategic --Stellvertreter im Wissenschaftlich-Technischen Rat der Fraunhofer Gesellschaft am IOSB Advisory Group --Mitglied im CIGRE WG B4.58: »Devices for load flow control and methodologies for direct voltage control in a meshed Warweg, O.: --Mitglied im NPE Unterarbeitsgruppe IKT --Mitglied im VDE/ITG Energieinformationsnetze HVDC grid« --Mitglied im Lenkungskreis Hochspannungs- und Höchstspannungsnetze des FNN --Ordentliches Mitglied der Sächsischen Akademie der Watson, K.: --Co-Chair der GEO Health and Environment Community of Practice --Mitglied GEO Integrated Global Water Cycle Observations Community of Practice Wissenschaften, Technikwissenschaftlichen Klasse --Mitglied im Beirat der Plattform Zukunftsfähige Energienetze des Bundeswirtschaftsministeriums --Mitglied im Vorstand der IEEE Germany Section (Industry Relation Officer) und der IEEE Power & Energy Society Germany (Treasurer) Wendelstein, N.: --Mitwirkung in internationaler Arbeitsgruppe (SE, F, NL, UK) TA 108.019 »Laser beam propagation and imaging through severe environments« --Mitglied in der NATO-SET-174 Gruppe Winkelmann, M.: --Deutscher Vertreter in der Arbeitsgruppe» Multispectral Camouflage Concealment and Deception« der deutschisraelischen Kooperation »EO Sensor Performance Modeling« Zielinski, A.: Wenzel, A.: --Mitglied Fraunhofer Allianz Embedded --Mitglied VDI/VDE-GMA FA 7.20 Cyber Physical Systems --Mitglied F-AG7 CLARIN »Angewandte Sprachwissenschaft, Computerlinguistik« --Mitglied der COST Action »Multilingual and multifaceted interactive information access« (MUMIA) Werling, S.: --Beauftragter für Schutzrechte im IOSB (Patente, Marken etc.) 139 n a m e n , d a t e n , e r e i g n i ss e N a m e s , d at e s , e v e n t s Patente und Gebrauchsmuster 2013 Patents and utility models 2013 Anstett, G.; Ebert, R.: Grafmüller, M.; Zopf, S.: Jacubasch, A.: Rehfeld, N.: Einrichtung und Verfahren Verfahren und Vorrichtung Verfahren zum Betrieb Verfahren zur Bildmarken- zur Erkennung von Laser- zur rechnergestützten einer Werkzeugmaschine unterstützten Bildauswer- strahlung Segmentierung wenigstens sowie Werkzeugmaschine tung PCT/EP2013/071419 eines einen Code mit DE 10 2007 021 070 Method for picture mark Anmeldedatum 14.10.2013 wenigstens einer Codezeile Veröffentlichungsdatum supported image evalua- enthaltenden Bildes 24.10.2013 tion Beyerer, J.; Heizmann, M.; DE 10 2012 208 025 A1 Frühberger, P.: Publikationsdatum Jakoby, A.; Feuchter, M.; Anordnung und Verfahren 14.11.2013 Birnstill, P.: zur multisensorischen EP 2 092 486 Erteilungsdatum 30.1.2013 Netzübergangskom- Scherer-Negenborn, N.; Erfassung von Proben- Hartrumpf, M.; Heintz, R.: ponente mit Anfrage/ Lutzmann, P.; Scherer, C.: bereichen einer Probe Vorrichtung zur Klassi- Antwort-Zuordnung und Vorrichtung und Verfahren DE 10 2013 205 001.1 fizierung transparenter Überwachung zur Messung von Schwin- Anmeldedatum 21.3.2013 Bestandteile in einem DE 10 2012 208 290 A1 gungen Materialstrom Publikationsdatum 7.11.2013 EP 13198785.1 Eberle, B.; Ritt, G.: Device and method for the Verfahren und Vorrichtung classification of transparent Jakoby, A.; Helwig, D.: zur Begrenzung einer component in a material Hardware-Kryptomodul Taphanel, M.: transmittierten optischen flow und System zur Kommuni- Vorrichtung zur optischen Leistung und Entfernungs- EP 2 212 035 B1 kation mit einer externen Bestimmung der Ober- messer Erteilungsdatum 12.6.2013 Umgebung flächengeometrie einer DE 10 2013 201139.3 US 8,422,003 B2 DE 10 2013 223366.3 dreidimensionalen Probe Anmeldedatum 24.1.2013 Erteilungsdatum 16.4.2013 Anmeldedatum 15.11.2013 Device for optically Frühberger, P.; Heizmann, M.; Hartrumpf, M.: Paul, D.; Hartrumpf, M.; geometry of a three- Ijsselmuiden, J.; Vorrichtung und Verfahren Burkhard, M.; Palmer, M.: dimensional sample Peinsipp-Byma, E.: zur optischen Charakteri- Vorrichtung zur optischen DE 10 2011 117 523 B3 Anordnung zum Abtasten sierung von Materialien Sortierung von Schüttgut Erteilungsdatum 18.4.2013 einer Probenfläche sowie Apparatus and method Device and method for WO 2013/064395 entsprechendes Verfahren for optically characterizing optically sorting bulk Publikationsdatum 10.5.2013 DE 10 2013 206 546.9 materials material Anmeldedatum 12.4.2013 US 2013/0222803 A1 EP 2 537 598 B1 Publikationsdatum 29.8.2013 Veröffentlichungsdatum Anmeldedatum 20.12.2013 determining the surface 4.12.2013 140 Vieth, K.-U.: ® Verfahren zum Einrichten einer dem optischen Identifizieren von Objekten dienender Anlage, Laborbildaufnahmesystem zum Durchführen eines solchen Verfahrens und Anordnung umfassend das Laborbildaufnahmesystem ™ ® ™ sowie die Anlage Method for preparing a system which is used to optically identifying objects, laboratory image capturing system for carrying out such a method, and arrangement comprising the laboratory image capturing system and the system Marken DE 10 2012 001 868 A1 Publikationsdatum 25.7.2013 Wortmarke »CyphWay®« PCT/EP2013/050693 DE 30 2013 006 547 Anmeldedatum: 16.1.2013 Eintragungstag 30.10.2013 WO 2013/110529 Publikationsdatum: 1.8.2013 Wortmarke »FETS®« DE 30 2012 037 109 Willersinn, D.; Ruf, M.; Eintragungstag 4.9.2013 Scheuermann, B.; Vais, A.; Ziehn, J.; Rosenhahn, B.: Wortmarke »THS®« Verfahren zum Steuern EM 011492758 eines Fahrzeugs, Vorrich- Veröffentlichungstag tung zum Erzeugen von 14.10.2013 Steuersignalen für ein Fahrzeug und Fahrzeug Wortmarke »TISIM®« DE 10 2013 225 057.6 DE 30 2013 017 309 Anmeldedatum 5.12.2013 Eintragungstag 11.3.2013 141 Wissenschaftliche Veröffentlichungen finden sie im Web. abstracts und volltexte unter: www.iosb.fraunhofer.de > Publikationen You find scientific publications on the Web. abstracts and whole texts: www.iosb.fraunhofer.de > Publications Lehrtätigkeiten teaching activities Ament, C.: --Regelungs- und Systemtechnik 1, SS 2013 --Regelungs- und Systemtechnik 2, WS 2013/14 --Modellbildung, WS 2013/14 -- Systemidentifikation, SS 2013 --Fuzzy und Neuro Control, WS 2013/14 Fakultät für Informatik und Automatisierung, Technische Universität Ilmenau Arens, M.: --Einführung in die Bildfolgenauswertung, SS 2013 Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Beyerer, J.: --Mustererkennung, SS 2013 --Automatische Sichtprüfung und Bildverarbeitung, WS 2013/2014 (im WS 2013/2014 als beste Wahlvorlesung durch die Fakultät für Informatik des KIT ausgezeichnet) --Seminar: Technologiegestütztes Lernen, SS 2013 --Seminar: Bildauswertung und -fusion, SS 2013 und WS 2013/2014 --Proseminar: Anthropomatik: Von der Theorie zur Anwendung, SS 2013 und WS 2013/2014 (gemeinsam mit Prof. Uwe Hanebeck) Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) 142 Bier, C.; Birnstill, P.; Krempel, E.: --Blockseminar »Interdisziplinäres Seminar - Datenschutz zwischen Technik und Recht«, WS 2012/2013 Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Bretschneider, P.: --Vorlesungsbeitrag zum Thema Energieprognose im Rahmen der Lehrveranstaltung Elektrische Energieversorgung III von Prof. Westermann, SS 2013 Fakultät für Elektrotechnik und Informationstechnik, Technische Universität Ilmenau Flatt, H.: --Embedded Systems Design, WS 2013/2014 Fachbereich Elektrotechnik und Technische Informatik, Hochschule OstwestfalenLippe, Lemgo Geggus, S.: --Netzwerke und Bussysteme, SS 2013 Fachbereich Mechatronik, Duale Hochschule BadenWürttemberg (DHBW), Karlsruhe Geisler, J.: --Mensch-Maschine-Wechselwirkung in der Anthropomatik: Basiswissen, WS 2013/2014 (im WS 2013/2014 als beste Wahlvorlesung durch die Fakultät für Informatik des KIT ausgezeichnet) Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Heizmann, M.: --Einführung in die Informationsfusion, WS 2013/2014 Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Heizmann, M.: --Verteilte Messsysteme, 15.-19.4.2013 Blockveranstaltung am Chinesisch-Deutschen Hochschulkolleg (CDHK) der Tongji-Universität, Shanghai, China Hübner, W.: --Zweidimensionale Signale und Systeme, WS 2013/2014 Fakultät für Elektrotechnik, Karlsruher Institut für Technologie (KIT) Jasperneite, J.: --Rechnernetze, SS 2013 -- Communication for distributed systems (CDS), SS 2013 --Maschinennahe Vernetzung, WS 2013/2014 --Weitverkehrsnetze, WS 2013/2014 --Protocol-Engineering/ Entwurf von Kommunikationsprotokollen, WS 2013/2014 Fachbereich Elektrotechnik und Technische Informatik, Hochschule OstwestfalenLippe, Lemgo Längle, T.: --Echtzeitsysteme, SS 2013 --Projektpraktikum Robotik und Automation I+II, SS 2013 --Informatik für Naturwissenschaftler und Ingenieure I, WS 2013/2014 Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) --Kognitive Systeme, WS 2013/2014 Fachbereich Informationstechnik, Duale Hochschule Baden-Württemberg (DHBW), Karlsruhe Li, P.: --Regelungs- und Systemtechnik 1, SS 2013 --Prozessoptimierung 1, SS 2013 --Prozessoptimierung 2 / Dynamische Optimierung / Optimal Control, SS 2013 -- Hauptseminar Simulation und Optimale Prozesse, SS 2013 --Prozessdynamik, SS 2013 --Projektseminar TKST, SS 2013 --Prozessoptimierung 2, WS 2013/2014 --Control Engineering, WS 2013/2014 --Hauptseminar Simulation und Optimale Prozesse, WS 2013/2014 Fakultät für Informatik und Automatisierung, Technische Universität Ilmenau Meidow, J: -- Gastvorlesung »Ausgleichungsmodelle für Analyse von Bildsequenzen«, 24.1.2013 Fakultät für Bauingenieur-, Geo- und Umweltwissenschaften, Karlsruher Institut für Technologie (KIT) Monari, E.: --Digital Image Processing, SS 2013 Fakultät für Elektro- und Informationstechnik, Hochschule Karlsruhe – Technik und Wirtschaft Müller, M.: --Pattern Recognition / Masterstudiengang, Pflichtkurs, SS 2013 Fakultät für Elektro- und Informationstechnik, Hochschule Karlsruhe – Technik und Wirtschaft Niggemann, O.: --Algorithmen und Datenstrukturen 1, SS 2013 --Verteilte Systeme, SS 2013 --Theoretische Informatik, WS 2013/2014 --Algorithmen und Datenstrukturen 2, WS 2013/2014 Fachbereich Elektrotechnik und Technische Informatik, Hochschule OstwestfalenLippe, Lemgo Pieper, C.: --Hardware eingebetteter Systeme, SS 2013 Fachbereich Elektrotechnik und Technische Informatik, Hochschule OstwestfalenLippe, Lemgo Rauschenbach, T.: --Diagnose- und Vorhersagesysteme, WS 2013/2014 Fakultät für Informatik und Automatisierung, Technische Universität Ilmenau Roller, W.; Streicher, A.; Szentes, D.; Kannegieser, E.: --Seminar zum Technologiegestützten Lernen (TGL), SS 2013 --Seminar in Kooperation mit dem Forschungszentrum Informatik (FZI), der Hochschule Karlsruhe für Technik und Wirtschaft (HsKa) und dem Institut für Berufspädagogik (KIT/IBP) für die Fachrichtungen Informatik, Informationswirtschaft und Wirtschaftswissenschaften, Karlsruher Institut für Technologie (KIT) Scharaw B.: --Integriertes Wasserressourcenmanagement, 11.-27.1. / 11.-21.4. / 26.5.-1.6. / 10.-14.11.2013 Faculty of Construction and Water Technology, Mongolian University of Science and Technology --Integriertes Wasserressourcenmanagement, 18.-30.9.2013 China Agricultural University in Hohhot, China Schuchert, T.: --Grundlagen der Informatik I, WS 2013/14 Fakultät für Elektro- und Informationstechnik, Hochschule Karlsruhe -Technik und Wirtschaft Tchouchenkov, I.: --Praxis der Softwareentwicklung (PSE), Kamerabasierte Steuerung eines Mikroquadrokopter-Schwarm, WS 2013/2014 Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Wenzel, A.: --Mikroprozessortechnik, SS 2013 --Mikrocontrollertechnik, WS 2013/2014 --Embedded Systems, WS 2013/2014 Fakultät Elektrotechnik, Fachhochschule Schmalkalden Widak, H.: -- Labor Digitaltechnik, SS 2013 Fakultät für Elektro- und Informationstechnik, Hochschule Karlsruhe – Technik und Wirtschaft Zielinski, A.: --Korpuslinguistik, SS 2013 --Text Mining, WS 2013/2014 Institut für Computerlinguistik, Ruprecht-Karls-Universität Heidelberg 143 Dissertationen Dissertations Franz, Stefan Anpassung perzeptiver Komponenten von Fahrerassistenzsystemen Fakultät für Elektrotechnik und Informationstechnik, Karlsruher Institut für Technologie (KIT) Gruna, Robin Beleuchtungsverfahren zur problemspezifischen Bildgewinnung für die automatische Sichtprüfung Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Kühnert, Christian Data-driven methods for fault localization in process technology Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) Müller, Markus Szeneninterpretation unter Verwendung multimodaler Sensorik und Salienzmaßen Fakultät für Elektrotechnik und Informationstechnik, Karlsruher Institut für Technologie (KIT) Vagts, Hauke Privatheit und Datenschutz in der intelligenten Überwachung: Ein datenschutzgewährendes System, entworfen nach dem »Privacy by Design«-Prinzip Fakultät für Informatik, Karlsruher Institut für Technologie (KIT) 144 Vorträge lectures Prof. Beyerer auf der FISCCDM Konferenz in Riyadh, Saudi-Arabien. Adomeit, U.; Müller, K.: Focal Plane Arrays as Alternatives to Image Intensifier Tubes – Comparison of Different Detector Technologies. IDGA’s 8th Annual Night Vision Systems Conference, USA, Arlington, 31.7.2013 Adomeit, U.: Verfahren zur Leistungssteigerung von Wärmebildgeräten. Seminar SE 1.02 »Infrarottechnik – Grundlagen, Trends und moderne Anwendungen« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 7.-10.10.2013 Adomeit, U.; Müller, K.: Experimentelle Bewertung passiver bildgebender Sensorik am IOSB. Vortrag Symposium Bewertung Wärmebildgeräte, WTD 91, Meppen, 9.-10.10.2013 Adomeit, U.; Schuberth, W.: IR-Detektorentwicklung. Seminar SE 3.11 »Warnsensorik (UV, IR, mmW, Terahertz) und Gegenmaßnahmen« der CarlCranz-Gesellschaft e.V., Oberpfaffenhofen, 19.-21.11.2013 Adomeit, U.; Schuberth, W.: Thermisches Reichweitenmodell zur Punktzielauffassung (TRP). Seminar SE 3.11 »Warnsensorik (UV, IR, mmW, Terahertz) und Gegenmaßnahmen« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 19.11.2013 Anstett, G.: Active and Passive Imaging Sensor Developments for Security Applications. 21st International Congress on Photonics in Europe – collocated with LASER World of Photonics 2013, München, 13.-16.5.2013 Anstett, G.: Neue Sensorkonzepte: THz-Technologie und -Sensoren. Seminar SE 1.04 »Neue Lasersensoren für den militärischen und sicherheitsrelevanten Einsatz« der Carl-Cranz-Gesellschaft e.V., Ettlingen, 23.-24.4.2013 Batz, T.: -- FLIWAS 3.0: Anwendungsfallbeschreibung – Vorstellung der Methode, Beispiele. -- FLIWAS 3.0: Anwendungsfälle für BW – Vorstellung und Diskussion der bisherigen Entwürfe. Auftaktveranstaltung FLIWAS 3.0, Stuttgart, 11.9.2013 Batz, T.; Schillinger, W.: Messungen und Naturschutz: Perspektiven mit FLIWAS 3.0 - Benutzerorientierte Ausprägungen, Nutzung mit mobilen Endgeräten. 4. Arbeitstagung Land-KommunenKooperation FLIWAS Baden-Württemberg, Stuttgart, 28.11.2013 Vortrag: Batz Baumann, M.: Combining interactive and automated scheduling. SYSTEMA Expert Day, Dresden, 24.1.2013 Beyer, D.: Comparison of the energy storage requirements potentials between the market and energy network oriented approach. IEA ECES 26 6th Meeting of Annex 26, DLR, Stuttgart, 9.7.2013 Beyer, D.: Analyse des regional und zeitlich aufgelösten Energieausgleichsbedarfs in Deutschland zur Kompensation volatiler Energieerzeugung unter Berücksichtigung der Leitungsbelastung im Übertragungsnetz. VDE ETG 2013, Berlin, 5.-6.11.2013 Beyerer, J.: Optical Characterization of Materials. International Conference on Optical Characterization of Materials (OCM 2013), Karlsruhe, 6.-7.3.2013 Beyerer, J.: Neue Technologien im Spannungsfeld zwischen Nutzen und informationeller Selbstbestimmung – Erläutert am Beispiel der Videoüberwachung. acatech - Deutsche Akademie der Technikwissenschaften e.V., Themennetzwerk Sicherheit, Braunschweig, 16.4.2013 145 Vorträge lectures Beyerer, J.: Technologies for Holistic Crisis Management. 10th International Conference on Information Systems for Crisis Response and Management, ISCRAM 2013, Baden-Baden, 12.-15.5.2013 Beyerer, J.: Nutzen und Herausforderungen von Überwachungsund Diagnose-Systemen. VDI-Fachkonferenz »Zustandsüberwachung und Optimierung«, Karlsruhe, 12.-13.6.2013 Beyerer, J.: Modern Technologies for Crisis Management. (Keynote Speech) The First Saudi International Conference on Crisis and Desaster Management, Saudi Arabien, Riyadh, 8.-9.9.2013 Beyerer, J.: Die Kamera – Dein Freund und Helfer - Datenschutz und Privatheit gewährende Technologien für die Videoüberwachung. Rotary Club Schwetzingen-Walldorf, Walldorf, 8.10.2013 Beyerer, J.: Sicherheit braucht ein querschnittliches Theorierückgrat. acatech - Deutsche Akademie der Technikwissenschaften e.V., Themennetzwerk Sicherheit, Karlsruhe, 23.10.2013 Beyerer, J.: Videoüberwachungssysteme der nächsten Generation. Seminar VS 10.05 »Videoüberwachung für Sicherheitsaufgaben« der Carl-Cranz-Gesellschaft e.V., Karlsruhe, 12.-14.11.2013 Beyerer, J.: Sehen, Verstehen, Vernetzen. Sehen, Verstehen, Vernetzen – Technologien des Fraunhofer IOSB für den Bedarf der Streitkräfte, Karlsruhe, 13.11.2013 146 Beyerer, J.: -- Polizeirelevante Forschung am IOSB. -- Digitale Bild- und Videoauswertung. Sondersitzung der AG Kripo und UA FEK, Austausch mit Fraunhofer bezüglich polizeirelevanter Forschung, Karlsruhe, 21.11.2013 Beyerer, J.: Intelligente Videoüberwachung – Beschützer oder Big Brother? Symposium »Netzwert« 2013, FraunhoferGesellschaft, München, 3.-4.12.2013 Bohn, S.: SuperGrid – Das europäisch-nordafrikanische HGÜOverlay-Netz der Zukunft. Internationaler ETG-Kongress 2013, »Energieversorgung auf dem Weg nach 2050«, Berlin, 5.-6.11.2013 Boldt, M: Using Morphological Differential Attribute Profiles for Chance Categorization in High Resolution SAR Images. ISPRS Hannover Workshop 2013, Hannover, 21.-24.5.2013, Posterpräsentation am 23.5.2013 Bretschneider, P.: Herausforderungen für Strommarkt und Stromnetze – Aspekte zu den 12 Thesen der AGORA-Energiewende. Energiebeirat Thüringer Ministerium für Wirtschaft, Arbeit und Technologie, Erfurt, 4.2.2013 Bretschneider, P.; Pflugradt, S.; Karstädt, F.; Ritter, S.; Schaller, F.: Optimale Betriebsführung virtueller Kraftwerke mit und ohne Berücksichtigung von Netzrestriktionen. VDI-Konferenz: Virtuelle Kraftwerke; Karlsruhe, 5.-6.3.2013 Bretschneider, P.: Beiträge energieeffizienter Städte zur Energiewende. Energieeffizienz - Aktuelle Entwicklungen und praktische Ergebnisse, Förderverein Gaszentrale e.V., Unterwellenborn, 29.8.2013 Bretschneider, P.; Pflugradt, S.; Karstädt, F.; Ritter, S.; Schaller, F.: Betriebsführung dezentraler Erzeuger- und Speicheranlagen. Konferenz Energy EcoSystems, Leipzig, 23.-24.9.2013 van de Camp, F.; Voit, M.; Geisler, J.: Interaktive Visualisierung großräumiger Lagen. 4. Expertentreffen »Weltraumlagezentrum«, Kalkar, 30.4.2013 Bretschneider, P.: Smart Cities - Visionen und Ansätze für Städte von morgen. Fachtagung Stadt Licht + Verkehr, Leipzig, 28.11.2013 van de Camp, F.; Schührer, P.; Stiefelhagen, R.: How to choose element sizes for novel interactive systems. ITS, Schottland, St. Andrews, 6.-9.10.2013 Bulatov, D.: Detection of Small Roof Details in Image Sequences. 18th Scandinavian Conference on Image Analysis, Finnland, Espoo, 20.6.2013 Dimitrov, T.: Combining interactive and automated scheduling. SYSTEMA Expert Day, Dresden, 24.1.2013 Bulatov, D.: Comparison of an L1-MCDA-based and a RANSAC-based Planar Segmentation Procedure. SPIE-Conference on Earth Resources and Environmental Remote Sensing/GIS Applications, Dresden, 23.9.2013 Bürsing, H.: Neue Sensorkonzepte mit ultra-kurzen Laserpulsen. Seminar SE 1.04 »Neue Lasersensoren für den militärischen und sicherheitsrelevanten Einsatz« der Carl-Cranz-Gesellschaft e.V., Ettlingen, 23.-24.4.2013 Bürsing, H.: Flash Lager zur Echtzeitgewinnung von Entfernungsbildern. Sehen, Verstehen, Vernetzen – Technologien des Fraunhofer IOSB für den Bedarf der Streitkräfte, Karlsruhe, 13.11.2013 van de Camp, F.; Stiefelhagen, R.: Applying Force Fields to Black-Box GUIs Using Computer Vision. IEEE Workshop on the Applications of Computer Vision 2013, USA, Clearwater, 17.-18.1.2013 van de Camp, F.; Stiefelhagen, R.: glueTK - A Framework for Multi-Modal, Multi-Display Human-Machine-Interaction. International Conference on Intelligent User Interfaces, USA, Santa Monica, 21.3.2013 Eberle, B.; Dengler, S.; Ritt, G.; Muller, O.: Laser Protection of Optronical Sensors with Nanoparticles. 41st Freiburg Infrared Colloquium, Freiburg, 26.-27.2.2013 Eberle, B.: -- Herausforderungen für Lasersensoren im militärischen und sicherheitsrelevanten Einsatz. -- Operationelle Grundlagen für Lasersensoren. -- Laserradar-Verfahren und -Systeme. -- Fernerkennung von Bedrohungen und Gefahren. Seminar SE 1.04 »Neue Lasersensoren für den militärischen und sicherheitsrelevanten Einsatz« der Carl-Cranz-Gesellschaft e.V., Ettlingen, 23.-24.4.2013 Eberle, B.: Laser-Radarsysteme für Zielaufklärung und Navigation. Seminar SE 2.28 »Intelligente Sensorik I – Grundlagen und Anwendungen« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 3.-6.6.2013 Eberle, B.: -- Potenzial zukünftiger Laser-Sensoren. -- Zukünftige passive Infrarot-Sensoren. Seminar SE 2.31 »Intelligente Sensorik II – Entwicklungspotential und zukünftige Systeme« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 16.-19.9.2013 147 Vorträge lectures Eberle, B.: Initial Briefing to: NATO Science & Technology Organization Sensors & Electronics Technology Panel bezüglich der Aktivitäten in NATO SET-198/RTG »Visible Laser Dazzle – Effects and Protection«. 32nd Panel Business Meeting, Norwegen, Oslo, 23.-25.10.2013 Eberle, B.: Laser-Hinderniswarnung. Seminar SE 3.11 »Warnsensorik (UV, IR, mmW, Terahertz) und Gegenmaßnahmen« der CarlCranz-Gesellschaft e.V., Oberpfaffenhofen, 19.-21.11.2013 Ebert, R.: Status und Perspektiven der Nachtsichtsensorik. Forschungs- und Technologiesymposium »Sensortechnologien«, Bildungszentrum der Bundeswehr (BiZBw), Mannheim, 4.-5.6.2013 Emter, T.: 3D-Kartierung und Lokalisierung mittels Normal Distribution Transform. DWT-Forum »Unmanned Vehicles IV«, Bonn-Bad Godesberg, 28.-29.5.2013 Essendorfer, B.: Coalition Shared Data. Combined ASIISG and Joint JISR Panel. NATO Headquarters, Belgien, Brüssel, 20.3.2013 Fetzner, A.: Multisensor-basierte Kontrollkonzepte für humanoide Roboter. Symposium »Netzwert« 2013, FraunhoferGesellschaft, München, 3.-4.12.2013 Fischer, Y.; Beyerer, J.: Ontologies for Probabilistic Situation Assessment in the Maritime Domain. CogSIMA 2013, USA, San Diego, 25.-28.2.2013 Fischer, Y.; Unmüßig, G.: Architektur von Videoüberwachungssystemen und HMI. Seminar VS 10.05 »Videoüberwachung für Sicherheitsaufgaben« der Carl-Cranz-Gesellschaft e.V., Karlsruhe, 12.-14.11.2013 148 Fischer, Y.: Interaktive Situationsanalyse am Beispiel der maritimen Überwachung. Sehen, Verstehen, Vernetzen – Technologien des Fraunhofer IOSB für den Bedarf der Streitkräfte, Karlsruhe, 13.11.2013 Flatt, H.: Systeme entwickeln - aktuelle Forschungsschwerpunkte und Anwendungen. Elektronik Forum OWL - Intelligentes Energiemanagement eingebetteter Systeme, Lemgo, 15.10.2013 Flemming, S.; Bretschneider, P.: Regionale Energieausgleichsbedarfe. 2.Regionale Energiekonferenz Südwestthüringen, Suhl, 20.11.2013 Frey, C.: Assistenzsystem zum effizienten Fahren. Nutzfahrzeugmesse Karlsruhe NUFAM, Messe Karlsruhe, 26.9.2013 Gabler, R.: Sensordatenfusion für elektrooptische Sensoren. Seminar SE 2.18 »Multisensordatenfusion: Grundlagen und Anwendungen« der Carl-Cranz-Gesellschaft e.V., Wachtberg-Werthhoven, 9.-11.4.2013 Gabler, R.: Bildauswerteverfahren für Warnsensoren. Seminar SE 3.11 »Warnsensorik (UV, IR, mmW, Terahertz) und Gegenmaßnahmen« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhoven, 19.-21.11.2013 Gelo, S.: Theorie und Methoden der Farbmessung. Fraunhofer Allianz Vision – Inspektion und Charakterisierung von Oberflächen mit Bildverarbeitung, Karlsruhe, 4.12.2013 Göhler, B.; Lutzmann, P.: Recent developments of the Gated-Viewing system demonstrator at Fraunhofer IOSB. 4th Workshop on Active Imaging, French-German Research Institute of Saint-Louis (ISL), Frankreich, Saint-Louis, 20.-21.11.2013 Groß, W.: Evaluation of Spectral Unmixing using Nonnegative Matrix Factorization on Stationary Hyperspectral Sensor Data of Specifically Prepared Rock and Mineral Mixtures. International Conference for Optical Characterization of Materials (OCM 2013), Karlsruhe, 6.-7.3.2013 Hammer, H.: Sensordatenfusion für interaktive Luft- und Satellitenbildauswertung. Seminar SE 2.18 »Multisensordatenfusion: Grundlagen und Anwendungen« der Carl-Cranz-Gesellschaft e.V., Wachtberg-Werthhoven, 9.-11.4.2013 Hammer, J.H.; Beyerer, J.: Robust Hand Tracking in Realtime Using a Single Head-Mounted RGB Camera. HCI International 2013, USA, Las Vegas, 25.7.2013 Hammer, J.H.; Maurus, M.; Beyerer, J.: Real-Time 3D Gaze Analysis in Mobile Applications. ETSA 2013, South Africa, Cape Town, 31.8.2013 Hebel, M.: Automatische Änderungsdetektion beim vorwärtsblickenden Airborne Laser Scanning urbaner Gebiete. 18. Münchner Fortbildungsseminar Geoinformationssysteme, München, 10.4.2013 Heinze, N.: Multisensorielle Videoauswertung für die Überwachung und Aufklärung mit UA. SGW-Forum UV (unmanned vehicles) IV, Bonn-Bad Godesberg, 28.5.2013 Heinze, N.: Echtzeitauswertung von »Full-Motion-Video« für Aufklärung mit AUS. Forschungs- und Technologiesymposium »Sensortechnologien«, Bildungszentrum der Bundeswehr (BiZBw), Mannheim, 4.6.2013 Heinze, N.; Brüstle S.; Orlov, Z.: Videoaufbereitung, Archivierung und Recherche. Seminar VS 10.05 »Videoüberwachung für Sicherheitsaufgaben« der Carl-Cranz-Gesellschaft e.V., Karlsruhe, 12.-14.11.2013 Heizmann, M.: Inspektion stark reflektierender Objekte. Mehr sehen mit dem richtigen Licht – Innovative Beleuchtungslösungen für Machine-Vision-Anwendungen, SPECTARIS-Wissensraum, Waldbronn, 18.6.2013 Heizmann, M.; Emter, T.; Petereit, J.: Mobile Roboter zur Überwachung von Liegenschaften. Seminar VS 10.05 »Videoüberwachung für Sicherheitsaufgaben« der Carl-Cranz-Gesellschaft e. V., Karlsruhe, 12.-14.11.2013 Heizmann, M.: Theorie und Methoden der 3-D-Vermessung von Oberflächen. Seminar »Inspektion und Charakterisierung von Oberflächen mit Bildverarbeitung«, Fraunhofer Allianz Vision, Karlsruhe, 4.-5.12.2013 Heizmann, M.: Texturanalyse. Seminar »Inspektion und Charakterisierung von Oberflächen mit Bildverarbeitung«, Fraunhofer Allianz Vision, Karlsruhe, 4.-5.12.2013 Herzog, R.: Where is the Business in the IoT? Future Internet Assembly (FIA), Irland, Dublin, 8.-10.5.2013 Hild, J.; et al.: Evaluating Multi-Modal Eye Gaze Interaction for Moving Object Selection. The Sixth International Conference on Advances in Computer-Human Interactions (ACHI), Frankreich, Nizza, 26.2.2013 Hild, J.; Fischer, Y.; Peinsipp-Byma, E.; et al.: Gaze-based interaction for real-time video surveillance systems. 8th Future Security Security Research Conference, Berlin, 17.-16.9.2013 149 Vorträge lectures Jacobi, M.; Karimazira, D.: Underwater pipeline and cable inspection using autonomous underwater vehicles. OCEANS’13 MTS/IEEE Bergen, Norwegen, Bergen, 10.-13.6.2013 Jakoby, A.: Mein Netz – mein Handy – meine Daten. IT & Media, Darmstadt, 25.4.2013 Jakoby, A.: The CYSPA alliance – Vision and Timeline. 3rd SAP for Nuclear Infoday, SAP Headquarters, Walldorf, 22.5.2013 Jasperneite, J.: Industrie 4.0 : Wie kommt die Intelligenz in die Maschine? – Projektbeispiele aus dem BMBF-Spitzencluster „Intelligente Technische Systeme OstwestfalenLippe“ einbringen. Vortragsreihe INDUSTRIE 4.0 – Kompetenz aus NRW (Cluster ProduktionNRW), Hannover Messe 2013, Hannover, 11.4.2013 Jasperneite, J.: Industrie 4.0 zum Anfassen in der Lemgoer Modellfabrik. Forum Industrial IT des ZVEI anlässlich der Hannover Messe 2013, Hannover, 11.4.2013 Jasperneite, J.: Industrie 4.0: Alter Wein in neuen Schläuchen. Sick AG Automobiltage 2013, Waldkirch, 18.6.2013 Jasperneite, J.: Smart Factories, CPS und Industrie 4.0. Bitkom Akademie Workshop »Auf dem Weg zum Internet der Dinge«, Herzogenrath, 11.7.2013 Jasperneite, J.: Wie die Intelligenz in die Fabrik kommt! 1. Markt&Technik Summit Industrie 4.0 WEKA FACHMEDIEN, München, 16.10.2013 150 Karimanzira, D.; Jacobi, M.; Pfützenreuter, T.; Rauschenbach, T.; Eichhorn, M.; Taubert, R.; Ament, C.: AUV Mission (Re)Planning and Guidance Concept for Water Quality Monitoring. 7th IFIP International Conference on Computer and Computing Technologies in Agriculture, China, Beijing, 18.9.-20.9.2013 Karstädt, F.: Analyse und Prognose der Technologien und Anwendungsfelder thermischer und elektrischer Energiespeicher auf Nieder- und Mittelspannungsebene. Zwischenbericht, Beiratssitzung der Thüringer Energie- und GreenTech-Agentur (ThEGA), Thüringer Ministerium für Wirtschaft, Arbeit und Technologie, Erfurt, 6.9.2013 Käßler, M.: Energiemanagement für die Energiewende. E-world 2013, Forum Energiewende, Essen, 7.2.2013 Käßler, M.: Energiemanagement für die Energiewende. Hannover Messe Industrie 2013, BEE Forum, Hannover, 9.4.2013 Käßler, M.: Energiewende: Status Quo. EMS-EDM PROPHET Anwendertage 2013, Auerstedt, 5.6.2013 Käßler, M.: Energiewende: Status Quo. 14. Schönauer Stromseminar, Schönau, 6.7.2013 Kaufmann, I.: Aktive Sensorik für den Nahbereich. Seminar SE 1.04 »Neue Lasersensoren für den militärischen und sicherheitsrelevanten Einsatz« der Carl-Cranz-Gesellschaft e.V., Ettlingen, 23.-24.4.2013 Klaiber, S.; Bretschneider, P.; Waczowicz, S.; Mikut, R.; Konotop, I.; Westermann, D.: Intelligente Prognoseverfahren für beeinflusstes Verbrauchsverhalten in Energiesystemen. 23. Workshop Computational Intelligence, Dortmund, 5.-6.12.2013 Klaiber, S.; Warweg, O.; Nicolai, S.; Bretschneider, P.: Evaluation of Energy Storages for the Optimization of Wind Energy Integration Based upon Different Forecast Error Scenarios. Uta Betancourt (Hg.): Proceedings / 12th Wind Integration Workshop, International Workshop on Large-Scale Integration of Wind Power into Power Systems as well as on Transmission Networks for Offshore Wind Power Plants, Vereinigtes Königreich Großbritannien und Nordirland, London, 22.-24.10.2013 Konnerth, K.: Camouval – Automatic Camouflage Evaluation. 9th International IR Target and Background Modeling & Simulation Workshop, Frankreich, Toulouse, 10.-13.6.2013 Krempel, E.: Videoüberwachung und Privatsphäre. SIRA-Abschlusskonferenz »Innere Sicherheit seit dem 9/11; Zur Akzeptanz von Sicherheitsmaßnahmen in Theorie und Praxis«, München, 7.-8.11.2013 Krempel, E.: Privatheit und Datenschutz. Seminar VS 10.05 »Videoüberwachung für Sicherheitsaufgaben« der Carl-CranzGesellschaft e.V., Karlsruhe, 12.-14.11.2013 Kuntze, H.-B.; Frey, C.; Emter, T.; Petereit, J.; Tchouchenkov, I.; Müller, T.: SENEKA - Sensornetzwerk mit mobilen Robotern für das Katastrophenmanagement. Fraunhofer Innovationscluster Future Urban Security Baden-Württemberg, Freiburg, 11.7.2013 Kuny, S.: Simulation based texture analysis of heaps of debris for damage assessment in high resolution SAR data. 6th International Conference on Recent Advances in Space Technologies (RAST 2013), Türkei, Istanbul, 12.-14.6.2013 Kuny, S.: Signature analysis of destroyed buildings in simulated high resolution SAR data. International Geoscience and Remote Sensing Symposium (IGARSS 2013), Australien, Melbourne, 21.-26.7.2013 Kunz, S.; van der Schaaf, H.; Watson, K.: Fraunhofer experience with a mobile app to record health data in the field. Uganda prototype – Design and Implementation. Workshop OGC Location Standards for Next Generation LBS, Spanien, Barcelona, 27.2.1013 Vortrag: van der Schaaf Kuwertz, A.: Ontology-Based Meta Model in Object-Oriented World Modeling for Interoperable Information Access. ICONS 2013, The Eighth International Conference on Systems, Spanien, Sevilla, 27.1. - 1.2. 2013 Kuwertz, A.: Knowledge Model Quantitative Evaluation for Adaptive World Modeling. IEEE Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA 2013), USA, San Diego, 25.-28.2.2013 Kuwertz, A.: An Architectural Framework for ISR Analytics. NATO Symposium on Architecture Assessment for NEC (SCI-254), Estland, Tallinn, 14.-15.5.2013 Kuwertz, A.: Quantitative Measures for Adaptive Object-Oriented World Modeling. 4th Workshop on Dynamics of Knowledge and Belief, 36th Annual German Conference on Artificial Intelligence (KI-2013), Koblenz, 17.9.2013 Längle, T.: Color Control for signature analysis of granular objects. 17. SpectroNet Collaboration Forum 2013, Jena, 28.8.2013 151 Vorträge lectures Längle, T.: Bildgewinnung bei der Oberflächenprüfung. Fraunhofer Allianz Vision – Inspektion und Charakterisierung von Oberflächen mit Bildverarbeitung, Karlsruhe, 4.12.2013 Negara, C.: On-line visualization and analysis of multispectral data in industry. 16th SpectroNet Collaboration Forum, Karlsruhe, 5.3.2013 Lutzmann, P.: -- Gated-Viewing Systeme. -- Laser Vibrometrie. Seminar SE 1.04 »Neue Lasersensoren für den militärischen und sicherheitsrelevanten Einsatz« der Carl-Cranz-Gesellschaft e.V., Ettlingen, 23.-24.4.2013 Nicolai, S.: Betriebsführung eines hybriden Speichersystems – Entwurf und Implementierung im Projekt Smart Region Pellworm. Workshop »Hybride Energiespeichersysteme für die Energiewende«, TU Chemnitz, Chemnitz, 7.11.2013 Middelmann, W.: Hyperspektralsensorik zur Erkennung und Spezifizierung von Tarnmaterialien und zur Entdeckung von IEDs. Forschungs- und Technologiesymposium »Sensortechnologien«, Bildungszentrum der Bundeswehr (BiZBw), Mannheim, 4.-5.6.2013 Middleton, S.; Moßgraber, J.; Tao, R.: A Geo-Distributed System Architecture for Different Domains. Posterpräsentation im Rahmen der European Geosciences Union General Assembly 2013, Österreich, Wien, 7.-12.4.2013 Vortrag: Moßgraber Monari, E.: Intelligente Videoanalyse für verteilte Kamerasysteme. SIMEDIA Forum Videoüberwachung/Videotechnik, Berlin, 15.5.2013 Monari, E.: Automatische Sensorselektion zur videobasierten Objektverfolgung in großen Kameranetzen. Seminar VS 10.05 »Videoüberwachung für Sicherungsaufgaben« der Carl-Cranz-Gesellschaft e.V., Karlsruhe, 12.-14.11.2013 Müller, M.: Kameras, Schnittstellen, mobile Kameraträger. Seminar VS 10.05 »Videoüberwachung für Sicherungsaufgaben« der Carl-Cranz-Gesellschaft e.V., Karlsruhe, 12.-14.11.2013 152 Peinsipp-Byma, E.: Technische Innovationen zum Sicherheitsmanagement. SIMEDIA, Stuttgart, 10.9.2013 Peinsipp-Byma, E.: Optimale Mensch-Computer-Kooperation durch intuitive Mensch-Computer-Interaktion. UPA-Treffen der UPARegionalgruppe Karlsruhe, 18.11.2013 Pfrommer, J.: Dynamic vehicle redistribution and online price incentives in shared mobility systems. Invited Seminar Talk at the Institute for Transport Planning and Systems (IVT), ETH Zurich, Schweiz, Zürich, 22.4.2013 Pfützenreuter, T.; Rauschenbach, T.; Jacobi, M.: Monitoring and Inspection of Hydropower stations and Dams with Unmanned Underwater Vehicles. Hydropower 2013--CHINCOLD 2013 Annual Meeting and the 3rd International Symposium on Rockfill Dams, China, Kunming, 1.11.-3.11.2013 Pohl, M.: Extraction and Refinement of Building Faces in 3D Point Clouds. SPIE-Conference on Earth Resources and Environmental Remote Sensing / GIS Applications, Dresden, 24.9.2013 Putze, F.; Hild, J.; Kärgel, R.; Herff, C.; Redmann, A.; Beyerer, J.; Schultz, T.: Locating User Attention Using Eye Tracking and EEG for Spatio-Temporal Event Selection. International Conference on Intelligent User Interfaces, USA, Santa Monica, 21.3.2013 Rauschenbach, T.: Application of Underwater Vehicles in Fish Farming. 7th IFIP International Conference on Computer and Computing Technologies in Agriculture, China, Beijing, 18.-20.9.2013 Rauschenbach, T.: Aspects of Water Resources Mangement. International Conference on Water Resources Management on the occasion of the 50th anniversary of Beijing Water Authority, China, Beijing, 17.9.2013 Ritt, G.: Schutz gegen Laserstrahlung. Seminar SE 1.04 »Neue Lasersensoren für den militärischen und sicherheitsrelevanten Einsatz« der Carl-Cranz-Gesellschaft e.V., Ettlingen, 23.-24.4.2013 Roller, W.: Auswertung von Radarbildern. Kurzlehrgang »Grundlagen der Radartechnik« des Bildungszentrums der Bundeswehr, Mannheim, 13.-.17.5.2013 Roller, W.: Transforming classical e-learning to eBook – lessons learned and first insights. Workshop Usability eBooks, VDE (ITG), Leipzig, 5.6.2013 Roller, W.; Berger, A.; Szentes D.: Technology Based Training for Radar Image Interpreters. 6th International Conference on Recent Advances in Space Technologies, Türkei, Istanbul, 12.-14.6.2013 Sander, J.: Bayesian fusion: Modeling and application. 2013 Workshop on Sensor Data Fusion: Trends, Solutions, Applications (SDF), Bonn, 9.-11.10.2013 Sauer, O.: Industrie 4.0: neue Potenziale durch IT in der Produktion. Wirtschaftsverband Industrieller Unternehmen Baden e.V.(wvib), Freiburg, 23.1.2013 Sauer, O.: Organisation des Virtuellen Fabrikbetriebs. Kurs: »Werkzeuge zur Digitalen Fabrik«, Weiterbildungsmaster Industrielles Produktionsmanagement, Universität Kassel, Kassel, 27.1.2013 Sauer, O.: Industrie 4.0 - Bedeutung für MES. Workshop: MES in der Praxis, Automatisierungstreff, Sindelfingen, 22.3.2013 Sauer, O.: Expertentalk Industrie 4.0 mit anschließender InnovationTour. Hannover Messe Industrie, Hannover, 11.4.2013 Sauer, O.: Vorstellung Industrie 4.0 bei Freudenberg. Deidesheim, 16.5.2013 Sauer, O.: Industrie 4.0 Informationstechnik in der Fabrik der Zukunft. TARGUS Management Consulting AG, Ratingen, 5.7.2013 Sauer, O.: Industrie 4.0 Informationstechnik für die Fabrik der Zukunft. T-Systems / APRISO-Veranstaltung, Karlsruhe, 25.9.2013 Sauer, O.: Organisation des Virtuellen Fabrikbetriebs. Kurs: »Werkzeuge zur Digitalen Fabrik«, Weiterbildungsmaster Industrielles Produktionsmanagement, Universität Kassel, Kassel, 29.9.2013 Sauer, O.: Level-3-Systeme: Komponenten und deren Aufgaben. ThyssenKrupp-Innovationstag, Andernach, 10.10.2013 153 Vorträge lectures Sauer, O.: Industry 4.0: Information and communication technologies in the factory of the future. Schaeffler IT Innovation day, Herzogenaurach, 16.10.2013 Schönbein, R.: Interoperabilität in der abbildenden Aufklärung. DWT-Konferenz »Angewandte Forschung für Verteidigung und Sicherheit in Deutschland«, Berlin, 3.-5.2.2014 Sauer, O.: Plug & Work – vertikale Integration vom Feldgerät bis zum MES-System. 1. Industrie 4.0-Summit, München, 17.10.2013 Schönbein, R.: Gastbeitrag zur Vorlesung: Web-Anwendungen und Serviceorientierte Architekturen II. Karlsruher Institut für Technologie (KIT), Karlsruhe, 3.7.2013 Sauer, O.: Intuitive Interaktion in der Fabrik der Zukunft. Kongress Connected Products, Frankfurt, 20.11.2013 Sauer, O.: Industrie 4.0 - die vierte industrielle Revolution durch das Internet? Absolventenkongress Deutschland 2013, Staufenbiel Institut, Köln, 28.11.2013 Scherer-Negenborn, N.: Zieldetektion und Zielverfolgung mit abbildenden Infrarotsensoren. Seminar SE 1.02 »Infrarottechnik-Grundlagen, Trends und moderne Anwendungen« der Carl-CranzGesellschaft e.V., Weßling/Oberpfaffenhofen, 7.-10.10.2013 Schick, A.; van de Camp, F.; Stiefelhagen, R.: How to Click in Mid-Air. HCI International 2013, USA, Las Vegas, 25.7.2013 Schilling, H: Concept and integration of an on-line quasi-operational airborne hyperspectral remote sensing system. SPIE-Conference on Earth Resources and Environmental Remote Sensing / GIS Application, Dresden, 24.9.13 Schleipen, M.: Semantische Interoperabilität als zwingende Voraussetzung der Vernetzung und virtuellen Inbetriebnahme in der Industrie 4.0. Ramp Up – Anlaufmanagement in der Automobil-Produktion, Braunschweig, 12.-13.3.2013. 154 Schönbein, R.: System Architecture enhancing the Capabilities of Sensor Suites to improve Situational. EDA, Belgien, Brüssel, 23.10.2013 Schönbein, R.: Interoperabilität und Systemarchitekturen. Sehen, Verstehen, Vernetzen – Technologien des Fraunhofer IOSB für den Bedarf der Streitkräfte, Karlsruhe, 13.11.2013 Schriegel, S.; Leßmann, G.: Mikroprozessor »Tiger-Chip« bring das Internet in die Maschine. Dialog-Veranstaltung Innovationsallianz NRW: Industrielle Informationstechnologie für intelligente technische Systeme, Lemgo, 17.9.2013 Schuchert, T.: Videounterstützte Identifikationsverfahren und Verhaltensanalyse. Privacy-Day 2013, ARGE-Daten, Österreich, Wien, 26.2.2013 Schuchert, T.: Drohnentechnologie, aktueller Stand der Technik, Ausblick auf die künftige technische Entwicklung. Fachtagung »Einsatz von Drohnen«, Ministerium des Innern, Rheinland-Pfalz, Polizeipräsidium Mainz, Mainz, 12.9.2013 Schuchert, T.: Applications in border situation monitoring. Unmanned Aerial Systems for Rapid Mapping, European Commission, Joint Research Centre Geneva, Schweiz, Genf, 13.9.2013 Schulz, K.: Generalized Interpretation Scheme for Arbitrary HR InSAR Image Pairs. SPIE-Conference on Earth Resources and Environmental Remote Sensing/GIS Applications IV, Dresden, 23.9.2013 Schwanenberg, D.; Karimazira, D.; Allen, C.: Short-Term Optimization of Hydro Power Assets Under Uncertain Meteo Forcing. 35th IAHR World Congress, China, Chengdu, 8.-13.9.2013 Schwarz, A.: Tarnen & Täuschen. Allgemeine Wehrtechnik. Lehrgangskurs Allgemeine Wehrtechnik, Bildungszentrum der Bundeswehr, Mannheim, 5.2.2013 Schwarz, A.: Multispektral wirksame Tarnung und Täuschung. Seminar SE 2.28: »Intelligente Sensorik: technischer Stand und Entwicklungspotential« der Carl-Cranz-Gesellschaft e.V., Oberpfaffenhofen, 3.-6.6.201 Schwarz, A.: Signaturmanagement. Tarnen und Täuschen. Lehrgangskurs Allgemeine Wehrtechnik, Bildungszentrum der Bundeswehr, Mannheim, 27.8.2013 Schwarz, A.: Grundlagen der Tarnung und Täuschung im thermalen Infrarot. Seminar SE 1.02 »Infrarottechnik – Grundlagen, Trends und moderne Anwendungen« der Carl-CranzGesellschaft e.V., Oberpfaffenhofen, 7.-10.10.2013 Schweitzer, C.: Optical spaceflight experiment 2CIR. 3rd TET-Customer Days, German Space Operations Center, Oberpfaffenhofen, 21.-22.3.2013 Sprung, D.: Using the output data of the COSMO-weather forecast model to predict the turbulent modulation transfer function over a tropical ocean and comparison with experimental results during the SMARTEX trial. In: NRSM 2013: National Radio Science Meeting, USA, Boulder, 8.-11.1.2013 Sprung, D.: Statistische Analyse vertikaler Turbulenzmessungen in der unteren atmosphärischen Grenzschicht. DWTOptronik-Tagung, Meppen, 23.-25.9.2013 Sprung, D.: Investigation of optical turbulence over the sea from measurements with a Boundary Layer Scintillometer (BLS2000) and comparison to high-speed imaging methods. Scintillometer-Workshop, Tübingen, 7.-9.10.2013 Streicher, A.: Mobile Assistenz in der Bildauswertung. Fachausschusssitzung Anthropotechnik - Ausbildung und Training in der Fahrzeug- und Prozessführung, Frankfurt, 5.11.2013 Taphanel, M.: Speed-up chromatic sensors by optimized optical filters. Optical Metrology SPIE, München, 14.5.2013 Taphanel, M.: Impact of Thin Film Fabrication to the Optimization Process of a Multispectral Chromatic Camera. Optical Interference Coating, Kanada, Whistler, 18.6.2013 Taphanel, M.: Die Zukunft der konfokalen Messtechnik - zu langsam war gestern. Fachtagung Produktionsmesstechnik, Schweiz, Buchs, 4.9.2013 Tchouchenkov, I.: Kleine unbemannte Flugsysteme - Möglichkeiten und Grenzen. Symposium »ROBOTER: EFFEKTE auf Kultur und Recht« (im Rahmen von EFFEKTE Wissenschaftsfestival Karlsruhe), Karlsruhe, 27.6.2013 155 Vorträge lectures Thomalla, C.: Industrie 4.0 – der Paradigmenwechsel in der industriellen Fertigung. 16. Fachmesse i+e, Freiburg, 24.1.2013 Usländer, T.: ENVIROFI Architecture including Generic Enablers. ENVIROFI DAY, Dublin Convention Centre, Irland, Dublin, 6.3.2013 Usländer, T.: Provision of observations through an OGC Sensor Observation Service and Presentation of the „DIRA – Disease Incidence Reporting App“. Open Geospatial Consortium (OGC) TC, VAE, Abu Dhabi, 17.-20.3.2013 Usländer, T.: SERVUS – A Collaborative Tool Support for Agile Requirements Analysis. ENVIP Workshop at ISESS 2013. Österreich, Neusiedl am See, 9.-11.10.2013 Usländer, T.: ICT Support for Efficient and Collaborative Risk Assessment. ETPIS Conference on Future Safety and Security Research in Europe, Tschechische Republik, Prag, 24.-25.10.2013 Usländer, T.: Industrial Smart Grids. EU Brokerage Event on Key Enabling Technologies (KET) in Horizon 2020, Frankreich, Straßburg, 29.11.2013 Usländer, T.: Referenzmodelle am Beispiel OASIS SOA. Sitzung des VDI / VDE GMA FA 7.21 Industrie 4.0, Frankfurt, 19.12.2013 Vieth, K.-U.: Modular rapid prototyping for bulk sorting systems. 16th SpectroNet Collaboration Forum, Karlsruhe, 5.3.2013 Voit, M.: Multimodale Mensch-Maschine-Interaktion in aufmerksamen Umgebungen. 12. Sitzung DKE / BKT »Beraterkreis Technologie«, Frankfurt, 6.11.2013 156 Voth, S.; Schuchert T.; Schroth, A.: Gaze Estimation in Low-Resolution Eye Images. ECEM 2013, 7th European Conference on Eye Movement, Schweden, Lund, 11.-16.8.2013 Wagner, B.: Geodateninfrastrukturen für Sicherheitsaufgaben – interaktiv, genormt, rollenoptimiert. BBK, Bad-Neuenahr, 24.10.2013 Walter, D.: Overview of dazzling of imaging sensors with laser pulses. ISL Symposium »Laser and Laser Applications«, French-German Research Institute of Saint-Louis ISL, Frankreich, Saint-Louis, 5.3.2013 Watson, K.: General Overview of the EO2HEAVEN Project. Stakeholders Workshop, Südafrika, Pretoria, 12.-13.2.2013 Watson, K.: General Overview of the EO2HEAVEN Project. Stakeholders Workshop, Südafrika, Durban, 14.-15.2.2013 Watson, K.: General Overview of the EO2HEAVEN Project. GEO Health and Environment Community of Practice Workshop, USA, Silver Spring, 26.-28.3.2013 Watson, K.: Posterpräsentation zu EO2HEAVEN. GEOSS European Projects Workshop, Spanien, Barcelona, 15.-16.4.2013 Watson, K.: Introduction to EO2HEAVEN. EO2HEAVEN Conference, Belgien, Leuven, 13.-15.5.2013 Weikersdorfer, D.; Schick, A.; Cremers, D.: Depth-Adaptive Supervoxels for RGB-D Video Segmentation. IEEE International Conference on Image Processing, Australien, Melbourne, 15.-18.9.2013 Weiskopf, A.: Flexible embedded telemetry system for agriculture and aquaculture. 7th IFIP International Conference on Computer and Computing Technologies in Agriculture CCTA2013, China, Beijing, 18.-20.9.2013 Westermann, D.: An overlay network for Europe – The DC Grid Option. IEEE PES Workshop on SUPERGRID Interaction between AC and DC Power Systems, Schweiz, Dättwil, 4.9.2013 Willersinn, D.: Videoverarbeitung und -auswertung, Echtzeitverfahren. Seminar VS 10.05 »Videoüberwachung für Sicherungsaufgaben« der Carl-Cranz-Gesellschaft e.V., Karlsruhe, 12.-14.11.2013 Zaschke, C.: Systemarchitekturen – Anforderungen, Arbeitsgebiete und Lösungen. Karlsruher Institut für Technologie (KIT), Karlsruhe, 3.7.2013 Zepp, A.: Fast Defocus Measurement for Laser Communications with the Holographic Wavefront Sensor. In: Optical Society of America (OSA), Washington, D.C.: Adaptive Optics: Methods, Analysis and Applications (AO), USA, Arlington, 23.-27.6.2013 Zepp, A.: Umweltbegrenzungen und Korrekturmöglichkeiten am Beispiel der Laserkommunikation. Sehen, Verstehen, Vernetzen – Technologien des Fraunhofer IOSB für den Bedarf der Streitkräfte, Karlsruhe, 13.11.2013 Zielinski, A.: Ontology-based Semantic Search for Information Professionals – Ready for Use? 6th Information Retrieval Facility and 2nd Open Interdisciplinary MUMIA Conference 2013, Republik Zypern, Limassol, 7.–9.10.2013 157 V e r n i ss a g e n 2 0 1 3 IO S B K a r l s r u h e 2013 fanden im Fraunhofer IOSB am Standort Karlsruhe 3 Ausstellungen statt. Die optische Wahrnehmung wird, neben der wissenschaftlichen, um die künstlerische Dimension erweitert. In 2013 Fraunhofer IOSB hosted three art exhibitions. So optical perception is enriched by the sense of fine arts. 158 Imp r e ss u m Ed i t o r i a l N o t e s Redaktion Bildquellen Sibylle Wirth Titel, Seite 2, 4/5, 26/27, 28, 30, Layout 33, 36 unten, 44/45, 46, 55, 56/57, Christine Spalek 68, 80/81, 82 oben, 84/85, 86/87, 88/89, 90, 92, 94/95 oben, 96, Proof Reading 98/99, 100/101, 102/103, 104/105, SciTech Communications GmbH 106/107, 108, 110/111, 112/113, Im Weiher 12 114/115, 116: 69121 Heidelberg indigo - Studio für Werbefotografie Druck Seite 16: E&B engelhardt und bauer VGB Power Tech GmbH Karlsruhe Germany www.vgb.org/home.html Anschrift der Redaktion Seite 17 unten, 20, 74, 78, Fraunhofer-Institut für Optronik, 118/119, 142/143, 144: Systemtechnik und Bildauswertung MEV IOSB Presse und Öffentlichkeitsarbeit Seite 27 oben: Sibylle Wirth Daimler AG Fraunhoferstraße 1 76131 Karlsruhe Seite 32: Telefon +49 721 6091-300 Jungmann Systemtechnik Fax +49 721 6091-413 [email protected] Seite 37 oben: Rainer Sturm, pixelio.de/ Thomas Usländer, Fraunhofer IOSB/ Bei Abdruck ist die Einwilligung Collage: Stefan Riel, Fraunhofer IOSB der Redaktion erforderlich. Seite 39: Schleswig-Holstein Netz AG © Fraunhofer IOSB Seite 75: Karlsruhe 2014 Wilhelm Busch: ein Institut der Fraunhofer- Lehrer Lämpel (aus Max und Moritz) Gesellschaft zur Förderung der angewandten Forschung e. V. Alle übrigen Abbildungen: München Fraunhofer IOSB 159 Ad r e ss e n Add r e ss e s Karlsruhe Standort Karlsruhe Fraunhoferstraße 1 76131 Karlsruhe Telefon +49 721 6091-0 Fax +49 721 6091-413 [email protected] www.iosb.fraunhofer.de Ettlingen Leitung Prof. Dr.-Ing. habil. Jürgen Beyerer Telefon +49 721 6091-210 [email protected] Presse und Öffentlichkeitsarbeit Dipl.-Ing. Sibylle Wirth Telefon +49 721 6091-300 [email protected] Verwaltung Dipl.-Kaufm. Siegbert Böckle Telefon +49 721 6091-350 [email protected] Ilmenau Standort Ettlingen Gutleuthausstraße 1 76275 Ettlingen Telefon +49 7243 992-0 Fax +49 7243 992 298 Institutsteil Angewandte Systemtechnik AST Am Vogelherd 50 98693 Ilmenau Telefon +49 3677 461-0 Fax +49 3677 461-100 steffi.nothnagel@ iosb-ast.fraunhofer.de www.iosb-ast.fraunhofer.de Leitung Bereich Photonik und optronische Systeme Dr. rer. nat. Reinhard Ebert Telefon +49 7243 992-131 [email protected] Leitung Prof. Dr.-Ing. habil. Thomas Rauschenbach Telefon +49 3677 461-124 thomas.rauschenbach@ iosb-ast.fraunhofer.de 160 Lemgo Beijing Fraunhofer-Anwendungszentrum Industrial Automation INA Langenbruch 6 32657 Lemgo Telefon +49 5261 702-5998 Fax +49 5261 702-5969 elena.sanchez@ iosb-ina.fraunhofer.de www.iosb-ina.fraunhofer.de Fraunhofer Representative Office Beijing Leitung Prof. Dr.-Ing. Jürgen Jasperneite Telefon +49 5261 702-572 juergen.jasperneite@ iosb-ina.fraunhofer.de Dipl.-Ing. Hong Mu Telefon +86 10 65900 621 Fax +86 10 65900 619 [email protected] Representative for Production and Information Technologies Unit 0610 Landmark Tower II 8 North Dongsanhuan Road Chaoyang District 100004 Beijing PR China