annual report - Fraunhofer IOSB - Fraunhofer

Transcription

annual report - Fraunhofer IOSB - Fraunhofer
Fraunhofer IOSB Annual Report 2013 / 2014
F r a u n h o f e r I n s t i t u t e o f O p t r o n i c s , S y s t e m T e c h n o l o g i e s a n d I m a g e E x p l o i tat i o n
Tablesort
S y s t e m t e c h n i k u n d B i l d a u s w e r t u n g I OS B
F r a u n h o f e r s t r a SS e 1
76131 Karlsruhe
w w w. i o s b . f r a u n h o f e r . d e
indigo - Studio für Werbefotografie
Fraunhofer-Institut für Optronik,
ANNUAL REPORT
2013 / 2014
ANNUAL REPORT
2013/2014
Preface
Prof. Dr.-Ing. habil.
Jürgen Beyerer
Dear Sir or Madam,
When faced with a technical problem for which there are established solutions, technologies
or sophisticated products, one only has to find the right supplier and a competent integrator
capable of solving the task cost-effectively and reliably.
If, however, a technical problem arises, for which a standard solution – let alone a suitable
approach – has not yet been identified, and for the solution of which the latest research
results or even new research activities are required, then, Fraunhofer with its many specialized institutes, is the right address.
Fraunhofer IOSB is the first port of call for the fields of
• optronics,
• systems engineering, and
• image analysis.
With its extensive portfolio of competencies, IOSB is Europe’s leading center of excellence in
these areas.
But scientific and technical skills alone are not sufficient to guarantee the success of an
application-oriented research institute. To be a successful innovator also takes an intimate
knowledge of the industries and markets for which innovations with commercial value are
to be created. Our scientific and technical competencies in the sectors and markets we serve
cover the following five business segments:
• Automation
• Energy, water and environment
• Automated visual inspection
• Security, and
• Defense
With the numerous positive results in 2013 we again demonstrated our ability to meet the
challenges presented by these fields of activity. All of IOSB’s sites have undergone an outstanding commercial and scientific evolution, both in terms of quality and quantity. Personnel
levels, budget, and business project volume, as well as economic results have reached record
levels. The prospects for 2014 are also highly promising.
An important challenge for 2014 is to establish a professorship for Optronics at the Faculty
of Electrical Engineering and Information Technology of KIT. Prof. Dr. Maurus Tacke, who
represented this field at IOSB, commenced his well-deserved retirement on May 1, 2013.
He has been succeeded in the management of the field of Photonics and Optoelectronic
Systems, comprising the departments of Signatorics, Optronics, Scene Analysis, and Object
Recognition by Dr. Reinhard Ebert.
With the Chair of Optronics, the cooperation with KIT will be institutionalized with another
faculty important for IOSB in addition to our existing collaboration with Informatics. Although
this new professorship has already been under discussion and in preparation for some time,
the motto “good things come to those who wait“ applies here: As all parties are working
towards a common goal, we are hoping to be able to achieve this aim, which is of great
significance to IOSB, before the end of this year.
As every year, we want to provide our readers with as comprehensive an insight into the
work of our research departments as possible with this annual report. Because of the
numerous exciting topics covered by the research and development work carried out by
our capable staff, we cannot do more here than offer a brief glimpse into our activities.
Our special thanks goes to our partners and clients in business, in government and in the
ministries, and to all the sponsors and advisors of IOSB. The support and cooperation of
the federal ministries of Education and Research (BMBF) and of Defense (BMVg) are vital
in enabling us to carry out our activities.
Our gratitude also extends to the employees of IOSB and their excellent work. Their expertise,
skills, diligence and academic motivation is the cornerstone of our institute’s success.
Dear readers, this report aims to provide you with an overview of IOSB, with a few deeper
insights into typical projects and examples of our research work. We hope that we have succeeded in striking a good balance that makes for interesting reading and we would welcome
your comments.
Karlsruhe, Ettlingen, Illmenau and Lemgo, May 2014
Prof. Dr.-Ing. habil. Jürgen Beyerer
Contents
P reface 2
B u si n ess U n its
C o n te n ts 4
A u tomatio n Bernard, T.:
the i n stit u te i n profile
The Institute in Profile
Organization Chart
26
6
10
Model-based optimization of a complex biological
production process28
Schick, A.:
A research factory for industrial automation 1 2
Gesture-based Quality Assurance
30
Usländer, T.:
CIIT new construction
14
Towards ProVis 4.0: Production monitoring and
control in light of Industrie 4.0
IT security lab for industrial control systems 16
32
Flatt, H.:
Highly available communication34
C o n tact O ffice C hi n a 18
E n er g y, Water a n d E n viro n me n t T he I n stit u t E i n F ig u res
19
36
Nicolai, S.:
Intelligent Distribution Grid & Energy Storage:
iosb i n F ra u n hofer a l l ia n ces
20
SmartRegion Pellworm
38
Rauschenbach, T.:
iosb i n F ra u n hofer Gro u ps 23
Small Hydropower Plants: Assessment of Climate
Protection Potential and Improvement through
F ra u n hofer - G ese l l schaft 2 4
Locations25
Smart Technologies
TRIDEC – Early Warning Systems Architecture
Names , dates , eve n ts
116
40
Chaves, F.:
A dvisor y B oard 117
S cie n tific P u blicatio n s
142
Frühberger, P.:
V er n issa g e n 2 0 1 3 158
MicroLab
E ditoria l Notes
159
Vieth, K.-U.:
A ddresses
160
GrapeSort – Optical sorting of grapes to improve
A u tomated V is u al I n spectio n 42
44
46
quality and the removal of foreign objects48
Taphanel, M.:
CCT Sensor – Towards high-speed 3D sensing50
Schwarz, A.:
Directional reflectance measurements with a
robot-based goniometer52
Höfer, S.:
Thermal Infrared Deflectometry 54
D epartme n ts P ortfolios
D efe n se
56
C ore C ompete n ce O ptro n ics
80
Sprung, D.:
Optical Turbulence – Atmospheric impact on
Optronics (OPT) 82
imaging and wave propagation: Basic research
Signatorics (SIG)
84
and applications58
Visual Inspection Systems (SPR)
86
Eberle, B.:
C ore C ompete n ce S y stem tech n olo g ies
First Results of a New Eye-Safe 3D-Laser-Radar
APD Line Scanner
88
60
Tchouchenkov, I.:
Energy (NRG)
90
Heterogeneous reconnaissance data: task-oriented
Water and Mobile Systems (WMS)
92
acquisition, distributed exploitation and interactive
Information Management and Production Control (ILT) 94
utilization
62
96
Systems for Measurement, Control and Diagnosis
MODISSA – a test bed for “Mobile Distributed
Situation Awareness”
Fraunhofer Application Center Industrial
Automation INA
Hebel, M.:
64
(MRD)98
Secure Communication Architectures (SKA)
Middelmann, W.:
100
Approval of trial capabilities: A real-time airborne
C ore C ompete n ce I ma g e e x ploitatio n multi- and hyperspectral sensor system in an
interoperable environment
102
66
Interactive Analysis and Diagnosis (IAD)
104
Interoperability and Assistance Systems (IAS)
106
Object Recognition (OBJ)
108
Scene Analysis (SZA)
110
Grasemann, G.:
Video Exploitation Systems (VID)
112
MobSC – Mobile Situation Center for the
Variable Image Acquisition and Processing (VBV)
S ec u rit y 68
Eisele, Ch.:
AlGaN detectors for observation of UV emitters
Management of Complex Crisis Situations
70
72
Research Group Streicher, A.:
INTUITEL Intelligent Tutoring Interface for
Technology Enhanced Learning
74
Monari, E.:
Patient-tracking for epilepsy monitoring
76
Jakoby, A.:
CyphWay – The one device for secure communication
78
Contents_2
114
the institute in profile
Objectives
IOSB’s mission is the same as that of the Fraunhofer-Gesellschaft: Research of practical utility
lies at the heart of all activities pursued by the Fraunhofer-Gesellschaft. With its research the
IOSB seeks to further technology-driven innovation; with market analysis it seeks to further
application-driven innovation; and in cooperation with partners from research and industry it
supports innovation in society and industry.
What makes the institute special is that it combines core know-how in optronics, system
technologies and image exploitation with application know-how gained through an extensive
dialog with its partners.
Short portrait
Established on January 01, 2010, the Fraunhofer Institute of Optronics, System Technologies
and Image Exploitation IOSB grew to become Europe’s largest research institute in the field
of image acquisition, processing and analysis. IOSB’s other areas of activity are control and
automation technology, and information and knowledge management.
IOSB has four locations in Germany: Karlsruhe, Ettlingen, Ilmenau and Lemgo (highlighted
on the map of the Fraunhofer Gesellschaft on page 33), as well as a representative office in
Beijing.
The three core competencies of Optronics, System Technologies and Image Exploitation give the
institute its distinctive profile. Optronics covers the interface region between electromagnetic
radiation and electronic signals. It deals with converting information about the appearance of
the environment and the objects it contains into electrical signals and – conversely – electrical
signals into optical images.
Image processing covers conditioning and real-time processing of, and automatic and
interactive information extraction from images and videos.
System integration, which represents a cross-section of expertise and is essential for responding to difficult, comprehensive issues with integrated solutions, may, at first sight, appear
to be our most abstract field of research. System integration covers everything that is required
for analysis, gaining an understanding of, modeling, development, and controlling complex
systems.
6
1 The departments of IOSB and
their relation to the core competencies optronics, image exploitation and system technologies.
Optronics
OPT:Optronics
SIG: Signatorics
SPR: Visual Inspection Systems
System technologies
NRG: Energy
WMS: Water and Mobile Systems
ILT:
Information Management
and Production Control
INA: Fraunhofer Application
Center Industrial
Automation
Figure 1
MRD: Systems for Measurement,
Lemgo
Peking
Control and Diagnosis
SKA: Secure Communication
Karlsruhe
Ettlingen
Ilmenau
Director
Division Photonics
Advanced System Tech- Fraunhofer Applica-
Beijing Representative
Prof. Dr.-Ing. habil.
and Optronic
nology (AST) Branch
tion Center Industrial
Office of IOSB
Jürgen Beyerer
Systems
of Fraunhofer IOSB
Automation INA
Head of division
Head of AST
Head of department Head of
IAS: Interoperability and
Dr. rer. nat.
Prof. Dr.-Ing. habil.
Prof. Dr.-Ing.
representative office
Reinhard Ebert
Thomas Rauschenbach Jürgen Jasperneite
Dipl.-Ing. Hong Mu
OBJ: Object Recognition
Architectures
Image exploitation
IAD: Interactive Analysis and
Diagnosis
Departments:
SPR, ILT, MRD, SKA, Departments:
IAD, IAS, VID, VBV
Departments:
OPT, SIG, OBJ, SZA NRG, WMS
Assistance Systems
Department:
SZA: Scene Analysis
INA
VID: Video Exploitation
Systems
VBV: Variable Image Acqui-
The key of IOSB are fourteen departments and a research group, which represents building
sition and Processing
(Research Group)
blocks the link to the Chair for Interactive Real-Time Systems of the Institute of Anthropomatics at the Faculty of Informatics of KIT. The Competence Triangle in Figure 1 illustrates the
share of core competencies contributed by each of IOSB’s departments.
With their various key areas, the departments of IOSB cover the entire process chain from
signal acquisition through signal analysis to integration into operational systems. In practical
use, systems interact with their environment. This, too, is reflected by the activities of IOSB,
which cover all degrees of freedom required for effective system design.
The problems on which IOSB focuses in its research and development work usually require
the integration of a range of different scientific disciplines. This awareness forms the basis for
the allocation of our departments within the competence triangle in Figure 1. The abundance
of our expertise gives us a great bandwidth of achievable goals. While finding solutions
to our tasks requires sophisticated technologies to deal with the various subproblems, the
creation of value and benefit requires a well-organized interplay of powerful components
in a coherent whole.
7
the institute in profile
In order to leverage this potential, profound expertise in automation technology, system
architecture, software engineering, network engineering, information and knowledge
management, interoperability technologies and, not least, a systematic design of humanmachine systems is required. Typical for problems beyond a certain degree of difficulty and
complexity is that optimal solutions are not merely automatisms but rather man-machine
systems, in which – in addition to hardware and software – the organization into an overall
process is crucial.
Convincing examples of systems from IOSB include the image and video analysis system ABUL
and VABUL for the LUNA unmanned reconnaissance aircraft, several of which are in use in
the German Armed Forces and now also in the Swiss Air Force; the RecceMan® system, which
provides efficient interactive object recognition in aerial photographs and has also been taken
into operation as a valuable tool by the German Armed Forces; and the control system
ProVis.Agent®, which is being used very successfully in automobile production at Daimler AG,
in particular in the Bremen and Wörth factories. In industrial quality inspection, large numbers
of our sorting systems are working reliably, for example, in glass recycling plants. Our partner
Binder+Co was awarded the Austrian State Prize for Innovation for this system.
Complementary to its research and development activities, IOSB has systems evaluation and
assessment capabilities. An example is IOSB’s thermal range model software package TRM 4,
with which the performance of the overall system consisting of vision device and observer is
determined quantitatively. Based on the knowledge of all components and associated human
capabilities, this system considers technical features and laboratory measurements to perform
assessments. With its neutral evaluation competence, IOSB supports clients in planning and
developing components and systems, in concept development and planning of facilities, and
in procurement.
Our business units bring together the expertise of IOSB towards the markets. As well as
requiring scientific and technology skills, best-of-class solutions need also need in-depth
industry knowledge. The five business units are listed alphabetically in Figure 2. Developing
2 Business Units of IOSB.
8
3 Organization chart May 2014.
dynamically, they provide specific solutions, services and products tailored to the needs of
their specific markets. The departments participate in the business units according to the
allocation of their activities to the markets.
Of great importance for IOSB are its close ties with the Karlsruhe Institute of Technology
(KIT), which complements its research capabilities. With the Chair for Interactive Real-Time
Systems at the Institute for Anthropomatics of the Faculty of Informatics, consulting activities
of university chairs at IOSB, membership of university professors in the Board of Trustees,
lecturing by IOSB staff and more, cooperation with the KIT is already multi-faceted.
An intensified collaboration with KIT in the research work at the Ettlingen site to sustainably
integrate the entire range of IOSB’s activities in the science region of Karlsruhe is also being
planned. To this end a Chair in Optronics is to be established at the Faculty of Electrical
Engineering and Information Technology of KIT.
At IOSB’s Ilmenau and Lemgo sites the cooperation with the Technical University of Ilmenau
and the University of East Westphalia Lippe has also been strengthened through professorships and is proving highly fruitful.
9
overview
Director
Prof. Dr.-Ing. habil.
Organization Chart
Deputies to the Director
Dr. rer. nat. Reinhard Ebert
Jürgen Beyerer
Dr. rer. nat. Jürgen Geisler
Dr.-Ing. Olaf Sauer
Optronics System technologies
10
Head of department OPT
Optronics
Dr. rer. nat. Dipl.-Chem.
Helge Bürsing
Phone +49 7243 992-446
Head of department NRG
Energy
Dr.-Ing. Peter Bretschneider
Phone +49 3677 461-102
Head of department INA
Fraunhofer Application Center
Industrial Automation
Prof. Dr.-Ing. Jürgen Jasperneite
Phone +49 5261 702-572
Head of department SIG
Signatorics
Dr. rer. nat. Karin Stein
Phone +49 7243 992-114
Head of department WMS
Water and Mobile Systems
Prof. Dr.-Ing. habil.
Thomas Rauschenbach
Phone +49 3677 461-124
Head of department MRD
Systems for Measurement,
Control and Diagnosis
Dr.-Ing. Michael Heizmann
Phone +49 721 6091-329
Head of department SPR
Visual Inspection Systems
Prof. Dr.-Ing. Thomas Längle
Phone +49 721 6091-212
Head of department ILT
Information Management and
Production Control
Dr.-Ing. Thomas Usländer
Phone +49 721 6091-480
Head of department SKA
Secure Communication
Architectures
Dipl.-Inform. Thomas Kresken
Phone +49 721 6091-273
Image exploitation
Division:
Photonics
and Optronic
Systems
Head of department IAD
Interactive Analysis and
Diagnosis
Dr. rer. nat. Elisabeth Peinsipp-Byma
Phone +49 721 6091-393
Strategy and Innovation
Management
Dr. Gunnar Brink
Phone +49 721 6091-640
Head of department SZA
Scene Analysis
Dr.-Ing. Karsten Schulz
Phone +49 7243 992-106
Head of division
Dr. rer. nat. Reinhard Ebert
Public Relations
Dipl.-Ing. Sibylle Wirth
Phone +49 721 6091-300
Phone +49 7243 992-140
[email protected]
Head of department IAS
Interoperability and Assistance
Systems
Dr.-Ing. Rainer Schönbein
Phone +49 721 6091-248
Head of department VID
Video Exploitation Systems
Dr.-Ing. Markus Müller
Phone +49 721 6091-250
Assigned departments
Optronics
Dr. rer. nat. Dipl.-Chem.
Helge Bürsing
Signatorics
Dr. rer. nat. Karin Stein
Commercial and Technical
Management
Dipl.-Kaufm. Siegbert Böckle
Phone +49 721 6091-350
Object Recognition
Dr. rer. nat. Michael Arens
Scene Analysis
Dr.-Ing. Karsten Schulz
Head of department OBJ
Object Recognition
Dr. rer. nat. Michael Arens
Phone +49 7243 992-147
Group manager VBV
Variable Image Acquisition and
Processing (Research Group)
Dr. rer. nat. Alexey Pak
Phone +49 721 608-45912
Representative Office China,
Beijing
Dipl.-Ing. Hong Mu
Phone +86 10 65900 621
11
Welcome to the Factory of the Future
A research factory
for industrial automation
A research factory is a manufacturing system, which is flexible and resource-efficient as well
as adaptive to humans and can therefore be operated intuitively. It is a highly complex system
consisting of technical components that even incorporate intelligence. We firmly believe that
we will have smart factories soon. The paradigm of “Internet of Things” is making inroads on
all areas of daily life: Whether in the home, in cars, or in production, embedded systems are
rapidly becoming our daily companions. Coffee makers, toasters, and even plants can “have
their own voice” and be responsive. This hidden computer systems, which are connected to
the Internet are working to make users’ lives easier. In future production systems the plants
control themselves and work pieces are able to advise the production system how they have
to be processed. This makes production much more flexible and allowing mass customization.
As part of the German government’s high-tech strategy the trend of merging production
technology with information technology has been termed “Industry 4.0” – the fourth industrial
revolution. The technological platform at the core of Industry 4.0 is the Internet of Things (IOT),
which largely eliminates the distinction between the virtual and the real world.
Since 2005 we have been working specifically on ICT-based automation technologies to realize
the factory of the future. In 2014, as we continue to pursue the same objective, the proven
research and demonstration platform “Lemgo Modellfabrik” is evolving into an intelligent
factory of the future.
12
With a consistently modular design concept in terms of mechatronics, automation, and
software, the most important characteristics of a Research Factory – such as adaptability,
plug-and-play capability and ease of use – are demonstrated with augmented reality
methods.
Located on the campus of the Ostwestfalen-Lippe University of Applied Sciences, the Research
Factory will be both demonstration facility and learning environment for students of industrial
and electrical engineering as well as of computer science. Small and medium-sized producing
companies will have the opportunity of benefit from a batch production and training their
personnel.
On a floor area of 2000 m², intelligent automation solutions will be explored, developed and
tested here. The research factory for Industry 4.0 technologies is an initiative of the
Fraunhofer IOSB-INA and the OWL University of Applied Sciences
Our research factory – Nestled
in the CIIT Research Campus.
13
Groundbreaking
A Westphalian success story: Research
Center CIIT in Lemgo is expanding
It is a success story made in OWL. Industry leaders from the world of electrical engineering
are partnering with research institutions. Dedicated private investors provide the necessary
capital. The CENTRUM INDUSTRIAL IT (CIIT) in Lemgo is the home of the Fraunhofer Application
Center for Industrial Automation and Germany’s first Science-to-Business center in the field
of industrial automation. Built in 2010 on the campus of OWL University, the research center
is now, four years later, being extended to twice its former size.
The CIIT has globally established itself as a high-tech research center. Technology companies
and research institutes, who carry out research work in the field of IT-based automation,
here work under a single roof. Adjacent and connected to CIIT’s existing premises right on
the campus of OWL University, a new building is being erected, increasing the total area to
10,000 square meters. The new building is to be inaugurated in mid-2015. The Fraunhofer
Application Center for Industrial Automation (IOSB-INA) can now significantly expand its
floorspace. The CIIT partners, too, are getting more space for work and research. Flexible
project areas that are available for short- and medium-term rental will also be available.
14
On March 20, 2014 around 150 invited guests celebrated the groundbreaking ceremony
for the CIIT extension. Among the guests was Svenja Schulze, Minister for Innovation,
Science and Research of North Rhine-Westphalia, which presented the CIIT with the “Place
of Progress” award for exceptional cooperation between industry and science. This award
is presented to institutions in North Rhine-Westphalia that unite economic, ecological and
social innovation and enable progress for society. Minister Svenja Schulze praised the longterm interdisciplinary cooperation within the CIIT. “Science and industry are pulling together
here – permanently, head to head and under one single roof. A venture from which both
benefit”, said Schulze in her speech.
The extension also symbolizes the growth of the network that has developed around the CIIT.
Numerous research projects, dual degree opportunities, graduate school and the award of a
prize for young researchers demonstrate the fruitfulness of the close cooperation between
industry, research institutes and universities in Lemgo.
15
IT security lab for industrial
control systems
IOSB establishes an IT security lab for industrial control systems in 2014, which specializes
in net-working and the application of Internet technologies in the factory of the future
(Industrie 4.0). This IT security lab combines IOSB’s expertise in automation, control and IT
security. It thus enables IOSB to provide its customers with tailored solutions from a single
source. In order to support consulting and development services, the IT security lab provides
IOSB’s customers an opportunity to carry out security investigations around new security
technologies for networked industrial control systems. Particular aspects of this lab are the
protection of networked cyber physical systems (CPS) by applying security technologies
promulgated by the »Internet of Things« community.
IOSB experts focus on the analysis of security threats, the identification of vulnerabilities in
production networks, and the development of solutions that allow the operator to observe
the security state of its assets (security monitoring, gaining overview of the situation).This
IT security lab comprises its own industrial automation systems with integrated equipment
from different manufacturers. Security research and the testing of new security technologies
and products can be carried out in an integrated real environment. Security investigations
are executed in the classical multi-level IT system automation pyramid ranging from the field
Contact:
Dipl.-Inform. Birger Krägelin
Phone +49 721-6091-454
[email protected]
16
VGB Power Tech GmbH Germany.
device level up to manufacturing execution systems (MES) and enterprise resource planning
(ERP), as well as in networked CPS environment possibly relying upon virtualized, distributed
data storage systems. The latter case tends to be a typical Industrie 4.0 environment, which
typically relies upon cloud technologies, implemented as private or public cloud or both. Here,
security, privacy and trust aspects need particular attention. Furthermore, the secure local
automation systems at IOSB Karlsruhe are connected to further labs residing at other locations
of IOSB (Lemgo, Ilmenau) so that multi-site supply chain settings can be demonstrated. As it
is set-up as a high security lab it allows the IOSB scientists to study special attack techniques
and dangerous malicious programs. Further the development of new methods to identify
vulnerabilities (penetration testing, vulnerability testing) is carried out.
The IT security lab for industrial control systems is well connected nationally and internationally
and leverages close cooperation networks between experts from academia and industry. The
IOSB activities are involved in the high-tech strategy of the federal government (Industrie 4.0)
and in standardization processes for Industrial IT security technology.
IT
17
1
Contact Office China,
Beijing
1 The Thuringian Minister
President Christine Lieberknecht,
Professor Thomas Rauschenbach
(Fraunhofer IOSB-AST) and
Professor Li as well as Science
Minister Christoph Matschie
(from right) at the handover
of “C-Watch” in Beijing.
Many German companies have discovered China as an attractive market for itself. However,
these companies often need local partners also in applied research. Due to a long-term
cooperation with several research institutes and industrial partners in China, Fraunhofer IOSB
established a representative office in Beijing as early as in 1996.
The focus of the representative office is the initiation of research activities focused in the
areas of environment and energy. Especially in the field of water supply and water resource
management Fraunhofer IOSB is involved in many R&D projects in China.
2013 was one of the most successful years since the establishment of the representative
office. Under the presence of prime minister of the state of Thuringia Christine Lieberknecht
and minister Christoph Matschie the underwater vehicle „C-Watch“ was delivered to the
Dipl.-Ing. Mu Hong
Chinese customer, China Agriculture University (CAU) in May 2013. A second vehicle will be
Phone +86 10 65900 621
transferred to the Nanjing Hydraulic Research Institute in 2014.
Fax +86 10 65900 619
[email protected]
As part of the funding program „International Partnerships for Sustainable Technologies and
Services for Climate Protection and the Environment“ (CLIENT), the research project „HAPPI“
Fraunhofer Representative
(Small Hydropower Plants: Assessment of Climate Protection Potential and Improvement by
Office Beijing
Smart Technologies) could be successfully started. As a third major water project, the EU
Representative for Production
project INAPRO (Innovative model and demonstration based water management for resource
and Information Technologies
efficiency in integrated multitrophic agriculture and aquaculture system) could be initiated.
Unit 0610 Landmark Tower II
8 North Dongsanhuan Road
Offside the water sector, an industrial project with Volkswagen Group China and Fraunhofer
Chaoyang District
IWU has to be mentioned, addressing several issues in electric mobility. Beyond, a consulting
100004 Beijing, PR China
project in the field of cable harness production started together with the Beijing Research
Institute of Telemetry (BRIT).
Contacting us in Germany
Prof. Dr.-Ing. habil.
Furthermore, the exchange of scientists between China and Germany could be strengthened:
Thomas Rauschenbach
Nine Chinese visiting scholars of the China Agriculture University and the Yellow Sea Fishery
Phone +49 3677 461-124
Research Institute could be welcomed to Germany within the EU personnel exchange fund
thomas.rauschenbach@
„Marie Curie Actions“.
iosb-ast.fraunhofer.de
18
The InstitutE in Figures
The development of IOSB
Funding*
continues to be positive and
we are expanding organically.
Especially pleasing is the substantial growth in our returns
from private enterprise in
2013.
Aside from the peak in 2012,
which was due to exceptional
Business expenses
investments, the IOSB grows
steadily.
In addition to our permanent
staff we also engaged 175
student assistants and interns.
* The diagram does not
include research and business
Staff
activities concerning defense.
Annotation:
The chart “business expenses 2009“
shows only the figures for IITB
without FOM.
19
Alliances
iosb in Fraunhofer alliances
Fraunhofer AutoMOBILE Production Alliance
Business areas:
•Production research for
electromobility
Carmakers, their suppliers, and those equipping the automotive industry, represent a decisive
•Methodological competence
economic factor in Germany. Significant changes to the entire concept of mobility are ultim-
(logistics, planning, quality
ately being driven by global trends, such as dwindling natural resources, an increasing need for
assurance)
mobility, urbanization and megacities. In addition, German carmakers and their suppliers are
•Vehicle body
facing increasingly tough competition as the trend towards low-cost vehicles takes hold.
•Powertrain
•Electrical/electronic systems
The Fraunhofer Alliance pools the expertise of 18 institutes, who collectively provide the German
•Interior
automotive industry with a competent single-source partner for its research and development
•Assembly/vehicle final assembly
needs. The complementary effect achieved by combining the individual institutes‘ key areas of
research, makes it possible to generate rapid, integrated and sustainable innovations along the
entire process chain of vehicle manufacturing – from the planning stage right through to the
finished vehicle. The Alliance tackles the challenges posed by environmental policies (reducing
fuel consumption and CO2; electromobility; cutting material consumption) while taking full
Contact at IOSB:
account of commercial imperatives (ongoing pressure to cut costs).
Dr.-Ing. Olaf Sauer
Fraunhofer Embedded Systems Alliance
Business areas:
•Materials and components
•Numerical and experimental
Fraunhofer Embedded Systems Alliance: Complex technological products generally contain
embedded systems: computers that monitor, regulate and control various functions. Embedded
systems are very much at the heart of high-tech devices in the automotive industry, in mechan-
methods
•Electronics and control
technology
ical and plant engineering, in medical technology or in home electronics.
•Systems
The complexity and capabilities of these systems have grown to such an extent in the course
Deputy Spokesperson of alliance:
of their technological development that they are now beyond the competencies of any one
Prof. Dr.-Ing. Jürgen Jasperneite
field. In response, Fraunhofer has created the Embedded Systems Alliance, bringing together
the expertise of those Fraunhofer Institutes whose combined competencies in the fields of
information technology, electronics and engineering cover the entire spectrum of embedded
Contact at IOSB:
systems.
Prof. Dr.-Ing. Andreas Wenzel
20
Fraunhofer Energy Alliance
Business areas:
•Renewable energy sources
•Energy-efficiency technologies
In the Fraunhofer Energy Alliance eighteen Fraunhofer Institutes join their expertise in energy
•Buildings and components
technologies and energy research, with the aim to give research and development from one
•Intelligent energy nets
hand to industry and energy economy.
•Energy storage and micro-energy
systems
The alliance co-operates with the Fraunhofer networks Microenergy Technology, Wind Energy,
Direct-Ethanol-Fuelcell and Smart Grids.
Deputy Spokesperson of alliance:
Dr.-Ing. Peter Bretschneider
The Alliance’s work is chiefly focused on: Renewable energy sources (solar energy, biomass,
wind power); energy-efficient technologies (fuel cells, combined heat and power (CHP) systems
and gas delivery, building-service technologies, power electronics); buildings and components
(low-energy-houses, building energy technology); smart grids (p.e. systemtechnological grid
integration of distributed generators; electrical energy storage and micro-energy systems
Contact at IOSB:
(lithium battery technology, fuel-cell systems) and energy management solutions.
Dr.-Ing. Peter Bretschneider
Fraunhofer Food Chain Management Alliance
Thematic areas:
•Food chemistry
•Food packaging technology
The Fraunhofer »Food Chain Management« Alliance is a platform that merges the expertise of
•Logistics
12 Institutes. It aims at introducing latest scientific know-how in new products and solutions of
•Microsystem technology
this field by means of mutual projects.
Food Chain Management has an enormous economic significance. Therefore new approaches
in food safety, microelectronics and logistics, which can easily be integrated in the entire food
chain and exhibit an added value as high as possible at low costs are the main objective.
Contact at IOSB:
The alliance acts as a competent contact partner and problem solver, both for industrial
Dipl.-Ing., Dipl.-Wirt. Ing.
partners and SMEs as well as institutional funding organizations on a national, European and
Henning Schulte
global level.
Prof. Dr.-Ing. Thomas Längle
Fraunhofer Vision Alliance
Business areas:
•Industrial image processing
•Automated visual inspection
The Fraunhofer Vision Alliance combines the expertise of institutes in the field of automated
•3-D surveying
visual inspection and image processing.
•Thermography
•X-ray inspection
The main office in Erlangen serves as the initial point of contact for customers. This office is
•Surface inspection
also responsible for the coordination of joint projects. The institutes cooperating in the Vision
•Medical engineering
Alliance offer services relating to applications of innovative sensors, from terahertz radiation
•Safety engineering
over the visual spectrum and infrared to x-ray, the associated handling, and the evaluation of
•Traffic engineering
the sensor data. Their work focuses particularly on optical sensing and automated inspection
•Terahertz imaging
processes for quality assurance.
Contact at IOSB:
Dr.-Ing. Michael Heizmann
Prof. Dr.-Ing. Thomas Längle
21
Fraunhofer Water Systems Alliance
Business areas:
•Urban/periurban water
management systems
In the Fraunhofer Water Systems Alliance (SysWasser) eleven Fraunhofer Institutes have been
pooling their expertise in the research and development of effective water infrastructure
•Processes and systems for the supply with drinking and service water
systems and technology.
•Wastewater treatment processes
The alliance’s objective is to take sustainable solutions for water catchment, infrastructure,
•Integrated water resource
and systems
and wastewater treatment and adapt them for use in practical applications on a national and
international level, taking into consideration the relevant social, economic and environmental
implications.
management (IWRM)
•Analysis and evalutation of
water-economic systems
The use of an integrated, systemic approach linking the energy, waste management and
Contact at IOSB:
agricultural sectors will contribute towards a more efficient and environmentally compatible
Prof. Dr.-Ing. habil.
usage of water as a life-essential resource.
Thomas Rauschenbach
Fraunhofer Space Alliance
Business areas:
•Communication and Navigation
•Materials and Processes
Bringing together 13 institutes, the Fraunhofer Space Alliance conducts applied research in the
•Energy and Electronics
field of industrial space technology. Weather forecasts, navigation, real-time transmission for
•Surfaces and Optical Systems
satellite TV or global Internet access – space industry applications and services have become an
•Protection Technology and
indispensable part of daily life, underpinning the importance of space technology for a modern
industrialized society. In the Fraunhofer Space Alliance, the institutes pool their technological
Reliabilty
•Sensor systems and Analysis
expertise in order to provide the industry and funding agencies such as the European Space
Agency (ESA) and the European Commission with a central contact.
Fraunhofer acts as systems provider, developing a wide range of top-quality components,
integrating them into an overall system and delivering that system to the customer. The sheer
technological variety of the participating institutes enables the Fraunhofer Space Alliance
to offer its customers a unique range of services. Its business units are Communication and
Contact at IOSB:
Navigation, Materials and Processes, Energy and Electronics, Surfaces and Optical Systems,
Dr. rer. nat. Dipl.-Phys. Karin Stein
Protection Technology and Reliability and Sensor Systems and Analysis.
Dipl.-Ing.(FH) Caroline Schweitzer
22
Alliances_3
iosb in Fraunhofer Groups
Fraunhofer Information and
Business areas:
Communication Technology Group
•Digital media
•E-Business
As the largest ICT research group in Europe, the Fraunhofer Information and Communication
•E-Government
Technology Group serves as a one-stop shop for industrial customers and media enterprises
•Communication systems
•Energy and Sustainability
The strengths of the member institutes are pooled strategically and marketed jointly. This net-
•Medicine
work makes it possible to translate application-oriented research into customized, integrated
•Production
solutions for a specific sector:
•Security
• tailored IT solutions
•Financial service provider
• competent consulting on technological issues
•Automotive
• pre-competitive research for new products and services
Regular economy summits unite the right partners from industry and research. The Fraunhofer
Information and Communication Technology Group evolves strategies and visions for mediumterm priority research areas, providing its member institutes with assistance in the transfer of
technology and the marketing of their research activities. The ICT Group also publishes the
Contact at IOSB:
economy magazine »InnoVisions«, which is available at the kiosk.
Prof. Dr.-Ing. habil. Jürgen Beyerer
Fraunhofer Group for Defense and Security
Business areas:
•Security research
•Protection and deterrence
This group has been formed by Fraunhofer institutes as a means of coordinating their research
•Reconnaissance and surveillance
activities and defining common goals in the area of »Defense and Security«.
•Explosives and safety engineering
The chief objective of the group is to agree on common strategies vis-à-vis government funding
•Decision-making support for
agencies and to promote collaboration with these institutions and with the defense industry.
government and industry
Furthermore, the members of the group intend to align their research strategies with the
•Localization and communication
requirements of the projected unification of European defense and security policy.
•Image processing
The group aims to maintain its traditional combination of research fields with civil and military
applications, because it represents a valuable source of innovation and technological progress,
to the benefit of all parties. It will continue to exploit this factor as a competitive advantage
in both markets. The member institutes of the group, which engage in both civil and defense
research, thus have an important role to play in the transfer of knowledge. They ensure that
any significant breakthrough in research funded by non-military sources will be used to benefit
Contact at IOSB:
defense technology, and vice versa.
Prof. Dr.-Ing. habil. Jürgen Beyerer
Fraunhofer Group for Production
Business areas:
•Product development
•Manufacturing technologies
The Fraunhofer Group for Production is a cooperative venture by a number of Fraunhofer
•Manufacturing systems
Institutes, created with the aim of collaborating on production-oriented research and deve-
•Production processes
lopment in order to be able to offer customers in the manufacturing, commercial and service
•Production organization
sectors comprehensive single-source solutions derived from the pooling of the wide-ranging
•Logistics
expertise and experience of the individual institutes. The Fraunhofer Group for Production
makes use of the latest findings in industrial engineering and information science to offer a
Contact at IOSB:
range of services that covers the entire product life cycle or value chain.
Dr.-Ing. Olaf Sauer
23
Fraunhofer-Gesellschaft
R e se a rc h of pra cti ca l u ti l i ty l i e s a t th e h eart of al l ac ti v i ti es purs ued by the
Fr a unhof e r- Ge s e l l s c h a ft. Fo u n d e d i n 1 9 4 9, the res earc h organi z ati on underta k e s a pplie d re s e a rch th a t d ri v e s e co n o mi c dev el opment and s erv es the wi der
b e ne f it of soc ie ty . I ts s e rv i ce s a re s o l i c i te d by c us tomers and c ontrac tual partn e r s in indust r y , th e s e rv i ce s e c to r a n d p u bl i c admi ni s trati on.
At present, the Fraunhofer-Gesellschaft maintains 67 institutes and research units. The majority
of the more than 23,000 staff are qualified scientists and engineers, who work with an annual
research budget of 2 billion euros. Of this sum, more than 1.7 billion euros is generated
through contract research. More than 70 percent of the Fraunhofer-Gesellschaft’s contract
research revenue is derived from contracts with industry and from publicly financed research
projects. Almost 30 percent is contributed by the German federal and Länder governments
in the form of base funding, enabling the institutes to work ahead on solutions to problems
that will not become acutely relevant to industry and society until five or ten years from now.
International collaborations with excellent research partners and innovative companies around
the world ensure direct access to regions of the greatest importance to present and future
scientific progress and economic development.
With its clearly defined mission of application-oriented research and its focus on key
technologies of relevance to the future, the Fraunhofer-Gesellschaft plays a prominent role
in the German and European innovation process. Applied research has a knock-on effect
that extends beyond the direct benefits perceived by the customer: Through their research
and development work, the Fraunhofer Institutes help to reinforce the competitive strength
of the economy in their local region, and throughout Germany and Europe. They do so by
promoting innovation, strengthening the technological base, improving the acceptance of
new technologies, and helping to train the urgently needed future generation of scientists
and engineers.
As an employer, the Fraunhofer-Gesellschaft offers its staff the opportunity to develop the
professional and personal skills that will allow them to take up positions of responsibility within
their institute, at universities, in industry and in society. Students who choose to work on
projects at the Fraunhofer Institutes have excellent prospects of starting and developing a
career in industry by virtue of the practical training and experience they have acquired.
The Fraunhofer-Gesellschaft is a recognized non-profit organization that takes its name
from Joseph von Fraunhofer (1787–1826), the illustrious Munich researcher, inventor and
more at:
entrepreneur.
www.fraunhofer.de
24
l o c at i o n s
Locations of the Fraunhofer
institutes in Germany
more at:
www.standortkarte.fraunhofer.de
25
B u s i n e ss U n i t
Automation
Spokesperson
technology. Industrial ICT has to fulfill high standards, which
Dr.-Ing. Michael Heizmann
result from competitive production costs, high equipment
Phone +49 721 6091-329
availability, required product quality and guaranteed delivery
times. Mechanical engineers, computer scientists and automation experts must therefore cooperate more closely than
ever to meet future requirements. That is what the team of
the Automation Business Unit stands for.
To date, ICT in production technology has been based on the
architectural model of the automation pyramid. Owing to
increasing ICT support on all hierarchical levels of the factory,
however, there seems to be a new trend according to which
the information flow in factories follows a new ”reference
model of industrial information technology”. This model takes
Business Unit Development
account of three dimensions of information flow, namely
Dr.-Ing. Olaf Sauer
vertical and horizontal integration, and integration spanning
Phone +49 721 6091-477
the entire life cycle of production equipment.
When it comes to enabling shop-floor-related ICT systems to
communicate consistently within the three aforementioned
dimensions, for example, it is necessary to connect them
systematically with the systems of the digital factory (life
cycle dimension) and with automation technology on the
control and field levels (vertical integration). To this end, it is
indispensable to use unified, general syntax and semantics.
Specifically, the activities of the Automation Business Unit
Real-time ICT for complex manufacturing processes
focus on the following areas:
Automation technology is a key factor for the competitive-
1) Production monitoring and control technology and MES:
ness of the German manufacturing industry. Automation
Monitoring and control systems become increasingly
– and particularly industrial information technology – also
important for transparent and safe production. We
plays a major role in the current debate about cyber-physical
consider control technology to be a fundamental part of
systems and the Internet of Things: Information and commu-
today’s manufacturing execution systems.
nication technology (ICT) penetrates all devices, machinery
2) Adaptive information technology: Adaptivity is one of the
and equipment in production, on all hierarchical levels,
key requirements for the factory of the future – not just in
ranging from sensors and machine components, machines
physical terms, but increasingly in terms of software, too.
and their controls to interlinked plants and their visualization
Our current activities in the field of Secure Plug&Work are
across operations by means of monitoring and control
ground-breaking in this respect.
26
3) Industrial Smart Grids: We deal with the challenge of
• Network-based data loggers for process and system diagnosis
energy management in manufacturing operations. To this
• Autonomous robot platforms
end, our specialists make use of the principles of smart
• Intelligent Energy Systems research platform at the sub-
grids, including the integration with the smart grids of
institute of Advanced System Technology (IOSB-AST)
energy providers. We combine our expertise in energy
• ICT energy laboratory at the sub-institute of Advanced
management and suppliers’ energy data management with
System Technology (IOSB-AST)
long-term experience in monitoring production plants on
behalf of energy consumers.
References / product highlights
4) Process intelligence and quality improvement: We use
state-of-the-art monitoring and control technology as well
• ProVis.Agent® integrated monitoring, control and reporting
as condition monitoring to improve plant performance and
system for car body, paint and assembly shops of the
availability in the process and manufacturing industry.
Bremen and Wörth plants of Daimler AG
5) Industrial communication: It is our vision to create an
internet for machines and “things” in general in manufacturing, making real-time information available on all
levels of a distributed automation system in the required
• Integration platform in the press shop of the Bremen plant
of Daimler AG
• ProVis.Agent® monitoring and control system for Thyssen
Krupp Steel AG, Duisburg
quality and allowing devices to be integrated on the basis
• Various interoperability tools based on CAEX and OPC UA
of standardized Plug&Work principles.
• ProDaMi: suite containing data mining tools for decision
6) Robot systems: This area focuses on activities relating the
control of autonomous and partly autonomous robots and
vehicles, acting as individuals, in groups and in cooperation
with human beings.
support in manufacturing
• Condition monitoring for Bayer Technology Services GmbH,
Leverkusen
• PROFINET single-chip solution for Phoenix Contact,
Blomberg and Siemens AG, Nürnberg
Equipment / laboratory facilities
• Various projects relating to Industry 4.0
• Model factory at the Fraunhofer Application Center
Industrial Automation (IOSB INA) in Lemgo
• ProVis test bed
• Automation test bed including PLCs, communication,
and monitoring and control systems
• Tools for online fine planning and scheduling for discrete
manufacturing (ProVis.APS)
• OPC and OPC UA simulation
• AutomationML™ test center
• Virtual commissioning laboratory including PLCs, WinMOD,
and Delmia Automation
• Test installation to demonstrate interoperability and adaptivity
• Design and simulation tools for engineering and testing
micro-electronic IPs in the field of real-time communication
27
S y s t e ms f o r M e a s u r e m e n t ,
Control and Diagnosis
www.iosb . frau n h o fer.d e / M R D
Model-based optimization of a complex
biological production process
T he produc t ion o f b u l k a n d fi n e c h e m i c a l s bas ed on renewabl e res ourc es has gai ned i nc reas i ng i mpor t ance
i n re c e nt y e a r s a s “ wh i te b i o te c h n o l o g y“ . Surfac tants whi c h, for the mos t part, are c urrentl y manuf act ure d indust r ia lly fro m p e tro ch e m i c a l ra w m ateri al s , are a potenti al produc t of the us e of bi otec hnological
p roduc t ion m e th o d s . O n e k n o wn e xa m p l e of mi c robi al s urfac tants i s rhamnol i pi ds from the bact er ium
P se udom ona s a e ru g i n o s a . R h a m n o l i p i d s can be produc ed on the bas i s of renewabl e res ourc es such as
ve ge t a ble oils o r s u g a r. T h e y a re ch a ra c te riz ed by thei r good env i ronmental s us tai nabi l i ty and bi od egr adab ilit y a nd e x c e l l e n t s u rfa c ta n t p ro p e rti e s. A s i gnifi c ant reas on as to why bi otec hnol ogi c al l y p roduced
rha m nolipids ca n n o t y e t c o mp e te wi th s yntheti c s urfac tants on the market i s the rel ati v el y l ow product
yie lds. A pproa ch e s u s e d s o fa r to o p ti m i z e the produc ti on of bi os urfac tants are l argel y bas ed on heur ist ic
p roc e sse s, pa r t i cu l a rl y wi th re g a rd to th e rhamnol i pi d c reator Ps eudomonas aerugi nos a. The ai m of t he
p roje c t w a s t he re fo re to a tta i n o p ti mi ze d proc es s management s trategi es by us i ng an i nterdi sciplinar y
com bina t ion of a d v a n ce d p ro c e s s co n tro l , bi ol ogi c al proc es s tec hnol ogy and mol ec ul ar bi ol ogi c al m et hods
i n o rd e r t o m a k e i t p o s s i b l e t o p ro d u c e s u r f a c t a n t s f ro m re n e w a b l e re s o u rc e s i n a n e c o n o m i c a l a n d
s u s t a ina ble w a y.
Results
Figure 1 shows the reactions and interactions for forming Pseudomonas aeruginosa (biomass)
and the products mono-rhamnolipid and di-rhamnolipid. The biomass is in large part formed
from glycerol and fatty acid. Nitrogen is also required for its formation along with the trace
elements phosphorus, sulfur and iron. As shown in Figure 1, the sunflower oil that is added
is cleaved into glycerol and fatty acid by using lipase as a catalyst. Lipase, in turn, is formed
by using glycerol, fatty acid and nitrogen and under the catalytic effect of the biomass.
Mono-rhamnolipid is also formed from glycerol and fatty acid under the catalytic effect of
the biomass. A part of the mono-rhamnolipid reacts with glycerol and fatty acid to make
di-rhamnolipid. As a by-product, polysaccharide is formed from glycerol and fatty acid.
State variables of the model are firstly the concentration of biomass, sunflower oil, lipase,
glycerol, fatty acid, mono-rhamnolipid, di-rhamnolipid, polysaccharide, nitrate and carbon
dioxide. Another state variable is the concentration of C4-HSL (HSL = homoserine lactone),
Contact:
which is a measure of quorum sensing. The bacterium Pseudomonas aeruginosa uses
Dr. Thomas Bernard
quorum sensing to control the secretion of the rhamnolipids.
Phone +49 721 6091-360
[email protected]
28 Business Unit Automation
1
2
1 Process for creating
biosurfactants.
2 Using a model-based oil feed
strategy results in greater
product formation (blue line).
By using the chemical equations and the reaction kinetics, a non-linear dynamic model of the
Shown in comparison with the
process has been developed. In total, the model consists of 11 common, highly non-linear
standard batch process (grey line).
and coupled differential equations. The model contains 38 parameters, 8 of these parameters
were determined experimentally, 22 parameter values were taken from literature or from
databases or derived from balance equations. The remaining 8 parameters were fitted based
Project execution
on measured timings of the bioprocess. A specific numerical sensitivity analysis was also per-
Dr.-Ing. Christian Kühnert,
formed to obtain a prioritization of the parameters. The results of the sensitivity analysis were
Dipl.-Ing. Markus Vogelbacher
clearly visualized using a Hinton diagram. By using this approach, five parameters out of the
38 parameters were identified as having the greatest influence on the defined quality indices
when varied. The selected parameters were then optimized in the form of an algorithm,
which minimizes the deviation of the simulated processes from the measured data. Based on
the model, optimized process control strategies were investigated to significantly increase the
rhamnolipid production rate. As can be seen in Figure 2, the model-based oil supply strategy
results in a significantly higher product formation.
Funding
The work is funded by the Baden-Württemberg Stiftung in the “Environmental Technology
Literature
Research“ program.
[1] Henkel, M.; Schmidberger, A.;
Kühnert, C.; Beuker, J.; Bernard, T.;
Schwartz, T.; Syldatk, C.; Hausmann, R.:
Kinetic modeling of the time course
of N-butyryl-homoserine lactone
concentration during batch cultivations of Pseudomonas aeruginosa
PAO1. Journal Applied Microbiology and Biotechnology, SpringerVerlag Berlin Heidelberg 2013.
DOI 10.1007/s00253-013-5024-5
Project Partners
Prof. Dr. Rudolf Hausmann, University of Hohenheim, Subinstitution Bioprocess Engineering,
Institute of Food Science and Biotechnology, Garbenstrasse 25, D-70599 Stuttgart
Marius Henkel, Karlsruhe Institute of Technology (KIT), Institute of Process Engineering in
Life Sciences, Section II: Technical Biology, 76131 Karlsruhe
Anke Schmidberger, Dr. Thomas Schwartz, Karlsruhe Institute of Technology (KIT),
Institute of Functional Interfaces, 76344 Eggenstein-Leopoldshafen
[2] Henkel, M.; Schmidberger, A.;
Kühnert, C.; Schwartz, T.; Bernard, T.;
Syldatk, C.; Hausmann, R.: A model
for rhamnolipid production with
Pseudomonas aeruginosa: Development of optimized biotechnological
processes. In: DECHEMA Conference Biosurfactants – Challenges
and perspectives, 16–17.05.2013,
DECHEMA-Haus, Frankfurt am Main
Business Unit Automation
29
I n t e r a c t i v e A n a ly s i s
and Diagnosis
w ww.ios b . frau n h o fer.d e / IA D
1
Gesture-based Quality Assurance
Intuitive interaction for industrial environments
N e x t - ge ne r a t io n h u m a n -c o mp u te r i n te ra cti on offers i ntui ti v e c ontrol ev en for c ompl ex s y s tems. In t his
project, we applied our vision-based gesture recognition technologies to a challenging industrial application
area . Toge t he r wi th th e B M W G ro u p i n La n ds hut, we i mprov ed thei r qual i ty as s uranc e proc es s for paint ed
bumpers by directly marking errors with gesture interaction. This saves production time while simultaneously
re duc ing e r ror s a n d i mp ro vi n g wo rk i n g co ndi ti ons .
Task
Quality assurance is an integral part of production as it ensures that products meet company
standards and customer expectations. Like most elements of current production systems,
quality assurance is tightly integrated into the IT infrastructure, and every finding must be
documented. While various systems are linked with sophisticated data exchange interfaces,
the human-computer interface is often less than perfect, as it forces workers to use mouse
and keyboard to insert data into input masks. This is not how humans naturally interact and
therefore suboptimal.
The BMW Group noticed that there is potential for improvement regarding the interaction
between workers and computers, in particular in industrial environments. As a test case, they
chose one of their factories in Landshut where painted bumpers are produced (Figure 1). After
production, these bumpers are visually inspected by workers to ensure the expected high
quality. Their findings must then be entered into a terminal that cannot be accessed from the
actual inspection area. Even though this terminal already uses modern touchscreen technology,
there are several drawbacks: Workers must leave their workplace to go to the terminal. This
costs valuable production time and requires that workers shift their focus from their actual
work. Furthermore, workers must remember the precise location of errors, which can lead to
imprecise input, in particular in cases of multiple errors. Therefore, the BMW Group decided
to apply the human-computer interaction technologies of the Fraunhofer IOSB to their quality
assurance process to allow for a more direct control through intuitive gestures.
Result
Contact:
The Fraunhofer IOSB develops technologies for SmartRooms – intelligent environments that
Dipl.-Inform. Alexander Schick
perceive their interiors and react to people. The goal is to provide natural and intuitive ways
Phone +49 721 6091-620
of interacting with computers, for example through gestures. These technologies were applied
[email protected]
to the use case of the BMW Group to improve the quality assurance process.
30 Business Unit Automation
3
The current system perceives both workers and bumpers in real-time. In particular, it recognizes
1 Quality assurance process at
gestures and relates them to the currently inspected bumper. If an error was found, workers
BMW Plant Landshut.
can now simply point at them, in much the way they would when interacting with a colleague.
2 3D reconstruction and
The system recognizes and interprets these gestures and automatically records the pointed-at
gesture interaction.
error locations in the quality assurance system. If no errors were found, a simple swipe gesture
3 Integration into the quality
over the bumper documents it as error-free. This improves the quality of the documentation
assurance system.
because workers can precisely point at the errors in front of them. It also saves time because
workers are not required to leave their inspection area.
Customer
Project description
This project was commissioned by
The system is based on the technologies developed in the SmartControlRoom at Fraunhofer
the BMW Plant Landshut.
IOSB. Two depth sensors placed near the ceiling view the whole inspection area from above.
This ensures that the inspection process is not disrupted by additional hardware that is in the
way of workers. The sensor data is then combined into a coherent 3D reconstruction and both
Project execution
workers and bumpers are detected (Figure 2). The bumper recognition is based on a CAD model
Two departments united their
and can be applied to arbitrary parts by simply changing the model. Gesture recognition gives
expertise for this project. Alexander
information about the arms in 3D and gestures can be directly linked to the bumpers. This
Schick (IAD) implemented the vision-
enables workers to simply mark error locations by pointing at them. To allow for a seamless
based gesture recognition and object
integration into the existing quality assurance system ANABEL, our system was designed as a
tracking. Todor Dimitrov (ILT) inte-
gesture device that acts as an additional input modality (Figure 3). Both the installation of the
grated these modules into the qua-
hardware and the integration into the existing system did not disrupt the current process, but
lity assurance system of the BMW
smoothly blended into the existing environment.
Group. Dr.-Ing. Olaf Sauer supported this project during all phases,
A prototype system was
from acquisition to completion.
installed in the BMW Plant
Landshut for an evaluation
period of two months. The
reactions of the workers
were positive as they saw a
direct improvement of their
work. In addition, they enjoyed the system, as gesture
interaction can be much
more pleasant and enjoyable
than traditional interfaces.
2
Literature
[1]Schick, A.; Sauer, O.:
wt Werkstattstechnik online,
Ausgabe 9-2013, S. 731-732
[2]Schick, A.; Sauer, O.:
QZ Qualität und Zuverlässigkeit,
Ausgabe QZ 11/2013, S. 48-50
Business Unit Automation
31
I n f o r m at i o n M a n a g e m e n t
and Production Control
www.iosb . frau n h o fer.d e / ILT
1
Towards ProVis 4.0: Production monitoring and control in light of Industrie 4.0
The advent of the ”Inter net of Things and Services” in automation technology and industrial production has
shifted the technological discussion towards the use of Inter net technology in all its facets, ranging from
Inter net protocols, data description languages (for example XML in the form of AutomationML) to serviceoriented architectures (SOA, probably in the form of OPC-UA) or lightweight Web services for online interaction with “smart” devices, such as sensors, actuators, or so-called cyber-physical systems (CPS) in general.
T his t re nd – in G e rma n y p ro m o te d b y th e Indus tri e 4.0 i ni ti ati v e – wi l l al s o affec t thos e func ti ons t hat are
com m only c la s s ifi e d a s M a n u fa c tu ri n g E xec uti on Sy s tems (M ES). The F raunhofer I O SB produc tion suit e
P roV is c ont a ins a n M E S co re c o mp o n e n t, whi c h prov i des moni tori ng and c ontrol func ti ons for discret e
m a nuf a c t ur ing p ro ce s s e s . T h i s h a s b e e n s u c c es s ful l y depl oy ed, operated and mai ntai ned for more t han 25
ye a r s a t t he c a r a n d tru c k ma n u fa c tu ri n g pl ants of D ai ml er A G i n Bremen and Wörth. I t al s o monit or s and
controls soaking pit plants of ThyssenKrupp Steel Europe AG in Duisburg. Due to its architecture, based on
an agent-based software platform, it is already well positioned to migrate towards the arising technological
tre nds dom ina te d b y I n te r n e t te ch n o l o g y.
The ProVis production suite
In its current version, the ProVis suite provides the following functions and classifies them
according to their architectural position (see figure):
• ProVis.Kernel: The kernel provides functions to convert several input/output formats and
protocols (Integra, OPC, OPC-UA, MMS, etc.) and to send manufacturing information
about the current and next shift to the relevant manufacturing equipment. It also contains
a dedicated engineering tool.
• ProVis.Agent®: This core component includes functions to monitor all production-relevant
data in real time and to process and aggregate these data, for example to provide status
information about production facilities and to generate shift-specific reports. All of these
functions are driven by a flexible, configurable production time scheme.
• ProVis.Visu®: This is the visualization component for all production-relevant data and all
inferred information. Visualization can be configured either manually with a graphical editor
or using templates and an automatic data import mechanism such as AutomationML.
Contact:
• ProVis.Paula: This component allows users to retrieve aggregated information through a highly-
Dr.-Ing. Thomas Usländer
configurable, modular Web-based analysis and reporting tool. It can be used, for example,
Phone +49 721-6091-480
to efficiently calculate key performance indicators (KPIs) and to get a quick overview of current
[email protected]
and estimated shift-specific piece numbers and related disturbances in the production process.
32 Business Unit Automation
2
3
1 Control room of the press
shop at Daimler AG, Bremen.
Emerging Trends
2 ProVis Development Team
Following current market trends and customer needs additional requirements shall be fulfilled
of IOSB.
by MES:
3 ProVis.APS in a multi-display
• MES shall automatically support vertical integration to shop-floor level based on
environment of IOSB.
engineering principles, such as plug-and-produce.
• MES shall integrate universal engineering tools based on standard data exchange formats,
such as AutomationML.
• MES shall be open and support horizontal integration of components and functions
– possibly provided by multiple software vendors – through standardized interfaces.
• MES shall support various communication interfaces according to international and
enterprise-specific standards.
• MES shall be scalable and enable decentralized self-organization of production systems.
• Information produced by MES shall be provided to users in tailored form through role-specific
interfaces, including mobile devices and innovative gesture-based interaction.
• MES shall be connected to a Digital Factory Repository and shall rely upon its production
plant information.
• MES shall integrate energy monitoring and energy management functions that are, on one
hand, dedicated to the production site itself and on the other linked to the energy manage-
References:
ProVis Production Suite:
http://www.iosb.fraunhofer.de/
servlet/is/18359/
ment systems of energy suppliers inside or outside the enterprise to pave the way towards
Industrial Smart Grids.
• MES shall incorporate facility management services related to the production site building
and infrastructure, for example to optimize the use of energy resources such as electricity,
Industrie 4.0:
http://www.iosb.fraunhofer.de/
servlet/is/24313/
heat or compressed air.
• MES shall support simulation functions to allow its use as a production assistant.
Internet of Things:
• MES shall be enhanced with flexible resource scheduling functions as currently provided
http://www.iosb.fraunhofer.de/
mainly by separate systems, such as ProVis.APS, the Advanced Planning and Scheduling
servlet/is/29600/
Systems for Shop-Floor Production of Fraunhofer IOSB.
However, all of these additional functions will be used and accepted by automation and
production technicians only if industrial core requirements such as security, robustness,
reliability and real-time capability are guaranteed. An in-depth look at these requirements
and trends quickly reveal that a “ProVis 4.0” that takes on board trends and paradigms
of “Industrie 4.0” will comprise an open, scalable, secure, and flexible development and
engineering platform and that this platform shall provide MES core functions as standard
services. Furthermore, it shall support and leverage multi-vendor production systems-ofsystems. Fraunhofer IOSB will perform this development work as an active partner in various
standardization bodies (IEC, VDI, DIN).
Literature
[1]Frey, C.; Heizmann, M.;
Jasperneite, J.; Niggemann, O.;
Sauer, O.; Schleipen, M.; Usländer, T.;
Voit, M. (Fraunhofer IOSB): IKT in
der Fabrik der Zukunft - Beitrag
der Industriellen Informations- und
Kommunikationstechnik zu Industrie
4.0. atp edition 56(4), 2014
Business Unit Automation
33
F r a u n h o f e r App l i c a t i o n C e n t e r
I n d u s t r i a l A u t o m at i o n
www.iosb . frau n h o fer.d e / INA
1
Highly available communication
Seamless Redundancy solutions for networked
technical systems
I n t he c our se o f th e fo u rth i n d u s tri a l re v ol uti on, produc ti on proc es s es are i nc reas i ngl y automat ed. This
m e a ns t ha t m a ch i n e mo d u l e s a n d e v e n i ndi v i dual dev i c es are c onnec ted wi th eac h other and exchange
d a t a c onst a nt ly . T h e a i m i s to d e v e l o p i ntel l i gent fac tori es , i n whi c h i nformati on about the cur rent
p roc e ss, m a int e n a n c e i n te rva l s fo r i n d i v i d u al dev i c es , and produc t s tatus i s av ai l abl e at any gi v en t im e in
a ddit ion t o t he u s u a l p ro ce s s co n tro l . I n s h ort: The fac tory i s to be c ompl etel y trans parent.
Contact:
2
Fraunhofer Application Center
Industrial Automation INA
Dr.-Ing. Holger Flatt
Due to the ever-increasing volume of data and network connectivity in technical systems the
Phone +49 5261 94290-31
role of communication technology – which is responsible for smooth data transmission – has
[email protected]
grown. The main requirements for data transmission in automation technology networks
34 Business Unit Automation
3
consist of fast, reliable and time-synchronous communication. It is also important that no
1 The RedBox – a prototype by
data is lost. Reliable cabling and topologies are essential. The most common solution is the
Yacoub Automation and IOSB-INA.
ring topology, in which data is transmitted through two separate, independent lines, so that
2 The RedBox can connect HSR-
a transmission is guaranteed even if one line is damaged. In this type of ring topology, two
and PRP-networks with each
data packets normally arrive at the recipient. These packets must undergo a redundancy
other.
check, which deletes duplicates. Redundancy mechanisms must be provided by the network
3 Dual-board solution used as
at all levels of the factory – from the field level to the control center – to ensure the required
RedBox hardware platform.
uninterrupted process operation.
To provide a redundancy platform for highly available communication in Ethernet networks,
Partners
which use various different topologies, two redundancy protocols have been defined in
Yacoub Automation GmbH
standard IEC 62439-3: PRP (PRP: Parallel Redundancy Protocol), and HSR (High Availability
Seamless Redundancy). Several vendors have already brought solutions to market that
are based on PRP or HSR. Research projects are now facing the challenge of developing a
solution that can be used for both protocols. In a BMWi-funded project with Berlin-based
company Yacoub Automation GmbH, IOSB INA has tackled this challenge. The aim was to
create a redundancy solution that can be switched between standard Ethernet devices to
integrate them into PRP/HSR networks. According to the requirements, IOSB INA has developed a RedBox (redundancy box) that can be integrated in an HSR network as well as a PRP
network, or can connect networks of both types with each other. With this solution users can
use the RedBox flexibly according to their requirements. These protocols were implemented
on an FPGA platform. The time-critical parts of the implementation have been realized completely in hardware. To avoid the usual costs for the implementation of a network component
with the described functionality, a low-cost FPGA variant (Altera Cyclone IV) was combined
with a high-performance switch ASIC (Marvell FireFox). These two components are linked
through an MII interface and provide four ports for connecting end nodes. In measurements
on sample configurations (PROFINET controllers and devices, Meinberg master clock, etc.)
interoperability with other manufacturers’ RedBoxes and support for time synchronization
standard IEEE 1588 could be identified.
To further develop the solution and gain a market advantage, IOSB INA and Yacoub Automation GmbH have decided to initiate a follow-up project, the aim of which is to make the
RedBox useable in hazardous areas. This adds several new requirements for the hardware: A
RedBox for hazardous areas must be optimized to ensure a very high level of safety, which
should be maintained even in the rare event of a malfuction. It must not ignite even if several
technical faults occur in the device at the same time. Furthermore, its energy usage must be
optimized to meet the stringent requirements for approval for use in hazardous areas. By
complying with current safety standards for explosion-protected areas, the solution of IOSB
INA can be used in many other industries and application scenarios.
Literature
[1] Flatt, H.; Jasperneite, J.;
Rauchfuß, J.: Ein FPGA-Ansatz zur
Anwendung von PRP/HSR-Redundanzprotokollen mit IEEE 1588 Zeitsynchronisation in der Automatisierungstechnik. In: Jahreskolloquium
Kommunikation in der Automation
- KommA, Magdeburg, Germany,
Nov 2013
[2] Flatt, H.; Jasperneite, J.;
Dennstedt, D.; Hung, T. D.: Mapping of PRP / HSR Redundancy
Protocols onto a Configurable
FPGA/CPU Based Architecture. In:
IEEE International Conference on
Embedded Computer Systems:
Architectures, Modeling and Simulation (SAMOS XIII), S. 121-128,
Samos, Greece, Jul 2013
[3] Rauchfuß, J.; Flatt, H.: Hochverfügbare Kommunikation in Automatisierungsnetzen - Realisierung
einer stoßfreien Redundanz,
SPS-Magazin, Sonderausgabe zur
Hannover Messe, TeDo-Verlag
GmbH, 2013, S. 104-105
Business Unit Automation
35
B u s i n e ss U n i t
Energy, Water and
Environment
Spokesperson
modeling, and systems analysis to knowledge-based process
Prof. Dr.-Ing. habil.
optimization with a wide range of methods and sophisticated
Thomas Rauschenbach
algorithms. An example for this is the energy market solution
Phone +49 3677 461-124
EMS-EDM PROPHET® that supports utility companies and system operators with varied and complex tasks in a liberalized
market environment. In the fields of water management as
well as environmental information and early-warning systems
our business unit offers customized ICT applications for the
private and public sectors. The objective is to provide integrated
solutions that are flexible and can also adapt to individual
constraints, such as those of service oriented architectures
(SOA) and standard interfaces of the “Internet of Things
and Services”. Beside the close collaboration with industry,
the business unit sees itself as a technology driver for future
Deputy Spokesperson
topics of intelligent energy systems and Integrated Water
Dr.-Ing. Thomas Usländer
Resources Management (IWRM) in numerous national and
Phone +49 721 6091-480
international research projects.
Markets
The target groups of the business unit Energy, Water and
Environment range from utility companies through communal
water suppliers to governmental institutions, with a current
focus on the German and European market. This business unit
draws on international research projects and projects with
industrial partners in Portugal, China, Mongolia and Turkey,
as well as on European research projects in the fields of
Mission and vision
environmental risk management, early warning systems and
environmental monitoring. In the medium term the impor-
The nexus of sustainable and affordable energy, secure access
tance of international markets for this business unit will grow.
to clean drinking water and effective environmental protection
Impulses are expected not only from Asia and the Middle East,
must be better understood and managed through the provision
but also from the USA, where a contract for the optimization
of tools, models and methodologies to exchange and process
of the hydropower plants at the Columbia River was acquired
data. This is fundamental for the development of solutions
from Bonneville Power Administration (BPA) in 2012.
meeting the needs of future markets. Fraunhofer IOSB offers
integrated ICT systems, consulting services, and development
The market of innovative environmental information systems
of prototypes to industrial clients and public authorities that
is served by the product suite WaterFrame®, which is installed
approach the problem from a holistic point of view. They
in many German federal states (Länder) for communal and
cover the whole spectrum from sensor systems, systems
governmental use. WaterFrame® is being extended according
36
to customer needs to support standards of the Open Geospatial Consortium (OGC) compliant with the requirements
• Thematic information system for the Integrated Rhine
Program
of European spatial data infrastructures (INSPIRE). It is complemented by WebGenesis® for knowledge- and Web-based
References
information systems.
• ABB AG
• AHK GmbH, Freiburg
The business unit’s portfolio is complemented by its know-how
• Beijing Water Authority
in the field of maritime system technology, which is special-
• Bonneville Power Administration (BPA)
ized in the guidance of underwater vehicles for automated
• BTC AG
inspection of underwater infrastructures and for water quality
• Disy Informationssysteme GmbH, Karlsruhe
monitoring.
• DONG Energy Germany
• Ministries of the Environment and Federal State Agencies
Laboratory and test facilities
of Baden-Wuerttemberg (LUBW) / Rhineland-Palatinate /
Thuringia (TLUG) / Bavaria (LfU)
ICT Energy Lab: energy and energy data management,
• natGAS AG
virtual power plants, operational management of island and
• Nanjing Hydraulic research Institute
area networks
• Spacebel, Belgium
Intelligent energy systems research platform: micro grids,
• Stadtwerke Bielefeld GmbH
operational management strategies, storage management,
• Stadtwerke Marburg GmbH
automated metering, intelligent distribution networks,
• SWE Energy GmbH & SWE grid GmbH
electric mobility
• TenneT TSO GmbH
Maritime systems research platform: 250 m³ water volume,
• The German Federal Institute of Hydrology (BfG)
lorry access capability, energy and data interface, rail system
for object placement
Environment sensor network INSENSUM: air, ground
and water monitoring, open interfaces as well as mobile
applications according to the Sensor Web Enablement (SWE)
initiative of the Open Geospatial Consortium (OGC)
Product highlights
• EMS-EDM PROPHET® – energy and energy data
management
• HydroDyn – network simulation solution for water and gas
• WaterDemand – water supply forecasting
• WebGenesis® / WaterFrame® – environmental information
system for government agencies (environmental portal,
specialized information offers, information systems for
ground water, surface water and drinking water)
37
Energy
www.iosb . frau n h o fer.d e / ? 1 4 5 9 3
1
INTELLIGENT DISTRIBUTION GRID & ENERGY
STORAGE: SmartRegion Pellworm
T he polic y obje c ti ve s o f th e e n e rg y tra n si ti on i n Germany are v ery ambi ti ous : thus , 80 perc ent of t he
e le c t r ic it y powe r n e e d s b y 2 0 5 0 s h o u l d c ome from renewabl e energy s ourc es . The North Sea island
P e llw or m a lre a d y re a ch e d th i s v a l u e a n d i s therefore a s ui tabl e pl ac e as a pi l ot regi on for a power syst em
wit h e ne r gy st o ra g e s a n d a n e xtre me l y h i gh proporti on of di s tri buted power generati on from biom ass,
p hot ov olt a ic s a n d wi n d . A l l th e s e co mp onents need a s ophi s ti c ated c ontrol and management syst em
conne c t ing distri b u te d g e n e ra ti o n , e n e rg y s torages and a fl ex i bl e demand. I n addi ti on, c ros s -di sciplinar y
topic s suc h a s h e a t g e n e ra ti o n ca n co n ti n u e to pl ay an i mportant rol e.
Sponsored by:
Goals
The project “SmartRegion Pellworm”, sponsored by the BMU and BMWi, is one of the projects
of the lighthouse “battery storage in distribution grids” of the funding initiative “energy
storage” of the federal government and includes as a central element the building up and
operation of such a smart grid. Hybrid storage is used to map the different fields of application
of storage systems. In addition to two stationary storage facilities with different technologies
(li-ion battery and redox-flow battery) there are also unidirectional storage systems, e.g. electric
storage stoves, heat pumps, and the biogas plant on the island.
Within the framework of this project comprehensive analysis of present and future business
models of hybrid storage systems are performed for market, grid and local supply.
The experience gained during realization and operation should feed into the analysis of
transferability of the Pellworm approach to other distribution grids and the investigation of
business models.
Realization
Contact:
The task of Fraunhofer IOSB Advanced System Technology (AST) includes the question of the
Advanced System Technology (AST)
optimal operational management of hybrid storage systems for various use cases. Therefore
Branch of Fraunhofer IOSB
an extensive analysis of measurement data of the energy system is being conducted, and all
Dipl.-Ing. Steffen Nicolai
relevant electric and thermic components are being modelled and integrated in optimization
Phone +49 3677 461-112
models of the particular operational management strategies.
[email protected]
3 8 Business Unit Energy, Water and Environment
2
3
1 Redox-Flow-Battery (container
left), power electronics (container center) and lithium-ion
battery (container right).
2 Hybrid power plant.
3 Solar park.
4 Integrated energy management system in real market
framework.
Partners
consortium manager
4
Gustav Klein GmbH
Based on examined business models all objective functions of the relative operational manage-
Fraunhofer UMSICHT
ment will be created. Thereby, both financial and technical restrictions of the energy system
Fachhochschule Westküste
must be regarded, including data from customers and feed-in, current grid condition and also
RWTH Aachen IFHT
exogenous influences, such as meteorological data and different special conditions, such as
Saft Batterien GmbH
feed-in management. A special challenge is the combination of different, partly opposing
Schleswig-Holstein Netz AG
objective functions for operational management. Mapping of various chronological levels of
operational management is possible because of a multi-stage optimization approach.
Project execution
Dipl.-Ing. Steffen Nicolai
The core of the operational management solution is the energy management system EMS-
Dipl.-Ing. (FH) Sebastian Flemming
EDM PROPHET ®. Here the implementation of the operational management strategies in the
form of optimization models takes place. During the startup phase the basic functions of the
operational management solution are tested. These functions build the basis for the complex
Literature
operational management strategies in the demonstration phase.
[1] Nicolai, S.; Koopmann, S.;
Wasowicz, B.; Bretschneider, P.:
“Hierarchical Management of a
hybrid storage system - Project
SmartRegion Pellworm” – IRES
2013, Berlin, November 2013
Evaluation
Evaluation of various relevant parameters of the energy system, with and without being actively
influenced by the different operational management strategies, provides an essential statement
of functionality of the operational management strategy. Through different scenarios the
operational management was evaluated using quality factors. The presentation of all proportionate influences of the requirements of the business models and the specifications of the
grid management attracts special attention during the analysis. Another main focus of the
analysis will be the detailed view on the behavior of the complete system in special situations.
[2] Koopmann, S.; Pollok, T.;
Wasowicz, B.; Nicolai, S.;
Schnettler, A.: “Evaluation of business cases for a hybrid storage system in the SmartRegion Pellworm”
– Kraftwerk Batterie RWTH Aachen,
Februar 2013
Business Unit Energy, Water and Environment
39
W a t e r a n d M o b i l e S y s t e ms
www.iosb . frau n h o fer.d e / ? 1 4 9 9 4
www.ha p p i s h p . c o m
1
Small Hydropower Plants: Assessment of
Climate Protection Potential and Improvement through Smart Technologies
C hina a im s t o re d u ce th e u s e o f fi re wo o d and other fuel s by drawi ng el ec tri c al power from s ma ll hydrop o w e r plants (SHP) to create a climate-friendly energy infrastructure. By 2014 over a thousand small hydropower plants will be installed in 24 provinces as to substitute fuel-powered plants (Small Hydropower Substituting Fuel – SHSF). Although this sounds a lot it is worth noting that, for example Bavaria alone has more
than 3600 SHPs (smaller than 100 kW). In Austria there are more than 2800 SHPs, providing about nine
percent of Austria’s electricity demand and supplying about 1.7 million households (more than 50 percent
of Austrian households) with electricity. At over 90 percent the availability of these SHPs is fairly good.
There is still a considerable potential for SHP development in the EU: Less than half of the potential – about
44 TWh/a – ha been tapped to date leaving more than 50 TWh/a that can be brought online in the future (1).
The reduced use of fossil fuels resulting from the use of hydropower is offset by the latter’s impact on water
ecology, channel flow, socio-economics, and aquatic ecosystems. These issues are given a low priority in
China. Often these multi-objective problems influence each other.
Sponsored by:
Research objectives
The German-Chinese research project HAPPI (Small Hydropower Plants: Assessment of Climate
Protection Potential and Improvement by Smart Technologies) aims to develop an evaluation
method for planning, construction, and operation of small hydropower plants, focusing on
at least three main aspects: first, ecological effects, such as the protection of climate, nature
Chinese project partner:
and water, i.e. impacts on flora and fauna, landscape and watercourses, and land use; second,
economical effects, such as cost-efficiency, network infrastructure and proximity to costumers,
realization periods, and location and constructional optimization; and – last but not least –
social effects, such as improved infrastructure, employment, influence on the development
potential of rural settlement, poverty reduction and resettlement.
Contact:
Advanced System Technology (AST)
Work packages
Branch of Fraunhofer IOSB
Together with six partners, three of which are small and medium-sized enterprises (SMEs),
Prof. Dr. Thomas Rauschenbach
Fraunhofer IOSB defined 15 working packages to achieve the following research objectives:
Phone +49 3677 461-124
environmental sustainability analysis (1), climatic sustainability analysis (2), socio-economical
thomas.rauschenbach@
iosb-ast.fraunhofer.de
(1)Source: http://dev02.semaforce.eu/fileadmin/esha_files/documents/publications/2013/SHPRoadmap_FINAL_Public.pdf
4 0 Business Unit Energy, Water and Environment
2
3
sustainability analysis (3), hydrological modeling and CO2 balancing (4), hydraulic system and
1 Oldest small hydro power
location optimization (5), geotechnology and structural hydraulic engineering (6), control and
plant in China with German
management strategies (7), energy management strategies (8), financing strategies and
technology from the 1920s.
operator models (9), monitoring system (10), integrated planning guide (11), automatic cascade
2 HAPPI model regions in China
operation (12), ex post evaluation of the sustainability aspects (13), feasibility evaluation (14),
(red and blue dots).
and participation processes and capacity building (15).
3 Work packages.
Perspectives
In addition to tapping the ecological benefits and optimize the use of the unexploited energy
Partners
potential of hydropower – especially in China – HAPPI aims to achieve economic benefits through
Advanced System Technology
know-how-transfer, patents and the export of engineering services and facility delivery. Goals
(AST) Branch of Fraunhofer IOSB,
of the project are the development and application of new policies for small hydro power plants
Fraunhofer Institute for Systems
with a focus on socio-economic and ecological sustainability and taking into account climate
and Innovation Research ISI,
change and land use. Further aims include the development of advanced planning guidelines for
University of Kassel,
hydroelectric power plants (selected optimal power plant sites, civil engineering and hydraulic
G.U.B. Ingenieur AG
optimization, support with obtaining regulatory approval), a new application of control and
Umwelt- und Ingenieurtechnik
energy management strategies for small hydro power plants (individually and in coordination)
Dresden GmbH,
and the integration of small hydropower plants in regional and national power distribution grids.
Ingenieurgesellschaft
Processing the results will therefore focus on the following goals:
Prof. Dr. Sieker mbH,
• Employment of models for location evaluation and design of energy-optimized hydropower
G.M.F. mbH - Gesellschaft für
plants from a hydrologic, hydraulic, ecological and economic perspective
Meß- und Filtertechnik mbH
• Coordinated control of SHP and integration into the power grid
• Application of dimensioning processes for an optimized structural design of hydroelectric
installations in largely modular architecture
Project execution
Prof. Dr. Thomas Rauschenbach
• Implementation of ecological design concepts at for dams, hydraulic conduits and the
application of fish-friendly power plant technology on inland waterways
Dr.-Ing. Divas Karimanzira
Dr.-Ing. Peter Bretschneider
• Training in the use of the developed quality management tools and assurance of health
protection and occupational safety at the construction site
• Consulting services for developing marketable company structures for the operation and
cost-effectiveness of utility companies
• Development and application of financing and operator models tailored to the legal and
social circumstances in China.
Project description
Name: Small Hydropower Plants: Assessment of Climate Protection Potential and Improvement
by Smart Technologies; Work packages: project management (consortium manager), controlling and management strategies, energy management strategies, automatic cascade operation
Life span: 01.02.2013 – 31.01.2016; Tags: Small Hydropower Plants, China, automatic
cascade operation, energy management strategies, multiple criteria optimization
Literature
[1]Karimanzira, D.; Rauschenbach, T.;
Mu, H.: Management of cascaded
reservoirs in the beijiang river basin:
A pilot project. In Integrated Water
Resources Management (IWRM)
2012, Karlsruhe, Germany, 2012
[2] Mu, H.; Rauschenbach, T.;
Karimanzira, D.: Modeling and
control of bi-directional water flow
with application to the Taihu Lake
basin. Global Perspective on Engineering Management, 2013
Business Unit Energy, Water and Environment
41
I n f o r m at i o n M a n a g e m e n t
and Production Control
1 Examples for the forward and
www.iosb . frau n h o fer.d e / ILT
backward simulation of the propagation of tsunami waves.
Top: simulation results for a hypothetical event in the eastern Mediterranean
Bottom: retrospective simulation of
the real Tohoku tsunami event on
11th March 2011.
Both events are displayed on the
globe and on a map. ©2011: GFZ.
TRIDEC – Early Warning
Systems Architecture
Ts una m is w re a k h a vo c a n d ca u s e e n o rm o u s ec onomi c damage wi th a hi gh l os s of l i v es i n c oas tal regions.
To be e ff e c t iv e a ts u n a mi e a rl y wa r n i n g s ys tem mus t be abl e to ac qui re and reac t to s ens or s i gna ls w it hin
fe w m inut e s. E x i s ti n g wa r n i n g s y s te m s re qui re ex tens i v e s oftware engi neeri ng to i nc orporate new sensor s
a nd da t a source s a s we l l a s mo d e l s to c o mpute the l i kel y propagati on of the ts unami .
What issues are to be solved
The integrated EU FP7 project TRIDEC focused on new approaches and technologies for intelligent geo-information management in collaborative, complex and critical decision processes
in earth management. The key objective was to develop a software architecture for a tsunami
early warning system to equip existing and future Tsunami Warning Centers around the
Mediterranean Sea. The TRIDEC architecture had to facilitate the integration of new sensors
and models, and to support real-time processing of data streams. The typical data sources
not only include sensors on land and sea, but also unconventional sensors, such as streams
of tweets with eyewitness accounts. The early warning systems have to integrate data sources
from multiple nations of the Mediterranean region and be customizable for decision-makers
with local or specific emergency plans and defined warning dissemination processes. At the
same time scientists need to be able to improve the underlying rules, models and computations without relying on extensive help from IT experts.
Description of the solution
All components of the TRIDEC architecture were conceived, designed and implemented to be
suited to integrate a multitude of heterogeneous services and software tools, data and information sources. From the domain experts’ point of view this means that they can leverage all
relevant information in order to provide adequate and timely support to decision-makers.
Description of methods and processes
The main objective of TRIDEC presented a number of challenges, such as the task of examining,
adopting and adapting a large number of state-of-the-art systems and components as well as
Contact:
contributing to a diversity of emerging innovative ICT technologies. Some challenges concerned
Dipl.-Inform. Fernando Chaves
the integration of existing warning systems (system-of-systems architecture) and the design
Phone +49 721-6091-509
of a scalable and resilient communication infrastructure based on a message-oriented middle-
fernando.chaves-salamanca@
ware (MOM). Another set of challenges was concerned with the management of large and
iosb.fraunhofer.de
dynamically increasing volumes of data and information as well as data fusion processes and
4 2 Business Unit Energy, Water and Environment
2 Innova Rig, an innovative
drilling plant for scientific
research, serving as a testbed for
the TRIDEC Use case “Drilling”.
3 Early detection of critical events and the impact of the commence-
©2011: GFZ.
ment time of counter actions on the crisis development. ©2011: TDE.
the management of metadata on different semantic levels. Further effort went into the design
Project execution
and implementation of Decision Support Services, including an ontology based on the SSN
Dipl.-Inform. Ulrich Bügel
Ontology of OGC and W3C, federated Semantic Registries for registering (over MOM) meta-
Dr.-Ing. Siegbert Kunz
data about crisis-relevant objects, a workflow and rule engine, a rule editor for Decision Tables,
Dipl.-Inform. Jürgen Moßgraber
and a number of standards-based interfaces for connecting all these different components.
Dipl.-Inform. Felix Riedel
Dipl.-Inform. Manfred Schenk
Further IOSB projects on Early Warning Systems
Dr. Kym Watson
EO2HEAVEN (Earth Observation and ENVironmental modeling for the mitigation of HEAlth risks)
Dr. Andrea Zielinski
was co-funded by the European Commission under FP7, Grant Agreement 244100. IOSB led
the work on the architecture of a Spatial Information Infrastructure, which formed the basis for
warning systems in the area of environmental impact on health. Case studies investigated the
effects of air pollution in Saxony and Durban and the risk of cholera outbreaks in Uganda. See
www.eo2heaven.org.
Literature
INCA (Integrated Nowcasting through Comprehensive Analysis) was co-funded by the European Commission with the InterReg IVb Programm. IOSB developed an early landslide detection
and warning system (ELDEWAS) that incorporates dynamic nowcasting data and merges them
with static geological data for certain regions (for Burgenland in Austria for instance) in order
to gain short-term predictions for the danger of landslide events. See
[2]Moßgraber, J. et al: The Seven
Main Challenges of an Early Warning System Architecture; ISCRAM
2013, Baden-Baden
www.iosb.fraunhofer.de/?40945
Figures and technical data
TRIDEC (Collaborative, Complex and Critical Decision-Support in Evolving Crises)
Coordinator: Geoforschungszentrum Potsdam
Duration: 9/2010-10/2013
Budget: ≈ 8.9 million €
Principal/partner
TRIDEC was co-funded by the European Commission under FP7 (Seventh Framework
Programme), Grant Agreement 258723
[1] Wächter, J. et.al: TRIDEC Systemof-Systems, Choreography of largescale concurrent tasks in Natural
Crisis Management; ISADS 2013,
Mexico City
[3]Chaves, F. et al: Semantic Registries for Heterogeneous Sensor Networks – Bridging the semantic gap
for collaborative crisis management;
WebS 2013, Prague, Czech Republic
[4]Riedel, F. et al: Workflows and
Decision Tables for Flexible Early
Warning Systems; ISCRAM 2012,
Vancouver, Canada
[5]Zielinski, A. et al: Social Media
Text Mining and Network Analysis
for Decision Support in Natural
Crisis Management; ISCRAM 2013,
Baden-Baden
Business Unit Energy, Water and Environment
43
B u s i n e ss U n i t
Automated Visual
Inspection
Spokesperson
Prof. Dr.-Ing. Thomas Längle
Phone +49 721 6091-212
assurance and / or increasing productivity in real time that
come into play when “seeing” is the solution of choice.
“Seeing” in this context refers not only to what the human
eye is capable of, but also includes the entire electromagnetic
spectrum from UV to IR as encountered in the natural and
technical world. The technical solutions offered cover a broad
service portfolio, ranging from feasibility studies to process
developments, practical validation up to and including demonBusiness Unit Development
strators and productive systems that can be used at the
Dipl.-Ing., Dipl.-Wirt. Ing.
customer’s site.
Henning Schulte
Phone +49 721 6091-275
Markets
“Seeing” relevant information forms the basis for our solutions. In a technical respect, this generally comprises image
acquisition using line scan or area array cameras and image
analysis in real time. Whether the task is to rapidly monitor
a large number of moving parts while sorting bulk goods
(in order to separate desirable parts from undesirable ones),
detect changes in the reflective properties or the texture of
a surface (which are indicative of product defects or process
Mission and vision
defects) or classify objects or object groups (to detect divergences from specifications), we are able to offer tailored
Replacing the five human senses with a wide range of technical
solutions to our partners and customers.
sensors is something we do on a daily basis. This is especially
true when it comes to acquiring more accurate information or
Whenever the task is to “sort” large quantities of parts
doing so faster than humanly possible; or if we want to use
(e.g. bulk goods) in the material flow and in real time or
a technical device to replace or assist a person performing a
verifying the compliance of complex individual parts with
given task.
specifications – whether in terms of color, shape or other
“visible” properties – our solutions are put into practice. The
In the Inspection and Visual Inspection business unit, Fraunhofer
solutions we develop are used in recycling glass or enriching
IOSB gathers all activities in the field of sensor technology,
minerals to the same extent that they are used in sorting tea,
image analysis and signal processing for the purpose of quality
coffee and other foods.
44
In the field of surface inspection, we not only detect changes
References / product highlights
in the structure, but also convert sensor data using photometric stereo or deflectometry into 3D data in order to reach
conclusions relating to part topography. These methods are
used to evaluate both glossy and mat surfaces. Sometimes
“taking a look inside parts” or simply “seeing through them”
• Binder+Co AG: Systems for sorting recycling glass;
recognizes heat-resistant glass containing lead
• SALUS Haus GmbH & Co. KG: Systems for sorting tea and
herbs; color, size and debris sorting
is helpful when it comes to recognizing constituents or diver-
• PETKUS Technologie GmbH: Sorting of seed
gences. If light can be used to make them visible or the mate-
• Uhlmann GmbH: Blister inspection
rials being searched for have specific reflective properties, we
• GREIWING logistics for you GmbH: Sorting system for
find them. We also offer solutions for special problems such
as “seeing” vibrations from far away, “seeing” in an adverse
environment (e.g. in deep-sea environments) or recognizing
objects for identification purposes.
plastic granulates
• Zwiesel Kristallglas AG: Inspection of glass lenses for
occlusions and air bubbles
• Eti Maden General Directorate: System for sorting materials
(colemanite)
Equipment, lab and test facilities
• De Beers UK Limited: Systems for finding diamonds
• Sliding tables with a variety of lighting facilities for image
acquisition
• Experimental systems for sorting bulk goods (each equipped
with a camera and blow-out unit) in various configurations
as a belt sorter, channel sorter, sorter with chute and freefall sorting
• Measurement stations for inspecting surfaces,
e.g. photometric stereo or deflectometry
• Measuring devices for 3D inspection
• Test systems for transparent materials
• Multispectral workbench
• Lab equipment for characterizing materials
• Microscopic image acquisition stations
• Test lab with lighting technology
• Fully-automatic BRDF measuring station
• Experimental systems for underwater inspection
45
S y s t e ms f o r M e a s u r e m e n t ,
Control and Diagnosis
www.iosb . frau n h o fer.d e / M R D
1
MicroLab
M ic rosc opic ins p e cti o n s ys te m s a re g e tti ng more and more i mportant i n as s uri ng qual i ty of i nd ust r ially
p roduc e d good s . W i th i ts n e wl y b u i l t u p mi c ros c opy l aboratory (M i c roL ab) F raunhofer I O SB i s t aking a
n e w a pproa c h. Va ri o u s m i c ro s co p e s a re c ombi ned wi th s tandard automati on c omponents , s uc h as robot s,
p osit ioning st a g e s a n d i l l u m i n a ti o n c o mp onents , to real i z e automati c i ndus tri al i ns pec ti on. M i croLab is
e quippe d w it h ve rs a ti l e o p ti ca l mi cro s co p es whi c h prov i de a wi de range of s ens ors for c ombi ne d usage.
C ur re nt ly Mic ro L a b c o n ta i n s a m a c ro s co pi c dev i c e wi th different i l l umi nati on c omponents , a research
m ic rosc ope w it h U V i l l u mi n a ti o n , a wh i t e-l i ght i nterferometer and a 3D rec ons truc ti ng autofocussing
s y st e m , w hic h a l s o ca n b e u s e d fo r ro u g h nes s meas urements .
Automation
The key role in automation in MicroLab is played by a six-axis industrial robot. The robot, which
is connected to a central control unit that interacts with additional sensors, places various
specimen onto the microscopic devices in an exactly defined position. The inspection system
therefore exactly knows about the overall condition of a currently running inspection process.
It can intelligently influence this running process to optimize throughput, for example using
all inspection devices in parallel. It can also prioritize specific specimen, giving it a decisive
advantage over industrial assembly lines, which can handle goods only sequentially.
General applications
MicroLab deliberately uses standard industrial automation components. These can be
combined at will to realize customer-driven inspection systems for visual inspection and quality
assurance analysis. The different sensor components with their diverse properties can be used
to examine the properties of a large number of different specimens, such as completeness of
electronic components or roughness of iron, steel or other industrially produced materials. The
combination of multiple microscopes brings inspection tasks to a new level, allowing specimens
to be inspected by multiple sensors with a range of characteristics within one automation
process. The gathered information can then be used as input for multi-sensor fusion. To provide
a clearer idea of microscopic dimensions, figure 2 illustrates these using a real-life example.
Inspection of a technical sample can be seen in figure 3.
The microscopic devices are further used to acquire ground truth information. This is extremely
Contact:
important when constructing new sensor components in order to back up the measurement
M.Sc. Peter Frühberger
results. Another reason our customers like the MicroLab concept is its modular construction. It
Phone +49 721 6091-314
is quite easy to integrate components of MicroLab into existing quality assurance systems. The
[email protected]
long-term knowledge of IOSB in the field of image processing is of high value in the context of
4 6 Business Unit Automated Visual Inspection
2
3
MicroLab. Established methods of image processing, ranging from image fusion to photometric
1 MicroLab in action.
stereo, are transferred to the microscopic dimensions. The integration of such established
2 3D surface profile of a
methods is the basis of providing modular microscopic inspection systems for industrial
2 Euro coin.
purposes.
3 Measurement of a
metallic surface.
MicroLab in research and education
4 Graphical user interface (GUI)
MicroLab, with its multiple sensors, delivers great possibilities for research and education. Over
for visual interaction.
the past year several research projects were conducted with the help of MicroLab equipment.
5 Installation: Microscope next
One highlight was the implementation of a novel approach for instrumenting a microscope
to eye tracker and running
with gaze-based interaction.
software.
Finding important regions and focal planes within a microscopic process can be seen as a
6 Image Fusion Process – an
visual search task. Our research combined advanced image processing algorithms – highly
image series and a depth map
encapsulated and easy to use – with a state-of-the-art human-machine interface to realize the
are used as input for generating
operators’ tasks, such as focusing, image analysis, and synthetic image enhancement driven
a synthetic image that is in focus
by gaze-based interaction. Figures 4 and 5 show the installation together with the developed
everywhere.
graphical user interface.
As the depth of field becomes quite small at higher levels of magnification it is important to
compute a synthetically enhanced image that has all visually selected focal planes in focus at
Project execution
once. To achieve this, the software creates a depth map in the background which, together
M. Sc. Peter Frühberger,
with the recorded image series, provides the input for the image fusion algorithm. Figure 6
Dr.-Ing. Stefan Werling,
gives an overview of the overall fusion
Dr.-Ing. Michael Heizmann
Outlook and future
Although conceived only recently, MicroLab has already established itself as a contact point for
a wide range of applications. Within the last year it was used to measure a variety of technical
surfaces, such as CMOS sensors. It was also used to gain detailed reflectance information to
better understand properties of industrial materials and to reconstruct bidirectional reflectance
distribution functions (BRDF). Furthermore, the automation component has been integrated
into the overall system, and methods of interaction with microscope devices have been developed and implemented. MicroLab will be presented at CeBIT 2014.
4
5
Business Unit Automated Visual Inspection
6
47
V i s u a l I n sp e c t i o n S y s t e ms
www.iosb . frau n h o fer.d e / S P R
GrapeSort – Optical sorting of grapes
to improve quality and the removal of
foreign objects
D r ink ing a nd e n j o y i n g a g l a s s o f wi n e i s u s ual l y taken for granted. F or a wi nemaker, i t i s by no m eans a
m a t t e r of c our s e to p ro d u c e q u a l i ty wi n e, c ons i deri ng c l i mate c hange and the v ari abi l i ty of w eat her.
R e c e nt ly , diff e re n c e s i n g ra p e ri p e n e s s o f up to 40 degree O ec hs l e (°O e) hav e been rec orded on a single
g r a pe v ine . T hi s p re s e n ts a c h a l l e n g e : G ra pe harv es ti ng i s bec omi ng i nc reas i ngl y automated, and a lt hough
i m prov e d c ont i n u o u s l y , th e m a c h i n e s u s e d c annot as s es s grape qual i ty i n the way that a human har vest er
ca n. S e le c t ion o f ma ch i n e -h a rve s te d g ra pes by thei r degree of ri penes s has therefore bec ome a n issue,
toge t he r w it h th e s e p a ra ti o n o f fo re i g n o bj ec ts , whi c h hav e a negati v e i nfl uenc e on the wi ne’s f lavor.
Task
Grape sorting machines from a handful of companies have already been on the market for a
few years. These are able to remove foreign objects, such as leaves, stems, and bugs. Some are
also able to detect botrytis – a mold that affects both white and red grapes. These machines
have not established themselves in the wine community because their sorting quality, software
and hardware operation, and cleaning procedures do not meet wine makers’ requirements.
Due to these drawbacks we applied for a ZIM (The Central Innovation Program – Zentrales
Innovationsprogramm Mittelstand) research project of the BMWI (Federal Ministry of Economics
and Technology – Bundesministerium für Wirtschaft und Technologie).
IOSB’s tasks in the research project are:
--Analyzing grapes using hyperspectral imaging in the wave band of 400 to 2500 nm
--Implementing results of the analysis in the sorting machine
--Sorting grapes by different ripeness parameters, such as degree Oechsle, acidity,
and nitrogen content
--Removal of foreign objects, such as bugs, stems, wire fragments, leaves, and wood
--User-friendly graphical user interface
IOSB’s project partners focus on:
--Definition of sorting criteria and preparation of grapes for sorting tests
--Laboratory analysis of the grapes
Contact:
--Wine-making from the sorted grapes, and wine tasting
Dr. rer. nat. Kai-Uwe Vieth
--Improvement of air-based sorting unit, and reduction of air consumption
Phone +49 721 6091-279
--Improvement of material transport
[email protected]
--Hygienic design
4 8 Business Unit Automated Visual Inspection
1
2
1 Valve block equipped with
112 nozzles to separate different qualities.
2 Experimental sorter equipped with a camera box, a light-
Description of project status quo
ing unit, a conveyor belt and
Grapes of types Pinot Noir, Pinot Blanc, and Riesling have been used during the harvest season
a valve block.
of 2012 to acquire short-wave infrared (SWIR) hyperspectral image data and red-green-blue
(RGB) images. Hyperspectral image data yield a full spectrum within the SWIR band for each
pixel, i.e. from 1000 to 2500 nm. Following preprocessing the data was analyzed using multi-
Partners
variate data analysis. The aim was to correlate the hyperspectral data with the laboratory data
The application for the ZIM
provided by the project’s wine experts, Hochschule Geisenheim. Based on the analysis, charac-
research project was submitted
teristics were selected for use in classification. To achieve good classification results during the
in cooperation with Hochschule
2013 harvest season, the software was adapted and the sensor hardware was matched to the
Geisenheim University and two
task. The resulting hardware consisted of two line scan cameras that were used in parallel: one
industrial partners: ARMBRUSTER
sensitive in the visible range, the other in the infrared range. The latter was equipped with a
Kelterei-Technologie GmbH and
special filter. In addition the incident light was extended into the visible range to correspond
Ingenieurbüro Waidelich.
with the measured wave band.
Project execution
In preparation for the experiments in October 2013, the software was extended with a function
Dr. rer. nat. Kai-Uwe Vieth,
for recording sorting results and to offer several possibilities of teaching it the different grape
Dipl.-Inform. Christian Negara,
qualities, especially using only the visible spectral range or a mixture of visible and infrared
Dipl.-Inform. Bettina Otten,
spectrum.
Dipl.-Ing. Erich Enderle,
Petra Riegel, Matthias Schwartz
In October 2013 many experiments on both red and white grapes to detect foreign objects,
mold, and ripeness degree were performed with the adapted sorter prototype at Hochschule
Geisenheim University (see Figure 2). In addition, a large corpus of hyperspectral data in the
range from 400 to 2500 nm was acquired for further analysis with the aim of improving the
sorting system that will be used in the next harvest season in 2014.
Intermediate results
We achieved very good results in the removal of foreign objects and botrytis-afflicted grapes,
both red and white. Regarding quality parameters such as degree of ripeness a classification
was possible but the degree of discrimination has yet to be improved.
Funding
This project was financed by The Central Innovation Program (Zentrales Innovationsprogramm
Mittelstand) research project of the Federal Ministry of Economics and Technology (Bundesministerium für Wirtschaft und Technologie).
Literature
[1]Lafontaine, M.; Freund, M.;
Vieth, K.-U.; Negara, C.: Automatic
fruit sorting by non-destructive
determination of quality parameters
using visible/near infrared to improve
wine quality: I. Red wine production.
NIR news 24(8), pp. 6-8, 2013
[2]Negara, C.; Vieth, K.-U.;
Lafontaine, M.; Freund, M.: Automatic fruit sorting by non-destructive
determination of quality parameters
using visible/near infrared to improve
wine quality: II. Regression Analysis.
NIR news 25(1), pp. 4-6, 2014
Business Unit Automated Visual Inspection
49
V i s u a l I n sp e c t i o n S y s t e ms
www.iosb . frau n h o fer.d e / S P R
1
CCT Sensor – Towards high-speed 3D sensing
M ic rosc opic 3D s e n s i n g i s a n e s ta b l i s h e d tool i n qual i ty c ontrol . H owev er, there i s s ti l l a l ac k of inlineca pa ble m e a su ri n g d e v i ce s . D u e to s p e e d l i mi tati ons mos t of the av ai l abl e 3D s ens ors are for l a bor at or y
u se only . One typ e o f 3 D s e n s o r, wh i ch us es the c hromati c c onfoc al pri nc i pl e, i s al ready av ailable as
h igh- spe e d v e r s i o n wi th m o re th a n 5 0 ,0 0 0 meas urements per s ec ond. H owev er, i t i s a poi nt s ensor w hich
re quire s a 2D s ca n to co v e r a n o b j e c t s urfac e. The s tep from poi nt to l i ne s c an s ens or i s technically
cha lle nging, e s p e ci a l l y if th e me a s u re me n t s peed s houl d remai n the s ame. W i thi n thi s proj ec t a m ult is pe c t r a l c a m e r a a p p ro a ch wa s d e ve l o p e d , whi c h has the potenti al of enabl i ng c utti ng-edge m easur ing
s pe e ds. T hus, t h e ch ro m a ti c c o n fo c a l tri a ngul ati on (C C T) s ens or i s wel l s ui ted for i nl i ne appl i c at ions.
Task
The technical problem in a nutshell: The chromatic confocal principle for 3D measurements
encodes different surface heights by unique wavelengths. The optics of chromatic sensors
split up a white light source into its monochromatic wavelengths. Additionally, each wavelength is focused at a different distance from the sensor. If an object surface is located within
the measurement range, a single wavelength is focused while the others are out of focus.
The measurement itself is carried out by spectral analysis of the reflected light using a spectrometer. The reflected light spectrum shows a characteristic peak at the wavelength that is
currently focused. Due to the confocal optics, wavelengths which are out of focus are blocked.
The 3D information is obtained by mapping the peak wavelength to the corresponding
height value.
A technical problem arises by changing over from a point sensor to a line scan sensor. Each
measuring spot requires its own spectrometer and this causes a huge gain in data traffic.
Typically, a spectrometer necessary for a point sensor consists of 1000 pixels. A line scan
sensor with 2000 measurement spots causes data traffic of two million pixels per measurement
(2000 pixel per spot times 1000 pixel per spectrometer). This amount of data causes a bottleneck and significantly slows down the measurement speed. The way to enable high-speed
measurements is to avoid high data traffic.
Results
At the Fraunhofer IOSB a solution has been developed by replacing the spectrometer with a
Contact:
multispectral camera. Compared with an ordinary RGB color camera, a multispectral camera
Dipl.-Ing. Miro Taphanel
consisting of more than three spectral channels equipped with customized filters. The task
Phone +49 721 6091-389
of the spectrometer within the chromatic sensor principle is to measure the wavelength of
[email protected]
monochromatic light. The developed multispectral camera uses six optimized interference
5 0 Business Unit Automated Visual Inspection
2
3
1 Example measurement with
stitching artefacts utilizing the
multispectral camera approach.
filters for this task. At the CONTROL 2013 fair an implementation of the camera with a filter
2 CCT optics without filter
wheel was demonstrated. With six filters the number of pixels per measurement drops from
wheel.
two million down to twelve thousand, using the same numbers as in the previous example.
3 Characteristic rainbow colors
on the object surface.
The purpose of this multispectral camera is to speed up chromatic confocal line scan sensors.
4 Lens design with improved
A new optical sensor design was developed, which is optimized for 3D line scan sensing.
measurement performance.
This chromatic confocal triangulation (CCT) sensor, in combination with the developed
multispectral camera shows promising results. With this concept microscopic high-speed 3D
sensing becomes feasible.
Project execution
Dipl.-Ing. Miro Taphanel,
Project description
Prof. Dr.-Ing. Thomas Längle
To realize a multispectral camera with custom transmission characteristics the technology
of interference filters was used. The spectral transmission characteristic of interference filters
can be controlled by adjusting layer thicknesses. Each filter consists of a stack of thin films
with alternating high and low refractive index. Based on a physical model of the 3D measurement system the filters of the multispectral camera were optimized by finding the best-suited
thin film filter stacks. In cooperation with the Fraunhofer Institute for Surface Engineering
and Thin Films IST the filters were manufactured and mounted on a filter wheel. Additionally,
CCT sensor optics were set up to proof the concept for 3D sensing. Current research focuses
on shrinking the filters to pixel size to avoid the slow filter wheel. With these competences
the Fraunhofer IOSB will have the ability to set up a 3D sensor with cutting-edge measurement
speed. According to the state of the art in camera technology a microscopic 3D sensor with
more than 50,000 measurement lines per second becomes feasible. Typically, a measurement
line consists of 2000 adjacent measurement spots.
Literature
[1] Taphanel, M.; Hovestreydt, B.;
Beyerer, J. “Speed-up chromatic
sensors by optimized optical filters”,
Proc. SPIE Vol 8788. pp. 87880S87880S-10 (2013)
4
[2] Taphanel, M.; Beyerer, J.
“Fast 3D in-line sensor for specular
and diffuse surfaces combining
the chromatic confocal and triangulation principle”, Instrumentation
and Measurement Technology
Conference, pp. 1072 -1077 (2012)
Business Unit Automated Visual Inspection
51
S i g n at o r i c s
www.iosb . frau n h o fer.d e / S IG
1
Directional reflectance measurements
with a robot-based goniometer
Optical reflections on surfaces are of great interest for a wide range of applications. There are many technical and scientific examples of the use of reflections. Automated imaging-based inspection and machine
vision sy st e m s ca n fi n d d e fe c ts o r c o n s pi c uous features , for ex ampl e by detec ti ng c hange o f opt ical
re f le c t a nc e c omp a re d to fa u l t-fre e wo rk p iec es . Bec aus e the human ey e i s v ery s ens i ti v e, s l i ght c h anges in
re f le c t ion f rom o p ti ca l p a i n ts a n d co a ti ngs are readi l y s potted by c us tomers . Remote s ens i n g needs
d e t a ile d k now l e d g e o f th e re fl e cta n ce o f n atural materi al s for a meani ngful ex ami nati on of hy pe r spect r al
s a t e llit e da t a . Fu rth e rm o re , c o mp u te r s c i enc e us es s urfac e refl ec tanc e model s to des i gn realist ic
3 D sc e ne s.
T he m a gnit ude o f o p ti ca l re fl e cti o n fro m s urfac es of opaque and trans parent obj ec ts i s i nfl uenc ed by t he
s u r f a c e m a t e r i a l ’s o p t i c a l p r o p e r t i e s a n d a c t u a l g e o m e t r i c a l s t r u c t u r e ( r o u g h n e s s a n d g r a n u l a r i t y ) .
A b s o l u t e l y f la t s u rfa ce s re fl e ct l i g h t d i re cti onal l y , l i ke a mi rror, whereas mat s urfac es s c atter l i gh t int o all
d ire c t ions. Re a l s u rfa c e s re fl e ct th e i n c i d e nt l i ght more or l es s around the i deal refl ec ti on di rec tion. The
for m of t his re fl e c ti o n l o b e d e p e n d s to a large ex tent on the l i ght’s i nc i dent angl e, but al s o – be cause of
d ispe r sion – on i ts wa ve l e n g th .
Task
Reflections on surfaces are characterized with the help of the Bidirectional Reflectance
Distribution Function (BRDF), which describes the amount of reflected light in each direction
as a function of the incident angle and wavelength of the light. The measurement of the BRDF
characteristics with high spatial and spectral resolution presents a major challenge. This task is
best performed with an automated setup to achieve the necessary precision and reproducibility.
Some national institutes of metrology, such as the Physikalisch-Technischen Bundesanstalt (PTB)
in Brunswick have constructed such a setup and use it for highly accurate BRDF measurements
of reference standards. Other setups are available in other institutions (e.g. ONERA, Toulouse)
or can be bought from commercial companies (e.g. surface optics, USA). All setups are
optimized for special purposes and have some limitations in certain cases, i.e. in their spectral
Contact:
range, measurement spot diameter or sample type. Commissioned by the Wehrtechnische
Dr.-Ing. Dipl.-Phys.
Dienststelle 52 and with financial support from the German MOD a robot-based BRDF
Alexander Schwarz
goniometer was developed and built at the IOSB to perform measurements in the visible and
Phone +49 7243 992-103
infrared spectral range. The lighting unit was designed such as to be able to also measure the
[email protected]
retro reflex signal from the sample.
5 2 Business Unit Automated Visual Inspection
2
3
Optical setup
1 BRDF goniometer with robot,
turntable and sample.
With the goniometer at the IOSB the BRDF of samples can be measured automatically. The
2 Spatial reflectance distribu-
setup consists of two main parts: an industrial robot from KUKA, mounted headfirst on a
tion of a sample.
framework and a height-adjustable turntable directly under the hanging robot. A movable
3 Roof of a car.
mechanical semi-circular guide rail integrated in the table carries the lighting unit. The angle
of the semi-circular guide rail is controlled by the robot to obtain the required incident angles
between 0° and 90°.
Project execution
Dipl.-Ing. (FH) Michael Kremer,
The sample is fixed on the turntable, which is also controlled by the robot. All incident azimuth
Dipl.-Inform. Dipl.-Ing. (BA)
angles can be realized by turning the table, on which samples of different sizes and thicknesses
Martina Richter,
can be mounted. Because the sample is in a horizontal position, bulk solids and liquids can also
Dr.-Ing. Dipl.-Phys.
be measured.
Alexander Schwarz
At the end of the robot arm an optical sensor (e.g. a photo diode or camera) is mounted to
detect the reflected light. During the measurement the robot moves the sensor around the
sample along a hemispherical plane such that the sensor traverses all required reflection angles.
At each measurement position the robot stops and reflection data are collected.
Because the correct mechanical adjustment of all components is indispensable to guarantee
accurate measurement values, the robot was calibrated absolute mechanically to reach a repeat
positional accuracy of 0.1 mm.
The complete measurement procedure is controlled by two PCs. One of these controls the
movements of the robot, the turntable and the semi-circular guide rail; the other controls
the lighting unit and the sensor and handles the measurement data. All angles, changes and
adaptations of the measurement procedure can be realized easily with parameterized software.
The illuminating light source is a thermal emitter (e.g. a halogen lamp). Alternatively, lasers
with different wavelengths can be used. Calibration is done with the help of reference standards such as a Spectralon plate.
Results
With this goniometer setup BRDF measurements in the visible and near-infra-red (NIR) spectral
range have been successfully performed. The reflectance distribution of highly reflecting, glossy
and mat samples has been measured and characterized precisely.
To visualize the optical material properties measurement results can be presented in different
ways: BRDF and reflection lobe in 2D or 3D.
Business Unit Automated Visual Inspection
53
Research Group
V a r i a b l e Im a g e A c q u i s i t i o n
a n d P r o c e ss i n g
w ww.ios b . frau n h o fer.d e / V B V
1
Thermal Infrared Deflectometry
New insights into specular surfaces
D e f le c t om e t r y i s a re l i a b l e m e th o d o f c o ntac t-free, opti c al meas urement of a s urfac e s hape. I t provides
h ighly a c c ur a t e s u rfa c e s l o p e i n fo rma ti o n , whi c h i s the meas urement parameter that mos t c l os ely resem b le s t he hum a n p e rc e p ti o n o f s p e cu l a r s u rfac es and, as s uc h, enabl es an obj ec ti v e ev al uati on.
A simple deflectometric sensor can be assembled with off-the-shelf components. It consists of
a monitor, which displays a series of code patterns, and a camera that observes the reflection
of these patterns in the test surface. The visible distortion of these patterns characterizes the
shape of the surface. As a consequence of this working principle, the conventional deflectometry is limited to specular surfaces such as mirrors, polished surfaces, or glossy coatings,
which exhibit a reflection primarily in the visible light spectrum.
One way to partially overcome this restriction is to use longer wavelengths, since the optical
properties of materials are usually wavelength-dependent. The long-wave infrared (LWIR)
spectrum in particular has beneficial properties for deflectometry, notably a higher reflectivity
of most surfaces. This effect is especially pronounced with metals and enables the deflectometric inspection of raw metal or machined metal parts. In visible light unpolished metals
usually exhibit a dull reflection, which blurs the image, whereas in the LWIR spectrum they
display near mirror-like reflectivity.
Other materials that benefit from the change of spectrum are transparent materials such as
glass or several plastics [2]. In the visible spectrum interference effects, such as multiple inner
reflections or a visible background behind the translucent object, prohibit an undisturbed
deflectometric measurement. In the LWIR spectrum, however, many of these materials appear
opaque so that the predominant primary reflection allows for a deflectometric measurement
of the surface. While cameras for this spectrum are readily available, the suitable technology
for creating the necessary code patterns is not.
Contact:
Dipl.-Inform. Sebastian Höfer
Phone +49 721 608 45915
[email protected]
5 4 Business Unit Automated Visual Inspection
2
3
1 Laboratory setup for infrareddeflectometry: A laser generates
thermal patterns on a projection
surface, while a thermal camera
observes the reflection of the
patterns.
2 , 3 Result after decoding a
deflectometric measurement.
The Variable Image Acquisition and Processing (VBV) Research Group of the Fraunhofer IOSB
in cooperation with the Vision and Fusion Lab (IES) at the Karlsruhe Institute for Technology
(KIT) is developing such methods of pattern generation that are necessary for deflectometry
in the LWIR spectrum. The developed methods range from static patterns and arrays of
thermal elements to spatial and temporal variable patterns generated with laser light [1]. The
novel pattern-generation techniques necessitate the adaptation of the coding methods from
the visible to the thermal infrared spectrum. Promising results have been achieved by using
a powerful laser to generate large-scale, dynamic patterns. The laser creates heat patterns
on a projection surface, which then serves as the pattern display for the deflectometric code
sequence (Fig. 1). This setup allows for the deflectometric inspection of raw metal surfaces,
which are difficult to handle with optical inspection methods in the visible light [3].
Current research focuses on the use of static patterns, which represent a simple way of code
pattern generation but require a more sophisticated evaluation of the data. In addition,
an adaptation of the methods and algorithms for the evaluation and 3D reconstruction of
deflectometric data developed at the Fraunhofer IOSB for the LWIR spectrum is required.
With a complete processing chain for the acquisition and evaluation of deflectometric data
in the thermal infrared spectrum, the deflectometry can be extended to a whole range of
new surface materials. Its ability of inspecting raw metal surfaces enables its application in
earlier stages of a manufacturing process and can save costs due to an earlier detection of
defects before further processing.
Literature
[1] Beyerer, J.; Heizmann, M.;
Werling, S.: “Konzept zur Erzeugung eines räumlich und / oder
zeitlich veränderbaren thermischen
Strahlungsmusters”, European
Patent EP 10191409.1 , 11 (2009)
[2]Höfer, S.; Roschani, M.;
Werling, S.; Beyerer, J.: “Verfahren
und Vorrichtung zur Inspektion von
Glasoberflächen”, XXV. Messtechnisches Symposium des Arbeitskreises der Hochschullehrer für
Messtechnik e.V., S. 127-138 (2011)
[3] Höfer, S.; Werling, S.; Beyerer, J.:
“Thermal pattern generation for
infrared deflectometry.” Proceedings
SENSOR 2013: 785-790 (2013)
Business Unit Automated Visual Inspection
55
B u s i n e ss U n i t
Defense
Spokesperson
Content
Dr. rer. nat. Michael Arens
Phone +49 7243 992-147
The IOSB’s core competency lies in research into optronic
systems for human and computer vision, real-time processing
and analysis of imagery, and full-motion video as well as the
necessary information and communication technology for
the use of images in network-enabled operations.
Of special significance for the German armed forces is our
research and technology work in the following areas:
• Design, evaluation and protection of existing and future
optical and optronic sensor systems: daylight and night
vision, hyperspectral sensing, laser-based sensors and
protection against laser threats.
Coordinator
• Warning sensors, propagation of light through the
Dr. rer. nat. Jürgen Geisler
atmosphere, signatorics for reconnaissance and protection,
Phone +49 721 6091-262
concepts for and evaluation of camouflage, concealment
or +49 7243 992-109
and deception.
• Network-enabled interoperable real-time processing and
analysis of imagery for purposes ranging from wide-area
imaging reconnaissance to target detection in weapon
platforms, including human-system-integration.
• Computer assisted object and situation recognition and
image-based methods for object tracking and target
handoff.
• System architectures for networked simulation and generation of terrain and building models for simulator-based
Mission
training.
For the benefit of Germany’s defence as part of Europe and
The research and technology activity of business unit Defence
NATO the Fraunhofer IOSB supports the German ministry
is carried out in three tiers:
of defence and its subordinate authorities as well as the
• To support the ability of the German ministry of defence
defence industry with applied research and technology on
(GMOD) and its subordinate authorities for analysis and
the areas of imaging with optronic systems, image and signal
evaluation of defence-related technologies the IOSB
analysis, and architectures for simulation and information
conducts basic research that is funded by the GMOD in
systems. Rapid transfer of our research results in order to
the long term.
enhance the ability of the armed forces and to protect our
soldiers is our prime objective.
• Based on this research the institute conducts technology
projects of the GMOD with a medium-term horizon and
specific objectives.
56
Reference solutions
• Finally projects with the defence industry lead to solutions
for the forces. These projects are carried out in close coordination with the GMOD to ensure the independent role
of the IOSB as consulting entity for the governement.
• ABUL – Full-motion video exploitation system for
reconnaissance and surveillance (air, land, and sea)
• RecceMan®: Interactive recognition assistance for aerial
and satellite imagery reconnaissance
• i2exrep for reporting in image-based reconnaissance
International cooperations based either on bilateral agree-
• SAR-Tutor for image analysis training
ments, with contracts from the European Defence Agency
• Computer-Aided Interactive Performance Evaluation Tool
(EDA), or common research activities in the context of NATO’s
Science & Technology Organization (NATO STO) are continuously flanking our national defence research work.
CARPET for camouflage assessment
• OMSIS: Onboard Infrared Ship signature Management
system
• Digital Map Table
To the extent that military security classification does not
prevent this, the R&T in business unit Defence is incorporated
into the IOSB’s applied research for civil purposes performed
by the other four units in order to achieve the highest benefit
• CSD – Coalition Shared Data Server and clients for interoperable data and information distribution
• Predicition tool for thermal imaging based on a Thermal
Range Model (TRM 4)
for all application areas.
• Environment measurement system for characterization of
Equipment, and lab and test facilities
• GERTICO: Infrastructure for federated simulators
atmospheric effects
• Environment simulation (e. g. for camouflage assessment)
• Adaptive optics
• Bidirectional reflectance analysis of materials
• Airborne platform for imaging radiometrics (AirSIG)
• Observer performance evaluation
• Assessment of visual and infrared imaging systems
• Optronic countermeasures
• Femtosecond laser lab
• Human-computer interaction for image analysis
(eye gaze, gesture)
• Testbed for network-enabled imaging reconnaissance
• Federation of simulators
• Distributed Network Battlelab (DNBL)
• SAR simulation (CohRaS®: Coherent Ray-tracing based
SAR-Simulator)
• Reconnaissance and surveillance with mobile sensor swarms
• Serious gaming for image analysis training
• Airborne multisensor platform (VIS, LWIR and hyperspectral)
57
S i g n at o r i c s
www.iosb . frau n h o fer.d e / S IG
1
Optical Turbulence – Atmospheric impact
on imaging and wave propagation: Basic
research and applications
E le c t ro- opt ic a l a n d i m a g i n g s ys te m s a re us ed i n many mi l i tary fi el ds , e.g. war ni ng, rec onnai s s a nce and
ta r ge t a c quisit i o n . De s i g n a n d va l i d a ti o n of mi l i tary s y s tems hav e to take ac c ount of meteorol ogical cond it ions. E nv iron m e n ta l c o n d i ti o n s h a ve to be c ons i dered for appl i c ati on, effi c i enc y and us e on diff erent
p la t f or m s in t he o p e ra ti o n a re a . T h e y a re d etermi ned by c l i mati c i mpac t, weather c ondi ti ons , and int er action w it h t he e a rth ’s s u rfa ce . C h a ra cte ri z ati on, quantifi c ati on, and c orrec ti on proc edures of atmospher ic
i nf lue nc e s a re i n d i s p e n s a b l e . C l i m a ti c i mp ac ts determi ne the c hoi c e of the s pec tral range (UV up t o IR) f or
a n opt im um us e o f e l e c tro -o p ti c a l s y s te m s.
Atmospheric phenomena like diffraction, refraction, aerosol scattering and absorption, and
turbulence influence wave propagation of electro-optical and imaging systems. Basic research
at the Signatorics department of the Fraunhofer IOSB is focused on optical turbulence in the
lower atmospheric boundary layer, quantifying the impact of the turbulent atmosphere on wave
propagation. Optical turbulence may result in a strong degradation in imaging quality, making
tasks such as detection, classification and identification difficult or even impossible. Because the
atmosphere experiences turbulence almost continuously, correction procedures for compensation of turbulence are investigated.
This report gives an overview of the basic research and applications dealing with atmospheric
corrections regarding the influence of optical turbulence on electro-optical systems as part of
the ATLIMIS (Atmospheric Limitations of Military Systems) project.
Optical turbulence is described by the structure function parameter of the refractive index of
air, Cn², and is caused by temperature and humidity fluctuations in the atmosphere. These are
created by thermal (interaction with the earth surface by heating and cooling) and mechanical
forces (wind shear) or evaporation.
Project description
Contact:
The basic research focuses on field trials investigating the spatial and temporal resolution of
Dr. Detlev Sprung
optical turbulence in the lower atmospheric boundary layer, in which most of the electro-optical
Phone +49 7243 992-164
systems are operated. These experimental trials, with time periods from several weeks up
[email protected]
to several years, are performed in different climatic conditions, including deserts, moderate
58 Business Unit Defense
2
3
central European, arctic, and sub-tropical. Regarding the influence of the earth surface, typical
1 Example of a diel cycle of the
land covers, including sea surfaces at different temperatures, various rural agricultural sites,
vertical distribution of optical
and urban areas are investigated. Besides these experiments under typical atmospheric
turbulence (Cn²). The color coding
conditions, the project focuses on the long-term experiment VerTurM (Vertical Turbulence
represents the strength of the
Measurements) in which the vertical distribution of the optical turbulence up to a height of
optical turbulence (dark red cor-
400 m is investigated with various complementary instruments. This long-term experiment
responds to strong turbulence).
has been set up on the site of the WTD 91 (Technical Centre of Weapons and Ammunition
2 Comparison of vertical pro-
of the German Armed Forces) in Meppen (north-western Germany) since June 2009. A diel
files of optical turbulence (Cn²)
cycle of the vertical distribution of the optical turbulence for one typical day in summer is
measured during the VerTurM
presented in Fig. 1. A high variability of optical turbulence can be identified. Measured vertical
experiment (dots) and the calcu-
profiles are analyzed with respect to the meteorological conditions. Diurnal and seasonal
lations using the Tatarskii model
effects are investigated. Regarding standard meteorological data a prediction model of the
(line) for a daytime case (12:00
vertical distribution of turbulence should be derived regarding standard meteorological data
CET, red) and a nighttime case
and therefore the efficiency of electro-optical systems in the lower atmospheric boundary
(21:00 CET, blue).
layer should be improved. Results from existing models (e.g. Tatarskii, Fig. 2) deviate strongly
3 Schematics of turbulence
from the measurements, especially at stable atmospheric conditions at night.
compensation of an adaptive
optics system.
All measured optical turbulence data are stored in a database maintained at the Signatorics
department. Here the measured turbulence data can be combined with the performance
properties of electro-optical systems, allowing the operating instruments to be characterized
regarding specific measurement sites and times (meteorological conditions).
The results of the experimental work on optical turbulence are also used for model validation
and for the correction, improvement and prediction of performance of electro-optical and
imaging systems.
For practical applications software tools are developed to compensate turbulence for use of
the data in imaging systems. Using adaptive optics, systems are implemented for measuring
and correcting fast wavefront distortions (Fig. 3). The project also covers laser applications for
urban environments.
Sponsor
The research and application on optical turbulence are part of the project ATLIMIS (Atmospheric
Limitations of Military Systems, No. E/UR1M/9A265/AF170), commissioned and sponsored by
the WTD91 (Technical Centre of Weapons and Ammunition) of the German Armed Forces and
embedded in the business segment defense.
Project execution
Dr. rer. nat. Karin Stein, Dr. Detlev Sprung, Dr. Peter Grossmann, Erik Sucher
Literature
[1] Sprung, D.; Grossmann, P.;
Sucher, E.; Stein, K.: Stability and
height dependant variations of the
structure function parameters in
the lower atmospheric boundary
layer investigated from measurements of the long-term experiment
VerTurM (vertical turbulence measurements), SPIE Remote Sensing,
8178-08, Prague, 2011
[2]Sprung, D.; Grossmann, P.;
Sucher, E.: Investigation of seasonal
and diurnal cycles on the height
dependence of optical turbulence
in the lower atmospheric boundary
layer, SPIE Optics and Photonics,
8719-19, San Diego, 2012
[3]Gladysz, S.; Stein, K.; Sucher, E.;
Sprung, D.: Measuring non-Kolmogorov turbulence, SPIE Remote
Sensing, 8890-40, Dresden, 2013
Business Unit Defense
59
Op t r o n i c s
www.iosb . frau n h o fer.d e / O P T
1
FIRST RESULTS OF A NEW EYE-SAFE
3D-LASER-RADAR APD LINE SCANNER
I n a non- c oope ra ti v e e n vi ro n me n t, i m a g i n g 3D l as er radar s ens ors offer a uni que potenti al c ompared t o
p a ssiv e se nsor s re g a rd i n g ta s k s l i k e s u rve i l l anc e, detec ti on of s mal l obj ec ts , rec onnai s s anc e, c l as s if icat ion,
p rot e c t ion, obs ta c l e a v o i d a n c e , p o s i ti o n i n g, terrai n model i ng, depth s oundi ng, autonomous na vigat ion,
a ut om a t ic obje c t re co g n i ti o n , a n d o b j e ct trac ki ng. Empl oy i ng s c anni ng l as er s y s tems i t was pro ven t hat
l a se r r a da r se n s o rs o ffe r th e c a p a b i l i ty o f automati c data ev al uati on. Thei r outs tandi ng perform ance is
o w e d t o t he f a ct th a t l a s e r ra n g e d e p th res ol uti on i s i ndependent of the s ens or’s di s tanc e to the t ar get .
I n c ont r a st t o p a s s i ve s e n s o rs , fo r wh i ch there ex i s t no rel i abl e obj ec t rec ogni ti on al gori thms , the m ain
d iff ic ult y in int ro d u c i n g o p e ra ti o n a l l a s e r radar s y s tems i s owed to the l ac k of adequate s ens ors .
Two-dimensional scanning systems suffer from the drawback of spatial resolution, when, for
a given field of view (FOV), a high image update rate is necessary. Tasks demanding reliable
resolution of small objects, especially at long ranges in real time, can be fulfilled only by sensors consisting of detector arrays. The detector is the heart of an imaging 3D sensor system
and ensures sufficient frame rates and a high spatial resolution for tasks such as detection or
classification.
Increasing efforts have been made throughout the world to develop 3D detectors based on
one- or two-dimensional arrays. Detector development focuses on avalanche photo detectors
(APD) operated in the Geiger mode (GAPD) or in the linear (non-Geiger) mode. GAPDs offer
the advantage of higher sensitivity, but there are also some negative effects using GAPDs
in laser radar: First, dark counts generated by thermal noise can cause false alarms. Second,
GAPDs experience a dead time in which the detector element does not work after detecting
a photon. The dead time typically varies from 10 ns to 1 µs and depends on the detector
material and on the design of the quenching electronics. Thus usually only one echo can be
detected in Geiger mode. In linear mode multiple successive echoes can be detected within
a short range.
Contact:
Dr. rer. nat. Dipl. Phys. Bernd Eberle
Phone +49 7243 992-132
[email protected]
60 Business Unit Defense
2
3
1 View of the 3D line detector
camera (left) and the laser source
(right) equipped with lenses.
2 Visual impression of the
environmental surrounding of
Here we present first results for a recently developed 3D imaging laser radar sensor, working in
the laboratory. The distance to
the short-wave infrared (SWIR) band at 1.5 µm. It consists of a novel Cadmium Mercury Tellu-
the high building on the left
ride (CMT) linear detector array with 384 x 1 APD elements at a pitch of 25 µm, developed by
side of the scene is 270 m.
AIM Infrarot Module GmbH. The APD elements were designed to work in linear (non-Geiger)
3 Depth image of the measured
mode. Each pixel is capable of providing time of flight measurement, and – due to its linear
scene composed of processed
detection mode – allowing the detection of three successive echoes. The digital read-out
data, coded in false colors.
integrated circuit (ROIC) was designed to offer a principal depth resolution of 60 cm. Using
additional electronic processing on the ROIC a depth resolution of 15 cm was attained. The
ROIC delivers the time-of-flight (TOF) data for the whole flashed area all at once; for test
Partners
purposes an intensity mode is available. The maximum read-out rate is 4 kHz.
In cooperation with WTD 81,
AIM Infrarot Module GmbH,
The 3D laser radar system was set up in a laboratory from which the surrounding environment
EADS Deutschland GmbH
could be accessed. The sensor head, consisting of 3D sensor and laser source as well as a SWIR
CASSIDIAN
camera to monitor the laser beam, were mounted on a horizontally scanning rotation stage.
This scan direction was attributed to the fact that the 3D sensor was mounted with the
detector line in the vertically direction. Trying to realize an FOV of around five degrees for
the present test purposes, we chose a commercial SWIR lens with an f-number of 100/1.4 as
receiver optics for the 3D laser range camera. To suppress background radiation, a bandpass
filter of 80 nm width was mounted in the back of that lens.
In the absence of a kilohertz-laser system we used a Q-switched 20 Hz OPO laser from Quantel
(Big Sky CFR 400 Laser Series) with an output power of 70 mJ at the wavelength of 1.57 µm.
The transmitter optics, developed by EADS Deutschland GmbH Cassidian, was designed to fit
the linear FOV of the receiver. The whole experimental set-up was operated by a home-build
computer control unit, which controlled triggering of 3D camera, laser and scanning unit,
as well as providing data recording and real-time visualization of the measured range data.
During data acquisition each of the three echoes was visualized in real time on the monitor
of the control computer.
Literature
[1] Eberle, B.; Kern, T.; Hammer, M.;
Schwanke, U.; Nowak, H.: OPTRO
2014, Paris, FR, Paper No. 2956200
“Performance of a new eye-safe
3D laser radar APD line scanner”
Business Unit Defense
61
Interoperability and
Ass i s t a n c e S y s t e ms
www.iosb . frau n h o fer.d e / IA S
1
Heterogeneous reconnaissance data:
task-oriented acquisition, distributed
exploitation and interactive utilization
R e c onna issa nc e s ys te m s m u s t b e a d a p ta b l e and s c al abl e to meet the ti me and s pac e requi rement s of a
re c onna issa nc e m i s s i o n . S i tu a ti o n d e p e n d e nt different i nformati on s ourc es mus t be uti l i z ed – not only t o
ca r v e out diff e re n t a s p e cts , b u t a l s o to v e r ify the gathered i nformati on by l i nki ng them i n ti me and space.
T he e x ploit a t io n m u s t ta k e p l a c e ti me l y and al l as pec ts of the rec onnai s s anc e tas k mus t be c on sidered.
R e sult s of t he e x p l o i ta ti o n mu s t b e d i s s e m i nated ti mel y and i n s tandardi z ed formats to the request or s.
A system of this kind needs special mechanisms for interoperability. In addition to interlinking,
the cooperation of systems and users with various competencies at a technical, logical and
semantic level play a vital role to achieve a consistent workflow.
To provide a solution to these problems a distributed experimental system-of-systems for videobased reconnaissance was set up at Fraunhofer IOSB. Closely cooperation with potential users
and participation in realistic exercise scenarios assure quality and applicability of the whole
system group as well as the single system components.
The so-called ExBA group of interlinked systems, then, is a heterogeneous system-of-systems
consisting of a range of different sensors and of components for sensor management, communication and analysis, interactive visualization, and automated and manual processing of data
and information. This solution offers standardized interfaces to other systems, which can be
integrated into the reconnaissance workflow.
Department IAS has developed a system called AMFIS for managing and evaluating heterogeneous sensors, which can be stationary or mounted on heterogeneous sensor carriers in a
homogenized ground control station within a complex parallel reconnaissance application.
For this purpose a distributed modular architecture was developed, allowing a quick and
efficient adaptation of the system to varying demands or the need for special sensors. The
Contact:
parallel control of different sensor carriers was integrated and tested on the ground, in the
Dr.-Ing. Igor Tchouchenkov
air and on water. To achieve technical and semantic interoperability, the system contains
Phone +49 721 6091-552
communication components for transferring reconnaissance data in STANAG 4609 as an
igor.tchouchenkov@
integrative system interface and supports additional information exchange systems, such as
iosb.fraunhofer.de
XMPP and Coalition Shared Data (CSD), which is a STANAG 4559 implementation.
62 Business Unit Defense
2
1 Interactive image exploitation.
2 A distributed experimental
Department VID has developed ABUL, a modular system for assisting the exploitation process
system-of-systems for video-
for unmanned aerial vehicles. Thereby, ABUL provides real-time optimized features for online
based reconnaissance (ExBA).
surveillance and reconnaissance as well as functionalities valuable for offline reconnaissance
tasks. Key features of the system include video processing algorithms for stabilizing and
improving the video image, for detecting moving and stationary objects, and for generating
Project execution
geo-referenced mosaics or stereo images etc. ABUL is flexible in adapting to different sensors
Dipl.-Geophys. Ralf Eck (IAD)
and data. Interoperability is a main focus of the development. STANAG 4609 video data with
Dipl.-Inform. Norbert Heinze (VID)
encoded metadata is processed in real time. Interface to the CSD enables dissemination of
Dipl.-Wirt.-Ing. FH Florian Segor (IAS)
the exploitation products.
Dipl.-Inform. Christian Zaschke (IAS)
The software for Digital Situation Table (DigLT) was developed by department IAD to connect
heterogeneous reconnaissance, tactical and spatial data from multiple sources, such as ZGeoBw,
OpenStreetMap and CSD, and allows role-based visualization and interaction. Since the
different roles in ISR use different hardware, the software also supports mobile devices,
normal PC workstations, digital situation table and video walls. These devices support different
modes of interaction, such as touch input with finger, mouse and keyboard, and 3D gestures.
The software can specifically adapt the spatial data for the resolution of the display of the
device used without a delay. The result is a visualization optimized for every device and its
interaction with the spatial data.
The information hub in ExBA is a CSD Server. The CSD stores and disseminates data based on
a standardized interface, metadata model and data formats. The other ExBA systems store and
retrieve data from the server over client applications. Systems from other vendors and providers
that respect the standards (STANAGs) the CSD is based on can easily be connected to ExBA
through this concept. This allows the integration of ExBA functionality into a bigger surveillance
and reconnaissance architecture. By sharing information within ExBA and with other units and
organizations, situation awareness can be enhanced.
The ExBA was successfully tested within the scope of the “Unified Greding” experiment. The
integrative system reconnaissance data was provided by the AMFIS sensors and by external
sensor carriers and were broadcasted live to the ABUL video exploitation system and to the
map-based visualization with DigLT. The data was then evaluated, used for situation representation and analysis and archived. All relevant primary data as well as reconnaissance results
were stored in standardized formats in a CSD server.
Fraunhofer IOSB thanks the WTD81 for financing research and support in the
“Unified Greding” experiment.
Business Unit Defense
63
Ob j e c t R e c o g n i t i o n
www.iosb . frau n h o fer.d e / O B J
Laser scanner
Pa n / t i lt u n i t
360° camera
1
MODISSA – a test bed for “Mobile
Distributed Situation Awareness”
I n t he ne a r f ut u re , v e h i c l e s wi l l b e e q u i pped wi th a v ari ety of s ens ors , c omputers , and c ommu nicat ion
s y st e m s, f or e x a m p l e to i mp l e me n t d ri ve r as s i s tanc e func ti ons . O n the c i v i l i an market, thi s dev elopm ent
i s la r ge ly dr iv e n b y a g ro wi n g i n te re s t i n safety and c omfort. A ddi ti onal l y , the mi l i tary has an i n creasing
d e m a nd f or situ a ti o n -a wa re n e s s c a p a b i l i ti es i n thei r v ehi c l es . Thes e trends hav e bec ome wel l es tablished
i n t he sc ie nt if i c c o mmu n i ty. H o we v e r, c u rrent res earc h on thes e topi c s i s often hampered by th e lack of
a n a de qua t e , c o n fi g u ra b l e te s ti n g a n d d e mons trati on pl atform.
Task
A versatile research vehicle is needed that provides testing and analysis functionalities for
a wide range of sensors and various operating scenarios. Depending on the investigated
scenario such a vehicle can even play different roles, for example a leader or follower in a
convoy, a single vehicle in traffic, or a command and control vehicle. Example applications
for its sensors are obstacle detection and avoidance, traffic monitoring, acquisition of 3D
data, change detection, as well as target location, target tracking, target designation and
target handoff between vehicles. It is even possible to simulate a network of multiple vehicles
and their interaction.
The MODISSA platform
MODISSA (Mobile Distributed Situation Awareness) is the IOSB’s realization of an experimental
platform for hardware evaluation and software development in the above contexts of automotive safety, security, and military applications. It is based on a Volkswagen van VW T5 that
has been equipped with a broad range of sensors and contains hardware for complete raw
data capture, real-time data analysis, and immediate data visualization on in-car displays
(Figure 1). The VW van carries several sensors on a roof rack, and a power supply as well
as operational electronics inside. The sensor configuration can be adapted to the needs of
the respective study. The electronics, including several PCs, are located in a rack behind the
driver’s seat. A row of passenger seats behind it is arranged for people operating the system
or watching real-time processing demonstrations. The power for the sensor system is provided
by four high-capacity Li-ion batteries that are stored in a box in the back of the van. This power
Contact:
system has sufficient capacity for several hours of independent operation.
Dr. rer. nat. Marcus Hebel
Phone +49 7243 992-323
Control of the sensors and data acquisition are performed by PCs in a rack inside the van.
[email protected]
Three types of PCs are included: A control PC, several recording PCs, and a powerful process-
64 Business Unit Defense
2
1 The MODISSA platform
enables mobile sensor data
acquisition, sensor data analysis
and mobile demonstrations.
2 Mobile 3D model acquisition
with the MODISSA platform. The
data acquired with two Velodyne
laser scanners (red and green for
visualization) constitute highly
accurate 3D representations of
the vehicle’s vicinity. 3D data
can be accumulated for wide
area models and can be fused
with imagery acquired with the
ing PC. For georeferencing and time synchronization, an Applanix inertial navigation system
camera sensors of the MODISSA
is built into the van. Its IMU (Inertial Measurement Unit) is mounted on the same mounting
platform.
plate as the main sensors to minimize errors caused by the plate’s elasticity. GPS antennas are
positioned on the roof near the front and back of the vehicle.
Participants
The sensors are mounted on plates fastened to two cross bars of a standard roof rack. The
Dr. rer. nat. Michael Arens,
current sensor configuration includes two rotating Velodyne laser scanners, an omnidirectional
Dr.-Ing. Christoph Bodensteiner
camera, and two cameras on a pan-tilt unit (one visual-range camera and one microbolometer
Dipl.-Inform. Marvin Gordon,
infrared camera). The laser scanners are located ahead of both roof rack bars over the front
Dr. rer. nat. Marcus Hebel,
corners of the vehicle roof, and are positioned on a wedge with a 25 degree angle to the
Dr. rer. nat. Wolfgang Hübner,
horizontal, sloping to the front outside at a 45 degree angle. This configuration guarantees a
Dipl.-Phys. Simon Lemaire,
good coverage of the roadway in front of the car and allows scanning of building facades
Dr. rer. nat. Volker Schatz,
alongside and behind it (Figure 2). A vertical plate between the laser scanners serves to
Dipl.-Ing. Clemens Scherer
shield these from mutual direct laser radiation. The omnidirectional imaging system is directly
fastened to the roof rack bar near the back of the vehicle, and the pan-tilt unit is located in the
center of the vehicle between the rack bars to reduce interference with the two laser scanners.
Conclusion and Outlook
An initial version of the MODISSA platform has been realized. Currently implemented applications include data acquisition and interaction paradigms with the sensors, such as looking
around through the roof-mounted omnidirectional sensor with a head-mounted display
when sitting inside the car. We are currently realizing more encompassing applications on
the MODISSA platform, such as pedestrian detection, target detection and target handoff
applications, as well as wide-area 3D model acquisition.
Business Unit Defense
65
S c e n e A n a ly s i s
www.iosb . frau n h o fer.d e / S Z A
1
Approval of trial capabilities:
A real-time airborne multi- and
hyperspectral sensor system in
an interoperable environment
Moder n mission characteristics require the use of advanced imaging sensors in reconnaissance. In particular,
h igh spa t ia l a n d s p e ctra l re s o l u ti o n i m a g i n g prov i des promi s i ng data for a v ari ety of tas ks . Thes e include
the c la ssif ic a t io n a n d d e te c ti o n o f o b j e cts of mi l i tary rel ev anc e, s uc h as c amoufl aged uni ts or i mprovised
e x plosiv e de v ic e s (I E Ds ). E s p e c i a l l y i n a s y mmetri c warfare wi th hi ghl y mobi l e forc es , i ntel l i genc e, sur veill a nc e a nd re c on n a i s s a n c e (I S R ) n e e d s to b e av ai l abl e c l os e to real -ti me. Thi s demands the us e of un m anned
a e r ia l v e hic le s (U AV s ) i n co mb i n a ti o n wi t h downl i nk c apabi l i ty and the i ntegrati on i n an i nteroper able
e nv ironm e nt .
System overview
In cooperation with OHB System-AG and GEOSYSTEMS GmbH the Fraunhofer IOSB developed
a multi- and hyperspectral sensor system, which is integrated in a wing pod for ease of
installation and calibration. It is designed for the real-time acquisition and analysis of hyperspectral data. The main component is a Specim AISA Eagle II hyperspectral sensor, covering
the visible and near-infrared (VNIR) spectral range with a spectral resolution up to 1.2 nm
and 1024 pixel across track, leading to a ground sampling distance below 1 m at typical
flight altitudes. The push broom characteristic of the hyperspectral sensor demands an inertial
navigation system (INS) for rectification and georeferencing of the image data. Additional
sensors are a high-resolution RGB (HR-RGB) frame camera and a thermal imaging camera.
For online application, the data is preselected, compressed and transmitted to the ground
control station (GCS) by an existing system in a second wing pod. The final result after data
processing in the GCS is a hyperspectral orthorectified GeoTIFF, which is filed in the ERDAS
APOLLO geographical information system. APOLLO allows remote access to the data and
offers web-based analysis tools. Furthermore, the system is integrated in a Coalition Shared
Contact:
Database (CSD). Collected data and achieved results can be put in CSD for exchange with
Dr. rer. nat. Dipl.-Math.
other units.
Wolfgang Middelmann
Phone +49 7243 992-133
wolfgang.middelmann@
iosb.fraunhofer.de
66 Business Unit Defense
2
3
1 Multisensor pod mounted on
Stemme S-10.
2 Camouflage nets detected in
hyperspectral data.
3 Landcover map created with
semiautomatic classification
algorithms.
System benefits
Partners
Capturing hyperspectral data in spectral bands of visible light as well as near- and mid-
WTD81 / OHB System Ag
infrared opens up new opportunities for differentiating materials. Different materials,
such as minerals and vegetation, possess different spectral absorption and reflection
bands. They can be identified using these spectra. This can be used for automatic target
Project execution
detection or the creation of land cover maps containing not only types of use (i.e. man-
Dipl.-Ing. Andreas Lenz,
made objects, vegetation) but gives information about the specific material. In the case
Dipl.-Phys. Hendrik Schilling,
of environmental monitoring, important factors include vegetation state (damaged forests),
Dipl.-Inform. Dominik Perpeet,
or material properties (environmental pollution).
Dipl.-Math. techn. Wolfgang Groß,
Dipl.-Ing. (FH) Eckehard Bernstein,
The field trial
Dipl.-Inform. Gisela Häufel,
Within the context of the opening of the “Zentrum für Interoperabilität, NetOpFü und
Dipl.-Inform. Sebastian Wuttke,
Simulation“ (ZINS, Center for Interoperability, Network-Centric Warfare and Simulation)
Dr.-Ing. Karsten Schulz
at the WTD 81 in Greding, a military scenario simulating the evacuation of an embassy
was performed. In preparing the evacuation, routes had to be planned to allow safe
access to the embassy. Our system’s task was reconnaissance of the surrounding area
for mission preparation, in particular the creation of maps as well as the detection of
possible sources of danger. Before the actual evacuation took place, a complete dataset
of the whole base area was collected. The data were transferred to the ground control
station during acquisition, giving a first impression of the situation around the embassy.
In post processing, the radiometric and geometric correction on hyperspectral data was
carried out. Target detection algorithms were used to identify possible sources of danger.
A group of camouflaged targets could be identified in the southern part of the base. An
image, highlighting these targets and giving their position was created. Furthermore,
hyperspectral classification algorithms were used to create precise and up-to-date maps,
which can be used for route planning. All results were put into the CSD so that they
could be accessed by all participating units.
Literature
[1]Schilling, H.; Lenz, A.;
Gross, W.; Perpeet, D.; Wuttke, S.;
Middelmann, W.: “Concept and
integration of an on-line quasioperational airborne hyperspectral
remote sensing system”, Proc.
SPIE 8897, Electro-Optical Remote
Sensing, Photonic Technologies, and
Applications VII; Military Applications in Hyperspectral Imaging and
High Spatial Resolution Sensing,
88970V (October 22, 2013)
Business Unit Defense
67
B u s i n e ss U n i t
Security
Spokesperson
Considering that new technologies are being discussed in
Dr.-Ing. Markus Müller
controversial manner with respect to conflicting aspects of
Phone +49 721 6091-250
security needs and the need for freedom, particularly if they
are associated with surveillance, IOSB pursues the notion
of “Privacy by Design”, which requires that privacy criteria
are already accounted for during the design of the system.
Furthermore the protection of industrial installations and
production capabilities against cyber-attacks in the context
of the “Industry 4.0“ paradigm is an uprising task for which
IOSB has already set up working groups and projects.
The range of services spans from studies (e.g. for evaluation)
to the realization of experimental systems or prototypes and
in individual cases up to and including system development.
Business Unit Development
In typical projects the security researchers of Fraunhofer IOSB
Dr.-Ing. Andreas Meissner
support customers in their efforts to improve their competitive
Phone +49 721 6091-402
position, addressing challenges previously thought too difficult
with new product generations featuring innovations from the
cutting edge of research.
Markets
The business unit Security serves customers from the private
and public sector. The former includes, among others, security
technology providers, security service providers and operators
of properties with critical security profiles. IOSB serves official
bodies at the federal, state and municipal level in the public
sector, particularly official bodies and emergency services,
Mission
which aim to identify and evaluate new technologies in order
The business unit Security focuses on the security needs of
to fulfill their duties.
people, companies and official bodies, which wish to protect
against natural and intentionally planned hazards, and com-
IOSB is available as a partner for specialized small and medium-
prises a broad range of interlinked competencies that deal
sized companies for the development of product innovations
with sensor sphere optronic aspects as well as multimodal
and considers itself to be a research resource for companies,
surveillance robotics (on land, at sea and in the air), the
which would also like to benefit from new scientific results
development of ultra-modern analytical methods, the sup-
without maintaining their own research department. Scientists
port of interoperable standards for the real-time exchange
from the business unit Security often take on demanding sub-
of information for risk detection and management as well
tasks in large projects on behalf of large companies. System
as assistance in the situational analysis and human machine
integrators integrate IOSB developments in their systems, for
interaction in situation centers.
example based on licenses.
68
Prior to or after acquisition of their contracts, security service
Equipment, laboratory and test facilities
providers and IOSB discuss the possibilities for further increase
• Comprehensive laboratory equipment for capturing the
in the efficiency and/or effectiveness of their work by means of
entire image processing chain, from sensors through
using new technologies; if necessary, IOSB involves industrial
analysis to interoperable information exchange
partners for commercial development and 24/7 support of
the systems. Providers of novel high-tech products, which want
to offer their own customers assurance with respect to their
performance claims, commission IOSB with lab evaluation and
benchmarking tests, on the basis of which absolute and/or
relative conclusions relating to performance can be drawn.
• Innovative, powerful sensors, such as eye-safe gated viewing
lasers, two-color infrared sensors, multi- and hyperspectral
sensors, and remotely-sited laser vibrometry systems
• Distributed test setups for multi-camera tracking and
privacy-compliant video analysis in public spaces
• Multimodal sensor platforms: Experimental robotics on land,
IOSB experts offer consultation to companies or official bodies,
at sea and in the air, and associated ground control stations
which are preparing large invitations to tender for security
(stationary and in vehicles) for mission planning and control
systems, particularly when it comes to the issue of relevant
in heterogeneous deployment networks
new technologies. This particularly includes the evaluation
• A “Smart Control Room“ lab as a “perceptual room“
of technologies with respect to their suitability for certain
• Mobile Control Center – a truck-based experimental
objectives.
platform for on-site situation management support
Companies that intend to resort to publicly funded research
References and product features
projects in order to enhance their portfolio receive assistance
• Fraunhofer IOSB as strategic partner for security research and
by IOSB when it comes to identifying suitable funding
programs and preparing a proposal. During the course of a
project, IOSB acts as a research partner. Furthermore IOSB
finds funding programs and suitable partners from industry
for users in search of new technologies for their fields of
activity.
technology of the German federation of security services (BDSW)
• Armasuisse / Swiss Confederation: UAV-based systems for
border surveillance
• Various event organizers: Providing security at major events
with IOSB sensors and sensor carriers
• Fraunhofer-wide management and coordination of large
scale project SENEKA – sensor network with mobile robots
In a technological respect and according to the overall research
proposition of Fraunhofer IOSB, methods and systems for
image exploitation are a core area, which are for example
for disaster management
• Federal Ministry of Education and Research (BMBF):
Systems for water quality monitoring
developed for property surveillance in both indoor and outdoor
• Federal Ministry of Education and Research (BMBF): Video
areas. With its competencies, IOSB handles the entire chain
assisted systems for detecting conspicuous movement
from sensor-sphere data acquisition, sensor carriers and their
patterns, attacks and assaults, and abandoned luggage
automatic control for surveillance missions, analysis on an
• European Union (EU): Systems for identifying victims of
automatic or human-machine basis, multi sensor fusion, and
natural disasters and searching for missing persons
situation analysis up to and including the use of information
• European Union (EU): Systems for offshore monitoring
acquired in this manner for higher-level management support.
System design in compliance with privacy protection is an
explicit topic of research and part of the consulting portfolio
of the business unit Security.
(detection of illegal border crossings and, smuggling of
people, weapons, and drugs)
• European Union (EU): Systems for the protection of critical
infrastructures and utility networks
69
S i g n at o r i c s
www.iosb . frau n h o fer.d e / S IG
1
AlGaN detectors for observation
of UV emitters
M a ny a pplic a t i o n s , wh e th e r c i vi l i a n o r mi l i tary , c al l for s ens ors whi c h are s ens i ti v e to ul trav i o let ( UV)
ra dia t ion. N ot a b l e e xa m p l e s i n c l u d e mo n i tori ng of UV emi tters i n water treatment fac i l i ti es an d in UV
cur ing proc e sse s . Fu rth e r c i vi l i a n e x a m p l e s i nc l ude moni tori ng of pl as ma proc es s es , parti c l e measurem ent
sy st e m s a nd sp e c tro s co p y . A m i l i ta ry a p p l i c ati on of s pec ifi c i nteres t i s mi s s i l e approac h war ni ng syst em s
(MAW S ) w or k in g i n th e U V-C s p e c tra l b a n d (240 nm – 280 nm).
Detectors commonly used in industrial applications are based on silicon (Si) or silicon carbide (SiC).
When very high sensitivity is required, photomultiplier-based systems present a possible alternative. Often, additional optical filters are needed to meet spectral requirements. The sensitivity
of these detectors usually decreases constantly under heavy illumination due to degradation of
detector or filter materials.
Since March 2011 detectors based on aluminum gallium nitride (AlGaN) have been developed
in a joint project between Fraunhofer Institutes IAF, IOSB, IPM, ISIT and IFAM. These novel
detectors are intended to overcome the weaknesses of Si and SiC. The project is funded through
a Fraunhofer internal grant. Photodiodes and line sensors are epitaxially grown at the Institute
for Applied Solid State Physics (IAF), while integration and hybridization of the detectors is
performed at the Institute for Silicon Technology (ISIT). The Institutes for Physical Measurement
Techniques (IPM), Manufacturing Technology and Advanced Materials (IFAM) and of Optronics,
System Technologies and Image Exploitation (IOSB) develop applications and prototype systems
based on these detectors.
Electro-optical properties of AlxGa1-xN (0<x<1) are determined by the ratio of aluminum to
gallium. The cutoff wavelength decreases from 365 nm (GaN) to 210 nm (AlN) with increasing
Al content. This allows the detectors to be spectrally optimized for a given application. Inclusion
of an additional layer with higher Al content – and therefore shorter cutoff wavelength –
during epitaxial growth of the detectors, results in narrow-band sensitivity (minimum bandwidth
of approx. 10 nm) without the use of external filters. This additional layer can be used as a second
active layer yielding a detector with two distinct spectral channels.
Contact:
Dr. rer. nat. Dipl.-Phys. Christian Eisele
Phone +49 7243 992-177
[email protected]
70 Business Unit Security
2
1 Demonstrator of a scanning
line camera based on AlGaN line
sensors.
2 Scenery in different spectral
bands, visual (left), complete UV
Electro-optical characteristics of the detectors manufactured so far are comparable with the
band (center) and UV-C (right).
best values published for AlGaN detectors and with the maximum values of SiC and Si detectors.
UV images were taken with our
Detectors for different sub-bands of the ultraviolet spectrum – UV-A (320 - 365 nm), UV-B
camera demonstrator.
(280 - 315 nm) and UV-C (240 - 280 nm) – have been produced.
Work at Fraunhofer IOSB focuses on imaging applications using these detectors. To investigate
Partners
the potential of the AlGaN technology we are developing a scanning camera system with the
Fraunhofer IAF, IPM, IFAM, ISIT
AlGaN line arrays supplied by IAF and ISIT. Fig. 1 shows the demonstrator of this system, which
is currently operated by an external data acquisition system. Fig. 2 shows an image of a scene
taken in the visible spectral range (left), in the complete UV range (center) and in UV-C (right).
Project execution
Both UV images were taken with our camera. A deuterium lamp (200 - 400 nm) is located in
Dr. rer. nat. Dipl.-Phys. Christian Eisele,
the center of the images.
Dipl.-Ing. (FH) Dirk Seiffer
One potential application of the line sensors is its use in sorting machines. The ability to match
the detector’s spectral sensitivity to the investigated material, and the potential of having a
second channel that is sensitive at another band within the same sensor (dual color capability)
may simplify system design and improve system performance. Further possible applications are
remote sensing from airborne platforms, for example with the aim of detecting oil spills on the
sea surface, or monitoring combustion or plasma processes.
Our focus is on a possible deployment of the UV-C detectors as part of a civilian missile approach
warning system. Compared to the photocathode systems currently used in military systems,
the new solution promises robustness of the semiconductor sensor, small size, comparatively
low cost, low weight and the inherent insensitivity to the solar background beyond 280 nm,
which reduces the need for external filters. In addition, the aforementioned inclusion of a
second channel with a different spectral sensitivity could facilitate a rough determination of
the distance to the missile and estimation of time-to-impact.
There are many imaging applications for which AlGaN sensors appear to be well suited. For
low-light scenarios, further improvements of the sensors are, however, necessary. Future research
will therefore include feasibility studies on AlGaN-based avalanche photodiodes. An improved
version of our (scanning) line camera and the development of focal plane arrays are further
tasks we will pursue.
Business Unit Security
71
I n t e r a c t i v e A n a ly s i s
and Diagnosis
w ww.iosb . frau n h o fer.d e / IA D
1
MobSC – Mobile Situation Center for the
Management of Complex Crisis Situations
I n sudde n c r isis s i tu a ti o n s th e re i s a l wa ys the need of rapi d dec i s i ons bas ed on a huge amount of inf or m ation f rom diff ere n t ta s k s a n d s o u rc e s . T h e M obSC of F raunhofer I O SB i s an ex peri mental pl atform f or t he
i nt e r a c t iv e ha n d l i n g o f s u c h i n fo rma ti o n b y a c ombi ned team. I t i s a c l us ter wi th ergonomi c di splay and
i nt e r a c t ion de v i c e s c o mb i n e d wi th h i g h -p erformanc e work pl ac es . F eaturi ng energy and c l i mate f acilit ies
a s w e ll a s broa d b a n d co mmu n i ca ti o n , i t i s abl e to work c ompl etel y autonomous l y .
Fraunhofer IOSB has been working on team workspaces for many years, using large horizontal and
vertical displays with gesture interaction, fovea
tablets™ for detailed views and selection, other
mobile devices and conventional work stations.
They set up a combined working landscape for
heterogeneous teams and individual specialists
for dedicated tasks. The Mobile Situation Center
realizes this working environment within a
medium-size truck (Figure 1) that is able to work
completely autonomously due to its own power
2
supply, triple climate system and several information interfaces to the environment. Figure 2 shows the architecture of the complete system.
All calculations are performed in an on-board processing center in a separated room. The
core system for the interaction is the digital situation table, which is located in the center of
the room and based on a 42 inch multitouch display with camera-based gesture control. On
the front wall, four 46 inch panels set up the wall display realized as one virtual display with
quad HD resolution and two Microsoft Kinect® devices for the gesture control. Optionally
tablet systems and workstations can be used.
In addition to the interaction control systems there are several subsystems for different tasks:
the CSD (Coalition Shared Database) system is an IOSB product for specialized access control
Contact:
to security-relevant information. The ABUL system supports automatic and interactive image
Dr.-Ing. Gunther Grasemann
and video analysis, especially for security applications such as screening, tracking, and change
Phone +49 721 6091-441
detection. The INSENSUM system is a meteorological measuring and analyzing system for
gunther.grasemann@
incorporating weather information, such as temperature, wind and humidity, as well as their
iosb.fraunhofer.de
history and prognosis.
72 Business Unit Security
3
4
An external subsystem interfaced with a standard network connection is the IOSB AMFIS
1 MobSC carrier system.
systems for the control of mobile sensor carriers such as UAVs and UGVs for cameras and
2 MobSC system architecture.
special sensors (e.g. chemical or nuclear).
3 Change detection with the
subsystem ABUL.
The Mobile Situation Center can be used for the management of crisis situations or for
4 Demonstration of the MobSC.
supporting situation awareness in critical environments such as mass events or congresses.
The following example shows how the change detection works. Steady and UAV-based
cameras deliver live streams to the MobSC for successive monitoring of the area. These
Project execution
streams are normally shown on the wall display. In addition, the ABUL system uses one of
Dr.-Ing. Gunther Grasemann
them to create a geo-referenced mosaic of the area (Figure 3). At fixed intervals (e.g. every
Dr.-Ing. Andreas Meißner
30 minutes), a new mosaic is created and can be used for automatic and interactive change
Dr.-Ing. Siegbert Kunz
detection. In Figure 3 the red square marks an object which the automatic component of
Dr. rer. nat. Elisabeth Peinsipp-Byma
ABUL has detected as new at this position since the last monitoring flight and which might
Dipl.-Wirt.-Ing. FH Florian Segor
be dangerous (e.g. explosive (IED) or toxic).
Dr.-Ing. Igor Tchouchenkov
Dipl.-Ing. Christian Teutsch
The current mosaic is displayed on the digital situation table as a geo-referenced overlay on
the airborne image of the area. The combined team in the MobSC can select any suitable
view of the sensor signals on the displays to support them in the decision of how to handle
the current situation. For this purpose the immediate history at the current position can be
reconstructed with video sequences from the database on the CSD.
In addition, the INSENSUM system delivers the current weather conditions together with
the weather history and forecast. This can be provided as a condensed view of a wind rose
(Figure 3). For access to the respective sensor data, OGC conform services, such as the SOS
(Sensor Observation Service) or the WMS (Web Map Service) are provided for request and
delivery of the wind rose as an overlay image. The displayed information can be very important for the decision of whether or not to evacuate an area or a certain building. Finally,
the stored video sequences can be helpful in supporting the search for a suspicious person
who may have deposited the object and be on their way to other serious actions.
The experimental Mobile Situation Center shows that it is possible to integrate sensing, analysis
and interactive display tools with high-performance capabilities in a small, mobile platform
that can be ready for operation within a couple of minutes and offers nearly the full set of
functions, residential interaction capabilities and measuring and analyzing subsystems available
and suitable for the respective tasks.
Fraunhofer IOSB has held several exhibitions in the last years, including the Security 2012 fair
in Essen, the ISCRAM 2013 in Baden-Baden and the internal cluster workshop of the Innovation
Cluster “Future Urban Security“ in Freiburg (Figure 4).
Business Unit Security
73
Interoperability and
Ass i s t a n c e S y s t e ms
www.iosb . frau n h o fer.d e / IA S
INTUITEL
Intelligent Tutoring Interface for Technology
Enhanced Learning
The worldwide increase of knowledge has led to an information-based society, where a single individual is
no longer capable of completely knowing and thoroughly understanding a significant part of the available
knowledge in a given field. Teaching is necessary to acquire knowledge and skills for life-long lear ning (L3),
e it he r in sc hoo l , a t u n i v e rs i ty o r a t th e workpl ac e. H owev er, human tutors and s ui tabl e teac hi ng m at er ial
a re e x pe nsiv e re s o u rc e s th a t mi g h t n o t b e av ai l abl e for al l domai ns and at al l ti mes . I ntel l i gent t ut or ing
s y st e m s ( IT S ) try to o v e rc o me th i s b o ttl e nec k. Therefore, us er adaptabi l i ty i s a key requi rement , since
l e a r ning is uniq u e a n d tu to ri a l fe e d b a c k h as to be gi v en ac c ordi ng to the i ndi v i dual progres s and prof ile
o f a st ude nt . T h e p re s e n te d I T S s y s te m tries to fi nd a l ev el s ui tabl e for the i ndi v i dual l ear ner, thus reducing t he ov e r a l l co mp l e x i ty o f th e l e a r n i n g proc es s .
Objectives
The objective of the EU-project “Intelligent Tutoring Interface for Technology Enhanced Learning”
(INTUITEL, www.intuitel.eu) is to enhance state-of-the-art e-learning content and learning
management systems (LMS). The INTUITEL framework can be integrated into existing e-learning
systems and will then provide additional functionality. An INTUITEL-enabled system adapts
itself in response to the learners, monitors their progress and behavior, combines this with
didactic and domain-specific knowledge and, by automated reasoning, deduces optimal
guidance and feedback. In particular, it finds an optimal sequence of course modules for the
student w.r.t. a pre-specified reference path in the presence of incomplete information and
concurrent learning paths.
Project overview
INTUITEL is an interdisciplinary project joined by a consortium of twelve international partners
from pedagogics, education and IT technology. The Fraunhofer IOSB contributes with its
expertise in technology, e-learning and knowledge transfer. As established experts in image
Contact:
exploitation the institute brings in learning content for a radar image interpretation course
Dipl.-Inf. Alexander Streicher
as testing ground as well its state-of-the-art learning management system Crayons®. The
Phone +49 721 6091-277
experience of the Fraunhofer IOSB in semantic web technologies is a main pillar of the auto-
[email protected]
matic reasoning and deduction capabilities of the intelligent part of INTUITEL.
74 Business Unit Security
1
2
1 INTUITEL System Overall
Architecture.
2 Wilhelm Busch: Lehrer
Lämpel (aus Max und Moritz).
The architecture of INTUITEL is organized in five main areas: (i) a lightweight interface to LMS;
Project execution
(ii) a semantic learning object model (SLOM) specification for learning content interoperability;
Dipl.-Inform. (FH) Anton Berger,
(iii) pedagogical and domain models to describe didactical concepts as well as domain knowl-
M.Sc. Ehm Kannegieser,
edge; (iv) the backend with a model that monitors the learner’s progress and the reasoning
Dipl.-Math. Can Özmen,
engine; (v) a communication layer which handles internal and external messaging.
Dipl.-Phys. Wolfgang Roller,
Dipl.-Inf. Alexander Streicher,
In INTUITEL, learning goals will be defined according to the desired competency, which will
M.Sc. D. Szentes,
be mapped to the available content, thereby providing means for companies and educational
Dr. Andrea Zielinski
organizations to better manage their collective knowledge. At the same time, high flexibility
to choose a learning pathway is maintained by offering system-driven and learner-directed
navigation tools, thereby increasing the empowerment of teachers and learners and fostering
the acquisition of methodological knowledge. By interpreting the learner’s responses
INTUITEL will automatically determine his position within a cognitive map for the particular
learning content. The INTUITEL-enabled LMS then plays the role of a pedagogically skilled
teacher, transparently guiding the learner towards the required competencies. Positive and
goal-oriented feedback messages will provide important advice to learners in their learning
experience. Furthermore, by providing the cognitive position also as a feedback, INTUITEL
will enable the learners to establish an intuitive model of their current learning effort and
therefore also enhance their metacognitive skills. Several market-leading LMS, including the
Open Source platforms Moodle and ILIAS, will be equipped and tested with the technology
to achieve these pedagogical goals. The involvement of several project partners in commercial
e-learning activities and other project partners in university e-learning activities will ensure
the testing and evaluation of the pedagogical and technical aspects of INTUITEL under
realistic conditions.
Acknowledgements
The research leading to these results has received funding from the European Union‘s
Seventh Framework Programme (FP7/2007-2013) under grant agreement n° 318496.
Literature
[1] Swertz, C.; Schmölz, A.;
Forstner, A.; Heberle, F.; Henning, P.;
Streicher, A.: A Pedagogical Ontology as a Playground in Adaptive
Elearning Environments. In Matthias
Horbach (Ed.): Lecture Notes in
Informatics (LNI), INFORMATIK 2013:
43. Jahrestagung der Gesellschaft
für Informatik. Proceedings. Köllen
Druck+Verlag. 2013
[2] Swertz, C.; Schmölz, A.;
Forstner, A.; Streicher, A.: Adaptive
Learning Environments as Serious
Games. In Mafalda Carmo (Ed.),
Proceedings of the International
Conference on Education and New
Developments 2013 (pp. 175–180).
2013
Business Unit Security
75
V i d e o E x p l o i t a t i o n S y s t e ms
www.iosb . frau n h o fer.d e / VI D
1
Patient-tracking for epilepsy
monitoring
When security technology helps fight diseases
E p i l e p s y m o n i t o r i n g i s v i t a l i n t h e a c c u r a t e d i a g n o s i s o f u n c o n t ro l l e d s e i z u re s a n d i n p re p a r a t i o n f o r
e p i le psy sur ge r y. T h e e p i l e p s y m o n i to ri n g uni t (EM U) i s where c onti nuous v i deo EEGs are perform ed. The
vide o re c ords t h e p a ti e n t’s p h y s i ca l a cti vi t y , i nc l udi ng s ei z ures and what happens i n the moment s bef ore
a nd a f t e r se iz u re . S i mu l ta n e o u s l y wi th th e v i deo rec ordi ng, the EEG rec ords brai n ac ti v i ty . Both video and
E E G inf or m a t io n a l l o w p h ys i ci a n s to p i n p o i nt the ty pe of s ei z ure that i s oc c urri ng and prec i s el y l ocat e t he
sourc e . On t he o n e h a n d i t i s n e c e s s a ry to keep the pati ent as c l os e as pos s i bl e i n the foc us of the video
to se e a lso, f o r e xa m p l e , s ma l l mu s c l e twi tc hes ; on the other hand the pati ent s houl d al s o have t he
fre e dom t o m o v e a ro u n d i n th e p a ti e n t ro om.
For t his pur pos e to d a y ’s v i d e o E E G s y s te m s us e pan-ti l t-z oom c ameras that are manual l y c ontrolled by
m e dic a l st a ff , wh o a re u s u a l l y i n ch a rg e of c onti nuous l y c ontrol l i ng the c amera to keep the pat ient in
fo c us w hile a t th e s a me ti m e o b s e rv i n g E E G ac ti v i ty for di agnos i s . H owev er, manual c amera c on t rol and
vide o m onit or in g o v e r a l o n g e r p e ri o d o f ti me i s ex haus ti ng and l owers operator’s attenti on.
To ov e rc om e t h i s p ro b l e m , a n i n n o va ti v e a utomated pati ent trac ki ng s y s tem has been des i gned an d develope d t oge t he r wi th N I HO N K O H DE N , wh i c h c ons i s ts of a two-c amera s etup c onnec ted to the F ra unhof er
I O S B A ut oTr a c k ® p a ti e n t tra c k i n g s o ftwa re.
The system concept
The AutoTrack® software is responsible for real-time processing of video streams from all
cameras available for monitoring as well as for automatic camera control.
The typical camera setup consists of two cameras: a static overview camera and a pan-tilt-zoom
camera. The static wide-angle camera provides an overview of the entire monitoring room,
while the pan-tilt-zoom camera is used for active high-resolution patient observation. Both
camera streams are processed independently by dedicated video processing modules, which
Contact:
Dr.-Ing. Eduardo Monari
Phone +49 721 6091-411
[email protected]
76 Business Unit Security
are able to detect and localize the observed patient.
Manual Camera
Control (GUI)
Visualization
AutoTrack System Core
(3D position multi-camera tracking and
ptz camera control)
Camera
Control
API
ptz
camera
control
Video
Analytics
VideoAnalytics
VideoAnalytics
multi-feature
patient detection
& 3D-localization
Optional
additional camera
2
3
1 MXT badge – a visual tag developed by the Fraunhofer IOSB.
2 AutoTrack system concept.
3 AutoTrack prototype user
interface.
Detection is performed based on color appearance features and by the use of visual tags
Principal / Project partner
(IOSB MXT badges), which are fixed to the monitored patient’s clothes. MXT badges (Fig. 1)
Nihon Kohden Europe GmbH
are defined visual patterns which can be identified and localized in image data reliably and very
quickly, even under adverse lighting conditions (e.g. low light, low contrast, or low resolution).
Project execution
One unique feature of the AutoTrack system is its ability to track the patient in the monitoring
M.Sc. Sascha Voth
room in 3D space, instead of tracking in video (pixel coordinates) only. This approach allows
Dr.-Ing. Eduardo Monari
®
a higher scalability of both the camera network and camera mounting positions. Since the
images from each camera are processed by independent video processing modules, and position
information is exchanged between modules based on a common 3D coordinate system,
camera control can be performed by any available camera in the network.
Furthermore, MXT badges can be identified by an integrated code (ID number). These IDs
are used to distinguish between patients in the same monitoring room and to avoid mix-ups
during automated tracking.
From prototyping to product
In 2013 the AutoTrack® system prototype has been evaluated by medical technicians at Heidelberg University Hospital (Universitätsklinik Heidelberg). After proof of concept and user-oriented
software optimization the AutoTrack® software has been presented to the public and end-users
at the MEDICA Düsseldorf Trade Fair, and at the AES (Annual Meeting of the American Epilepsy
Society) in Washington D.C. with big success and very positive market feedback.
In the near future integration of the AutoTrack® software into Nihon Kohden EEG products
is planned.
Business Unit Security
77
S e c u r e C o mm u n i c a t i o n
Architectures
www.iosb . frau n h o fer.d e / S K A
CyphWay – The one device for secure
communication
T he use of m ob i l e te rm i n a l s s u c h a s n o te b ooks , tabl et PC s , and s martphones are of i nc reas i ng s i gnif icance
toda y . U sua lly th e s e e ffi ci e n t te rmi n a l s p ro v i de i mmedi ate ac c es s to the I nter net and to an organ izat ions’
i nt r a ne t . In pa rti c u l a r th ro u g h th e i r mu l tif unc ti onal i ty tabl et PC s and s martphones are bec omi ng a lucr ativ e t a r ge t of in d u s tri a l e s p i o n a g e . A cc o rd i ng to a s urv ey on i ndus tri al es pi onage c onduc ted by Cor por at e
Tr ust in 2012 [ 1 ] th e i n c re a s i n g u s e o f ta b l et PC s and s martphones i s , at 63.7 perc ent, ranked num ber 1
in development efforts, thereby presenting an increasing risk of know-how leakage for German enterprises.
The security of several of these terminals is, however, highly controversial. To ensure data
security, various cryptographic methods are used. Since these terminals are used to output
data to humans via a user interface, a continuous encryption of the transmitted data is not
possible. Leakage of any single item of data cannot, therefore, be fully prevented. However,
the loss of control over a large set of sensitive data is much more problematic than the loss
of single data sets. This may occur, for example, if the used encryption keys are obtained by
an adversary.
This is where CyphWay, developed at Fraunhofer IOSB, comes in. CyphWay protects keys
through encryption. Decrypted keys are available only within specially developed, trusted
hardware modules that are separate from the mobile device. These modules also perform the
task of encrypting and decrypting the data and keys. CyphWay has a modular structure and
permits the use of different communication media, such as USB or Bluetooth. It can therefore
be used within different scenarios and for different terminals – from smartphones to desktops,
for data clouds to end-to-end communication – without the need for intermediate servers.
CyphWay can be easily adapted to new requirements, such as new methods or data security
requirements, by simply customizing its modules.
An intelligent key management system (part of which has been published in [2]) prevents data
being decrypted when a mobile terminal is attacked. Combining safety-critical components
(i.e. the encryption and decryption functions), and the key management system in a trusted
hardware crypto module guarantees the best possible protection of sensitive data.
Contact:
Dr. rer. nat. Andreas Jakoby
Phone +49 721 6091-534
[email protected]
78 Business Unit Security
1
2
1 Encryption of a data record.
2 Visionary design of
CyphWays.
CyphWay consists of the three following components:
Project execution
1. the trusted hardware crypto module
Dr. rer. nat. Andreas Jakoby,
2. the communication module
Dimitri Helwig
3. the integration module
The integration module is implemented directly on the terminal. Depending on the terminal’s
design and capacity the communication module, too, can be implemented on the terminal.
The trusted hardware crypto module, in contrast, must be physically separate from the
terminal. To verify authorization, users have to authenticate themselves at both devices – the
terminal and CyphWay.
Message encryption consists of the following steps (see Figure 1):
1. The terminal sends the unencrypted data to CyphWay (using protective mechanisms of the
appropriate near-field communication channel)
2. Using the key management system CyphWay determines the required key.
3. The data is encrypted on the trusted hardware crypto module.
4. CyphWay sends the encrypted data to the terminal.
5. The terminal sends the encrypted data to its destination using the appropriate wide-field
communication channel.
Decryption takes place in the same way
Secure end-to-end communication, for example via SMS, e-mail, or online chat
The data sets are encrypted by sender’s CyphWay before transmission and decrypted by the
recipient’s CyphWay after receipt of the data. All data traffic between the terminals is encrypted.
The integrated key management system ensures that only authorized receivers can decrypt these
messages. Eavesdropping on the communication is therefore doomed to fail.
Secure data storage in the cloud
Data encrypted with CyphWay can be stored in the cloud. The encryption protects these
data from access by unauthorized parties. As in the previous use case the integrated key
management system guarantees that only authorized parties can decrypt the data. Sensitive
information can therefore be provided for authorized persons even if senders and recipients are
not active at the same time.
Literature
[1] CORPORATE TRUST, “STUDIE:
Industriespionage 2012,“ 2012.
[2] Jakoby, A.; Müller, W.; Vagts, H.:
“Protecting Sensitive Law Enforcement Agencies Data - Data Security
in the Cloud,“ in International Conference on Cyber Warfare and Security (ICCWS 2014), West Lafayette,
Indiana, USA, 2014.
Business Unit Security
79
Core Competence
Optronics
Core Competence
Optronics
Optronics (OPT)
substitute for real-life scenes. Using a computer process the
templates are degraded to the extent that the resulting image
most closely resembles the image that the thermal imaging
Competencies and portfolio
device being simulated would show of the scene.
The Department of Optronics (OPT) develops methods for
New device concepts are being analyzed and assessed with
experimental and model-based performance evaluation and for
IOSB_SITOS(S). For this purpose 3D scenes (simulation model
optimization of passive and active optronic systems. Laboratory
IOSB_SITOS(D) for dynamic applications) are also generated,
evaluation systems are being developed for infrared detector
and visual simulations to evaluate the performance of imaging
mosaics, thermal imaging equipment, image intensifier tubes
sensors conducted.
and laser sensors, taking into account perturbation and hardening. Theoretical work related to novel evaluation methods
The use of laser sensors is often limited by the safety require-
and variables have resulted, among other innovations, in new
ments associated with laser equipment. To estimate the hazard
analytical range models and imaging simulation models.
range of the laser sensor, the degree of reflection of the laser
radiation from the investigated object must also be known.
Our thermal range model IOSB_TRM4 allows a calculation of
Both modeling and numerical calculation of the reflection
the performance of scanning and rigid thermal imaging devices,
behavior of laser radiation on surfaces that are subject to
and cameras in the NIR and SWIR spectral range. IOSB_TRM4 is
statistical fluctuations – such as water surfaces – present
being continually adapted to current requirements and equipped
a particular challenge. For this purpose the dynamic water
with new features: Currently it is being extended for thermal
surface model IOSB_WOM has been developed.
bolometer cameras.
Novel sensing methods and components are being developed
For image simulation of IR sensors in static applications, the
and implemented in laboratory samples. They include gated
simulation model SITOS(S) has been developed. This can be
viewing cameras and laser radars with heterodyne detection
used to simulate real-life scenes from a thermal imaging device.
for determining 2D and 3D laser reflection signatures, and 2D
The simulation uses high-quality IR image templates as a
vibration signatures for target classification over long distances.
1
82 Core Competence Optronics
2
Head of department:
Dr. rer. nat. Dipl.-Chem. Helge Bürsing
Phone +49 7243 992-446
[email protected]
www.iosb.fraunhofer.de/OPT
To obtain the 2D vibration signature, the laser beam scans
1 , 2 Gated-viewing exposure
the target in X and Y direction. For each measuring point a
of a ship, using the sliding-gate
frequency analysis is performed. If the target vibrates (e.g. a
technique in Figure 2.
running drive unit) a micro Doppler shift is imprinted onto the
3 Dual-color image processing
laser beam. This allows vibrating targets to be located through
(MW, medium-wave; LW, long-
partial obstructions (vegetation, fog, camouflage nets, etc.) to
wave).
analyze their vibration behavior. From the findings conclusions
4 Image simulation for evalua-
about the motorization of the objects can be drawn and their
tion of IR camera performance.
geometric shape partially reconstructed.
In addition, concepts for the protection from laser radiation
are being developed for optronic sensors, with a particular
focus on protection against laser dazzling.
3
Projects
• Laser radar demonstrators and methods for target
classification
• Use of laser vibrometry for remote diagnosis of mechanical
structures
• Analytical calculation, modeling (IOSB_TRM4), and experimental verification of the range performance of imaging
sensor systems (passive and active) in the spectral range
from UV to thermal infrared for military and civilian tasks
• Experimental performance evaluation of passive and active
optronic sensors
• 3D scene generation and image simulation for performance
4
evaluation of imaging sensors (IOSB_SITOS(D))
• Eye protection against laser radiation
(protection from dazzle and injury)
• Influence of and protection from laser radiation on
optronic sensors
• Propagation phenomena of ultra-short laser pulses
(femtoseconds) in atmosphere and in optical materials
• Investigations on the use of laser radiation in maritime
environments using a water surface model IOSB_WOM
• Development of laser safety concepts
Core Competence Optronics
83
Signatorics (SIG)
Competences and Portfolio
The competences of the department SIGNATORICS
Within the department, research is also being carried out on
(SIGNATORIK – SIG) focus on the following areas:
the use of warning sensors in the civilian settings. On the one
hand, research projects in the area of signature management
• Warning sensor technology
conduce to change and/or reduction of the owned signature
• Signature management
and thus to the reduction of discoverability. On the other
• Environmental limitation
hand, possible adverse camouflage and deception measures
are also being evaluated. Both, ground- and air-based meas-
The activities comprise, amongst others, performance
urement methods are developed and deployed in aircrafts
optimization of electro-optical technology in the atmospheric
and helicopters within the scope of complex field trials over
environment (from ultraviolet to the infrared spectrum),
land and sea. Relevant material and system properties are
as well as development and improvement of signature
identified with the help of innovative laboratory and field
management measures.
measurement systems and are used in numerical simulations
for signature evaluation.
One of the core research themes within the field of warning
sensor technology, beside the characterization of the envi-
An essential subtopic within all research areas of the depart-
ronment and the backgrounds, is information gathering on
ment is the analysis of atmospheric effects on electro-optical
the signatures of potential threats. Warning sensor systems
systems. As far as suppression of environmental effects is
are developed for diverse threat scenarios.
concerned, the department makes use of a comprehensive
database on limiting factors, like atmospheric refraction and
turbulence, acquired over the past years. These measurements
are the basis for evaluation of atmospheric effects on sensors,
1
with the objective of achieving optimum compensation for
such effects.
84 Core Competence Optronics
Head of department:
Dr. rer. nat. Karin Stein
Phone +49 7243 992-114
[email protected]
www.iosb.fraunhofer.de/SIG
1 Holographic wavefront
sensor assembly.
2 MWIR radiance distribution
(color-coded) of a research vessel.
3 High-performance spectroWork within the department focuses on the following
meter assembly.
topics:
• Innovative warning sensor technology for the military and
civilian sectors
• Designing sensors for satellite-based monitoring systems
• Measurement of atmospheric parameters and development
of corresponding compensation methods
2
• Application of adaptive optics and software-based
methods for image correction
• Development, testing, and evaluation of multi-spectral signature management approaches and deception measures
• Laboratory experiments and field trials in maritime and
terrestrial environments with passive and active sensors
• Identification of optical properties of materials within the
full spectral range
• Design of analytical models and numerical simulations for
radiation transport and propagation processes in maritime
and terrestrial scenarios
3
Core Competence Optronics
85
Visual Inspection Systems (SPR)
Competences and portfolio
The Visual Inspection Systems (SPR) department develops
The department operates an image exploitation center and a
and delivers systems for automatic visual inspection tasks
cross-application multi-sensor lab with experimental apparatus
in industry. The main areas of application are currently the
for process clarification as well as development systems for a
automatic sorting of bulk goods in recycling, mining and the
variety of application areas. On the “multispectral workbench”,
food industry (e.g. waste glass, metals, gold, diamonds, tea,
materials can be inspected within the frequency range from
herbs, coffee, grains, and seed), the inspection of surfaces
ultraviolet (UV) up to and including near infrared (NIR) in order to
for defects (e.g. paint coat inspection), the inspection and
obtain optimal decision-making criteria for the inspection task.
characterization of transparent materials of all shapes (e.g.
Such “hyperspectral imaging” experience is directly linked to the
flat glass, headlight glass, and sunroofs), color measurement
work group for multispectral data analysis coordinated by SPR.
of granulates and inspection of blister packs.
Projects and products
All these applications are characterized by the fact that the
inspection is performed at high throughput rates inline with
the higher-level process, which thus calls for high-performance
image exploitation systems. The imaging sensors are used
for high-resolution line scan cameras of various types (color,
grayscale, UV, and imaging NIR), 3D area array scanners or
laser scanners. The image acquisition equipment is individually
tailored to the specific task at hand, making particular use of
folded beam paths and LED flash illumination.
• VisioChromHR: Image exploitation system for automatic
inspection of tablet blisters
• Clarity: Image exploitation system for automatic sorting
of waste glass shards
• ClarityHR: Image exploitation system for automatic sorting
of heat-resistant glass
• ClarityLead: Image exploitation system for automatic
sorting of lead-containing glass
• Minexx: Image exploitation system for automatic sorting
The system platform for solving application tasks consists
of standard PCs based on the PCIexpress bus under the
Windows 7 and Windows embedded OS. The system’s high
processing power is achieved with specially developed plug-in
cards for the PCIexpress bus. Together with a real-time system
of algorithms for the capture and exploitation of images,
this platform is at the core of the delivered application systems.
of minerals
• GemStar: Image exploitation system for automatic detection
of diamonds in granulated rock
• FoodControlHR: High-resolution image exploitation system
for automatic purification of tea, herbs and dried vegetables
• CoffeeControl: Double-sided image exploitation system for
automatic sorting of coffee
• WheatControl: Image exploitation system for automatically
The department’s products are used in industrial applications
around the world. Partnered companies are responsible for
marketing and service. In some cases, however, the department
develops directly for end users and takes care of installation
and service in the process.
86 Core Competence Optronics
cleaning grains
• GranuControl: Image exploitation system for automatic
sorting of plastic granulates
• SpotInspect: Image exploitation system for automatically
detecting contamination in a material flow
Head of department:
Prof. Dr.-Ing. Thomas Längle
Phone +49 721 6091-212
[email protected]
www.iosb.fraunhofer.de/SPR
• Purity: Image exploitation system for detecting defects as
air bubbles or inclusions in arbitrarily-shaped transparent
materials (e.g. flat glass, curved glass, lentils, or granulate)
• Purity tension: Image exploitation system for detecting
defects and measuring tension in arbitrarily-shaped
transparent materials
• MultiScan: Image exploitation system for automatic detec-
• Sliding tables with a variety of different lighting fixtures for
image acquisition
• Experimental systems for sorting bulk goods (each equipped
with a camera and blow-off device) in various configurations
as a belt sorter, sorter with chute and free-fall sorting
• Measurement stations for inspecting surfaces
• Measurement setup for 3D inspection
tion of defects and for evaluating texture, color and luster
• Test system for transparent materials
of industrial goods (e.g. tiles, base plates, coated steel belt,
• Multispectral workbench (240 – 2500 nm)
or copper laminates)
• Lab equipment for material characterization
• ColorControl: Image exploitation system for automatically
• Sorting container for fast prototype production
identifying the color of granular products (e.g. synthetic
granules)
The methods used for image exploitation permit evaluation
of shape, texture, color, luster, material signature and 3D
Infrastructure and equipment
characteristics of the specimens.
Image exploitation systems for industrial visual inspection are
application-specific or customer-specific. This is why almost
all research projects start with the question of whether the
respective task can be solved at all using an image exploitation system. After that, the limits of the recognition capacity
are determined. Eventually, an estimation of the resource
requirement for system realization is performed. Satisfactory
answers to these questions can be obtained only through
experiments, which tend to be costly and time-consuming.
The image exploitation center and the cross-application
multi-sensor lab of the IOSB were set up for the purpose of
experimental procedure clarification with, if applicable, the
involvement of other IOSB departments and the KIT research
group. The image exploitation center and the multi-sensor lab
offer numerous facilities for image acquisition and exploitation.
In addition to cameras and lighting equipment, they include:
Core Competence Optronics
87
Core Competence
System technologies
Core Competence
System technologies
Energy (NRG)
Expertise and portfolio
The German and European energy supply is facing major
EMS-EDM PROPHET® - Development
challenges: Renewable energy is only one aspect of the
• Software solution EMS-EDM PROPHET®
current structural changes to the energy system. Energy
• Implementation of forecast and optimization methods
efficiency and cross-cutting issues such as electric mobility,
• Support of market regulations (MaBiS, KoV IV)
power analyzes, forecasts, virtual power plants and energy
• Open, cross-system IT architecture
storage are gaining importance through the interconnected
• Scalable, high performance client/server development
european power system. Fraunhofer IOSB-AST, department
energy, has in all these areas extensive knowledge which is
Energy systems
applied in various projects over fifteen years.
• Grid simulation and network planning
• Smart grids
In the industrial sector, the software solution EMS-EDM
• Optimal system management and adaptive grid protection
PROPHET is successfully represented in the German and
• Grid integration, energy storage and e-mobility
Turkish energy market by major partners such as Compello
• Safe IT infrastructures for smart grids
®
GmbH and BTC AG. Here topics such as energy and energy
data management are at the forefront. In 2013 EMS-EDM
Energy business and system analysis
PROPHET became certified by TÜV within a project with
• Liberalized energy markets and business models
Dow Olefinverbund GmbH.
• Market processes and communication
®
• Smart metering
In energy research, more foreward-looking issues like demand
• Energy economic analysis
response and demand side management, energy storages,
• Development of forecast and optimization methods
wind power forecast technologies or the integration of
renewable energy into the power grid are explored.
Energy technology components and equipment
• System engineering and small producer
The department energy consists of five working groups:
• Components for efficient energy usage
EMS-EDM PROPHET® - Engineering
• Decentralized energy storages / grid protection components
• Project management
• Automation device / safe IT components
• Demand and feed-in forecast
• Procurement optimization in liberalized markets
• Optimization of energy processes
• Accounting grid and network utilization management
9 0 C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s
Head of department:
Dr.-Ing. Peter Bretschneider
Phone +49 3677 461-102
[email protected]
www.iosb.fraunhofer.de/AST
1 Smart charging methods for
E-Mobility.
2 SuperGrid - meshed HVDC
Tasks and projects
grids in Western Europe and
North Africa.
• ADELE ING - Adiabatic compressed-air energy storage
(CAES) for electricity supply (BMWi, Energy Storage
Funding Initiative)
• Energy storage study for medium and low voltage power
grids (Thuringia energy and GreenTech-Agentur (ThEGA)
• Gesteuertes Laden 3.0 managed by BMW AG (BMWi)
• Smart Region Pellworm managed by E.ON Hanse AG
(BMU, Energy Storage Funding Initiative)
1
• ICT energy lab - research and development platform for
analysis and development of IuK technologies for centralized
and decentralized intelligent energy supply systems and
training center for EMS-EDM PROPHET®
• EMS-EDM PROPHET® - energy management with forecast
and optimization as well as energy data management for
liberalized energy markets
• SuperGrid - The future power highway - analysis of a
meshed high-voltage direct current transmission grid in
Western Europe and North Africa (Fraunhofer Society)
• Hybrid urban energy storage - regional grid balancing with
virtual energy storages (Fraunhofer Society)
• Demand analysis energy storage (BAES, BMWi)
• sMobiliTy - development of a cloud-based system and
2
service platform for electric mobility (BMWi)
• REM 2030 - Regional Eco Mobility 2030
(Baden-Württemberg, Fraunhofer Society)
• EBUS - Implementation of an e-mobility concept in the
Thuringian tramway cities, including vehicle technology,
infrastructure and energy supply, Working group 2:
Concept study for a town-wide power supply system for
the operation of electric buses in Thuringia (Ministry of
Construction, State Development and Transportation)
• EnEff:Stadt / EnEff:Wärme - Concomitant research (BMWi)
C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s
91
Water and Mobile Systems (WMS)
Expertise and portfolio
The department water and mobile systems is engaged in the
field of holistic and integrated consideration of water supply
• Modeling, simulation and optimization of surface water
systems
systems, the development of embedded systems, assistance
• Flash flood warning systems
systems, and autonomously driven land and underwater
• Water demand forecast
vehicles. The department is split into three working groups:
Tasks and Projects
Embedded systems
• Integration of embedded systems
• Embedded control and regulation systems
• System design and modules for autonomous vehicles
• Hardware integration
• AVATARES: autonomous test platform for proving and
evaluating driver assistance systems (ARIES Ingeniería Y
Systemas S.A.)
• ServiceAssist software adaptation: maintenance software
• Guiding systems for vehicles
for electric wheelchair systems (Otto Bock mobility
• Maintenance and diagnostic systems
Solutions GmbH)
• Sensor data fusion and simulation
• Z60 controller hardware: development of a mechatronic
concept to test and evaluate new additional operating sys-
Water supply and wastewater treatment
• Drinking water abstraction
• Drinking water treatment
• Drinking water distribution
tems for wheelchairs (Otto Bock Mobility Solutions GmbH)
• OTHELLO: development of a mobile household assistant for
people with limited mobility
• KLARA: development of a personal handling assistance to
• Reservoir and dam systems
support tasks like grabbing, giving and depositing of low
• Wastewater collection
weights through semi-autonomous functions
• Wastewater treatment
• Sludge treatment
• Recycling of wastewater
• Test software for ultrasonic device: special real-time software
for inspection systems to characterize ultrasonic transmitters
• SYTECH: Wiring loom fabrication: consulting project about
automation solutions for flexible fabrication of wiring looms
Maritime systems and surface water
• Additional Bluetooth module: concept and implementation
• Simulation and guiding software for underwater vehicles
of a module which can be integrated into the control unit
• Design, engineering and construction of underwater
of a wheelchair to control electronic devices (Otto Bock
vehicles and compression-proof modules
• Virtual test environment for simulation of mobile systems
and evaluation of vehicle guidance strategies
• Control functions for the automated inspection of
underwater infrastructure, sea cables and pipelines
9 2 C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s
Mobility Solutions GmbH)
• Maritime systems and surface water
• HAPPI: small hydro power plant – evaluation of the
potential of climate protection and improvement by
intelligent technology
Head of department:
Prof. Dr.-Ing. habil. Thomas Rauschenbach
Phone +49 3677 461-124
[email protected]
www.iosb.fraunhofer.de/AST
1 Module based guidance systems for autonomous vehicles.
2 Mission of the TIETEK AUV.
• 4D project DeDAvE: development of a deep-dive-able
autonomous underwater vehicle for exploration
• INAPRO: innovative model- and demonstration-based
water management for resource efficiency in integrated
multi-trophic agriculture and aquaculture systems
• MoMo II: Integrated Water Resources Management for
Central Asia: Model Region Mongolia (FONA – Research
for Sustainable Development, BMBF)
1
• ABB Mina Abdullah (Industry)
• Market survey - Twenty20 - Partnership for Innovation
(BMBF)
• EDIT - Pilot system for online monitoring of waterborne
pathogens
• ZIM-ASWA - development of a autarkic system solution
for water and wastewater treatment with on-line process
control in lightweight construction (BMWi)
• ZIM-REWANET - intelligent automation solution for a
resource efficient water supply network management
and high-level tank management in drinking water
supply systems (BMWi)
2
C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s
93
Information Management and
Production Control (ILT)
The objective of the department Information Management
semantic annotation) and the fusion of heterogeneous sensor
and Production Control (ILT) is to develop components and
data to meaningful technical information and decision support
complete solutions for the design, operation and maintenance
(“Fusion4Decision”) enrich our products.
of complex information, control and test systems. Our focus
lies on the application domains of environment, health, risk
In national and international projects we are responsible for
management, resource efficiency, production and security.
the systematic and moderated requirements analysis as well
as for the specification and realization of service-oriented and
On the basis of agile methods in requirements analysis, sys-
event-driven architectures (SOA/EDA).
tem design and recognized architectural and communication
standards, we implement open, innovative, and customized
We develop thematic applications and connect them to inte-
software solutions, encompassing and driving new para-
grated environmental information systems. Our software frame-
digms of the “Internet of Things and Services” as well as
work WaterFrame® renders data sources accessible and inte-
“Industrie 4.0”.
grates geographical information system (GIS) components as
well as innovative geostatistical methods. WaterFrame® provides
We analyze the suitability of modeling and communication
support in generating thematic maps, diagrams and reports.
methods for:
With the ProVis production suite we realize production control
• Complex manufacturing processes and facilities
system components and integrated solutions according to
(e.g. AutomationML and OPC-UA)
• Environmental sensors and models (SensorML)
functional requirements of MES (Manufacturing Execution
• Environmental observations (geospatial standards of the
Systems). The functions offered by ProVis range from monitoring and managing production facilities up to engineering
Open Geospatial Consortium OGC)
control rooms and the processes of manufacturing control and
We model customers’ domain-specific knowledge with onto-
fine-granular scheduling. This allows us to deploy production
logies (Web Ontology Language OWL). We couple simulators
control systems in automotive production sites and the steel
and models on the basis of the High-Level Architecture HLA.
industry (soaking pit plants), including the engineering and
Our information management system “WebGenesis ” supports
automatic configuration of these systems and development
the ontology-driven generation of Web-based information
tools for Web-based analysis and reporting systems.
®
systems and Web portals with complex cross-linking of
knowledge elements, problem-specific information analysis
We develop and run test systems for selected de-facto stand-
and personalized user interaction.
ards such as Foundation Fieldbus, AutomationML, and HLA.
Our objective is to promote the adoption of standards in the
Our research results regarding smart services for the efficient
market and to support interoperability in open systems. We
search and retrieval in heterogeneous data sets (“big data”),
therefore actively participate in the relevant standardization
the extraction of knowledge with data mining methods (incl.
bodies in VDI/VDE, DKE, DIN, IEC and OGC.
9 4 C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s
Head of department:
Dr.-Ing. Thomas Usländer
Phone +49 721 6091-480
[email protected]
www.iosb.fraunhofer.de/ILT
Products
• WebGenesis® – Web-based information and knowledge
• Environmental Sensor Network INSENSUM
management solutions for applications in the environment,
Dr.-Ing. Siegbert Kunz
traffic and automation sectors and for the documentation
Phone +49 721 6091-600
of research projects
[email protected]
• WaterFrame – Java framework for the development of
®
• Fieldbus Foundation conformance test center
thematic applications and environmental information
Dipl.-Ing. Michael Theis
systems
Phone +49 721 6091-321
• Fusion4Decision – service pattern and software platform
for sensor data fusion and decision support based on OGC
[email protected]
• AutomationML test center
standards
Dr.-Ing. Miriam Schleipen
• ProVis.Agent /Visu – agent-based production control
®
Phone +49 721 6091-382
®
and visualization system for managing and monitoring
automated production facilities
[email protected]
• HLA simulation test center
• ProVis.Paula –production and plant data evaluation system
Dipl.-Inform. Reinhard Herzog
with data mining components
Phone +49-721-6091-294
• ProVis.APS – Web-based fine-granular scheduling system
[email protected]
for continuous optimization of manufacturing schedules
• AutomationML test system – Web-based conformance
testing of AutomationML descriptions, available online at
http://amltest.iosb.fraunhofer.de
• GERTICO – Modeling and service infrastructure for coupled
1 Environment portal and envi-
simulators based on HLA
• SRL – Simulation Resource Library for the documentation
of simulation tools and models
• Network Calculus – methodology for the performance
ronmental information systems.
1
evaluation of communication networks
• ProVis – integration and test facility
Dipl.-Inform. Gerhard Sutschet
Phone +49 721 6091-370
[email protected]
• WaterFrame®– integration and test facility
Dipl.-Ing. Jörg Stumpp
Phone +49 721 6091-259
[email protected]
Hintergrundbild: Rainer Sturm / pixelio.de
Infrastructure
C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s
95
Fraunhofer Application Center
Industrial Automation (INA)
Competencies and portfolio
The Fraunhofer Application Centre for Industrial Automation
The Fraunhofer Application Centre for Industrial Automation
(INA) in Lemgo, which was founded in fall 2009 in the center
is a research institution in the BMBF-Edge Cluster “Intelligent
of East Westphalia-Lippe, one of the most important regions
Technical Systems East Westphalia-Lippe it´s OWL”, which is
in the German engineering industry, pursues ambitiously
currently the largest project in the field of Industry 4.0.
its research vision: “an Internet for Machinery”, in which
real-time information in all levels of an automation system is
Research and development
available and can be used by assistance systems for diagnosis
and optimization. In this Internet for machinery devices and
The Fraunhofer Application Center Industrial Automation
services should be integrated easily by using the plug-and-play
implements publicly funded research projects, works in the
principle. Hardware and software are clearly separated and
area of bilateral contract research, develops software and
functions and data are distributed – a cloud for automation
hardware prototypes and designs test and hedging solutions.
emerges. Microelectronics, software technics and system
engineering in conjunction with application knowledge from
Areas of application are industrial IT, automation techniques,
the automation provide the core competencies. Thus, imme-
the machinery and equipment manufacturing and related
diately applicable results for IT-based automation products
sectors.
and systems can be offered. Target groups are producers of
hardware and software for automation, machine and plant
Currently our work is based on the following priorities:
manufactures and operators of technical systems. There the
main focus of the INA lies on the provision of required system
Cognitive processes for the automation:
engineering for automation, to be able to capture, connect
and intelligently process information easily. This includes
In this working group, the development and use of computer
the microelectronic implementation of embedded system
models to support the life cycle of complex automation
functions.
systems is the focus of our activities.
Since 2010 INA is a partner of the Centrum Industrial IT (CIIT).
This includes per example:
The CIIT, which is based on the Campus of the University
of Applied Science East Westphalia-Lippe, is Germany’s
• Data collection in distributed systems
first Science-to-Business Center in the field of automation
• Modeling of technical systems (machine learning)
technologies. Under the motto “Where IT meets Automation”
• Real-time forecast of technical systems with the goal of
science and industry has established an open partner network
self-configuration, -diagnosis and -optimization, condition
and develop technologies for future IT-based automation
monitoring
techniques under one roof.
9 6 C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s
Head of department:
Deputy Head of department:
Prof. Dr.-Ing. Jürgen Jasperneite
Prof. Dr. rer. nat. Oliver Niggemann
Phone +49 5261 702-572
Phone +49 5261 702-5969
[email protected]
[email protected]
www.iosb-ina.fraunhofer.de
www.iosb-ina.fraunhofer.de
Embedded Systems for the automation
focuses on the mapping of all information-processing procedures and information- and communication-technologies
This field summarizes our capabilities and activities in the
from the control level up to the sensor. It is a hybrid technical
development of innovative automation technologies, which
process, ie the plant contains both - continuous and discrete
are integrated by our partners in their products.
process elements. This offers an ideal proving ground for the
testing and validation of innovative technologies and products,
• IP core development (VHDL, Verilog) for system-on-chip
solutions (ASIC, FPGA), including verification
• Intelligent networking, for example, based on real time
Ethernet and Industrial Wireless
as well as for their interaction. Since the end of 2013 the
Lemgo Model Factory is part of the German-wide first intersite production network, which includes plant in Karlsruhe
and Ilmenau.
• Middleware solutions (e.g. OPC-UA)
• Design and implementation of embedded real-time systems
Lemgo Model Factory (LMF)
In the CIIT, Fraunhofer Application Centre together with
its partner institute InIT – Institute for Industrial IT of the
University of Applied Science OWL, operates the Lemgo
Model Factory (LMF), as a research platform for IT-based
automation. The complexity of design, commissioning and
operation of technical systems increases due to increasingly
higher demands. Therefore design, commissioning and
operation of technical systems become time-consuming and
error-prone. The automation technology in use today lack
mechanisms for self-configuration, self-optimization and selfdiagnosis, ability to face this progress and to suitable support
the people. The impact of industrial IT in making technical
systems in production processes more intelligent can already
can be seen in the Lemgo Model Factory. The Model Factory
is a production plant in the laboratory scale, in which real
actuator, sensors, bus systems automation components and
software of different vendors are implemented. The LMF
C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s
97
Systems for Measurement,
Control and Diagnosis (MRD)
Competencies and Portfolio
• Control and feedback control techniques
--Model predictive and structure-variable control for appli-
The acquisition and evaluation of sensory and other data plays
a crucial role in many applications: in industry, sensory data,
together with process models, establishes the basis for obtaining high-quality, universal functionality of products as well as
facilitating an optimal productivity of production facilities.
cations in process engineering, robotics, transportation
and traffic engineering
--Process control using data-driven models
--Control using imaging sensors (visual servoing)
• Data analysis for technical processes
--Development, adaptation and application of methods for
A full understanding of the processing chain – from data
acquisition through processing and evaluation to optimization
or feedback into the process, and always considering the
classification, machine learning, and data mining
--Generation of structure hypotheses, and analyses of
causality
dynamics and other characteristics of the process – is essential
--Performance and condition monitoring
also for other fields of application, such as environment
--Anomaly detection
processes, robotics, traffic and civil security. In this context
the Systems of Measurement, Control and Diagnosis (MRD)
department offers the following core competencies:
--Diagnosis (e.g. to identify cause-effect relationships)
• Information fusion
--Multisensor fusion
--Dynamic information fusion using heterogeneous sources
• Modeling and simulation
--Analytical, knowledge-based and data-driven modeling
--Block-oriented and finite element models
(e.g. using Matlab / Simulink, COMSOL)
--Model reduction and parameter estimation
(e.g. of finite element models for material and heat flows)
--Modeling, simulation and image synthesis for imaging
systems (e.g. under water, using deflectometry)
--Applications in process engineering, ground water,
biotechnology, automated visual inspection and robotics
• Measurement and sensor techniques
--Optical and imaging measurement techniques
--Automated microscopy
--Deflectometry and other image-based surface inspection
methods
--Tailored solutions for special applications of common
measurement techniques (e.g. laser triangulation in pipes)
9 8 C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s
(e.g. for environmental warning modules)
--Fusion of image and geometry data (e.g. for pipe
inspection, mobile robots, and surface inspection)
• Robotics
--Environment-interactive trajectory planning and
manipulation, also in cooperation with humans
--Simultaneous localization and mapping (SLAM),
also using multiple sensory sources
--Localization, path planning and control, also for
cooperating mobile robots
--Detection of (dynamic) obstacles
--Control of complex kinematics in mobile robotics
--Robot control based on ROS middleware
• Image and signal processing
--Real-time image and signal processing, suitable for
industrial needs
--Texture analysis
Head of department:
Dr.-Ing. Michael Heizmann
Phone +49 721 6091-329
[email protected]
www.iosb.fraunhofer.de/MRD
--Defect detection on surfaces (e.g. using adapted features
--Energy monitoring and optimization for home applications
(e.g. coordination of heating and ventilation)
and classification methods)
--Generation of 3D data (e.g. using deflectometry, sidescan
sonars, stereo cameras and other reconstruction methods)
• Environment and resources
--Quality control for water supply systems and waste
water disposal
--Processing of 3D data (measurement data and reconstruction results)
--Early-warning systems for severe weather events
(e.g. landslides)
--Image processing for applications in robotics
--Use of computer graphics for automated visual inspection
--Multisensor inspection systems for water pipes and
sewer ducts
Applications and projects
• Monitoring, control and optimization in process engineering
(e.g. chemical and biotechnological processes)
--Mass flux management (for water and soil)
• Security
--Security for drinking water supply (including sensor
--Model-based control in process engineering
(e.g. for glass drawing and biotechnological processes)
--Tools for online process monitoring
systems and management systems)
--Surveillance of buildings and assets
--Reconnaissance in emergencies (e.g. mapping and localiza-
--Monitoring of wind energy plants
tion for assistance robots; detection of victims
• Quality and productivity assurance for process and
and hazard sources)
manufacturing engineering
--Robot-based exploration
--Optimization of production processes and products
--Mine clearance in former conflict areas
(e.g. for glass drawing processes and crop drying)
--Tools for evaluating process and product data
--Surface inspection (e.g. for painted, specular and
textured surfaces)
• Sensor systems
1 Deflectometric inspection of
--Sensor development and adaptation for special applications
(e.g. pipe inspection)
--Image-based sensor systems for surface inspection
a car body part.
1
--Systems for underwater applications
--Automated microscopic inspection
• Robot systems
--Service robots (e.g. for home applications)
--Mobile assistance and inspection robots
--Applications of robotics in logistics and production
--Robots for security applications
--Agricultural robotics (e.g. for precision farming)
--Processing of sensor data for unterwater robotics
• Assistance systems
--Assistance for efficient mobility (individual mobility
and logistics)
C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s
99
Secure Communication Architectures
(SKA)
For companies, communication services that function properly
Cyber security
are crucial to their survival. This includes globally networked
Security is a continual process that is essential for maintaining
locations, reliable, low-maintenance solutions, as well as
the effectiveness of necessary technical measures. The loss of
protected critical infrastructures for production, energy supply,
sensitive corporate data to unauthorized parties and criminals
and logistics.
is currently one of the most serious security issues. For this
reason we devote as much attention to attacks and vulnerable
Our customers benefit from assured confidentiality and
points as we do to holistic security management that is,
authenticity in communication processes, comprehensive,
accounting for company processes and statutory boundary
individual solutions, reduction of investments through the
conditions.
use of standards, and low personnel levels for network and
security management. Clearly-defined communication and
Data protection in video surveillance
interfaces between IT service providers and customers, and
We address the need for privacy and data economy with
between users and suppliers are a prerequisite for creating a
solutions for monitoring the collection, processing and
continual improvement process.
dissemination of personal data. On a technical level our work
ensures that personal data is used only for the intended
Our work addresses the need for improved assurance of
purpose within the surveillance system.
privacy and data economy, and for support in collecting and
processing personal data. We research and integrate solutions
Watch over me!
for technical monitoring and assuring that data in surveillance
Modern video-supported surveillance systems are capable of
systems is handled in accordance with the intended purpose.
identifying and tracking persons or recognizing situations.
We offer protection concepts for data management and
Our current focus is on secure communication between
processing. Our solution makes it possible to interactively
mobile devices, suppression of unauthorized data loss, video
alert the system through the use of gestures, so that affected
surveillance in accordance with privacy-by-design principles,
parties are able to interact with surveillance systems. We also
usage control in video surveillance, secure parallel operation
provide a video-based return channel from security personnel
of IPv6 and IPv4, private cloud solutions for secure mobile
to affected parties, which can be used to handle emergencies
access, as well as consulting and auditing in accordance with
in medical environments in particular.
ISO/IEC 20000 by certified employees.
Distributed usage control
On behalf of the Fraunhofer-Gesellschaft, we are responsible
Distributed usage control is a generalization of access control.
for WAN communication at the Fraunhofer IOSB for over 150
Data can still be controlled once it has left your hands. In
locations with more than 23,000 employees around the world,
order to allow people to control the dissemination and usage
who rely on our centralized range of services for IT security,
of their data themselves, we conduct research for solutions
e-mail, DNS and remote access.
together with Fraunhofer IESE and TU Munich. In the process,
1 0 0 C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s
Head of department:
Dipl.-Inform. Thomas Kresken
Phone +49 721 6091-273
[email protected]
www.iosb.fraunhofer.de/SKA
we establish the implementation of legal requirements on data
-- Industrie 4.0: intrusion detection in production
provenance and on the protection of intellectual property.
-- KASTEL: IT security center of the BMBF
-- PRECYSE: Prevention, protection and reaction to cyber
An overview of our competences
attacks to critical infrastructures
-- CYSPA: European Cyber Space Alliance
Information security
-- Privacy and security in monitoring systems
-- Confidentiality, authenticity and integrity of data
-- Cloud services providing mobile access for authorities and
communication
organizations responsible for security
-- Protection of critical infrastructures
-- Creation of robust and secure cryptosystems
-- Process-based security management in accordance with
ISO/IEC 27000
-- Intrusion detection (IDS) and prevention (IPS)
Identity protection and management
-- Privacy-by-design and data protection in video surveillance
-- Distributed usage control
1 User interaction with the
-- Acceptance and usability of security and data protection
solutions
surveillance system enables
-- Public key infrastructure (PKI) and planning of trust centers
IT service management in accordance with
transparency.
1
ISO/IEC 20000
-- Auditing and consulting
Resources
-- Cyber security lab
-- IPv6 security lab
-- Privacy-by-design video surveillance
Tasks and projects
-- Social media for companies – who is in control?
-- Secure communication and data exchange between
mobile end devices
C o r e C o m p e t e n c e S y s t e m Te c h n o l o g i e s
101
Core Competence
Image exploitation
Core Competence
Image exploitation
Interactive Analysis and Diagnosis (IAD)
Profile and competencies
The department Interactive Analysis and Diagnosis (IAD)
and calculating large quantities of data. Humans, on the
develops innovative interaction methods, smart environments
other hand, are still superior to computers when it comes to
and assistance systems with the aim of supporting people in
recognizing and interpreting complex structures in images.
various analysis tasks.
The following solutions are currently provided:
On one hand IAD is focused on the development of multimodal interaction within smart environments. The devel-
Multimodal interaction
oped interaction techniques apply mostly to video-based
• Interaction with multi-display environments
interaction methods which cover capturing and tracking of
• Video-based posing and gesture recognition for
human-machine interfaces
persons, recognition of hand pose and pointing gestures,
and analysis of activities within a certain environment using
• Gaze-based interaction for video image analysis
gaze-based interaction and speech.
• Person tracking for interaction and building automation
• Interaction techniques for mobile augmented-reality
On the other hand IAD develops assistance systems, which
support people in the process of decision-making. Application
applications
• Gesture-based interaction for industrial applications
areas are diagnosis of technical systems, image interpretation,
and intelligent surveillance systems. Our concepts take into
Assistance systems
account the strengths of both computer systems and humans.
• Interactive and knowledge-based object recognition
Computer systems are capable of rapidly saving, searching
• Situation analysis for crisis management and security
services
• Setup of geodata infrastructure and software architectures
1
for surveillance systems
• Optical measurement and vibration analysis applied to
wind turbines
The following products and projects are provided:
• SmartControlRoom – An intelligent crisis center including
innovative interaction
• Gaze-based interaction for video image analysis
• Digital Engineering Table DigET – Interactive decision
support for industrial applications
• Digital Map Table including Fovea-Tablett® – A multidisplay workspace for computer-supported collaborative
work on geodata
104 Core Competence Image Exploitation
Head of department:
Dr. rer. nat. Elisabeth Peinsipp-Byma
Phone +49 721 6091-393
[email protected]
www.iosb.fraunhofer.de/IAD
1 SmartControlRoom.
2 Gesture controlled Digital
Map Table.
3 Smart Video analysis.
• RecceMan® – Interactive assistant for object identification
• SiteAnalyst – Assistant for analyzing complex object
arrangements
• Maritime situation assessment for the detection of critical
situations
• ARtSENSE – Interaction techniques for mobile augmentedreality applications
• Vibration analysis of wind turbines with long-distance
2
laser vibrometer
• Image-based pitch angle analysis for wind turbines
• MCMXT – Embedded system for 3D measurement tasks
based on optical markers
3
Core Competence Image Exploitation
105
Interoperability and Assistance
Systems (IAS)
Competencies and portfolio
The department Interoperability and Assistance Systems (IAS)
The work includes the design, implementation and evaluation
offers solutions to the market in which the interaction of
of system solutions for interactive sensor data analysis,
people with complex information systems plays the key role.
knowledge creation and integration of knowledge into expert
In a “system of systems” approach interoperability is vital.
systems to support networked data analysis, the modeling of
users, workflows and application domains, as well as compe-
With research and development projects in the field of soft-
tence management in distributed systems. Laboratory and field
ware architecture for computer-based assistance systems
experiments on demonstrators and operational systems are
with a focus on dialog design and semantic interoperability,
performed to optimize system performance and to evaluate
we contribute to the technical and content networking of
human-machine communication. In addition to developing
systems. By designing dialogs that are adapted to the users
basic system architectures that promote interoperability the
and tasks we promote collaborative work using innovative
department’s product range includes components for interactive
multi-modal and multi-media interaction technologies. With
image analysis, ontology-based specialist databases, network-
ontology-based information systems, web services and intel-
enabled information management systems, and training and
ligent software agents the knowledge needed is distributed
education systems. Compliance with and monitoring of national
on time to the right people through suitable connections to
and international software quality standards is an integral part
personalized end-user devices in a layer-compliant granularity.
of the development activities.
Modern, technology-based learning environments and the
use of “serious games” provide users with the required
Our partners and clients include the German Federal Ministry
decision-making abilities. Providers of knowledge-intensive
of Defense (FMOD), Federal Office for equipment, information
services will be supported in focusing on their core compe-
technology and use of the Armed Forces (BAAINBw),
tencies and creativity.
the defense industry and the European Union. In various
international cooperations experience in the field of imagebased reconnaissance and surveillance is exchanged. In our
research we cooperate with universities, colleges and partner
institutions. Applications are mainly in the fields of defense
and civil security.
106 Core Competence Image Exploitation
Head of department:
Dr.-Ing. Rainer Schönbein
Phone +49 721 6091-248
[email protected]
www.iosb.fraunhofer.de/IAS
1 Interoperability.
Projects and products
Equipment
• Image database – archiving system for the management
• ISVA demonstrator – a hub for national and international
of aerial and satellite images
• Image data management system for aerial and satellite
image analysis in the field of reconnaissance and surveillance
• SAR Tutor – web-based training tool for SAR image analysis
• Crayons – Web-based authoring and learning environment
©
• ViSAR – simulator for visualizing geometric radar effects
• CSD/NSD Coalition/National Shared Database. Client-server
system for distributing reconnaissance-relevant information
secured networks in the field of reconnaissance and
surveillance
• SaLVe – radar image database center: a multi-sensor image
data archive for remote sensing
• AMFIS – reconnaissance and surveillance with miniature
aircrafts in the sensor network (configurable ground control
stations, various UAVs, UGVs and sensors)
(requests, orders, messages, sensor data and products) in
• A mobile ad-hoc sensor network (GPS, imaging and acoustic,
1
vibration, temperature, motion and light sensors)
accordance with STANAG 4559
• MAJIIC – demonstration laboratory (restricted area): Multi-
• ISAAC (ISr Artifact Access Client) Software Suite (.lib, .bat,
sensor Aerospace-Ground Joint ISR Interoperability Coalition
desk, .map, .web) for accessing CSD/NSD servers according to
• DNBL – development laboratory (restricted area): Distributed
STANAG 4559 (NSILI – NATO Standard ISR Library Interface)
Network Battlelab Laboratory for certification and testing
• ISVA – intelligent reconnaissance sensor combination for
networking data, information, services and experts
of components for networked intelligence gathering and
reconnaissance
• I2Exrep – database-supported form-based report generation
for analysis of aerial and satellite images according to
STANAG 3377/3596 and other reporting formats
• DbEd – Data Tree Editor for creation and maintenance of the
1
reporting vocabulary used in image based reconnaissance
• MAJIIC 2 – Multi-INT All-source Joint ISR Interoperability
Coalition
• AMFIS ground control station – Generic ground control
station. AMFIS (reconnaissance and surveillance with
miniature aircraft in sensor networks) for controlling and
coordinating stationary and mobile sensors/sensor carriers,
and for evaluating sensor data and situation reports
Core Competence Image Exploitation
107
Object Recognition (OBJ)
Expertise and Portfolio
The department Object Recognition (Objekterkennung - OBJ)
tion. The field of Heterogeneous Hardware Structures
develops and evaluates algorithms for automatic object
deals with the specification and combination of hardware
detection and object tracking in sensor networks.The
structures suitable for complex real-time vision systems.
department’s activities range from the evaluation of video
streams in the infrared and visual spectral band and the
Especially with regard to military tracking systems, performance
analysis of laser sensor data to the semantic description of
evaluation is an essential topic. Based on years of experience
a three-dimensional, dynamic environment via multi-sensory
the field Tracking and Tracker Assessment deals with the
data acquisition and automatic alerting in case of specifically
development and design of evaluation schemes that interrelate
defined occurrences. In addition, real-time implementations
and evaluate both the performance ability of tracking algo-
of the algorithms are evaluated on the basis of heterogeneous
rithms and the risk analysis, while possible counter-measures
hardware structures.
are taken into account.
The research work in the field of Object Recognition in Sen-
The acquisition and analysis of 3D data is of increasing
sor Networks is focused on the detection and representation
importance in those application areas that require a high
of objects in imagery data streams of interconnected mobile
degree of automation and reliability of object recognition.
sensors. In this context the technologies investigated include
The department’s work in the field of Object Recognition
aspect-independent descriptions of objects, the registration of
in 3D Data is concerned with the development, optimization,
sensor-generated images with three-dimensional context data,
and evaluation of methods for 3D data analysis for use with
and bandwidth-economical transfer of object information.
established sensor techniques as well as prototypical hardware.
In addition to object recognition, data acquired by theses sen-
Video Content Analysis combines methods for the detection
sors is used for detecting changes and for providing context
and tracking of objects in video streams with algorithms for
information for image exploitation.
the conceptual description and analysis of the extracted
quantitative information. The studies aim at devising systems
Selected Projects
for the semantic analysis of videos. This means that videos
are not only analyzed quantitatively, but that the extracted
• THS® - Target Handoff System
information is associated with conceptual background knowl-
• Semantic Video Analysis
edge in order to draw conclusions from the visually perceived
• MODISSA – Mobile Distributed Situation Awareness
environment.
• Change Detection in Lidar sensor data
• VibroTrack – distant vibration measurement on running
Machine vision algorithms extend from simple filtering functions up to complex analysis methods. Currently available
hardware also varies with respect to computing performance,
programming paradigms, architectures, and power consump108 Core Competence Image Exploitation
wind turbines
Head of department:
Dr. rer. nat. Michael Arens
Phone +49 7243 992-147
[email protected]
www.iosb.fraunhofer.de/OBJ
1 Change detection based on
2 The project Semantic Video
two aerial lidar scans: green
Analysis aims at detecting, clas-
color indicates manmade struc-
sifying, and conceptually describ-
tures present in both datasets,
ing events and interrelations of
whereas red and yellow color
events in visually perceivable
indicate vanished or added
scenarios.
structures, respectively.
1
2
Core Competence Image Exploitation
109
Scene Analysis (SZA)
Core Competencies and Portfolio
of transmission bandwidths to the generation of indications
in both single and multiple images (change detection and
Background of the department’s research activities is the
change categorization). The common exploitation of data
demand of intelligence and reconnaissance for the prompt
from a multi-sensor platform (VIS, LWIR, Hyperspectral and
availability of interpretation results with georeference. This
LIDAR) is one of the key features of actual demonstrators
includes both wide-ranging evaluation (screening) and local
or future operational systems. Data fusion and information
3D scene reconstruction, required as a basis for decision making
extraction capabilities are the core competencies for a success-
in the context of military operations and disaster management.
ful exploitation and are therefore one of the department’s
A multitude of powerful airborne and spaceborne systems,
main research activities.
e.g., Heron, SAR-Lupe and TerraSAR-X, deliver data that can
no longer be evaluated by humans due to its sheer volume
Often a scene can be evaluated properly only if its spatial
and the resulting work load. Automatic conditioning and
extent can be determined. Therefore, the Scene Analysis
processing of the data draws the analyzer’s attention to rele-
department develops procedures for the automatic derivation
vant sections, thereby also enabling the efficient processing
of 3D descriptions of urban terrain based on the evaluation
of large data volumes. For a fast and precise evaluation, the
of multi-sensory image data acquired by spaceborne, airborne,
analyzer needs assistance systems that are able to detect,
or land-based reconnaissance systems.
analyze and classify objects and scene changes.
To utilize the efficiency of networked sensor systems, the
The Scene Analysis department develops and studies methods
method of interconnected sensor data evaluation must be
for the automatic evaluation of multi-sensor image data in
designed based on the “system of systems” concept. For
reconnaissance networks. For this purpose efficient procedures
this purpose, procedures are being developed which relate
are being developed for segmentation, classification, scene
the data of imaging sensors to a common reference frame.
reconstruction, change detection, and fusion of a wide range
The potential applications from the fusion of sensor data up
of sensor data. The research focuses on
to a real-time-generated overview of situations are being
analyzed and adequate procedures realized.
• Image interpretation
• 3D object analysis
Only few sensors can acquire evaluable image data, irrespec-
• Cooperative data evaluation in sensor systems
tively of the daytime or current weather conditions. The per-
• Exploitation of Synthetic Aperture Radar (SAR) images
formance of imaging radar systems, with a synthetic aperture
(SAR) is hardly limited in this regard. Because of their phase-
For processing large data volumes, the high-performance sys-
preserving evaluation, interferometric SAR systems are able
tems exploit the micro architecture of current workstations. In
to capture the 3D shape of a scene. Furthermore, by using
the scope of image interpretation the analysis of hyperspectral
time series, minimal surface movements can be detected. SAR
data is of particular importance. Here, methods for the extrac-
images are difficult to interpret by a human due to the specific
tion of relevant information take center stage. Applications
mapping characteristics. Therefore, interpretation support is
range from the pure reduction of data for a better utilization
particularly valuable. SAR image analysis and simulation are
110 Core Competence Image Exploitation
Head of department:
Dr.-Ing. Karsten Schulz
Phone +49 7243 992-106
[email protected]
www.iosb.fraunhofer.de/SZA
1 Evaluation of hyperspectral
sensor data.
2 View on an automatically
therefore among the core competencies of the department,
extracted model of the scene
with a special focus on feature analysis, change detection
„Vaihingen“ with buildings,
and change categorization in SAR data.
vegetation and terrain.
ISPRS Benchmark:
Research work focuses on the following core topics:
www.isprs2012.org/abstract/1113.asp
Image interpretation
• Efficient screening procedures for the analysis of large
1
data volumes
• Structural change detection
• Analysis of hyperspectral image data
• Fusion and exploitation of data from multi-sensor systems
3D object analysis
• reconstruction of 3D objects from image sequences or
laser scanner data
• Automatic derivation of 3D building models from
3D point clouds
• Image-aided navigation
Cooperative data evaluation for networked sensor
systems
• Information fusion of sensor data and geo-information
• Automatic georeferencing of image contents
2
1
• Preparation of sensor data showing urban terrain for
simulation systems
SAR image exploitation
• Feature extraction and analysis, change detection and
categorization
• Simulation of SAR image signatures for interpretation assistance (CohRaSS: Coherent Raytracing-based SAR Simulator)
• Determination of ground heaving or depression by means
of time series
• Model-based building reconstruction from interferometric
SAR images
Core Competence Image Exploitation
111
Video Exploitation Systems (VID)
Competences and portfolio
Tasks and projects
Especially in image sequences pattern and situation recognition
• ABUL – Automatic Image Exploitation for Uninhabited
play a vital part in the fields of disaster management, criminal-
Aircraft: Exploitation of video streams in ground control
istics, homeland security, defense against terrorism, driving
stations. Main systems:
assistance, and industrial quality control. The complexity and
--LUNA drone: UAV-based system for tactical purposes
demands for robustness, reliability, and efficiency of the results
are steadily increasing.
(deployed by the German Bundeswehr in Afghanistan)
--ADS-95 RANGER: UAV-based system for border surveillance
--MiSAR: Exploitation of SAR image sequences
The Video Exploitation Systems (VID) department is active in
--HERON: NATO STANAG 4609 streaming test system
the fields of automatic processing and exploitation of image
--DNBL: Integrated system (connected with PPQ, Airbus
signals in complex, mainly non-cooperative surroundings.
The image data comes mainly from image acquisition sensors
in multi-modal platforms (space, air, land, or water). VID
Defence image exploitation system) for NATO exercises
--SD9.4: Visualization and processing of STANAG 4609
video streams in the SD9.4 net as VM ware application
develops and integrates software for image processing, fusion,
and exploitation for autonomous and human-operated systems.
• VABUL – Video Database ABUL: video database for the
The main sensors to be exploited are visual-optical, infrared,
Swiss Confederation
SAR (Synthetic Aperture Radar), and others. A major aspect
Interactive see-through augmented-reality device:
of our work is the realization of components to be integrated
augmented-reality device with integrated eye tracking
into larger systems. In specific cases we can also develop the
whole system. Further areas of expertise of the department
include interoperability in heterogeneous networks and
• NEST – Network Enabled Surveillance and Tracking: Open
system architecture for multi-sensor property surveillance
application domain knowledge. The use and performance
profile of the developed software are measured by bench-
• Federal Ministry of Education and Research (BMBF):
marking and with test systems. Current activities include the
Video-assisted systems for detecting conspicuous movement
development of components for land vehicles, unpiloted
patterns, attacks and assaults, and abandoned luggage
air systems, autonomous land robots for surveillance, and
security applications. Military applications – the exploitation of
airborne and space-borne imagery – are also being developed.
Another focus lies on developing new methods in the field
of situational awareness and biometrical approaches.
• Federal Ministry of Education and Research (BMBF): Videoassisted system for riot detection
• Federal Ministry of Education and Research (BMBF): Person
detection in forensic mass data
• Federal Ministry of Defense (BMVg): Automatic camouflage
assessment
112 Core Competence Image Exploitation
Head of department:
Dr.-Ing. Markus Müller
Phone +49 721 6091-250
[email protected]
www.iosb.fraunhofer.de/VID
1 Automatic Exploitation of
Aerial and Satellite Image Data.
2 Pose and gaze estimation for
mobile information systems.
• Federal Ministry of Defense (BMVg): Robust tracking of
moving objects from moving platforms in real-time
Federal Ministry of Defense (BMVg): Image and image feature
fusion (e.g. for automatic image stitching with high precision)
• European Union (EU): System for offshore monitoring
(detection of illegal border crossings and, smuggling of
people, weapons, and drugs)
1
• European Union (EU): System for the detection of vehicle
collisions
• European Union (EU): Body identification assistance system
2
Core Competence Image Exploitation
113
Variable Image Acquisition and
Processing (VBV) Research Group
Competences and Research Topics
and planning algorithms, this kind of approach paves the way
for novel applications where traditional methods would fail or
The Variable Image Acquisition and Processing (VBV) Research
not be flexible enough.
Group develops methods and systems for automated visual
inspection that are based on variable image acquisition tech-
Projects
niques, or, more generally, exploit various kinds of heterogeneous information. Multiple theoretical and application-related
• Situation analysis in maritime surveillance systems
issues studied here in close cooperation with the other
• Navigation of autonomous deep-sea vehicles
departments of the IOSB and the Vision and Fusion Laboratory
• Object classification in reconnaissance and surveillance via
(Lehrstuhl für Interaktive Echtzeitsysteme – IES) of the Karlsruhe
imaging sensors
Institute of Technology (KIT) include:
• Dynamic infrared pattern generation for deflectometric
• Holistic systems theory-based modeling of image
• Open adaptive modeling of the environment for artificial
inspection
acquisition and optimization of the evaluation process
• Reproducible acquisition of optimal image series, for
example by variation of illumination, focusing, camera
position and optical filters
• Fusion of data from the image series and from the other
available information sources
• Online control of the variable acquisition parameters
(Active Vision)
• Inspection and reconstruction of partially or fully specular
surfaces
cognitive systems
• Probabilistic planning methods for deflectometric surface
inspection
• Optical signal pre-processing in spectroscopy and 3D shape
measurement
• Model reduction for non-linear and spatially distributed
processes
• Underwater Vision: acquisition and exploitation of underwater imagery
• Interactive techniques for augmented reality environments
• Detection of surface defects based on deflectometric
The variability of image acquisition is crucial if a single image
measurement data using wavelet analysis
does not fully capture the features of interest of a studied
• Person identification and face recognition in video data
object or scene. The control system may then take multiple
• Control of cyber-physical production systems
images, adjusting the parameters – such as the camera’s posi-
• Methods of face registration, 3D reconstruction, and super-
tion or field of view (for example to improve visibility of the
resolution in video data
occluded objects) – or switching to different spectral bands. In
• Methods of classification in hyper-spectral inspection
combination with data fusion, this may provide a description
• Planning and execution of maneuvers for autonomous
quality that is hardly if at all achievable with other inspection
vehicles in traffic
methods. Facilitated by the availability of inexpensive camera
• Analysis and generation of regular and statistical textures
and manipulation systems and by the progress in modeling
• Methods for specular 3D reconstruction
114 Core Competence Image Exploitation
Head of department:
Dr. rer. nat. Alexey Pak
Phone +49 721 608-45912
[email protected]
www.iosb.fraunhofer.de/VBV
1 Laboratory setup for infrared-deflectometry.
2 Deflectometric inspection in
Robot / MiniCAVE laboratory.
Infrastructure and equipment
Robot laboratory:
The laboratory’s industrial robot provides precise, automated,
and reproducible adjustment of the image acquisition
geometry. For example: illumination re-positioning allows
very complex objects to be captured with a high degree of
accuracy. In addition to traditional camera-based inspection,
1
the laboratory is used for the inspection of specular objects
with a deflectometric sensor head.
Infrared deflectometric laboratory:
Certain diffuse surfaces (such as metal sheets used in auto
bodies) are specular when observed in the thermal infrared
spectrum allowing their accurate inspection for the presence of
dents, waves, and irregularities using deflectometry. However,
unlike thermal infrared cameras, long-wavelength imaging
devices are not readily available. The laboratory hosts several
prototypes of devices to generate fast thermal deflectometric
pattern series. In particular, one prototype utilizes a powerful
laser to “draw” a pattern on a moving plastic band.
2
MiniCAVE laboratory:
Typically, the smaller the pattern projection screen, the longer
a deflectometric inspection of a complex object takes. The
radical way to increase the inspection area processed with a
fixed camera-screen constellation is to completely enclose the
object in a shell that serves as a screen. The MiniCAVE laboratory is equipped with digital projectors that enable a nearly
complete coverage of the environment with encoding patterns
(displayed on the walls and the ceiling). The research here is
focused on calibration and measurement techniques in such
environments and the associated advantages and challenges
for the inspection tasks.
Core Competence Image Exploitation
115
n a m e n , d a t e n , e r e i g n i ss e
N a m e s , d at e s , e v e n t s
Kuratorium
Advisory Board
F r aunho f e r I n s t it u t e of Opt r on ics, Sy stem Tech n olog ies a n d Ima g e Ex ploitati o n
(D ecemb er 2 013)
Dr. Fritz Merkle
(Vorsitzender) OHB-System AG, Bremen
Dr. Sven Olaf
EADS Deutschland GmbH – Cassidian Electronics, Immenstaad
MR Dr. Annerose Beck
Sächsisches Staatsministerium für Wissenschaft und Kunst,
Dresden
Dr. Jörn Oprzynski
Siemens AG, Karlsruhe
Roland Bent
Phoenix Contact GmbH & Co. KG, Blomberg
Prof. Dr. Rüdiger Dillmann
Karlsruher Institut für Technologie (KIT), Karlsruhe
FZI Forschungszentrum Informatik, Karlsruhe
Dr. Elmar Dorner
SAP Research Center CEC, Karlsruhe
Dipl.-Ing. Robert Fetter
Thüringer Ministerium für Bildung, Wissenschaft u. Kultur, Erfurt
Prof. Dr. Christian Heipke
Leibniz Universität Hannover, Hannover
RD Dr. Wolf Junker
Bundesministerium für Bildung und Forschung, Bonn
Prof. Dr. Helmut Klausing
VDE e.V., Frankfurt
MinR Peter Rothemund
Wirtschaftministerium, Stuttgart
Prof. Dr. Gert Siegle
Hildesheim
Marion Sielemann
Bundesministerium der Verteidigung, Bonn
Dr. Walter Stammler
LFK-Lenkflugkörpersysteme GmbH, Unterschleißheim
Prof. Dr. Christoph Stiller
Karlsruher Institut für Technologie (KIT), Karlsruhe
FZI Forschungszentrum Informatik, Karlsruhe
MinR Norbert Michael Weber
Bundesministerium der Verteidigung, Bonn
Christoph Winterhalter
ABB AG Forschungszentrum Deutschland, Ladenburg
Gäste im Kuratorium:
Dr. Rainer Kroth
Diehl BGT Defence GmbH & Co. KG, Überlingen
Dr. Norbert Kuschnerus
Bayer Technology Services GmbH, Leverkusen
Andreas Ernst
Rheinmetall AG, Düsseldorf
Dr. Thomas Steckenreiter
Bayer Technology Services GmbH, Leverkusen
Prof. Dr. Karl-Heinz Meisel
Hochschule Karlsruhe – Technik und Wirtschaft, Karlsruhe
Ständige Gäste im Kuratorium:
Dr. Horst Nasko
Technologiemanagement, München
Dr. sc. techn. h.c. Dietrich Ernst
Erlangen
117
n a m e n , d a t e n , e r e i g n i ss e
N a m e s , d at e s , e v e n t s
Internationale
Gäste und Gastwissenschaftler
International guests
and visiting Scientists
Qiucheng Li, PhD-Student, China Agriculture University
Dr. Yaping Gao, Scientist at Yellow Fishery Research
Beijing, China, 1.9.2012-31.8.2016
Institute, 26.2.-4.3.2013
Prof. Jihong Zhang, Yellow Fishery Research Institute,
Dr. Eduard Santamaria, Post-Doc Stipendium, ERCIM
26.2.-4.3.2013
Fellowship, Universitat Politecnica de Catalunya, Spanien,
Yellow Fishery Research Institute, Qingdao,
1.1.-31.5.2013
Italo Toselli, Italian citizen from the Italian Marine, ERCIM
Prof. Daoliang Li, Head of China-EU Center for Information
scholar (prior to that Naval Postgraduate School, Monterey,
& Communication Technologies in Agriculture (CICTA),
CA, USA), 1.9.2013-31.8.2014
16.1.-6.3.2013
Dr. Zhenbo Li, Scientist at Faculty for Information & Com-
Toshimasa Iijima, Researcher, Industrial Research Institute
munication Technologies in Agriculture, 16.1.-28.1.2013
Hokkaido Research Organization, http://www.hro.or.jp,
Dr. Xinhu Chen, Scientist at Faculty for Information &
Sapporo, Japan, research period abroad, 1.11.2013-31.3.2014
Communication Technologies in Agriculture, 16.1.-28.1.2013
Prof. Yaoguang Wei, Scientist at Faculty for Information &
Herr S. Elbegbayan, Director of the water and wastewater
Communication Technologies in Agriculture, 2.4.-6.6.2013
company of Darkhan, Mongolia, 21.11.-1.12.2013
Dr. Chunli Zhang, Scientist at Faculty for Information &
Communication Technologies in Agriculture, 2.4.-6.6.2013
Mr. Benoit Mellier (FR), Mr. Ric Schleijpen (NL),
Dr. Yingyi Chen, Scientist at Faculty for Information &
Mr. Keith Naylor (GB), Mr. Neil Towning (GB),
Communication Technologies in Agriculture, 15.7.-31.8.2013
Mr. Jan Bekkeng (NO), Mr. Anders Clausen (DK),
Dr. Qui Ying, Scientist at Faculty for Information & Commu-
NATO-Gruppe SCI-239, 17.-19.12.2013
nication Technologies in Agriculture, 15.7.-31.8.2013
China Agriculture University Beijing, China,
Baena Galle, Doktorand, University of Barcelona and Royal
Academy of the Sciences and Arts of Barcelona, Spanien,
1.2.2013-31.8.2013
118
Mitarbeit in Arbeitskreisen
Working groups
Counter - Improvised Explosive Device
Multispektral (Multi Spectral)
Ilja Kaufmann (Spokesperson),
Thomas Längle (Spokesperson),
Jan Bartelsen, Yvonne Fischer, Jürgen Geisler, Wolfgang Groß,
Sebastian Bauer, Jürgen Beyerer, Carsten Dachsbacher,
Klaus Jäger, Alexander Schwarz, Peter Solbrig
Jörg-Detlef Eckhardt, Wolfgang Gross, Robin Gruna,
Michael Heizmann, Matthias Michelsburg, Christian Negara,
Health & Care
Fernando Puente, Henning Schulte, Uwe Sörgel,
Kym Watson (Spokesperson),
Günter Struck, Kai-Uwe Vieth, Max Winkelmann
Thomas Bernard, Yvonne Fischer, Michael Heizmann,
Joris Ijsselmuiden, Andreas Jakoby, Ilja Kaufmann, Erik Krempel,
Oberflächeninspektion (Surface Inspection)
Kristian Kroschel, Andreas Meissner, Eduardo Monari, Markus
Michael Heizmann (Spokesperson),
Müller, Tanja Schultz, Rainer Stiefelhagen, Igor Tchouchenkov,
Robin Gruna, Sebastian Höfer, Ilja Kaufmann, Thomas Längle,
Michael Voit, Frank Weichert, Andreas Wenzel
Wolfgang Melchert, Eduardo Monari, Thomas Müller,
Christian Negara, Max-Gerd Retzlaff, Martina Richter,
Maschinelles Lernen (Machine Learning)
Matthias Richter, Masoud Roschani, Henning Schulte,
Oliver Niggemann (Spokesperson),
Alexander Schwarz, Miro Taphanel, Markus Vogelbacher,
Christian Frey, Vladimir Hinze, Christian Kühnert,
Stefan Werling, Mathias Ziebarth
Fabian Müller, Matthias Richter, David Schaffranek,
Andreas Wenzel, Sebastian Wuttke
Mobile Endgeräte (Mobile Devices)
Simon Lemaire (Spokesperson),
Frank Pagel (Spokesperson),
Björn Böttcher, Alexander Enderle, Peter Frühberger,
Tianyi Guan, Marcus Hebel, Mario Kaufmann, Erik Krempel,
Birger Krägelin, Siegbert Kunz, Christian Negara,
Michael Okon, Daniel Szentes, Florian van de Camp,
Hylke van der Schaaf
119
n a m e n , d a t e n , e r e i g n i ss e
N a m e s , d at e s , e v e n t s
Ehrungen und Preise
Honors and Awards
Highlight of the Journal of Optics (2012) was given to Stefanie
Marcus Hebel was awarded Förderpreis Geoinformatik
Dengler, Christian Kübel, Andreas Schwenke, Gunnar Ritt,
2013 for his dissertation: “Änderungsdetektion in urbanen
Bernd Eberle for the publication “Near- and off-resonant optical
Gebieten durch objektbasierte Analyse und schritthaltenden
limiting properties of gold-silver alloy nanoparticles for intense
Vergleich von Multi-Aspekt ALS-Daten“, The award was
nanosecond laser pulses“. In: Journal of Optics, Vol. 14(7)
given by Verein Runder Tisch GIS e.V., Technische Universität
München, 10.4.2013
Eduard Santamaria, Igor Tchouchenkov, Rainer Schönbein,
Florian Segor received Best Paper Award for the publication:
Andrea Zielinski received Best Research Paper Award for her
“Path Planning for Rapid Aerial Mapping with Unmanned
publication: “Detecting Natural Disaster Events on Twitter
Aircraft Systems“. The Eighth International Conference on
across Languages“, 6th International Conference on Intelli-
Systems (ICONS 2013), Spain, Seville, 27.1.-1.2.2013
gent Interactive Multimedia Systems and Services, Portugal,
Sesimbra, 26.-28.6.2013
Jutta Hild, Elke Müller, Edmund Klaus, Elisabeth Peinsipp-Byma,
Jürgen Beyerer were awarded Best Paper Award for the
David Münch, Ann-Kristin Grosselfinger, Wolfgang Hübner,
publication “Evaluating Multi-Modal Eye Gaze Interaction
Michael Arens received Best Paper Award for their article
for Moving Object Selection“. The Sixth International Confer-
“Unconstrained Online Configuration of a Master-Slave
ence on Advances in Computer-Human Interactions (ACHI),
Camera System, 9th. International Conference on Computer
France, Nice, 24.2.-1.3.2013
Vision Systems ICVS 2013, Russia, Saint Petersburg,
16.-18.7.2013
Jochen Meidow received the Hansa-Luftbild-Award 2013
for his article: “Efficient Multiple Loop Adjustment for
Buren Scharaw received an honor by the Ministry Road,
Computer Vision Tasks“ published in the journal “Photo-
Transport, Construction and Urban Development Mongolia
grammetrie – Fernerkundung – Geoinformation“ in the
during the BMBF-delegation trip an, 2.9.2013
course of the 33rd Scientific-Technical Annual Conference of
the German Society for Photogrammetry, Remote Sensing
Jahanzaib Imtiaz, Ganesh Shrestha, Jürgen Jasperneite
and Geoinformation of the Hansa Luftbild plc, represented
received WIP Best Paper Award for their publication: “An
by Dr. Paul Harfield (member of the board), Germany,
Optimized OPC-UA Transport Profile to Bringing Bluetooth
Freiburg, 28.2.2013
Low Energy Device into IP Networks“. The 18th IEEE Conference on Emerging Technologies and Factory Automation
INNOVATIONSPREIS-IT (Innovation Prize-IT) under the patronage of the Ministry for Economics, Labour and Transport of
Niedersachsen, BEST OF 2013, Solutions: Business software,
EMS-EDM PROPHET®, 20.3.2013
Alexander Schick received the Industriepreis 2013
(Industry Pize 2013) in the category research & development
for “Gesteninteraktion der Qualitätssicherung“ awarded by
Huber Verlag für Neue Medien during the Hannover Messe
2013, 3.4.2013
120
(ETFA´2013), Italy, Cagliari, 10.-13.9.2013
Prof. Maurus Tacke from the NATO Research and Technology
Organisation (NATO-RTO) was honored with the Von Kármán
Medal for his impressive career, his dedication and his personal
contribution to improving the research and technology cooperation between the NATO-States in the field of optronic.
The Von Kármán Medal is the highest honor, which this
committee awards. The Von Kármán Medal was conferred
on Prof. Tacke in Vilnus during the Fall 2013 STB Symposium
18.-20.9.2013.
Thomas Usländer, Arne J. Berre, Carlos Granell, Denis Havlik,
José Lorenzo, Zoheir Sabeur, Stefano Modafferi received Best
Scientific Paper Award for the publication: “The Future Internet Enablement of the Environment Informations Space“.
ISESS 2013, Austria, Neusiedl am See, 9.-11.10.2013
Tobias Munz passed his exam as IT administator with
distinction (“sehr gut“). He was awarded “BEST AZUBI“
by the Fraunhofer-Society.
121
n a m e n , d a t e n , e r e i g n i ss e
N a m e s , d at e s , e v e n t s
Besondere Veranstaltungen
Special Events
21. Sitzung des Fachausschusses 3.51 »Bildverarbeitung in
1. Internationale Konferenz OCM 2013
der Mess- und Automatisierungstechnik« der VDI/VDE-GMA,
»Optische Charakterisierung von Materialien«,
Organisation und Leitung: Dr. M. Heizmann, Frankfurt a. M.,
IOSB, Karlsruhe, 6.-7.3.2013, 74 Teilnehmer
18.1.2013, 8 Teilnehmer
Seminar »Sehen was andere nicht sehen«, Hector-Akademie,
VDI Zukunftskongress Industrie 4.0
Leitung Dr. K. Stein, IOSB, Ettlingen 20.4.2013, 7 Teilnehmer
Leistungsspektrum des GF Automatisierung
Düsseldorf, 30.1.2013
8. Schul-Energie-Tag im Ilmkreis, Mitausrichter: AST Ilmenau,
Goethe-Gymnasium Ilmenau, 24.4.2013, Exponat: Überall-
Counter-IED Workshop, Fraunhofer IOSB, Organisation:
kraftwerk / Wasserstoffauto (ca. 90 Teilnehmer: Schülerinnen /
I. Kaufmann, Ettlingen, 29.-30.1.2013, ca. 40 Teilnehmer
Schüler / Eltern / Lehrer aus Ilmenau und Umgebung)
47. Regelungstechnisches Kolloquium in Boppard, Ausrich-
Girls’Day – Mädchen - Zukunftstag
tung durch das Fraunhofer IOSB, organisatorische Leitung:
Fraunhofer IOSB, Karlsruhe, Ilmenau, 25.4.2013, 40 Teilnehmer
Dr. M. Heizmann, Boppard, 20.-22.2.2013, 33 Beiträge,
ca. 200 Teilnehmer aus Hochschulen und Industrie
22. Sitzung des Fachausschusses 3.51 »Bildverarbeitung in
der Mess- und Automatisierungstechnik« der VDI/VDE-GMA,
Seminar »Sonne, Mond und Planeten«, Hector-Akademie,
Organisation und Leitung: Dr. M. Heizmann Frankfurt a. M.,
Leitung: Dr. J. Krieg, IOSB, Ettlingen, 23. 2.2013, 7 Teilnehmer
26.4.2013, 11 Teilnehmer
Seminar »Wie wird das Wetter gemacht«, Hector-Akademie,
»IEEE International Conference on Robotics and Automation«
Leitung: Dr. K. Stein, IOSB, Ettlingen, 2.3.2013, 7 Teilnehmer
(ICRA2013), Mitarbeit bei der Koordination der Robot
16. SpectroNet Collaboration Forum, IOSB Karlsruhe,
Karlsruhe, 6.-10.5.2013
Challenges: Dr. M. Heizmann, J. Petereit, T. Emter,
5.3.2013, 95 Teilnehmer
Workshop »Where is the business in IoT?«, Leitung des
Workshops: R. Herzog, Future Internet Assembly,
Irland, Dublin, 8.-10.05.2013, 80 Teilnehmer
10th International Conference on Information Systems for
Crisis Response and Management, ISCRAM 2013, Chair:
Prof. Dr.-Ing. J. Beyerer, Co-Chair: Dr. T. Usländer,
Baden-Baden, 12.-15.5.2013, ca. 300 Teilnehmer
EMS-EDM PROPHET Anwendertage für Kunden von
EMS-EDM PROPHET®, Ausrichter AST Ilmenau,
Auerstedt, 4.-5.6.2013, 50 Teilnehmer
122
Regelungstechnisches Kolloquium in Boppard.
VDI-Fachkonferenz: »Zustandsüberwachung und Optimierung«,
Unified Greding (Messkampagne) 2013
fachliche Konferenzleitung: Prof. Dr.-Ing. habil. J. Beyerer,
Wehrtechnische Dienststelle (WTD) 81, Greding, 23.-27.9.2013
inhaltliche Koordination der Konferenz: Dr. M. Heizmann,
Karlsruhe, 12.-13.6.2013, ca. 45 Teilnehmer
23. Sitzung des Fachausschusses 3.51 »Bildverarbeitung in
der Mess- und Automatisierungstechnik« der VDI/VDE-GMA,
Workshops Nr. 2: »WIBAS 5.0: Vorstellung und Diskussion Neu-
Organisation und Leitung: Dr. M. Heizmann, Frankfurt a. M.,
entwicklung Wasserrecht (u. a. Vorbereitung Datenmigration)«,
27.9.2013, 11 Teilnehmer
Leitung des Workshops: T. Batz, 29. Fortbildungsveranstaltung
Informationstechnik Wasser, Immissionsschutz, Boden, Abfall,
Sitzung des EMS-EDM Produktbeirates, Ausrichter:
Arbeitsschutz (WIBAS) des Ministeriums für Umwelt, Klima
AST Ilmenau, Erfurt, 24.10.13, 12 Teilnehmer
und Energiewirtschaft. Altensteig, 12.-13.7.2013,
30 Teilnehmer
MAJIIC 2 MAJEX (Simulated Exercise) 2013
Veranstaltung gesamt: 114 Teilnehmer
Niederlande, Den Haag, 28.10.2013-21.11.2013
Workshop: »Marktregularien«, Ausrichter: AST,
Workshop »IT-Administration von EMS-EDM Prophet®«,
AST Ilmenau, 23.7.2013, 10 Teilnehmer
Ausrichter: AST Ilmenau,
AST Ilmenau, 5.11.2013, 11 Teilnehmer
Tutorial: »Exploiting Social Media for Natural Language
Processing: Bridging the Gap between language-Centric and
Seminar VS 10.05 »Videoüberwachung für Sicherheits-
Real-World Applications«, 51st Annual Meeting of the asso-
aufgaben« der Carl-Cranz-Gesellschaft e.V., Organisation
ciation for Computational linguistics. Leitung des Tutorials:
und Leitung: Dr.-Ing. G. Grasemann,
Prof. Dr. S. Ponzetto, Dr. A. Zielinski, 3.-9.8.2013,
Karlsruhe, 12.-14.11.2013, 6 Teilnehmer
Bulgarien, Sofia, ca. 60 Teilnehmer
Sehen, Verstehen, Vernetzen – Technologien des Fraunhofer
MAROS 2013 – Maritime Robotik und Sensorik:
IOSB für den Bedarf der Streitkräfte, Leitung / Organisation:
»Design the Future 2025«, Ausrichter: AST Ilmenau,
Prof. Dr.-Ing. habil. J. Beyerer, Dr. J. Geisler,
Ilmenau, 9.-10.9.2013, 62 Teilnehmer
Karlsruhe, 13.11.2013, 87 Teilnehmer
73. Sitzung des Fachausschusses 1.10 »Grundlagen
Vortragsreihe: »Informationstechnologie“,
Messsysteme« der VDI/VDE-GMA, Organisation und Leitung:
Vorsitz: Prof. Dr. J. Jasperneite
Dr. M. Heizmann, Maulburg, 16.9.2013, 9 Teilnehmer
Vortragsreihe: »Produktion & Supply Chain“,
Vorsitz: Dr. O. Sauer
DAAD-Sommerschule »Sustainable Water Management«
Kongress Industrie 4.0 – Flexibilisierung durch digitale,
2013, Mitausrichter: AST Ilmenau, AST Ilmenau und TU
intelligente und agile Produktionsnetzwerke,
Ilmenau, 16.-27.9.2013, 18 internationale Teilnehmer
Stuttgart, 18.-19.11.2013, ca. 100 Teilnehmer
IEEE Symposium on Precision Clock Synchronization for
Industrie 4.0: Von der Strategie zur Praxis, Süddeutscher Verlag
Measurement, Control and Communication (ISPCS´2013),
Leistungsspektrum des GF Automatisierung
Lemgo, 22.-27.9.2013, 150 internationale Teilnehmer
Esslingen, 4.-5.12.2013
123
2013
2013
2013
2013
2013
2013
TriDec: Tsunami Early Warning System
The TRIDEC-exhibit shows new developments in intelligent data processing for Crises
Management based on two examples: a system for early discovery of impending incidents
in drilling operations, not unusual at oil/natural gas boreholes, which have the potential to
cause enormous damages to the environment, and the Tsunami Early Warning System for the
Mediterranean and the Northeast Atlantic (under development). Visitors will be able to let
the “Globe“ vibrate and see the seismological outcome.
AquaBioTox: Online Monitoring of drinking water quality
Water supply networks are constantly exposed to deliberate or accidental contamination. For
the protection of public health there is significant interest in sensors and software systems
to answer the following questions: Where is the source of the contamination? What impact
will the contamination have on the water distribution network? Which measures are needed
to contain the harm? This exhibit presents the online broadband sensor »Aquabiotox« and a
simulation tool for the transport of ingredients in drinking water networks.
SENEKA - Sensor Network with Mobile Robots for Disaster Management
The SENEKA project idea aims to provide task forces and rescue teams with sensors and
robots capable of forming dynamic networks, thereby significantly reducing the time required
for the most important phases of disaster management when it comes to saving lives: reconnaissance of the disaster area and the search for victims and sources of danger. The SENEKA
concept is particularly quick and efficient when it comes to exploring an unknown devastated
area as the various sensors and robots distributed throughout the area are capable of
networking with one another based on the situation (swarming), thereby enabling them to
cooperatively complete complex reconnaissance and search missions.
124
2013
2013
2013
2013
2013
2013
Industrial Smart Grids
Acquisition, monitoring and optimization of energy consumption are getting a central
question in plant construction and mechanical engineering. An Industrial smart grid supports
the operator of machines and plants to analyze and improve the system performance and
efficiency continuously and to seek an optimum working point. An Industrial Smart grid supports a more uniform energy consumption by an active real-time load management as well as
to improve the power quality by reducing harmonics. As a result energy costs will be reduced
and the life-time of electronic equipment used in production lines will be extended.
The demonstrator shows a technical process with a real-time energy management at the PLClevel and the data communication with the energy provider.
Interactive Video Surveillance
Interactive Video Surveillance systems enable communication with the monitored people. This
can happen either via gesture recognition or by mobile devices. These new “active“ users aid
the operator which now can react faster and more precisely. Important information is send to
the security guards mobile devices, which improves reaction time and team coordination.
Additional features become available for the supervised persons. They can receive navigation
help and view which personal data is processed by the system. Next to these new features, we
will also present the integration of some privacy protection principles, i.e., “Privacy by Design“
and “Privacy by Default“. These principles become increasingly important, as they are required
in the proposal for the reform of the EU data protection reform.
Gesture recognition in manufacturing
For quality assurance, BMW checks all their bumpers and other painted parts multiple times.
Currently, workers have to leave their workplace and enter the results into the quality assurance system after visual inspection. The Fraunhofer IOSB developed a gesture recognition
system that can make this process more intuitive and efficient. Pointing gestures are now
recognized at the place of inspection to directly tell the quality assurance system the location
and type of the production error. The workers do not need to leave the place of inspection
anymore and the whole process becomes faster and more intuitive.
125
2014
2014
2014
2014
2014
2014
CyphWay: The One Device for Secure Communication
Her wide range of use makes tablets and smartphones to be a lucrative destination for espionage. The CyphWay - developed at the Fraunhofer IOSB - closes this vulnerability. The core of
the CyphWays is a trusted hardware module. It encapsulates and protects the safety-critical
components, such as the en- and decryption unit as well as key management. It ensures
optimal protection of sensitive data. A communication module enables the connection of the
trusted hardware module to the used terminal.
Deflectometry
Fraunhofer IOSB offers solutions, for measurements and assisted evaluations of painted
surfaces. Basing on deflectometry, shape and waviness of surfaces will be analyzed. The FEM
based measurement allows the direct, automated comparison with the CAD design as well as
the detection of local surface defects. The manual, gesture based evaluation of the measured
results and their documentation within the measurement protocol, complete the process.
Indexed by gesture control, features are forwarded with position information to the testing
system. The completed document contains the 3-D reconstruction and information which
have been generated by additional interaction with the object.
VibroTrack
Vibrations are one main issue on the developing and maintenance of wind turbines. Laser
vibrometry, based on doppler shift of light, is able to determine vibrations from a distance
also on parts of the turbine, where no sensors have been integrated. Fraunhofer IOSB has
developed a tracking system and an optimized laser vibrometer, which are able to even scan
the moving rotor blades. An image processing system tracks and stabilizes the laser spot on
the rotating blade. This allows for scanning the vibration characteristics of the whole blades
under real operating conditions.
MicroLab
Fraunhofer IOSB combines in its newly arranged microscopy laboratory MikroLab several
microscopic devices with different sensor properties each. This combination is achieved by
instrumenting well-established automation systems to provide an automatized microscopic
inspection. Thinking of quality assurance, microscopic inspection is getting more and more
important. In order to preserve given installations a non-invasive way of integration must
be followed. The measurement setup given demonstrates an experimental setup by using
standard industrial components.
126
2014
2014
2014
2014
2014
2014
SpectralFinder: System for real-time distinction of materials
The system developed by Fraunhofer IOSB uses hyperspectral data for the distinction of
materials in real-time. While regular cameras capture colors in only three broad channels
(red, green and blue), the system‘s hyperspectral videocamera has a spectral resolution of
over 130 much finer channels. These allow distinction of chemically different but visually
similar materials. Applications include mining operations, airborne evaluation of large areas
and also, due to its video capabilities and efficient processing algorithms, moving objects at
production lines.
EO2HEAVEN: Man, Environment and Health
A global challenge is to better understand the complex relationships between environmental
factors, population exposure and their impact on human health. The exhibit builds on results
of the FP7 projects ENVIROFI and EO2HEAVEN to demonstrate early warning systems (EWS’)
in environmental health relating to air pollution and the water-borne disease cholera. The
EWS’ for both decision makers and scientists use a GIS and Spatial Information Infrastructure
based upon open standards for web-services. A mobile app to record health data in the field
provides data to the EWS.
SENEKA: Sensor Network with Mobile Robots for Disaster Management
The SENEKA project idea aims to provide task forces and rescue teams with sensors and
robots capable of dynamically forming demand-responsive networks, thereby significantly
reducing the time and improving accuracy required for reconnaissance of the disaster area
and the search for victims and sources of danger (e.g. gases). The ad-hoc nature of natural
disasters (e.g. earthquakes), terrorist attacks and large-scale industrial accidents (e.g. in
nuclear power plants) makes rapid, extensive, situation-specific reconnaissance and detection
of victims and sources of danger essential for saving lives.
NurseEye
Video-based fall- and emergency detection contributes greatly to safety in hospitals and care
facilities. Due to highly winding and vast campuses it is often complicated to provide fast
and reliable help for those in need without technical support. The care sector comes with
additional requirements on data protection and respect for privacy. With the video-pillar care
we present novel concepts for emergency detection, alerting of care attendants as well as
methods for data protection and acceptance of such technology by staff and patients.
127
n a m e n , d a t e n , e r e i g n i ss e
N a m e s , d at e s , e v e n t s
Messen und Fachausstellungen
trade fairs and exhibitions
E-world energy & water
VfS Kongress
Control 2013
2013
Leipzig, 9.-10.4.2013
Stuttgart, 14.-17.5.2013
Essen, 5.-7.2.2013
Exponat:
Exponate:
Exponat:
--(1,e)-Gateway
--CCT-Sensor
--EMS-EDM PROPHET
--Deflektometrie-Sensor
Wasser Berlin 2013
Leipziger Buchmesse
Berlin, 23.-26.4.2013
Cloudzone
Leipzig, 14.-17.3.2013
Exponat:
Karlsruhe, 15.-16.5.2013
Experteninterview zum Thema
--BMBF-Stand: Touchscreen
Exponate:
Energiewende (Martin Käßler)
Exponat MoMo
--CyphWay
--Cloud für sensible Daten
HMI 2013
AFCEA
Hannover, 8.-12.4.2013
Bonn Bad Godesberg,
Jahresfachtagung der Ver-
Exponate:
24.-25.4.2013
einigung des deutschen
--SENEKA - Sensornetzwerk
Exponate:
Brandschutzes e.V. (vfdb)
mit mobilen Robotern für das
--ABUL
Weimar, 27.-29.5.2013
Katastrophenmanagement
--AMFiS
Exponate:
--AquaBioTox-Demonstrator II
--A3GSim
--SENEKA - Sensornetzwerk
--Gestenbasierte Qualitäts-
--(1,e)-Gateway
mit mobilen Robotern für das
--Blickbasierte Interaktion
Katastrophenmanagement
kontrolle
--QUANJO TDS
--TRIDEC - Tsunami Frühwarnsystem
IT&Media
Darmstadt, 24.-25.4.2013
1. Thüringer
Exponate:
Elektromobilitätstag
--Energiedemonstrator
--(1,e)-Gateway
Erfurt, 7.6.2013
--Industrie 4.0: Virtual Fort
--CyphWay
Exponat:
--NEST-FlughafenDemonstrator
--sMobiliTy
Knox (ProVis APS – Feinplanung aus der Cloud)
--BMBF-Stand: Secure-Plugand-Work
--Stand Fraunhofer-Allianz
Energie: Bildschirmexponat
»Die Welt der Energie in
Zahlen«
--Gemeinschaftsstand mit
CIIT Partnern: Spitzencluster
»Intelligente Technische
Systeme OstWestfalenLippe,
it’s OWL«
128
ISCRAM 2013
Baden-Baden, 12.-15.5.2013
Fachtagung
Exponate:
Produktionsmesstechnik
--SENEKA - Sensornetzwerk
Buchs, Schweiz, 3. –
mit mobilen Robotern für das
4.9.2013
Katastrophenmanagement
Exponat:
--Mobiles Lagezentrum
--AMFIS
--INSENSUM Messstation
--CCT Sensor
VDMA Kongress
VDE-ETG-Kongress 2013
„Intelligenter Produzieren“
Energietag
Hannover, 16.-17.9.2013
Berlin, 5.-6.11.2013
Posterpräsentation: Automa-
Posterausstellung der Abt.
tisierung und Industrie 4.0
Energie
MSV Brünn
Medica 2013
Brünn, Tschechische Republik,
Düsseldorf, 20.-23.11.2013
7.-11.10.2013
Exponat:
Exponat:
--AutoTrack
--Bildschirmexponat »Die
(Patienten-Tracking-System)
Welt der Energie in Zahlen«
AES 2013
It-sa
Washington DC, USA,
Nürnberg, 8.-10.10.2013
6.-13.12.2013
Exponate:
Exponat:
--(1,e)-Gateway
--AutoTrack (Patienten-
--CyphWay
Tracking-System)
--InfoVis
--Cloud für sensible Daten
INTERGEO
Essen, 8.-10.10.2013
Exponate:
--Wingpod
--Beispiel zur Änderungsdetektion im Bergbau
--Software zur Echtzeitklassifikation hyperspektraler
Bildsequenzen
ThEGA-Forum 2013
Arnstadt, 14.10.2013
Stand mit Präsentation der
Abt. Energie
129
n a m e n , d a t e n , e r e i g n i ss e
N a m e s , d at e s , e v e n t s
Mitarbeit in Gremien
Participation in Committees
Adomeit, U.:
Beyerer, J.:
--Mitglied der NATO-Gruppe ET-080 »Exploitation of Human
--Stellvertretender Vorsitzender des Fraunhofer-Verbundes für
Signatures for Threat Determination«
--Vorsitzender der NATO-Gruppe SET-ET-083 »Assessment and
modelling the performance of digital night vision image fusion«
Verteidigungs- und Sicherheitsforschung VVS
--Mitglied des Kuratoriums des Forschungszentrums Informatik
(FZI), Karlsruhe
--Vorstandsmitglied des Kuratoriums der Hochschule Karlsruhe
Agsten, M.:
Technik und Wirtschaft
--Mitglied VDE Arbeitskreis Smart Grids
--Leitung des Technischen Forums der Firma inspectomation
Ament, C.:
--Mitglied acatech - Deutsche Akademie der Technikwissen-
GmbH, Mannheim
--Mitglied im Rat der Fakultät für Informatik und
Automatisierung der TU Ilmenau
--Gutachter des DAAD: Auswahl für Doktorandenprogramme
schaften e.V., München und Berlin
--Sprecher Themennetzwerk Sicherheit, acatech
--Mitglied des Editorial Board der Zeitschrift »Information
Fusion« Elsevier
Arnoldt, A.:
--gewähltes Mitglied im Beirat der VDI/VDE GMA
--Mitglied und Vertreter der Abt. NRG des IOSB-AST im
--Mitglied im wissenschaftlichen Beirat der Zeitschrift at –
Fraunhofer-Netzwerk Windenergie
--Mitglied im VDE/DKE Backendsysteme
Automatisierungstechnik der GMA (VDI/VDE-Gesellschaft
Mess- und Automatisierungstechnik) und der NAMUR
(Interessengemeinschaft Prozessleittechnik der chemischen
Batz, T.:
--Mitglied der Gesellschaft für Informatik, Fachgruppe
Datenbanksysteme
--Mitglied der Gesellschaft für Informatik, Fachgruppe
Requirements Engineering
--Mitglied bei Gesellschaft für Projektmanagement (GPM)
und pharmazeutischen Industrie)
--Member of IEEE Computer Society
--Member of IEEE Intelligent Transportation Systems
--Member of Society for Industrial and Applied Mathematics
(SIAM)
--Member of The International Society for Optical Engineering
(SPIE)
Baumann, M.:
--Mitglied im Industriearbeitskreis »Produktionslogistik für die
variantenreiche Serienfertigung«
--Mitglied der Deutschen Arbeitsgemeinschaft für Mustererkennung e.V. (DAGM)
--Mitglied im VDE
--Mitglied im Beirat der Deutschen Initiative für Netzwerk-
Beyer, D.:
information (DINI)
--Mitarbeit im BITKOM
--Mitglied im Beirat der Zeitschrift »Strategie und Technik«
--Mitarbeit im IEA ECES Annex 26 »Electric Energy Storage -
--Mitglied im Beirat der Zeitschrift »Europäische Sicherheit
Future Energy Storage Demand«
und Technik«
--Mitglied in der Jury INNOVATIONSPREIS 2013, Initiative
Mittelstand 2013, in den Kategorien E-Learning und
Wissensmanagement
130
Bohn, S.:
--Mitglied im Programmkomitee der Teilkonferenz: Crisis
--Mitglied VDE Arbeitskreis »Smart Grids«
Management – Information Systems, Humanitarian Logictics
and IT-based Decision Support, Multikonferenz Wissen-
Boldt, M.:
schaftsinformatik, Paderborn, 26.-28.2.2014
--Session Chair for the SPIE Conference Session 2: »Infrastruc-
--General Chair der OCM (International Conference on Optical
Characterization of Materials), Karlsruhe, 6.-7.3.2013
--Robot Challenge Chair of the IEEE Conference on Robotics
tures and Urban Areas II«, and Session 3 »GIS Education«,
Conference: Earth Resources and Environmental Remote
Sensing / GIS Applications IV
and Automation (ICRA), Karlsruhe, 6.-11.5.2013
--Conference Chair of the ISCRAM 2013, 10th International
Bretschneider, P.:
Conference on Information Systems for Crisis Response and
--stellv. Sprecher Fraunhofer-Allianz Energie
Management, Baden-Baden, 12.-15.5.2013
--Koordinator im Netzwerk »Intelligente Energienetze«
--Session Chair Conference EOM 106B Automated Visual
Inspection, SPIE Optical Metrology, München, 13.-16.5.2013
--Konferenzleiter der vom VDI Wissensforum organisierten
Konferenz Zustandsüberwachung und Optimierung,
Karlsruhe, 12.-13.6.2013
--Mitglied im Programmausschuss der »8th Future Security«,
Berlin, 17.-19.9.2013
--Mitglied im Programmkomitee des IEEE-Workshops »Sensor
Data Fusion – Trends, Solutions Applications«, Bonn,
9.-11.10.2013
--Mitglied im Programmkomitee der FORMS/FORMAT
(»Formal Methods for Automation and Safety in Railway and
Automotive Systems«), Braunschweig, 30.9.-2.10.2014
--Mitglied im Netzwerk Windenergie
--Mitglied im Fraunhofer-Netzwerk »Energiespeichersysteme
und Netze«
--Mitglied im GMA FA 5.14 »Computational Intelligence«
(GI Fachgruppe Fuzzy-Systeme und Soft-Computing)
--Mitglied im BDI-Arbeitskreis »IT für Energiemärkte der
Zukunft«
--Mitglied im Institut für Energiewirtschaftsrecht Jena
--Mitglied im IEA ECES Annex 26 »Electric Energy Storage Future Energy Storage Demand«
--Mitglied im Netzwerk Solarinput
--wissenschaftlicher Leiter der Arbeitsgruppe Energiespeicher
im Thüringer Netzwerk »Material innovativ Thüringen«
--stellv. Vorstandsvorsitzender des Thüringer Erneuerbare
Bernard, T.:
Energien Netzwerk (ThEEN)
--Mitglied im NAMUR-Arbeitskreis 2.2 »Prozessführung«
--Stellvertretende Ombudsperson im IOSB zur Sicherung guter
wissenschaftlicher Praxis
Bulatov, D.:
--Reviewer »Photogrammetrie – Fernerkundung –
Geoinformation (PFG)«
Bier, C.:
--Reviewer »ISPRS-Journal of Photogrammetry«
--Mitglied im DIN-Gremium Arbeitskreis »Normung«
Bürsing, H.:
Birkle, M.:
--Wissenschaftlicher Beirat der IWRM (Integrated Water Resources Management)-Konferenz 2014 der Karlsruher Messeund Kongress GmbH (KMK), Karlsruhe, 19.-20.11.2014
--Mitglied NATO-Gruppe SCI-239 »Countermeasure Concepts
Against Future IR/EO Threats«
--Mitglied der NATO-Gruppe SCI-ET-264 »Protection of Military
Systems from High Energy Laser (HEL) Attacks«
131
n a m e n , d a t e n , e r e i g n i ss e
N a m e s , d at e s , e v e n t s
Mitarbeit in Gremien
Participation in Committees
Carmer von, C.F.:
Ebert, R.:
--Mitglied in der NATO SET-144 Gruppe »Mitigation of ship
--National Member NATO SET Panel
Electro-Optical Susceptibility against Conventional and
Asymmetric Threats«
--Mitglied der NATO-SET-ET-082 »Naval Platform Protection in
the EO/IR Domain«
--Governmental Expert of EDA CapTech IAP03 »Optical Sensor
Systems & Signal, Image Processing«
--Co-Chair Symposium SPIE Security and Defence 2013,
Dresden, 23.-26.9.2013
--Mitglied in der NATO SCI-224 Gruppe »ET on EO & IRCountermeasures against Anti-ship Missiles«
--Mitarbeit CSSM WG 2 an IR Ship Signature Management
Systems, DEU, NLD, CAN, NOR, BEL
Eck, R.:
--Mitglied im Fachbereich 2 »Dienste und Anwendungen«
der Informationstechnischen Gesellschaft (ITG) im VDE
Chaves, F.:
Even, M.:
--Vertreter des IOSB im Koordinierungsausschuss F+E IuK im
--Mitglied NATO-RTO-SET-145 »Extraction of Geospatial
Rahmen der Kooperation KEWA des Umweltministeriums
Baden-Württemberg
Intelligence Information from Space Borne SAR Sensors«
--Reviewer IEEE Journal of Selected Topics in Applied Earth
Observations and Remote Sensing
Dimitrov, T.:
--Mitarbeit im BITKOM AK Industrie 4.0
Fischer, Y.:
--Technical Program Committee, CogSIMA, San Diego, USA,
Dimmeler, A:
25.-28.2.2013
--Mitglied der NATO-Gruppe SCI-239 »Countermeasure
Concepts against future IR/EO Threats«
--Mitglied der NATO-Gruppe SET-190 »Phenomenology and
Exploitation of Thermal Hyperspectral Sensing«
Frey, C.:
--Mitglied im VDI/VDE-GMA-Fachauschuss 5.14
»Computational Intelligence«
--Mitglied bei EDA DUCAS »Detection in Urban scenario using
Combined Airborne imaging Sensors«
Gladysz, S.:
--Mitglied in der NATO SET-165 Gruppe »Adaptive Optics for
Dunau, P.:
--Mitglied in der NATO SCI -212 Gruppe »Performance
Criteria for Camouflage Systems derived from Operational
Scenarios«
Laser Beam Delivery and Passive and Active Imaging and
Turbulence Mitigation«
--Session Chair, Committee Member, »Adaptive Optics:
Methods, Analysis and Applications« 23 - 27 Juni 2013,
Arlington, USA
Eberle, B.:
--Reviewer »Optics Express«
--Chairman der NATO-Gruppe SET-ET-198
»Visible Laser Dazzle – Effects and Protection«
--Mitglied im »Team of Experts« zur Revision der STANAG
4495 »Eye Protection for the individual Soldier – Laser
Protection«
Grasemann, G.:
--Arbeitskreis Video des Verbands für Sicherheitstechnik e.V.
(VfS), Hamburg
--Arbeitskreis Gebäudemanagement des Verbands für Sicherheitstechnik e.V. (VfS), Hamburg
132
Groß, W.:
--Mitarbeit bei DEU - CHE Kooperation »Hyperspectral Imaging«
--Mitarbeit bei DEU - ISR Kooperation
»Hyperspectral Reconnaissance«
--Organisatorische Leitung des Regelungstechnischen
Kolloquiums in Boppard
--Mitglied im Programmausschuss »International Conference
on Optical Characterization of Materials« (OCM-2013),
Hammer, H.:
--Mitarbeit bei DEU - ISR Kooperation »Visual Processing,
Multisensor Fusion & Exploitation for ISR Application«
--Reviewer »GRSL – Geoscience and Remote Sensing Letters«
Karlsruhe, 6.-7.3.2013
--Mitglied im Programmausschuss Konferenz »Automated
Visual Inspection« der SPIE Optical Metrology 2013,
München, 13.-16.5.2013
Hebel, M.:
Herzog, R.:
--Mitglied der Deutschen Gesellschaft für Photogrammetrie,
--MSG-ET-035: Leitung der NATO Arbeitsgruppe
Fernerkundung und Geoinformation e.V. (DGPF)
»Development of High Level Architecture (HLA) Federation
Compliance Test Tool«
Heizmann, M.:
--Stellvertretender Vorsitzender des Fachbeirats des Fachbereichs 3 »Fertigungsmesstechnik« der VDI/VDE-Gesellschaft
Mess- und Automatisierungstechnik (GMA) seit 01/2012
--MSG-106: Mitarbeit in der NATO Arbeitsgruppe
»Enhanced CAX architecture, design and methodology«
--Mitarbeit in der Standards Working Group des Open
Geospatial Consortium »Sensor Web for IoT SWG«
--Leitung des Fachausschusses 3.51 »Bildverarbeitung in
der Mess- und Automatisierungstechnik« der VDI/VDE-
Hild, J.:
Gesellschaft Mess- und Automatisierungstechnik (GMA) seit
--Session Chair auf der DigitalWorld (ACHI), Nizza, Frankreich,
03/2006
24.2.-1.3.2014
--Leitung des Fachausschusses 1.10 »Grundlagen der
Messsysteme« der VDI/VDE-Gesellschaft Mess- und Automa-
Jacobi, M.:
tisierungstechnik (GMA) seit 04/2011, Mitarbeit seit 11/2005
--Beirat VDI-GMA als Vertreter der Studenten und
--Vertretung des Fraunhofer IOSB im Arbeitskreis der
Jungingenieure des VDI
Fraunhofer-Allianz Vision seit 06/2004
--Leitung des Arbeitskreises »Oberflächeninspektion« am
Fraunhofer IOSB seit 10/2010
--Mitglied des Fachbeirats 1 »Grundlagen und Methoden
der Mess- und Automatisierungstechnik« der VDI/VDEGesellschaft für Mess- und Automatisierungstechnik (GMA)
Jakoby, A.:
--Mitglied AG »Digital vernetztes Unternehmen« Initiative
»Weiterentwicklung der IKT in Baden-Württemberg«
--Mitglied Forschungsorientierte sektorale Themenplattform 3
der Polizei
seit 01/2013
--Mitglied im wissenschaftlichen Beirat des Kooperativen
Promotionskollegs „Entwurf und Architektur Eingebetteter
Systeme (EAES)“ der Hochschule Pforzheim und der Universität Tübingen seit 12/2012
--Mitglied im VDI
133
n a m e n , d a t e n , e r e i g n i ss e
N a m e s , d at e s , e v e n t s
Mitarbeit in Gremien
Participation in Committees
Jasperneite, J.:
Kresken, T.:
--Co-Chair des Subcommittee on Information Technology
--Mitglied Allianz für Cyber-Sicherheit
in Industrial and Factory Automation (IES FA 5) in der IEEE
--Mitglied Cyberforum e.V.
Industrial Electronics Society
--Mitglied der Fachredaktion der ATP
(Automatisierungstechnische Praxis)
--Mitglied VDI/VDE Gesellschaft Mess- und
Krol, O.:
--Stellvertreter des IOSB in der Fraunhofer-Allianz SysWasser
--Vertreter des IOSB in der German Water Partnership
Automatisierungstechnik (GMA)
--Mitglied GMA-Fachausschuss 5.12 Echtzeitsysteme
Kuntze, H.-B.:
--Mitglied GMA-Fachausschuss 6.15 Zuverlässiger Betrieb
--(Gründungs-) Mitglied des VDI-GMA-Fachausschusses 4.13
Ethernet-basierter Bussysteme in der industriellen
Automatisierung (Leitung)
--Mitglied GMA-Fachausschuss 7.21 »Industrie 4.0« - Begriffe,
Referenzmodelle, Architekturkonzepte
»Steuerung und Regelung von Robotern«
--(Gründungs-) Mitglied im VDI/VDE-GMA-Fachausschuss 5.14
»Computational Intelligence«
--Mitglied der Deutschen Gesellschaft für Robotik (DGR)
--Vorstandmitglied OWL-Maschinenbau
--stellvertretender Sprecher der Fraunhofer-Allianz Embedded
Systems
--IEEE Senior Member
--Mitglied der IEEE Computer Society
--Mitglied der IEEE Communications Society
Kunz, S.:
--Koordinator des EMV-Kompetenzverbundes Fraunhofer EMC
--Mitglied in der Deutschen Gesellschaft für EMV Technologie
e. V. (DEMVT)
--Mitglied in der Deutschen Gesellschaft für
Produktmanagement (GPM)
Kaufmann, I.:
--Mitglied der »Threat Detection Expert Community« der EDA
Kühnert, C.:
--Mitglied im VDI/VDE-GMA-Fachausschuss 5.14
Krägelin, B.:
»Computational Intelligence«
--Mitglied der Gesellschaft für Informatik
--Mitglied der Fachgruppe »Arbeitsplatzsysteme«
der Gesellschaft für Informatik
Längle, T.:
--Paritätische Kommission zum Leistungsentgelt am IOSB
--Mitglied im VDI
--Mitglied Personalentwicklungskonzept 2 am IOSB
--Mitglied im Beirat der Deutschen Initiative für
--Program Chair International Conference on Optical
Netzwerkinformationen (DINI)
Characterization of Materials (OCM 2013) in Karlsruhe
--Mitglied Sprecherkreis IT-Sicherheitsbeauftragten der
Fraunhofer-Gesellschaft
Li, P.:
--Mitglied der Studiengangkommission Ingenieurinformatik
Krempel, E.:
--Mitarbeit in ETCETERA - Workshop: Validation of Future Civil
Security Technologies
--Mitarbeit in ETCETERA – Workshop: Framework Conditions
of Civil Security Technologies
134
--Mitglied der Stipendienkommission der chinesischen
Regierung für chinesische Studenten
--Beauftragter vom Rektor für den wissenschaftlichen
Austausch China-Südasien
Meidow, J.:
Pfrommer, J.:
--Mitglied der Deutschen Arbeitsgemeinschaft für Muster-
--Mitarbeit im Fachausschuss 7.21 »Industrie 4.0« der VDI/VDE-
erkennung e.V. (DAGM)
Gesellschaft Mess- und Automatisierungstechnik (GMA)
--Mitglied in der Deutschen Gesellschaft für Photogrammetrie
und Fernerkundung (DGPF)
--Mitglied im VDI
--Mitglied NATO-SET-167 Gruppe »Navigation Sensors and
Systems in GNSS Denied Environments«
Pfützenreuter, T.:
--Vertreter des IOSB-AST in der Gesellschaft für Maritime
Technik e.V.
--Vertreter des IOSB-AST im Subsea Monitoring Network
--Mitarbeit bei DEU – SWE Kooperation
»Navigation in Urban Terrain«
--Reviewer »Photogrammetrie – Fernerkundung –
Geoinformation (PFG)«
Rauschenbach, T.:
--Mitglied des VDI / VDE GMA-Fachausschuss 5.14
»Computational Intelligence«
--Reviewer »Measurement Science and Technology«
--Mitglied der Gesellschaft für Maritime Technik (GMT)
--Reviewer »Information Fusion«
--Mitglied im VDE
--Reviewer ISPRS Workshop »CMRT13«
--Mitglied IEEE, Oceanic Engineering Society
--Reviewer Konferenz »Fusion 2013«
--Mitglied Fraunhofer Allianz SysWasser
--Mitglied der Foren bei German Water Partnership
Meissner, A.:
(Länderforen China und Vietnam)
--Vertreter des Fraunhofer IOSB im BITKOM Arbeitskreis
Öffentliche Sicherheit
--Mitglied im Beirat des VfS - Verband für Sicherheitstechnik
--Mitglied der ISCRAM Association (Information Systems for
Repasi, E.:
--Mitglied der NATO-Gruppe SET-084 »Simulation of Active
Imaging Systems«
Crisis Response and Management)
Ritt, G.:
Michaelsen, E.:
--Co-Chair IAPR-TC7 (International Association for Pattern
--Mitglied der NATO-Gruppe SET-198
»Visible Laser Dazzle – Effects and Protection«
Recognition – Technical Committee 7, Remote Sensing and
Mapping)
--Associate Editor, Pattern Recognition Letters, Elsevier Verlag
Roller, W.:
--Mitglied BITKOM Arbeitskreis »Learning Solutions«
--Mitglied im Institutsbildungsausschuss (IBA) des IOSB
Middelmann, W.:
--Mitarbeit bei DEU - CHE Kooperation »Hyperspectral Imaging«
--Mitglied im Arbeitskreis» Personalentwicklungskonzept«
(PEK) des IOSB
--Mitarbeit bei Detection in Urban scenarios using Combined
Airborne imaging Sensors (DUCAS), EDA-Projekt (European
Defence Agency) PROJECT ARRANGEMENT No B0294 IAP3 GC
Okon, M.:
--Mitglied im Arbeitskreis Mess- und Automatisierungstechnik
(GMA) im VDI Bezirksverein Karlsruhe
135
n a m e n , d a t e n , e r e i g n i ss e
N a m e s , d at e s , e v e n t s
Mitarbeit in Gremien
Participation in Committees
Sauer, O.:
Schleipen, M.:
--Leitung des Fachbereichs »Informationstechnik« in der
--Mitarbeit in Arbeitsgruppe »DKE K941.0.2 AutomationML«
VDI-Gesellschaft GPP
--Leitung des VDI-GPL-Richtlinienausschusses
»Digitaler Fabrikbetrieb«
--Mitglied im VDI-GPL-Fachausschuss »Digitale Fabrik«
--Mitglied im VDI-GPP-Fachausschuss »MES«
--Mitglied des VDI-GPP-Richtlinienausschusses
»Logische Schnittstelle MES-Maschine«
--Mitglied in der VDA-ITA »Informationstechnologie für die
Automobilindustrie«
--Mitglied im CIRP »STC »O« Optimization of Manufacturing
Systems«
--Mitglied in der »OPC Foundation«
--Mitglied des Automotive Engineering Netzwerks Südwest
--Mitglied der smartFactoryKL
der Deutschen Kommission Elektrotechnik Elektronik
Informationstechnik
--Mitarbeit im DIN AK 060-30-05-04 des Normenausschuss
Maschinenbau (NAM, gepflegt durch den VDMA)
--Mitarbeit im Fachausschuss 6.12 »Durchgängiges Engineering
von Leitsystemen« der VDI/VDE-Gesellschaft Mess- und
Automatisierungstechnik (GMA)
--Mitarbeit in im Fachausschuss 7.21 »Industrie 4.0« der VDI/
VDE-Gesellschaft Mess- und Automatisierungstechnik (GMA)
--Mitarbeit im Fachausschuss 142 »Manufacturing
Execution Systems« der VDI-Gesellschaft Produkt- und
Prozessgestaltung (GPP)
--Mitarbeit in der Arbeitsgruppe »Digitaler Fabrikbetrieb« der
VDI-Gesellschaft Fördertechnik Materialfluss Logistik (FML)
--Vorstand Wirtschaftsstiftung Südwest
--Mitarbeit in der IEC Working group 9 of SC 65E
--Mitglied im VDI-Fachausschuss Modellierung und Simulation
--Stellvertretende Vorsitzende der Arbeitsgruppe »Schnitt-
--Mitglied im Fachbeirat Digitale Fabrik@Produktion
stellen MES Maschinenebene« des Fachausschusses 142
--Erstansprechpartner des IOSB in der Innovationsallianz der
»Manufacturing Execution Systems« der VDI-Gesellschaft
Technologieregion Karlsruhe
Produkt- und Prozessgestaltung (GPP)
Scharaw, B.:
Schönbein, R.:
--Head of Section Central Asia, GWP
--Mitglied der Deutschen Gesellschaft für Wehrtechnik e.V.,
-- Mitglied des wiss. Rates der Deutsch-Mongolischen Gesellschaft
Bonn
--Mitglied im Kharaa River Basin Administration
--Mitglied der Human Factors and Ergonomics Society, Santa
Schilling, H.:
--Mitglied im Fachausschuss T 5.4 Anthropotechnik, Deutsche
Monica, USA
--Mitarbeit bei DEU - CHE Kooperation
»Hyperspectral Imaging«
--Mitarbeit bei Detection in Urban scenarios using Combined
Airborne imaging Sensors (DUCAS), EDA-Projekt (European
Gesellschaft für Luft- und Raumfahrt (DGLR)
--Mitglied im Editorial Board of the International Journal On
Advances in Systems and Measurements (IARIA Journals)
--Mitglied im Programmausschuss ICONS
Defence Agency) PROJECT ARRANGEMENT No B0294 IAP3 GC
Schuchert, T.:
--Mitglied der Deutschen Arbeitsgemeinschaft für Mustererkennung e.V. (DAGM)
136
Schulz, K.:
Seiffer, D.:
-- Conference Co-Chair for the SPIE Conference »Earth Resources
--Mitwirkung in internationaler Arbeitsgruppe (SE, F, NL, UK)
and Environmental Remote Sensing/GIS Applications«, RS08
--Session Chair for the SPIE Conference Session »Infrastructures
and Urban Areas«, RS08
--Session Chair for the SPIE Conference Session
»Environmental Monitoring II«, RS08
--Deutsch-Israelische Kooperation TA 17, Working Group 4,
Hyperspectral Imaging
TA 108.019 »Laser beam propagation and imaging through
severe environments«
--Mitglied in der NATO SET-143 Gruppe »Radar and Infrared
Synergy for Military Situation Awareness«
--Mitwirkung in der Arbeitsgruppe ALWS »Airbone Platform
Effects On Laser Systems And Electro-Optical Warning
Sensors«
--Member of IEEE Geoscience and Remote Sensing Society
--Mitglied NATO-RTO-SCI-248 »Vulnerability of NATO operations to current and future commercial space-based Synthetic
Aperture Radar (SAR) sensors«
--Mitglied NATO-RTO-SET-145 »Extraction of Geospatial
Intelligence Information from Space Borne SAR Sensors«
--Reviewer » Photogrammetrie – Fernerkundung –
Geoinformation (PFG)«
Sprung, D.:
--Mitwirkung in der deutsch-israelischen Arbeitsgruppe SBMD
»Satellite Based Missile Detection«
--Mitwirkung in der Kooperation mit dem Kiepenheuer-Institut
für Solarphysik (KIS), Freiburg, »Bestimmung der optischen
Turbulenz am Observatorium VTT auf dem Teide / Teneriffa,
Spanien«
--Reviewer »Information Fusion« Elsevier
--Mitwirkung in der deutsch-israelischen Arbeitsgruppe mit
Schwarz, A.:
--Mitwirkung in der deutsch-südafrikanischen Kooperation mit
dem Soreq / Israel »Wind and turbulence measurements«
--Mitglied in der NATO SCI -230 Gruppe »Advanced Materials,
Systems and Evaluation Methods for Adaptive Camouflage «
dem CSIR Südafrika »Determination of the vertical distribution
of optical turbulence over savannah«
Schweitzer, C.:
Stein, K.:
--Mitwirkung in der deutsch-israelischen Arbeitsgruppe SBMD
--Chairman Konferenz »SPIE Remote Sensing«
»Satellite Based Missile Detection«
vom 23.-26.9.2013 in Dresden
--Chairman der NATO-SET-143 Gruppe »Radar and Infrared
Sander, J.:
--Technical Program Committee der 16th International
Conference on Information Fusion (Fusion 2013)
Synergy for Military Situation Awareness«
--Mitglied und Chairman der NATO SET-ET-082
»Naval Platform Protection in the EO/IR Domain«,
vom 14.-18.10.2013, Niederlande, Den Haag
Segor, F.:
--Mitglied im Programmausschuss ICONS
--Mitglied in der NATO SET-144 Gruppe »Mitigation of ship
Electro-Optical Susceptibility against Conventional and
Asymmetric Threats«
--Mitwirkung in der deutsch-israelischen Arbeitsgruppe SBMD
»Satellite Based Missile Detection«
--International Advisory Board IAB von FOCUS, Schweden
137
n a m e n , d a t e n , e r e i g n i ss e
N a m e s , d at e s , e v e n t s
Mitarbeit in Gremien
Participation in Committees
Steusloff, H.:
Thiele, A.:
--Kurator des Heinz Nixdorf Instituts, Universität Paderborn
--Reviewer »Photogrammetrie – Fernerkundung –
--Vorsitzender des DIN-Präsidialausschusses SO-FIE
(Forschung, Innovation, Entwicklung)
--Vorsitzender des DIN-Präsidialausschusses FOCUS ICT
--stellv. Vorsitzender der DKE (Deutsche Kommission
Geoinformation (PFG)«
--Reviewer IEEE Transactions on Geoscience and Remote
Sensing (TGRS)
--Reviewer IEEE Geoscience and Remote Sensing Letters (GRSL)
Elektrotechnik Elektronik Informationstechnik)
--Vorsitzender des DKE-Beraterkreises Technologie (BKT)
Thomalla, C.:
--Vorsitzender des DKE-Lenkungsausschusses »Elektromobilität«
--Mitarbeit im DIN AK 060-30-05-04 Normenausschuss
von DKE und DIN NAAutomobil
--Vorsitzender der DKE-Fokusgruppe »Netzintegration Lastmanagement und dezentrale Energieerzeugung« (NeLDE)
--stellv. Vorsitzender der Regionalkonferenz der
TechnologieRegion Karlsruhe
--Mitglied im Forschungsnetzwerk »Normung« des DIN
--Mitglied im Technologieausschuss der IHK Karlsruhe
Maschinenbau (NAM, gepflegt durch den VDMA),
--Mitarbeit im MES D.A.C.H Verband e.V.,
Technik Gruppe UMCM
--Mitglied im VDI/VDE-GMA Fachausschuss
»5.23 XML in der Automation«
--Mitglied in der Arbeitsgruppe »Logische Schnittstellen MES Maschinenebene« des VDI-KfIT, Fachausschuss 2.5.1 »MES«
--Mitglied im Cercle de l’ILL, Straßburg
--Mitglied im VDI
--Member of the China Instrument and Control Society (CIS)
--Mitglied in der Gesellschaft für Operations Research (GOR)
--Mitglied der Gesellschaft für Informatik (GI)
--IOSB-Beauftragter für das betriebliche Vorschlagswesen
--Mitglied im Verein Deutscher Ingenieure (VDI)
--Mitglied im Verband der Elektrotechnik Elektronik Informationstechnik e.V. (VDE)
Tchouchenkov, I.:
--Mitglied im Richtlinienausschuss VDI/VDE-GMA
--Mitglied im Beirat des Fachausschusses »Informatik« der
Fachgesellschaft GPP im VDI
--Mitglied im Wirtschaftsrat Deutschland, Sektion KarlsruheBruchsal
--Beiratsvorsitzender der IWRM (Integrated Water Resources
Management)-Konferenz 2014 der Karlsruher Messe- und
Kongress GmbH (KMK), Karlsruhe, 19.-20.11.2014
Usländer, T.:
-- Mitglied im VDI/VDE-GMA Fachausschuss 7.21 »Industrie 4.0«
- Begriffe, Referenzmodelle, Architekturkonzepte
--Mitglied im VDI Fachausschuss »Ressourceneffizienz«
--stimmberechtigter Vertreter der Fraunhofer-Gesellschaft im
Technical Committee des Open Geospatial Consortium (OGC)
--Vertreter der Fraunhofer-Gesellschaft im European Virtual
Tacke, M.:
--Mitglied RTB Research Technology Board
--Mitglied Beirat ISL
--Mitglied F&T Beirat des BMVg
--Member SET- 136 STANDEX-Steering Committee
Institute for Integrated Risk Management (EU-VRi)
--Technical Representative des IOSB im Industriekonsortium
Object Management Group (OMG)
--Vertreter des IOSB im Koordinierungsausschuss F+E IuK im
Rahmen der Kooperation MAF-UIS des Umweltministeriums
Baden-Württemberg
--Mitglied in der Arbeitsgruppe 5.11 »Computers and
Environment« der International Federation for Information
Processing (ifip)
138
Vieth, K.-U.:
Westermann, D.:
--Paritätische Kommission zum Leistungsentgelt am IOSB
--Mitglied im CIGRE SG B4, HVADC and FACTS, Strategic
--Stellvertreter im Wissenschaftlich-Technischen Rat der
Fraunhofer Gesellschaft am IOSB
Advisory Group
--Mitglied im CIGRE WG B4.58: »Devices for load flow control
and methodologies for direct voltage control in a meshed
Warweg, O.:
--Mitglied im NPE Unterarbeitsgruppe IKT
--Mitglied im VDE/ITG Energieinformationsnetze
HVDC grid«
--Mitglied im Lenkungskreis Hochspannungs- und
Höchstspannungsnetze des FNN
--Ordentliches Mitglied der Sächsischen Akademie der
Watson, K.:
--Co-Chair der GEO Health and Environment Community
of Practice
--Mitglied GEO Integrated Global Water Cycle Observations
Community of Practice
Wissenschaften, Technikwissenschaftlichen Klasse
--Mitglied im Beirat der Plattform Zukunftsfähige Energienetze
des Bundeswirtschaftsministeriums
--Mitglied im Vorstand der IEEE Germany Section
(Industry Relation Officer) und der IEEE Power & Energy
Society Germany (Treasurer)
Wendelstein, N.:
--Mitwirkung in internationaler Arbeitsgruppe (SE, F, NL, UK)
TA 108.019 »Laser beam propagation and imaging through
severe environments«
--Mitglied in der NATO-SET-174 Gruppe
Winkelmann, M.:
--Deutscher Vertreter in der Arbeitsgruppe» Multispectral
Camouflage Concealment and Deception« der deutschisraelischen Kooperation
»EO Sensor Performance Modeling«
Zielinski, A.:
Wenzel, A.:
--Mitglied Fraunhofer Allianz Embedded
--Mitglied VDI/VDE-GMA FA 7.20 Cyber Physical Systems
--Mitglied F-AG7 CLARIN »Angewandte Sprachwissenschaft,
Computerlinguistik«
--Mitglied der COST Action »Multilingual and multifaceted
interactive information access« (MUMIA)
Werling, S.:
--Beauftragter für Schutzrechte im IOSB (Patente, Marken etc.)
139
n a m e n , d a t e n , e r e i g n i ss e
N a m e s , d at e s , e v e n t s
Patente und Gebrauchsmuster 2013
Patents and utility models 2013
Anstett, G.; Ebert, R.:
Grafmüller, M.; Zopf, S.:
Jacubasch, A.:
Rehfeld, N.:
Einrichtung und Verfahren
Verfahren und Vorrichtung
Verfahren zum Betrieb
Verfahren zur Bildmarken-
zur Erkennung von Laser-
zur rechnergestützten
einer Werkzeugmaschine
unterstützten Bildauswer-
strahlung
Segmentierung wenigstens
sowie Werkzeugmaschine
tung
PCT/EP2013/071419
eines einen Code mit
DE 10 2007 021 070
Method for picture mark
Anmeldedatum 14.10.2013
wenigstens einer Codezeile
Veröffentlichungsdatum
supported image evalua-
enthaltenden Bildes
24.10.2013
tion
Beyerer, J.; Heizmann, M.;
DE 10 2012 208 025 A1
Frühberger, P.:
Publikationsdatum
Jakoby, A.; Feuchter, M.;
Anordnung und Verfahren
14.11.2013
Birnstill, P.:
zur multisensorischen
EP 2 092 486
Erteilungsdatum 30.1.2013
Netzübergangskom-
Scherer-Negenborn, N.;
Erfassung von Proben-
Hartrumpf, M.; Heintz, R.:
ponente mit Anfrage/
Lutzmann, P.; Scherer, C.:
bereichen einer Probe
Vorrichtung zur Klassi-
Antwort-Zuordnung und
Vorrichtung und Verfahren
DE 10 2013 205 001.1
fizierung transparenter
Überwachung
zur Messung von Schwin-
Anmeldedatum 21.3.2013
Bestandteile in einem
DE 10 2012 208 290 A1
gungen
Materialstrom
Publikationsdatum 7.11.2013
EP 13198785.1
Eberle, B.; Ritt, G.:
Device and method for the
Verfahren und Vorrichtung
classification of transparent
Jakoby, A.; Helwig, D.:
zur Begrenzung einer
component in a material
Hardware-Kryptomodul
Taphanel, M.:
transmittierten optischen
flow
und System zur Kommuni-
Vorrichtung zur optischen
Leistung und Entfernungs-
EP 2 212 035 B1
kation mit einer externen
Bestimmung der Ober-
messer
Erteilungsdatum 12.6.2013
Umgebung
flächengeometrie einer
DE 10 2013 201139.3
US 8,422,003 B2
DE 10 2013 223366.3
dreidimensionalen Probe
Anmeldedatum 24.1.2013
Erteilungsdatum 16.4.2013
Anmeldedatum 15.11.2013
Device for optically
Frühberger, P.; Heizmann, M.;
Hartrumpf, M.:
Paul, D.; Hartrumpf, M.;
geometry of a three-
Ijsselmuiden, J.;
Vorrichtung und Verfahren
Burkhard, M.; Palmer, M.:
dimensional sample
Peinsipp-Byma, E.:
zur optischen Charakteri-
Vorrichtung zur optischen
DE 10 2011 117 523 B3
Anordnung zum Abtasten
sierung von Materialien
Sortierung von Schüttgut
Erteilungsdatum 18.4.2013
einer Probenfläche sowie
Apparatus and method
Device and method for
WO 2013/064395
entsprechendes Verfahren
for optically characterizing
optically sorting bulk
Publikationsdatum 10.5.2013
DE 10 2013 206 546.9
materials
material
Anmeldedatum 12.4.2013
US 2013/0222803 A1
EP 2 537 598 B1
Publikationsdatum 29.8.2013
Veröffentlichungsdatum
Anmeldedatum 20.12.2013
determining the surface
4.12.2013
140
Vieth, K.-U.:
®
Verfahren zum Einrichten
einer dem optischen
Identifizieren von Objekten dienender Anlage,
Laborbildaufnahmesystem
zum Durchführen eines
solchen Verfahrens und
Anordnung umfassend das
Laborbildaufnahmesystem
™
®
™
sowie die Anlage
Method for preparing
a system which is used
to optically identifying
objects, laboratory
image capturing system
for carrying out such a
method, and arrangement
comprising the laboratory
image capturing system
and the system
Marken
DE 10 2012 001 868 A1
Publikationsdatum
25.7.2013
Wortmarke »CyphWay®«
PCT/EP2013/050693
DE 30 2013 006 547
Anmeldedatum: 16.1.2013
Eintragungstag 30.10.2013
WO 2013/110529
Publikationsdatum: 1.8.2013
Wortmarke »FETS®«
DE 30 2012 037 109
Willersinn, D.; Ruf, M.;
Eintragungstag 4.9.2013
Scheuermann, B.; Vais, A.;
Ziehn, J.; Rosenhahn, B.:
Wortmarke »THS®«
Verfahren zum Steuern
EM 011492758
eines Fahrzeugs, Vorrich-
Veröffentlichungstag
tung zum Erzeugen von
14.10.2013
Steuersignalen für ein
Fahrzeug und Fahrzeug
Wortmarke »TISIM®«
DE 10 2013 225 057.6
DE 30 2013 017 309
Anmeldedatum 5.12.2013
Eintragungstag 11.3.2013
141
Wissenschaftliche Veröffentlichungen finden sie im Web.
abstracts und volltexte unter: www.iosb.fraunhofer.de > Publikationen
You find scientific publications on the Web.
abstracts and whole texts: www.iosb.fraunhofer.de > Publications
Lehrtätigkeiten
teaching activities
Ament, C.:
--Regelungs- und Systemtechnik 1, SS 2013
--Regelungs- und Systemtechnik 2, WS 2013/14
--Modellbildung, WS 2013/14
-- Systemidentifikation, SS 2013
--Fuzzy und Neuro Control,
WS 2013/14
Fakultät für Informatik und
Automatisierung, Technische
Universität Ilmenau
Arens, M.:
--Einführung in die Bildfolgenauswertung, SS 2013
Fakultät für Informatik,
Karlsruher Institut für
Technologie (KIT)
Beyerer, J.:
--Mustererkennung, SS 2013
--Automatische Sichtprüfung
und Bildverarbeitung,
WS 2013/2014 (im WS
2013/2014 als beste
Wahlvorlesung durch die
Fakultät für Informatik des
KIT ausgezeichnet)
--Seminar: Technologiegestütztes Lernen, SS 2013
--Seminar: Bildauswertung
und -fusion, SS 2013 und
WS 2013/2014
--Proseminar: Anthropomatik:
Von der Theorie zur
Anwendung, SS 2013 und
WS 2013/2014 (gemeinsam
mit Prof. Uwe Hanebeck)
Fakultät für Informatik,
Karlsruher Institut für
Technologie (KIT)
142
Bier, C.; Birnstill, P.;
Krempel, E.:
--Blockseminar »Interdisziplinäres Seminar - Datenschutz
zwischen Technik und
Recht«, WS 2012/2013
Fakultät für Informatik,
Karlsruher Institut für
Technologie (KIT)
Bretschneider, P.:
--Vorlesungsbeitrag zum
Thema Energieprognose
im Rahmen der Lehrveranstaltung Elektrische
Energieversorgung III von
Prof. Westermann, SS 2013
Fakultät für Elektrotechnik
und Informationstechnik,
Technische Universität
Ilmenau
Flatt, H.:
--Embedded Systems Design,
WS 2013/2014
Fachbereich Elektrotechnik
und Technische Informatik,
Hochschule OstwestfalenLippe, Lemgo
Geggus, S.:
--Netzwerke und Bussysteme,
SS 2013
Fachbereich Mechatronik,
Duale Hochschule BadenWürttemberg (DHBW),
Karlsruhe
Geisler, J.:
--Mensch-Maschine-Wechselwirkung in der Anthropomatik: Basiswissen,
WS 2013/2014 (im WS
2013/2014 als beste
Wahlvorlesung durch die
Fakultät für Informatik des
KIT ausgezeichnet)
Fakultät für Informatik,
Karlsruher Institut für
Technologie (KIT)
Heizmann, M.:
--Einführung in die Informationsfusion, WS 2013/2014
Fakultät für Informatik,
Karlsruher Institut für
Technologie (KIT)
Heizmann, M.:
--Verteilte Messsysteme,
15.-19.4.2013
Blockveranstaltung am
Chinesisch-Deutschen
Hochschulkolleg (CDHK) der
Tongji-Universität, Shanghai,
China
Hübner, W.:
--Zweidimensionale Signale
und Systeme, WS 2013/2014
Fakultät für Elektrotechnik,
Karlsruher Institut für
Technologie (KIT)
Jasperneite, J.:
--Rechnernetze, SS 2013
-- Communication for distributed systems (CDS), SS 2013
--Maschinennahe Vernetzung,
WS 2013/2014
--Weitverkehrsnetze,
WS 2013/2014
--Protocol-Engineering/
Entwurf von Kommunikationsprotokollen, WS
2013/2014
Fachbereich Elektrotechnik
und Technische Informatik,
Hochschule OstwestfalenLippe, Lemgo
Längle, T.:
--Echtzeitsysteme, SS 2013
--Projektpraktikum Robotik
und Automation I+II,
SS 2013
--Informatik für Naturwissenschaftler und Ingenieure I,
WS 2013/2014
Fakultät für Informatik,
Karlsruher Institut für
Technologie (KIT)
--Kognitive Systeme,
WS 2013/2014
Fachbereich Informationstechnik, Duale Hochschule
Baden-Württemberg
(DHBW), Karlsruhe
Li, P.:
--Regelungs- und Systemtechnik 1, SS 2013
--Prozessoptimierung 1,
SS 2013
--Prozessoptimierung 2 /
Dynamische Optimierung /
Optimal Control, SS 2013
-- Hauptseminar Simulation und
Optimale Prozesse, SS 2013
--Prozessdynamik, SS 2013
--Projektseminar TKST,
SS 2013
--Prozessoptimierung 2,
WS 2013/2014
--Control Engineering,
WS 2013/2014
--Hauptseminar Simulation
und Optimale Prozesse,
WS 2013/2014
Fakultät für Informatik und
Automatisierung, Technische
Universität Ilmenau
Meidow, J:
-- Gastvorlesung »Ausgleichungsmodelle für Analyse
von Bildsequenzen«,
24.1.2013
Fakultät für Bauingenieur-,
Geo- und Umweltwissenschaften, Karlsruher Institut
für Technologie (KIT)
Monari, E.:
--Digital Image Processing,
SS 2013
Fakultät für Elektro- und
Informationstechnik, Hochschule Karlsruhe – Technik
und Wirtschaft
Müller, M.:
--Pattern Recognition / Masterstudiengang, Pflichtkurs,
SS 2013
Fakultät für Elektro- und
Informationstechnik, Hochschule Karlsruhe – Technik
und Wirtschaft
Niggemann, O.:
--Algorithmen und Datenstrukturen 1, SS 2013
--Verteilte Systeme, SS 2013
--Theoretische Informatik,
WS 2013/2014
--Algorithmen und Datenstrukturen 2, WS 2013/2014
Fachbereich Elektrotechnik
und Technische Informatik,
Hochschule OstwestfalenLippe, Lemgo
Pieper, C.:
--Hardware eingebetteter
Systeme, SS 2013
Fachbereich Elektrotechnik
und Technische Informatik,
Hochschule OstwestfalenLippe, Lemgo
Rauschenbach, T.:
--Diagnose- und Vorhersagesysteme, WS 2013/2014
Fakultät für Informatik und
Automatisierung, Technische
Universität Ilmenau
Roller, W.; Streicher, A.;
Szentes, D.; Kannegieser, E.:
--Seminar zum Technologiegestützten Lernen (TGL),
SS 2013
--Seminar in Kooperation mit
dem Forschungszentrum
Informatik (FZI), der Hochschule Karlsruhe für Technik
und Wirtschaft (HsKa) und
dem Institut für Berufspädagogik (KIT/IBP) für die
Fachrichtungen Informatik,
Informationswirtschaft und
Wirtschaftswissenschaften,
Karlsruher Institut für
Technologie (KIT)
Scharaw B.:
--Integriertes Wasserressourcenmanagement, 11.-27.1. /
11.-21.4. / 26.5.-1.6. /
10.-14.11.2013
Faculty of Construction
and Water Technology,
Mongolian University of
Science and Technology
--Integriertes Wasserressourcenmanagement,
18.-30.9.2013
China Agricultural University
in Hohhot, China
Schuchert, T.:
--Grundlagen der Informatik I,
WS 2013/14
Fakultät für Elektro- und
Informationstechnik, Hochschule Karlsruhe -Technik
und Wirtschaft
Tchouchenkov, I.:
--Praxis der Softwareentwicklung (PSE), Kamerabasierte
Steuerung eines Mikroquadrokopter-Schwarm,
WS 2013/2014
Fakultät für Informatik,
Karlsruher Institut für
Technologie (KIT)
Wenzel, A.:
--Mikroprozessortechnik,
SS 2013
--Mikrocontrollertechnik,
WS 2013/2014
--Embedded Systems,
WS 2013/2014
Fakultät Elektrotechnik,
Fachhochschule
Schmalkalden
Widak, H.:
-- Labor Digitaltechnik, SS 2013
Fakultät für Elektro- und
Informationstechnik, Hochschule Karlsruhe – Technik
und Wirtschaft
Zielinski, A.:
--Korpuslinguistik, SS 2013
--Text Mining, WS 2013/2014
Institut für Computerlinguistik,
Ruprecht-Karls-Universität
Heidelberg
143
Dissertationen
Dissertations
Franz, Stefan
Anpassung perzeptiver Komponenten von
Fahrerassistenzsystemen
Fakultät für Elektrotechnik und Informationstechnik,
Karlsruher Institut für Technologie (KIT)
Gruna, Robin
Beleuchtungsverfahren zur problemspezifischen
Bildgewinnung für die automatische Sichtprüfung
Fakultät für Informatik, Karlsruher Institut für Technologie (KIT)
Kühnert, Christian
Data-driven methods for fault localization in
process technology
Fakultät für Informatik, Karlsruher Institut für Technologie (KIT)
Müller, Markus
Szeneninterpretation unter Verwendung multimodaler
Sensorik und Salienzmaßen
Fakultät für Elektrotechnik und Informationstechnik, Karlsruher Institut für Technologie (KIT)
Vagts, Hauke
Privatheit und Datenschutz in der intelligenten
Überwachung: Ein datenschutzgewährendes System,
entworfen nach dem »Privacy by Design«-Prinzip
Fakultät für Informatik, Karlsruher Institut für Technologie (KIT)
144
Vorträge
lectures
Prof. Beyerer auf der FISCCDM Konferenz in Riyadh, Saudi-Arabien.
Adomeit, U.; Müller, K.:
Focal Plane Arrays as Alternatives to Image Intensifier
Tubes – Comparison of Different Detector Technologies.
IDGA’s 8th Annual Night Vision Systems Conference, USA,
Arlington, 31.7.2013
Adomeit, U.:
Verfahren zur Leistungssteigerung von Wärmebildgeräten.
Seminar SE 1.02 »Infrarottechnik – Grundlagen, Trends und
moderne Anwendungen« der Carl-Cranz-Gesellschaft e.V.,
Oberpfaffenhofen, 7.-10.10.2013
Adomeit, U.; Müller, K.:
Experimentelle Bewertung passiver bildgebender Sensorik
am IOSB. Vortrag Symposium Bewertung Wärmebildgeräte,
WTD 91, Meppen, 9.-10.10.2013
Adomeit, U.; Schuberth, W.:
IR-Detektorentwicklung. Seminar SE 3.11 »Warnsensorik
(UV, IR, mmW, Terahertz) und Gegenmaßnahmen« der CarlCranz-Gesellschaft e.V., Oberpfaffenhofen, 19.-21.11.2013
Adomeit, U.; Schuberth, W.:
Thermisches Reichweitenmodell zur Punktzielauffassung
(TRP). Seminar SE 3.11 »Warnsensorik (UV, IR, mmW, Terahertz)
und Gegenmaßnahmen« der Carl-Cranz-Gesellschaft e.V.,
Oberpfaffenhofen, 19.11.2013
Anstett, G.:
Active and Passive Imaging Sensor Developments for
Security Applications. 21st International Congress on Photonics in Europe – collocated with LASER World of Photonics
2013, München, 13.-16.5.2013
Anstett, G.:
Neue Sensorkonzepte: THz-Technologie und -Sensoren.
Seminar SE 1.04 »Neue Lasersensoren für den militärischen
und sicherheitsrelevanten Einsatz« der Carl-Cranz-Gesellschaft
e.V., Ettlingen, 23.-24.4.2013
Batz, T.:
-- FLIWAS 3.0: Anwendungsfallbeschreibung – Vorstellung
der Methode, Beispiele.
-- FLIWAS 3.0: Anwendungsfälle für BW – Vorstellung
und Diskussion der bisherigen Entwürfe.
Auftaktveranstaltung FLIWAS 3.0, Stuttgart, 11.9.2013
Batz, T.; Schillinger, W.:
Messungen und Naturschutz: Perspektiven mit FLIWAS
3.0 - Benutzerorientierte Ausprägungen, Nutzung mit
mobilen Endgeräten. 4. Arbeitstagung Land-KommunenKooperation FLIWAS Baden-Württemberg, Stuttgart, 28.11.2013
Vortrag: Batz
Baumann, M.:
Combining interactive and automated scheduling.
SYSTEMA Expert Day, Dresden, 24.1.2013
Beyer, D.:
Comparison of the energy storage requirements potentials between the market and energy network oriented
approach. IEA ECES 26 6th Meeting of Annex 26, DLR,
Stuttgart, 9.7.2013
Beyer, D.:
Analyse des regional und zeitlich aufgelösten Energieausgleichsbedarfs in Deutschland zur Kompensation
volatiler Energieerzeugung unter Berücksichtigung der
Leitungsbelastung im Übertragungsnetz. VDE ETG 2013,
Berlin, 5.-6.11.2013
Beyerer, J.:
Optical Characterization of Materials. International Conference on Optical Characterization of Materials (OCM 2013),
Karlsruhe, 6.-7.3.2013
Beyerer, J.:
Neue Technologien im Spannungsfeld zwischen Nutzen
und informationeller Selbstbestimmung – Erläutert
am Beispiel der Videoüberwachung. acatech - Deutsche
Akademie der Technikwissenschaften e.V., Themennetzwerk
Sicherheit, Braunschweig, 16.4.2013
145
Vorträge
lectures
Beyerer, J.:
Technologies for Holistic Crisis Management.
10th International Conference on Information Systems for Crisis
Response and Management, ISCRAM 2013, Baden-Baden,
12.-15.5.2013
Beyerer, J.:
Nutzen und Herausforderungen von Überwachungsund Diagnose-Systemen. VDI-Fachkonferenz »Zustandsüberwachung und Optimierung«, Karlsruhe, 12.-13.6.2013
Beyerer, J.:
Modern Technologies for Crisis Management. (Keynote
Speech) The First Saudi International Conference on Crisis and
Desaster Management, Saudi Arabien, Riyadh, 8.-9.9.2013
Beyerer, J.:
Die Kamera – Dein Freund und Helfer - Datenschutz und
Privatheit gewährende Technologien für die Videoüberwachung. Rotary Club Schwetzingen-Walldorf, Walldorf,
8.10.2013
Beyerer, J.:
Sicherheit braucht ein querschnittliches Theorierückgrat.
acatech - Deutsche Akademie der Technikwissenschaften e.V.,
Themennetzwerk Sicherheit, Karlsruhe, 23.10.2013
Beyerer, J.:
Videoüberwachungssysteme der nächsten Generation.
Seminar VS 10.05 »Videoüberwachung für Sicherheitsaufgaben« der Carl-Cranz-Gesellschaft e.V., Karlsruhe,
12.-14.11.2013
Beyerer, J.:
Sehen, Verstehen, Vernetzen. Sehen, Verstehen, Vernetzen
– Technologien des Fraunhofer IOSB für den Bedarf der
Streitkräfte, Karlsruhe, 13.11.2013
146
Beyerer, J.:
-- Polizeirelevante Forschung am IOSB.
-- Digitale Bild- und Videoauswertung.
Sondersitzung der AG Kripo und UA FEK, Austausch mit
Fraunhofer bezüglich polizeirelevanter Forschung, Karlsruhe,
21.11.2013
Beyerer, J.:
Intelligente Videoüberwachung – Beschützer oder
Big Brother? Symposium »Netzwert« 2013, FraunhoferGesellschaft, München, 3.-4.12.2013
Bohn, S.:
SuperGrid – Das europäisch-nordafrikanische HGÜOverlay-Netz der Zukunft. Internationaler ETG-Kongress
2013, »Energieversorgung auf dem Weg nach 2050«, Berlin,
5.-6.11.2013
Boldt, M:
Using Morphological Differential Attribute Profiles for
Chance Categorization in High Resolution SAR Images.
ISPRS Hannover Workshop 2013, Hannover, 21.-24.5.2013,
Posterpräsentation am 23.5.2013
Bretschneider, P.:
Herausforderungen für Strommarkt und Stromnetze –
Aspekte zu den 12 Thesen der AGORA-Energiewende.
Energiebeirat Thüringer Ministerium für Wirtschaft, Arbeit und
Technologie, Erfurt, 4.2.2013
Bretschneider, P.; Pflugradt, S.; Karstädt, F.; Ritter, S.; Schaller, F.:
Optimale Betriebsführung virtueller Kraftwerke mit
und ohne Berücksichtigung von Netzrestriktionen.
VDI-Konferenz: Virtuelle Kraftwerke; Karlsruhe, 5.-6.3.2013
Bretschneider, P.:
Beiträge energieeffizienter Städte zur Energiewende.
Energieeffizienz - Aktuelle Entwicklungen und praktische
Ergebnisse, Förderverein Gaszentrale e.V., Unterwellenborn,
29.8.2013
Bretschneider, P.; Pflugradt, S.; Karstädt, F.; Ritter, S.; Schaller, F.:
Betriebsführung dezentraler Erzeuger- und Speicheranlagen. Konferenz Energy EcoSystems, Leipzig, 23.-24.9.2013
van de Camp, F.; Voit, M.; Geisler, J.:
Interaktive Visualisierung großräumiger Lagen.
4. Expertentreffen »Weltraumlagezentrum«, Kalkar, 30.4.2013
Bretschneider, P.:
Smart Cities - Visionen und Ansätze für Städte von morgen.
Fachtagung Stadt Licht + Verkehr, Leipzig, 28.11.2013
van de Camp, F.; Schührer, P.; Stiefelhagen, R.:
How to choose element sizes for novel interactive
systems. ITS, Schottland, St. Andrews, 6.-9.10.2013
Bulatov, D.:
Detection of Small Roof Details in Image Sequences.
18th Scandinavian Conference on Image Analysis, Finnland,
Espoo, 20.6.2013
Dimitrov, T.:
Combining interactive and automated scheduling.
SYSTEMA Expert Day, Dresden, 24.1.2013
Bulatov, D.:
Comparison of an L1-MCDA-based and a RANSAC-based
Planar Segmentation Procedure. SPIE-Conference on Earth
Resources and Environmental Remote Sensing/GIS Applications,
Dresden, 23.9.2013
Bürsing, H.:
Neue Sensorkonzepte mit ultra-kurzen Laserpulsen.
Seminar SE 1.04 »Neue Lasersensoren für den militärischen
und sicherheitsrelevanten Einsatz« der Carl-Cranz-Gesellschaft
e.V., Ettlingen, 23.-24.4.2013
Bürsing, H.:
Flash Lager zur Echtzeitgewinnung von Entfernungsbildern. Sehen, Verstehen, Vernetzen – Technologien des
Fraunhofer IOSB für den Bedarf der Streitkräfte, Karlsruhe,
13.11.2013
van de Camp, F.; Stiefelhagen, R.:
Applying Force Fields to Black-Box GUIs Using Computer
Vision. IEEE Workshop on the Applications of Computer
Vision 2013, USA, Clearwater, 17.-18.1.2013
van de Camp, F.; Stiefelhagen, R.:
glueTK - A Framework for Multi-Modal, Multi-Display
Human-Machine-Interaction. International Conference on
Intelligent User Interfaces, USA, Santa Monica, 21.3.2013
Eberle, B.; Dengler, S.; Ritt, G.; Muller, O.:
Laser Protection of Optronical Sensors with Nanoparticles.
41st Freiburg Infrared Colloquium, Freiburg, 26.-27.2.2013
Eberle, B.:
-- Herausforderungen für Lasersensoren im militärischen
und sicherheitsrelevanten Einsatz.
-- Operationelle Grundlagen für Lasersensoren.
-- Laserradar-Verfahren und -Systeme.
-- Fernerkennung von Bedrohungen und Gefahren.
Seminar SE 1.04 »Neue Lasersensoren für den militärischen
und sicherheitsrelevanten Einsatz« der Carl-Cranz-Gesellschaft
e.V., Ettlingen, 23.-24.4.2013
Eberle, B.:
Laser-Radarsysteme für Zielaufklärung und Navigation.
Seminar SE 2.28 »Intelligente Sensorik I – Grundlagen und
Anwendungen« der Carl-Cranz-Gesellschaft e.V.,
Oberpfaffenhofen, 3.-6.6.2013
Eberle, B.:
-- Potenzial zukünftiger Laser-Sensoren.
-- Zukünftige passive Infrarot-Sensoren.
Seminar SE 2.31 »Intelligente Sensorik II – Entwicklungspotential und zukünftige Systeme« der Carl-Cranz-Gesellschaft e.V.,
Oberpfaffenhofen, 16.-19.9.2013
147
Vorträge
lectures
Eberle, B.:
Initial Briefing to: NATO Science & Technology Organization Sensors & Electronics Technology Panel bezüglich der
Aktivitäten in NATO SET-198/RTG »Visible Laser Dazzle
– Effects and Protection«. 32nd Panel Business Meeting,
Norwegen, Oslo, 23.-25.10.2013
Eberle, B.:
Laser-Hinderniswarnung. Seminar SE 3.11 »Warnsensorik
(UV, IR, mmW, Terahertz) und Gegenmaßnahmen« der CarlCranz-Gesellschaft e.V., Oberpfaffenhofen, 19.-21.11.2013
Ebert, R.:
Status und Perspektiven der Nachtsichtsensorik.
Forschungs- und Technologiesymposium »Sensortechnologien«,
Bildungszentrum der Bundeswehr (BiZBw), Mannheim,
4.-5.6.2013
Emter, T.:
3D-Kartierung und Lokalisierung mittels Normal Distribution Transform. DWT-Forum »Unmanned Vehicles IV«,
Bonn-Bad Godesberg, 28.-29.5.2013
Essendorfer, B.:
Coalition Shared Data. Combined ASIISG and Joint JISR
Panel. NATO Headquarters, Belgien, Brüssel, 20.3.2013
Fetzner, A.:
Multisensor-basierte Kontrollkonzepte für humanoide
Roboter. Symposium »Netzwert« 2013, FraunhoferGesellschaft, München, 3.-4.12.2013
Fischer, Y.; Beyerer, J.:
Ontologies for Probabilistic Situation Assessment in
the Maritime Domain. CogSIMA 2013, USA, San Diego,
25.-28.2.2013
Fischer, Y.; Unmüßig, G.:
Architektur von Videoüberwachungssystemen und HMI.
Seminar VS 10.05 »Videoüberwachung für Sicherheitsaufgaben«
der Carl-Cranz-Gesellschaft e.V., Karlsruhe, 12.-14.11.2013
148
Fischer, Y.:
Interaktive Situationsanalyse am Beispiel der maritimen
Überwachung. Sehen, Verstehen, Vernetzen – Technologien
des Fraunhofer IOSB für den Bedarf der Streitkräfte, Karlsruhe,
13.11.2013
Flatt, H.:
Systeme entwickeln - aktuelle Forschungsschwerpunkte
und Anwendungen. Elektronik Forum OWL - Intelligentes
Energiemanagement eingebetteter Systeme, Lemgo, 15.10.2013
Flemming, S.; Bretschneider, P.:
Regionale Energieausgleichsbedarfe. 2.Regionale Energiekonferenz Südwestthüringen, Suhl, 20.11.2013
Frey, C.:
Assistenzsystem zum effizienten Fahren. Nutzfahrzeugmesse Karlsruhe NUFAM, Messe Karlsruhe, 26.9.2013
Gabler, R.:
Sensordatenfusion für elektrooptische Sensoren.
Seminar SE 2.18 »Multisensordatenfusion: Grundlagen
und Anwendungen« der Carl-Cranz-Gesellschaft e.V.,
Wachtberg-Werthhoven, 9.-11.4.2013
Gabler, R.:
Bildauswerteverfahren für Warnsensoren.
Seminar SE 3.11 »Warnsensorik (UV, IR, mmW, Terahertz)
und Gegenmaßnahmen« der Carl-Cranz-Gesellschaft e.V.,
Oberpfaffenhoven, 19.-21.11.2013
Gelo, S.:
Theorie und Methoden der Farbmessung.
Fraunhofer Allianz Vision – Inspektion und Charakterisierung
von Oberflächen mit Bildverarbeitung, Karlsruhe, 4.12.2013
Göhler, B.; Lutzmann, P.:
Recent developments of the Gated-Viewing system
demonstrator at Fraunhofer IOSB. 4th Workshop on Active
Imaging, French-German Research Institute of Saint-Louis (ISL),
Frankreich, Saint-Louis, 20.-21.11.2013
Groß, W.:
Evaluation of Spectral Unmixing using Nonnegative
Matrix Factorization on Stationary Hyperspectral Sensor
Data of Specifically Prepared Rock and Mineral Mixtures.
International Conference for Optical Characterization of
Materials (OCM 2013), Karlsruhe, 6.-7.3.2013
Hammer, H.:
Sensordatenfusion für interaktive Luft- und Satellitenbildauswertung. Seminar SE 2.18 »Multisensordatenfusion:
Grundlagen und Anwendungen« der Carl-Cranz-Gesellschaft
e.V., Wachtberg-Werthhoven, 9.-11.4.2013
Hammer, J.H.; Beyerer, J.:
Robust Hand Tracking in Realtime Using a Single
Head-Mounted RGB Camera. HCI International 2013,
USA, Las Vegas, 25.7.2013
Hammer, J.H.; Maurus, M.; Beyerer, J.:
Real-Time 3D Gaze Analysis in Mobile Applications.
ETSA 2013, South Africa, Cape Town, 31.8.2013
Hebel, M.:
Automatische Änderungsdetektion beim vorwärtsblickenden Airborne Laser Scanning urbaner Gebiete.
18. Münchner Fortbildungsseminar Geoinformationssysteme,
München, 10.4.2013
Heinze, N.:
Multisensorielle Videoauswertung für die Überwachung
und Aufklärung mit UA. SGW-Forum UV (unmanned vehicles)
IV, Bonn-Bad Godesberg, 28.5.2013
Heinze, N.:
Echtzeitauswertung von »Full-Motion-Video« für Aufklärung mit AUS. Forschungs- und Technologiesymposium
»Sensortechnologien«, Bildungszentrum der Bundeswehr
(BiZBw), Mannheim, 4.6.2013
Heinze, N.; Brüstle S.; Orlov, Z.:
Videoaufbereitung, Archivierung und Recherche. Seminar
VS 10.05 »Videoüberwachung für Sicherheitsaufgaben« der
Carl-Cranz-Gesellschaft e.V., Karlsruhe, 12.-14.11.2013
Heizmann, M.:
Inspektion stark reflektierender Objekte. Mehr sehen mit
dem richtigen Licht – Innovative Beleuchtungslösungen für
Machine-Vision-Anwendungen, SPECTARIS-Wissensraum,
Waldbronn, 18.6.2013
Heizmann, M.; Emter, T.; Petereit, J.:
Mobile Roboter zur Überwachung von Liegenschaften.
Seminar VS 10.05 »Videoüberwachung für Sicherheitsaufgaben«
der Carl-Cranz-Gesellschaft e. V., Karlsruhe, 12.-14.11.2013
Heizmann, M.:
Theorie und Methoden der 3-D-Vermessung von
Oberflächen. Seminar »Inspektion und Charakterisierung von
Oberflächen mit Bildverarbeitung«, Fraunhofer Allianz Vision,
Karlsruhe, 4.-5.12.2013
Heizmann, M.:
Texturanalyse. Seminar »Inspektion und Charakterisierung
von Oberflächen mit Bildverarbeitung«, Fraunhofer Allianz
Vision, Karlsruhe, 4.-5.12.2013
Herzog, R.:
Where is the Business in the IoT?
Future Internet Assembly (FIA), Irland, Dublin, 8.-10.5.2013
Hild, J.; et al.:
Evaluating Multi-Modal Eye Gaze Interaction for Moving
Object Selection. The Sixth International Conference on
Advances in Computer-Human Interactions (ACHI), Frankreich,
Nizza, 26.2.2013
Hild, J.; Fischer, Y.; Peinsipp-Byma, E.; et al.:
Gaze-based interaction for real-time video surveillance
systems. 8th Future Security Security Research Conference,
Berlin, 17.-16.9.2013
149
Vorträge
lectures
Jacobi, M.; Karimazira, D.:
Underwater pipeline and cable inspection using autonomous underwater vehicles. OCEANS’13 MTS/IEEE Bergen,
Norwegen, Bergen, 10.-13.6.2013
Jakoby, A.:
Mein Netz – mein Handy – meine Daten.
IT & Media, Darmstadt, 25.4.2013
Jakoby, A.:
The CYSPA alliance – Vision and Timeline. 3rd SAP for
Nuclear Infoday, SAP Headquarters, Walldorf, 22.5.2013
Jasperneite, J.:
Industrie 4.0 : Wie kommt die Intelligenz in die Maschine?
– Projektbeispiele aus dem BMBF-Spitzencluster „Intelligente Technische Systeme OstwestfalenLippe“ einbringen.
Vortragsreihe INDUSTRIE 4.0 – Kompetenz aus NRW (Cluster
ProduktionNRW), Hannover Messe 2013, Hannover, 11.4.2013
Jasperneite, J.:
Industrie 4.0 zum Anfassen in der Lemgoer Modellfabrik.
Forum Industrial IT des ZVEI anlässlich der Hannover Messe
2013, Hannover, 11.4.2013
Jasperneite, J.:
Industrie 4.0: Alter Wein in neuen Schläuchen.
Sick AG Automobiltage 2013, Waldkirch, 18.6.2013
Jasperneite, J.:
Smart Factories, CPS und Industrie 4.0. Bitkom Akademie
Workshop »Auf dem Weg zum Internet der Dinge«,
Herzogenrath, 11.7.2013
Jasperneite, J.:
Wie die Intelligenz in die Fabrik kommt!
1. Markt&Technik Summit Industrie 4.0 WEKA FACHMEDIEN,
München, 16.10.2013
150
Karimanzira, D.; Jacobi, M.; Pfützenreuter, T.; Rauschenbach, T.;
Eichhorn, M.; Taubert, R.; Ament, C.:
AUV Mission (Re)Planning and Guidance Concept for
Water Quality Monitoring. 7th IFIP International Conference
on Computer and Computing Technologies in Agriculture,
China, Beijing, 18.9.-20.9.2013
Karstädt, F.:
Analyse und Prognose der Technologien und
Anwendungsfelder thermischer und elektrischer
Energiespeicher auf Nieder- und Mittelspannungsebene.
Zwischenbericht, Beiratssitzung der Thüringer Energie- und
GreenTech-Agentur (ThEGA), Thüringer Ministerium für
Wirtschaft, Arbeit und Technologie, Erfurt, 6.9.2013
Käßler, M.:
Energiemanagement für die Energiewende.
E-world 2013, Forum Energiewende, Essen, 7.2.2013
Käßler, M.:
Energiemanagement für die Energiewende. Hannover
Messe Industrie 2013, BEE Forum, Hannover, 9.4.2013
Käßler, M.:
Energiewende: Status Quo. EMS-EDM PROPHET
Anwendertage 2013, Auerstedt, 5.6.2013
Käßler, M.:
Energiewende: Status Quo. 14. Schönauer Stromseminar,
Schönau, 6.7.2013
Kaufmann, I.:
Aktive Sensorik für den Nahbereich. Seminar SE 1.04
»Neue Lasersensoren für den militärischen und sicherheitsrelevanten Einsatz« der Carl-Cranz-Gesellschaft e.V., Ettlingen,
23.-24.4.2013
Klaiber, S.; Bretschneider, P.; Waczowicz, S.; Mikut, R.;
Konotop, I.; Westermann, D.:
Intelligente Prognoseverfahren für beeinflusstes
Verbrauchsverhalten in Energiesystemen. 23. Workshop
Computational Intelligence, Dortmund, 5.-6.12.2013
Klaiber, S.; Warweg, O.; Nicolai, S.; Bretschneider, P.:
Evaluation of Energy Storages for the Optimization of
Wind Energy Integration Based upon Different Forecast
Error Scenarios. Uta Betancourt (Hg.): Proceedings / 12th
Wind Integration Workshop, International Workshop on
Large-Scale Integration of Wind Power into Power Systems as
well as on Transmission Networks for Offshore Wind Power
Plants, Vereinigtes Königreich Großbritannien und Nordirland,
London, 22.-24.10.2013
Konnerth, K.:
Camouval – Automatic Camouflage Evaluation.
9th International IR Target and Background Modeling &
Simulation Workshop, Frankreich, Toulouse, 10.-13.6.2013
Krempel, E.:
Videoüberwachung und Privatsphäre. SIRA-Abschlusskonferenz »Innere Sicherheit seit dem 9/11; Zur Akzeptanz
von Sicherheitsmaßnahmen in Theorie und Praxis«, München,
7.-8.11.2013
Krempel, E.:
Privatheit und Datenschutz. Seminar VS 10.05 »Videoüberwachung für Sicherheitsaufgaben« der Carl-CranzGesellschaft e.V., Karlsruhe, 12.-14.11.2013
Kuntze, H.-B.; Frey, C.; Emter, T.; Petereit, J.; Tchouchenkov, I.;
Müller, T.:
SENEKA - Sensornetzwerk mit mobilen Robotern für das
Katastrophenmanagement. Fraunhofer Innovationscluster
Future Urban Security Baden-Württemberg, Freiburg, 11.7.2013
Kuny, S.:
Simulation based texture analysis of heaps of debris
for damage assessment in high resolution SAR data.
6th International Conference on Recent Advances in Space
Technologies (RAST 2013), Türkei, Istanbul, 12.-14.6.2013
Kuny, S.:
Signature analysis of destroyed buildings in simulated
high resolution SAR data. International Geoscience and
Remote Sensing Symposium (IGARSS 2013), Australien,
Melbourne, 21.-26.7.2013
Kunz, S.; van der Schaaf, H.; Watson, K.:
Fraunhofer experience with a mobile app to record
health data in the field. Uganda prototype – Design and
Implementation. Workshop OGC Location Standards for
Next Generation LBS, Spanien, Barcelona, 27.2.1013
Vortrag: van der Schaaf
Kuwertz, A.:
Ontology-Based Meta Model in Object-Oriented World
Modeling for Interoperable Information Access. ICONS
2013, The Eighth International Conference on Systems,
Spanien, Sevilla, 27.1. - 1.2. 2013
Kuwertz, A.:
Knowledge Model Quantitative Evaluation for Adaptive
World Modeling. IEEE Conference on Cognitive Methods in
Situation Awareness and Decision Support (CogSIMA 2013),
USA, San Diego, 25.-28.2.2013
Kuwertz, A.:
An Architectural Framework for ISR Analytics. NATO
Symposium on Architecture Assessment for NEC (SCI-254),
Estland, Tallinn, 14.-15.5.2013
Kuwertz, A.:
Quantitative Measures for Adaptive Object-Oriented
World Modeling. 4th Workshop on Dynamics of Knowledge
and Belief, 36th Annual German Conference on Artificial
Intelligence (KI-2013), Koblenz, 17.9.2013
Längle, T.:
Color Control for signature analysis of granular objects.
17. SpectroNet Collaboration Forum 2013, Jena, 28.8.2013
151
Vorträge
lectures
Längle, T.:
Bildgewinnung bei der Oberflächenprüfung.
Fraunhofer Allianz Vision – Inspektion und Charakterisierung
von Oberflächen mit Bildverarbeitung, Karlsruhe, 4.12.2013
Negara, C.:
On-line visualization and analysis of multispectral data
in industry. 16th SpectroNet Collaboration Forum, Karlsruhe,
5.3.2013
Lutzmann, P.:
-- Gated-Viewing Systeme.
-- Laser Vibrometrie.
Seminar SE 1.04 »Neue Lasersensoren für den militärischen
und sicherheitsrelevanten Einsatz« der Carl-Cranz-Gesellschaft
e.V., Ettlingen, 23.-24.4.2013
Nicolai, S.:
Betriebsführung eines hybriden Speichersystems – Entwurf
und Implementierung im Projekt Smart Region Pellworm.
Workshop »Hybride Energiespeichersysteme für die
Energiewende«, TU Chemnitz, Chemnitz, 7.11.2013
Middelmann, W.:
Hyperspektralsensorik zur Erkennung und Spezifizierung
von Tarnmaterialien und zur Entdeckung von IEDs.
Forschungs- und Technologiesymposium »Sensortechnologien«,
Bildungszentrum der Bundeswehr (BiZBw), Mannheim,
4.-5.6.2013
Middleton, S.; Moßgraber, J.; Tao, R.:
A Geo-Distributed System Architecture for Different
Domains. Posterpräsentation im Rahmen der European
Geosciences Union General Assembly 2013, Österreich,
Wien, 7.-12.4.2013
Vortrag: Moßgraber
Monari, E.:
Intelligente Videoanalyse für verteilte Kamerasysteme.
SIMEDIA Forum Videoüberwachung/Videotechnik, Berlin,
15.5.2013
Monari, E.:
Automatische Sensorselektion zur videobasierten
Objektverfolgung in großen Kameranetzen. Seminar
VS 10.05 »Videoüberwachung für Sicherungsaufgaben«
der Carl-Cranz-Gesellschaft e.V., Karlsruhe, 12.-14.11.2013
Müller, M.:
Kameras, Schnittstellen, mobile Kameraträger. Seminar
VS 10.05 »Videoüberwachung für Sicherungsaufgaben« der
Carl-Cranz-Gesellschaft e.V., Karlsruhe, 12.-14.11.2013
152
Peinsipp-Byma, E.:
Technische Innovationen zum Sicherheitsmanagement.
SIMEDIA, Stuttgart, 10.9.2013
Peinsipp-Byma, E.:
Optimale Mensch-Computer-Kooperation durch intuitive
Mensch-Computer-Interaktion. UPA-Treffen der UPARegionalgruppe Karlsruhe, 18.11.2013
Pfrommer, J.:
Dynamic vehicle redistribution and online price incentives in shared mobility systems. Invited Seminar Talk at the
Institute for Transport Planning and Systems (IVT), ETH Zurich,
Schweiz, Zürich, 22.4.2013
Pfützenreuter, T.; Rauschenbach, T.; Jacobi, M.:
Monitoring and Inspection of Hydropower stations and
Dams with Unmanned Underwater Vehicles. Hydropower
2013--CHINCOLD 2013 Annual Meeting and the 3rd
International Symposium on Rockfill Dams, China, Kunming,
1.11.-3.11.2013
Pohl, M.:
Extraction and Refinement of Building Faces in 3D Point
Clouds. SPIE-Conference on Earth Resources and Environmental
Remote Sensing / GIS Applications, Dresden, 24.9.2013
Putze, F.; Hild, J.; Kärgel, R.; Herff, C.; Redmann, A.; Beyerer, J.;
Schultz, T.:
Locating User Attention Using Eye Tracking and EEG for
Spatio-Temporal Event Selection. International Conference
on Intelligent User Interfaces, USA, Santa Monica, 21.3.2013
Rauschenbach, T.:
Application of Underwater Vehicles in Fish Farming.
7th IFIP International Conference on Computer and Computing
Technologies in Agriculture, China, Beijing, 18.-20.9.2013
Rauschenbach, T.:
Aspects of Water Resources Mangement. International
Conference on Water Resources Management on the occasion
of the 50th anniversary of Beijing Water Authority, China,
Beijing, 17.9.2013
Ritt, G.:
Schutz gegen Laserstrahlung. Seminar SE 1.04 »Neue Lasersensoren für den militärischen und sicherheitsrelevanten Einsatz«
der Carl-Cranz-Gesellschaft e.V., Ettlingen, 23.-24.4.2013
Roller, W.:
Auswertung von Radarbildern. Kurzlehrgang »Grundlagen
der Radartechnik« des Bildungszentrums der Bundeswehr,
Mannheim, 13.-.17.5.2013
Roller, W.:
Transforming classical e-learning to eBook – lessons
learned and first insights. Workshop Usability eBooks,
VDE (ITG), Leipzig, 5.6.2013
Roller, W.; Berger, A.; Szentes D.:
Technology Based Training for Radar Image Interpreters.
6th International Conference on Recent Advances in Space
Technologies, Türkei, Istanbul, 12.-14.6.2013
Sander, J.:
Bayesian fusion: Modeling and application. 2013 Workshop
on Sensor Data Fusion: Trends, Solutions, Applications (SDF),
Bonn, 9.-11.10.2013
Sauer, O.:
Industrie 4.0: neue Potenziale durch IT in der Produktion.
Wirtschaftsverband Industrieller Unternehmen Baden e.V.(wvib),
Freiburg, 23.1.2013
Sauer, O.:
Organisation des Virtuellen Fabrikbetriebs. Kurs: »Werkzeuge zur Digitalen Fabrik«, Weiterbildungsmaster Industrielles
Produktionsmanagement, Universität Kassel, Kassel, 27.1.2013
Sauer, O.:
Industrie 4.0 - Bedeutung für MES. Workshop: MES in der
Praxis, Automatisierungstreff, Sindelfingen, 22.3.2013
Sauer, O.:
Expertentalk Industrie 4.0 mit anschließender InnovationTour. Hannover Messe Industrie, Hannover, 11.4.2013
Sauer, O.:
Vorstellung Industrie 4.0 bei Freudenberg.
Deidesheim, 16.5.2013
Sauer, O.:
Industrie 4.0 Informationstechnik in der Fabrik der Zukunft.
TARGUS Management Consulting AG, Ratingen, 5.7.2013
Sauer, O.:
Industrie 4.0 Informationstechnik für die Fabrik der
Zukunft. T-Systems / APRISO-Veranstaltung, Karlsruhe,
25.9.2013
Sauer, O.:
Organisation des Virtuellen Fabrikbetriebs. Kurs: »Werkzeuge zur Digitalen Fabrik«, Weiterbildungsmaster Industrielles
Produktionsmanagement, Universität Kassel, Kassel, 29.9.2013
Sauer, O.:
Level-3-Systeme: Komponenten und deren Aufgaben.
ThyssenKrupp-Innovationstag, Andernach, 10.10.2013
153
Vorträge
lectures
Sauer, O.:
Industry 4.0: Information and communication
technologies in the factory of the future. Schaeffler IT
Innovation day, Herzogenaurach, 16.10.2013
Schönbein, R.:
Interoperabilität in der abbildenden Aufklärung.
DWT-Konferenz »Angewandte Forschung für Verteidigung
und Sicherheit in Deutschland«, Berlin, 3.-5.2.2014
Sauer, O.:
Plug & Work – vertikale Integration vom Feldgerät bis zum
MES-System. 1. Industrie 4.0-Summit, München, 17.10.2013
Schönbein, R.:
Gastbeitrag zur Vorlesung: Web-Anwendungen und
Serviceorientierte Architekturen II. Karlsruher Institut für
Technologie (KIT), Karlsruhe, 3.7.2013
Sauer, O.:
Intuitive Interaktion in der Fabrik der Zukunft. Kongress
Connected Products, Frankfurt, 20.11.2013
Sauer, O.:
Industrie 4.0 - die vierte industrielle Revolution durch
das Internet? Absolventenkongress Deutschland 2013,
Staufenbiel Institut, Köln, 28.11.2013
Scherer-Negenborn, N.:
Zieldetektion und Zielverfolgung mit abbildenden Infrarotsensoren. Seminar SE 1.02 »Infrarottechnik-Grundlagen,
Trends und moderne Anwendungen« der Carl-CranzGesellschaft e.V., Weßling/Oberpfaffenhofen, 7.-10.10.2013
Schick, A.; van de Camp, F.; Stiefelhagen, R.:
How to Click in Mid-Air. HCI International 2013, USA,
Las Vegas, 25.7.2013
Schilling, H:
Concept and integration of an on-line quasi-operational
airborne hyperspectral remote sensing system.
SPIE-Conference on Earth Resources and Environmental
Remote Sensing / GIS Application, Dresden, 24.9.13
Schleipen, M.:
Semantische Interoperabilität als zwingende Voraussetzung der Vernetzung und virtuellen Inbetriebnahme
in der Industrie 4.0. Ramp Up – Anlaufmanagement in der
Automobil-Produktion, Braunschweig, 12.-13.3.2013.
154
Schönbein, R.:
System Architecture enhancing the Capabilities of
Sensor Suites to improve Situational. EDA, Belgien,
Brüssel, 23.10.2013
Schönbein, R.:
Interoperabilität und Systemarchitekturen. Sehen,
Verstehen, Vernetzen – Technologien des Fraunhofer IOSB
für den Bedarf der Streitkräfte, Karlsruhe, 13.11.2013
Schriegel, S.; Leßmann, G.:
Mikroprozessor »Tiger-Chip« bring das Internet in die
Maschine. Dialog-Veranstaltung Innovationsallianz NRW:
Industrielle Informationstechnologie für intelligente technische
Systeme, Lemgo, 17.9.2013
Schuchert, T.:
Videounterstützte Identifikationsverfahren und
Verhaltensanalyse. Privacy-Day 2013, ARGE-Daten,
Österreich, Wien, 26.2.2013
Schuchert, T.:
Drohnentechnologie, aktueller Stand der Technik,
Ausblick auf die künftige technische Entwicklung.
Fachtagung »Einsatz von Drohnen«, Ministerium des Innern,
Rheinland-Pfalz, Polizeipräsidium Mainz, Mainz, 12.9.2013
Schuchert, T.:
Applications in border situation monitoring. Unmanned
Aerial Systems for Rapid Mapping, European Commission,
Joint Research Centre Geneva, Schweiz, Genf, 13.9.2013
Schulz, K.:
Generalized Interpretation Scheme for Arbitrary HR
InSAR Image Pairs. SPIE-Conference on Earth Resources and
Environmental Remote Sensing/GIS Applications IV, Dresden,
23.9.2013
Schwanenberg, D.; Karimazira, D.; Allen, C.:
Short-Term Optimization of Hydro Power Assets Under
Uncertain Meteo Forcing. 35th IAHR World Congress, China,
Chengdu, 8.-13.9.2013
Schwarz, A.:
Tarnen & Täuschen. Allgemeine Wehrtechnik.
Lehrgangskurs Allgemeine Wehrtechnik,
Bildungszentrum der Bundeswehr, Mannheim, 5.2.2013
Schwarz, A.:
Multispektral wirksame Tarnung und Täuschung.
Seminar SE 2.28: »Intelligente Sensorik: technischer Stand
und Entwicklungspotential« der Carl-Cranz-Gesellschaft e.V.,
Oberpfaffenhofen, 3.-6.6.201
Schwarz, A.:
Signaturmanagement. Tarnen und Täuschen. Lehrgangskurs
Allgemeine Wehrtechnik, Bildungszentrum der Bundeswehr,
Mannheim, 27.8.2013
Schwarz, A.:
Grundlagen der Tarnung und Täuschung im thermalen
Infrarot. Seminar SE 1.02 »Infrarottechnik – Grundlagen,
Trends und moderne Anwendungen« der Carl-CranzGesellschaft e.V., Oberpfaffenhofen, 7.-10.10.2013
Schweitzer, C.:
Optical spaceflight experiment 2CIR. 3rd TET-Customer Days,
German Space Operations Center, Oberpfaffenhofen,
21.-22.3.2013
Sprung, D.:
Using the output data of the COSMO-weather forecast
model to predict the turbulent modulation transfer
function over a tropical ocean and comparison with experimental results during the SMARTEX trial. In: NRSM 2013:
National Radio Science Meeting, USA, Boulder, 8.-11.1.2013
Sprung, D.:
Statistische Analyse vertikaler Turbulenzmessungen
in der unteren atmosphärischen Grenzschicht. DWTOptronik-Tagung, Meppen, 23.-25.9.2013
Sprung, D.:
Investigation of optical turbulence over the sea from
measurements with a Boundary Layer Scintillometer
(BLS2000) and comparison to high-speed imaging
methods. Scintillometer-Workshop, Tübingen, 7.-9.10.2013
Streicher, A.:
Mobile Assistenz in der Bildauswertung. Fachausschusssitzung Anthropotechnik - Ausbildung und Training in der
Fahrzeug- und Prozessführung, Frankfurt, 5.11.2013
Taphanel, M.:
Speed-up chromatic sensors by optimized optical filters.
Optical Metrology SPIE, München, 14.5.2013
Taphanel, M.:
Impact of Thin Film Fabrication to the Optimization
Process of a Multispectral Chromatic Camera. Optical
Interference Coating, Kanada, Whistler, 18.6.2013
Taphanel, M.:
Die Zukunft der konfokalen Messtechnik - zu langsam
war gestern. Fachtagung Produktionsmesstechnik, Schweiz,
Buchs, 4.9.2013
Tchouchenkov, I.:
Kleine unbemannte Flugsysteme - Möglichkeiten
und Grenzen. Symposium »ROBOTER: EFFEKTE auf Kultur
und Recht« (im Rahmen von EFFEKTE Wissenschaftsfestival
Karlsruhe), Karlsruhe, 27.6.2013
155
Vorträge
lectures
Thomalla, C.:
Industrie 4.0 – der Paradigmenwechsel in der industriellen Fertigung. 16. Fachmesse i+e, Freiburg, 24.1.2013
Usländer, T.:
ENVIROFI Architecture including Generic Enablers.
ENVIROFI DAY, Dublin Convention Centre, Irland, Dublin,
6.3.2013
Usländer, T.:
Provision of observations through an OGC Sensor Observation Service and Presentation of the „DIRA – Disease
Incidence Reporting App“. Open Geospatial Consortium
(OGC) TC, VAE, Abu Dhabi, 17.-20.3.2013
Usländer, T.:
SERVUS – A Collaborative Tool Support for Agile
Requirements Analysis. ENVIP Workshop at ISESS 2013.
Österreich, Neusiedl am See, 9.-11.10.2013
Usländer, T.:
ICT Support for Efficient and Collaborative Risk Assessment. ETPIS Conference on Future Safety and Security Research
in Europe, Tschechische Republik, Prag, 24.-25.10.2013
Usländer, T.:
Industrial Smart Grids. EU Brokerage Event on Key Enabling
Technologies (KET) in Horizon 2020, Frankreich, Straßburg,
29.11.2013
Usländer, T.:
Referenzmodelle am Beispiel OASIS SOA. Sitzung des
VDI / VDE GMA FA 7.21 Industrie 4.0, Frankfurt, 19.12.2013
Vieth, K.-U.:
Modular rapid prototyping for bulk sorting systems.
16th SpectroNet Collaboration Forum, Karlsruhe, 5.3.2013
Voit, M.:
Multimodale Mensch-Maschine-Interaktion in
aufmerksamen Umgebungen. 12. Sitzung DKE / BKT
»Beraterkreis Technologie«, Frankfurt, 6.11.2013
156
Voth, S.; Schuchert T.; Schroth, A.:
Gaze Estimation in Low-Resolution Eye Images. ECEM
2013, 7th European Conference on Eye Movement, Schweden,
Lund, 11.-16.8.2013
Wagner, B.:
Geodateninfrastrukturen für Sicherheitsaufgaben –
interaktiv, genormt, rollenoptimiert. BBK, Bad-Neuenahr,
24.10.2013
Walter, D.:
Overview of dazzling of imaging sensors with laser pulses.
ISL Symposium »Laser and Laser Applications«, French-German
Research Institute of Saint-Louis ISL, Frankreich, Saint-Louis,
5.3.2013
Watson, K.:
General Overview of the EO2HEAVEN Project.
Stakeholders Workshop, Südafrika, Pretoria, 12.-13.2.2013
Watson, K.:
General Overview of the EO2HEAVEN Project.
Stakeholders Workshop, Südafrika, Durban, 14.-15.2.2013
Watson, K.:
General Overview of the EO2HEAVEN Project.
GEO Health and Environment Community of Practice
Workshop, USA, Silver Spring, 26.-28.3.2013
Watson, K.:
Posterpräsentation zu EO2HEAVEN. GEOSS European
Projects Workshop, Spanien, Barcelona, 15.-16.4.2013
Watson, K.:
Introduction to EO2HEAVEN. EO2HEAVEN Conference,
Belgien, Leuven, 13.-15.5.2013
Weikersdorfer, D.; Schick, A.; Cremers, D.:
Depth-Adaptive Supervoxels for RGB-D Video
Segmentation. IEEE International Conference on Image
Processing, Australien, Melbourne, 15.-18.9.2013
Weiskopf, A.:
Flexible embedded telemetry system for agriculture and
aquaculture. 7th IFIP International Conference on Computer
and Computing Technologies in Agriculture CCTA2013, China,
Beijing, 18.-20.9.2013
Westermann, D.:
An overlay network for Europe – The DC Grid Option.
IEEE PES Workshop on SUPERGRID Interaction between
AC and DC Power Systems, Schweiz, Dättwil, 4.9.2013
Willersinn, D.:
Videoverarbeitung und -auswertung, Echtzeitverfahren.
Seminar VS 10.05 »Videoüberwachung für Sicherungsaufgaben« der Carl-Cranz-Gesellschaft e.V., Karlsruhe,
12.-14.11.2013
Zaschke, C.:
Systemarchitekturen – Anforderungen, Arbeitsgebiete
und Lösungen. Karlsruher Institut für Technologie (KIT),
Karlsruhe, 3.7.2013
Zepp, A.:
Fast Defocus Measurement for Laser Communications
with the Holographic Wavefront Sensor. In: Optical Society
of America (OSA), Washington, D.C.: Adaptive Optics: Methods,
Analysis and Applications (AO), USA, Arlington, 23.-27.6.2013
Zepp, A.:
Umweltbegrenzungen und Korrekturmöglichkeiten
am Beispiel der Laserkommunikation. Sehen, Verstehen,
Vernetzen – Technologien des Fraunhofer IOSB für den Bedarf
der Streitkräfte, Karlsruhe, 13.11.2013
Zielinski, A.:
Ontology-based Semantic Search for Information
Professionals – Ready for Use? 6th Information Retrieval
Facility and 2nd Open Interdisciplinary MUMIA Conference
2013, Republik Zypern, Limassol, 7.–9.10.2013
157
V e r n i ss a g e n 2 0 1 3
IO S B K a r l s r u h e
2013 fanden im Fraunhofer
IOSB am Standort Karlsruhe
3 Ausstellungen statt.
Die optische Wahrnehmung
wird, neben der wissenschaftlichen, um die künstlerische
Dimension erweitert.
In 2013 Fraunhofer IOSB
hosted three art exhibitions.
So optical perception is
enriched by the sense of
fine arts.
158
Imp r e ss u m
Ed i t o r i a l N o t e s
Redaktion
Bildquellen
Sibylle Wirth
Titel, Seite 2, 4/5, 26/27, 28, 30,
Layout
33, 36 unten, 44/45, 46, 55, 56/57,
Christine Spalek
68, 80/81, 82 oben, 84/85, 86/87,
88/89, 90, 92, 94/95 oben, 96,
Proof Reading
98/99, 100/101, 102/103, 104/105,
SciTech Communications GmbH
106/107, 108, 110/111, 112/113,
Im Weiher 12
114/115, 116:
69121 Heidelberg
indigo - Studio für Werbefotografie
Druck
Seite 16:
E&B engelhardt und bauer
VGB Power Tech GmbH
Karlsruhe
Germany www.vgb.org/home.html
Anschrift der Redaktion
Seite 17 unten, 20, 74, 78,
Fraunhofer-Institut für Optronik,
118/119, 142/143, 144:
Systemtechnik und Bildauswertung
MEV
IOSB
Presse und Öffentlichkeitsarbeit
Seite 27 oben:
Sibylle Wirth
Daimler AG
Fraunhoferstraße 1
76131 Karlsruhe
Seite 32:
Telefon +49 721 6091-300
Jungmann Systemtechnik
Fax +49 721 6091-413
[email protected]
Seite 37 oben:
Rainer Sturm, pixelio.de/
Thomas Usländer, Fraunhofer IOSB/
Bei Abdruck ist die Einwilligung
Collage: Stefan Riel, Fraunhofer IOSB
der Redaktion erforderlich.
Seite 39:
Schleswig-Holstein Netz AG
© Fraunhofer IOSB
Seite 75:
Karlsruhe 2014
Wilhelm Busch:
ein Institut der Fraunhofer-
Lehrer Lämpel (aus Max und Moritz)
Gesellschaft zur Förderung der
angewandten Forschung e. V.
Alle übrigen Abbildungen:
München
Fraunhofer IOSB
159
Ad r e ss e n
Add r e ss e s
Karlsruhe
Standort Karlsruhe
Fraunhoferstraße 1
76131 Karlsruhe
Telefon +49 721 6091-0
Fax +49 721 6091-413
[email protected]
www.iosb.fraunhofer.de
Ettlingen
Leitung
Prof. Dr.-Ing. habil. Jürgen Beyerer
Telefon +49 721 6091-210
[email protected]
Presse und Öffentlichkeitsarbeit
Dipl.-Ing. Sibylle Wirth
Telefon +49 721 6091-300
[email protected]
Verwaltung
Dipl.-Kaufm. Siegbert Böckle
Telefon +49 721 6091-350
[email protected]
Ilmenau
Standort Ettlingen
Gutleuthausstraße 1
76275 Ettlingen
Telefon +49 7243 992-0
Fax +49 7243 992 298
Institutsteil Angewandte
Systemtechnik AST
Am Vogelherd 50
98693 Ilmenau
Telefon +49 3677 461-0
Fax +49 3677 461-100
steffi.nothnagel@
iosb-ast.fraunhofer.de
www.iosb-ast.fraunhofer.de
Leitung
Bereich Photonik und
optronische Systeme
Dr. rer. nat. Reinhard Ebert
Telefon +49 7243 992-131
[email protected]
Leitung
Prof. Dr.-Ing. habil.
Thomas Rauschenbach
Telefon +49 3677 461-124
thomas.rauschenbach@
iosb-ast.fraunhofer.de
160
Lemgo
Beijing
Fraunhofer-Anwendungszentrum Industrial Automation
INA
Langenbruch 6
32657 Lemgo
Telefon +49 5261 702-5998
Fax +49 5261 702-5969
elena.sanchez@
iosb-ina.fraunhofer.de
www.iosb-ina.fraunhofer.de
Fraunhofer Representative
Office Beijing
Leitung
Prof. Dr.-Ing. Jürgen Jasperneite
Telefon +49 5261 702-572
juergen.jasperneite@
iosb-ina.fraunhofer.de
Dipl.-Ing. Hong Mu
Telefon +86 10 65900 621
Fax +86 10 65900 619
[email protected]
Representative for Production
and Information Technologies
Unit 0610 Landmark Tower II
8 North Dongsanhuan Road
Chaoyang District
100004 Beijing
PR China