investigation of alternative methods of transferring reconnaissance

Transcription

DRDC Toronto CR-2005-054
INVESTIGATION OF ALTERNATIVE METHODS OF TRANSFERRING
RECONNAISSANCE AND PLATOON ORDERS INFORMATION
by:
Harry A. Angel, David W. Tack and Lisa J. Massel
Humansystems® Incorporated
111 Farquhar St., 2nd Floor
Guelph, ON N1H 3N4
Project Director:
David W. Tack (519)-836-5911
PWGSC Contract No. W7711-017747/001/TOR
Call-up No. 7747-25
HSI® SIREQ Item #140
On behalf of
DEPARTMENT OF NATIONAL DEFENCE
as represented by
Defence Research and Development Canada - Toronto
1133 Sheppard Avenue West
Toronto, Ontario, Canada
M3M 3B9
DRDC Toronto Scientific Authority
Maj Linda Bossi
(416) 635-2197
July 2005
This document contains information that may not be passed or shared, even in confidence, with
foreign military, research and development representatives or civilian contractors of any nationality
without the expressed prior permission of the Exploitation Manager of SIREQ TD.
The scientific or technical validity of this Contract Report is entirely the responsibility of the
contractor and the contents do not necessarily have the approval or endorsement of Defence R&D
Canada
© Her Majesty the Queen as represented by the Minister of National Defence, 2005
© Sa Majesté la Reine, représentée par le ministre de la Défense nationale, 2005
Abstract
This experiment investigated the technological ability to capture and transfer information from
recce patrols to higher echelons. A daily mission was carried out in which three sections
conducted recce patrols. Following the recce patrols, the section leaders and the platoon
commander collocated and conducted recce briefings. Three different methods of capturing,
preparing and transferring information with increasing digital capability were evaluated by a jury
of the section leaders’ and platoon commander’s peers watching the transfer of information from
a remote location. The first method acted as a baseline for the other two conditions (current CF
practice). In this Face to Face condition, the report and drawings were drafted by hand, and
pictures were taken with a Polaroid camera. The patrol briefing was conducted face to face. For
the Digital/Radio condition, the report and drawings were produced digitally, and pictures were
taken with a digital camera. The briefing was conducted remotely by radio. For the
Digital/Telepresence condition, the report and drawings were produced digitally, pictures were
taken digitally, and overlays were used. For this condition, the briefing took place remotely by
telepresence.
Following the section recce briefings, the platoon commander conducted a recce and distributed
his orders. For the commander’s recce, the following three methods evaluated were the physical
recce (current CF procedure), remote recce by radio, and remote recce by Unattended Aerial
Vehicle (UAV).
The final study investigated distributed orders and the different ways of transferring information.
Distributed orders were conducted in a centralized and two different decentralized formations (by
radio and telepresence).
Participants liked the ability to create digital reports, pictures, drawings, and overlays. They felt
the greatest advantage was the ease with which this information could be sent electronically to
higher echelons and be reproduced. Participants preferred recce briefings to be conducted face
to face, however, because with this method they were able to tell if the other soldier
comprehended the information they were sharing. If a briefing must be conducted remotely,
participants preferred telepresence over the radio.
Participants believed that it was always necessary to conduct a Commander’s physical recce
because it increases the commander’s situational awareness of the enemy, objective, and terrain.
This information allows the commander to change his plan as appropriate and determine assault
positions, withdraw routes, fire base location, etc.
Overall, participants preferred to have distributed orders conducted face to face, which allows
individuals to view each other’s body language as well as easily determine each other’s
comprehension of the plan. Also, participants believed that gathering at one location increases
the communication among sections, thereby increasing efficiency.
Humansystems®
Reconnaissance and Platoon Orders Information
Page i
Résumé
La présente expérience nous a permis d’examiner la capacité qu’offre la technologie pour la
communication aux échelons supérieurs de l’information saisie pendant des patrouilles de
reconnaissance. Trois sections ont pour mission des patrouilles de reconnaissance quotidienne.
Après les patrouilles, les chefs de section et le commandant du peloton participent à un briefing.
Un jury composé de collègues du commandant et des chefs de section évalue à distance la
communication de l’information qui est saisie, préparée et communiquée selon trois méthodes à
complexité croissante. La première méthode représente la norme actuellement en cours dans les
FC et contre laquelle les deux autres sont évaluées. Le rapport est rédigé et les esquisses
dessinées à la main, et les photos sont prises au moyen d’un appareil Polaroid. Le briefing se fait
en situation de face à face. La deuxième méthode se déroule dans un environnement de radio
numérique où le rapport, les dessins et les photographies sont produits par moyens numériques.
Le briefing se fait à distance, par radio. La troisième méthode exploite les moyens numériques de
la méthode précédente mais permet en plus la superposition, et le briefing a lieu à distance par
téléprésence.
À la suite du briefing de reconnaissance des sections, le commandant du peloton effectue une
reconnaissance et distribue ses ordres. Les trois méthodes de reconnaissance suivantes ont servi à
évaluer la reconnaissance du commandant : la reconnaissance physique (pratique actuelle dans les
FC), la reconnaissance à distance, par radio, et la reconnaissance à distance par véhicule aérien
télépiloté (VAT).
Une dernière composante de l’étude porte sur la distribution des ordres et sur diverses façons de
communiquer l’information. Les ordres sont distribués dans un environnement de formation
centralisée et dans deux environnements de formation décentralisée (par radio et par
téléprésence).
Les participants aiment la capacité de créer des rapports, des dessins, des photographies et des
superpositions numériques. À leur avis, le plus grand avantage de cette méthode est la facilité
avec laquelle l’information peut être communiquée par voie électronique aux échelons supérieurs,
et reproduite. Ils préfèrent des briefings exécutés en personne, cependant, car ils sont en mesure
ainsi de juger si l’autre soldat comprend l’information qui lui est communiquée. Dans le cas de
briefings exécutés à distance, les participants préfèrent les briefings par téléprésence plutôt que
par radio.
Les participants croient qu’il est toujours nécessaire que le commandant exécute une
reconnaissance physique, car cette méthode accroît chez lui la perception de la situation
relativement à l’ennemi, à l’objectif et au terrain. Cette information permet au commandant de
modifier son plan au besoin, de déterminer les positions d’assaut, les voies de retrait,
l’emplacement des bases de feu, etc.
En général, les participants préfèrent que les ordres soient distribués en personne, pour être en
mesure de constater le langage corporel de l’autre et de déterminer de part et d’autre la
compréhension du plan. Les participants croient également que le fait de se rassembler dans un
même endroit accroît la communication entre les sections et, par conséquent, l’efficacité.
Humansystems®
Page ii
Executive Summary
This experiment investigated the use of technology to capture and transfer information from
reconnaissance (recce) patrols to higher echelons. A daily mission was carried out in which three
sections conducted recce patrols. Following the recce patrols, the section leaders and the platoon
commander collocated and conducted the recce briefings. Three different methods of capturing,
preparing and transferring information with increasing digital capability were evaluated (Hand/Face
to Face, Digital/Radio and Digital/Telepresence - refer to Table 1). These methods were evaluated
by a jury of their peers watching the transfer of information, from a remote location.
Table 1: Section Recce Patrol Conditions
Hand/Face to Face
Digital/Radio
Digital/Radio
Information Capture
Preparing Recce Report
• Hand Written
• Entered Digitally
• Entered Digitally
Side View Drawings
• Hand Drawn
• Digital Cameras (still
pictures)
• Digital Camera (still
pictures & video)
• Digitally Drawn
• Digitally Drawn
• Polaroid Camera
Overhead View Drawings
• Hand Drawn
• Overlays
Information Transfer
Information Transfer Modality
• Face to face
• Remotely by Radio
• Telepresence (web
cameras)
After the recce briefings, the platoon commander conducted a commander’s recce and distributed
orders in three different ways. For the commander’s recce, the following three methods were
evaluated: physical recce, remote recce by radio, and remote recce by UAV. Distributed orders
were conducted in a centralized and decentralized manner.
Data was collected through questionnaires, focus group discussion, and human factors observation.
Results showed that participants liked the ability to digitally create reports, pictures, drawings,
and overlays. They thought that the greatest advantage was the ease in which this information
could be sent electronically to higher echelons and the ease in reproducing the information
locally. The digital camera was considered a great asset because of the level of detail that could
be captured. Participants, however, desired the additional ability to take pictures at night with
night vision devices and thermal cameras. Also, they wanted a digital camera with greater zoom
capability (e.g. x10).
Participants preferred recce briefings to be conducted face to face. They explained that better
understanding was achieved with a face to face meeting. However, if a briefing must be
conducted remotely, participants’ preferred telepresence compared to remote by radio because
like a face to face encounter, telepresence briefing allowed the participants to see each other’s
faces and gauge understanding.
Humansystems®
Page iii
Participants also thought that it was always necessary to conduct a Commander’s physical recce
of the objective because it increases the commander’s situational awareness of the enemy,
objective, and terrain. This information allows the commander to change his plan as appropriate
and determine assault positions, withdraw routes, fire base location, etc. By conducting a recce
remotely by radio, participants believed that the commander had to place too much trust on the
recce patrol to help the commander adjust the plan as appropriate. Participants found the UAV
images useful but would like the orientation and the scale of the images added.
Overall, participants preferred to have distributed orders conducted face to face because it allows
individuals to view each other’s body language. It was also said to be easy to determine each
other’s comprehension of the plan. Moreover, participants believed that gathering at one location
increases the communication among sections, thereby increasing efficiency.
By conducting distributed orders remotely, participants thought that time would be saved. The
presentation of the orders took significantly less time over the radio. However, it was more
difficult to receive feedback over the radios and to ensure comprehension of the orders, despite
the fact that no significant difference was found across conditions regarding the level of
comprehension. Participants were also concerned about the amount of radio traffic required.
Participants found the telepresence to be a quick method of distributing orders, and it reduced the
amount of movement required. They liked having the information stored on their wearable
computers (Xybernauts) and being able to pass this information onto the troops. Participants
found that not a lot of time was spent viewing the images of the other participants because of the
amount of other information on their computer screens. In order to improve telepresence
distributed orders, participants desired faster computers.
Humansystems®
Page iv
Sommaire
La présente expérience nous a permis d’examiner la capacité qu’offre la technologie pour la
communication aux échelons supérieurs de l’information saisie pendant des patrouilles de
reconnaissance. Trois sections ont pour mission des patrouilles de reconnaissance quotidienne.
Après les patrouilles, les chefs de section et le commandant du peloton participent à un briefing. Un
jury composé de collègues du commandant et des chefs de section évalue à distance la
communication de l’information qui est saisie, préparée et communiquée selon trois méthodes à
complexité croissante (moyens manuels et de face à face, radio numérique, téléprésence numérique)
– voir tableau 1).
Tableau 1 : Conditions des patrouilles de reconnaissance des sections
Manuel/en personne
Radio numérique
Téléprésence numérique
Saisie de l’information
Rapport de reconnaissance
• Écrit à la main
• Saisie numérique
• Saisie numérique
Dessins (vue latérale)
• Dessinés à la main
• Appareil numérique
(images fixes)
• Appareil numérique
(images fixes et vidéo)
• Dessins numériques
• Dessins numériques
• Appareil Polaroid
Dessins (vue de dessus)
• Dessinés à la main
• Superposition
Communication de l’information
Méthode de communication
• En personne
• À distance – par radio
• Téléprésence (webcam)
À la suite du briefing de reconnaissance des sections, le commandant du peloton effectue une
reconnaissance et distribue ses ordres. Les trois méthodes de reconnaissance suivantes ont servi à
évaluer la reconnaissance du commandant : la reconnaissance physique (pratique actuelle dans les
FC), la reconnaissance à distance, par radio, et la reconnaissance à distance par véhicule aérien
télépiloté (VAT). Les ordres sont distribués dans un environnement de formation centralisée et
dans deux environnements de formation décentralisée (par radio et par téléprésence).
Nous avons recueilli les données au moyen de questionnaires, de discussions en groupe de
consultation et d’observations des facteurs humains.
Selon les résultats, les participants aiment la capacité de créer des rapports, des dessins, des
photographies et des superpositions numériques. À leur avis, le plus grand avantage de cette
méthode est la facilité avec laquelle l’information peut être communiquée par voie électronique
aux échelons supérieurs, et reproduite sur les lieux. L’appareil photo numérique est considéré
comme un outil très utile en raison de sa capacité de saisir les détails. Cependant, les participants
désirent être en mesure de prendre des photos la nuit avec des dispositifs de vision nocturne et
des caméras nocturnes, et veulent disposer d’appareils numériques à zoom plus puissant (p. ex.,
x 10).
Humansystems®
Page v
Les participants préfèrent des briefings exécutés en personne, cependant. À leur avis, cela facilite
la compréhension. Dans le cas de briefings exécutés à distance, les participants préfèrent les
briefings par téléprésence plutôt que par radio, car cela ressemble davantage à une réunion dans
laquelle il est possible de voir les visages et de juger de la compréhension.
Les participants croient qu’il est toujours nécessaire que le commandant exécute une
reconnaissance physique de l’objectif, car cette méthode accroît chez lui la perception de la
situation relativement à l’ennemi, à l’objectif et au terrain. Cette information permet au
commandant de modifier son plan au besoin, de déterminer les positions d’assaut, les voies de
retrait, l’emplacement des bases de feu, etc. Dans le cas de reconnaissances effectuées à distance,
les participants sont d’avis que le commandant doit trop se fier à la patrouille de reconnaissance
pour être en mesure de modifier son plan au besoin. Quant aux images saisies par VAT, les
participants les considèrent utiles mais aimeraient voir s’ajouter aux images des indications
d’orientation et d’échelle.
En général, les participants préfèrent que les ordres soient distribués en personne, pour être en
mesure de constater le langage corporel de l’autre. Il est également plus facile de déterminer de
part et d’autre la compréhension du plan. Les participants croient aussi que le fait de se réunir
dans un même endroit accroît la communication entre les sections et, par conséquent, l’efficacité.
Les participants sont d’avis que la distribution des ordres à distance fait gagner du temps, car la
communication par radio est considérablement plus rapide. Mais la rétroaction est plus
difficilement établie par radio, ainsi que le sentiment que les ordres sont compris, malgré le fait
que l’on n’a détecté aucune différence dans l’ensemble des conditions évaluées en ce qui
concerne le niveau de compréhension. De plus, les participants se préoccupent de la quantité de
trafic radio qui est générée.
Les participants sont d’avis que le moyen de la téléprésence est une façon rapide de distribuer les
ordres, et réduit la quantité de mouvements. Ils aiment avoir l’information disponible dans leur
ordinateur vestimentaire (Xybernauts) et être en mesure de communiquer cette information à
leurs troupes. Ils avouent ne pas mettre beaucoup de temps à visualiser les images des autres
participants en raison de la quantité de renseignements affichés à l’écran de leur ordinateur. Des
ordinateurs plus rapides amélioreraient le processus de distribution des ordres à distance.
Humansystems®
Page vi
Table of Contents
ABSTRACT ......................................................................................................................................................I
RESUME ......................................................................................................................................................... II
EXECUTIVE SUMMARY ...........................................................................................................................III
SOMMAIRE ................................................................................................................................................... V
TABLE OF CONTENTS ............................................................................................................................ VII
LIST OF TABLES.........................................................................................................................................IX
LIST OF FIGURES........................................................................................................................................ X
1
BACKGROUND ..................................................................................................................................... 1
1.1
2
ABBREVIATIONS IN THIS REPORT ...................................................................................................... 3
SECTION RECCE ................................................................................................................................. 4
2.1
SECTION RECCE BACKGROUND ........................................................................................................ 4
2.2
AIM ................................................................................................................................................... 4
2.3
METHOD ........................................................................................................................................... 4
2.3.1 Overview...................................................................................................................................... 5
2.3.2 Materials...................................................................................................................................... 5
2.3.3 Participants ................................................................................................................................. 6
2.3.4 Experimental Conditions ............................................................................................................. 6
2.4
PROCEDURE ...................................................................................................................................... 9
2.5
DEPENDENT VARIABLES ................................................................................................................... 9
2.5.1 Rating Scales ............................................................................................................................. 10
2.6
RESULTS ......................................................................................................................................... 12
2.6.1 Section Recce Patrol: Objective Results.................................................................................... 12
2.6.2 Section Recce Patrol: Jury Information Task Questionnaire .................................................... 15
2.6.3 Section Recce Patrol: Information Transfer Exit Questionnaire............................................... 24
3
COMMANDER’S RECCE .................................................................................................................. 27
3.1
COMMANDER’S RECCE BACKGROUND ............................................................................................ 27
3.2
AIM ................................................................................................................................................. 28
3.3
METHOD ......................................................................................................................................... 28
3.3.1 Overview.................................................................................................................................... 28
3.3.2 Materials.................................................................................................................................... 29
3.3.3 Participants ............................................................................................................................... 29
3.3.4 Experimental Conditions: Physical, Radio, UAV Video ............................................................ 29
3.4
PROCEDURE .................................................................................................................................... 29
3.5
DEPENDENT VARIABLES ................................................................................................................. 30
3.5.1 Rating Scales ............................................................................................................................. 30
3.6
RESULTS ......................................................................................................................................... 30
3.6.1 Commander’s Recce: Update Task Questionnaire ................................................................... 30
3.6.2 Commander’s Recce: Exit Questionnaire.................................................................................. 32
Humansystems®
Page vii
4
DISTRIBUTED ORDERS ................................................................................................................... 35
4.1
DISTRIBUTED ORDERS BACKGROUND............................................................................................. 35
4.2
AIM ................................................................................................................................................. 36
4.3
METHOD ......................................................................................................................................... 36
4.3.1 Overview.................................................................................................................................... 36
4.3.2 Materials.................................................................................................................................... 36
4.3.3 Participants ............................................................................................................................... 37
4.3.4 Experimental Conditions: Face to Face, Radio, and Telepresence........................................... 37
4.4
PROCEDURE .................................................................................................................................... 38
4.5
DEPENDENT VARIABLES ................................................................................................................. 38
4.5.1 Rating Scales ............................................................................................................................. 39
4.6
RESULTS ......................................................................................................................................... 39
4.6.1 Distributed Orders: Objective Results....................................................................................... 39
4.6.2 Distributed Orders: Task Questionnaire .................................................................................. 39
4.6.3 Distributed Orders: Exit Questionnaire .................................................................................... 48
4.6.4 Distributed Orders: Focus Group Discussion ........................................................................... 51
5
DISCUSSION ........................................................................................................................................ 52
6
REFERENCES...................................................................................................................................... 55
ANNEX A: TRIAL MATERIALS ............................................................................................................. A-1
ANNEX B: JURY INFORMATION TASK QUESTIONNAIRE ........................................................... B-1
ANNEX C: RECCE INFORMATION EXIT TRANSFER ..................................................................... C-1
ANNEX D: COMMANDER’S RECCE UPDATE TASK QUESTIONNAIRE..................................... D-1
ANNEX E: COMMANDER’S RECCE EXIT QUESTIONNAIRE........................................................ E-1
ANNEX F: ORDERS BRIEFING – PROVIDER..................................................................................... F-1
ANNEX G: ORDERS BRIEFING – RECEIVERS ..................................................................................G-1
ANNEX H: ORDERS COMPREHENSION WITH MAP.......................................................................H-1
ANNEX I: TEAMWORK ............................................................................................................................ I-1
ANNEX J: NASA TLX WORKLOAD .......................................................................................................J-1
ANNEX K: DISTRIBUTED ORDERS EXIT QUESTIONNAIRE ........................................................K-1
Humansystems®
Page viii
List of Tables
TABLE 1: SECTION RECCE PATROL CONDITIONS ............................................................................................... III
TABLEAU 1 : CONDITIONS DES PATROUILLES DE RECONNAISSANCE DES SECTIONS ............................................ V
TABLE 1: RECCE INFORMATION TRANSFER CONDITIONS..................................................................................... 5
TABLE 2: AMOUNT OF TIME REQUIRED TO COMPLETE RECCE INFORMATION TRANSFER ................................... 13
TABLE 3: AVERAGE SIZE OF DIGITAL INFORMATION SENT IN THE DIGITAL/RADIO AND
DIGITAL/TELEPRESENCE RECCE TRANSFER ............................................................................................ 14
TABLE 4: NUMBER OF ITEMS USED PER CONDITION .......................................................................................... 15
TABLE 5: PARTICIPANT ASSESSMENT OF THE QUALITY OF INITIAL INFORMATION PROVIDED............................ 18
TABLE 6: PARTICIPANT ASSESSMENT OF THE QUALITY OF INITIAL INFORMATION PROVIDED............................ 32
TABLE 7: TIME REQUIRED TO PRESENT ORDERS BRIEFING ................................................................................ 39
TABLE 8: SCORING METHOD OF THE ORDERS COMPREHENSION QUESTIONNAIRE ............................................ 48
Humansystems®
Page ix
List of Figures
FIGURE 1: FACE TO FACE PATROL BRIEFING ....................................................................................................... 6
FIGURE 2: PLATOON COMMANDER RECEIVING ORDERS REMOTELY .................................................................... 7
FIGURE 3: JURY MEMBERS VIEWING RECCE INFORMATION ................................................................................. 7
FIGURE 4: JURY ROOM SET-UP ............................................................................................................................ 8
FIGURE 5: PLATOON COMMANDER VIEWING A XYBERNAUT DURING THE DIGITAL 2 CONDITION ....................... 8
FIGURE 6: PLATOON COMMANDER'S SCREEN DURING THE TELEPRESENCE CONDITION ....................................... 9
FIGURE 7: STANDARD RATING SCALE ............................................................................................................... 10
FIGURE 8: INFORMATION UTILITY RATING SCALES ........................................................................................... 11
FIGURE 9: AGREEMENT SCALE ......................................................................................................................... 11
FIGURE 10: TIME TO COMPLETE RECCE INFORMATION TRANSFER..................................................................... 12
FIGURE 11: AVERAGE VOLUME OF RECCE INFORMATION TRANSFER PACKAGE................................................. 14
FIGURE 12: OVERALL PARTICIPANT ACCEPTABILITY OF CONDITIONS FOR INFORMATION TRANSFER ................ 16
FIGURE 13: DEGREE OF PARTICIPANT ACCEPTABILITY OF TEXT DATA PROVIDED ............................................. 19
FIGURE 14: DEGREE OF PARTICIPANT ACCEPTABILITY OF SIDE VIEW INFORMATION PROVIDED ........................ 20
FIGURE 15: DEGREE OF PARTICIPANT ACCEPTABILITY OF OVERHEAD VIEW INFORMATION PROVIDED ............. 21
FIGURE 16: DEGREE OF PARTICIPANT ACCEPTABILITY OF AURAL INFORMATION PROVIDED ............................. 22
FIGURE 17: TRADITIONAL COMMANDER’S RECONNAISSANCE TECHNIQUES ..................................................... 27
FIGURE 18: REMOTE COMMANDER’S RECONNAISSANCE TECHNIQUES – RECCE TEAMS ................................... 28
FIGURE 19: REMOTE COMMANDER’S RECONNAISSANCE TECHNIQUES –UAVS ................................................. 28
FIGURE 20: OVERALL PARTICIPANT ACCEPTABILITY OF CONDITIONS FOR INFORMATION TRANSFER ................ 31
FIGURE 21: TRADITIONAL COMMANDER’S ORDERS BRIEFING TECHNIQUES ...................................................... 35
FIGURE 22: REMOTE COMMANDER’S BRIEFING TECHNIQUES ............................................................................ 36
FIGURE 23: DEGREE OF PARTICIPANT ACCEPTABILITY RATING OF ORDERS BRIEFING - PROVIDER .................... 40
FIGURE 24: DEGREE OF PARTICIPANT ACCEPTABILITY OF ORDERS BRIEFING – RECEIVERS (QUESTIONS 1-9) ... 41
FIGURE 25: DEGREE OF PARTICIPANT ACCEPTABILITY OF ORDERS BRIEFINGS - RECEIVERS (QUESTIONS 10-17)
................................................................................................................................................................ 42
FIGURE 26: COMPARISON OF PROVIDER AND RECEIVER FOR ORDERS BRIEFING .............................................. 44
FIGURE 27: TEAMWORK QUESTIONNAIRE - SECTION A.................................................................................... 45
FIGURE 28: TEAMWORK QUESTIONNAIRE - SECTION B .................................................................................... 46
FIGURE 29: WORKLOAD - NASA TLX............................................................................................................. 47
FIGURE 30: ORDERS COMPREHENSION SCORES ................................................................................................ 48
FIGURE 31: DISTRIBUTED ORDERS EXIT QUESTIONNAIRE (QUESTIONS 1-9) .................................................... 49
FIGURE 32: DISTRIBUTED ORDERS EXIT QUESTIONNAIRE (QUESTIONS 10-17) ................................................ 50
Humansystems®
Page x
1
Background
The purpose of the Soldier Information Requirement – Technical Demonstrator (SIREQ – TD)
Project is to investigate the effects of enhancing information-related capabilities in dismounted
infantry operations (Tack, 2000). For each information enhancement capability the goal of the
project was to determine the following:
•
•
•
Utility for dismounted infantry operations
Usability of different modalities
Operational impact on mission effectiveness
Defence Research and Development Canada (Toronto) has been examining the benefits and
operational impact of providing additional information at the dismounted infantry section and
platoon level through a variety of section and platoon level studies at Fort Benning, Georgia.
The usefulness of providing complex digital information at the platoon and section level was
shown to be positive in a previous study conducted in support of the Soldier Information
Requirements Technology Demonstration (SIREQ-TD) project -Reconnaissance Information
Transfer in Urban Operations (2004). It was found that in order to be effective, digital
information (pictures, video, virtual models) needed to be at an acceptable level of accuracy and
resolution. The previous study identified the need to investigate the efficacy of using low,
medium, and high resolution digital images. As well, the ease of digital image capture, editing,
and transmission of the captured information needed to be investigated at the platoon level. This
preliminary study pushed digital information to the sections and platoons. If sections and
platoons are to become sources of information, the study recommended that limitations of the
current technologies needed to be further understood. This preliminary investigation also
demonstrated support for using Unattended Aerial Vehicles (UAV’s) at the platoon level for
Military Operations in Urban Terrain (MOUT). Further studies were recommended to
investigate the effectiveness of using UAV’s for non-urban missions and to confirm the utility of
UAV’s for MOUT missions.
Information technology can create information management problems for commanders and staff.
A large amount of information is now available such that information overload becomes a reality
unless controls are implemented to control the quality and quantity of information. Quality is a
subjective term for which each leader will have his or her own definition, it does however imply
that it proves useful to the user and satisfies some stated or implied need. Providing leaders with
volumes of data that do not impact current or foreseeable operations is inappropriate. Quantity
of information implies that information can be measured for magnitude, size, amount, etc. Text
messages are typically dozens of kilobytes in size (if that) while streaming video is usually
megabytes in size. There are physical limits to wireless network band widths so that large files
impact image flow and thus situational awareness across the network. While it is fairly easy to
quantify and characterize computer mediated information, it is more difficult to quantify
information size in verbal communications.
Information in a military environment can be examined in terms of information modality, i.e.
text, verbal, video, tactile, etc. Information can also be examined in terms of medium of
communication, i.e., face to face (briefings, orders groups, direct liaison, sand table models,
Humansystems®
Page 1
etc.), remote (radio, computer images and text), or telepresence (webcams, computer images and
text)
The thrust of information technology is in the areas of radio and data communication, and
computer–mediated communication. Technology now exists to provide leaders at all levels with
near real time video imagery, weather updates, situation reports, personnel status reports,
satellite imagery, etc. The question is what information and how much information is needed at
the Platoon Commander (Pl Comd), Section Commander (Sect Comd) and Soldier level.
Information could be examined in terms of a number of characteristics. The SIREQ Project used
the following criteria when evaluating information requirements:
•
•
•
•
•
•
•
•
•
Importance - Without this information could you complete this task?
Complexity - How complex was the information?
Timeliness - How acceptable was the timeliness of this information for the task?
Difficulty - How difficult was it to use the information to complete the task?
Retention - For how long was this information useful?
Update frequency - How frequently do you update this information?
Frequency of use - How often do you use this information?
Accuracy - How acceptable is the accuracy of this information for the task?
Time pressure - What time pressure did you feel when acquiring, sending, or receiving
this information?
Thus, the usefulness of information and volume of information manageable differs as the leader
progresses through the operational planning, rehearsal, and execution stages. The emphasis on
what information and how much is desirable varies with each different leader, combat operation,
and phase of operation.
For example, during a detailed section reconnaissance (the Canadian Land Force universally
utilizes the term recce to describe reconnaissance) of the objective, the team observes the objective
and records hand written notes and sketches of the scene. Occasionally, film photographs are
collected but these must be carried back to a recce briefing to be useful. These in-service recce
recording methods offer limited benefits when recce data must be reported remotely. Alternative
recce recording methods, which offer digital information capture and greater stand-off from the
recce objective, may reduce the time required for a detailed recce and may provide the Pl Comd
with more information with which to develop a better plan. The in-service method for patrol
briefing is a centralized method of conducting the briefing face-to-face. The time for the platoon to
move into a central Objective Rendezvous (ORV) to conduct this briefing is not tactically
inconsiderable. The capability to conduct briefings in a decentralized formation over radio or by
telepresence could reduce the risk of detection by the enemy and greatly speed up the platoon’s
readiness to assault the objective.
Today in the CF, a commander’s recce is similar to the section recce. That is to say, prior to
assaulting an objective, the Pl Comd will move forward to one or more positions on the ground
where the objective can be observed and the situation assessed. The Pl Comd might confirm the
sketches he received from a previous section recce or he may create his own sketches while he is
performing his recce or when he returns to the ORV. The information acquired from the
commander’s recce will be used by the Pl Comd to develop his plan of assault. This process,
however, introduces considerable delays in initiating the assault and has the potential for exposing
the platoon to enemy detection. Remote observation of the objective, on the other hand, may
Humansystems®
Page 2
reduce or eliminate the need for the commander’s recce, thereby reducing the time required for the
Pl Comd to produce his plan and lessening the risk of enemy detection.
Following the commander’s recce and the development of an assault plan, the Pl Comd will
organize the platoon in an all-round defence at an ORV where he will brief the Section and
Weapons Detachment (Det) commander face-to-face. The Section and Weapons Det Comds will
then brief their troops, usually only one or two participants at a time. Once briefed, the Sections
and the Weapons Det will maneuver to their respective lines of departure. Collectively, the
movement time of moving the platoon into a central ORV and then re-deploying the Sections and
Weapons Det, prior to assault, is not tactically inconsiderable. For instance, the process of moving
the platoon into an ORV and then briefing all members increases the risk of being detected by the
enemy. The capability to provide distributed orders briefings to small units tactically deployed in a
decentralized formation might reduce the risk of detection by the enemy and, moreover, greatly
speed up the platoon’s readiness to assault the objective. On the other hand, decentralized briefings
may result in a reduction in mission orders comprehension.
The following study, therefore, investigates a variety of information capture and transfer
techniques on section recce, commander recce, and distributed order practices in order to assess
whether digital technology enhances participants’ competencies in these areas compared to
current CF practices. To maintain clarity throughout the report, each of these practices is treated
as a separate investigation. The report is, thus, broken into 3 stages, which include the aim,
method, and results for the section recce, commander recce, and distributed orders. Following
the results, there will be an integrated discussion regarding the impact of the various information
capture and transfer techniques on section recce, commander recce, and distributed order
practices.
1.1
Abbreviations in this Report
Terminology
Abbreviation
Canadian Forces
CF
Weapons Detachment
Det
Kilobytes
KB
Local Area Network
LAN
Military Operations in Urban Terrain
MOUT
NASA Task Load Index
NASA TLX
Non-Commissioned Officer
NCO
Objective Rendezvous
ORV
Platoon Commander
Pl Comd
Reconnaissance
recce
Section Commander
Sect Comd
Soldier Information Requirements Technology Demonstration
SIREQ-TD
Unattended Aerial Vehicle
UAV
Humansystems®
Page 3
2
Section Recce
This section of the report describes the background, aims, method and results for the impact of
using different types and levels of information for section recce performance.
2.1
Section Recce Background
Traditionally dismounted personnel conduct reconnaissance missions using a variety of stand
alone data capture systems (Polaroid cameras, video cameras, etc.) Images and information is
obtained and the information is forwarded when the recce party returns to friendly lines. It
should be noted that radios are also used to send time sensitive critical verbal information if
required.
Concern has been raised that this approach consumes large amounts of time and raises the risk
that the information may be lost if the recce party is discovered during its return to friendly lines.
Technology now exists to capture and send large amounts of information of detection. In order
to see if technology can improve the quality of information captured and the speed of
reconnaissance missions a number of novel approaches have been proposed. One approach is to
employ digital image capture systems (digital cameras, digital video cameras, UAVs, etc.)
While these tools may capture large amounts of information, the speed of transfer is currently
limited by the fact that face to face debriefing is the only way information is transferred. Rather
than conducting the in-service face to face debrief it has been proposed to conduct recce
reporting wirelessly. Information captured can be sent remotely and the verbal reporting can be
conducted by radio or by web-style net meetings
2.2
Aim
The following aims were pursued in this stage of the experiment:
•
Evaluate the utility and usability of digitally enhanced means of capturing recce
information.
•
Evaluate the utility and usability of digitally enhanced means of preparing recce report
information.
•
Evaluate the utility and usability of different levels of source information (richness) for
intelligence assessment.
•
Evaluate the utility and usability of digitally enhanced means of transferring recce report
information.
•
Identify the interface design issues associated with each information exchange modality
and the design of the computer interface.
2.3
Method
This section provides an overview of the experimental method and explains the approach and data
collection.
Humansystems®
Page 4
2.3.1
Overview
A nine-day field trial was undertaken at Fort Benning, Georgia over the period of 19 October to
19 November 2003 in order to assess different levels of recce information capturing and
transferring. Fifteen (n = 15) regular force infantry participants participated in the recce
information capture and transfer study.
Each section was given a recce mission at the start of the day and the sub-units were required to
manoeuvre to their objective and conduct a point recce. Tools were provided to the section
commanders for data capture and data entry purposes. Upon completion of information
gathering activities, the section commanders were required to build a standard recce report and
then brief their platoon commander on the results of the recce.
Participants were divided into three groups of leadership. They were required to complete a total
of nine recce patrols; three for each mission condition (see Table 1) below.
Table 1: Recce information transfer conditions
Hand/Face to Face
Digital/Radio
Digital /Telepresence
Information Capture
Preparing Recce Report
Hand Written
Entered Digitally
Entered Digitally
Side View Drawings
Hand Drawn
Digital Cameras (still
pictures)
Digital Camera (still pictures
& video)
Digitally Drawn
Digitally Drawn
Polaroid Camera
Overhead View Drawings
Hand Drawn
Overlays
Information Transfer Modality
Face to face
Remotely by Radio
Telepresence (web
cameras)
While one group was completing the three mission conditions, the other two groups
independently assessed the information captured and transferred.
Human factors observers were assigned to work with the participants for the purposes of data
collection and focus group discussions.
2.3.2
Materials
The materials needed for the recce information capture and transfer study included a Field
Message Pad, Polaroid Spectra 1200si Instant Camera, Cyber-shot 5.0 Megapixel Digital Still
Camera, Sony Micro MV Video Camera, Fire-I Colour Digital Camera, Xybernaut MA V
Wearable Computer, Microsoft Net Meeting, Digital Patrol Report, Kenwood TK-280 Handheld
Humansystems®
Page 5
Radio, i-Visit, and NetMeeting.1 Each condition required a different combination of these.
Section 2.2.4 provides more detail.
2.3.3
Participants
Fifteen (n = 15) regular force infantry participants participated in the recce information capture
and transfer study. The average age was 32.0 ± 5.6. The ranks of the participants were as
follows: three Officers, six Sergeants, five Master Corporals, and one Corporal. On average,
they had 122 ± 77 months of regular military service. Only three of the participants had not been
on a tour.
2.3.4
Experimental Conditions
To evaluate the impact of digital enhancement for capturing, preparing and transferring three
conditions were examined in this experiment: Hand/Face to Face, Digital/Radio, and
Digital/Telepresence. Below is a detailed description of each experimental condition and the
equipment used. Also, in the Digital/Radio and Digital/Telepresence conditions the participants
used an assigned input device from the input device experiment that was running concurrently.
The input devices included track point, soft keyboard, hard keyboard, voice input, and stylus. A
detailed description of these devices can be found in the Input Device Investigation for Future
Dismounted Soldier Computer Systems (Bos & Tack, 2004).
a) Hand/Face to Face
In the Hand/Face to Face condition the sections leaders used a field message pad and a Polaroid
camera to record their recce information. Following this, section leaders briefed the Platoon
Commander face to face (see Figure 1). This face to face interaction was video taped and fed
live to a separate room for the jury to view and evaluate the information transfer. After each
section leader’s briefing any side or overhead view drawings, hand written text, and photographs
were shown to the jury members.
Figure 1: Face to face patrol briefing
1
For a full description of these please refer to Annex A.
Humansystems®
Page 6
b) Digital/Radio
In the Digital/Radio condition, the section leaders were given a digital camera (cyber-shot or
micro MV) to take pictures as required during their recce. The section leaders and the platoon
commander each used a Xybernaut wearable computer. The digital pictures were downloaded on
to the Xybernaut computer. The section leaders entered text information for their patrol report
into a proforma. Also, the section leaders were able to make digital sketches (side view and
overhead views) as required on the Xybernaut (portable computer) using the drawing tools and
white board function in MSN Net Meeting.
Each of the three section leaders presented their recce information individually to the platoon
commander. Each section leader was located in a different tent than the platoon commander.
The digital pictures, patrol report, and drawings were transferred through a network from the
section leader to the platoon commander and the jury. The section leaders and the platoon
commander were able to view the digital information on a Xybernaut (see Figure 2) and the jury
viewed the digital information on desktop computers in a separate room (see Figure 3 and Figure
4). Internet Explorer, an Internet browser, was used as the viewer of the digital information.
The section leader and the platoon commander verbally communicated over Kenwood TK-280
radios. The radio communication was presented over speakers to the jury in the separate room.
Figure 2: Platoon commander receiving orders remotely
Figure 3: Jury members viewing recce information
Humansystems®
Page 7
Figure 4: Jury room set-up
c) Digital/Telepresence
In the Digital/Telepresence condition, the section leaders and the platoon commander were given
the same equipment and software to perform their recce and briefing as in the Digital/Radio
condition. This equipment included a digital camera and a Xybernaut portable computer. The
software included MSN Net Meeting, Internet Explorer, and the digital patrol report. Also during
the briefings the section leaders and the platoon commander were located in separate tents.
In addition, this condition used Fire-i web cameras during the briefing (telepresence). The web
cameras allowed the section leader and the platoon commander to see each other even though
they were in different locations (see Figure 5). In order to display the Fire-i camera images on
the Xybernauts and allow interaction between the participants, i-Visit software was used. The
jury was able to view the platoon commander’s Xybernaut screen during each briefing. (see
Figure 6).
Figure 5: Platoon commander viewing a Xybernaut during the Digital 2 condition
Humansystems®
Page 8
Figure 6: Platoon commander's screen during the telepresence condition
2.4
Procedure
A Platoon was required to conduct three independent section-size recce patrols each morning for
a total of nine days. Following the recce patrols the three section leaders and the platoon
commander collocated and conducted recce briefings. Three different methods of capturing,
preparing, and transferring this information with enhanced digital capability (in-service,
Digital/Radio, and Digital (with transparency)/Telepresence) were utilized during the recce
patrols and briefings. These methods were evaluated by a jury of their peers watching the
transfer of information from a remote location. The jury consisted of eight to ten regular force
infantry NCOs and Officers that were not involved in that day’s mission. Following the patrol
reports, the platoon commander of the mission used the recce information for a subsequent
platoon assault on one of the three recce objectives.
2.5
Dependent Variables
Quantitative measures for the recce information capture and transfer study included the
following: the time to complete recce information transfer, volume of physical information
transferred, and average number of attachments utilized.
Human factors tests included further subjective data and experimenter observations. For the Jury
Information Task Questionnaire (see Annex B), jury participants viewed the interaction and the
exchange of information between the three section commanders and the platoon commanders, and
assessed this in a number of ways. First, they assessed the overall acceptability of information
Humansystems®
Page 9
capture and transfer in each condition. Following this, they assessed the quality of information,
which was measured according to importance, complexity, timeliness, difficulty, retention,
update frequency, frequency of use, accuracy, and time pressure. Jury participants then assessed
the acceptability of the text data, the side view information, the overhead view information, and
the aural data captured and transferred by each method.
In total, each jury member filled out three Jury Information Task Questionnaires for each of the
three conditions (for a total of 9) based on different section leaders and platoon commanders
information transfer.
At the end of the trial, all of the jury participants filled out an Exit Questionnaire (see Annex C),
evaluating the information transfer. They assessed advantages and disadvantages of the
following: text data written by hand versus on a computer; side-view draws/photo data drawn by
hand or on a computer or using a digital camera or Polaroid camera; overhead view drawings
versus photo data; verbal briefings being face to face, remote by radio or video conferencing.
Participants also participated in a guided focus group discussion.
2.5.1
Rating Scales
Figure 7, Figure 8, and Figure 9 are the scales participants used in the questionnaires.
Figure 7: Standard rating scale
Humansystems®
Page 10
Figure 8: Information utility rating scales
Figure 9: Agreement scale
Humansystems®
Page 11
2.6
Results
The following results include first the quantitative measures followed by the qualitative measures
and then the responses from the guided focus group.
2.6.1
Section Recce Patrol: Objective Results
2.6.1.1 Time to Complete Recce Information Transfer
The time to present the section recce information to the platoon commander was recorded. As
depicted in Figure 10, the times varied between information transfer methods, and varied from
an average low of 7.25 minutes for the Hand/Face to Face condition to a high of 12.25 minutes
for the Digital /Telepresence condition.
Recce Inf ormation Transf er Time to Complete Results
Mean; Box: Mean±SE; Whisker: Mean±SD
18
16
14
Time (Minutes)
12
10
8
6
4
2
0
Hand/Face to Face
Digital/Telepesence
Digital/Radio
Mean
Mean±SE
Mean±SD
Figure 10: Time to complete recce information transfer
These timings do not include the time to prepare the recce report or travel time that would be
required for the platoon to be centralized for the Face to Face condition.
Due to technical problems the time to transfer section recce information for two of the
telepresence missions was not captured. The number of mission’s captured and summary
information is detailed in Table 2.
Humansystems®
Page 12
Table 2: Amount of time required to complete recce information transfer
Average (min.)
Standard Deviation (±min.)
Maximum (min.)
Minimum (min.)
Number (n)
Hand/Face to Face
7
Digital/Radio
10.25
Digital/Telepresence
12.25
2
3.25
5
10.25
14.75
20
4.75
4.25
6
9
9
7
Note: two telepresence recce information transfer mission were not recorded
A statistical analysis was not performed comparing this data because of the low sample size.
The Hand/Face to Face condition for forwarding a recce report required less time to complete
than both the Digital/Radio and Digital/Telepresence conditions. Although the
Digital/Telepresence condition required almost double the time to complete the same recce
debriefing, it should be noted that the participants were not experts on the software used in this
condition and that the software used did have some stability issues, which required outside
intervention to correct. Participants and experimenter observers believed that given more user
experience, the time to complete telepresence recce reporting will lessen in the future.
2.6.1.2 Volume of Physical Information Transferred
The volume of physical recce information transferred (pictures, sketches, videos, etc.) was also
recorded. The average volume varied between a low of 1.6 Megabytes for the Digital/Radio
condition to a high of 3.6 Megabytes for the Digital/Telepresence condition (Figure 11 and Table
3).
The approximate estimate for file size of Polaroid photo transferred to a digital format for
Hand/Face to Face was 500 kilobytes (KB) and on average 4 photos were used (SD=1.9) per
Hand/Face to Face recce report.
The mean file size of the digital photos used in the Digital/Radio and Digital/Telepresence
conditions was 203.8 KB (SD=279.1KB, max=1501KB, min=58KB); and on average 6.4
photos were used (SD=2.7) for the Digital/Radio recce report and on average 4.5 photos were
used (SD=3.2) for the Digital/Telepresence recce report. The mean file size of digital video
used in the Digital/Telepresence condition was 1824.7 KB (SD=1230.4KB, max=5383KB,
min=129KB); and on average 2 videos were used (SD=1.4) for the Digital/Telepresence recce
report.
Humansystems®
Page 13
Recce Inf ormation Transf er Av erage Package Size Results
Mean; Box: Mean±SE; Whisker: Mean±SD
7000
6000
Size (KB)
5000
4000
3000
2000
1000
0
Hand/Face to Face
Mean
Mean±SE
Mean±SD
Digial/Telepresence
Digital/Radio
Figure 11: Average volume of recce information transfer package
The estimation of the volume of information that was transferred may indicate that the
Digital/Telepresence condition involved almost twice the amount of information than both the
Hand/Face to Face and Digital/Radio conditions. The large difference can be attributed to the
use, on average, of two video clips per Digital/Telepresence condition.
Table 3: Average size of digital information sent in the Digital/Radio and
Digital/Telepresence Recce Transfer
Mean (KB)
Standard Deviation (±KB)
Maximum (KB)
Minimum (KB)
Number (n)
Digital
Photos
203.8
279.1
1501
Digital
Video
1824.7
1230.4
5383
58
96
129
24
The utility of using file size with the amount of information is debateable. Information to the
user is defined with respect to the user’s knowledge and goals, so different users will take away
different amounts of information from the same materials. Also, the size of the files depends on
the way images are coded and compressed by software, making the comparison between formats
difficult. The data presented above was included to give the reader an indication of the size of
the files transmitted during the study and thus the operational impact on wireless network
requirements.
Humansystems®
Page 14
2.6.1.3 Average Number of Attachments Used
The average number of photos, sketches, videos, etc. used in the different transfer conditions
was also recorded. The average number varied between a low of 6.0 items for the Hand/Face to
Face condition to a high of 7.8 items for the Digital /Telepresence condition (see Table 4).
Table 4: Number of items used per condition
Average (n)
Hand/Face to Face
6.0
Digital/Radio
7.8
6.6
1.9
2.6
3.6
9
11
13
2
4
3
9
9
9
Standard Deviation (±n)
Maximum (n)
Minimum (n)
Number (n)
Note: number of items included photos, video, maps and/or sketches
As seen in Table 4, the average number of attachments used did not vary much across conditions.
2.6.2
Section Recce Patrol: Jury Information Task Questionnaire
Each jury member filled out a minimum of three recce Jury Information Task Questionnaires for
each of the three conditions. Jury member’s data for each condition was averaged for all criteria.
Missing data points were replaced with means.
The following areas were explored for information captured and transferred across conditions:
•
Overall acceptability
•
Quality of information provided
•
Acceptability of text data provided
•
Acceptability of side-view information provided
•
Acceptability of overhead view information provided
•
Acceptability of aural information provided
2.6.2.1 Overall Acceptability of Information Transfer
This section of the questionnaire asked for overall ratings regarding the method of information
transfer. The responses are based on the 7-point acceptability scale. For all three conditions, the
user acceptance ratings were between ‘Barely Acceptable’ and ‘Reasonably Acceptable’.
Generally, the Hand/Face to Face condition was rated more acceptable than the two digital
conditions. The Digital/Radio condition was, in general, rated the least acceptable. The results
are illustrated in Figure 12.
Humansystems®
Page 15
HF>DR
HF>DR
HF>DR
HF>DR
Clarification
Time to comprehend
Effort to comprehend
Ease of using info
Completely Acceptable
HF>DR
Recce Inf ormation Transf er Task Questionnaire Results
Vertical bars denote 0.95 conf idence interv als
Reasonably Acceptable
Barely Acceptable
Borderline
Barely Unacceptable
Reasonably Unacceptable
Trust in digital info transfer
Reducing cognitive workload
Detailed raid execution
General mission planning
Global situational awaress
Enemy situation al aware nes s
Supporting terrain awareness
Disseminating info
Time to recieve info
Detail of info received
Hand/Face to Face (HF)
Digital/Radio (DR)
Digital/T elepresence (DT )
Amount of info received
Completely Unacceptable
Figure 12: Overall participant acceptability of conditions for information transfer
Across all of the task questions (15), no significant difference was found across the three
conditions (Hand/Face to Face, Digital/Radio, Digital /Telepresence) of information transfer.
A repeated-measures ANOVA was conducted for each task assessment criteria and significant
differences were found between the Hand/Face to Face condition and the Digital/Radio
condition. The former was found to be significantly more acceptable than the latter for the
following criteria: amount of recce information received (F(2, 26)=3.458, p=.0466),
opportunity to gain clarification (F(2, 26)=5.615, p=.009), time required to comprehend
information (F(2, 26)=4.961, p=.0149), effort required to comprehend information (F(2,
26)=4.901, p=.0156), and effort/ease of using & or manipulating recce information for
planning (F(2, 26)=4.0837, p=.0287).
The results suggest that face to face briefings (Hand/Face to Face condition) were more
acceptable than the remote radio briefings (Digital/Radio condition) for passing on explanations
of the recce information transferred. Face to face briefings permitted greater information to be
passed as it allowed the recce detachment commander to fill in subtle details that would not be
passed via radio. The Hand/Face to Face condition allowed the platoon commander to obtain
more clarification on the information sent, i.e. exact views on directions of photos taken, scale,
landmarks, etc. Remote briefings by radio took longer to comprehend and required more
individual effort to comprehend. Face to face information could be used more easily than remote
radio-briefed information.
Humansystems®
Page 16
The acceptability for the time to receive recce information was not significantly different across
conditions. It is interesting to note that while the Hand/Face to Face condition took much longer
than the other two conditions (see 2.6.1), the participants rated this approach as more acceptable
for the length of time required to receive information than the digitally mediated conditions
(Digital/Radio and Digital /Telepresence). It may be possible that the participants recognized the
need for more clarification and detail in the report, and thus more time was required.
The results for the Digital /Telepresence condition suggest that telepresence helped mitigate some
of the negatives of the remote radio briefing. Except for trust in information transfer,
telepresence recce information transfer was rated more acceptable than radio mediated
information transfer.
2.6.2.2 Quality of Initial Information Provided
The quality of the initial information provided was assessed according to its importance,
complexity, timeliness, difficulty, retention, update frequency, frequency of use, accuracy, and
time pressure. The average results for each condition are presented in Table 5.
The importance of the information was rated between ‘can not complete this task without this
information’ and ‘can complete the task with some difficulty without this information’ for all
three conditions. The complexity of the information was rated between ‘low-medium’ and
‘medium’ for all three conditions. Participants rated the timeliness of the information between
‘borderline’ and ‘acceptable’ for all three conditions. They rated the difficulty to use the
information between ‘borderline’ and ‘somewhat easy to use’ for all three conditions. The
retention, or how long the information was useful, was rated between ‘a few minutes’ and ‘a few
hours’ for all three conditions. Participants rated the update frequency of the information
between ‘sometimes’ and ‘often’ for all three conditions. They rated the frequency of use of the
information between ‘sometimes’ and ‘often’ for all three conditions. Participants rated the
accuracy of the information as ‘acceptable’ for all three conditions. They rated the time pressure
they feel when acquiring, sending or receiving this information between ‘busy’ and ‘moderate
activity’ for all three conditions.
A Friedman ANOVA was conducted for each criterion and the following significant differences
were found.
Humansystems®
Page 17
Table 5: Participant assessment of the quality of initial information provided
Question
Digital/Radio (DR)
Digital/Telepresence (DT)
Hand/Face to Face
(HF)
Digital/Radio
(DR)
(DT)
Sig. Diff.
p≤0.05
Mean
SD
Mean
SD
Mean
SD
Importance: Without this information I
can complete this task.
2.8
0.8
2.8
0.7
2.7
0.6
Complexity: How complex is the
information?
2.4
0.8
2.8
0.8
2.8
0.8
Timeliness: How acceptable is the
timeliness of this information for the task?
3.8
0.4
3.8
0.6
3.8
0.7
Difficulty: How difficult is it to use the
information to complete the task?
4.1
0.3
3.7
0.6
3.7
0.8
Retention: For how long is this
information useful?
3.0
0.4
2.8
0.3
3.0
0.5
Update Frequency: How frequently
would you wish to update this
information?
2.2
0.6
1.8
0.6
1.9
0.5
Frequency of Use: How often do you use
this information?
2.1
0.7
1.9
0.7
2.2
0.8
Accuracy: How acceptable is the
accuracy of this information for the task?
4.0
0.2
3.8
0.5
4.0
0.4
HF,
DT>DR
Time Pressure: What time pressure do
you feel when acquiring, sending or
receiving this information?
3.7
0.6
3.3
0.9
3.4
0.8
HF>DR,DT
HF<DR,DT
HF>DR,DT
HF>DR
The Hand/Face to Face condition was rated significantly less complex than the Digital/Radio and
Digital/Telepresence conditions (Chi Sqr. (N=16, df=2) = 11.49, p<0.00). This suggests that
significantly more complex information is transferred with the Digital/Radio and
Digital/Telepresence conditions compared to the in-service method (Hand/Face to Face
condition). This complex information is also more difficult to use. Results showed that the
Hand/Face to Face condition was rated significantly less difficult to use the information provided
than the Digital/Radio and Digital Two conditions (Chi Sqr. (N=16, df=2) = 8.55, p<0.01).
The participants also believed that face to face briefings required less referral to notes than the
digitally mediated methods.
The Hand/Face to Face condition was rated significantly lower than the Digital/Radio condition
regarding the need to be updated frequently (Chi Sqr. (N=16, df=2) = 8.49, p<0.01). The
participants believed that information provided in a face to face briefing did not have to be
updated frequently compared to the digital methods. Information provided by observers on the
ground contained up to date changes in vegetation, enemy positions, patrol patterns etc., whereas
digital images could be days if not weeks or months old. It should be noted that the impact of
having to return to base was not included in this evaluation. In reality, recce patrols would have
had to spend hours, if not days, returning to friendly lines to get this information to the platoon
Humansystems®
Page 18
commander. Thus, digitally transferred information could be considered minutes, if not hours,
old while in-service methods take considerably longer.
The Hand/Face to Face condition was rated significantly more acceptable for accuracy than the
Digital/Radio condition. Face to face briefings allowed recce commanders to identify up to date
changes to maps, aerial photos, etc. As well, the Digital/Telepresence condition was rated
significantly more acceptable for accuracy than the Digital/Radio condition (Chi Sqr. ( N=16,
df=2) = 12.16, p<0.00)
The Hand/Face to Face condition was rated significantly less than the Digital/Radio and
Digital/Telepresence conditions for time pressure (Chi Sqr. (N=16, df=2) = 7.19, p<0.03).
The participants believed they were under more time pressure when briefing the results of their
recce missions in the digital format than when they were conducting face to face briefings.
Participants are trained to keep radio traffic to a minimum and using over 10 minutes of radio
time (see 2.6.1.1) was an issue for them. The participants attempted to expedite the digital
briefing, passing on critical information only, and if the platoon commander needed more
information, he could refer to the attached files or ask specific questions.
There were no significant differences across conditions regarding importance, timeliness,
retention, and frequency of use.
2.6.2.3 Acceptability of Text Information Provided
For this section of the Jury Information Task Questionnaire, participants were asked to rate the
acceptability of the text information. The responses are based on the 7-point acceptability scale
(see Figure 7). For the Hand/Face to Face condition, the text information was hand-written
notes on a field message pad. For both the Digital/Radio and Digital/Telepresence the test
information was digital text in note pad. As shown in , the ratings were between ‘Barely
Acceptable’ and ‘Reasonably Acceptable’ for all three conditions. Refer to Figure 13.
Information Transfer - Task Questionnaire:
Text information Acceptability Ratings Results
Vertical bars denote 0.95 confidence intervals
Completely Accept
Reasonably Accept
Barely Acceptable
Borderline
Barely Unacceptable
Ease of distributing info
Importance to mission success
Perceived accuracy
Relevance at Platoon/Section
Timeliness of info
Info detail / complexity
Ease of using info
Time to use info
Time to comprehend
Digital/Radio (DR)
Digital/T elepresence (DT )
Reliability for info transfer
Completely Unaccept
Suitability for getting info
Reasonably Unaccept
Figure 13: Degree of participant acceptability of text data provided
Humansystems®
Page 19
Overall, no significant difference was found across the three conditions of information transfer
regarding text data. However, a repeated-measures ANOVA was conducted for each criteria and
found that the Hand/Face to Face and the Digital/Radio conditions were significantly more
acceptable for the utility of information – importance to mission success criterion compared to
the Digital/Telepresence condition.
2.6.2.4 Acceptability of Side View Information Provided
acceptability of the side view information that was provided by the varying conditions. The
responses are based on the 7-point acceptability scale (see Figure 7). In the Hand/Face to Face
condition, the side view consisted of hand drawings and Polaroid pictures. In the Digital/Radio
condition, still digital pictures were taken. In the Digital/Telepresence condition, still digital
pictures and short digital video clips were taken. For all three conditions, the ratings were
between ‘Barely Acceptable’ and ‘Reasonably Acceptable’ (Refer to Figure 14).
Inf ormation Transf er - Task Questionnaire
Side View Inf ormation Acceptability Ratings Results
Completely Accept
Reasonably Accept
Barely Acceptable
Borderline
Barely Unacceptable
Perceived accuracy
Timeliness of info
Ease of using info
Time to use info
Time to comprehend
Digital/Radio (DR)
Digital/Telepresence (DT )
Completely Unaccept
Reasonably Unaccept
Figure 14: Degree of participant acceptability of side view information provided
Overall, no significant difference was found between the three conditions. Moreover, a repeatedmeasures ANOVA conducted for each criteria revealed no significant differences.
2.6.2.5 Acceptability of Overhead View Information Provided
acceptability of the overhead view information provided in each condition. The responses are
based on the 7-point acceptability scale (see Figure 7). In the Hand/Face to Face condition, the
overhead view was hand drawn. In the Digital/Radio condition, overhead views were digitally
drawn. In the Digital/Telepresence condition, overhead views were digitally drawn with
Humansystems®
Page 20
overlays, if desired by the soldier. For all three conditions, the ratings were between ‘Barely
Acceptable’ and ‘Reasonably Acceptable’ (Refer to Figure 15).
Inf ormation Transf er - Task Questionnaire:
Ov erhead View Inf ormation Acceptability Ratings Results
Completely Accept
Reasonably Accept
Barely Acceptable
Borderline
Barely Unacceptable
Reasonably Unaccept
Perceived accuracy
Timeliness of info
Ease of using info
Time to use info
Time to comprehend
Digital/Radio (DR)
DigitalT elepresence (DT )
Completely Unaccept
Figure 15: Degree of participant acceptability of overhead view information
provided
Overall, no significant difference was found across the three conditions. As well, a repeatedmeasures ANOVA conducted for each criteria revealed no significant differences across
conditions for any of the criteria.
2.6.2.6 Acceptability of Aural Information Provided
acceptability of the aural information provided. The responses are based on the 7-point
acceptability scale (see Figure 7). For the Hand/Face to Face condition, the participants were
face to face. For the Digital/Radio condition the participants communicated over radios. For the
Digital/Telepresence condition, the participants communicated by telepresence (i.e., radio and
web cameras). The Digital/Radio and Digital/Telepresence conditions were rated between
‘Barely Acceptable’ and ‘Reasonably Acceptable’; whereas, the Hand/Face to Face condition was
rated between ‘Reasonably Acceptable’ and ‘Completely Acceptable’ (see Figure 16).
Humansystems®
Page 21
Inf ormation Transf er- task Questionnaire:
Aural Inf ormation Acceptability Ratings Results
HF>DR,DT
HF>DR,DT
Ease of using info
HF>DR,DT
Time to use info
Perceived accuracy
HF>DR,DT
HF>DR,DT
Time to comprehend
Timeliness of info
HF>DR,DT
Digital/Radio (DR)
Digital/Telepresence (DT)
Completely Accept
Reasonably Accept
Barely Acceptable
Borderline
Barely Unacceptable
Reasonably Unaccept
Completely Unaccept
HF>DR,DT
Figure 16: Degree of participant acceptability of aural information provided
Overall, a significant difference was discovered across the three conditions (F(2,26) = 4.1,
p<0.03, MS = 28.03). A post hoc Duncan’s test revealed the Hand/Face to Face condition to
be significantly more acceptable than the Digital/Radio and Digital/Telepresence conditions for
the aural information provided. In other words, the participants found it more acceptable to
communicate face to face than over radio or by telepresence.
A repeated-measures ANOVA was conducted for each criteria and the following significant
differences were found. The Hand/Face to Face condition was shown to be significantly more
acceptable than the digital conditions for the following criteria: suitability of modality/format
(i.e. paper or electronically) for getting the information (F(2,26) = 9.8, p<0.00, MS = 5.64),
reliability of the modality for information transfer (F(2,26) = 7.62, p<0.00, MS = 5.22), time
required to comprehend information (F(2,26) = 5.4, p<0.01, MS = 3.87), effort required to
comprehend information (F(2,26) = 5.8, p<0.01, MS = 3.59), time required to use the
information (for plans) (F(2,26) = 5.5, p<0.01, MS = 2.88), effort/ease of using and or
manipulating information for planning (F(2,26) = 4.4, p<0.02, MS = 3.05), and acceptability of
information detail/complexity (F(2,26) = 5.5, p<0.01, MS = 3.2).
No significant difference was found across the three conditions for the following criteria: utility
of information – timeliness, utility of information – relevance at platoon/section level, utility of
information – perceived accuracy, utility of information – importance to mission success, and
ease of distributing information.
2.6.2.7 Jury Information Task Questionnaire Comments
Participants were given the opportunity to comment on the three conditions (Hand/Face to Face,
Digital/Radio, Digital/Telepresence) on the Jury Information Task Questionnaire. Below is a
summary of their comments.
Humansystems®
Page 22
Hand/Face to Face
Participants commented that hand written text lacks timeliness because it must be hand delivered.
With respect to Polaroid photos, participants mentioned that it is difficult to get enough details
and difficult to develop a panoramic view. They also said that Polaroid cameras do not have the
capability to take pictures at night. Again, participants reported that it is time consuming to wait
for the information to be delivered to the Platoon Commanders and may be outdated by this time.
Participants also suggested that the usefulness of overhead view hand drawings of the objective
depends on individual drawing skill. They can be effective at detailing the objective, depending
on the timeliness of the information and accuracy.
For aural information, participants preferred the face to face method because they found it easier
to gain clarification and they were able to see facial expressions.
Digital/Radio
Participants found the format of the digital report to be too cumbersome. They found it time
consuming to enter in the information and difficult to decipher the important information in the
output format of the report. They found the text report left a lot of gaps. However, they
commented that talking over the radio and viewing the digital pictures helped to fill in these gaps.
Participants suggested a more user friendly and standard format for the digital patrol report.
Participants reported that they would like more zoom capability of the digital cameras. They
would like bearing and gird references as well as distance from objective automatically recorded
and tagged to each picture. They believed this would reduce the amount of information that must
be transferred verbally and the time spent interpreting the pictures. Participants also desired an
easier method for naming the photos than that which was provided in the study.
Participants found it difficult to draw a detailed overhead view of the objective. They would like
more elaborate digital drawing tools than that which was provided. They also desired maps that
have greater detail, which can be enlarged without reducing quality.
Participants reported that the radio communication gave clarification to the digital text, drawings,
and pictures. However, there was concern that too much radio time was required.
Again, participants commented that the digital report needed to be less cumbersome. They
believed, however, it was a good method of sending information to reduce radio transmissions.
For side view pictures, participants would like the grid reference bearing and distance from
objective added to each picture. Moreover, they desired a better method of naming pictures and
videos than that which was provided in the study. The participants would like better zoom
capability when taking photos and recording video.
The participants would like enhanced drawing tools as well as more detailed maps, aerial photos,
and satellite photos with good quality zoom capability.
Some of the participants found the web cam images to be useful, whereas, others commented that
they did not look at them.
Humansystems®
Page 23
Participants believed that faster computers and user friendly software were required to have this
type of information transfer working efficiently and smoothly.
2.6.3
Section Recce Patrol: Information Transfer Exit Questionnaire
The Information Transfer Exit Questionnaire contained open-ended questions. It assessed general
advantages and disadvantages of text data written by hand versus on a computer, side view data
drawn by hand or by computer or using a digital camera or Polaroid camera, overhead view
drawings versus photo data, and verbal face to face briefings compared to radio or video
conferencing briefings. The following sections summarize participants’ comments.
2.6.3.1 Text Data
All of the participants believed that there is a need for patrol reports to be completed at the
dismounted Platoon level or lower. While six participants thought that future patrol reports
should continue to be completed by hand on field message pads, nine stated that patrol reports in
the future should be completed on a mini-computer.
Participants thought that a mini-computer was advantageous for patrol reports because it could
electronically transmit information from a remote location in real time. Other advantages to the
mini-computer identified by participants were a fill in the blank proforma could ensure a standard
format is used, the increased legibility, the ease to consolidate multiple patrol reports, and the
ease to make copies. However, participants also identified disadvantages, which included the
need for a power source, the threat of lost information due to crashing, the durability of
technology, a computer training requirement, and more equipment to carry.
Participants also provided advantages for hand writing patrol reports on a field message pad. For
example, there is no training involved, there is nothing to break, it is fast and easy to use, and it
is accessible (i.e., everyone has paper and pen). However, there were disadvantages of handwritten patrol reports. Participants explained that handwriting can be difficult to read, it must be
hand carried to other locations, a standard format may not have been followed, and paper is
vulnerable to the elements.
Participants believed that the format of the proforma needs to be enhanced in order to improve
the means of preparing a recce patrol report. Participants suggested a less structured form with
more space for additional comments. The output after submitting the patrol report should only
contain the fields where text was entered to reduce the amount of useless information that was
sifted through. Participants would like the ability to annotate or add comments to patrol reports.
Moreover, a standard patrol report format throughout the CF was suggested.
Six of the fifteen participants believed that patrol reports should always be completed behind
friendly lines once the mission was finished, whereas, the other nine commented that this is not
always necessary.
Twelve of the fifteen participants believed that there is a need for added report preparation
capabilities for dismounted sections and recce detachments.
Humansystems®
Page 24
2.6.3.2 Side View Pictures
All of the participants identified a need for completed drawings and side view photographs at the
dismounted Platoon level or lower. They also believed that digital cameras should capture side
view pictures because of the increased accuracy, the electronic transmission capability, the zoom
capability, and the possibility of infrared red and image intensifier capability. About half of them
thought that hand drawn pictures on paper or on a computer is useful.
Participants explained that the advantages of hand drawing side view pictures onto a field
message pad are that no additional equipment is required, participants can add their own
interpretation, and the drawings are easy to alter. Participants explained that the advantages of
hand drawing side view pictures onto a computer are they can be transmitted easily and the
drawing can be overlaid on a map. They also said that satellite photos, unattended aerial vehicle
(UAV) photos, and drawings can be easily altered.
Only a few participants supported the use of Polaroid cameras for side view pictures. The main
advantage of this technique was said to be the immediate hard copy of the picture.
To improve the capture of side view images, participants suggested the following information
should be added to the pictures: bearing, grid, and scale. They also said that additional drawing
tools on the computer are required. Participants thought that digital cameras need to have
increased zoom capability, improved panoramic options, and the ability to take pictures at night.
Moreover, participants thought that there should be the capacity to send the pictures immediately
or when deemed required. They also would like to be able to store the pictures for later use.
All of the participants agreed that there is a need for additional imaging capability for dismounted
sections and recce detachments.
2.6.3.3 Overhead View Drawing / Photo
All of the participants agreed that an overhead drawing or picture is required at the dismounted
Platoon level or lower. Eight of the fifteen participants believed that overhead viewing could be
drawn in a field message pad or on a portable computer. Eleven participants mentioned that the
overhead image could be captured as an UAV photo or drawn as an UAV image overlay.
Thirteen participants thought that the overhead image could be drawn as a map overlay.
According to participants, the advantages of hand drawing overhead view onto a field message
pad are that no additional equipment is required and it is easy to alter. On the other hand, they
believed that the advantages of drawing on a computer is they can be electronically transferred,
different colours can be readily manipulated to reduce confusion of the sketch, corrections can
easily be made, and duplicates can be made while maintaining the quality. Participants
commented that the advantages of an overhead sketch drawn with an electronic map overlay is
that grid locations are available, thereby enabling participants the ability to orient themselves to
the ground better. Participants reported that the advantage of a UAV image is the ability to see
real time footage of the terrain and target. The ability to draw an overlay on the UAV image
enables participants to add information about their plan to the image, increasing comprehension.
To improve the means of capturing overhead views, the participants desired the ability to zoom
in and out of an overhead picture, grid references, the time the picture was taken, the scale of the
picture, and enhanced drawing tools. Participants said that they would also like the ability to send
the overhead images immediately and be able to store them.
Humansystems®
Page 25
All of the participants believed that there is a need for an added overhead image capability for
dismounted sections and recce detachments.
2.6.3.4 Verbal Briefings
Fourteen of the fifteen participants stated that there is a current need to give verbal patrol
debriefs at the dismounted Platoon or lower levels. Thirteen of them said that debriefings could
be done face to face. Participants explained that an advantage of face to face debriefings is the
ability to gauge the other person’s understanding by observing facial expressions. Other
advantages of this kind of briefing is the ability to easily gain clarification, make corrections, and
additions to the patrol report.
Ten participants stated that briefings could be done remotely by radio. An advantage to this
procedure was the ability to conduct the debriefing over a given distance while keeping the target
objective in sight. They also said that an advantage to debriefings conducted via the radio was the
reduction of movement around the ORV. Participants liked the radio because information was
disseminated quickly.
Eight participants stated that debriefings could be done remotely by video conferencing.
Participants thought that this method was advantageous because it can be done over distances,
and it resembles face to face interaction because you can see the other person’s face and
potentially gauge their understanding.
Three participants thought that debriefings should be done by remotely by LAN with no video
conferencing.
Face to face debriefings will always be the first choice of participants and will be done if
possible. However, ten of the fifteen participants believed that technology (digital reports,
pictures, overlay, video conferencing, etc.) could reduce the need for face to face debriefings.
They argued that if participants had reliable communication and a reliable system for sending
images and reports, then remote debriefings would be possible. Participants thought that remote
or telepresence briefings would be a valuable contribution to a recce detachment because
participants could remain in place at objective and send up to the minute updates of the situation.
Fourteen participants stated that there is a need for dismounted sections and recce detachments to
have the ability to conduct debriefs remotely.
Humansystems®
Page 26
3
Commander’s Recce
using different types and levels of information for the commander’s pre-attack recce.
3.1
Commander’s Recce Background
Traditionally commanders conduct a personal reconnaissance prior to developing their orders for
an attack. Once the platoon is in the ORV the commander would move forward with his recce
group and conduct a stealthy recce. Usually the commander is guided by a member of a team
sent ahead to observe the objective. The commander typically observes the objective from a
number of observation points along the perimeter, moving in a cloverleaf fashion to avoid
detection – see Figure 17. Concern has been raised that this approach consumes large amounts
of time and raises the risk of detection, either the commander conducting his recce or the platoon
located in the ORV. In order to see if technology can improve the speed and efficacy of the
commander’s recce, remote reconnaissance’s have been proposed. One approach is to utilize
remote sensors (cameras, seismic sensors, etc.) emplaced along the perimeter of the objective by
the recce team sent ahead. The commander would simply call up the various views and
information while in the security of the ORV – see. Another approach to conducting a physical
recce is to utilize tactical UAVs. UAVs have the ability to quickly examine large areas of
ground, observe behind buildings, etc. Hovering UAVs also have the ability to concentrate
search activities where enemy activity has been located – see Figure 18 and Figure 19.
Figure 17: Traditional commander’s reconnaissance techniques
Humansystems®
Page 27
Figure 18: Remote commander’s
reconnaissance techniques – Recce
Teams
3.2
Figure 19: Remote commander’s
reconnaissance techniques –UAVs
Aim
•
Evaluate the effectiveness of providing the Platoon Commander with remote recce data
versus the conventional eyes-on-recce.
•
Evaluate the effectiveness of each Commander’s recce option for providing awareness of
the situation at the objective.
•
Determine the suitability of each Commander’s recce option for supporting the assault
planning activity and for its impact on mission success.
•
Identify the interface design issues associated with each recce data collection option and
the associated implications for interface design.
3.3
Method
This section provides an overview of the experimental method and explains the approach and data
collection.
3.3.1
Overview
19 November 2003.
Humansystems®
Page 28
3.3.2
Materials
Radio, i-Visit, and NetMeeting.2 Each condition required a different combination of these.
Section 3.2.4 provides more detail.
3.3.3
Participants
Three regular forces infantry commanders were used for this stage of the experiment.
3.3.4
Experimental Conditions: Physical, Radio, UAV Video
The Commander’s Recce study examined three different methods of gaining additional tactical
information or confirming earlier information prior to the platoon attack: Physical, Radio, and
UAV Video. Below is a detailed description of each experimental condition and the equipment
used.
a) Physical
To establish a baseline condition, the Commander conducted a physical recce. This is current
CF procedure. The commander was provided with an aerial photograph, 1:50,000 map and a
field message pad.
b) Radio
For this condition, the Commander conducted a recce remotely over radio with one of the
sections with ‘eyes on’. The Kenwood radios were used to transfer this information.
c) UAV Video
For the remote UAV Video, the Commander conducted a recce by remotely viewing UAV over
flight video footage of the objective.
3.4
Procedure
The platoon commander conducted a commander’s recce of the site of the assault in all of the
conditions: Physical, Radio, and Unattended Aerial Vehicle (UAV) Video.
Following the attack, the platoon commander filled out an Update Task Questionnaire (Annex
D), evaluating the commander’s recce method employed. At the end of the trial, the participants
completed an Exit Questionnaire (Annex E) and participated in a focus group discussion.
2
Humansystems®
Page 29
3.5
Dependent Variables
For the Commander’s Recce Update Task Questionnaire, participants assessed the overall
acceptability of information capture and transfer in each condition. Following this, they assessed
the quality of information, which was measured according to importance, complexity, timeliness,
difficulty, retention, update frequency, frequency of use, accuracy, and time pressure for
acquiring, sending, or receiving the information.
The Commander’s Recce Exit Questionnaire contained open ended questions, which assessed the
need of a physical recce given different information, additional information required, advantages
and disadvantages of a physical recce, advantages and disadvantages of relying on previous recce
information, advantages and disadvantages of real-time information, and the optimum tools for a
commander’s recce.
3.5.1
Rating Scales
Rating scales used in the Commander’s Recce study were the same as those used in the Section
Recce Patrol. For a review, please see Figure 7, 8, and 9.
3.6
Results
The following results include the qualitative measures from the Task Questionnaire and Exit
Questionnaire followed by the responses from the guided focus group.
3.6.1
Commander’s Recce: Update Task Questionnaire
The three platoon commanders evaluated the three different methods for conducting a
commander’s recce. Since the N was only three for this portion of the study no statistical
analysis were completed beyond descriptive statistics.
3.6.1.1 Overall Acceptability for Information Transfer
This section of the questionnaire asked for overall ratings of the method of information transfer.
The responses are based on the 7-point acceptability scale (see Figure 7). The average ratings are
presented in Figure 20.
Humansystems®
Page 30
Co mma nder 's Recce Task Quest io nnaire
Modality Acceptance Results
Overall acceptance of new info
Overall utility of new info
New info supporting raid executtion
New info enhancing enemy SA
New info enhacing friendly SA
Ease of recording new info
Time available to use new info
Ease of manipulating new info
Effort required to understand new info
Oppertunity to gain clarification
Time to recceive new info
Physical
R ad io
U AV Vid eo
Amount of new information received
Barely Acceptable
Borderline
Barely Unacceptable
Figure 20: Overall participant acceptability of conditions for information transfer
Though the overall ratings were positive for all three conditions (no criteria received an average
rating below “Borderline” for acceptability), the Platoon commanders believed that a physical
recce is a requirement. Not only does the physical recce provide the Platoon Commander with up
to date information, it also gives him or her a “feel” for the ground in order to develop a suitable
plan for an assault on the objective.
3.6.1.2 Quality of Initial Information Provided
The quality of information was assessed according to its importance, complexity, timeliness,
difficulty, retention, update frequency, frequency of use, accuracy and time pressure.
The importance of the information was rated between ‘can not complete this task without this
information’ and ‘can complete the task with difficulty without this information’ for the Physical
condition. The Radio and UAV Video conditions were rated ‘can complete the task with
difficulty without this information’. The complexity of information was rated between ‘lowmedium’ and ‘medium’ for all three conditions. The timeliness of the information was rated
between ‘borderline’ and ‘acceptable’ for all three conditions. The difficulty to use the
information was rated between ‘somewhat easy’ to ‘very easy’ for the Physical condition. The
Radio and UAV Video conditions were rated between ‘borderline’ and ‘somewhat easy’. The
retention, or how long the information was useful, was rated between ‘a few minutes’ and ‘a few
hours’ for all three conditions. The update frequency of the information was rated between
‘sometimes’ and ‘often’ for all three conditions. The frequency of use of the information was
rated between ‘sometimes’ and ‘often’ for all three conditions. The accuracy of the information
Humansystems®
Page 31
was rated between ‘borderline’ and ‘acceptable’ for all three conditions. The time pressure the
participants felt when acquiring, sending or receiving this information was rated between ‘busy’
and ‘moderate activity’ for all three conditions. The results are presented in Table 6.
Table 6: Participant assessment of the quality of initial information provided
Question
3.6.2
Physical
Radio
UAV Video
Mean
SD
Mean
SD
Mean
SD
Importance: Without this information I
can complete this task.
2.0
0.0
3.0
0.0
3.0
0.8
Complexity: How complex is the
information?
2.7
0.5
3.0
0.0
3.0
0.0
Timeliness: How acceptable is the
timeliness of this information for the task?
3.3
0.5
3.3
0.9
3.7
0.5
Difficulty: How difficult is it to use the
information to complete the task?
4.3
0.5
3.7
0.5
3.3
0.5
Retention: For how long is this
information useful?
2.3
0.5
2.3
0.5
2.3
0.5
Update Frequency: How frequently
would you wish to update this
information?
1.7
0.5
1.7
0.5
1.3
0.5
Frequency of Use: How often do you use
this information?
1.7
0.5
1.7
0.5
2.0
0.0
Accuracy: How acceptable is the
accuracy of this information for the task?
4.0
0.8
4.0
0.0
3.3
0.9
Time Pressure: What time pressure do
you feel when acquiring, sending or
receiving this information?
3.3
0.5
3.0
0.0
3.3
0.5
Commander’s Recce: Exit Questionnaire
The Exit Questionnaire contained open-ended questions. The Exit Questionnaire focused on the
three conditions; physical recce, no physical recce or relies on previous information received.
The non-physical recce relied on telepresence/real-time information. All fifteen participants that
took part in the jury and the attacks filled out this questionnaire since all of them perform recces
as part of their duties. The following is a summary of the participants’ comments.
3.6.2.1 Physical Recce
All of the participants agreed that there is a need to conduct a physical recce of the objective at
the dismounted Platoon or lower levels following the recce information transfer Hand/Face to
Face condition (FMP drawings, Polaroid picture, face to face verbal debrief, and hand written
text). Moreover, twelve of the fifteen participants believed that a physical recce was required
following the recce information transfer Digital/Radio condition (digital drawings, digital
pictures, radio debrief, and digital text). And eleven of the fifteen participants believed that a
Humansystems®
Page 32
physical recce was required following the recce information transfer Digital/Telepresence
condition (digital drawings, digital pictures, overlays, telepresence, and digital text).
Participants said that, if a recce of the objective has not been undertaken, participants would
require additional information from a commander’s recce, which included current location of the
objective, ground layout, and enemy location, size, and strength. Participants used the acronym
SALUTE (S = size, A= activity, L = location, U = unit, T = time, E = equipment) to
organize this information. This information is then used to determine the fire plan, approaches,
assault positions, cut offs, and routes for withdraw.
On the other hand, the additional information that the participants would require from a
commander’s recce, if a recce of the objective had been undertaken, is to confirm the location of
the objective, ground layout, and enemy location, size, and strength. This information would
then be used to adjust the commander’s plan as required.
According to participants, the advantages of a physical recce include knowing the current
situation on the objective, increase situational awareness by actually seeing the ground layout,
confirmation of the plan’s feasibility, and it allows the commander to change the plan as
required. The disadvantages of a physical recce, however, include the chance of compromise
(contact with enemy), time required, and increased manpower requirements.
Participants suggested that high zoom cameras (10x or more), 3D satellite map or image to show
contours and inter-visibility on a smaller scale (25 to 50m), and optical devices for night and day
viewing of the objective would improve a physical commander’s recce. Also, the participants
would like the ability to electronically transfer information from the patrol to the platoon
commander, including grid markers of the patrol location and bearing.
3.6.2.2 No Physical Recce – Reliance on Previous Information
Participants believed that the advantages of relying on previous recce information include
increased mission tempo and less chance of enemy contact because of reduction of movement on
objective position.
However, participants believed that the disadvantages of not conducting a physical recce and
relying on previous recce info are many. For example, they said that a platoon does not have
confirmation of enemy location and any changes on the objective, nor are they able to confirm
the feasibility of the plan compared to the actual ground layout. Participants also commented that
there is reduced situational awareness, and the platoon commander must rely on lower level
leadership to correctly layout position and have a thorough knowledge of platoon operations. In
effect, the platoon commander has less control.
If a previous recce of an objective has been undertaken, the additional information that is
required so that a commander does not have to complete a physical recce is: up to date
information on enemy location, size and strength, up to date information on objective and layout
of the ground. Participants explained that the Platoon commander requires this information to
confirm and adjust his or her plan. Some of the participants thought that real time video of the
objective and panoramic views would be helpful.
Humansystems®
Page 33
3.6.2.3 No Physical Recce – Rely On Telepresence/Real Time Information
Participants commented that the advantages of relying on real time information are constant
updates of what the enemy is doing so that plans can change accordingly, mission tempo may be
increased, and movement on the objective may be reduced.
Yet participants also reported that the disadvantages of not conducting a physical recce and
relying on real-time information are the concern about technology breakdowns, limited situational
awareness, no direct intimacy with the ground layout, co-ordination might not be as clear, and
the commander relying on patrol recce to make his or her decisions.
Participants explained that, if real time information is available, the additional information that is
required so that a commander does not have to complete a physical recce is the ground layout.
This information allows the platoon commander to plan cut off location, routes, fire base
location, approach areas, and every position view.
Overall, participants thought that a physical recce by the commander is always necessary. They
explained that the commander needs to have high situational awareness about the enemy,
objective, terrain and his own troops. Participants believed that the time spent on a recce is time
well spent.
About half of the participants stated that the optimal method to record text information is with a
digital proforma, to create side view images on the computer, using drawing tools and overlays,
and to capture overhead views with a UAV. All of the participants preferred to capture side view
images is with a digital camera. On the other hand, the preferred method of verbal information
transfer is face to face. However, the participants found the ability to send information
electronically to be an asset.
Humansystems®
Page 34
4
Distributed Orders
providing platoon attack orders in a distributed manner.
4.1
Distributed Orders Background
Traditionally dismounted infantry platoon commanders give their orders for an attack in an ORV
with all sub-unit commanders in attendance – see Figure 21. Because each of the sub-units must
move to the ORV concern has been raised that this approach consumes large amounts of time.
The time required to get all the sub-units into the ORV also raises concerns with premature
detection. As well because all of the commander’s are in very close proximity to each other
there is a high that the unit’s primary leader could be destroyed by one enemy mortar bomb or
similar area weapon. In order to see if technology can improve the speed and efficacy of the
dismounted infantry commander’s orders briefing, distributed orders have been proposed.
Mechanized units typically use distributed orders via radio because of the large distances
involved and the need to maintain operation tempo.
Technology now exists to pass on large amounts of information digitally i.e. utilize remote
sensors (cameras, seismic sensors, etc.) that were emplaced along the perimeter of the objective
by a recce team sent ahead. This technology may permit commanders to conduct orders briefing
in a distributed fashion, i.e. not all sub-unit commanders would have to be co-located see Figure
22. Given unlimited digital bandwidth, commander’s can conduct web-style net meetings where
all the faces of unit leaders are presented to the platoon commander. This approach may allow
the briefer to observe the non-verbal cues of his followers and their understanding of his orders.
Figure 21: Traditional commander’s orders briefing techniques
Humansystems®
Page 35
Figure 22: Remote commander’s briefing techniques
4.2
Aim
•
Determine the communications effectiveness implications of performing orders briefing
in a centralized and de-centralized format.
•
Evaluate the tactical implications of performing orders briefings in a centralized and a decentralized format.
•
Identify the interface design issues associated with the digital briefing option and the
design of the computer interface.
4.3
Method
4.3.1
Overview
19 November 2003.
4.3.2
Materials
Humansystems®
Page 36
Radio, i-Visit, and NetMeeting.3 Each condition required a different combination of these, which
is outlined in section 4.2.4.
4.3.3
Participants
The same fifteen (n = 15) regular force infantry participants that participated in the recce
information capture and transfer study participated in the distributed orders study. The average
age was 32.0 ± 5.6. The ranks of the participants were as follows: three Officers, six Sergeants,
five Master Corporals, and one Corporal. On average, they had 122 ± 77 months of regular
military service. Only three of the participants had not been on a tour.
4.3.4
Experimental Conditions: Face to Face, Radio, and Telepresence
Distributed orders were conducted with three conditions (similar to that in stage 1 Section Recce
Patrol): Face to Face, Radio, and Telepresence. Greater detail of each condition is described
below.
a) Face to Face
The face to face distributed orders were presented to the whole platoon. The Platoon
Commander created a sand model and passed around Polaroid pictures from the appropriate
recce patrol as necessary. The participants also had a 1:25, 000 paper map.
b) Radio
For the distributed orders radio condition, each section leader and the platoon commander were
in separate tents. The platoon commander verbally communicated to his three section leaders
over Kenwood TK-280 radios. The platoon commander was able to share text information,
digital pictures, and digital drawings through a network. The section leaders and the platoon
commander were able to enter and view the digital information on a Xybernaut. Digital sketches
were created on the Xybernauts using the drawing tools and white board function in MSN Net
Meeting. Also, text information was created on the Xybernauts. Internet Explorer, an Internet
browser, was used as the viewer of the digital information.
c) Telepresence
The distributed orders telepresence condition was exactly the same as the radio distributed orders
conditions with the addition of Fire-i web cameras. The web cameras allowed the three section
leaders and the platoon commander to see one another even though they were in different
locations (i.e. tents). i-Visit software was used to display the Fire-i camera images on the
Xybernauts, which made it possible for participants to interact.
3
Humansystems®
Page 37
4.4
Procedure
Following the platoon commander’s recce, he developed his assault plan and distributed orders to
his platoon. Three different methods of transferring this information were evaluated: Face to
Face, Radio (with digital files), and Telepresence (with digital files).
The section leaders and platoon commander were the same for three consecutive days. A total
of three sets of section leaders and platoon commanders participated in this study, evaluating the
three conditions in a counter balanced order.
Prior to the experiment the participants were trained on the tools to manage novel recce
gathering, report preparation, and information transfer. Also, throughout the experiment an
experimenter assisted the participants with any technology difficulties. The UAV footage used
for the Comd’s Recce was previously recorded with the enemy in place on the objective.
Section leaders and the platoon commanders filled out questionnaires evaluating the method of
distributed orders.
4.5
Dependent Variables
After the attack, the platoon commander taking part in the attack filled out an Orders Briefing –
Provider Task Questionnaire (see Annex F) and the section leaders filled out an Order’s Briefing
– Receiver Task Questionnaire (see Annex G). Both the platoon commander and the section
leaders filled out the Teamwork (see Annex I) and NASA TLX Workload (see Annex J)
questionnaires. Also, the section leaders filled out the Order Comprehension Questionnaire (see
Annex H). At the end of the trial the participants completed a Distributed Orders Questionnaire
(see Annex K), and participated in a focus group discussion.
For the Order’s Briefing – Provider Task Questionnaire, the participants assessed the amount and
time to provide the information, confidence in others understanding the information, ease of
providing information, overall ease and utility of orders briefing method, and the general likes
and dislikes of the method. For the Order’s Briefing – Receiver Task Questionnaire, participants
assessed the amount and time to receive the information, comprehension of the information,
effectiveness for situational awareness, overall ease and utility of orders briefing method, and
general likes and dislikes of the method.
For the Teamwork Task Questionnaire, participants evaluated the team during the platoon attack
and perception of the team. The NASA TLX Workload Task Questionnaire assessed mental
demand, physical demand, temporal demand, performance, effort and frustration.
The Orders Comprehension Task Questionnaire contained open ended questions. The
participants answered specific questions and facts about the orders they received. These included
formation, grouping and tasks, H Hour, attack position, order to march to attack position, line of
departure, route, assault position and line, dismount area, consolidation, and fire plan.
For the Distributed Orders Exit Questionnaire, participants assessed the amount and time to
received information, time and effort to understand information, confidence in understanding,
effectiveness for awareness, and overall ease and utility.
Humansystems®
Page 38
4.5.1
Rating Scales
Rating scales used in the Distributed Orders study were the same as those used in the Section
Recce Patrol. For a review, please see Figure 7, 8, and 9.
4.6
Results
The following results include first the quantitative measures followed by the qualitative measures
and then the responses from the guided focus group. Results also include a comparison between
the responses of the provider and receivers.
4.6.1
Distributed Orders: Objective Results
4.6.1.1 Time to Present Distributed Orders
The time to present distributed orders was recorded (see Table 7). These timings do not include
the time to prepare the orders or travelling time that would be required for the platoon to be
centralized for the Face to Face condition.
Table 7: Time required to present orders briefing
Platoon
Face to Face
Radio
Telepresence
9
15 min 38 sec
10 min 10 sec
13 min 6 sec
8
17 min 20 sec
8 min 36 sec
13 min 55 sec
7
Orders were given over two
days, and thus were not timed.
11 min 30 sec
17 min 30 sec
Average
16 min 22 sec
10 min 5 sec
14 min and 60 sec
Averages show that it took less time to distribute orders in the Radio condition compared to the
Telepresence and the Face to Face conditions. It should be noted that no statistical analysis was
conducted because of the small N=3.
4.6.2
Distributed Orders: Task Questionnaire
Various task questionnaires were conducted for this stage of the experiment. These include
orders briefing – provider, orders briefing – receiver, comparison of the providers and receivers,
team work, NASA TLX workload, and orders comprehension.
4.6.2.1 Acceptability of Orders Briefing - Provider
Three Platoon commanders evaluated the method of providing distributed orders each day after
the mission. For this questionnaire, no statistical analysis was conducted because of the small
N=3.
As shown in Figure 23, participants rated the Face to Face condition between ‘Borderline’ and
‘Reasonably Acceptable’, the Radio condition between ‘Barely Unacceptable’ and ‘Barely
Humansystems®
Page 39
Acceptable’, and the Telepresence condition between ‘Barely Unacceptable’ and ‘Reasonably
Acceptable’.
Distributed Orders Task Questionnaire
Orders Brieifing - Providers (N=3)
Overall utility of briefing method
Overall ease of providing orders briefing
1Sutiability for reducing memory demands
Suitability for reducing mental effort
Ease of providing platoon level sit info
Ease of providing terrain/nav info
Ease of providing section level sit info
Others understanding mission execution
Others understanding mission intent
Opportunity to back brief
Time required to give orders
Face to Face (F)
Radio (R)
Telepresence (T)
Amount of info provided
Barely Acceptable
Borderline
Barely Unacceptable
Figure 23: Degree of participant acceptability rating of orders briefing - provider
Considering distributed orders in the Face to Face condition, platoon commanders said that they
liked the ability to brief the entire platoon together while using a sand model. However, they
disliked the amount of time required to prepare and give the orders. To improve this briefing
method, the platoon commanders desired more photos, satellite maps, and aerial pictures.
For the Radio condition, the platoon commanders liked the ability of troops staying dispersed.
They thought this was a quick method for distributing information. The platoon commanders,
however, found it difficult to give details over the radio and difficult to receive feedback.
The platoon commanders liked the Telepresence condition because of the use of digital diagrams,
maps, and text to detail the plan. They found it slow, preparation time consuming, and difficult
to change the plan. The platoon commanders were also unsure if the plan was understood. To
improve this method, they suggested faster computers and more time to prepare.
4.6.2.2 Acceptability of Orders Briefing - Receiver
A total of 12 participants (Section Leaders and Weapons Det) filled out the Orders Briefing –
Receiver questionnaire. Repeated-measures ANOVAs were conducted.
Humansystems®
Page 40
The first nine criteria of the orders briefing – receiver questionnaire are presented in Figure 24.
Participants rated the Face to Face condition between ‘Barely Acceptable’ and ‘Completely
Acceptable’, and the Radio and Telepresence conditions between ‘Borderline’ and ‘Reasonably
Acceptable’.
The last eight criteria of the orders briefing – receiver questionnaire are presented in Figure 25.
For these eight criteria, participants rated the Face to Face and Telepresence conditions between
‘Barely Acceptable’ and ‘Reasonably Acceptable’, and the Radio condition between ‘Borderline’
and ‘Barely Acceptable’.
F>T,R
F>T,R
Confidence in comprehending mission execution
Effectiveness for section level SA
F>T,R
Confidence in comprehending mission intent
F>R
F,T>R
Effort required to comprehend info
Ease of recording info
F>R
Time required to comprehend info
Opportu nity for back brief
Face-to-Face (F)
Radio (R)
Telepres ence (T)
Time required to receive orders
Com pletely Acceptable
Reas onably Acceptable
Barely Acceptable
Borderline
Barely Unacceptable
Reas onably Unacceptable
Com pletely Unacceptable
Dis tributed Orders - Tas k Ques tionnaire
Orde rs B riefi ng - Rec eivers (N =12 ) - Qu estions 1-9
Figure 24: Degree of participant acceptability of orders briefing – receivers
(Questions 1-9)
Humansystems®
Page 41
F>R
F>R
Effectiveness for platoon level SA
Suitabilty for reducing mental e ffort
F,T>R
Dis tributed Orders Tas k Ques tionnaire
Orders Briefings - Receivers (N=12) - Ques tions 10-17
Vertic al b ar de note 0.9 5 co nfide nce inte rvals
Com pletel y Acceptable
Reasonabl y Acceptable
Barel y Acceptable
Borderline
Barely Unacceptable
O verall utility of briefing method
Overall ease of receiving orders briefing
Suitability for reducing memory demands
Effectiveness for status of en forces
Face-to-Face (F)
Radi o (R)
T elepresence (T )
Effectiveness for status of fr forces
Com pl etely Unacceptable
Effectiveness for terrain/nav awareness
Figure 25: Degree of participant acceptability of orders briefings - receivers
(Questions 10-17)
Overall a significant difference was found across the three conditions (F (2,22) = 4.1, p<0.03,
MS = 36.39). A post hoc Duncan’s test revealed that the Face to Face condition was
significantly more acceptable than the Radio condition.
A repeated-measures ANOVA was conducted for each criteria and the following significant
differences were found. The Face to Face condition was significantly more acceptable than the
Radio and Telepresence conditions for confidence in comprehending mission intent, confidence
in comprehending mission execution, and effectiveness for section level situational awareness.
Further, the Face to Face condition was significantly more acceptable than the Radio condition
for time required to comprehend information, ease of recording information, effectiveness for
platoon level situational awareness and suitability for reducing mental effort. The Face to Face
and Telepresence conditions were significantly more acceptable than the radio condition for effort
required to comprehend information and effectiveness for terrain / navigational awareness.
There were no significant differences with respect to the amount of information received, time
required to receive orders, opportunity for back brief, effectiveness for status of friendly forces,
Humansystems®
Page 42
effectiveness for status of enemy forces, suitability for reducing memory demands, overall ease
of receiving orders briefing, and overall utility of briefing method across the three conditions.
For the Face to Face condition, section leaders found getting clarification easy. They liked the
sand model and the ability of distributed orders being conducted with no equipment. The
participants found, however, the Face to Face condition to be time consuming, and did not like
the fact that everyone had to be at a central location. In order to improve this method, the
section leaders desired more time for the orders.
For the Radio condition, section leaders said it was a quick method for distributing orders, and
advantageous to receive orders from different locations. The participants disliked the lack of
visual reference, broken radio transmissions, and accuracy of maps. Further, they were also
concerned about the amount of radio time required and the difficulty for feedback. Section
leaders suggested improved radios, and more detailed map and drawings of the plan.
Section leaders also thought that Telepresence was a quick method for distributing orders, and it
reduced the amount of movement required. Participants liked having the information stored on
their Xybernauts and being able to pass this information onto the troops. They also liked the
ability to read the orders on the computer and ask for confirmation later. However, section
leaders thought that too much time was required for verbal confirmation of orders
comprehension, and found the Xybernaut operating system too slow. Participants believed that
Telepresence could improve with more powerful and faster computers.
4.6.2.3 Comparison of Provider And Receivers – Orders Briefing
Figure 26 compares the acceptability ratings of the providers and the receivers for the orders
briefing.
Humansystems®
Page 43
Dis tr ibuted Orders - Task Questionnaire
Comparison of Provider and Receiver for Orders Briefing
Barely Acceptable
Borderline
Barely Unacceptable
Overall utility of brie fing method
Overall ease of orders briefing
Reducing memory demands
Reducing mental effort
Platoon level SA
Terrain / nav info
Section level SA
Und ers tanding mission execution
Understanding mission intent
Opportunity for back brief
Prov ider - Face-to-Face
Prov ider - Radio
Prov ider - Telepresence
Receiv er - Face-to-Face
Receiv er - Radio
Receiv er - Telepresence
Amount of info
Time require d fo r orders
Figure 26: Comparison of Provider and Receiver for Orders Briefing
A statistical analysis was not performed comparing this data because of the low N=3 for the
providers. However, the following trends were noticed. Both the providers (platoon
commanders) and receivers (section leaders) rated the Face-to-Face condition more acceptable
than the Radio and Telepresence conditions. The receivers (section leaders) rated the Radio and
Telepresence conditions more acceptable than the providers (platoon commanders) did.
4.6.2.4 Team Work
The teamwork questionnaire was split into two sections: Section A and Section B. The sevenpoint agreement/disagreement scale was used for all criteria on this questionnaire (see Figure 9).
Missing data points were replaced with means.
Section A
The results of Section A are presented in Figure 27.
For all three conditions, the participants rated their agreement with the following statements
between ‘Slightly Agree’ and ‘Strongly Agree’: the platoon coordinates well in completing this
mission; the platoon leader provides good direction in helping our section meet this mission’s
goal’s; during this mission, other sections are able to anticipate my actions and I am able to
anticipate theirs; teamwork increases to our platoon’s ability to complete this mission, during this
mission; and, in this mission, the other leaders and I work well as a team.
Humansystems®
Page 44
The participants rated their agreement with the following statements between ‘Strongly Disagree’
and ‘Slightly Disagree’: the other leaders have failed to give me the information that I need to
make decisions; and, our platoon shows a poor level of cooperation during this mission.
Dis tributed Orders
Tea m work Q ues tion naire - S ectio n A (N= 15)
Com pletely Agree
Strongly Agree
Sl ightly Agree
Neutral
Sl ightly Di sagree
Other leaders and I work well as a team
Platoon shows poor level of cooperation
Other leaders failed t o give info needed
Teamwork increases to ability
Face-to-Face (F)
Radio (R)
T elepresence (T )
Able to anticipate other sections actions
Platoon coord well
Com pletely Di sagree
Platoon leader provides good direction
Strongly Di sagree
Figure 27: Teamwork Questionnaire - Section A
Overall, no significant difference was found between the three conditions for Section A of the
Teamwork Questionnaire. Further, a repeated-measures ANOVA was conducted for each
criterion in Section A of the questionnaire and no significant differences were found across
conditions.
Section B
The results of section B are presented in Figure 28.
For all three conditions the participants rated their agreement with the statements between
‘Slightly Agree’ and ‘Completely Agree’.
Humansystems®
Page 45
Dis tributed Orders
Team work Ques tionnaire - Section B (N=15)
Com pletely Agree
Strongly Agree
Sl ightly Agree
Neutral
Sl ightly Di sagree
Platoon leaders & I form a cohesive unit
Platoon performs well as a team
Members have a common view of mission
Team member first
Face-to-Face (F)
Radio (R)
T el epresence (T )
Platoon accomplished more as a team
Com pletely Di sagree
Confident in the abilities of my teammates
Strongly Di sagree
Figure 28: Teamwork Questionnaire - Section B
Overall no significant differences were found between the three conditions for Section B of the
teamwork questionnaire.
A repeated measures ANOVA was conducted for each criterion. The participants agreed with
the statement ‘our platoon is able to accomplish more as a team than as individuals sections’
significantly more in the Face to Face condition than the Telepresence condition.
No significant differences were found between the three conditions for the following statements
in Section B of the questionnaire: I see myself as a team member first and as a individual second;
I am confident in the abilities of my team mates during this mission; the members of the platoon
have a common view of how to complete this mission; in general, the platoon performs well as a
team; and, the platoon leaders and I form a cohesive unit.
Overall, the section leaders and platoon commanders thought the platoon worked well together
considering many participants within the platoon are new to the unit. The participants did not
comment on any differences in teamwork between the three distributed orders conditions.
Humansystems®
Page 46
4.6.2.5 Workload - NASA TLX
The NASA TLX is a standardized way to measure workload on six dimensions, which include
mental demand, physical demand, temporal demand, performance, effort, and frustration. The
NASA TLX ratings for the three conditions were between 3 and 6 (see Figure 29).
Dis tributed Orders
NASA TLX Ques tionnaire
Vertical bars dentoe 0.95 confidence intervals
10
9
Workload Rating
8
7
6
5
4
3
Frustration
Performance
Temporal Demand
Physical Demand
Mental Demand
1
Effort
2
Face-to-Face (F)
Radio (R)
Telepres ence (T)
Figure 29: Workload - NASA TLX
A repeated measures ANOVA was conducted on all of the NASA TLX ratings for the three
conditions. Overall, no significant differences were found across the three conditions.
Significant differences were found, however, between the workload dimensions (F (5,70) = 3.69,
p<0.01), MS = 7.267). A post hoc Duncan’s test revealed that the physical demand dimension
had a lower workload rating than the temporal demand, effort, and frustration dimensions. The
performance dimension had a lower workload rating than the temporal demand and the effort
dimensions.
4.6.2.6 Orders Comprehension
The Section leaders and Weapons Det filled out the orders comprehension questionnaire after the
attack each day. In total, 12 participants completed the questionnaire.
Humansystems®
Page 47
The orders comprehension questionnaires were scored by the method presented in Table 8.
Participants could receive a maximum total score of 19 points.
Table 8: Scoring method of the Orders Comprehension Questionnaire
•
Formation (1 point)
•
Order to March (1 point)
•
Groups and Tasks (1 point for each)
•
Assault left
•
Assault right
•
Assault depth
•
Assault depth
•
Firebase
•
Cut Off
•
Deception
•
Security
•
Fire Plan (1 point)
•
Map Information Elements (1 point for each)
•
Objective location (EN location)
•
Attack position on map (location)
•
Route to attack position
•
Assault position (location)
•
Assault line (orientation)
•
Dismount area (location)
•
Consolidation (location)
•
H Hr (time or code word, etc.) (1 point)
The average orders comprehension scores for each condition are presented in Figure 30.
Distributed Orders
Orders Comprehension Scores
11
10
9
Comprehension Score
8
7
6
5
4
3
2
1
0
Face-to-Face
Radio
Telepresence
Figure 30: Orders Comprehension Scores
No significant difference was found across the three conditions for the orders comprehension
scores.
4.6.3
Distributed Orders: Exit Questionnaire
The first nine criteria on the exit questionnaire are presented in Figure 31. The Face to Face
condition was rated between ‘Reasonably Acceptable’ and ‘Completely Acceptable’. The Radio
Humansystems®
Page 48
condition was rated between ‘Borderline’ and ‘Reasonably Acceptable’. The Telepresence
condition was rated between ‘Barley Acceptable’ and ‘Reasonably Acceptable’.
The other eight criteria on the exit questionnaire are presented in Figure 32. The Face to Face
condition was rated between ‘Barely Acceptable’ and ‘Completely Acceptable’. The Radio
condition was rated between ‘Borderline’ and ‘Reasonably Acceptable’. The Telepresence
condition was rated between ‘Barely Acceptable’ and ‘Reasonably Acceptable’.
F>T,R
F>T,R
F>,T,R
Effort required to understand info
Understanding mission inte nt
Understanding mission execution
F>T,R
F>T,R
Time required to understand info
F>R
F>T,R
Opportunity for back brief
F>T,R
Dis tributed Orders Exit Ques tionnaire(N=15)
Ques tions 1-9
Reasonably Acceptabl e
Barely Acceptabl e
Borderl ine
Barel y Unacceptabl e
E ffectiveness for Section Level SA
Ease of Re cording Info
Face-to-Face (F)
Radi o (R)
T elepresence (T )
Com pl etel y Unacceptable
Time required to receive orders
Reasonabl y Unacceptabl e
Figure 31: Distributed Orders Exit Questionnaire (Questions 1-9)
Humansystems®
Page 49
Dis tribu ted O rde rs E xit Ques tionn aire (N= 15)
Ques tions 10-17
Reasonably Acceptabl e
Barely Acceptabl e
Borderl ine
Barel y Unacceptabl e
O verall utility of briefing method
Overall ease of receiving orders briefing
Suitability for reducin g memory demands
Suitability for reducing mental e ffort
Effectiveness for platoon level SA
Effectiveness for status of en forces
Face-to-Face (F)
Radio (R)
T elepresence (T )
Effectiveness for status of fr forces
Com pl etel y Unacceptable
Effectiveness for terrain/nav awareness
Reasonabl y Unacceptabl e
Figure 32: Distributed Orders Exit Questionnaire (Questions 10-17)
Overall, a significant difference was found across the three conditions (F (2,28) = 8.16, p<0.00,
MS = 67.92). A post hoc Duncan’s test showed that the Face to Face condition was more
acceptable than the Radio and Telepresence condition. A repeated measures ANOVA conducted
for each criterion revealed the following significant differences.
The Face to Face condition was significantly more acceptable than the Radio and Telepresence
conditions for the following criteria: amount of information received, opportunity for back brief,
time required to understand information, effort required to understand information, confidence in
my understanding the mission intent, confidence in my understanding the mission execution,
effectiveness for section level situational awareness, and effectiveness for platoon level situational
awareness. Moreover, the Face to Face condition was significantly more acceptable than the
Radio condition for ease of recording information and effectiveness for terrain/navigational
awareness.
No significant differences were discovered across the three conditions for the following criteria:
the time required to receive orders, effectiveness for status of friendly forces, effectiveness for
status of enemy forces, suitability for reducing mental effort, suitability for reducing memory
demands, overall ease of receiving orders briefing, and overall utility of briefing method.
Humansystems®
Page 50
Participants found the Face to Face method was the best method to convey understanding, elicit
feedback, and determine comprehension. They also felt the map model used during the Face to
Face distributed orders gave the troops the best overview of the plan and helped to increase their
situational awareness.
Participants also liked the following digital features: white board function, digital pictures, digital
drawings/sketches, overlays, information stored for future reference on their computer,
telepresence, being separated to receive orders, and UAV footage.
Participants thought that the Xybernauts screens had too much information on them during the
digital meetings. They also thought that the Xybernaut was complicated to use. Participants
stated that using the radio required too much time to receive feedback and determine orders
comprehension of the troops.
To improve the briefing methods, participants desired faster, smaller and more user friendly
computers and software.
4.6.4
Distributed Orders: Focus Group Discussion
A focus group discussion took place at the end of the Distributed Orders component of the
experiment and generated the following thoughts.
Participants stated that the advantages of bringing everyone together for distributed orders are the
ability to see everyone’s body language and the ease of ensuring comprehension of the orders.
Of course, a disadvantage of this method is the increased time to assemble everyone together, if
this is even possible, given that some situations may prevent this.
Participants commented that an advantage of distributed orders over the radio is that there is less
time required for movement. On the other hand, there were concerns among participants that
there will be less communication between sections, thereby reducing efficiency. As well, they
were concerned that distributed orders over the radio may result in less comprehension.
Participants also stated that the digital system must be compatible with other countries’ systems,
and there must be a way to upgrade the system.
Participants found themselves to busy looking at the information sent to them during the
Telepresence condition that they did not look at the person on the webcam. However, they
thought the webcam might be useful to use as a live feed during recces.
Humansystems®
Page 51
5
Discussion
Recce Information Transfer
Overall, the participants found the three conditions to be acceptable. There were few significant
differences between the three conditions. Participants found the digital information that could be
sent electronically to be useful, but preferred to conduct patrol reports face to face instead of
over radios or by telepresence.
Information Capture
Digital cameras, for taking stills and video, were considered an asset for reconnaissance.
However, participants desired increased zoom capability (i.e. x10). When taking pictures,
participants wanted the camera to record the grid location, bearing, and scale of the picture.
Participants also wanted the ability to annotate the pictures. Participants also suggested an
increased panoramic capability in order to help situate others to the ground better. The
participants wanted the ability to take pictures at night with thermal imaging and/or image
intensification. They felt that it would be acceptable if they had to use their night vision device
and attach it to a camera when required.
The participants liked the concept of a digital patrol report form. It would ensure that a standard
format was followed and that information was not forgotten to be included. Collation of
numerous patrol reports would become easier. The patrol reports could easily be sent
electronically to higher echelons. However, some design issues of the prototype digital patrol
report were identified, such as there should be more room to write in the text boxes, the ability to
annotate patrol reports, a simplified standard format, and the output of the patrol report proforma
needs to be redesigned to be easier to read.
Participants thought that it was helpful to be able to draw side views and overhead views
digitally. They liked the ability to make overlay drawings over maps and pictures. However,
there is a need for more advanced drawing tools that include military symbol icons that can be
dropped in place on a picture.
The ability to send digital patrol reports, pictures, and sketches electronically to higher echelons
is good because it does not require a soldier to hand deliver them. When receiving electronic
files, however, participants mentioned they would like notification that a file arrived. This could
be achieved with an audio or visual alarm.
Participants’ preferred face to face communication compared to radio and telepresence. They
believed that face to face communication increases comprehension of the information transferred.
However, face to face briefing is tactically dangerous and it requires time to manoeuvre everyone
out and into position for an attack.
If face to face communication is deemed too dangerous, participants found telepresence
communication to be acceptable, given the ability to send files electronically. Similar to face to
face communication, when speaking to someone, by viewing the person’s face through a video
conference allows you to watch facial expressions and gauge their level of understanding.
Humansystems®
Page 52
Participants stated that, if required, they could conduct a patrol briefing remotely by radio, but
preferred to conduct briefings face to face or by telepresence.
The ease of use of the Xybernaut system and telepresence systems was less than ideal and the
systems till needed refinement. Remote recce information transfer involving large data sets took
significantly longer than face to face or radio-mediated recce reporting. The extra time required
may have been partially attributed to ease of use and software stability problems.
Participants realized that there are numerous advantages of being able to have ‘eyes on’ a target
the whole time leading up to an attack. For example, the information about the enemy is up to
date, there is less soldier movement and there is less time used to manoeuvre. In general,
participants believed that digital communication was less risky because the platoon leadership is
not located in one location during the briefing.
Commander’s Recce
No significant advantage was demonstrated by providing commanders with remote recce
information. Participants’ preference is to always perform a physical commander’s recce
because it increases the commander’s situational awareness of the enemy, objective, and terrain.
This information allows the commander to change his plan as appropriate and determine assault
positions, withdraw routes, fire base location, etc.
By conducting a recce remotely by radio, participants believed that the commander had to place
too much trust on the recce patrol to help the commander adjust the plan as appropriate.
Participants did find the ability to send digital information (text, pictures, drawings)
electronically to be an asset. They did acknowledge that conducting a commander’s recce
increased the chance of the mission being compromised, it is more time consuming, and it
required more manpower. However, participants felt strongly that time spent on a commander
recce is time well spent.
Participants found the UAV images useful. However, they do not want it to be their main source
of information. The platoon commanders still found it necessary to conduct physical recce.
Also, participants would like additional information added, to UAV images (such as orientation,
gridlines, and scale of the images) to make them more useful.
Distributed Orders
Overall, participants’ preferred to have distributed orders conducted face to face because this
allows individuals to view each other’s body language as well as easily determine each others
comprehension of the plan. Further, gathering at one location is believed to increase the
communication among sections, and thus increase efficiency.
By conducting distributed orders remotely by radio, the participants believed that time would be
saved. The presentation of the orders took significantly less time over the radio. However, it
was more difficult to receive feedback over the radios and to ensure comprehension of the
orders, despite the fact that no significant difference was found between the methods of
information transfer and the level of comprehension. Participants were also concerned about the
amount of radio traffic required.
Participants found the telepresence to be a quick method of distributing orders, and it reduced the
amount of movement required. Participants liked having the information stored on their
Humansystems®
Page 53
Xybernauts, and being able to pass this information onto the troops. Participants found that not a
lot of time was spent viewing the images of the other participants because of the amount of other
information on their computer screens. In order to improve telepresence distributed orders, they
would like faster computers.
Humansystems®
Page 54
6
References
A.
Bos, J.C. & Tack. D.W. (2004). Input Device Investigation for Future Dismounted
Soldier Computer Systems. (DRDC T Report CR 2005-052). Toronto, ON: Defence
Research and Development Canada – Toronto
B.
Tack, D.W. (2000). SIREQ TD Experimentation Programme Plan. (DRDC T Report CR
2005- XX). Toronto, ON: Defence Research and Development Canada – Toronto.
Humansystems®
Page 55
Annex A: Trial Materials
A1.1
Polaroid Camera
A Polaroid Spectra 1200si Instant Camera was used by the section commander to record side
view pictures on the patrol recce in the face to face condition (see Figure A-33).This camera had
an optical viewfinder that provides distance and light information, audio-visual signals that cue
the right photographic conditions, and a control panel that allowed control of exposure, focus,
flash, and self-timer settings.
Figure A-33: Polaroid Spectra 1200si instant camera
The features of this camera include:
•
•
•
•
•
•
•
•
•
•
•
•
A1.2
Automatic 10-zone focus
Automatic flash
Uses large-format Polaroid Spectra and 990 film
Self-time lets you get into the picture
Audible indicators for self timer and film empty
Lighten/darken, flash on/off, and self-timer controls
Sonar range-finder automatically focuses the camera
Automatic rapid flash recharge
Flash ready light indicator
Frame counter shows frames remaining
Tripod socket
Adjustable hand strap for easy and comfortable handling
Cyber-shot 5.0 Megapixel Digital Still Camera
The Cyber-shot 5.0 Megapixal Digital Still camera combines a 5.0 mega pixel CCD, Carl Zeiss
Vario Sonnar lens, Hologram AF laser focus assist and TTL preflash exposure control for superb
functionality. A dual function ring combines both zoom and manual focus (Figure A-34).
Humansystems®
Page A-1
Figure A-34: Cyber-shot 5.0 megapixel digital still camera
The features of this camera include:
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Effective 5.0 Mega Pixels(2/3" Gross 5.2 Mega Super HADsup>TM CCD)
5x Optical Zoom (10x Precision Digital Zoom)
Carl Zeiss™ “Vario Sonnar” Rotating Lens
F2.0-2.4, 38mm-190mm(35mm conversion)
USB 2.0 Hi-Speed
MPEG Movie HQX
NightFraming/NightShotTM
Hologram AF
ISO 800, 1/2000 shutter speed
14-bit DXP
Colour Viewfinder (180 K dots)
Burst 3 shots/AE Bracketing
ACC Terminal
Accessory Shoe (hot shoe)
Clear Colour NR / Clear Luminance NR
Multi Pattern/Spot / Centre Weighted Metering Multi point AF (Auto/Manual)
NR Slow Shutter
Quick Start Up Time
Shutter/Aperture/Manual Mode
AE Lock, Jog Dial
Manual Focus/Zoom Ring
Auto Pop-up Flash/Pre-Flash
ISO sensitivity setting
Clip Motion
Voice Memo/E-mail/Text/TIFF
Playback Zoom,Trimming,Resize, Sharpness
1.8" LCD Monitor (123 K dots)
AV Out (PAL/NTSC)
USB Terminal
InfoLITHIUMTM M-Series Battery System
Humansystems®
Page A-2
A1.3
Sony Micro MV Video Camera
Sony’s compact Micro MV video camera has a 1/4.7" Mega Pixel CCD, that produces an image
with 690,000 effective colour pixels and 520 lines of Horizontal resolution (Figure A-35). It has
an auto focus and auto iris control/gain control that lets more or less light through depending on
the brightness at the center of the area of focus. The video sight is also equipped with an image
stabilizing device (Super SteadyShot™), and adjustable zoom that can magnify in this experiment
up to twenty times (ten power optical zoom + ten power digital zoom).
Figure A-35: Sony Micro MV video camera
A1.4
Fire-i™ Color Digital Camera
Fire-i™ Color Digital Camera is a web camera. The camera allows you to display, control &
record full-size VGA still images and live video streams (Figure A-36). Video conference was
conducted over wired LAN using i-Visit video conference software. The Fire-i camera has the
following features:
•
•
•
•
•
•
•
•
•
Home/Office Monitoring
BTV™ Carbon software (evaluation version)
Capture still images (or video stream) while monitoring
Low power consumption (ideal for portable use)
Built-in f 4,65 mm lens with anti-reflective coating
Two 400Mbps FireWire ports
640x480 video resolution
30 frames per second
Spring clip for portable or Desktop flat displays attachment
Humansystems®
Page A-3
Figure A-36: Fire-i camera
A1.5
Hand Written Report – Field Message Pad
In this base line condition the section leaders used their Field Message Pad to hand write their
patrol report and to make any drawings.
A1.6
Xybernaut MA V Wearable Computer
A Xybernaut MA V wearable computer (Figure A-37) was attached to the CF tactical vest issued
to each soldier. Each Section Commander and the Platoon Commander participating in the day’s
attack wore one. The computer system features a 500Mhz Celeron processor with 256MB RAM.
The participants could interact with the system using a touch screen and stylus, miniature
trackball, soft keyboard, hard keyboard, and voice input devices. These input devices are
described in more detail in the FBES VI report (Input Device Investigation for Future
Dismounted Soldier Computer Systems (2004). A Global Positioning System was connected to
the USB port on the Xybernaut using a Keyspan USB to serial adapter. An optional Smartdisk
Firewire CD/RW drive could be connected to the IEEE1394 port on the Xybernaut.
GPS
Xybernaut PC
Serial to USB
Adapter
Miniature Trackball
CD/RW Drive
Tablet Display
Figure A-37: Xybernaut MA V wearable computer
Humansystems®
Page A-4
Software applications were displayed on a Xybernaut flat panel 640x480 resolution daylight
readable display (Figure A-38), with a screen measuring 6.4 inches.
Figure A-38: Tablet display
A1.7
Microsoft Net Meeting
In the Digital One condition Microsoft’s net meeting drawing tool and white board was used for
side and overhead view sketches. The whiteboard allowed the participants basic drawing tools to
draw sketches and to make overlays on maps and pictures. Also, during the briefing either the
Section Leader or the Platoon Commander could use the drawing board to present a point in real
time that both of them could view as well as the jury.
A1.8
Digital Patrol Report
Digital patrol report or proforma was developed in visual basic with input fields of the categories
of the information required for a patrol report (Figure A-39). After filling out the digital patrol
report a text file was created and could be opened from Internet Explorer for the participants to
view when required.
Humansystems®
Page A-5
Figure A-39: Digital patrol report interface
A1.9
Kenwood TK-280 Handheld Radio
The Kenwood radios were used for verbal communication between the Section Leader and the
Platoon Commander (Figure A-40). The radios have the following specifications:
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Watt VHF / 4 Watt UHF
Trunked or Conventional
250 Channel Conventional
32 Systems Trunked
Mil Spec for Driven Rain
12 Character Display
Multiple Scan Functions
Two Year Warranty
Wide Band Coverage
Programmable Function keys
High Quality Audio Output
Compounded Audio
Extra Long Life Battery Available
Die Cast Chassis
Humansystems®
Page A-6
•
•
•
•
•
Weather Sealed Universal Connector
Light Control
Key Lock Feature
Mil Spec Speaker Mic With Programmable Keys
Encryption Control
Figure A-40: Kenwood TK-280 handheld radio
A1.10 i-Visit
iVisit software integrates audio, video, chat and messaging into a usable package to enable real
time video conferencing. iVisit allows connections to multiple people.
iVisit enables you to:
•
•
•
•
•
Combine video conferencing, voice calls, instant messaging, file sharing and web cobrowsing for richer online meetings with friends, family, colleagues or customers.
Share pictures, videos, music, Powerpoint® presentations or any file format during voice
calls or video conferences.
Video conference, audio call and collaborate across Windows® or Macintosh® Operating
Systems and hardware.
Interact with users in 8 way video conference rooms, 100 party chat channels, or
privately one-to-one.
Offer scalable and affordable video conferencing.
A1.11 NetMeeting®
NetMeeting® is a Microsoft® product that allows face to face conversations using a PC and the
Internet. It has the following features:
Humansystems®
Page A-7
•
•
•
•
•
•
•
•
•
Video and Audio Conferencing: allows you to communicate with anyone on the Internet.
Chat: lets you conduct real-time conversations via text, with as many people as you like.
Internet Directory: in a Web site provided and maintained by Microsoft to locate people
to call on the Internet.
File Transfer: let you send one or more files in the background during a NetMeeting®
conference.
Program Sharing: lets you flexibly share multiple programs during a conference and
retain greater control over the way they are used.
Remote Desktop Sharing: lets you operate a computer from a remote location.
Security: uses three types of security measures to protect your privacy.
Advance Calling: allows you to send a mail message to a NetMeeting user or initiate a
Netmeeting call directly from you mail address book.
Whiteboard: lets you collaborate in real time with others via graphic information.
Humansystems®
Page A-8
Annex B: Jury Information Task
Questionnaire
Humansystems®
Page B-1
DATE: __________TIME: _____________
NAME/SUBJ #______________________
MISSION NUMBER: _________________
SECTION NUMBER:
_______________
ROLE:
Platoon Commander
Section
Commander
Other__________
Sideview Picture
Overhead Picture
FMP Sketch
Polaroid
Digital sketch
Digital picture
FMP Sketch
Digital sketch
Overlay on topo map
NA
UAV with Overlay
AURAL INFO
TEXT INFO
Face to face
Radio
Net Meeting (on-line)
UAV
NA
FMP Hard copy
NA
SECTION A: Rate the degree to which you agree
with the following statements using the scale
provided. Please consider your responses to these
scales carefully:
Amount of recce information received
Soft copy
NA
Completely
Unacceptable
1
2
Borderline
3
4
Completely
Acceptable
5
6
Level of detail of the recce information received
Time required to receive the recce information
Opportunity to gain clarification
Time required to comprehend information
Effort required to comprehend information
Effort/Ease of using and or manipulating recce
information for planning
Ease of disseminating recce information
Suitability for supporting terrain awareness
Suitability for supporting enemy situational
awareness
Suitability for supporting global situational awareness
Suitability for supporting general mission planning
Humansystems®
Page B-2
7
Completely
Unacceptable
1
2
Borderline
3
4
Completely
Acceptable
5
6
Suitability for supporting detailed raid execution
planning
Suitability of modalities for reducing cognitive
workload
Level of trust in digital information transfer
N/A
Please assess the recce package for utility in planning a Platoon Raid using the assessment criteria attached.
Please note the Platoon Raid must be executed by 1630hrs.
Humansystems®
Page B-3
7
1. Importance
Without this
information I can
complete this task:
2. Complexity
How complex is the
information?
N/A
1
2
3
4
5
N/A
1
2
3
4
5
Not at all
Can complete with difficulty
Can complete easily
Low - Simple signal word or
sign
Medium - May need to
make an ID or write down
or do simple integration
with other information
6. Update
Frequency
How frequently
would you wish to
update this
information?
7. Frequency of
Use
How often do you
use this information?
High - Requires integration
with other information or
calculations, interpretation
8. Accuracy
3. Timeliness
How acceptable is
the timeliness of this
information for the
task?
4. Difficulty
How difficult is it to
use the information
to complete the
task?
NA
1
2
3
4
5
Unacceptable
Borderline
Acceptable
NA
1
2
3
4
5
Very Difficult
Somewhat Difficult
Borderline
Somewhat Easy
Very Easy
How acceptable is
the accuracy of this
information for the
task?
9. Time Pressure
What time pressure
do you feel when
acquiring, sending or
receiving this
information?
NA
1
2
3
4
5
NA
1
2
3
4
5
NA
1
2
3
4
5
NA
1
2
3
4
5. Retention
For how long is this
information useful?
Humansystems®
NA
1
2
3
4
5
A
A
A
A
A
few seconds
few minutes
few hours
few days
few weeks or more
5
Often
Sometimes
Rarely
No.___ Units___
(Never or now only)
Often
Sometimes
Rarely
No.___ Units___
Unacceptable
Borderline
Acceptable
No.___ Units___
Extremely busy, very
difficult
Very busy, barely enough
time
Busy, challenging but
manageable
Moderate activity, spare
time
Light activity, minimum
demands
Page B-4
Please complete sections B-E for each category of information used
SECTION B: Rate the degree to which you agree with the
following statements using the scale provided. If no written
text was provided please check the “Not Applicable” circle.
Please consider your responses to these scales carefully:
TEXT DATA
(Written Patrol Reports)
Completely
Unacceptable
1
2
Borderline
3
4
5
Completely
Acceptable
6
7
Not Applicable
Suitability of modality/format (i.e. paper or
electronically) for getting the information
Reliability of the modality for information transfer
Time required to use the information (for plans)
Effort/Ease of using and or manipulating
Acceptability of information detail/complexity
Utility of information-Timeliness
Utility of information-relevance at Platoon/Section
level
Utility of information-Perceived Accuracy
Utility of information-Importance to mission
success
Ease of distributing information
Comments:
Humansystems®
Page B-5
SECTION C: Rate the degree to which you agree with the
following statements using the scale provided. If no side
view drawings, photos etc. were provided please check the
“Not Applicable” circle. Please consider your responses to
these scales carefully:
SIDE-VIEW DRAWINGS/PHOTOS
Completely
Unacceptable
1
2
Borderline
3
4
Completely
Acceptable
5
6
Not Applicable
Suitability of modality/format (i.e. paper or
electronically) for getting the information
level
success
Comments:
Humansystems®
Page B-6
7
SECTION D: Rate the degree to which you agree with the
following statements using the scale provided. If no
overhead view drawings, photos etc. were provided please
check the “Not Applicable” circle. Please consider your
responses to these scales carefully:
OVERHEAD DRAWINGS/PHOTOS
Completely
Unacceptable
1
2
Borderline
3
4
Completely
Acceptable
5
6
Not Applicable
Suitability of modality (i.e. paper or electronically)
for getting the information
level
success
Comments:
Humansystems®
Page B-7
7
SECTION E Rate the degree to which you agree with the
following statements using the scale provided. If no verbal
info was provided please check the “Not Applicable” circle.
Please consider your responses to these scales carefully::
AURAL DATA (Face to Face Briefings, Radio
Orders)
Completely
Unacceptable
1
2
Borderline
3
4
Completely
Acceptable
5
6
Not Applicable
Suitability of modality (i.e. radio or face to face) for
getting the information
level
success
Comments:
Humansystems®
Page B-8
7
Annex C: Recce Information Exit Transfer
Humansystems®
Page C-1
DATE: __________TIME: _____________
NAME/SUBJ #______________________
ROLE:
Platoon Commander
Section Commander
Other__________
Based upon your previous operational experience and your experiences over the past two
weeks please evaluate the recce patrol data collection, recording and information transfer
tools utilized in Sections A to D. In Section E you will be asked to record the optimum recce
tools that should be issued at the Section/Platoon level. Please note there is room for
additional comments, add them in the Section below.
Additional Comments
Humansystems®
Page C-2
SECTION A:
TEXT DATA
(Written Patrol Reports)
Is there a need to complete patrol reports at the
dismounted Platoon or lower level?
Need
If there is a need to complete recce patrol reports,
should the patrol reports if the future be completed
by hand in a FMP or on a computer?
FMP by hand
Advantages by hand on an FMP?
Advantages by computer?
Disadvantages by hand on an FMP?
Disadvantages by computer?
No need
On a mini computer
How can we improve the means of preparing a recce patrol report?
Should patrol reports always be completed behind
our lines after the mission is over?
Yes
No
Is there a need for giving dismounted sections or
recce dets any added report preparation
capabilities?
Yes
No
Humansystems®
Page C-3
SECTION B:
SIDE-VIEW DRAWINGS/PHOTOS DATA
Is there a need to complete drawings, take sideview photographs, etc., at the dismounted Platoon
or lower level?
If there is a need to create or capture images,
should the pictures be created by hand, in a FMP
or on a computer? Or should the images be
captured by a Polaroid or digital camera?
Need
No need
Drawn by hand in a FMP
Drawn by hand on a computer
Captured by Polaroid camera
Captured by digital camera
Advantages drawn by hand on an FMP?
Advantages drawn by hand in computer?
Advantages captured by Polaroid?
Advantages by digital camera?
How can we improve the means of drawing or capturing side-view pictures? Or what
features/capabilities should the camera/drawing system have?
Should images be sent immediately or stored until
after the patrol?
recce dets an added imaging capability?
Humansystems®
Sent immediately
Yes
Stored
No
Page C-4
SECTION C:
OVERHEAD-VIEW DRAWINGS/PHOTOS DATA
Is there a need to complete drawings, take
overhead-view photographs, etc., at the
dismounted Platoon or lower level?
Need
No need
Drawn by hand in a FMP
If there is a need to create or capture images,
Drawn by hand on a computer
should the pictures be created by hand, in a FMP
or on a computer? Or should the images be
Drawn as a map overlay
created as overlays on electronic maps or captured
Captured as a UAV image
as UAV or aerial photographs?
Drawn as a UAV image overlay
Advantages of drawn by hand?
Advantages drawn by hand in computer?
Advantages drawn as an electronic map overlay?
Advantages as a UAV image?
Advantages drawn as a UAV image overlay?
How can we improve the means of drawing or
capturing overhead-view pictures? Or what
features/capabilities should the
camera/drawing system have?
Should images be sent immediately or stored until
after the patrol?
Is there a need for giving dismounted sections
or recce dets an added imaging capability?
Humansystems®
Sent immediately
Yes
Stored
No
Page C-5
SECTION D:
VERBAL BRIEFINGS
Is there a current need to give verbal patrol
debriefs, at the dismounted Platoon or lower level?
If there is a need to give a verbal debrief, should
the debriefing be conducted face to face?
Need
No need
Need for face to face
No need
Face to face
Should the debriefing be done physically face to
face, remotely using video conferencing systems,
or remotely using radios or land lines?
Remote by radio
Remote by LAN (no video)
Remote by video conferencing
Advantages of face to face?
Advantages by radio
Advantages by videoconferencing?
Can technology (digital reports, pictures, overlays,
video conferencing, etc.) reduce the need for face
to face debriefings?
Always need for face to face debriefs
Reduced need for face to face
How can we improve the means of conducting verbal debriefs either face to face or remotely?
recce dets an ability to conduct debriefs remotely?
Humansystems®
Yes
No
Page C-6
SECTION E:
weeks please evaluate the recce patrol data collection, recording and information transfer
tools. Please record the optimum recce tools that should be issued at the Section/Platoon
level. Please note any added equipment required. If there is no need for kit, please mark
“NR” for not required. Please note there is room for additional comments at the beginning
of the questionnaire.
Element
Optimum
Comments
Patrol Report text
info record (i.e.
Performa, FMP)
Side-view Image
capture (i.e. camera,
video, etc.)
Side-view Image
creation (i.e.
drawing tool)
Overhead-view
Image capture (i.e.
UAV)
Overhead-view
Image creation (i.e.
drawing tool,
overlay builder)
Patrol Report verbal
info transfer (face to
face, radio, video
conferencing etc.)
Other recce tools
required.
Humansystems®
Page C-7
Annex D: Commander’s Recce Update Task
Questionnaire
Humansystems®
Page D-1
DATE: __________TIME: ____________
NAME: ___________________________
MISSION NUMBER: ________________
Physical Recce
No Physical Recce (Rely on Recce Info)
Remote Recce (UAV, Telepresence)
ROLE:
Platoon Commander
PL 2IC
SECTION A: Rate the degree to which you agree with the
following statements using the scale provided. Please
consider your responses to these scales carefully:
Section Commander
Completely
Unacceptable
1
2
Section 2IC
Borderline
3
4
Completely
Acceptable
5
6
Amount of new information received
Time required to receive all the new information
Opportunity to gain clarification
Effort required to comprehend new information
Effort/Ease of using and or manipulating new information
for adjusting initial plan
Time available to use the new information for adjusting
initial plan
Ease of recording new information
Suitability of new info for enhancing friendly situational
awareness
Suitability of new info for enhancing enemy situational
awareness
Suitability of new info for supporting raid execution
(mission awareness)
Overall utility of new information
Overall acceptance of gaining this extra information at the
Commander’s Recce
Please assess thecommanders recce info for utility in planning the Platoon Raid using the
assessment criteria attached. Please note the Platoon Raid must be executed by 1630hrs.
Humansystems®
Page D-2
7
1. Importance
Without this
information I can
complete this task:
2. Complexity
How complex is the
information?
N/A
1
2
3
4
5
N/A
1
2
3
4
5
Not at all
Can complete with difficulty
6. Update
Frequency
How frequently do
you update this
information?
Can complete easily
Low - Simple signal word or
sign
Medium - May need to
make an ID or write down
or do simple integration
with other information
7. Frequency of
Use
How often do you
use this information?
High - Requires integration
with other information or
calculations, interpretation
8. Accuracy
3. Timeliness
How acceptable is
the timeliness of this
information for the
task?
4. Difficulty
How difficult is it to
use the information
to complete the
task?
NA
1
2
3
4
5
Unacceptable
Borderline
Acceptable
NA
1
2
3
4
5
Very Difficult
Somewhat Difficult
Borderline
Somewhat Easy
Very Easy
How acceptable is
the accuracy of this
information for the
task?
9. Time Pressure
What time pressure
do you feel when
acquiring, sending or
receiving this
information?
NA
1
2
3
4
5
NA
1
2
3
4
5
NA
1
2
3
4
5
NA
1
2
3
4
5. Retention
For how long is this
information useful?
Humansystems®
NA
1
2
3
4
5
A few seconds
A few minutes
A few hours
A few days
A few weeks or more
5
Often
Sometimes
Rarely
No.___ Units___
(Never or now only)
Often
Sometimes
Rarely
No.___ Units___
Unacceptable
Borderline
Acceptable
No.___ Units___
Extremely busy, very
difficult
Very busy, barely enough
time
Busy, challenging but
manageable
Moderate activity, spare
time
Light activity, minimum
demands
Page D-3
Comments
Humansystems®
Page D-4
Annex E: Commander’s Recce Exit
Questionnaire
Humansystems®
Page E-1
DATE: __________TIME: _____________
NAME/SUBJ #______________________
ROLE:
Platoon Commander
Section Commander
Other__________
weeks please evaluate the approached to conducting the commander’s recce (Sections A to
C). In Section D you will be asked to record the optimum commander’s recce tools/approach
that should be issued/done at the Section/Platoon level. Please note there is room for below
for additional comments.
Additional Comments
Humansystems®
Page E-2
SECTION A:
Physical Recce:
Given the following recce info provided/means of transfer:
(baseline FMP drawings, polaroid pictures, face to face
verbal debrief, text) ,
Need
No need
Need
No need
Need
No need
is there a need to conduct a physical recce of the objective
at the dismounted Platoon or lower level?
(digital drawings, digital pictures, radio debrief, soft text) ,
(digital drawings, digital pictures, topo overlays, video
conferencing, soft text) ,
If a recce of an objective has not been undertaken what additional information is required at a
commander’s recce?
If a recce of an objective has been undertaken what additional information is required at a
commander’s recce?
Humansystems®
Page E-3
Advantages of a physical recce?
Disadvantages of a physical recce (impact on
tempo, detectability, etc)?
How can we improve the means of conducting a physical commander’s recce?
Humansystems®
Page E-4
SECTION B:
No Physical Recce
- Rely on Previous Info
Advantages of relying on previous recce info
(impact on tempo, detectability, etc)?
Disadvantages of not conducting a physical
recce and relying on previous recce info?
If a previous recce of an objective has been undertaken, what additional information is required so
that a commander does not have to complete a physical recce?
Humansystems®
Page E-5
SECTION C:
No Physical Recce
- Rely on Telepresence/Real-Time Info
Advantages of relying on real-time info (impact
on tempo, detectability, etc)?
Disadvantages of not conducting a physical
recce and relying on real-time info?
If real-time informatiuon is available, what additional information is required so that a commander
does not have to complete a physical recce?
Humansystems®
Page E-6
SECTION D:
weeks please evaluate the commander’s recce data collection, recording and information
transfer tools. Please record the optimum tools that should be issued at to the
Commander at the Section/Platoon level. Please note any added equipment required. If
there is no need for kit, please mark “NR” for not required. Please note there is room for
additional comments at the beginning of the questionnaire.
Element
Optimum
Comments
Text info record (i.e.
Performa, FMP)
Side-view Image
capture (i.e. camera,
video, etc.)
Side-view Image
creation (i.e.
drawing tool)
Overhead-view
Image capture (i.e.
UAV)
Overhead-view
Image creation (i.e.
drawing tool,
overlay builder)
Verbal info transfer
(face to face, radio,
video conferencing
etc.)
Other recce tools
required.
Humansystems®
Page E-7
Annex F: Orders Briefing – Provider
Humansystems®
Page F-1
PARTICIPANT NUMBER: __________
MISSION NUMBER:
SECTION NUMBER:
CONDITION:
ROLE:
FACE TO FACE
RADIO / MAP
DIGITAL MEETING
$
$
$
WPN DET COMD
SECT COMD
PL COMD
$
$
$
Rate the acceptance of the following statements using the
scale provided. Please consider your responses to the scale
carefully.
Amount of Information Provided
Time Required to Give Orders
Opportunity for Back Brief
Confidence in others understanding my Mission Intent
Confidence in others understanding the Mission Execution
Ease of Providing Section Level Situational Information
Ease of Providing Terrain/Navigational Information
Ease of Providing Platoon Level Situational Information
Suitability for Reducing Mental Effort
Suitability for Reducing Memory Demands
Overall Ease of Providing Orders Briefing
Overall Utility of Briefing Method
Humansystems®
Acceptability
☺
1
2
3
4
5
6
7
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
Page F-2
Likes Dislikes
Indicate the features/information you liked the most.
Indicate the features/information you liked the least.
1.
1.
2.
2.
3.
3.
Improvements
How would you improve this briefing method?
1.
2.
3.
Additional Comments
Humansystems®
Page F-3
Annex G: Orders Briefing – Receivers
Humansystems®
Page G-1
PARTICIPANT NUMBER: _________
MISSION NUMBER:
SECTION NUMBER:
CONDITION:
ROLE:
FACE TO FACE
RADIO / MAP
DIGITAL MEETING
$
$
$
WPN DET COMD
SECT COMD
PL COMD
$
$
$
Acceptability
Rate the acceptance of the following statements using the scale
provided. Please consider you responses to the scale carefully.
Amount of Information Received
Time Required to Receive Orders
Time Required to Comprehend Information
Effort Required to Comprehend Information
Confidence in Comprehending Mission Intent
Confidence in Comprehending Mission Execution
Ease of Recording Information
Effectiveness for Section Level Situational Awareness
Effectiveness for Terrain/Navigational Awareness
Effectiveness for Status of Friendly Forces
Effectiveness for Status of Enemy Forces
Effectiveness for Platoon Level Situational Awareness
Overall Ease of Receiving Orders Briefing
Humansystems®
1
2
3
4
5
6
☺
7
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
Page G-2
Likes Dislikes
1.
1.
2.
2.
3.
3.
Improvements
How would you improve this briefing method?
1.
2.
3.
Additional Comments
Humansystems®
Page G-3
Annex H: Orders Comprehension with Map
Humansystems®
Page H-1
PARTICIPANT NUMBER: _____________________ MISSION NUMBER: ___________________
SECTION NUMBER: _________________________
CONDITION:
ROLE:
FACE TO FACE
RADIO / MAP
DIGITAL MEETING
$
$
$
WPN DET COMD
SECT COMD
$
$
SECTION A: BASED ON THE ORDERS PROVIDED, ANSWER THE FOLLOWING QUESTIONS.
1. Formation:
2. Grouping and Tasks:
3. H Hour:
4. Attack position and route: please indicate on map provided
5. Order of march to attack position:
6. Line of departure: please indicate on map provided
7. Route: please indicate on map provided
8. Assault position: please indicate on map provided
9. Assault line: please indicate on map provided
10. Dismount Area: (if applicable): please indicate on map provided
11. Consolidation: please indicate on map provided
12. Fire Plan:
13. Zulu Harbour (if applicable): please indicate on map provided
Humansystems®
Page H-2
Humansystems®
Page H-3
Annex I: Teamwork
Humansystems®
Page I-1
MISSION NUMBER:
SECTION NUMBER:
CONDITION:
ROLE:
FACE TO FACE
RADIO / MAP
DIGITAL MEETING
$
$
$
WPN DET COMD
SECT COMD
PL COMD
$
$
$
Agreement with Statement
SECTION A: Rate the degree to which you agree
scales carefully:
Strongly
Disagree
1
Strongly
Agree
Neutral
2
3
4
5
6
7
The platoon coordinates well in completing this
mission.
The platoon leader provides good direction in helping
our section to meet this mission’s goals.
During this mission, other sections are able to
anticipate my actions and I am able to anticipate
theirs.
Teamwork increases to our platoon’s ability to
complete this mission.
During this mission, the other leaders have failed to
give me the information that I need to make
decisions.
Our platoon shows a poor level of cooperation during
this mission.
In this mission, the other leaders and I work well as a
team.
Humansystems®
Page I-2
Agreement with Statement
SECTION B: Rate the degree to which you agree
scales carefully:
Strongly
Disagree
1
Strongly
Agree
Neutral
2
3
4
5
6
7
Our platoon is able to accomplish more as a team
than as individual sections.
I see myself as a team member first and as an
individual second.
I am confident in the abilities of my teammates during
this mission.
The members of the platoon have a common view of
how to complete this mission.
In general, the platoon performs well as a team.
The platoon leaders and I form a cohesive unit.
SECTION C: COMMENTS
Humansystems®
Page I-3
Annex J: NASA TLX Workload
Humansystems®
Page J-1
PARTICIPANT NUMBER: ____________________ MISSION NUMBER: ___________________
SECTION NUMBER: _________________________
CONDITION:
ROLE:
FACE TO FACE
RADIO / MAP
DIGITAL MEETING
$
$
$
WPN DET COMD
SECT COMD
PL COMD
$
$
$
Rate the session by marking an “X” on each scale at the point that matches your experience.
Each line has two endpoint descriptors to help describe the scale. Please consider your
responses to these scales carefully.
MENTAL DEMAND (thinking, deciding, searching, remembering)
Low
High
(easy, simple)
(demanding, complex)
PHYSICAL DEMAND (controlling, operating, activating)
Low
High
(easy, restful)
(demanding, laborious)
TEMPORAL DEMAND (time pressure)
Low
High
(leisurely)
(frantic)
PERFORMANCE (how successful and how satisfied were you with performing this task?)
Good
Poor
EFFORT (how hard did you have to work, both mentally and physically?)
Low
High
FRUSTRATION
Humansystems®
Low
High
(gratified, complacent)
(discouraged, annoyed)
Page J-2
Annex K: Distributed Orders Exit
Questionnaire
Humansystems®
Page K-1
SECTION NUMBER: ______________
Rate the acceptance of the following statements using the scale provided.
Please consider your responses to the scale carefully.
_ Face to Face
Amount of Information Received
Time Required to Receive Orders
Time Required to Understand Information
Effort Required to Understand Information
Confidence in my Understanding the Mission Intent
Confidence in my Understanding the Mission Execution
Ease of Recording Information
Effectiveness for Section Level Situational Awareness
Effectiveness for Terrain/Navigational Awareness
Effectiveness for Status of Friendly Forces
Effectiveness for Status of Enemy Forces
Effectiveness for Platoon Level Situational Awareness
Humansystems®
_ Radio / Map
Digital Meeting
1
2
3
4
5
6
☺
7
1
2
3
4
5
6
☺
7
1
2
3
4
5
6
☺
7
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
Page K-2
_ Radio / Map
Overall Ease of Receiving Orders Briefing
Likes
_ Radio / Digital Files
Digital Meeting
1
2
3
4
5
6
☺
7
1
2
3
4
5
6
☺
7
1
2
3
4
5
6
☺
7
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
$
Dislikes
1.
1.
2.
2.
3.
3.
Improvements
How would you improve orders briefing methods?
1.
2.
3.
Additional Comments
Humansystems®
Page K-3
UNCLASSIFIED
DOCUMENT CONTROL DATA
(Security classification of the title, body of abstract and indexing annotation must be entered when the overall document is classified)
1. ORIGINATOR (The name and address of the organization preparing the document, Organizations
2. SECURITY CLASSIFICATION
for whom the document was prepared, e.g. Centre sponsoring a contractor's report, or tasking agency,
are entered in section 8.)
(Overall security classification of the document
including special warning terms if applicable.)
Publishing: DRDC
Toronto
UNCLASSIFIED
Performing: Humansystems® Incorporated, 111 Farquhar St., 2nd
floor, Guelph, ON N1H 3N4
Monitoring:
Contracting: DRDC
Toronto
3. TITLE (The complete document title as indicated on the title page. Its classification is indicated by the appropriate abbreviation (S, C, R, or U) in parenthesis at
the end of the title)
Investigation of Alternative Methods of Transferring Reconnaissance and Platoon
Orders Information (U)
Étude sur les moyens de communiquer les données de reconnaissance et les ordres de
peloton
4. AUTHORS (First name, middle initial and last name. If military, show rank, e.g. Maj. John E. Doe.)
Harry A. Angel; David W. Tack; Lisa J. Massel
5. DATE OF PUBLICATION
(Month and year of publication of document.)
July 2005
6a NO. OF PAGES
6b. NO. OF REFS
(Total containing information, including
Annexes, Appendices, etc.)
123
(Total cited in document.)
2
7. DESCRIPTIVE NOTES (The category of the document, e.g. technical report, technical note or memorandum. If appropriate, enter the type of report, e.g.
interim, progress, summary, annual or final. Give the inclusive dates when a specific reporting period is covered.)
Contract Report
8. SPONSORING ACTIVITY (The names of the department project office or laboratory sponsoring the research and development − include address.)
Sponsoring: DLR 5, NDHQ OTTAWA,ON K1A 0K2
Tasking:
9a. PROJECT OR GRANT NO. (If appropriate, the applicable
research and development project or grant under which the document was
written. Please specify whether project or grant.)
12QG01
10a. ORIGINATOR'S DOCUMENT NUMBER (The official
9b. CONTRACT NO. (If appropriate, the applicable number under which
the document was written.)
W7711−017747/001/TOR
10b. OTHER DOCUMENT NO(s). (Any other numbers under which
document number by which the document is identified by the originating
activity. This number must be unique to this document)
may be assigned this document either by the originator or by the
sponsor.)
DRDC Toronto CR 2005−054
SIREQ#140
11. DOCUMENT AVAILABILIY (Any limitations on the dissemination of the document, other than those imposed by security classification.)
Defence departments in approved countries − Document has initial limited distribution
through Exploitation Manager − TTCP and NATO countries and agencies − Unlimited
after initial limited distribution
12. DOCUMENT ANNOUNCEMENT (Any limitation to the bibliographic announcement of this document. This will normally correspond to the Document
Availability (11), However, when further distribution (beyond the audience specified in (11) is possible, a wider announcement audience may be selected.))
Other − Document to have initial Limited announcement
UNCLASSIFIED
DOCUMENT CONTROL DATA
(Security classification of the title, body of abstract and indexing annotation must be entered when the overall document is classified)
13. ABSTRACT (A brief and factual summary of the document. It may also appear elsewhere in the body of the document itself. It is highly desirable that the abstract
of classified documents be unclassified. Each paragraph of the abstract shall begin with an indication of the security classification of the information in the paragraph
(unless the document itself is unclassified) represented as (S), (C), (R), or (U). It is not necessary to include here abstracts in both official languages unless the text is
bilingual.)
(U) This experiment investigated the technological ability to capture and transfer information
from recce patrols to higher echelons. A daily mission was carried out in which three
sections conducted recce patrols. Following the recce patrols, the section leaders and the
platoon commander collocated and conducted recce briefings. Three different methods of
capturing, preparing and transferring information with increasing digital capability were
evaluated by a jury of the section leaders’ and platoon commander’s peers watching the
transfer of information from a remote location. The first method acted as a baseline for the
other two conditions (current CF practice). In this Face to Face condition, the report and
drawings were drafted by hand, and pictures were taken with a Polaroid camera. The
patrol briefing was conducted face to face. For the Digital/Radio condition, the report and
drawings were produced digitally, and pictures were taken with a digital camera. The
briefing was conducted remotely by radio. For the Digital/Telepresence condition, the
report and drawings were produced digitally, pictures were taken digitally, and overlays
were used. For this condition, the briefing took place remotely by telepresence.
Following the section recce briefings, the platoon commander conducted a recce and
distributed his orders. For the commander’s recce, the following three methods evaluated
were the physical recce (current CF procedure), remote recce by radio, and remote recce
by Unattended Aerial Vehicle (UAV).
The final study investigated distributed orders and the different ways of transferring
information. Distributed orders were conducted in a centralized and two different
decentralized formations (by radio and telepresence).
Participants liked the ability to create digital reports, pictures, drawings, and overlays.
They felt the greatest advantage was the ease with which this information could be sent
electronically to higher echelons and be reproduced. Participants preferred recce briefings
to be conducted face to face, however, because with this method they were able to tell if
the other soldier comprehended the information they were sharing. If a briefing must be
conducted remotely, participants preferred telepresence over the radio.
Participants believed that it was always necessary to conduct a Commander’s physical
recce because it increases the commander’s situational awareness of the enemy,
objective, and terrain. This information allows the commander to change his plan as
appropriate and determine assault positions, withdraw routes, fire base location, etc.
Overall, participants preferred to have distributed orders conducted face to face, which
allows individuals to view each other’s body language as well as easily determine each
other’s comprehension of the plan. Also, participants believed that gathering at one
location increases the communication among sections, thereby increasing efficiency.
14. KEYWORDS, DESCRIPTORS or IDENTIFIERS (Technically meaningful terms or short phrases that characterize a document and could be helpful in
cataloguing the document. They should be selected so that no security classification is required. Identifiers, such as equipment model designation, trade name,
military project code name, geographic location may also be included. If possible keywords should be selected from a published thesaurus, e.g. Thesaurus of
Engineering and Scientific Terms (TEST) and that thesaurus identified. If it is not possible to select indexing terms which are Unclassified, the classification of each
should be indicated as with the title.)
(U) Soldier Information Requirements Technology Demonstration Project; SIREQ TD; Recce
patrols; recce briefing; information transfer; Unattended Aerial Vahicle; UAV; telepresence;
digital tools; Human Factors

investigation of alternative methods of transferring reconnaissance

Transcription

Similar documents

May 2006

VOLUME 1, NO. 3 JUNE/JULY 2005 MOSUL, IRAQ

Please click this link to view the initial outline tour proposal

Theodore J. Leczo earned a B.S. degree in metallurgical

Siege of Bastogne – Total War

HAIX, FIRE HERO® XTREME (NO

D Co - Dukes July Newsletter 2011

Wedding Showcase - The Arsenal on the Charles

after action report for Fire Base Julie

Apache Newsletter AUG12