improving consumer information about motorcycle protective

Transcription

improving consumer information about motorcycle protective
Improving consumer information about motorcycle protective clothing IMPROVING CONSUMER INFORMATION
ABOUT MOTORCYCLE PROTECTIVE CLOTHING
PRODUCTS
Liz de Rome, Tom Gibson, Narelle Haworth,
Rebecca Ivers, Chika Sakashita & Paul Varnsverry
JANUARY 2012
Improving consumer information about motorcycle protective clothing Improving consumer information about motorcycle protective clothing products (2012)
was prepared for the Motor Accidents Authority of NSW (MAA), under the auspices of the
Australian Heads of CTP.
The project was led by Liz de Rome with Rebecca Ivers and Chika Sakashita from The
George Institute for Global Health, The University of Sydney.
Co-investigators were: Tom Gibson (Human Impact Engineering, Sydney), Narelle Haworth
(Centre for Accident Research and Road Safety– Queensland, Queensland University of
Technology) and Paul Varnsverry, PVA Technical File Services Limited (UK).
Improving consumer information about motorcycle protective clothing EXECUTIVE SUMMARY
The Motor Accidents Authority of NSW (MAA), under the auspices of the Australian Heads
of CTP, commissioned a study of the potential options for increasing the availability of
credible consumer information regarding motorcycle safety clothing.
A review of the literature highlighted the increasing participation in motorcycling in
Australasia and the associated increase in the numbers of motorcycle crash injuries. While
there is evidence that specialized motorcycle protective clothing may significantly reduce the
risk and severity of injuries in crashes, there is also evidence that over 25% of the protective
clothing worn by motorcyclists in Australia is of inferior quality and may fail under crash
conditions.
The researchers investigated a range of existing consumer information programs in road
safety and other sectors, to identify the features of different business models. An international
search of motorcycle clothing rating regimes found the most comprehensive and objective
program available to be the tests specified under the European Standards for motorcycle
protective clothing.
Consultations with riders and key stakeholders in the motorcycle accessories industry in
Australia and New Zealand found no significant barriers to the proposition of an independent
consumer testing and information program. Riders were generally supportive with the caveat
that such a program must not lead to compulsory usage of protective clothing. A substantial
proportion indicated that they would be willing to pay higher prices for protective clothing
that has been independently tested and accredited. Industry stakeholders were concerned that
they would be expected to absorb the costs of such a program, but did see some potential for
such a program assisting them to compete with cheap low quality imports. Industry support
for independent testing may increase as the provisions of the new Australian Consumer Law
(ACL) become more widely known. Under this Act, anyone in the supply chain (e.g.
manufacturer, importer, retailer or hirer), can be held liable if a product is found to be unsafe.
The findings of this report suggest that an independent scheme for testing and rating
motorcycle protective clothing could increase usage rates and reduce injuries, by enabling
riders to make informed purchasing decisions. It would also provide incentives to industry to
focus on higher quality products and would reduce the marketability of those found to be not
fit for purpose. Options for quantifying the potential benefits of improved quality and uptake
of protective clothing in terms of data sources and issues for benefit cost analysis are
discussed.
Five potential models of consumer information/ratings programs were examined to identify
the optimal model for this program. Factors considered included whether products are
assessed on single or multiple dimensions, completeness of coverage, how the ratings are
communicated to consumers, whether the system is mandatory or voluntary, how it relates to
any existing standards and how is it funded.
The recommended model is commonly used in road safety and requires external stakeholders
to provide funding for purchase, testing and promotion of results to intending purchasers. For
example, the Australian New Car Assessment Program (ANCAP) is funded by a consortium
of motoring organizations and road authorities who independently purchase and crash test
Improving consumer information about motorcycle protective clothing cars to specified performance criteria, Tests are generally based on standards and results
made available to the public though stakeholder communication networks. While this model
requires significant input of resources from the accrediting body, it has several important
advantages. It is not dependent on the support of either industry or consumers but, as the
ANCAP program has demonstrated, this approach operates most effectively by educating
consumers and thus shaping market demand for higher quality products. Over time the
changing market demand would be expected to create a more inviting business case for
industry to engage proactively with the program. As with ANCAP it would be recommended
that manufacturers be encouraged to take part by paying for the testing of their products
rather than waiting to be independently selected.
This model also has the potential to avoid the problems that have arisen in Europe where
testing is the responsibility of manufacturers. This has resulted in many of the largest
manufacturers avoiding the requirements of compliance with the European Standards by
avoiding any reference to safety when marketing their motorcycle clothing products.
With a funding base that is independent of industry, a star system may be more able than a
voluntary industry standard to withstand pressure to reduce the performance requirements.
Thus, the independent star system would potentially have greater safety benefits for
motorcyclists. In addition to ANCAP other current examples include the Child Restrain
Evaluation Program (CREP) and the Consumer Rating and Assessment of Safety Helmets
(CRASH). The essential features are that the tests are objectively validated and the
methodology and criteria transparent.
Further work, including focus groups, will be required to refine the presentation of results
(star ratings systems) to ensure they are readily comprehensible to the target audience.
Essentially, it is proposed that ratings be based on two separate dimensions. Each garment
would be rated firstly on injury protection and, secondly, on user comfort. The latter to
comprise weather protection, water penetration, thermal comfort and ergonomics. It is
proposed that a thermal manikin be used to ensure consistency and reliability in the thermal
testing. As there are a number of appropriate water penetration and thermal comfort standards
available, further work will be required to determine which would be optimal when used in
combination with the injury protection tests. Injury protection performance and ergonomics
would be evaluated using the equipment and test methodologies specified for the European
standards for motorcycle protective clothing.
Improving consumer information about motorcycle protective clothing CONTENTS The brief
1 The scope of the report
2
CHAPTER 1 – INTRODUCTION AND BACKGROUND
3 Injury risk and costs of motorcycle crashes
4 Crash data and injury incidence
The frequency and severity of injuries
Injury costs
Injury risk reduction and motorcycle protective clothing
The MAIDS study (Motorcycle Accident In-Depth Study)
The Gear study – effectiveness of motorcycle protective clothing
Quality And Failure Rates Of Motorcycle Clothing Products
Ride Magazine product tests
The Gear Study – product quality findings
Usage of motorcycle PPE
5 6 9 10 10 11 13 13 13 14
CHAPTER 2 - PRODUCT TESTS AND RATING SCHEMES FOR MOTORCYCLE
PROTECTIVE CLOTHING
21 Currently existing motorcycle clothing evaluation regimes
The European Standards for motorcycle protective clothing
background research and the evidence base for the european standards
22 22 22 The development of the European Standards for motorcycle protective clothing 23 Inter-product compatibility
24 Compliance with the European Standards
25 Industry support and compliance
26 Regulation of protective clothing in motorcycle sports
26 Motorcycle helmet rating schemes
27 Safety helmet assessment and rating program (SHARP)
27 Consumer rating and assessment of safety helmets (CRASH)
27 Consumer product information, reviews and ratings programs
28 Motorcycle magazine product reviews
Ride Magazine (UK)
Motorrad magazine (Germany)
Victorian motorcycle protective clothing consumer awareness program
28 29 29 29
Improving consumer information about motorcycle protective clothing CHAPTER 3 - CONSUMER RATING AND EVALUATION PROGRAMS
39 Identifying and classifying consumer information programs
39 Consumer information programs in vehicle and road safety
New and used car safety rating programs
40 40 Effects of car safety rating programs on purchase decisions
41 Other vehicle and road safety rating systems
42 Rating systems in other industries
Efficacy and cost-effectiveness
The different business models
43 45 52
CHAPTER 4 - CONSUMER CONSULTATIONS AND FURTHER RESEARCH55 Industry consultations
55 Rider consultations
56 The samples
Ownership and usage of protective clothing
Purchasing of protective clothing
Discussion and conclusions
The use of safety in protective clothing advertisements
Background to the study.
Aims and Method
Results
56 57 57 58 58 59 59 59
CHAPTER 5 - QUANTIFYING THE ECONOMIC AND HUMAN COSTS OF
MOTORCYCLE CRASHES
62 Introduction
62 Approaches to quantifying motorcycle road crash costs
62 Types of data required
Available sources of data and their limitations
Road crash data
Injury surveillance and claims data
Hospital admissions data
65 67 67 68 69 Injury insurance claims
69 Injury costs
69 Management of data limitations
70 Options for quantifying the potential benefits of improved quality and uptake of protective
clothing.
74 Improving consumer information about motorcycle protective clothing Methodological imperative 1:
75
Methodological imperative 2:
75 Methodological imperative 3:
76
CHAPTER 6 – CONCLUSIONS AND RECOMMENDATIONS
83 Introduction
83 Current sources of consumer information about motorcycle safety clothing
Motorcycle clothing test and evaluation regimes
Test facilities
83 84 84 Relevant features of the motorcycle clothing market in Australasia.
Models of consumer information programs
The feasibility in the Australian and New Zealand context
85 85 86 Recommended approach and mechanisms
89 Business model
89 Administration
89 Testing
89 Publication of results
90 Rating and reporting
90 APPENDICES
A. European Standards for Motorcycle Protective Equipment (PPE)
93
B. RIDE test results
94
C. Rating schemes - decision matrix
103
D. Rider survey
113
E. Data for cost estimates
123
F.
Test Facilities for EU Motorcycle PPE Standards
132
G. Standards for Thermal and Water Penetration test
133
H. Facilities for Thermal and Water Penetration tests
134
Improving consumer information about motorcycle protective clothing IMPROVING CONSUMER INFORMATION ABOUT
MOTORCYCLE PROTECTIVE CLOTHING PRODUCTS
THE BRIEF
The Motor Accidents Authority of NSW (MAA), under the auspices of the Australian Heads
of CTP, commissioned a study of the potential options for increasing the availability of
credible consumer information for motorcycle safety clothing.
The project team was coordinated by The George Institute for Global Health and includes
representatives of CARRS-Q, Human Impact Engineering (Sydney) and PVA Technical File
Services Limited (UK).
The current report is the first phase of a two part project. The aim of the first phase was to
identify options and assess the feasibility of increasing the availability of credible information
about the effectiveness of motorcycle protective clothing products in the Australasian market.
A range of options were to be considered including, but not only, the establishment of an
evidence-based rating program. The report is intended to provide sufficient information to
provide a framework and direction for a possible second phase. Should the second phase
proceed, it will involve a detailed cost benefit analysis and business case for implementation
of the options identified in phase
Structure of the report
Chapter 1 provides the outcome of a targeted review of the literature and available evidence
as to the risk, injury and cost reduction benefits of motorcycle protective clothing.
Chapter 2 provides a critical assessment of existing motorcycle protective clothing rating
and/or testing' regimes both nationally and internationally.
Chapter 3 reports on existing consumer information programs and what is known about their
efficacy and cost-effectiveness in road safety and other sectors.
Chapter 4 reports on the outcomes of industry and rider consultations in Australia and New
Zealand and further research into the likely impacts of improved consumer information about
protective clothing.
Chapter 5 outlines options for quantifying the economic and human costs of road crashes
involving motorcyclists and pillion passengers, and the potential benefits of improved quality
and uptake of protective clothing.
Chapter 6 describes the options for improving the availability of consumer information about
motorcycle safety clothing. It discusses the feasibility of each of the identified options in the
Australian and New Zealand context.
Chapter 1 – Introduction
1
Improving consumer information about motorcycle protective clothing THE SCOPE OF THE REPORT
This report is concerned with motorcycle protective clothing designed for riding on-road.
Protective equipment designed for off-road riding has been excluded as it is usually very
specialised and designed for impacts not directly applicable to on-road riding. The range of
products examined includes jackets, pants, one-piece suits, gloves and boots in addition to
impact protectors for the limbs and back. As helmets are already the subject of an Australian/
New Zealand standard, they are not the primary focus of investigation but are included in the
proposed options for consumer information systems.
The primary focus is on protection from injury in a crash, but also takes account of the
functionality of clothing. Discomfort and heat-related stress are recognised factors associated
with protective clothing in many industries, where protection from hazards has to be provided
at a cost to comfort and flexibility (James 2002). This is because the materials required to
provide injury protection tend to be heavier than normal clothing and, by creating
physiological stress, may potentially increase crash risk for motorcyclists (EEVC 1993). In
addition to the potential crash risk, heat is also a significant factor in discouraging usage of
protective clothing (de Rome 2011).
The aim of this project is to outline the options for increasing the availability of reliable
independent information about the protective performance of motorcycle clothing products to
riders in Australia and New Zealand. Options to be considered include the possibility of
developing a national and cross-Tasman regime for the testing and rating of motorcycle
protective clothing. The focus is the provision and promotion of reliable information to
consumers, not the development of any regulatory frameworks or government enforcement
policies.
Chapter 1 – Introduction
2
Improving consumer information about motorcycle protective clothing CHAPTER 1 – INTRODUCTION AND BACKGROUND
Motorcyclists represent an increasing proportion of road crash casualties in Australia and
around the world. This is due to the increasing number of riders, as motorcycles have become
the fastest growing sector of motor vehicles globally (Rogers 2008). Motorcyclists also have
a higher risk of injury than other motorised road users who are protected by a vehicle shell.
The safety measures routinely fitted to motor cars in order to safeguard the vehicle occupants
from injury in a road traffic accident are almost entirely absent from motorcycles. Vehiclemounted systems include crash bars and air bags, but neither have proven a reliable or viable
mechanism for general use due to the variety of pre-crash and collision motions of riders and
motorcycles. Crash bars have been found to be effective in some situations but the agents of
injury in others (Craig 1983, Mackay 1986, Ouellet et al. 1987, Sporner et al. 1990). While
test results are encouraging, the effectiveness of airbags in motorcycle crashes is yet to
proven (Ijima et al. 1998, Dragčević et al. 2009b, Thollon et al. 2010). A recent report to the
European Transport Safety Council concluded that the development of airbags mounted on
motorcycles will be a protracted task, particularly as the trend towards taller cars (people
carriers, minivans and SUVs) increases the risk of severe injury crashes. Collisions involving
vehicles with high, steep fronts or sides are more likely to result in the rider’s head impacting
the roof frame with higher risk of severe injury (ETSC 2008).
A number of researchers have concluded that effective injury prevention is most likely to
come from protection systems worn by the rider rather than attached to the motorcycle (Craig
1983, Nordentoft et al. 1984, Ouellet et al. 1987, Sporner et al. 1990). Motorcycle helmets
have been identified as an effective measure for reducing the risk of death or severe injury in
motorcycle crashes (Liu et al. 2008). Most recently, work has also been done on fall
dynamics for the development of airbags integrated into motorcycle jackets (Bellati et al.
2006, Dragčević et al. 2009a). Less attention has been paid to the injury reduction benefits of
motorcycle clothing but there is evidence that a significant proportion of motorcycle injuries
may be reduced or prevented by the use of effective protective clothing (Schuller et al. 1986,
EEVC 1993, Otte et al. 2002, ACEM 2004, de Rome et al. 2011a).
Despite such evidence, it is apparent that relatively few riders wear full motorcycle protective
clothing when they ride (Reeder et al. 1996, ACEM 2004, de Rome et al. 2004, Watson et al.
2008). Research into non-usage of protective clothing suggests that there is a range of
associated factors including riders’ age, lack of information, type of motorcycle, and
scepticism about its protective value (de Rome et al. 2011b), journeys purpose (de Rome
2006, Watson et al. 2008). In particular, hot weather has been cited as a factor in non-usage
of protective clothing (Koch and Brendicke 1998, Manzardo 2006, de Rome et al. 2011b).
The challenge for industry has been to provide protection from injury and weather conditions
without restricting the riders ease of movement or causing discomfort or fatigue.
Standards for motorcycle protective clothing were issued in Europe in the late 1990s. This
provided benchmarks and incentives for manufacturers to develop improved products (EEVC
1993). Despite the ensuing technical developments and new products, few European
manufacturers submit their products for testing, circumventing the need for compliance by
avoiding any reference to safety or protection in product descriptions.
Chapter 1 – Introduction
3
Improving consumer information about motorcycle protective clothing INJURY RISK AND COSTS OF MOTORCYCLE CRASHES
In Australia and New Zealand, as in many other high income countries, there has been a
substantial increase in the numbers of motorcycles registered and the number of rider
casualties. In the five years from 2004 and 2008, the reported numbers of motorcyclists
injured increased by 21% in Australia and almost doubled (94%) in New Zealand (ABS
2011, Ministry of Transport 2011, NZTA 2011). A risk rate is calculated as the number of
fatalities or injuries per 10,000 registered motorcycles. Thus while the numbers of reported
fatalities and injuries have gone up in each country, the risk rates have declined or remained
relatively stable. See Table 1.1 and Figure 1.1.
Table 1.1 Motorcycle casualties and casualty rates Australia and New Zealand†.
Australia
Motorcycle registrations*
Motorcycle fatalities
Fatality rate**
Motorcycle injuries
Injury rate**
New Zealand
Motorcycle registrations*
Motorcycle fatalities
Fatality rate**
Motorcycle injuries
Injury rate**
2004
2005
2006
2007
2008
2009
2010
2004-08
396
191
4.8
6,969
176.0
422
233
5.5
7,366
174.5
463
238
5.1
7,590
163.9
512
237
4.6
7,679
150.0
568
245
4.3
8,421
148.3
624
224
3.6
NA
NA
660
214
3.2
NA
NA
+43%
+28%
-11%
+21%
-16%
59
34
5.8
721
122.9
64
36
5.6
903
141.6
75
38
5.1
1,017
135.3
85
41
4.8
1,336
156.5
97
50
5.2
1,396
144.0
101
48
4.7
1,369
134.9
100
50
5.0
1,300
130.1
+65%
+47%
-11%
+94%
+17%
† Australian figures compiled from data published or provided by each State and Territory road authority. NZ data obtained
from Ministry of Transport 2011, NZTA 2011.
* Registrations ‘000,
**Fatality and injury rates calculated as number per 10,000 registered motorcycles
NA Injury data was not available for all Australian States and Territories at the time of writing.
Figure 1.1 Casualty rates per 10,000 registered motorcycles, 2004-2010
200.0
180.0
176.0
174.5
20.0
150.0
160.0
140.0
80.0
20.0
16.0
14.0
144.0
135.3
122.9
5.8
60.0
40.0
148.3
156.5
141.6
120.0
100.0
18.0
163.9
4.8
134.9
130.1
12.0
10.0
8.0
5.6
5.1
5.5
5.1
4.8
4.6
5.2
4.7
5.0
6.0
4.0
4.3
3.6
3.2
2009
2010
0.0
Injury rate (Aus)
Injury rate (NZ)
Fatalites rate (Aus)
Fatalites rate (NZ)
2.0
0.0
2004
2005
Chapter 1 – Introduction
2006
2007
2008
4
Improving consumer information about motorcycle protective clothing CRASH DATA AND INJURY INCIDENCE
The true number of motorcycle crash injuries and particularly minor injuries is difficult to
establish, even in countries where road fatality and serious injury records are relatively
accurate. This is due to under reporting of motorcycle crashes to police, and also to the bias
towards serious injuries that is inherent in records provided by hospital systems (Rutledge
and Stutts 1993, Lin and Kraus 2008).
Under-reporting of motorcycle crashes compared to other motor vehicle crashes, particularly
in relation to minor injury and single vehicle motorcycle crashes, has been identified in many
jurisdictions including Australia, New Zealand, Europe and Asia (Cercarelli et al. 1996,
Lopez et al. 2000, Alsop and Langley 2001, Melhuish 2002, ADB 2006, Amoros et al. 2006,
Wilson et al. 2011). A national survey conducted for the UK Department of Transport about
reported and unreported crashes, found that overall, 17% of motorcycle crashes had been
reported to police. This included 24% of injury crashes and 8% of non-injury crashes. Other
studies using hospital data linkage suggest that between 33%-69% of motorcycle crashes in
high income countries are reported to police (Harris 1990, Alsop and Langley 2001, Barros et
al. 2003, Richardson and Paini 2006).
Bias in injury records is due to the exclusion of non-hospitalized injuries from many injury
surveillance systems. In Australia, national injury surveillance systems exclude injured
persons who are treated only at the scene, in emergency departments or by private medical
services (AIHW 2011). A recent State-based study of motorcyclist presentations (n=104) to
emergency departments in Perth, Western Australia over a six month period, found that 63%
were subsequently admitted to hospital (Meuleners et al. 2007).
Population surveys may provide more accurate estimates of the actual proportions of injured
riders. A cohort study of 4,721 junior college students in Taiwan, found that the incidence
rates per 1,000 person-years were 358 crashes to 104 injured and 14 hospitalised (Lin et al.
2001).
Injury claims data is an alternate source of information, but is sometimes limited by the terms
of coverage. For example some schemes exclude casualties who were at-fault or if the crash
was not reported to police. However, the Accident Compensation Commission (ACC) in New
Zealand provides comprehensive no-fault based injury insurance cover for all injuries. Over
the period 2006-2010, there were 19,063 motorcycle road crash injury claims to the ACC, but
only 34% (n = 6,418) motorcycle injury crashes were reported to police (ACC 2011a,
Ministry of Transport 2011). The NZ data on injury claims is likely a reliable estimate of the
true number of motorcycle road crash injuries in New Zealand, but due to differences in
police reporting systems does not provide a means of estimating numbers in other
jurisdictions. The actual burden of injury from motorcycle crashes in Australia is more
difficult to establish and may be substantially higher than is currently recorded in Australian
jurisdictions (Richardson, 2006).
The burden of injury from motorcycle crashes may have repercussions beyond the short term
of an immediate injury. Motorcyclists have a relatively high risk of impairment and disability
following road crashes compared to other road user groups (Bull 1985, Mayou and Bryant
2003, Coben et al. 2007, Crompton et al. 2009, Hours et al. 2010). Their higher levels of
disability have been attributed to the high frequency of head and limb injuries. Most of the
documented research refers to of the disabling consequence head injuries and the
effectiveness of helmets (Rutledge and Stutts 1993, Peek-Asa and Kraus 1997, Hotz et al.
Chapter 1 – Introduction
5
Improving consumer information about motorcycle protective clothing 2004, Mertz and Weiss 2008, Crompton et al. 2009). However a retrospective study of
motorcyclists in New Zealand, who had received accident compensation payments for
disablement, found that 68% were associated with mechanical impairment of a limb and 80%
had disfiguring impairments due to soft tissue injuries including scarring and muscle wasting
(Clarke and Langley 1995).
THE FREQUENCY AND SEVERITY OF INJURIES
Distributions of injury severity can be described in terms of the Abbreviated Injury Severity
(AIS) scale, which classifies injury severity from 1 (minor) to 6 (maximal or currently
untreatable) (AAAM 2005). The distribution of injury severity for a sample of casualties can
be in terms of the severity of all recorded injuries, or by the single most serious injury
(MAIS) recorded for each individual.
While most motorcycle crash casualties are likely to sustain multiple injuries, a substantial
proportion will not sustain any severe injuries. The MAIDS European in-depth motorcycle
crash study (n = 923) found almost half (48%) of all injuries recorded were relatively minor
(AIS 1), as was the most serious injury (MAIS) suffered by a substantial proportion (38%) of
crashed motorcyclists (ACEM 2004). Similarly, an in-depth study of 1,082 motorcycle
crashes in Thailand reported similar proportions with minor (AIS 1) accounting for 65% of
all recorded injuries and 74% of the single most serious injury sustained by each rider
(Kasantikul 2001b, a). Twenty years earlier in the US, the respective proportions reported in
the Hurt Study were 62% and 53% (Hurt et al. 1981b). Figure 1.2 illustrates the distribution
of severity of all recorded injuries comparing crashes in Europe, Thailand and the US (Hurt et
al. 1981b, Kasantikul 2001b, ACEM 2004). It should be noted that even for those who also
have serious injuries, the reduction or prevention of additional minor injuries may improve
clinical outcomes by reducing blood loss, pain or the risk of infection from wound
contamination (EEVC 1993)
Figure 1.2 Distribution of severity of all recorded injuries (AIS) comparing crashed riders in
US (Hurt et al 1981b), Thailand (Kasantikul, 2001a,b) and Europe (ACEM, 2004).
Hurt, 1981
70%
Kasantikul, 2001
ACEM, 2004
65%
62%
60%
50%
48%
40%
27%
20%
17%
30%
20%
11%
10%
13%
5%
5% 3%
2%
4% 7% 3%
2% 1% 1%
AIS 3
AIS 4
AIS 5
AIS 6
0%
AIS 1
AIS 2
Figure 1.3 illustrates the relative distribution of the most severe injuries (MAIS) sustained by
riders in the US, Thai and European studies (Hurt et al. 1981b, Kasantikul 2001b, ACEM
2004). These figures suggest that if even just those injuries considered minor (AIS 1) could
be reduced or prevented, the proportion of riders with any injuries could be substantially
reduced.
Chapter 1 – Introduction
6
Improving consumer information about motorcycle protective clothing Figure 1.3 Distribution of the most serious injury (MAIS) sustained by each rider in USA
(Hurt et al, 1981b) and Europe (ACEM, 2004).
Hurt, 1981
80%
Kasantikul, 2001
ACEM, 2004
74%
70%
60%
53%
50%
38%
40%
30%
34%
22%
20%
12%
12%
10%
16%
8%
6% 3% 4%
4% 3% 5%
3% 1% 2%
MAIS 3
MAIS 4
MAIS 5
MAIS 6
0%
MAIS ≤1
MAIS 2
The distribution of injury type and severity follow similar patterns across time and in
different countries with heads, upper and lower limbs being most frequently injured in
motorcycle crashes.
Table 1.2 provides the distribution and type of injury as described by Otte, Kalbe and Suren
in 1981. The distribution is broadly consistent with that reported by other investigators over
the intervening years and in different countries (Trinca and Dooley 1979, Harms 1981, Hurt
et al. 1981b, Bachulis et al. 1988, Sosin et al. 1990, Koizumi 1992, Ankarath et al. 2002, Liu
et al. 2008, Crandon et al. 2009, Fitzharris et al. 2009, Lin and Kraus 2009, Forman et al.
2011).
Table 1.2 Distribution of type of injury by body part (n=470, Otte et al 1981).
Head
Neck
Shoulder
Thorax
Whole arm
Upper arm
Elbow
Lower arm
Wrist
Hand
Abdomen
Pelvis
Whole leg
Upper leg
Knee
Lower leg
Ankle
Foot
% of all
22.9
1.8
3.8
6.7
18.8
2.5
2.5
4.6
2
6.8
4
30.1
38.9
7.6
11.3
11.8
4.6
3.3
% of all
48.4
8.7
19
19
56.2
12.9
14.5
21.9
11.8
30.2
13.6
13.1
81.2
33.5
19.7
45.7
23
16.2
Soft tissue
39.6
5.7
12.5
12.3
50.6
10.1
13.4
14.5
9.9
27.3
8.3
11
75.7
25.6
48.1
35.7
20.3
14.9
Fractures
14.4
3.3
9
8.5
17.1
4.2
1.7
8.8
1.7
5.2
1.1
3.3
32.2
12.9
3.1
18.6
4.2
3.5
Internal
29.8
0.4
6.3
6.6
0.6
-
Injuries to the head and chest are the type of injuries most likely to be severe, but these are
not the most common type of injury sustained by motorcyclists. In 1993, Hell and Lob found
that 43% of head injuries were severe (AIS≥2) compared to the proportions of lower
extremities (37%), upper extremities (30%), thorax (25%), abdomen (16%), spine (12%) and
Chapter 1 – Introduction
7
Improving consumer information about motorcycle protective clothing pelvis (8%) (Hell and Lob 1993). These relative proportions are similar to those reported in
other studies, with highest injury risks to the head and lower extremities but head injuries
most likely to result in death or disability (Pedder et al. 1979, Hurt et al. 1981b, Otte 1987,
Sosin et al. 1990, Ankarath et al. 2002, ACEM 2004, Chen 2006, WHO 2009).
The substantial proportion of relatively minor injuries is critical to the estimation of
motorcycle injury costs and protective clothing because the largest cost savings that could be
made from protective clothing are for non-fatal injuries (EEVC 1993). In addition minor
injuries have been estimated to account for 88% of quality adjusted life years lost due to
injury in the first 6 months following a crash and for 91% over the remaining lifetime
(McClure and Douglas 1996).
Table 1.3 shows the distribution of injuries by body location and type of the primary injury
for motorcycle casualty claims in New Zealand in the financial years 2006-2010 (ACC
2011b). The locations of the most common primary injuries were the arms (n = 4321, 23%)
and legs (n = 4874, 26%). Dislocations/ sprains (27%) and fractures (24%), followed by
bruising or contusions (23%), were the most common types of injury.
Table 1.3 Number of claimants by type and location of primary injury, New
Zealand 2006-2010 (ACC 2011b)
Count of Claims
Arms
n (%) 23%
Feet/
ankles
Hands/
wrists
Head/ face Legs
Torso
Other
(unknown)
Total
10%
11%
8%
26%
19%
4%
100%
Bruising
676 (16)
366 (19) 262 (12) 739 (48)
1,343(28)
826 (23)
82 (12)
4,294 (23)
Burns
311 (7)
6
514 (11)
11 (0)
1
1,035 (5)
Open wounds
614 (14)
236 (12) 331 (15) 425 (28)
(0)
161 (7)
31 (2)
Dislocation/sprain 1,318(31) 706 (36) 606 (28) 6
Fractures
(0)
1,361(31) 653 (33) 798 (37) 100 (7)
1,361 (28) 171 (5)
135 (5)
3,273 (17)
799 (16) 1,605(45)
36 (45)
5,076 (27)
818 (17)
720 (20)
34 (20)
4,484 (24)
70 (2)
8
96
126 (4)
372 (4)
805 (4)
3,529
668
19,063
Internal organ injury -
-
-
18 (1)
-
Other injury
41 (1)
1(0)
14(1)
212 (14)
39
Total (100%)
4,321
1,968
2,172
1,531
4,874
Chapter 1 – Introduction
(0)
(1)
(2)
(1)
8
Improving consumer information about motorcycle protective clothing INJURY COSTS
The cost of different types of motorcycle crash related injuries can also be estimated from
claims records from the Accident Compensation Commission (NZ). Cost may be expressed
in terms of dollars or in the number of days off work. Table 1.4 shows the average cost and
Table 1.5 shows the average number of work compensation days paid by location and type
for the primary injury sustained per claimant.
Table 1.4
Average cost of claims by type and location of primary injury, New
Zealand 2006-2010 (ACC 2011b)
Type of injury/
Cost of Claims
Bruising
Arms
Hands/
wrists
$782
Head/
face
$6,414
Legs
Other
Torso
$1,069
Feet/
ankles
$843
$1,049
$2,319
$1,119
Burns
$876
$1,830
$1,236
$930
$493
$0
$360
Open wounds
$948
$3,022
$1,491
$1,566
$1,859
$3,875
$1,033
Dislocation/sprain
$2,538
$1,360
$1,248
$606
$3,281
$5,732
$1,535
Fractures
$6,893
$6,951
$5,557
$13,066 $14,869
$37,224
$13,232
$19,964
$7,726
$15,248
Internal organ injury
Other injury
$4,066
$20,542
$1,267
$4,115
$1,809
$15,819
$2,371
Total
$3,349
$3,329
$2,811
$5,210
$3,908
$12,173
$4,098
Table 1.5
Average number of days work compensation paid by type and location of
primary injury, New Zealand 2006-2010 (ACC 2011b)
Type of injury/
WC Days Paid
(first 12 months)
Bruising
Arms
Feet/
ankles
Hands/
wrists
Head/
face
Legs
Other
Torso
5.5
4.4
4.8
21.9
5.5
17.8
6.1
Burns
3.6
10.2
6.9
3.2
1.8
Open wounds
4.4
19.4
8.2
6.8
10.4
19.0
4.6
Dislocation/sprain
16.7
9.4
8.1
0.0
22.5
32.9
5.4
Fractures
49.7
53.9
39.5
39.1
96.3
101.1
57.7
24.6
45.7
Internal organ injury
93.1
1.0
Other injury
30.2
140.0
7.6
15.6
12.1
19.5
14.7
Total
22.8
24.5
19.2
18.3
24.5
24.1
17.3
Chapter 1 – Introduction
9
Improving consumer information about motorcycle protective clothing INJURY RISK REDUCTION AND MOTORCYCLE PROTECTIVE CLOTHING
For many years motorcycle safety research has been dominated by debate about the
effectiveness of helmets (Lawrence et al. 2002, Liu et al. 2008). There has been less focus on
other protection for the rider’s body, although the protective value of materials such as
leather have been known for at least 30 years (Feldkamp et al. 1977, Zettas et al. 1979,
Aldman et al. 1981, Hurt et al. 1981a, Schuller et al. 1982, Schuller et al. 1986, Otte and
Middelhauve 1987, Hell and Lob 1993). These studies were mostly descriptive and did not
conform to what would now be required of clinical research, but they did provide evidence of
the injury reduction potential of abrasion resistant materials and identify the need for
additional shock absorption over high risk areas. The findings of these studies stimulated
research into the development of more effective products and the development of standards
by which these products could be judged.
The European Standards for motorcycle protective clothing are based on two mechanisms for
protecting the motorcyclist’s body (EEVC 1993). The first requires protection of soft tissues
by material and construction, that is abrasion, cut, tear and burst resistant (CEN 2002). The
second requires the use of body armour or impact protectors (high-density foam shields)
which absorb and distribute the force of direct impacts to exposed areas, e.g. elbows (CEN
1998). There are separate standards for motorcycle protective gloves, boots, one piece suits,
jackets and pants and body armour for the limbs and back (see Appendix A). While only
enforceable in Europe, the standards have provided benchmarks for manufacturers across the
international market (de Rome 2006). The result has been the emergence of a new generation
of protective clothing products, however few manufacturers have submitted their products for
certification under the standards and until recently their performance in real world crashes
had not been examined.
THE MAIDS STUDY (MOTORCYCLE ACCIDENT IN-DEPTH STUDY)
In 2004, the findings of the MAIDS Study in Europe were published (ACEM 2004). This was
an in-depth motorcycle crash case-control study conducted over two years (1999-2000) in
France, Germany, Netherlands, Spain and Italy. The study was conducted by the Association
of European Motorcycle Manufacturers (ACEM) with the support of the European
Commission. Data was collected from 921 crashes including those involving motorcycles and
scooters (57%) and those involving mopeds and mofas (43%). This was the first study to
collect information about injuries and the effectiveness of clothing worn, since the
development of the European Standards for motorcycle protective clothing. To date, only descriptive results from the MAIDS study have been published, with clothing
effectiveness coded only relative to the effect it had on minor injuries (AIS 1). According to
the authors, the decision to consider only AIS 1 injuries was based on the belief that
motorcycle protective clothing has a minimal effect on reducing serious injuries (ACEM
2004). The effectiveness of clothing was coded according to whether there was evidence of
direct contact with surfaces that could cause AIS 1 injury (e.g., roadway) and the presence or
absence of injury in the medical record. Clothing was then classified according to whether it
prevented, reduced or had no effect on the severity of the AIS 1 injuries. The results indicated
that AIS 1 injuries were reduced or prevented on the upper torso (64.6%), lower torso
(61.3%), hands (43.5%) and feet (48.7%) by the clothing worn.
Clothing had also been classified by type of material (unknown, light, medium, heavy or
leather) and whether clothing was motorcycle oriented, but the associations between these
Chapter 1 – Introduction
10
Improving consumer information about motorcycle protective clothing levels of detail and injury prevalence were not reported. Data does not appear to have been
collected on the usage of fitted impact protectors (also called body armour), possibly because
these items were only just appearing in the market following the publication of European
standards for impact protectors (CEN 1998). In addition, the report did not distinguish
between the clothing worn by riders of motorcycles/scooters and that worn by those riding
mopeds/mofas.
THE GEAR STUDY – EFFECTIVENESS OF MOTORCYCLE PROTECTIVE CLOTHING
The Gear Study was a prospective cohort study of motorcyclists who crashed in the
Australian Capital Territory between June 2008 and June 2009 (de Rome et al. 2011a, b).
Eligible motorcyclists included riders and passengers of motorcycles and scooters who were
involved in road crashes causing injury or motorcycle damage. Participants were volunteers
recruited through the two hospitals and thirteen motorcycle repair services in the study area.
Baseline interviews were conducted face-to-face in participants’ homes or in hospital
approximately two weeks after their crash. Follow-up surveys were conducted by mail
approximately two months and six months later with the reference period being ‘over the past
four weeks’. At baseline, information was collected about the crash, clothing worn, injury
details and basic demographics. Injury reports completed at the interview were subsequently
corroborated with hospital records for independent scoring on the AIS scale by a trained
assessor. At the interview, participants also completed questionnaires about their general
health and functional ability prior to the crash. The questionnaires were also included as part
of the follow-up surveys to monitor the longer term consequences of the crash.
Primary analysis – injury risk reductions and protective clothing
The aim of the first stage analysis was to examine the association between use of motorcycle
protective clothing and risk of injury in crashes (de Rome et al. 2011a). This was a crosssectional analytic study of crashed motorcyclists (n=212) representing 71% of identified
eligible cases. The main outcome was hospitalisation and motorcycle crash-related injury.
Poisson regression was used to estimate relative risk (RR) and 95% confidence intervals (CI)
for injury to each body zone by injury type. Tests of association were adjusted for potential
confounders of injury identified from the literature including age, gender, motorcycle type,
crash type (single or multi-vehicle), type of impact (e.g. road surface, other vehicle or fixed
object) and the estimated speed of impact.
The results showed that motorcyclists were 21% less likely to be admitted to hospital if they
crashed while wearing motorcycle jackets, but the risk reduction was greater if they were
wearing motorcycle pants or gloves (51% and 59% respectively). When garments were fitted
with body armour (impact protectors), there was a significantly reduced risk of any injury to
the upper body (23%), hands and wrists (45%), legs (39%), feet and ankles (45%). However
the benefits of body armour could not be detected specifically in relation to fracture injuries.
Given the relatively low occurrence of fractures (15%), compared to soft tissue injuries
(71%), in unprotected motorcyclists (Duffy and Blair 1991) the sample size was likely too
small to be able to detect any such difference. While the findings of this study provide
convincing evidence of the overall protective benefits of body armour, further research is
necessary to establish the specific benefits of body armour for each part of the body in
relation to specific injury types, particularly fractures. Non-motorcycle boots were also
associated with a 53% reduced risk of any injury compared to shoes or joggers.
Chapter 1 – Introduction
11
Improving consumer information about motorcycle protective clothing Table 1.6 shows the estimated injury risk reduction associated with each type of protective
clothing, adjusted to take account of potentially confounding factors (rider age and gender,
motorcycle type, single or multi-vehicle crash, impact speed and type of impact). It is
apparent that the greatest risk reduction is in terms of cuts/abrasions, and to a lesser extent
soft tissue injuries including bruises.
Table 1.6 Relative injury risk reduction (IRR) protected vs. unprotected riders by type of
protective clothing
Any injuries
Cuts/abrasions
Soft tissue
Jacket
NS
- 58%
NS
Jacket +BA
- 23%
- 63%
- 33%
Gloves
NS
- 70%
- 40%
Gloves + BA
- 45%
- 73%
- 62%
Pants
NS
- 37%
NS
Pants + BA
- 39%
- 91%
- 47%
MC Boots
NS
NS
- 65%
MC Boots + BA
- 45%
- 90%
- 69%
Non-MC boots
- 53%
- 76%
- 61%
NS Not statistically significant., BA Body Armour , Adjusted for rider age and gender, motorcycle type, single or multivehicle crash, type of impact and impact speed.
The Gear Study - health outcomes in the six months following a motorcycle crash
The aim of the second stage analysis was to examine the associations between use of
protective clothing and subsequent impairment and disability in the six months following a
crash (de Rome et al. 2011c). Completed follow-up surveys at two and six months were
returned by 69% (n = 146) of eligible motorcyclists.
The exposure factor was usage of protective clothing classified as full protection (motorcycle
jacket and pants), partial protection (motorcycle jacket) and unprotected (neither). Outcomes
of interest included general health status (Short Form SF-36), disability (Health Assessment
Questionnaire) treatment and recovery progress, quality of life and return to work in the six
months post-crash. Odds ratios (OR) were estimated for categorical outcomes using multiple
logistic regression to assess differences in outcomes associated with levels of protection.
Odds ratios were adjusted for potential confounders including age, sex, occupation, speed and
type of impact. Non-parametric procedures were used for data that were not normally
distributed.
The results showed that compared to unprotected riders, both fully and partially protected
riders had fewer days in hospital and reported less pain immediately post-crash. At two
months, both protection groups were also less likely to have disabilities or reductions in
physical function. By six months, there were no significant differences in disability or
physical function between groups, but both protection groups were more likely to be fully
recovered and returned to pre-crash work than unprotected riders. Fully protected riders
achieved better outcomes than either partially or unprotected riders on most measures. There
were few significant differences between the full and partial protection groups, although the
latter showed greater impairment in physical health two months post-crash.
Chapter 1 – Introduction
12
Improving consumer information about motorcycle protective clothing QUALITY AND FAILURE RATES OF MOTORCYCLE CLOTHING PRODUCTS
RIDE MAGAZINE PRODUCT TESTS
The only published evidence-based program of motorcycle clothing product tests is the one
established by Ride Magazine in the United Kingdom (UK), which has published regular
reports since the European Standards tests were first available. A review of the most recently
available product tests (reported in detail in Appendix B), found that a substantial proportion
of garments rated poorly in tests of their protective performance including abrasion, burst and
impact force resistance. While these tests were based on those required by the European
Standards for motorcycle protective clothing, the magazine reports relative or scaled scores
rather than actual test results and in some cases improvised on the specified test
methodology. As a result it is not possible to infer from the published reports whether they
would be predictive of garments’ likely compliance with the European Standards. It was
apparent from the reports that price was not predictive of test performance.
THE GEAR STUDY – PRODUCT QUALITY FINDINGS
The Gear Study was the first in-depth study of the performance of motorcycle clothing in
crashes (de Rome et al. 2011a). Whereas a majority of the protective garments worn
sustained some impact in the crash, not all were damaged and only a proportion of those
damaged were considered to have failed. For the purposes of the study, garments were
assessed to have failed if damage to the protective layer potentially exposed the wearer to
injury. The protective layer is not necessarily the outer shell for example, in the case of
Kevlar lined jeans, the outer denim may be worn away but if the Kevlar lining remains intact
the garment has not failed.
Construction failure was defined as seams splitting or fastenings opening in the protective
layer due to crash impacts. Material failure was defined by holes in the protective layer of the
garment. The failure rate is calculated from the number of garments that failed as a
proportion of those that had sustained an impact.
In all 29.7% of motorcycle designed jackets, 25.7% of pants and 28.1% of gloves were
assessed to have failed in the crash. Table 1.5 lists the type of damage sustained by each type
of garment and the number and proportion of those that sustained an impact and failed to
provide the wearer with adequate protection. Such failure does not necessarily mean the rider
was injured as a result of that exposure.
Chapter 1 – Introduction
13
Improving consumer information about motorcycle protective clothing Table 1.7
Motorcycle clothing worn, impact and injuries sustained and failure recorded
Motorcycle clothing Jacket Pants Gloves Boots Worn (n) Impact sustained All garments damaged Type of damage sustained* Abrasion damage Burst damage Cut penetration Split Torn material Clothing failure* Material failure Construction failure 175 (82.6) 142 (81.1) 115 (65.7) 74 (34.9) 55 (74.3) 42 (56.8) 185 (87.3) 120 (64.9) 101 (54.6) 81 (38.2) 54 (66.7) 56 (69.1) 107 (75.4) 13 (9.2) 0 5 (3.5%) 51 (35.9) 35 (63.6) 1 (1.8) 2 (3.6) 1 (1.8) 22 (40.0) 89 (74.2) 4 (3.3) 1 (0.8) 10 (8.3) 44 (36.7) 51 (94.4) 2 (3.7) 2 (3.7) 3 (5.6) 6 (11.1) 52 (29.7) 18 (10.3) 19 (25.7) 2 (2.7) 52 (28.1) 14 (7.6) 7 (8.6) (6.2) *Percentage damaged and percentage failure, are given as a proportion of those motorcycle designed garments that sustained an impact.
These results are consistent with the findings of the Ride magazine products tests and provide
strong evidence that a substantial proportion of motorcycle garments may fail to provide the
expected level of protection in a crash.
USAGE OF MOTORCYCLE PPE
Relatively few studies have documented the prevalence of usage of protective clothing by
motorcyclists in the population. Most of those studies reporting itemised usage of protective
clothing have been based on samples of crashed riders (Aldman et al. 1981, Hurt et al. 1981a,
Schuller et al. 1982, Danner et al. 1984, ACEM 2004, Phan et al. 2008). The limitation of
such approaches to estimate usage in the rider population is that crashed riders are not
necessarily representative of all riders, and may include a higher proportion with
characteristics associated with higher crash risk, such as youth and risk taking ((Lin and
Kraus 2009). A number of cross-sectional surveys have been conducted to provide estimates
of usage in the wider riding population in Germany, New Zealand and Australia (Marburger
1987, Reeder et al. 1996, Koch and Brendicke 1998, de Rome and Brandon 2007, Wishart et
al. 2009).
Population estimates of protective clothing usage rates are also difficult to obtain because
motorcyclists are a small but highly segmented and diverse community, which makes it
difficult to obtain a representative sample (Johnston et al. 2008, Christmas et al. 2009,
Jamson and Chorlton 2009) (Johnston et al. 2008, Christmas et al. 2009, Jamson and
Chorlton 2009).
Population surveys distributed through licensing authorities are expensive and efforts to
survey samples within the motorcycling population are subject to bias according to the means
by which potential recruits are identified. Volunteers, particularly those contacted through
motorcycle media, networks or events, may be more representative of motorcycling
enthusiasts. Observational surveys may be biased to particular sections of the rider
population, according to the specific route or time or day of week (e.g. recreational or
commuting) and time of year in terms of weather and climatic factors.
There is also evidence that riders usage of protective clothing may vary according to the type
of machine (scooter or motorcycle), type of ride (recreation or commuting), their intended
Chapter 1 – Introduction
14
Improving consumer information about motorcycle protective clothing destination and the weather. This was first documented in 1986 in a survey of riders (n = 557)
attending a motorcycle exhibition in Germany. They were asked about their ownership and
usage of motorcycle clothing when riding in urban environments, country roads and on
motorways (Koch and Brendicke 1998). This study is of interest because it revealed that
riders did not always wear the protective clothing that they owned and that patterns of usage
varied according to riding environment. Discomfort and heat were identified as key
disincentives for always wearing full protective clothing.
Figure 1.4 presents the findings of three Australian cross-sectional surveys of riders’ usage of
protective clothing. The NSW study was a cross-sectional survey (n = 1300) distributed to
riders through motorcycle magazines, clubs and events in New South Wales and the
Australian Capital Territory, Australia. Compared to the general riding population, the
sample was over representative of experienced, older riders and motorcycle club members.
Riders were asked what they normally wore for recreational and commuting rides. Those who
had been involved in a crash (n = 338) were also asked what they had been wearing at the
time (de Rome 2006). The ACT study was an observational study of riders taken on popular
motorcycling recreational routes (n=116) and on key commuter routes (n = 272) in the
Australian Capital Territory in 2007 (Watson et al. 2008). The QLD studies were also
observational studies conducted in Brisbane on recreational (n = 144, 2006) and commuter
routes (n = 262, 2008) (Wishart et al. 2009). In each study, it is apparent that many riders
normally wear a helmet, gloves and motorcycle jackets, but are less likely to wear motorcycle
pants or boots, particularly for commuting. It is also apparent that the NSW riders, who had
been involved in a crash, were less likely to have been wearing protective clothing at the time
of the crash, despite their self reported ‘normal’ usage.
Figure 1.4 Protective clothing reported in cross-sectional surveys of Australian riders 1
Recreation NSW
Commuting NSW
Crash NSW
Commuting ACT
Recreation, QLD
Commuter, QLD
Recreation ACT 120%
100%
80%
60%
40%
20%
0%
Helmet/ eye protection
MC Jacket
MC Gloves
Boots
MC Pants
While none of the above studies can be assumed to provide an accurate picture of what all
riders wear or even the ‘average’ rider wears, some consistencies in the patterns can be
identified. It is apparent from this figure that riders are more likely to protect their upper body
1 Note: in the NSW study, riders who had been wearing a helmet but without eye protection, were not classified as having full protection for the head. Chapter 1 – Introduction
15
Improving consumer information about motorcycle protective clothing than their lower body, to wear more protective clothing for recreational than commuting rides
and that motorcycle pants are the garment least likely to be worn.
A survey of Australian and New Zealand riders (n=1020), conducted for the current project,
confirmed these general trends. It found that riders were more likely to own motorcycle
jackets and gloves than either boots or pants. Ownership did not necessarily imply always
wearing those garments. Motorcycle pants were least likely to be always worn, with only
41% of all respondents always wearing and 58% of all who owned pants, always wearing
them. A higher proportion owned (80%) and always wore (61%) motorcycle boots. Those
that owned jackets and gloves were more likely to report that they always wear them. See
Figure 1.5
Figure 1.5 Proportions of riders who own and who always wear each type of motorcycle
clothing (Australia).
Own
Always wear
Worn if owned
120%
100%
99% 98% 99%
96%
92%
84%
78%
80%
80%
72%
58%
60%
77%
79%
83%
61%
41%
40%
20%
0%
Helmet
MC long sleeved MC protective jacket
pants
MC Boots
MC Gloves
Conclusions
There is evidence that protective clothing can prevent or reduce the severity of injuries in
motorcycle crashes. There is also evidence that not all riders wear full protective clothing and
that not all protective clothing is of sufficient quality to be fit for the protective purpose.
If the proportion of riders benefiting from wearing protective clothing is to be increased, then
both usage rates and clothing quality must be improved. This is because if the quality is poor,
an increase in usage will have no overall benefit and quality failures will deter usage.
References
AAAM, 2005. Abbreviated injury scale 2005,. In: Gennarelli, T.A., Wodzin, E. eds.
Association for the Advancement of Automotive Medicine (AAAM), Barrington, Il, USA.
ABS, 2011. 9309.0 motor vehicle census, Australia, 31 january 2011.
ACC, 2011a. Data extracted on 11 October 2011 from ACC data warehouse tables refreshed
on 8 October 2011. Geoff Ness, Wellington, NZ.
ACC, 2011b. Motorcycle crash injury claims, 2006-2010. Accident Compensation
Commission, Wellington, NZ.
ACEM, 2004. MAIDS in-depth investigation of accidents involving powered two wheelers:
Final report 1.2. Association of European Motorcycle Manufacturers (ACEM)
http://www.maids-study.eu/ Last accessed 11 October 2010, Brussels, pp. 173.
Chapter 1 – Introduction
16
Improving consumer information about motorcycle protective clothing ADB, 2006. Mainstreaming road safety: Technical note. Asian Development Bank–
Association of Southeast Asian Nations, http://www.adb.org/Documents/Books/RoadSafety-Guidelines/, Manila.
AIHW, 2011. Trends in serious injury due to land transport accidents, Australia. Injury
Research and Statistics Series: No. 54. Australian Institute of Health and Welfare,
Canberra.
Aldman, B., Cacciola, I., Gustafsson, H., Nygren, A., Wersall, J., 1981. The protective effect
of different kinds of protective clothing worn by motorcyclists. In: Charpenne, J.P.C.A.
ed. Proceedings of the 6th International Conference of the Research Council on the
Biomechanics of Impact. IRCOBI, Salon-de-Provence (France), pp. 1-9.
Alsop, J., Langley, J., 2001. Under-reporting of motor vehicle traffic crash victims in New
Zealand. Accident Analysis and Prevention 33 (3), 353-9.
Amoros, E., Martin, J.-L., Laumon, B., 2006. Under-reporting of road crash casualties in
France. Accident Analysis and Prevention 38 (4), 627-635.
Ankarath, S., Giannoudis, P.V., Barlow, I., Bellamy, M.C., Matthews, S.J., Smith, R.M.,
2002. Injury patterns associated with mortality following motorcycle crashes. Injury 33
(6), 473-7.
Bachulis, B.L., Sangster, W., Gorrell, G.W., Long, W.B., 1988. Patterns of injury in helmeted
and nonhelmeted motorcyclists. American Journal of Surgery 155 (5), 708-711.
Barros, A.J., Amaral, R.L., Oliveira, M.S., Lima, S.C., Goncalves, E.V., 2003. Traffic
accidents resulting in injuries: Under reporting, characteristics and case fatality rate.
Cadernos Saude Publica 19 (4), 979-86.
Bellati, A., Cossalter, V., Lot, R., Ambrogi, A., 2006. Preliminary investigation on the
dynamics of motorcycle fall behavior: Influence of a simple airbag jacket system on rider
safety. Proceedings of the International Conference for Motorcycle Safety. Institute fur
Zweiradsicherheit, Cologne.
Bull, J.P., 1985. Disabilities caused by road traffic accidents and their relation to severity
scores. Accident Analysis and Prevention 17 (5), 387-397.
CEN, 1998. Motorcyclists' protective clothing against mechanical impact: Requirements and
test methods for impact protectors. EN 1621-1:1998. European Committee for
Standardisation, Brussels.
CEN, 2002. Protective clothing for professional motorcycle riders: Jackets, trousers and one
piece or divided suits - general requirements. EN 13595-1:2002. European Committee for
Standardisation, Brussels.
Cercarelli, L.R., Rosman, D.L., Ryan, G.A., 1996. Comparison of accident and emergency
with police road injury data. Journal of Trauma - Injury, Infection and Critical Care 40,
805-809.
Chen, H.B., 2006. Injury patterns and risk factors of motorcycle crashes. Chinese Journal of
Clinical Rehabilitation 10 (40), 187-190.
Christmas, S., Young, D., Cookson, R., Cuerdenm, R., 2009. Passion, performance,
practicality: Motorcyclists' motivations and attitudes to safety. Motorcycle safety research
project, PPR 442. Transport Research Laboratory, Wokingham, Berkshire UK.
Clarke, J.A., Langley, J.D., 1995. Disablement resulting from motorcycle crashes. Disability
and Rehabilitation 17 (7), 377-85.
Coben, J.H., Steiner, C.A., Miller, T.R., 2007. Characteristics of motorcycle-related
hospitalizations: Comparing states with different helmet laws. Accident Analysis and
Prevention 39 (1), 190-6.
Craig, G.R., Sleet, R. & Wood, S.R. , 1983. Lower limb injuries in motorcycle accidents.
Injury 15, 163-166.
Crandon, I.W., Harding, H.E., Cawich, S.O., McDonald, A.H., Fearron-Boothe, D., 2009.
Motorcycle accident injury profiles in Jamaica: An audit from the University Hospital of
Chapter 1 – Introduction
17
Improving consumer information about motorcycle protective clothing the West Indies. International Journal of Injury Control and Safety Promotion 16 (3), 175178.
Crompton, J.G., Tolulope, O., Stevens, K.A., Efron, D.T., Haut, E.R., Haider, A.H., 2009.
Motorcycle helmets save lives, but not limbs: A national trauma data bank analysis of
functional outcomes after motorcycle crash. Journal of Surgical Research 151 (2), 1-5.
Danner, M., Langwieder, K., Polauke, J., Sporner, A., 1984. Protective clothing for riders.
Buro fur KFZ- Technik, Federal Highway Research Institute, Bergisch Gladbach.
de Rome, L., 2006. The injury reduction benefits of motorcycle protective clothing.
http://www.ntsb.gov/events/symp_motorcycle_safety/symp_motorcycle_safety.htm, NTSB Public
Forum on Motorcycle Safety. National Transport Safety Board, September 12-13 2006,
Washington DC
de Rome, L., Brandon, T., 2007. Survey of motorcyclists in NSW, 2006 Motorcycle Council
of NSW, Inc. www.roadsafety.mccofnsw.org.au. Last accessed 5 October 2010., Sydney.
de Rome, L., Ivers, R., Fitzharris, M., Du, W., Richardson, D., Haworth, N., Heritier, S.,
2011a. Motorcycle protective clothing: Protection from injury or just the weather?
Accident Analysis and Prevention 43 (6), 1893-1900.
de Rome, L., Ivers, R., Haworth, N., Heritier, S., Du, W., Fitzharris, M., 2011b. Novice riders
and the predictors of riding without motorcycle protective clothing. Accident Analysis and
Prevention 43 (3), 1095-1103.
de Rome, L., Ivers, R.Q., Fitzharris, M., Haworth, N., Heritier, S., Richardson, D., 2011c.
Effectiveness of motorcycle protective clothing: Riders' health outcomes in the six months
following a crash. doi: 10.1016/j.lnjury.2011.10.025.
de Rome, L., Stanford, G., Wood, B., 2004. Survey of motorcyclists and their safety
initiatives. Australasian Road Safety Research, Policing and Education Conference,
http://trid.trb.org/view.aspx?id=771117. Perth, Australia.
Dragčević, Z., Takeuchi, K., Vecaj, D., Hursa, A., 2009a. Motorcycle jacket with integrated
air bag. Tekstil 58 (7), 346-351.
Dragčević, Z., Takeuchi, K., Večaj, D., Hursa, A., 2009b. Motorcycle jacket with integrated
air bag. Motorradjacke mit eingebautem airbag 58 (7), 346-351.
Duffy, E.M., Blair, A., 1991. Motorcycle accidents: The leg injury problem in perspective.
Proceedings of the International Conference of the Research Council on the Biomechanics
of Impact. IRCOBI Berlin, pp. 231-246.
EEVC, 1993. Report on motorcycle Safety. An EEVC Paper, Report of the Ad-hoc Group on
Motorcycle Safety, 1993. European Experimental Vehicles Committee Brussels, pp. 75.
ETSC, 2008. Vulnerable riders: Safety implications of motorcycling in the European union.
European Transport Safety Council, Brussels.
Feldkamp, G., Prall, W.D., Buehler, G., Junghanns, K., 1977. Motocycle accidents;
epidemiology, clinical aspects and protective measures, a followup and prospective study.
Unfallheilkunde 80 (1), 1-19.
Fitzharris, M., Dandona, R., Kumar, G.A., Dandona, L., 2009. Crash characteristics and
patterns of injury among hospitalized motorised two-wheeled vehicle users in urban India.
BMC Public Health 9.
Forman, J.L., Lopez-Valdes, F.J., Pollack, K., Heredero-Ordoyo, R., Molinero, A., Mansilla,
A., Fildes, B., Segui-Gomez, M., 2011. Injuries among powered two-wheeler users in
eight European countries: A descriptive analysis of hospital discharge data. Accident
Analysis and Prevention In Press, Corrected Proof. Available online 15 March 2011.
Harms, P.L., 1981. Injury patterns of motorcyclists involved in accidents. Supplementary
Report No 651. Transport and Road Research Laboratory, Crowthorne, Berkshire.
Harris, S., 1990. The real number of road traffic accident casualties in the Netherlands: A
year-long survey. Accident Analysis and Prevention 22 (4), 371-8.
Chapter 1 – Introduction
18
Improving consumer information about motorcycle protective clothing Hell, W., Lob, G., 1993. Typical injury patterns of motorcyclists in different crash typeseffectiveness & improvement of countermeasures. Proceedings of the 37th Annual
Conference of the American Association for the Advancement of Automotive Medicine.
AAAM, San Antonio, pp. 77-86.
Hotz, G., Cohn, S., Mishkin, D., Castelblanco, A., Li, P., Popkin, C., Duncan, R., 2004.
Outcome of motorcycle riders at one year post-injury. Traffic Injury Prevention 5 (1), 879.
Hours, M., Bernard, M., Charnay, P., Chossegros, L., Javouhey, E., Fort, E., Boisson, D.,
Sancho, P.O., Laumon, B., 2010. Functional outcome after road-crash injury: Description
of the ESPARR victims cohort and 6-month follow-up results. Accident Analysis and
Prevention 42 (2), 412-421.
Hurt, H.H., Ouellet, J., Wagar, I., 1981a. Effectiveness of motorcycle safety helmets and
protective clothing. Proceedings of the 25th Annual Conference of the American
Association for the Advancement of Automotive Medicine. AAAM, San Francisco, pp.
223- 235.
Hurt, H.H., Ouellet, J.V., Thom, D.R., 1981b. Motorcycle accident cause factors and
identification of countermeasures. In: University of Southern California Traffic Safety
Center ed. Technical Report. National Highway Traffic Safety Administration,
Washington, DC.
Ijima, S., Ozono, S., Ota, A., Yamamoto, T., 1998. Exploration of an airbag concept for a
large touring motorcycle. Proceedings of the 16th International Conference on the
Enhanced Safety of Vehicles. NHTSA, Canada.
James, P.Z., 2002. The hidden hazard of protective apparel. Occupational Health and Safety
71 (1), 55.
Jamson, S., Chorlton, K., 2009. The changing nature of motorcycling: Patterns of use and
rider characteristics. Transportation Research Part F: Traffic Psychology and Behaviour 12
(4), 335-346.
Johnston, P., Brooks, C., Savage, H., 2008. Fatal and serious road crashes involving
motorcyclists. Monograph 20 Department of Infrastructure,
http://www.infrastructure.gov.au/roads/safety/publications/2008/mono20.aspx Canberra,
pp. 26.
Kasantikul, V., 2001a. Motorcycle accident causation and identification of countermeasures
in Thailand, Volume 2: Up country Study. Chulalongkorn University, Bangkok, Thailand
10330.
Kasantikul, V., 2001b. Motorcycle accident causation and identification of countermeasures
in Thailand. Volume 1. Bangkok Study. Chulalongkorn University, Bangkok, Thailand
10330.
Koch, H., Brendicke, R., 1998. Protective clothing: Wearing patterns, knowledge and
attitudes of motorcyclists. In: Rothengatter, T., De Bruin, R. eds. Road user behaviour:
Theory and research. Van Gorcum & Company Assen, Netherlands.
Koizumi, M.S., 1992. Injury patterns in motorcycle accident victims. Rev Saude Publica 26
(5), 306-15.
Lawrence, B.A., Max, W., Miller, T.R., 2002. Costs of injuries resulting from motorcycle
crashes: A literature review. National Highway Traffic Safety Administration,
Washington DC,
http://www.nhtsa.dot.gov/PEOPLE/INJURY/pedbimot/motorcycle/Motorcycle_HTML/to
c.html (accessed June 11, 2010).
Lin, M.R., Hwang, H.F., Kuo, N.W., 2001. Crash severity, injury patterns, and helmet use in
adolescent motorcycle riders. Journal of Trauma - Injury, Infection and Critical Care 50
(1), 24-30.
Chapter 1 – Introduction
19
Improving consumer information about motorcycle protective clothing Lin, M.R., Kraus, J.F., 2008. Methodological issues in motorcycle injury epidemiology.
Accident Analysis and Prevention 40 (5), 1653-1660.
Lin, M.R., Kraus, J.F., 2009. A review of risk factors and patterns of motorcycle injuries.
Accident Analysis and Prevention 41 (4), 710-722.
Liu, B., Ivers, R., Norton, R., Boufous, S., Blows, S., Lo, S., 2008. Helmets for preventing
injury in motorcycle riders (review update). Cockrane Database of Systematic Reviews
Issue 1, pp. 37.
Lopez, D.G., Rosman, D.L., Jelinek, G.A., Wilkes, G.J., Sprivulis, P.C., 2000.
Complementing police road-crash records with trauma registry data -- an initial
evaluation. Accident Analysis and Prevention 32 (6), 771-777.
Mackay, M., 1986. Lower limb injuries to riders of motorcycles. Proceedings of the
Biomechanics and Medical Aspects of Lower Limb Injuries Conference. Society of
Automotive Engineers, Warrendale, PA USA, San Diego California, pp. 129-135.
Manzardo, D., 2006. Report on the performance of riders protective devices and the
corresponding injuries of riders. State-of-the-art regarding motorcyclists helmets and
clothing. Future research guidelines. APROSYS SP44 Integrated Project on Advanced
Protection Systems, http://www.aprosys.com/ , Last accessed 20 August 2010 ed.
Marburger, E.A., 1987. The protective clothing used by motorized two-wheelers in the
Federal Republic of Germany. Passive safety for motorcyclists: Contributions to second
Bochum workshops for two-wheel safety. Institute for Motorcycle Safety, Bochum,
Germany.
Mayou, R., Bryant, B., 2003. Consequences of road traffic accidents for different types of
road user. Injury 34 (3), 197-202.
McClure, R.J., Douglas, R.M., 1996. The public health impact of minor injury. Accident
Analysis and Prevention 28 (4), 443-451.
Melhuish, M., 2002. Technical report on road Safety in the Association of Southeast Asian
Nations. TAR: STU 36046. ADB. Asian Development Bank, Manila, Philippines.
Mertz, K., Weiss, H., 2008. Changes in motorcycle-related head injury deaths,
hospitalisations, and hospital charges following repeal of Pennsylvania's mandatory
motorcycle helmet law. American Journal of Public Health 98 (8), 1464-1467.
Meuleners, L.B., Lee, A.H., Haworth, C., 2007. Road environment, crash type and
hospitalisation of bicyclists and motorcyclists presented to emergency departments in
Western Australia. Accident Analysis and Prevention 39 (6), 1222-1225.
Ministry of Transport, 2011. Motor vehicle crashes in New Zealand 2010. Statistical
Statement Calendar year 2010. Ministry of Transport, Wellington, NZ.
Nordentoft, E.L., Larsen, C.F., Behrensdorff, I., 1984. The problem of leg injuries in
motorcycle riders. In: Cesari, D., Charpenne, A. eds. Proceedings of the International
Conference of the Research Council on the Biomechanics of Impact. IRCOBI, Delft, pp.
229-241.
NZTA, 2011. New Zealand motor vehicle registration statistics 2010. NZ Transport Agency,
Palmerston North.
Otte, D., 1987. Kinematics of motorized bicycle accidents--injury patterns, long-term
sequelae and protective possibilities. Z Unfallchir Versicherungsmed Berufskr 80 (1), 3746.
Otte, D., Middelhauve, V., 1987. Quantification of protective effects of special synthetic
protectors in clothing for motorcyclists. In: Cesari, D., Charpenne, A. eds. Proceedings of
the International Conference of the Research Council on the Biomechanics of Impact.
IRCOBI, Birmingham, UK, pp. 1-18.
Otte, D., Schroeder, G., Richter, M., 2002. Possibilities for load reductions using garment leg
protectors for motorcyclists -- a technical, medical and biomechanical approach.
Chapter 1 – Introduction
20
Improving consumer information about motorcycle protective clothing Proceedings of the 46th Annual Conference of the American Association for the
Advancement of Automotive Medicine. AAAM, pp. 367-385.
Ouellet, J.V., Hurt, H.H., Thom, D., 1987. Collision performance of contemporary crash bars
and motorcycle rider leg injuries. Accident reconstructions: Automobiles, tractors, semitrailers, motorcycles and pedestrians The Engineering Society for Advancing Mobility
Land Sea Air and Space (SAE), Warrendale, PA 15096, pp. 2829 - 2842.
Pedder, J.B., Hagues, S.B., Mackay, G.M., 1979. A study'of 93 fatal two-wheeled motor
vehicle accidents. Proceedings of the 4th International Conference of the International
Research Council of the Biomechanics of Impact. IRCOBI, Goteborg, Sweden.
Peek-Asa, C., Kraus, J.F., 1997. Estimates of injury impairment after acute traumatic injury
in motorcycle crashes before and after passage of a mandatory helmet use law. Annals of
Emergency Medicine 29 (5), 630-636.
Phan, V., Moutreuil, M., Martin, A., Feurxer, J.-C., Hermitte, T., 2008. Rider: A complete
study on accidents involving a powered two-wheeler: Accident causation, safety
equipment and injury mechanisms. CEESAR - Centre Europeen d' Etudes de Securite et d'
Analyse des Risques. (European Centre of Studies on Safety and Risk Analysis).
Reeder, A.I., Chalmers, D.J., Langley, J.D., 1996. The risky and protective motorcycling
opinions and behaviours of young on-road motorcyclists in New Zealand. Social Science
and Medicine 42 (9), 1297-1311.
Richardson, D.B., Paini, C., 2006. Amalgamation of police and hospital trauma data in the
Australian Capital Territory 2002-2003. Road Safety Research, Education and Policing
Conference, www.rsconference.com. Southport, Queensland.
Rogers, N., 2008. Trends in motorcycle fleets worldwide. International Workshop on
motorcycling safety,
http://www.internationaltransportforum.org/jtrc/safety/Lillehammer2008/lillehammer08.ht
ml. OECD, Lillehammer, Norway.
Rutledge, R., Stutts, J., 1993. The association of helmet use with the outcome of motorcycle
crash injury when controlling for crash/injury severity. Accident Analysis and Prevention
25 (3), 347-353.
Schuller, E., Beier, G., Spann, W., 1982. Effectiveness of protective clothing in Munich area
motorcycle accidents. Proceedings of the 26th Stapp car crash conference. Warrendale,
PA, Ann Arbor, pp. 259-267.
Schuller, E., Beir, G., Spann, W., 1986. Disability and impairment of protected and
unprotected motorcycle riders. SAE International Congress and Exposition - Crash Injury
Impairment and Disability: Long Term Effects, Detroit, MI. The Engineering Society for
Advancing Mobility Land Sea Air and Space (SAE), Warrendale, PA 15096, pp. 51-56.
Sosin, D.M., Sacks, J.J., Holmgreen, P., 1990. Head injury--associated deaths from
motorcycle crashes: Relationship to helmet-use laws. JAMA: Journal of the American
Medical Association 264 (18), 2395-2399.
Sporner, A., Langwieder, K., Polauke, J., 1990. Passive safety for motorcyclists. From the leg
protector to the airbag. SAE Technical Paper Series.
Thollon, L., Godio, Y., Bidal, S., Brunet, C., 2010. Evaluation of a new security system to
reduce thoracic injuries in case of motorcycle accidents. International Journal of
Crashworthiness 15 (2), 191-199.
Trinca, G.W., Dooley, B.J., 1979. The pattern of motor cycle injuries sustained by motor
cyclists in Victoria in 1974 and 1975. Australian and New Zealand Journal of Surgery 49
(2), 203-207.
Watson, B., Wishart, D., Christie, T., 2008. Canberra motorcycle apparel observation Study.
NRMA_ACT Road Safety Trust,
http://www.roadsafetytrust.org.au/c/rtt?a=da&did=1004593. Last accessed 5 October
2010, Canberra.
Chapter 1 – Introduction
21
Improving consumer information about motorcycle protective clothing WHO, 2009. Global status report on road safety: Time for action World Health Organization,
www.who.int/violence_injury_prevention/road_safety_status/2009, Geneva, pp. 301.
Wilson, S.J., Begg, D.J., Samaranayaka, A., 2011. Validity of using linked hospital and
police traffic crash records to analyse motorcycle injury crash characteristics. Accident
Analysis and Prevention In Press, Corrected Proof. Available online 3 April 2011.
Wishart, D., Watson, B., Rowden, P., 2009. Motorcycle rider protective apparel wearing:
Observational study results from the Brisbane and Canberra regions. Journal of the
Australasian College of Road Safety 20 (4), 52-59.
Zettas, J., Zettas, P., Thanasophon, B., 1979. Injury patterns in motorcycle accidents. Journal
of Trauma - Injury, Infection & Critical Care 19 (11), 833-6.
Chapter 1 – Introduction
22
CHAPTER 2 - PRODUCT TESTS AND RATING
SCHEMES FOR MOTORCYCLE PROTECTIVE
CLOTHING
A key task of the project was to identify and critically assess existing motorcycle
protective clothing rating and/or testing regimes both nationally and internationally. The
objective was to identify the relative merits of each approach in terms of efficiency, costeffectiveness, as well as their reliability and validity in estimating the injury protection
performance of motorcycle clothing under crash conditions. A framework for criteria was
established to provide structure to the process. Table 2.1 presents the framework with the
range of performance areas included in the tests/ratings systems and the types of
information provided.
Table 2.1 Framework for assessing motorcycle protective clothing rating/ testing regimes
Performance area A. Safety performance
B. User Performance C. User education ‐ dissemination of results
D. History E. Price F. Availability/ selections G. Rating scheme H. Degree of obligation
I. Jurisdiction Information provided Personal Protective Equipment (PPE) type Body region
Type of injury
Test method
Does this replicate real world injury? Comfort
Weight
Fit
Waterproofing
Heat
Heat/cold
Ease of use
Noise
Explanation of assessment.
Explanation of results.
Transparency of results.
Level of results available to user. Advice given on important things to look for when purchasing? Previous results remain available? How often is the review done?
History or recalls/problems available? Is price assessed?
Easily accessible to users?
Range of models tested? Popular models chosen?
How are they rated? Eg score, pass/fail, star rating etc. Voluntary/ mandatory
International/ national/ sub‐national This framework provided a structured approach to the assessment of each test regime
including the appropriateness of the test component, the stringency of conformity
assessment procedures, the performance rating approach and the effectiveness of getting
the results to the public in an understandable form. See Appendix C for a table of
information about the test regimes considered for this report.
Chapter 2– Product tests and rating schemes for motorcycle protective clothing
21
Improving consumer information about motorcycle protective clothing CURRENTLY EXISTING MOTORCYCLE CLOTHING EVALUATION REGIMES
A limited number of motorcycle protective equipment testing /regimes were identified and
their features documented in the evaluation framework. See Appendix C.
The most comprehensive testing scheme is that provided under the European Standards by
the European standards agency, Comité Européen de Normalisation (CEN). These
Standards are also published as national standards such as the British standard, French
standards etc.
The European Standards tests form the basis for consumer product rating programs
conducted by the British motorcycling magazine Ride and, to a lesser extent, the German
magazine Motorrad. These publications also include other tests relating to comfort and
utility such as evaluation of waterproofing and insulation that are not included in the
European Standards.
Other test/ratings regimes identified include regulations adopted by sporting bodies for
motorcycle racing but are less comprehensive than the European Standards. These other
evaluation regimes include the Motorcycle Federation of Japan Standard2 and the United
States’ SFI Foundation3 Specification 40.1 “Abrasion resistant rider/driver suits” technical
specification published in November 1993 (last reviewed December 2008). The SFI 40.1
specification pre-dates the European Standards by publication date and is reviewed more
frequently (usually bi-annually compared with every five years for European Standards);
however, its assessment regime is restricted to just two tests of materials: abrasion
resistance and tear strength.
A number of options for test procedures that may serve to assess thermal, water
penetration and other comfort features were also identified.
THE EUROPEAN STANDARDS FOR MOTORCYCLE PROTECTIVE CLOTHING
BACKGROUND RESEARCH AND THE EVIDENCE BASE FOR THE EUROPEAN STANDARDS
In the 1980s, Roderick Woods from Cambridge University (UK), conducted a series of
studies into the required properties of motorcycle protective clothing (Woods 1982, Woods
1983, Prime and Wood 1984, Woods 1986, Woods 1996b). This research involved the
analysis of crash damaged motorcycle suits and plotting the distribution of road contact
abrasion marks and type of damage including fabric, seam and fastening failure to define
the injury protection requirements for each part of the riders (Woods 1996a). The resulting
specifications were subsequently validated on a dummy in simulated crash incidents
(Woods 1996b). Figure 2.2 illustrates the four types of injury protection identified. Zone 1
requires impact and high abrasion resistance. Zone 2 requires high abrasion and materials
stress resistance. Zone 3 requires moderate abrasion resistance and Zone 4 requires low
abrasion resistance.
2 We have been unable to obtain an English language version of the Japanese standard. 3 The US SFI Foundation, Inc. (SFI) is a non‐profit organization established to issue and administer standards for specialty/performance automotive and racing equipment. Chapter 2 – Product tests and rating schemes for motorcycle protective clothing
22
Improving consumer information about motorcycle protective clothing Table 2.2 Motorcycle crash injury risk zones (Woods 1996a)
Zone 1. High risk - needs impact
protectors & high abrasion resistance (4.0
– 7.0seconds)
Zone 2. High risk - needs high
abrasion resistance (4.0 - 7.0 seconds)
Zone 3. Moderate risk - moderate
abrasion resistance (1.8 - 2.5 seconds)
Zone 4. Relatively low risk (1.0 - 1.5
seconds)
Woods also specified the required construction and burst strength of seams and linings,
placement, protection and strength of zip fasteners and other garment restraints and
fasteners for each body zone (Woods 1994). The results were published as the Cambridge
Standard for Motorcycle Rider’s Clothing (Woods 1999) and subsequently incorporated
into a British Standards Institute submission to the European Standards agency CEN
(Comité Européen de Normalisation).
At approximately the same time, a group of researchers from the Accident Research Unit
at the Medical University at Hannover (ARU-MUH) in Germany investigated the concept
of shock absorbing foam, initially developed in Sweden (Aldman et al. 1981, Nygren
1987). This group led by Dietmar Otte created impact protectors consisting of a hard
plastic outer shell with shock absorbing foam lining (Otte and Middelhauve 1987, Otte et
al. 2002). The outer shell distributed the force from a single point of impact to a wider
area, while the foam absorbed the force of the impact. The protectors were designed in
hinged segments to fit over vulnerable areas within existing garments. Areas selected for
coverage were those identified from injury patterns to have the highest frequency of soft
tissue and fracture injuries.
Laboratory tests reported up to 69% reduction in the level of force transmitted by a 35 kN
impact compared to leather clothing alone. (Note: A kiloNewton (kN) is equal to 1,000
Newtons, where a Newton is the unit of force required to accelerate a mass of 1 kilogram
at a rate of one metre per second.) A subsequent laboratory study comparing impact tests
on protected and unprotected human cadaver lower legs, found no soft tissue injuries and
50% fewer and less severe fracture injuries for protected compared to unprotected feet and
ankles. The researchers did not report significance tests for these findings (Otte et al.
2002). They concluded that impact protectors reduce the incidence of complex leg
fractures and high boots reduced the risk of ankle and foot injuries including fractures.
THE DEVELOPMENT OF THE EUROPEAN STANDARDS FOR MOTORCYCLE PROTECTIVE
CLOTHING
In 1989, the European Commission (EU) issued a general directive 89/686/EEC, under
which any personal protective equipment (PPE), that is clothing or equipment intended to
Chapter 2 – Product tests and rating schemes for motorcycle protective clothing
23
Improving consumer information about motorcycle protective clothing provide protection from injury, had to be tested and labelled as complying with a relevant
standard (CEC 1989).
At the time there were no standards for motorcycle protective clothing, but the Auto Cycle
Union (ACU), the governing body for motorcycle sport in the United Kingdom, were
concerned about the clothing worn by competitors in motorcycle racing. The ACU were
concerned about lack of quality control and evidence from a number of incidents in which
protective suits failed on the race track, resulting in a leading brand being banned from
race tracks (Varnsverry 2003). During the late 1980s, the ACU worked with industry and
medical experts to develop a specification for race suits, but this was not introduced due to
concerns of legal liability. Consequently, one of the medical experts involved in the work
approached the European Commission to apply for motorcycle clothing to be covered
under the directive. This application was successful, thus providing a mechanism for the
development of standards for motorcycle protective clothing
The resulting Standards employ two mechanisms for the protective function. The first
involves protection of soft tissues by materials, fastenings and construction that is
abrasion, cut, tear and burst resistant (CEN 2002). The second requires the use of body
armour (impact protectors ) which are high-density foam shields fitted over exposed areas
(e.g. elbows, knees) to absorb and distribute the force of direct impacts (CEN 1998, Otte et
al. 2002, CEN 2003).
Separate Standards and test specifications, each with a different number, were developed
for each type of clothing (jackets and pants, gloves, boots, impact protectors and back
protectors. Garments and protectors which satisfy the performance requirements of the EU
Standards will offer protection from abrasions, cuts, contusions, bruising and some
fractures. It is acknowledged that clothing cannot, however, mitigate against more serious
injuries such as major fractures which can occur when severe impacts, torsional or bending
forces are involved, or neurological spinal injuries.
Effectively the Standards assess key characteristics of materials and constructions used in
the manufacture of motorcyclists’ protective clothing, including:





Impact abrasion resistance
Impact cut resistance
Determination of bursting strength
Tensile strength
Impact energy attenuation
The Standards also evaluate the innocuousness of the materials used in the garments, to
ensure exposure to these does not constitute a hazard to the health of the wearer. Basic
ergonomic assessments replicate a series of movements commonly used when riding a
motorcycle, to provide an indication of comfort and fitness for purpose. They do not
consider issues of heat, cold or cost. The footwear Standard (EN 13634) is the only
document to consider waterproofing and only then as an optional test.
INTER-PRODUCT COMPATIBILITY
Compatibility between motorcycle clothing products – particularly the interface between
footwear and the lower legs of trousers or a suit, the wrists of gloves and those of a jacket
or suit, the waistbands of jackets and trousers and the lower edge of a helmet and the
shoulder area of a jacket or suit – is an area not currently covered under the EU Standards.
There are precedents with other standards (e.g. the British Standards Institution standards
Chapter 2 – Product tests and rating schemes for motorcycle protective clothing
24
Improving consumer information about motorcycle protective clothing for police riot equipment) which require ergonomic assessments to be performed with
other items of PPE which will ordinarily be worn in conjunction. These factors should be
considered for inclusion in any ratings protocol devised for motorcycle protective clothing.
Table 2.3 The European Standards for motorcycles protective clothing
EN 1621‐1:1997 “Motorcyclists' protective clothing against mechanical impact – Part 1: Requirements and test methods for impact protectors EN 13594:2002 “Protective gloves for professional motorcycle riders –Requirements and test methods” EN 13595‐1:2002 “Protective clothing for professional motorcycle riders – Jackets, trousers and one‐piece or divided suits – Part 1 – General requirements” EN 13595‐2:2002 “Protective clothing for professional motorcycle riders – Jackets, trousers and one‐piece or divided suits – Part 2 – Test method for determination of impact abrasion resistance” EN 13595‐3:2002 “Protective clothing for professional motorcycle riders – Jackets, trousers and one‐piece or divided suits – Part 3 – Test method for determination of burst strength” EN 13595‐4:2002 “Protective clothing for professional motorcycle riders – Jackets, trousers and one‐piece or divided suits – Part 4 – Test method for determination of impact cut resistance” EN 13634:2002 “Protective footwear for professional motorcycle riders – Requirements and test methods” EN 1621‐2:2003 “Motorcyclists’ protective clothing against mechanical impact – Part 2: Motorcyclists’ back protectors – Requirements and test methods” EN 14021:2003 “Stone shields for off‐road motorcycling suited to protect riders against stones and debris – Requirements and test methods” At the time of writing, two further Standards for impact protection are being drafted:
1.
2.
prEN 1621-3 Motorcyclists’ protective clothing against mechanical impact – Part 4: Chest
protectors – Requirements and test methods
prEN 1621-4 Motorcyclists’ protective clothing against mechanical impact – Part 4: Inflatable body
protectors – Requirements and test methods.
COMPLIANCE WITH THE EUROPEAN STANDARDS
Under the European Directive on Personal Protective Equipment (1989) any clothing
claiming to provide protection from injury must be tested and labelled as complying with
the relevant Standard. This applies to all safety equipment not just for motorcycle apparel.
Under the directive, a product can only be described as “protective” if it provides
protection from injury, the term cannot be applied to products that provide protection from
the weather.
This means that compliance with the European Standards is not mandatory. A product
only falls within the scope of the European Union’s Personal Protective Equipment
Directive 89/686/EEC; if a manufacturer, or their agent in the European Community,
claims or specifically implies in the literature or advertising that a product is intended to
offer protection from injury. Compliance with a European Standard carries a presumption
of conformity with this legislation. Motorcyclists’ clothing is classified as ‘Category 2’ or
‘Intermediate Design’ Personal Protective Equipment (PPE) which is required to be tested
Chapter 2 – Product tests and rating schemes for motorcycle protective clothing
25
Improving consumer information about motorcycle protective clothing by an independent, accredited test facility and certified by a government approved Notified
Body.
INDUSTRY SUPPORT AND COMPLIANCE
As motorcycle clothing can be represented as serving a number of different functions
including weather protection, manufacturers can circumvent the need for compliance by
avoiding any reference to safety or protection in product descriptions. As a result, ten years
since the first Standards were issued, there are still relatively few CE marked motorcycle
clothing products available in the European market.
However, despite the lack of CE marked products, it is apparent that the Standards have
provided benchmarks for manufacturers across the international market (de Rome 2006).
The result has been the emergence of a new generation of protective clothing products,
although their performance in real world crashes has rarely been examined (de Rome et al.
2011a).
REGULATION OF PROTECTIVE CLOTHING IN MOTORCYCLE SPORTS
Clothing worn in motorcycle sports is regulated by the relevant sports association. The
international body, Federation Internationale de Motocyclisme (FIM), has standing
technical regulations for clothing which are commonly adopted by national sporting bodies
(e.g. in the UK, the Auto Cycle Union). European, Japanese and American helmet
standards are quoted as normative references, but there is no reference to the European
Standards for clothing, boots or gloves. Discretion on whether these garments meet the
regulations rests with the Chief Scrutineer at an event, although no specialist knowledge of
motorcycle clothing is required for the position.
In Australia, the governing body of motorcycle sport is Motorcycling Australia (MA).
Regulations are contained in the Manual of Motorcycle Sport which covers General
Competition Rules and other relevant information including the protective clothing
required. The MA regulations for road racing require full-face helmets which are approved
under the Australian helmet standard and the FIM technical rules for road racing. The MA
Regulations also require riders to wear back protectors and have full body coverage with
leather or other material of high durability, however as with FIM, there is no guidance to
scrutineers in identifying clothing, boots or gloves that may not provide adequate
protection.
Despite the lack of attention from motorcycling sports, the International governing body
for kart racing (CIK) does reference the European standard for motorcycle jackets and
pants (EN 13595-2) test method in the international specification for kart racing overalls.
These garments are often part of the product range of manufacturers who also make
motorcycle clothing.
Chapter 2 – Product tests and rating schemes for motorcycle protective clothing
26
Improving consumer information about motorcycle protective clothing MOTORCYCLE HELMET RATING SCHEMES
There are government supported consumer information testing schemes for motorcycle
helmets in the UK and Australia. These run according to differing models.
SAFETY HELMET ASSESSMENT AND RATING PROGRAM (SHARP)
In 2007, the UK Department for Transport (DFT) launched the Safety Helmet
Assessment and Rating Program (SHARP) to provide safety information to consumers on
the best motorcycle helmets available. (See http://sharp.direct.gov.uk.) According to the
latest posting on the SHARP website (27 May, 2010), the results to date of 202 helmet
tests ratings had been published.
SHARP annually tests a selection of popular motorcycle helmets to a unique set of
requirements, and delivers the results in a 5 star rating system. A total of 32 impact tests
are made on a group of 7 helmets of differing sizes, in two types of impact (on a flat anvil
and an inclined plane) and at three impact severities (Halewood and Hynd 2008).
The testing methodology itself is based on the now withdrawn BSI 6651-1985 Standard.
The test results obtained from each helmet model are used to estimate the probability of
death for a wearer based on the results of the European Cost 327 Project (Bogerd et al.
2010). Cost 327 was an accident investigation and head injury analysis study based on 256
European crashes investigated in depth. A five star rating is allocated based on this
estimated probability. The rating is combined with information supplied by the helmet
manufacturer.
The SHARP website does not provide the details of the analysis used to derive the rating,
however is discussed in the report published by TRL (Halewood and Hynd 2008).
CONSUMER RATING AND ASSESSMENT OF SAFETY HELMETS (CRASH)
A similar Australian program, CRASH, is run by a consortium of government agencies
and motorist organisations who share a common interest in improving motorcycle safety.
The program is supported by the NSW Transport, Roads and Maritime Services, the
NRMA Motoring & Services, and the Victorian Transport Accident Commission (TAC).
CRASH aims to provide helmet buyers with independent and consistent information on the
levels of protection from injury in a crash provided by motorcycle helmets and the comfort
level of the helmet.
For the comfort level performance, the helmets were rated using comfort features which
were considered important by motorcyclists. These features were ranked based on results
from a 2010 survey conducted by the European project COST 357–PROHELM (Accident
Prevention Options with Motorcycle Helmets) involving 598 motorcyclists. The study
found 71 per cent of the riders wore a helmet that was not of the right size and 69 per cent
of the respondents reported discomfort using the helmet (Bogerd et al. 2010).
CRASH awards a star rating from 1 to 5 for each motorcycle helmet following
independent crash protection and comfort assessments by independent specialist
laboratories.
 Crash protection: 1 star = Meets AS/NZ Standard, 2 stars = Average, 3 stars = Above
average, 4 stars = Good, 5 stars = Excellent
 Comfort: 1 star = Poor, 2 stars = Average, 3 stars = Above average, 4 stars = Good, 5
stars = Excellent
Chapter 2 – Product tests and rating schemes for motorcycle protective clothing
27
Improving consumer information about motorcycle protective clothing In the crash protection assessments, the helmets were rated based on their individual
performance aspects. These aspects were ranked and weighted based on their importance
to reduce the risk of head and brain injury in a crash and are listed as follows:







Energy reduction in a higher speed impact on a flat surface (30 per cent)
Energy reduction in a higher speed impact on kerb surface (25 per cent)
Energy reduction in a lower speed impact on flat surface (15 per cent)
Helmet's ability to minimise the rotation of the helmet in a crash (10 per cent)
Helmet coverage (10 per cent)
Helmet chin-strap's strength (5 per cent)
Helmet's ability to minimise rebound (5 per cent)
To date the results of tests on 31 helmets have been published. The web address is
http://www.rta.nsw.gov.au/roadsafety/motorcyclesafety/index.html/.
CONSUMER PRODUCT INFORMATION, REVIEWS AND RATINGS PROGRAMS
The European Standards are high level technical documents for manufacturers and test
houses, which provide little information that would be immediately useful to the
consumer. However it is also a requirement of the PPE Directive for a basic level of
information to be provided by manufacturers, to assist consumers to choose suitable
protective clothing.
There is little evidence to date of any initiative by industry to enhance consumers’
knowledge about appropriate or effective protective clothing. This is perhaps best
illustrated by the publication in 2010 of “A campaign informing riders and raising their
awareness regarding the benefits of a good motorcycling equipment” by the motorcycle
industry in Europe’s trade body ACEM (Association des Constructeurs Européens de
Motocycles). The booklet entitled Protective Equipment for Riders (ACEM 2010), which
was central to the campaign lacks any reference to the European Standards for motorcycle
protective clothing.
There have been a number of initiatives by rider organizations, the motorcycle media and
government agencies to promote information about the benefits and selection of
appropriate protective clothing. These include a range of media including websites,
booklets and videos, such as: The Rider Risk series of videos; The Good Gear Guide for
Motorcycle and Scooter Riders and a number of information websites http://roadsafety.mccofnsw.org.au/a/75.html, http://www.spokes.com.au/#/protectiveclothing/jackets, http://www.rideforever.co.nz/gear/choosing-the-right-gear/ .
However while promoting the benefits of protective clothing, few of these sources provide
riders with any objective information about how well specific garments will provide injury
protection in a crash. This is a matter of concern as there is evidence that a substantial
proportion of motorcycle clothing does not perform well under laboratory tests based on
those specified by the EU Standards.
MOTORCYCLE MAGAZINE PRODUCT REVIEWS
Motorcycle magazines frequently provide reviews of products based on road tests of usage
which relate to weather proofing, comfort, convenience and durability. Only two have
been identified that also include tests of performance under crash conditions. These two
exceptions are the British motorcycling magazine ‘Ride’ and a German magazine
‘Motorrad’.
Chapter 2 – Product tests and rating schemes for motorcycle protective clothing
28
Improving consumer information about motorcycle protective clothing RIDE MAGAZINE (UK)
Ride was the first publication to use the European Standards as the benchmark in its
product tests. The magazine is online at http://www.motorcyclenews.com/Ride/.
Irrespective of whether or not the manufacturer claimed their clothing, boots or gloves to
be protective, their products were subjected to the relevant tests and part of the rating
allocated accordingly. Ride also conducted further tests, such as evaluations of
waterproofing and insulation, not incorporated in the European Standards for
motorcyclists’ protective clothing and equipment.
The Ride reviews included wearer trials by one or more experienced motorcycling
journalists. Ratings were allocated to each of several key areas, with cost factored in to
identify which products represented the best value for money. Products conforming to
European Standards were regularly awarded “Best Buy” or “Recommended.” See
Appendix B for a report on a selection of Ride published reviews.
MOTORRAD MAGAZINE (GERMANY)
Motorrad in Germany also has a record of publishing informative product reviews. The
magazine is online at http://www.motorradonline.de. The product reviews are less
systematic that those by Ride magazine. They sometimes report on testing which appears
to comply with the requirements of the European Standards and at other times varies from
the test procedure. For example, a comparison of gloves were rated by apparently
accepting the manufacturers CE certification and adding extra more subjective tests. When
testing textile combination suits, rather than use the European Standard abrasion and burst
strength testing, the testing was done by dropping a clad dummy from a moving vehicle
and rating the damage to the garment.
The Motorrad articles also included wearer trials by one or more experienced motorcycling
journalists. Point score ratings were allocated to each of several key areas, with cost
factored in to identify which products represented the best value for money. Motorrad uses
a different format for its reviews and does not clearly lay out the test procedures or
standards used.
VICTORIAN MOTORCYCLE PROTECTIVE CLOTHING CONSUMER AWARENESS PROGRAM
The Transport Accident Commission (TAC) and VicRoads are also investigating options
to assist motorcycle riders to make the best selection with regard to purchasing and
wearing protective clothing. This project is currently investigating the feasibility of
running a motorcycle protective clothing consumer awareness program based on the
laboratory testing of garments. The pilot program will involve the testing of a small
number of garments using tests for the European Standards for motorcycle protective
clothing. The results of the pilot are scheduled to be completed by June, 2012. Some of the
issues to be determined in the pilot are:





How many versions of a garment are required to generate a test result?
Does the sizing of a garment affect the testing protocol?
What is the rationale behind taking the mean score from 5 or 6 tests to obtain a test
result? What does it do to the test outcome reliability if the number of tests is reduced?
What, if any, compromises to the EU testing protocol are required to overcome any
feasibility issues?
What considerations need to be given in the translation of test results into a consumer
awareness program?
Chapter 2 – Product tests and rating schemes for motorcycle protective clothing
29
Improving consumer information about motorcycle protective clothing Conclusions
A critical review of existing motorcycle protective clothing rating and test regimes has
been made. The two existing rating and test regimes able to be applied for motorcycle
protective equipment closest to fulfilling the framework put forward at the beginning of
this chapter are the product tests and reviews published by Ride Magazine in the UK and
the Australian CRASH helmet rating scheme. These regimes both consist of a combination
of physical testing to appropriate standards with user assessment. Both schemes include
comprehensive and transparent reporting of the test result and a simple comparative rating
scheme.
References
ACC, 2004. Ride for ever, http://www.Rideforever.Co.Nz/gear/choosing-the-right-gear/.
In: de Rome, L. ed. Accident Compensation Commission, Wellington, NZ.
ACEM, 2010. Protective equipment for riders. In: Motorcycles, A.D.C.E.D. ed., Brussels.
Aldman, B., Cacciola, I., Gustafsson, H., Nygren, A., Wersall, J., 1981. The protective
effect of different kinds of protective clothing worn by motorcyclists. In: Charpenne,
J.P.C.A. ed. Proceedings of the 6th International Conference of the Research Council
on the Biomechanics of Impact. IRCOBI, Salon-de-Provence (France), pp. 1-9.
Bogerd, C.P., Carley, M., Crundall, D., Otte, D., Shahar, A., Shinar, D., Webb, D.,
Brühwiler, P.A., 2010. Cost action 357: Accident prevention options with motorcycle
helmets. St. Gallen
CEC, 1989. The Council of the European Communities directive on the approximation of
the laws of the member states relating to personal protective equipment 89/686/EEC.
Office for Official Publications of the European Communities, 1989L0686-08/10/1996
CONSLEG, http://ec.europa.eu/enterprise/sectors/mechanical/legislation/personalprotective-equipment/index_en.htm.
CEN, 1998. Motorcyclists' protective clothing against mechanical impact: Requirements
and test methods for impact protectors. EN 1621-1:1998. European Committee for
Standardisation, Brussels.
CEN, 2002. Protective clothing for professional motorcycle riders: Jackets, trousers and
one piece or divided suits - general requirements. EN 13595-1:2002. European
Committee for Standardisation, Brussels.
CEN, 2003. Motorcyclists' protective clothing against mechanical impact: Motorcyclists
back protectors - requirements and test methods. EN 1621-2:2003 European Committee
for Standardisation, Brussels.
de Rome, L., 2004. Motorcycle protective clothing,
http://roadsafety.Mccofnsw.Org.Au/a/75.Html. Motorcycle Council of NSW, Sydney,
Australia.
de Rome, L., 2009. The good gear guide for motorcycle & scooter riders.
Http://www.Infrastructure.Gov.Au/roads/safety/publications/2009/good_gear_guide.As
px, Canberra.
de Rome, L., Ivers, R., Fitzharris, M., Du, W., Richardson, D., Haworth, N., Heritier, S.,
2011. Motorcycle protective clothing: Protection from injury or just the weather?
Accident Analysis and Prevention 43 (6), 1893-1900.
Halewood, C., Hynd, D., 2008. Safety helmet assessment and rating programme (sharp) development of the performance evaluation protocol. Transport Research Laboratory
Wokingham, Berkshire UK.
MCC, 2011. Rider risk video series, www.Mccofnsw.Org.Au/a/332.Html. Motorcycle
Council of NSW, Sydney, NSW.
Nygren, A., 1987. Protective effect of a specially designed suit for motorcyclists. Passive
safety for motorcyclists. Institute for Motorcycle Safety - Institut fur Zweiradsicherheit
(IFZ), Bochum.
Chapter 2 – Product tests and rating schemes for motorcycle protective clothing
30
Improving consumer information about motorcycle protective clothing Otte, D., Middelhauve, V., 1987. Quantification of protective effects of special synthetic
protectors in clothing for motorcyclists. In: Cesari, D., Charpenne, A. eds. Proceedings
of the International Conference of the Research Council on the Biomechanics of
Impact. IRCOBI, Birmingham, UK, pp. 1-18.
Otte, D., Schroeder, G., Richter, M., 2002. Possibilities for load reductions using garment
leg protectors for motorcyclists -- a technical, medical and biomechanical approach.
Proceedings of the 46th Annual Conference of the American Association for the
Advancement of Automotive Medicine. AAAM, pp. 367-385.
Prime, D.M., Wood, R.I., 1984. Tests on the protection afforded by various fabrics and
leathers in a simulated impact of a motorcyclist on a road surface. In: Cesari, D.,
Charpenne, A. eds. Proceedings of the International Conference of the Research
Council on the Biomechanics of Impact. IRCOBI, Delft, pp. 253-264.
TAC, 2009. Spokes http://www.Spokes.Com.Au/#/protective-clothing/jackets, . In: de
Rome, L. ed. Transport Accident Commission, Melbourne, Victoria.
Varnsverry, P., 2003. Personal protective equipment (ppe): A briefing from the British
Motorcyclists Federation. In: Jackson, R., Olliffe, R. eds. British Motorcycle
Federation, Leicester, UK.
Woods, R.I., 1982. Necessary properties of winter motorcycling clothing. Journal of
Physiology 330, 51-52.
Woods, R.I., 1983. Cooling of Motorcyclists in various clothing during winter in Britain.
Ergonomics 26 (9), 847-861.
Woods, R.I., 1986. Relation between clothing thickness and cooling during motorcycling.
Ergonomics 29 (3), 455-462.
Woods, R.I., 1994. Testing motorcycle riders clothing and the personal protective
equipment directive. In: Charpenne, A., Zac, R. eds. Proceedings of the International
Conference of the Research Council on the Biomechanics of Impact. International
Research Council on Biokinetics of Impacts, Lyon, France, pp. 291-302.
Woods, R.I., 1996a. Specification of motorcyclists' protective clothing designed to reduce
road surface impact injuries. In: Johnson, J.S., Mansdorf, S.Z. eds. Performance of
protective clothing. American Society for Testing and Materials, ASTM STP 1237,
Philadelphia, pp. 3-22.
Woods, R.I., 1996b. Testing of protective clothing for motorcyclists: Validation of
laboratory tests by accident studies. In: Johnson, J.S., Mansdorf, S.Z. eds. Performance of
protective clothing. American Society for Testing and Materials, Philadelphia, pp. 43-56.
Woods, R.I., 1999. The Cambridge standard for Motorcyclists' clothing. Part 1. Jackets,
trousers, one piece suits and two piece suits, designed to provide mechanical protection
against some injuries. Protective Clothing Research Facility, Physiological Laboratory,
Cambridge University, Downing Street, Cambridge, UK CB2 3EG.
Chapter 2 – Product tests and rating schemes for motorcycle protective clothing
31
Improving consumer information about motorcycle protective clothing CHAPTER 3 - CONSUMER RATING AND EVALUATION
PROGRAMS
One of the key tasks was to analyze consumer information programs in road safety and other
sectors in terms of their efficacy and cost-effectiveness. A number of consumer information
programs in road safety were identified (e.g. ANCAP, CREP), including some focussed on
motorcycle safety (e.g. CRASH, SHARP and Ride), as well as in other non-road safety
sectors (e.g. fuel consumption and energy efficiency). However there is relatively little
evidence-based literature evaluating the efficacy and cost-effectiveness of these consumer
information programs, as most evaluation reports focus on the reach of the message rather
than the associated change in behaviour.
This section of the report will discuss the mechanisms by which consumer information
programs are known or postulated to work and assess the relevance of these mechanisms for
increasing usage of protective clothing.
IDENTIFYING AND CLASSIFYING CONSUMER INFORMATION PROGRAMS
Existing consumer information programs were examined in terms of whether they assess
products on single or multiple dimensions, how the ratings are communicated to consumers,
whether the system is mandatory or voluntary, the related issue of the completeness of
coverage, how the program relates to any existing standards and who funds the assessment
program.
Table 3.1 Key factors in a consumer rating / information system
Features Factors assessed Business model paid for by : Regulatory status Distribution of results Rating/ information disclosure Rating/ information displayed on product: Efficacy Cost‐effectiveness Single or multiple dimension.
Consumer directly
Industry organization / manufacturer of product being assessed. System mandatory or voluntary
On the product, website, magazine, multiple sites. Mandatory or voluntary
Test criteria available
Criteria available
Only consumer information programs that seek to inform the general public were examined.
Programs designed to inform a small number of specific consumers were not addressed in
this report. For example, the Nielsen media ratings have not been included because the main
consumers are advertising agencies and the commercial television and radio stations, rather
than the general public.
Consumer information is commonly available on the internet. A range of search terms,
which might ordinarily be used by consumers when looking for safety information, were
entered into an internet search engine to identify road safety rating systems that are easily
accessible by consumers. Further searches were then carried out to gather information about
any evaluations of these systems.
Chapter 3 – Consumer rating and evaluation systems 39 Improving consumer information about motorcycle protective clothing This section will begin by providing examples of Australian and international rating systems
used. It will outline the business models that have been used, and assess which may be most
useful in designing future rating systems in motorcycle safety.
CONSUMER INFORMATION PROGRAMS IN VEHICLE AND ROAD SAFETY
NEW AND USED CAR SAFETY RATING PROGRAMS
Programs have been developed to provide information to consumers who are intending to
purchase new or used cars, child restraints or motorcycle helmets. New Car Assessment
Programs have been developed in the United States, Europe, Japan, Korea, China and
Australia to provide safety information to intending purchasers of new cars. While they
initially considered only measures of secondary safety (ability to protect the occupants once a
crash had occurred), more recent changes to the Programs have incorporated crash avoidance
technologies such as enhanced stability control systems. The New Car Assessment Programs
generally test cars to a level of performance that is higher than specified in the mandatory
Government safety standards. This approach is used to avoid problems with regulatory
compliance if a failure should occur. These programs are funded by motorist associations and
government agencies and independently purchase and crash test vehicles. Thus, while the
majority of the largest selling models are tested, some are not, and the Australian New Car
Assessment Program (ANCAP) often presents results of European testing of some models.
Star ratings are available free to the public on a variety of websites. In Australia, car retailers
and vehicle manufacturers can voluntarily display the rating on vehicles for purchase or use
the ratings in advertising material. In the United States, it is mandatory to display the star
rating on the price tag of the vehicle.
Euro NCAP works on the same system and model as ANCAP. In 2009, Euro NCAP changed
its rating system to put a greater emphasis on rating the extent to which vehicles protect
pedestrians in crashes. Research by Liers (2009b) aimed to estimate how well the pedestrian
rating system matches the expected real world benefit. His results supported the inclusion of
findings from real-world accident data and associated effectiveness studies in the
development of passive safety measures, legislation tests or ratings like Euro NCAP (Liers
2009a)
In the U.S, as well as NCAP, the Insurance Institute for Highway Safety (IIHS), and
Consumers Union, also rate vehicle safety. The 2010 IIHS Status Report stated that the IIHS
and Consumers Union ratings attract more media attention than NCAP’s (IIHS 2010).
“Institute crash tests routinely are covered on national news, attracting tens of millions of
viewers. About 8 million people subscribe to Consumers Union publications, making the
flagship Consumer Reports a top -10 magazine” (Consumers Union 2012b, a). A common
characteristic of these programs is that they are not part of a regulatory program and their
purpose is to go beyond minimum government requirements “to do a better job of protecting
their occupants in crashes. For this reason, the tests generally are more demanding than those
required to comply with safety regulations established by governments in the United States
and elsewhere”.
The validity of laboratory crash test information and New Car Assessment programs, and
whether they predict real-world performance, has been demonstrated in research by the
Institute for Highway Safety in the U.S (Farmer 2005, Farmer et al. 2008, Teoh and Lund
2011). In a study of the relationship between frontal offset crash test ratings and real-world
fatality rates, Farmer (2005) found fatality rates per registered vehicle were lower for vehicles
Chapter 3 – Consumer rating and evaluation systems 40 Improving consumer information about motorcycle protective clothing rated ‘good’ than were for those rated ‘poor’. Farmer et al. also examined consumer safety
ratings for vehicle seats against real-world neck injury rates (Farmer et al. 2008). The
researchers found that real-world injury rates were 15% lower for vehicles with seats rated
‘good’ compared with vehicles with seats rated ‘poor’, and rates of neck injuries lasting 3
months or more were 35% lower for those rated ‘good’ compared with those rated ‘poor’.
Consumer information on side impact ratings has been shown to be a strong predictor of realworld performance. Teoh and Lund found drivers of vehicles rated ‘good’ were 70% less
likely to die when involved in left side crashes than of drivers of vehicle rated ‘poor’(Teoh
and Lund 2011). Death risk was 64% lower for those rated ‘acceptable’ compared with
‘poor’ and 49% lower than those rated ‘marginal’ compared with ‘poor’.
In Australia and New Zealand, the Used Car Safety Rating (UCSR) program seeks to assist
purchasers of used cars to select vehicles that will provide a greater level of protection to
occupants in the event of a crash as well as a low level of danger to occupants of other
vehicles (TAC 2012). This program is similar to the New Car Assessment Program (TAC
2012) in that it is independently funded by motorist associations and government agencies
and is a voluntary program where the results are publicised and available on a range of
websites, rather than being required to be displayed on the vehicle. It differs from the New
Car Assessment Program in that it derives its ratings from analyses of injury risk and severity
in Police-reported crashes, rather than laboratory crash testing.
EFFECTS OF CAR SAFETY RATING PROGRAMS ON PURCHASE DECISIONS
Relatively little information is available regarding the effect of consumer information
programs on consumers’ decisions when purchasing new or used cars. Spalding and King
investigated the role of safety features in consumers’ purchase decisions in Australia and the
relative importance of different sources of vehicle safety information (Spalding and King
2006). The investigators surveyed 175 individuals and found safety was ranked the joint fifth
most important attribute in a prospective future used vehicle purchase. Nearly 90% of the
respondents were aware of crash testing of vehicles. Awareness of ANCAP ratings was over
46% and awareness of UCSR was over 20%. More than half of the respondents considered
the advice from motoring clubs and magazine road tests on vehicles to be very useful.
However, almost 80% of respondents noted the seller of their last purchased vehicle did not
inform them very well about its safety features. The authors noted that mixed results provide
challenges and opportunities ahead to communicate benefits and encourage the purchase of
safer vehicles.
A national survey in the US (based on 928 drivers) found that safety was rated the second
most important factor in selecting a vehicle, after quality/reliability (McCartt and Wells
2010). Of the respondents, 86% said safety is a very important consideration. The importance
of safety appears to be higher in this larger U.S sample compared with the smaller Australian
sample. More than three-quarters of respondents said they had seen safety ratings or crash
test information (somewhat less than the awareness of crash testing in Australia) and 67% of
these U.S respondents said such information would be useful in purchasing or considering
which vehicle to own. Approximately 30% of respondents could name an organisation that
provides ratings.
A recently completed Queensland study by Spalding evaluated a pilot which was designed to
improve awareness of consumer information for the Used Car Safety Ratings (UCSR) at
point-of-sale (POS) (Spalding 2011). The report highlighted a lack of acceptability by the
vehicle sellers of the UCSR information being displayed at POS. In fact, the initial aim of the
Chapter 3 – Consumer rating and evaluation systems 41 Improving consumer information about motorcycle protective clothing research, which was to track changes in the vehicle safety levels of dealer held stock, could
not be achieved as there was not sufficient dealer support for the involvement for the duration
of the pilot. Feedback from dealers included that POS material was not seen as beneficial to
them and some felt it was detrimental to their business. Dealers felt that potential purchasers
generally have little interest in POS safety related information and/or they (the purchaser)
have done their safety research prior to entering the car yard. Feedback also suggested there
is lack of clarity (for the dealers) around the difference between ANCAP and UCSR.
New Car Assessment Programs have shown some effect in promoting improvements in the
level of fleet vehicle safety. The Australian Federal Government recently announced that all
Commonwealth fleet passenger car purchases would require a 5-star ANCAP rating and light
commercial vehicles would require a 4-star rating from July 2011. Several State governments
and private fleets have already made similar decisions.
OTHER VEHICLE AND ROAD SAFETY RATING SYSTEMS
The Child Restraint Evaluation Program (CREP) is another example of an independent
consumer information program. The program is supported by the NSW Roads and Marine
Services (RMS), NRMA Motoring & Services, the Royal Automobile Club of Victoria
(RACV), the Transport Accident Commission (TAC), and the Royal Automobile Club of
WA (RACWA). It is a multidimensional program in that it provides information on both the
levels of occupant protection provided by child restraints and the ease with which the
restraints can be used correctly. Currently restraints must meet the Australian/New Zealand
Standard AS/NZ 1754:2010 Child restraints for use in motor vehicles. However, the purpose
of the program is to apply commercial and public consumer pressure on manufacturers to
deliver Child Restraint Systems (CRS) that perform well beyond the requirements of the
Australian Standard. Thus, it is similar in purpose to the New Car Assessment Program.
The Consumer Rating and Assessment of Safety Helmets (CRASH) Program is discussed in
detail elsewhere in this report. It should be noted that it follows the same “business model” as
the New Car Assessment Program and CREP, in that it is funded by government and motorist
organisations and is a voluntary system which operates to promote performance beyond that
specified in mandatory standards. Little is known about the effects of the CREP or CRASH
programs on consumer behaviour.
Following from the example of the New Car Assessment Programs and the UCSR, rating
systems have also been developed for roads and for road crossing points. The Australian
Road Assessment Program (AusRAP) has developed into the International Road Assessment
Program (iRAP). It calculates crash rates on various major routes within a jurisdiction and
converts this data into star ratings (from 1 to 5) for routes. A ‘star rating’ model was
developed for rating the safety of individual road crossing points in Victoria considering the
main determinants of pedestrian crash and injury risk. The project by Corben, Logan and
Oxley demonstrated that is it feasible to objectively rate the safety performance of individual
road crossing points as well as provide indications of overall route safety (Corben et al.
2008). The authors note further work is desirable to improve the robustness of the
mathematical risk relationship utilised, as well as to broaden the applicability of the model to
walking populations and road environments. To the best of our knowledge, as yet there had
been no evaluation of effectiveness of the ‘star rating’ use for road crossings.
A ‘STAR rating’ system for tractor safety assessment has been developed as a means of
comparing the inherent safety features of individual tractors by giving tractor manufacturers,
Chapter 3 – Consumer rating and evaluation systems 42 Improving consumer information about motorcycle protective clothing dealers and users information critical in managing tractor risk (Scott et al. 2002). In this case
the stars system was developed “in a systematic process with reference to fatality and injury
patterns, current standards, and tractor safety research, and included farmer input” (Day et al.
2005, pg. 363). The rating system is available via the internet to farmers, tractor
manufacturers, and dealers. In Australia, it was initially implemented within the technical
education and training sector. In New South Wales, all agricultural and horticultural teachers
are required to undertake STARS training and training was to be incorporated into the
curriculum for agricultural students. The STARS system is included as resource material in
the rural occupational health and safety risk management course. As further evidence of the
reach of the system, in 2003, elements of the STAR system were used in the tender for the
purchase of several hundred new tractors for rural high schools in NSW. The authors note
“this indicates that recognition of STARS as a useful resource is beginning to occur” (Day et
al. 2005) p.362.
RATING SYSTEMS IN OTHER INDUSTRIES
To identify rating systems in other industries, a similar process of internet searches was
carried out as above. Accommodation standards and energy ratings observed provide
examples of different types of business models used. Information on a number of these
systems follows.
The AAA STAR rating is a consistent rating of (approximately 8,000) accommodation
properties throughout Australia. Properties are rated between one and five stars based on:
Cleanliness, Quality & Condition, Facilities & Services (AAA Tourism Corporate 2011). It is
a voluntary system where properties pay for a licence to be rated by AAA. The star level can
then be displayed by the property (on the premises) and is also available in accommodation
guides. These guides and standards listings are generally available free of charge to
consumers and the general public online or at visitor centres. Some auto clubs associated with
AAA may sell the guides for a fee. Properties pay a higher fee in their membership to have
their property’s information displayed more prominently in the guides (telephone
correspondence AAA Tourism, 2011).
AAA Tourism has surveyed consumers about the accommodation STAR rating symbol or
logo. Their research found that 89% of consumers recognised the AAA STAR symbol.
Responses to “Do you search by STAR ratings when choosing accommodation?” showed that
84% of consumers “use the STARS ‘always’ or ‘most of the time’ in the accommodation
buying process”. The STAR system was found to be extremely important guiding decision
making for consumers (between competing accommodations). It was found that the rating
had a great deal of equity in the minds of consumers, however this was largely subconscious,
and that there is a belief that all accommodation types should have a STAR rating (AAA
Tourism Corporate 2011).
The mandatory energy efficiency labeling scheme for household appliances is a well-known
consumer information program. A study conducted for the Australian Department of
Environment, Water, Heritage and the Arts used a series of focus group discussions in
Australia and New Zealand to address whether a 10-star rating scheme would improve the
current scheme which has long used a 6-star format to communicate the energy efficiency of
selected consumer appliances (Department of Environment et al. 2008). The results
(obtained by Winton Sustainable Research Strategies, 2008) found that after 20 years of
community awareness and promotion, the appliance energy labels is almost universal, with
Chapter 3 – Consumer rating and evaluation systems 43 Improving consumer information about motorcycle protective clothing most consumers having a good understanding of the basic concepts and features. It was also
found that:
Most have acted on the label in real appliance purchase decisions
Almost all are aware that more stars mean greater energy efficiency, and half stars are
clearly recognised and understood.
In their purchase process almost all referred to the stars (almost always before the
numbers), and they liked the graphical depiction. They saw the stars as a fun concept
that also communicates a simple and important environmental message.
With a 6-star label, consumers did not read the number of stars or half stars, they
tended to recognise the rating in its entirety, they “intuit or subitize” the rating,
without (consciously) counting each star.
Most people also referred to the energy consumption figure, the numbers, and while
they may have been unclear as to precisely what the numbers represented, most did
understand that the larger the number, the more energy that appliance consumes
and/or the more it will cost to run.
Research in Montreal investigated the development of a new energy rating system for
existing houses and concluded the following about owners’ awareness of the potential
advantages of the system. It was found that owners’ awareness could be increased by the
presentation of the actual energy performance compared with that of a reference house.
Secondly that awareness could be increased by the presentation of the potential savings
(Zmeureanu et al. 1998).
In the U.S., the ENERGY STAR® system is a voluntary labelling program to promote and
identify energy efficient products, buildings and practices. It is operated by the U.S.
Environmental Protection Agency (EPA) with the U.S. Department of Energy (DOE).
Research evaluated the ENERGY STAR® system in order to estimate the energy, dollar and
carbon savings achieved by the program. The method used was to calculate the number of
energy star units in place each year that can be attributed to the ENERGY STAR® program.
Sales of each product were segmented first into non-energy star and energy-star units. They
were further divided into those that would have been sold even without the program and
those that could be attributed to the program. It was estimated that the system saved more
than 1,194 trillion BTUs of energy and prevented carbon emissions of 21.1 million metric
tons in 2006 (Sanchez et al. 2007). Details of the sales figures, which would be useful in
examining estimated reach to consumers of the ENERGY STAR® system, were not provided
in the paper.
Consumers are also provided with information regarding the fuel consumption of new
vehicles. The fuel consumption labeling standard (ADR81/02) applies to all new vehicles
being sold in Australia (up to 3.5 tonnes gross vehicle mass). It is mandatory that vehicle
manufacturers display a fuel consumption labels on the front windscreen. The label indicates
both how many litres of fuel a vehicle will use to travel 100 kilometres as well as how many
grams of carbon dioxide the vehicle would emit for each kilometre (Department of
Sustainability 2011). The purchaser of the vehicle has no link to the funding of the system.
Vehicle manufacturers are responsible for the testing under this system. In the proposed
update from ADR81/01 the Department of Transport and Regional Services in consultation
with the Land Transport Environment Committee (2007) found that there were limitations to
Chapter 3 – Consumer rating and evaluation systems 44 Improving consumer information about motorcycle protective clothing the ADR81/01 in assisting consumers to make informed decisions when purchasing vehicles.
They found the label displayed as a combined figure for both fuel consumption and CO2
emissions leads to some confusion among those consumers who are unable to achieve these
results in real world driving (Department of Transport and Regional Services 2007).
Information is provided to consumers about a wide range of products and services by Choice
magazine. Choice is a not for profit organisation founded in 1960 which rates a range of
products on the market. The system both tests products and surveys customers to develop
reliability ratings. ‘Choice’ is funded by subscribers and governed by an elected council.
“CHOICE is the public face of the not-for-profit Australian Consumers Association (ACA)
Governed by an elected, unpaid and independent Council
Senior management team oversee day to day operations
Risk management based on Australia/New Zealand standard” (ACA 2011).
A brand awareness study commissioned by ‘Choice’ found that a large proportion (88%) of
‘Choice’ members had bought a product on a ‘Choice’ recommendation and nearly all were
happy with their purchase (ACA 2010). Given that the system has been in place for 51 years
and is still running, the model appears cost-effective from the ‘Choice’ point of view. The
model also appears cost-effective for consumer as 41% of non-members thought “CHOICE
can save you time and money”. However, the study also found only 22% of members and
17% of non-members regarded CHOICE as being visible in the community suggesting the
limited reach achieved by the organisation (ACA 2010).
A summary of the all the rating system models described above can be found in Table 3.2.
EFFICACY AND COST-EFFECTIVENESS
While a number of road safety and vehicle safety rating systems have been developed, there
appears to be little research which has evaluated the efficacy (regarding safety) or costeffectiveness of these rating systems in the ‘real world’. In the other industries, where there is
a commercial advantage for information regarding the reach of the programs, there has been
more research and has focused on consumer awareness of the rating programs (as outlined
above). Again there appears to be a lack of research detailing cost-effectiveness issues. The
length of time the system has been running, however, provided an indication of the success
and future viability of such a business model.
Chapter 3 – Consumer rating and evaluation systems 45 Improving consumer information about motorcycle protective clothing Table 3.2 Summary consumer rating systems models
Consumer rating
/ information
system
Single or
multiple
dimension
Business
model
Paid for
by
consumer
directly?
Paid for by
organisation/
manufacturer
of product
being
assessed?
System
mandatory or
voluntary?
NCAP
Single:
Safety
Consumer
has no direct
link to the
funding of
the system
Government
agencies &
motorist
associations
No
No
Vehicle
models
independently
chosen by
NCAP (AUS
& Euro).
Consumer
has no direct
link to the
funding of
the system
Government
agencies &
motorist
associations
No
New Car
Assessment
Program
UCRS
Used Car Rating
Scheme
Single:
Safety
Chapter 3 – Consumer rating and evaluation systems No
In the U.S.
NCAP star
rating must be
placed on the
price sticker
(as of Sep 07)
Not
Mandatory
Rating/
information
displayed on
the product,
website,
magazine,
multiple?
Often
displayed on
vehicle & in
advertising
material
(AUS)
Brochures
published,
available on
website s of
supporters
Rating/
information
displayed on
product:
Mandatory or
voluntary?
Efficacy
Costeffectivene
ss
Voluntarily
(AUS &
Europe) /
Mandatory
(U.S.)
Effect on
safety of
ratings
unknown:
Awareness of
ANCAP
ratings were
over 46%
(Spalding &
King 2006)
Unknown
Information
available on
the internet.
Not usually
displayed on
the vehicle by
the seller
Brochures
published and
available to
the consumer.
Voluntary
Effect on
safety of
ratings
unknown
Awareness of
UCSR was
over 20%
(Spalding &
King 2006)
Unknown
46 Improving consumer information about motorcycle protective clothing Consumer rating
/ information
system
Single or
multiple
dimension
Business
model
Paid for
by
consumer
directly?
Paid for by
organisation/
manufacturer
of product
being
assessed?
System
mandatory or
voluntary?
CREP
Multiple:
Safety &
Ease-of-use
Consumer
has no direct
link to the
funding of
the system.
Government
agencies &
motorist
associations
combine
NO
NO
Voluntary
Single:
Energy
efficiency
Consumer
has no direct
link to the
funding of
the system
NO
Suppliers
organise
testing and
certification
through
specialist
laboratories.
Mandatory
Child Restraint
Effectiveness
Program
ENERGY
STAR®
Chapter 3 – Consumer rating and evaluation systems Rating/
information
displayed on
the product,
website,
magazine,
multiple?
Information
available on
the internet.
Not usually
displayed on
the vehicle by
the seller
Brochures
published and
available to
the consumer.
Rating on the
product and
other sources
including web
47 Rating/
information
displayed on
product:
Mandatory or
voluntary?
Efficacy
Costeffectivene
ss
Voluntary
Unknown
Unknown
Mandatory
It is estimated
that the system
saved more
than 1,194
trillion Btus of
energy and
prevented
carbon
emissions of
21.1 million
metric tons in
2006 (Sanchez
etal., 2007)
Unknown
Improving consumer information about motorcycle protective clothing Consumer rating
/ information
system
Single or
multiple
dimension
Business
model
Paid for
by
consumer
directly?
Paid for by
organisation/
manufacturer
of product
being
assessed?
System
mandatory or
voluntary?
Fuel efficiency
Single: Fuel
efficiency
Consumer
has no direct
link to the
funding of
the system
NO
Manufacturer's
responsibility
to test &
produce the
labels
Mandatory
AAA Tourism
Single:
accom'n
standard
Subscription
type model.
Property
pays: via a
membership
licence
Generally
NO:
some star
rating
guides are
free (e.g.
Online)
others are
sold by
the
member
clubs
Property pays:
via
membership/
licence
Voluntary
Chapter 3 – Consumer rating and evaluation systems Rating/
information
displayed on
the product,
website,
magazine,
multiple?
On vehicle and
in advertising
Rating/
information
displayed on
product:
Mandatory or
voluntary?
Efficacy
Costeffectivene
ss
Mandatory on
new vehicle
Unknown
Unknown
Rating
displayed on
property and
published in
guides and
online
Voluntary
84% of
consumers use
the STARS
‘always’ or
‘most of the
time’(AAA
Tourism
Corporate,
2011)
This model
has been
financially
viable with
the system
running for
96 years
(since
1915)
(AAA
Tourism
Corporate,
2011)
48 Improving consumer information about motorcycle protective clothing Consumer rating
/ information
system
Single or
multiple
dimension
Business
model
Paid for
by
consumer
directly?
Paid for by
organisation/
manufacturer
of product
being
assessed?
System
mandatory or
voluntary?
CHOICE
Magazine
Multiple:
Product
testing &
reliability
rating
Subscription
type model
YES
NO,
Subscribers
pay
Voluntary
Chapter 3 – Consumer rating and evaluation systems Rating/
information
displayed on
the product,
website,
magazine,
multiple?
Ratings of
products in
CHOICE
magazine
49 Rating/
information
displayed on
product:
Mandatory or
voluntary?
Efficacy
Costeffectivene
ss
Ratings not
displayed on
products
Although a
large
proportion
(88%) of
CHOICE
members had
bought a
product on a
CHOICE
recommendati
on, only 22%
of members
regarded
CHOICE as
being visible
in the
community
and 17% of
non-members
regarded it as
being visible
(CHOICE,
2010)
CHOICE
is a not for
profit
organisatio
n, its model
appears
financially
viable as it
has been
running for
51 years
(was
founded in
1960)
funded by
their
members
and
safeguarde
d by an
elected
council
(CHOICE,
2010)
Improving consumer information about motorcycle protective clothing Rating/
information
displayed on
the product,
website,
magazine,
multiple?
Star rating
available as a
brochure (inc
on the
internet)
Rating/
information
displayed on
product:
Mandatory or
voluntary?
Efficacy
Costeffectivene
ss
Voluntary
Unknown
Unknown
Voluntary
Information
available on
the internet.
Voluntary
Unknown
Unknown
Mandatory
YES on the
product &
other sources
including web
Mandatory
Unknown
Unknown
Consumer rating
/ information
system
Single or
multiple
dimension
Business
model
Paid for
by
consumer
directly?
Paid for by
organisation/
manufacturer
of product
being
assessed?
System
mandatory or
voluntary?
CRASH
Multiple:
Safety and
user
assessment
Consumer
has no direct
link to the
funding of
the system.
Government
agencies &
motorist
associations
Consumer
has no direct
link to the
funding of
the system.
NO
NO
Voluntary
NO
NO
NO
Suppliers
organise
testing and
certification
through
specialist
laboratories.
Consumer
Rating and
Assessment of
Safety Helmets
(Motorcycle)
SHARP
Safety Helmet
Assessment and
Rating Program
(Motorcycle)
Standard
AS/NZS 1698
Protective
Helmets for
Vehicle Users
Multiple:
Safety, User
assessments,
price
Single:
Safety
UK
Government
Consumer
has no direct
link to the
funding of
the system
Chapter 3 – Consumer rating and evaluation systems 50 Improving consumer information about motorcycle protective clothing Consumer rating
/ information
system
Single or
multiple
dimension
Business
model
Paid for
by
consumer
directly?
Paid for by
organisation/
manufacturer
of product
being
assessed?
System
mandatory or
voluntary?
Ride Magazine
Multiple:
Safety, User
assessments,
price
Subscription
type model
YES
NO,
Subscribers
pay
Voluntary
Motorrad
magazine
Multiple:
Safety, User
assessments,
price
Subscription
type model
YES
NO,
Subscribers
pay
Voluntary
Chapter 3 – Consumer rating and evaluation systems Rating/
information
displayed on
the product,
website,
magazine,
multiple?
Ratings of
products in
Ride magazine
Rating/
information
displayed on
product:
Mandatory or
voluntary?
Efficacy
Costeffectivene
ss
Ratings not
displayed on
products
Unknown
Unknown
Ratings of
products in
Motorrad
magazine
Ratings not
displayed on
products
Unknown
Unknown
51 Chapter 3 – Consumer rating and evaluation systems THE DIFFERENT BUSINESS MODELS
In summary, five types of business models were identified:
1 Mandatory testing and display (e.g. appliance energy ratings, vehicle fuel consumption)
2 Purchase of products by external organisation(s), testing to beyond mandatory standards
and publicity (e.g. NCAP, CREP, CRASH)
3 Purchase of products by a consumer organisation which develops tests and publishes
results (e.g. Choice magazine)
4 Analysis of real-world safety performance of products by external organisation(s) and
publicity (e.g. UCSR)
5 Suppliers pay to have products assessed by independent organisation with results
published and often displayed (e.g. AAA accommodation ratings)
Conclusions
Overall, there has been relatively little evaluation of consumer rating and information systems
(in either road safety or other areas of consumer use). Most were single dimension and if there
was a requirement to label the rating on the product, these were generally voluntary and market
driven.
In the area of road safety, all the programs observed were designed to make an improvement
beyond the official standards. In the area of accommodation standards, there are no
comparable official rating systems however, there were quite a number of informal
accommodation rating systems available to consumers, in the form of internet forums and
ratings specific properties listed on websites. There were also systems developed in the
absence of official (government) standards.
References
AAA Tourism Corporate, 2011. Consumer research. http://www2.aaatourism.com.au/industry/
STARRatings/ConsumerResearch/tabid/142/default.aspx.
ACA, 2010. Annual review 2010 www.choice.com.au. Australian Consumer Association,
Marrickville, NSW.
ACA, 2011. How we run. Choice Magazine,. Australian Consumer Association,
http://www.choice.com.au/about-us/how-we-are-run.aspx, Marrickville, NSW.
Corben, B., Logan, D., Oxley, J., 2008. Star rating school walking routes. Report no. 275.
Monash Accident Research Centre, Clayton, Victoria.
Day, L., Scott, M., Williams, R., Rechnitzer, G., Walsh, P., Boyle, S., 2005. Development of
the safe tractor assessment rating system. Journal of Agricultural Safety and Health 11 (3),
353-364.
Department of Environment, Water, Heritage, and the Arts, 2008. Towards a 10-star energy
efficiency rating system for major household appliances. Canberra, ACT.
Department of Sustainability, E., Water, Pollution and Communities, 2011. Fuel consumption
labels http://www.Environment.Gov.Au/settlements/transport/fuelguide/label.Html.
Canberra, ACT.
Department of Transport and Regional Services, 2007. Proposed update of ADR81/01 fuel
consumption labelling for light vehicles LTEC position paper.
Http://www.ephc.gov.au/ltec/pdfs/positionpaper_proposed_adr81_02_nov2007.pdf.
Canberra, ACT.
Farmer, C.M., 2005. Relationships of frontal offset crash test results to real-world driver
fatality rates. Traffic Injury Prevention 6, 31-37.
Chapter 3 – Consumer rating and evaluation systems 52 Chapter 3 – Consumer rating and evaluation systems Farmer, C.M., Zuby, D.S., Wells, J.K., Hellinga, L.A., 2008. Relationship of dynamic seat
ratings to real-world neck injury rates. Traffic Injury Prevention 9, 561-567.
IIHS, 2010. Status report. Special Issue: Vol 45, No. 4, April 15, 2010. Insurance Institute for
Highway Safety, Arlington, US.
Liers, H., 2009a. Benefit estimation of the Euro NCAP pedestrian rating concerning real world
pedestrian safety. http://www-nrd.nhtsa.dot.gov/pdf/esv/esv21/09-0387.pdf.
Verkehrsunfallforschung an der TU Dresden GmbH (VUFO), (Traffic Accident Research at
the Technical University of Dresden GmbH (VUFO)).
Liers, H., 2009b. Benefit estimation of the Euro NCAP pedestrian rating concerning real world
pedestrian safety, . Proceedings of the 21st (Esv) International Technical Conference on The
Enhanced Safety of Vehicles. National Highway Traffic Safety Administration, Stuttgart,
Germany.
McCartt, A., Wells, J., 2010. Consumer survey about vehicle choice. Insurance Institute for
Highway Safety, Arlington, VA.
Sanchez, M.C., Webber, C.A., Brown, R.E., Homan, G.K., 2007. 2007 status report. Savings
estimates for the energy star® voluntary labelling Program. . Lawrence Berkeley National
Laboratory LBNL-56380. Environmental Energy Technologies Division, Berkeley, CA.
Scott, M., Williams, R., Day, L., Rechnitzer, G., Walsh, P., Boyle, S., 2002. Safe tractor
assessment rating system. Technical reference document. Monash Accident Research
Centre and Kondinin Group, Clayton, Victoria.
Spalding, S., 2011. Dealer pilot – evaluation of using POS consumer information for used car
Safety ratings. Royal Automobile Club of Queensland (RACQ). Brisbane, QLD.
Spalding, S., King, M., 2006. Motor vehicle Safety levels - considerations for consumers in
used vehicle purchasing decisions. Australasian Road Safety Research, Policing and
Education Conference, 25-27 October 2006. Surfers Paradise, Qld.
Teoh, E.R., Lund, A.K., 2011. IIHS side crash test ratings and occupant death risk in realworld crashes. Insurance Institute for Highway Safety, Arlington, US.
Zmeureanu, R., Fazio, P., DePani, S., Calla, R., 1998. Development of an energy rating system
for existing houses. Energy and Buildings 29 (1999), 107-119.
Chapter 3 – Consumer rating and evaluation systems 53 Improving consumer information about motorcycle protective clothing CHAPTER 4 - CONSUMER CONSULTATIONS AND
FURTHER RESEARCH
The following chapter describes the outcomes of consultations with industry, riders and a
study of motorcycle clothing advertisements.
INDUSTRY CONSULTATIONS
Consultations with key representatives of the motorcycle accessories industry in Australia
and New Zealand were conducted to identify factors that need to be taken into account in the
development of any ratings systems in order to avoid unnecessarily compromising the
viability of the industry.
Organisations consulted included - Cassons, Peter Stevens, Monza, Draggin Jeans, Tiger
Angel, Forbes and Davies, Darbie Accessories, Nationwide Accessories, Northern
Accessories, Eurobike, Whites and Crown Kiwi.
The Australian representatives had already been consulted about aspects of improving usage
and the quality of motorcycle protective clothing and were familiar with the concept of a star
rating system (Currie Communications 2009). All expressed views that were either positive
or neutral about the prospects of an independent protective clothing rating scheme for
consumers, there was no overt opposition expressed to the interviewer.
It was apparent that a key incentive for the local industry would be if a ratings scheme could
help them to compete with cheaper low quality imports. Concern was also expressed about
the perceived high proportions of accessories being bought on-line from overseas companies.
Factors such as taxes and import duties were also raised and it was apparent that removal of
GST on motorcycle clothing that is defined as a safety product could provide a significant
incentive.
Due to the differences in seasons between the northern and southern hemispheres, time
frames in relation to the ordering process were an issue for some importers. They need to
order stock well in advance and some were concerned about buying stock before it has been
assessed with the risks of receiving a poor rating. Others did not seem to consider the
prospect of a rating scheme as a threat but saw little benefit to their own business.
The recent introduction of the new Australian Consumer Law (ACL) provides a further
incentive as this has introduced a new nationally consistent system to regulate the safety of
consumer goods and product related services. The ACL is contained in a schedule to the
Competition and Consumer Act 2010, which has replaced the Trade Practices Act 1974. The
schedule is also mirrored in state and territory fair trading legislation. The ACL’s product
safety provisions set out how the Australian and state/territory Governments can regulate
consumer goods and product related services to ensure they are safe. The new Act does not
rely solely on mandatory standards, but places the onus on the industry to ensure their
products are safe. Under the new Act anyone in the supply chain (e.g. manufacturer,
importer, retailer or hirer), can be held liable if a product is found to be unsafe.
Chapter 4 – Consumer consultations and further research
55
Improving consumer information about motorcycle protective clothing RIDER CONSULTATIONS
Initial consultations with rider representatives were conducted to identify the appropriate web
forums. Discussions about protective clothing were conducted on a number of web forums in
order to reach a wide range of different rider groups. The researcher applied to become a
member of each forum and disclosed her identity and purpose in joining to seek input into the
research program.
Successful approaches were made to: Netrider, PerthRiders, IronBark Riders, Kiwi Biker,
Two Wheels Forum, Sydney City Scooter Riders. Unsuccessful attempts were made to
establish discussion posts on: RidingSA, AusTouring, QLD Motorcycle Riders, and Rider
Awareness Northern Territory (RANT). The lack of success was due technical difficulties
with the website, in most cases, possibly because these are run on a volunteer basis. The
application to join was rejected as spam by the forum moderator in one case (AusTouring).
Following these web-based discussions a web-based survey was developed taking account of
issues raised by the industry representatives and riders on the discussion forums. Questions
focused on the ownership and usage of motorcycle clothing, factors associated with choice of
clothing, sources of reliable information and willingness to pay more for accredited products.
Other questions related to demographic details, type of bike ridden and income. The survey
was held on two separate websites and invitations to take part were distributed through two
parallel mechanisms. See Appendix D for the survey questions.
The first mechanism was to distribute invitations to participate in the survey through the
motorcycle networks (MN) including motorcycle internet sites, discussion forums and clubs.
The advantage of consulting with these groups is that they are more readily identifiable and
accessible as motorcyclists, and more likely to be informed about the issues; the disadvantage is
that they may not be representative of the average rider.
The second mechanism was to use a market research company to conduct the survey using an
established research panel. Research panels (RP) are comprised of people who have agreed to
take part in on-line surveys. Participants are rewarded for their participation in surveys
through points systems, which can be redeemed for gift vouchers. They are recruited through
involvement in off-line computer assisted telephone interviews (CATI), opt-in invitations on
survey websites, banners and advertising. A part of their registration process involves
completion of a questionnaire about their demographic details, which also includes a range of
non-mandatory questions including their licence status and vehicles owned. Subgroups can
be identified for specific surveys based on these details such as riding a motorcycle.
The advantage of using a research panel (RP) is to obtain a more representative sample of
motorcyclists than may be obtained using motorcycle networks (MN). While panelists’
willingness to participate in on-line surveys means they cannot be regarded as a random
sample of the wider community, the recruitment process also means they may be more
representative of wider motorcycling population than enthusiasts recruited through
motorcycle community networks (MN).
THE SAMPLES
The research panel survey (RP) was conducted within Australia only, as the market research
company did not operate in New Zealand. The motorcycle networks (MN) survey was
conducted in Australia (n = 309) and New Zealand (n = 90).
Chapter 4 – Consumer consultations and further research
56
Improving consumer information about motorcycle protective clothing The RP survey provided 625 usable responses and the MN survey provided 309 usable
responses. There were no significant differences in the distribution of age, licence status or
helmet usage between the two survey samples. There were significantly more women (38%
vs 9%) and more scooter riders (16% vs 2%) in the RP sample (p<0.0001).
The MN sample were more likely (p<0.0001) than were the RP sample to say that they
always wore a motorcycle jacket (88% vs 71%), pants (62% vs 32%), boots (81% vs 51%)
and gloves (92% vs 70%) and more likely to belong to a motorcycle club (49% vs 22%) and
visit motorcycle discussion forums (79% vs 25%). There were also no significant differences
in usage of motorcycle clothing between the New Zealand and Australian samples, however
it should be noted that the New Zealand sample were obtained solely through motorcycle
networks as the market research panels was restricted to Australia.
OWNERSHIP AND USAGE OF PROTECTIVE CLOTHING
Both surveys confirmed that riders were more likely to own motorcycle jackets and gloves
than either boots or pants. However, ownership did not necessarily imply always wearing
those garments. The MN sample was significantly more likely both to own and always wear
clothing. Figure 4.1 shows the proportions of the combined samples who owned and always
wore motorcycle clothing. The last column in the figure shows the proportion who owned
and always wore each item. Motorcycle pants were least likely to be always worn, with only
41% of all respondents always wearing and 58% of all who owned pants, always wearing
them. A higher proportion owned (80%) and always wore (61%) motorcycle boots. Those
that owned jackets and gloves were more likely to report that they always wear them.
Figure 4.1 Proportions of riders who own and who always wear each type of motorcycle
clothing (Australia).
Own
Always wear
Worn if owned
120%
100%
99% 98% 99%
84%
78%
80%
96%
92%
80%
72%
58%
60%
77%
79%
83%
61%
41%
40%
20%
0%
Helmet
MC long sleeved MC protective jacket
pants
MC Boots
MC Gloves
PURCHASING OF PROTECTIVE CLOTHING
A higher proportion of the MN sample than the PR sample, had bought motorcycle protective
clothing within the last 12 months (p< 0.0001), although a high proportion of both groups had
done so (84% vs 56%). The majority of purchases were in local retail shops, with 69% of the
MN and 82% of the PR groups saying they had never bought on-line from an overseas
Chapter 4 – Consumer consultations and further research
57
Improving consumer information about motorcycle protective clothing company. While a relatively small proportion had bought some products on-line, over 73% of
the PR group and 64% of the MN group had bought 60% or more of their gear locally.
Other riders were identified as the source of reliable advice about which motorcycle clothing
to buy, more frequently than any other identified source. Industry sales and marketing
products were rated higher than government websites and materials produced specifically for
the purpose of informing riders about protective clothing.
Table 4.2
Reliable sources of information about protective clothing
I can obtain reliable information about which motorcycle clothing to buy from: Other riders Staff in motorcycle clothing shops Australian motorcycle magazines product reviews Rider community websites Websites selling motorcycle clothing Rider trainers Advertisements in motorcycle magazines Overseas motorcycle magazines product reviews Government websites/ print materials The Good Gear Guide The Ride Forever website The Spokes website Agree/ strongly agree Research panel Motorcycle networks 85% 89% 77% 53% 76% 67% 67% 79% 61% 49% 57% 50% 52% 29% 47% 53% 40% 21% 36% 25% 30% 13% 26% 10% Asked about consumer information, almost half (49%) agreed that more should be done to
provide riders with independent evaluations of the quality of motorcycle clothing before they
buy. Twenty-one percent (21%) disagreed and 30% were undecided.
Half (50%) said that they would be willing to pay more for gear that had been independently
tested and accredited, 28% disagreed and 22% were undecided.
DISCUSSION AND CONCLUSIONS
The results of the two surveys indicate that almost half those surveyed felt more should be
done to provide riders with independent information about protective clothing and would be
prepared to pay for such information. However it is also of concern that a substantial
proportion of riders appear to believe they can obtain reliable information about motorcycle
clothing from their own informal networks and that they appear to be somewhat naïve as
consumers, placing high reliance on information provided by manufacturers through sales
and advertising information.
The surveys also established that the majority of those surveyed had bought motorcycle gear
within the past 12 months and had made these purchases in local retail shops. The latter
factor is particularly important as it assuages concerns that a locally based evaluation
program would be ineffective if a high proportion of purchases are made from other
countries. This finding is also important in reassuring the local industry concerns about
perceived increasing proportions of on-line overseas purchases.
THE USE OF SAFETY IN PROTECTIVE CLOTHING ADVERTISEMENTS
A small study conducted for the current project investigated the use of safety language in
motorcycle clothing advertisements in 2004 compared to 2011.
Chapter 4 – Consumer consultations and further research
58
Improving consumer information about motorcycle protective clothing BACKGROUND TO THE STUDY.
The period selected encompassed the ongoing testing program conducted by Ride magazine
in the UK , but also marked the advent of programs about protective clothing quality and the
European Standards, aimed at the motorcycle accessories industry in Australia and New
Zealand (ACC 2004, de Rome 2004, MAA 2005). These initiatives included:
A. In 2003, the results of a study funded by the MAA into motorcycle protective clothing,
was released and the finding promoted through the Motorcycle Council of NSW (MCC)
website and community activities such as Motorcycle Awareness Week (de Rome 2003).
B. In 2004, in New Zealand the ACC undertook a major program to address the increasing
numbers of motorcycle casualties. The program, called ‘Ride for ever’, included a campaign
to provide riders with information about the benefits of wearing protective clothing. This
included a website providing information about choosing appropriate products. The campaign
also targeted the industry and provided hard cover books containing detailed information
about the features of effective protective clothing referenced to the European Standards.
C. In Australia in May 2005, a seminar funded by the MAA was conducted for the
motorcycle accessories industry. The focus of the seminar was to alert the industry to the
release of the European standards and the implications this may have for their businesses. As
a result of the seminar a working group was formed to examine options for establishing an
industry based rating scheme (de Rome et al. 2005). However, despite a number of
subsequent meetings being held no further progress was achieved.
D. In 2006, VicRoads and the TAC commissioned a report into the potential for
establishing a rating scheme for protective clothing (Haworth et al. 2006). The authors
concluded that a star rating system, whether a voluntary industry system or an independent
system, had the potential to provide such information to consumers and contribute to
reductions in the severity of injury to riders. Since that time the TAC has undertaken further
work investigating the potential for such a scheme through consultation and research with the
industry and with motorcyclists. At the current time, pilot tests are being conducted to assess
the feasibility of running a motorcycle protective clothing consumer awareness program
based on the laboratory testing of garments according to the European Standards.
AIMS AND METHOD
The aim of the current study was to assess whether there were any changes in the use of
safety as a selling point for motorcycle clothing since the release of the standards for
protective clothing in Europe (1998-2003), and following the initiatives to raise awareness of
the protective clothing standards in Australia and New Zealand.
The contents of six road riding motorcycle magazines from the United Kingdom, New
Zealand and Australia in 2004 were compared with the corresponding issues in 2011. A total
of 452 clothing advertisements were analysed to establish the proportion of advertisements
using safety/injury protection or impact protection as a selling point compared to those
referring to non-safety factors such as comfort, weather protection and style. Key words for
impact protection included but were not limited to references to CE marked impact
protectors.
RESULTS
Overall the usage of safety words in advertisements increased from 31% to 51%, (p<0.0001)
and references to impact protection increased from 18% to 41%, (p< 0.0001). Between
countries there was also a significant increase in the proportion of advertisements using
Chapter 4 – Consumer consultations and further research
59
Improving consumer information about motorcycle protective clothing safety words in Australia (16% vs 30%, p=0.03) and the UK (44% vs 62%, p=0.03). There
was no comparative increase in New Zealand, but the baseline in 2004 was substantially
higher than either UK or Australia (See Table 4.3).
Table 4.3
Motorcycle clothing advertisements using injury protection as a selling
point in UK, NZ and Australia 2004 compared to 2011
Safety key words Not used Used P value Total 2004 Aus 124 (84%) 24 (16%) 148 NZ 19 (40%) 29 (60%) 48 UK 32 (56%) 25 (44%) 57 175 (69%) 78 (31%) 253 All countries 2011 Aus 47 (70%) 20 (30%) 0.03 67 NZ 7 (37%) 12 (63%) NS 19 UK 43 (38%) 70 (62%) 0.03 113 All countries 97 (49%) 102 (51%) <0.0001 199 272 180 452 Total There was also a significant increase in references to impact protection in advertisements in
the UK, but not in either Australia or New Zealand (see Table 2). Comparison between
countries for 2011 found that Australian magazines had a relatively lower proportion of
advertisements using safety or impact protection than either New Zealand (p<0.01) or the UK
(p<0.0001). There were no significant differences between New Zealand and UK.
Table 4.4.
Motorcycle clothing advertisements using impact protection as a selling
point in UK, NZ and Australia 2004 compared to 2011
Impact protection P value
Not used Used Total Aus 133 (90%) 15 (10%) 148 NZ 32 (67%) 16 (33%) 48 UK 43 (75%) 14 (25%) 57 All countries 208(82%) 45(18%) 253 55 (82%) 12 (18%) 0.12
67 10 (53%) 0.16
19 59 (52%) 0.001
113 <0.0001
199 2004 2011 Aus NZ UK 9 (47%) 54 (48%) All countries 118 (59%) 81(41%) Total 326 126 452 Conclusions
The research and consultants conducted provide encouraging evidence of rider support for the
provision of evidence based information about the effectiveness of protective clothing
products. The rider surveys indicate that appropriate publicity for such a program will need to
Chapter 4 – Consumer consultations and further research
60
Improving consumer information about motorcycle protective clothing establish the credibility of the scheme. In particular this should focus on the independent
scientific evidence base of the ratings. This would appear to be essential to counter the
apparent suspicion of information provided by road safety agencies in preference for the
personal opinions of other riders and sales information provided by manufacturers.
There are also indications of likely industry cooperation provided the implementation process
takes accounts of the potential risks for the industry which have been identified. In particular,
removal of GST from the sale of accredited safety equipment could be an effective incentive.
As Spaulding found, industry is unlikely to lead change that is perceived to constitute a risk
to business, but there is evidence from other product areas that as consumers become better
informed, industries will respond to changing demand. The observed changes in the use of
injury protection as a selling point in motorcycle clothing advertisements, particularly in UK,
may be a sign of the industry responding to market demand. While this should not be taking
to imply any causal links between increasing consumer awareness and particular programs
(e.g Ride) or campaigns to raise awareness of performance quality issues. It is however worth
noting that following the MAA seminar in 2005 an Australian company, Drag'in Jeans,
undertook to adopt the EU standards and have since achieved CE certification for one line of
products.
References
ACC, 2004. Ride for ever, http://www.rideforever.co.nz/gear/choosing-the-right-gear/. In: de
Rome, L. ed. Accident Compensation Commission, Wellington, NZ.
Currie Communications, 2009. Motorcycle protective clothing communications audit: Final
report. VicRoads Melbourne.
de Rome, L., 2004. Motorcycle protective clothing,
http://roadsafety.mccofnsw.org.au/a/75.html. Motorcycle Council of NSW, Sydney,
Australia.
de Rome, L., Stanford, G., Wood, B., 2005. Final report on gearing up a seminar on
motorcycle protective clothing and consumer protection in Australia Motorcycle Council
of NSW, Sydney.
de Rome, L., Stanford, G. & Wood, B., 2003. Motorcycle protective clothing. Road Safety
Research, Policing and Education Conference http://trid.trb.org/view.aspx?id=706134.
Sydney, NSW.
Haworth, N., de Rome, L., Rowden, P., 2006. Motorcycle protective clothing: Stage 1 review
of literature and development of a safety ‘star rating’ system (rsd-0299). A report to
VicRoads. In: Queensland, C.-Q.T.C.F.A.R.R.S. ed. Vicroads, Melbourne.
MAA, 2005. Gearing up - motorcycle protective clothing - May 2005,
http://roadsafety.mccofnsw.org.au/a/107.html. Motor Accidents Authority, Sydney,
Australia.
Chapter 4 – Consumer consultations and further research
61
Improving consumer information about motorcycle protective clothing CHAPTER 5 - QUANTIFYING THE ECONOMIC AND
HUMAN COSTS OF MOTORCYCLE CRASHES
INTRODUCTION
There are no clear definitions of economic and human costs of crashes and injuries in the
literature. Some authors understand economic costs to be any costs that have a market price
(e.g. workplace productivity, vehicle repair costs) and human costs to be other costs that do
not have a market price (e.g. quality of life loss). Others understand human costs to be any
costs related to human loss, which includes economic costs such as productivity loss. From a
pure economics point of view, economic costs are any costs that have an opportunity cost.
Hence, for the purpose of outlining the methodological options for quantifying the costs of
road crashes involving motorcyclists and pillion passengers, it is useful to first list all the cost
items from the broadest societal perspective (i.e. all costs and consequences to whomsoever
they accrue). Inclusion or exclusion of some items can be then considered as options to
quantify motorcycle crash costs depending on the study context.
From a societal perspective, the relevant road crash costs are those accrued by the road crash
victims, their families, government, insurers, and taxpayers. Other narrower viewpoints
include a specific provider of the safety intervention, the consumers, or a third-party payer
(public or private). The viewpoints of the study guide what cost items are to be included and
omission of any relevant viewpoints must be justified. The appropriateness of the viewpoints
taken would depend on the decision making context.
When weighing the costs against the benefits of improved quality and uptake of protective
clothing, the most relevant costs are those that protective clothing is able to influence.
Protective clothing is not a crash prevention measure, but a crash consequence reduction
measure. In the event of a crash, protective clothing has the potential to prevent an injury or
reduce the severity of the injury consequences, but is likely to have little or no impact on fatal
injury crashes (EEVC 1993; Noordzij, Forke et al. 2001).
The final results for the costs of road crashes involving motorcyclists and pillion passengers
are naturally sensitive to the methods employed to calculate them. These methodological
factors that influence the magnitude of the estimations include the definitions and
classifications of road crash injuries, the availability and quality of data, the approaches taken
to estimate values of human life, and the assumptions made to accommodate the limitations
in the data. Therefore these issues will be discussed in the next sections. Finally the options to
quantify road crash costs involving motorcyclists and pillion passengers will be summarised
following the discussion.
APPROACHES TO QUANTIFYING MOTORCYCLE ROAD CRASH COSTS
There lacks consensus on the most appropriate approach for computing road crash costs
(Alfaro et al, 1994; Elvik, 2000). Understanding how road crash costs have been categorised
can assist in the determining which approach to take. The valuation of reductions in road
deaths can be made by the individuals who could experience road death or by the society as a
Chapter 5 – Options for cost benefit analysis of increased usage of protective clothing
62
Improving consumer information about motorcycle protective clothing whole (Evans, 2001). From an individual perspective, the costs of a road death include
material and immaterial costs. Material costs consist of the individual consumption that could
have occurred in the life years lost. Immaterial costs have no market price and represent the
loss of joy of life and the value of pain, sorrow and distress of the casualties and their
relations (Wijnen et al, 2009). The willingness-to-pay (WTP) approach can account for these
two costs.
However, for society as a whole the value of a road death is also determined by gross
production loss and medical costs (e.g. Alfaro et al, 1994; Persson & Odegaard, 1995), which
are not borne by the individuals directly. Gross production loss, which includes the individual
consumption loss, can be estimated by the human capital approach (HCA). Values derived
from the HCA are often found lower than the values derived from the WTP approach because
HCA is restricted to the economic costs and does not include human costs. Both approaches
have pros and cons as summarised in Table 5.1.
The HCA is based on the principle that the benefit of avoiding a premature death is given by
the present value of the income flow the economy could lose in such an event (Ashenfelter,
2006). It estimates the life-time earning foregone as the result of a productivity-reducing
disability and death. Some argue that the HCA tends to overestimate the true productivity
losses to the economy because the loss of an individual worker from the workforce only
creates transitory productivity loss (Koopmanschap and van Ineveld, 1992; Koopmanschap et
al, 1995). It is argued that another worker can replace the injured worker eventually.
The WTP approach seeks individuals’ valuation of the consequences of an intervention in
terms of the amount of money that individuals are willing to pay for reducing the risk of their
premature death or of injury (Gafni 1991; Hensher et al, 2010). It is implemented to elicit
individual preferences, predominantly through the application of contingent valuation (CV)
method. CV method uses surveys to elicit how much individuals would pay for the product.
Alternatively revealed preference (RP) method uses data on actual purchasing behaviour of
individuals for risk reducing products (e.g. protective clothing). Pros and cons of these
methods are summarised in Table 5.2. Other than the WTP approach, court-based
compensation awards have also been used as an alternative measure (BTE, 2000). All these
methods aim to estimate a monetised measure of not only income loss but also a reduction in
the enjoyment of life that arises due to disability or death. The HCA misses the latter source
because the same level of income does not provide the same level of satisfaction as it would
have been in the absence of the disability.
Chapter 5 – Options for cost benefit analysis of increased usage of protective clothing
63
Improving consumer information about motorcycle protective clothing Table 5.1 The pros and cons of the willingness-to-pay (WTP) approach and the human
capital approach (HCA)
WTP approach (ex-ante value)
HCA (ex-post value)
Pros Reflect people’s preferences (consistent Transparent, verifiable value
with welfare economics)
Provides valid lower bound estimate
Reflect one’s immaterial value of life
(quality, pain, grief, suffering of family
and friends)
Cons Empirical difficulties
It calculates earning capacity loss, which
means higher values are assigned to
working age people than younger and
older people. Hence the value of younger
and older people’s lives are undervalued.
Ignore immaterial costs
Sensitive to discount rate chosen
Table 5.2 The pros and cons of the two methods used to elicit WTP value: revealed
preference (RP) method and contingent valuation (CV) method
RP method
CV method
The survey can incorporate a descriptor
Pros Based on actual behaviour
that describes risks and risk reduction
level, the pros and cons of the product to
be valued.
Cons Limited applicability in road safety (e.g. The values are obtained in hypothetical
airbags cannot be purchased separately
scenarios.
because it is attached to the car; seatbelts
are obligatory).
The values are not considered under
budget constraints. Hence it may not be
Unrealistic assumption that people
feasible to allocate large resources for
correctly assess the risks that they take
marginal changes in safety.
and the risk reduction obtained from the
purchase when paying for the product
It only measures the preferences of
affected individuals only.
The theoretical superiority of the WTP approach lies in the value placed on the immaterial
aspect of road crashes, while the criticism of WTP approach lies in the practical/empirical
difficulties in assigning valid and reliable values of immaterial costs due to the lack of actual
market transactions to verify them. Value of road death prevention is variable with the
methods used, respondents’ income, their initial risk and age, individual or group risk, degree
of voluntary acceptance of or familiarity with the risk, the road safety intervention being
public or private. Hence a constant value cannot be obtained from the literature for Australia.
WTP values tend to be more reliable when it is context specific because WTP is a measure of
preference of specific individuals or groups who are affected by certain proposals. WTP
value should be determined for each road safety measure and its target group.
Chapter 5 – Options for cost benefit analysis of increased usage of protective clothing
64
Improving consumer information about motorcycle protective clothing The WTP approach is particularly suited to estimate the safety value of protective clothing.
This is because there are several unique features of protective clothing that make it less/more
valued as a safety product and it only affects specific road users (i.e. motorcycle riders). CV
surveys can be designed in such a way to maximize validity and reliability of the WTP
values. For example, in the descriptor of the CV survey the limitations of protective clothing
such as heat stress and discomfort (de Rome, 2006) could be clearly identified at the same
time as the safety benefits of protective clothing. This would elicit the value of protective
clothing with all its apparent pros and cons taken into account. That is, the costs borne by
those who are affected by protective clothing is already taken into account in the value
estimation.
TYPES OF DATA REQUIRED
Items one to 19 in Table 5.3 provide a schematic presentation of the total societal costs of
road crashes. These cost items are all used by BITRE (2009), BTE (2000), and the Dutch
Ministry of Transport (Ministry of Transport, 2004). They are consistent with European
recommendations with the exception of traffic delay costs (Alfaro et al, 1994). However,
traffic delay costs are particularly relevant for motorized countries like Australia as it was
found as one of the major costs of road crashes by BITRE (2009).
In addition to the first 19 items presented in Table 5.3, road crash intervention specific costs
may also be included in the cost calculations (items 20 – 22). For example, if the costs are
being weighted against the safety benefits of increased quality and uptake of protective
clothing, then an additional cost incurred to achieve them should also be included in the list.
On the other hand, some of the cost items 1 – 19 may be excluded on the basis that they are
not likely to influence the magnitude of cost savings because protective clothing does not
target them, for example protective clothing cannot prevent crashes. The largest cost savings
that could be made from protective clothing are likely to be for non-fatal injuries because the
most common consequences of crashes involving motorcyclists are minor and moderate (AIS
levels 1 and 2) injuries (ACEM, 2004). AIS refers to Abbreviated Injury Severity, which is a
scale from 1 (minor) to 6 (maximum) developed by the Association for the Advancement of
Automotive Medicine (AAAM 1990). Hence items such as 5 and 13 may not be as important,
while items 3 and 8 are of particular importance. In order to increase quality and uptake, cost
accruing measures such as promotion, public education, and enforcement may be required. If
a piece of protective clothing is damaged in the event of a crash, that piece should also be
replaced. If it is assumed that in the event of a crash protective clothing must always be
replaced, then replacement costs could be estimated from the number of crashes involving
motorcyclists and pillion passengers, the usage rate of protective clothing amongst them, and
the average price of protective clothing used by them based on market price. However, in
some cases protective clothing may be left intact after a crash and this estimation may
overestimate the replacement costs. Data on failure rate of the clothing may also be used in
the estimation. Failure rates could be obtained for products currently available in the market
as reported by international consumer testing programs (Ride 2005; Ride 2008; Ride 2009;
Ride 2009). Data on failure rates of clothing worn by Australian riders is also available from
the GEAR study (de Rome, Ivers et al. 2011). There are also intangible costs for the riders in
terms of discomfort of wearing clothing in the heat. This could be taken into account through
the WTP approach as described in the previous section.
Table 5.3 also categorizes cost items by perspectives to guide inclusion/exclusion of costs
based on the perspectives taken in the study. Depending on the decision making context, one
study may choose to quantify the costs from the government and insurers’ perspectives only,
Chapter 5 – Options for cost benefit analysis of increased usage of protective clothing
65
Improving consumer information about motorcycle protective clothing or another from the crash victims and their families and the intervention specific costs only.
For example, in the decision-making context of whether to implement a consumer
information program on motorcycle protective clothing (e.g. star rating system) or nothing (or
an alternative program), the costs and benefits associated with implementation of the program
and the alternative might be considered from the viewpoints of (a) the Australian Compulsory
Third Party (CTP) agencies, (b) Australian road authorities (the agencies that will incur the
protective clothing assessment costs) (c) protective clothing manufacturers, and (d)
motorcycle riders incurring out-of-pocket costs.
Table 5.3 Schematic presentation of the cost items to quantify road crash costs
involving motorcyclists and pillion passengers from a societal perspective.
Road crash
Wider Government
intervention societal services costs
specific costs costs
Health system and
Insurers’ costs
Costs for crash victim
and their families
Perspectives
Item
Cost
No.
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
Cost items
Workplace productivity
Household productivity
Workplace disruption and staff
replacement
Quality of life loss, pain and
suffering
Funeral
Unavailability of vehicles
Medical, ambulance and
rehabilitation
Long-term care
Insurance administration
Property damage
Vehicle repair
Towing
Coroner
Police
Fire and emergency services
Legal
Correctional services
Travel delays
Health cost of crash-induced
pollution
Program operational costs
Protective clothing replacement
costs
Costs borne by only those
wearing protective clothing
TOTAL
Column A: Cost
per unit ($)
Column B:
Number of
cases(n)
Column C:Subtotal ($ x n)
-
-
Sum of subtotals for items
1 – 22
Once all the relevant cost items to be included in the total cost estimation are identified, the
individual items must be measured and valued. In reference to Table 5.3, and in simple terms,
the total cost of road crashes is the sum of the subtotals of each cost item (Column C), each of
which is the product of the unit cost (Column A) and the number of cases for each item
(Column B). However, the costs identified in Table 5.3 are not common to all types of
Chapter 5 – Options for cost benefit analysis of increased usage of protective clothing
66
Improving consumer information about motorcycle protective clothing motorcycle crashes because they vary in consequences from no or minor injuries to fatal
injuries. In order to quantify the costs associated with motorcycle crashes which protective
clothing can influence on, the unit costs (column A, Table 5.3) and the number (column B,
Table 5.3 of cases must be obtained for hospitalised injuries, non-hospitalised injuries, and
property damage only crashes respectively. These figures must be obtained for those
involving motorcyclists and pillion passengers specifically.
AVAILABLE SOURCES OF DATA AND THEIR LIMITATIONS
ROAD CRASH DATA
Not all crashes on a road are considered by authorities to be road crashes, and not all crashes
occur on public roads. A clear definition of road crashes is required to ensure the data
collection is consistent over time and between different jurisdictions or intervention
alternatives that are compared within a study. It also allows legitimate comparisons between
studies.
Road crashes also have varying levels of consequences. Depending on the severity of the
consequence, the costs can be minor to quite significant. Injury costs depend on factors such
as injury type, injury severity, age and gender of the affected person, length of
hospitalisation, and whether the injury effects are short or long term (BITRE, 2009). For
maximum accuracy, the unit costs for each item would at least need to be estimated
separately for different injury severity levels. Hence, for costing purposes, road crash
consequences must be categorised into different groups and clearly define road crash injuries
at the outset.
The Bureau of Infrastructure, Transport and Regional Economics (BITRE, 2009) used the
following definitions in their estimation of road crash costs in Australia in 2006.
A fatal injury (road fatality) is defined as a death resulting from a road crash occurring on a
public road, with unintentional death occurring within 30 days from injuries sustained in the
crash.
Non-fatal injuries are classified as either hospitalised or non-hospitalised injuries:
A. Hospitalised injuries include persons who were admitted to hospital regardless of
their length of stay. Severity of hospitalised injuries:
 Severe to catastrophic injuries: 61 - 211 bed days
 Moderate to severe injuries: 30 - 60 bed days
 Mild to moderate injuries: 1- 30 bed days
 Admitted and discharged the same day
B. Non-hospitalised injuries include persons who attended hospital but were not
admitted, and those who received treatment from a general practitioner. This
excludes people who did not seek medical treatment.
Other distinctions of injuries include those used by BTE (2000); serious injuries (hospital
admission for 24 hours or more) and minor injuries (hospital admission of less than 24 hours
or first aid at the scene of the crash). However, these descriptors do not relate to measures of
injury severity such as the Abbreviated Injury Score (AIS), Injury Severity Score (ISS) and
Chapter 5 – Options for cost benefit analysis of increased usage of protective clothing
67
Improving consumer information about motorcycle protective clothing New Injury Severity Score (NISS). The potential data sources to obtain the number of crash
cases involving motorcyclists and pillion passengers are summarised in Table 5.4.
Table 5.4. Data sources to quantify motorcycle road crash incidence and costs.
Type of injury
Number of
cases
Data source
Fatality
Police reported crash data from State and Territory authorities,
BITRE, Infrastructure Australian Road Deaths Database
Hospitalised injuries - 1
night or more
AIHW –serious injury due to land transport accidents
Non-hospitalised injuries
d data
i
CTP claims
h
i l d i i
/
i
d
Total
Injured motorcyclists are known to be underrepresented in state crash datasets with only 29%
of injured motorcyclists involved in single vehicle crashes appear in state crash records
(Rosman and Knuiman 1994). When there is a risk of underestimation, it is appropriate to
adjust the estimates whenever the magnitude of underreporting can be estimated reasonably
from self-report surveys or data from other jurisdictions. It has previously been reported that
only 55% of motorcyclists involved in a serious crash reported the crash (de Rome &
Brandon 2007). Number of motorcycle crashes in police crash records could be adjusted
upwards using data from previous studies like de Rome & Brandon (2007) and Rosman et al.
(1994). If particular types of crashes are missing from the data in some jurisdictions, they
could also be estimated through extrapolation of data that is available in other jurisdictions.
For example, number of property damage-only (PDO) crashes in Victoria was estimated
using average crash ratios for all other jurisdictions in the BITRE’s road crash cost estimation
(BITRE 2009). Alternatively the proportion of PDO crash costs of the total crash cost
estimate supplied by BITRE (2009) or BTE (2000) can be used to estimate the cost of PDO
crashes in each state and territory (Connelly and Supangan 2006). Such assumptions,
although sometimes crude, may be useful to complement the imperfect official data and
increase the validity of cost estimates.
INJURY SURVEILLANCE AND CLAIMS DATA
Injury surveillance and claims data will provide more reliable estimates of the actual
incidence and costs of motorcycle crash injuries than data based on police reported crashes.
Unlike fatalities, data on the number of people injured in road crashes is not systematically
collected and studies have identified substantial underreporting of injuries in official crash
data. Although reporting levels increase with casualty severity, less than 65% of hospital
casualty records are in police records (Rosman and Knuiman 1994, Rosman 2001). Lower
severity crashes, single vehicle and PDO crashes are commonly underreported in police crash
records because police are far less likely to be involved and/or reporting is not compulsory in
some jurisdictions unless it exceeds a certain threshold (Lin and Kraus 2008; BITRE 2009).
The quality of incidence data on unreported road crashes, non-hospitalised injuries, and on
PDO crashes has also been reported as relatively poor by BITRE (2009). Sole reliance on
official data where such underreporting exists could be particularly problematic for
estimation of crash costs involving motorcyclists and pillion passengers because the most
common consequences of crashes involving motorcyclists are minor and moderate (AIS
levels 1 and 2) injuries (ACEM, 2004).
Chapter 5 – Options for cost benefit analysis of increased usage of protective clothing
68
Improving consumer information about motorcycle protective clothing This is critical to the estimation of motorcycle injury costs and protective clothing because
the largest cost savings that could be made from protective clothing are for non-fatal injuries
(EEVC 1993). It is also important to include injuries of all levels of severity because minor
injuries have been estimated to account for 88% of quality adjusted life years lost due to
injury in the first 6 months following a crash and for 91% over the remaining lifetime
(McClure and Douglas 1996).
HOSPITAL ADMISSIONS DATA
Hospital admission data have become the primary source of information about seriouslyinjured crash casualties in Australia (BITRE 2009). Hospital data provide information on:
injury by body region; demographic characteristics of the injured people; length of
hospitalisation and the nature of categorisations (for example, died in the hospital due to
injuries). Although these data are more likely to record motorcyclist casualties, hospital data
are not linked with crash data and they only include injured individuals who are admitted to
the hospital. BITRE’s national crash database for 2006 includes details of crashes for all
severity (fatal, hospitalised injuries, non-hospitalised injuries, property damage only), and
standardised vehicle types (cars, motorcycles, buses, rigid and articulated trucks) (BITRE
2009). They were provided by state and territory authorities and hence the crash data are
disaggregated by state or territory, metropolitan or non-metropolitan area. They made
estimates of non-hospitalised injuries based on data from TAC, AIHW, and ABS. Therefore
BITRE’s national crash database is an option to obtain motorcycle crash injury details.
INJURY INSURANCE CLAIMS
Claim cost estimates from injury insurance claims will also differ depending on jurisdiction
as different policies and claims thresholds apply. For example, in states where the
compulsory third party (CTP) schemes are fault-based (e.g. NSW and QLD), riders defined to
be at-fault are not eligible to claim and, as a result, motorcycle related injury costs may be
underestimated for those states. Whereas the ACC scheme in NZ and the TAC in Victoria,
are comprehensive schemes and not fault based, however in Victoria non-hospitalised
claimants are required to pay the first $564 of their costs, so those injuries may be excluded
from the TAC database. When insurance data from each jurisdiction is used, the insurance
policies must be well understood to ensure that the measurement of each variable is
consistent between jurisdictions.
INJURY COSTS
Injuries can trigger both immediate costs (e.g. ambulance transport) and flow-on longer term
costs that result from two main adverse outcomes of injuries – impairments and disabilities.
The number of people with impairments can be estimated using claims data provided by
Transport Accident Commission (TAC) of Victoria for persons who made a claim due to
injuries received in a road crash in Victoria and data obtained from Australian Institute of
Health and Welfare (AIHW). Disabilities are long-term outcomes of road crash injuries. Such
information is not available from police and hospital data. The number of people with
disabilities mainly caused by an injury that occurred on the road can be estimated from the
ABS (2004) data. The cost of a certain type of crash injury depends on factors such as
severity, age and gender of the injured person, length of hospitalisation, and whether the
effect are short or long term duration (BITRE 2009). Hence the methods to quantify crash
injury costs must account for all such interactions.
Chapter 5 – Options for cost benefit analysis of increased usage of protective clothing
69
Improving consumer information about motorcycle protective clothing Finer unit costs can be obtained where injury costs per highway crash victim were estimated
by body part injured, fracture involvement, and threat-to-life severity scores using the
Abbreviated Injury Scale (AIS) in the USA (Zaloshnja, Miller et al. 2004). They are in US$
and year 2000 values. Such data are especially useful for quantifying cost savings of
measures like protective clothing that target narrow ranges of injuries. This study also
highlighted the importance of applying the same coding system for injury cost calculations
and coding injury incidence data as the AIS scale has been revised several times since it was
first developed. Success versions are named for the year of issue, i.e. AIS90, AIS2005. For
example, 29% of injuries would change severity score when shifting from AIS85 to AIS90
(Garthe et al. 1996). Hence, adoption of figures from other sources must ensure that the same
classification methods (e.g. AIS2005) are used for the incidence data as for the unit cost data.
There are a number of options for how crash costs may be valued by items. These are listed
in Appendix E the data variables required and the potential data sources. These options are
based on what was used by BITRE (2009) because a lot of the limitations from previous
estimations, e.g. (BTE, 2000), were overcome with improved methods. For example, the
limitations in the HCA and WTP approach were managed respectively in their
approximations of workplace and household output losses and intangible loss of life and/or
quality of life. In addition, BITRE (2009) estimates are the most comprehensive and latest
published figures available for crash costs in Australia. The table in green background
describes injuries, and other property and general costs are summarised in purple background.
Injuries were further categorised to cost them by different severities, but the definitions for
injuries are presented in one table.
MANAGEMENT OF DATA LIMITATIONS
The estimation of crash costs is an inexact science (BTE 2000). Due to the limitations in the
data quality and availability and to the requirement of data collection from disparate sources
to reach a final estimate, some clear assumptions must be made in practice. It is critical that
any assumptions made in the calculations are clearly presented and justified.
Variations in road crash costs across Australian jurisdictions have been observed due to
variability in the number of crash-related fatalities and injuries and of population and in the
cost of services/materials (Connelly & Supangan 2006; BITRE 2009). Unit cost data by all
the eight states and territories can be collected to obtain the national sum. Alternatively, a
range estimate using data from some states (e.g. three states representing the smallest,
medium, and largest population) could be collected. The largest crash costs were observed in
New South Wales, the smallest in ACT, and Western Australia was about mid-range in 2006
(BITRE 2009). Extrapolation of state data to make national estimates can be practically
useful, especially when some states lack certain data while others have the data. In the USA
for example, national total number of ambulance transports was estimated from applying the
proportion of injured motorcyclists transported by ambulance in San Diego County (Max et
al. 1998). Such assumptions made to obtain national estimates must be clearly reported in the
study.
Injury cost computation is extremely complex; however BITRE (2009) has calculated these
costs for all road crashes in 2006. Estimated social cost of road crashes involving
motorcycles is 20.2 cents per kilometre travelled in 2006 value (BITRE 2009). However
while the methodology may be robust for other road users, the estimates of kilometres
travelled for motorcycle should be used with caution as they are extrapolations based on
survey data with a standard error rate of between 10% and 50% in (ABS 2008; ABS 2011).
Chapter 5 – Options for cost benefit analysis of increased usage of protective clothing
70
Improving consumer information about motorcycle protective clothing While the BITRE 2006 Australian dollar (AUD) values could be converted to the present
value using the annual geometric mean of the Australian Consumer Price Index for the
intervening period e.g. (Connelly & Supangan 2006) with the assumption that nothing but
purchasing power of each AUD has changed. It must be noted that changes in trend as well as
changes in injury classification codes can make extrapolation of old data solely based on CPI
limited in validity. For example, admissions in the high threat to life group have been
increasing with growing numbers of injured male motorcyclists and pedal cyclists (Berry &
Harrison 2008). Significant differences in cost values can be observed when old published
costs adjusted for inflation are used rather than costs that are updated with the incidence and
cost data based on the most current injury severity classification (Zaloshnja et al. 2004).
Hence, for an assumption such as CPI adjustment, it must be justified with evidence that no
other significant changes have occurred since the old data were collected. Alternatively,
further assumptions could be made and old figures adjusted to accommodate the known
changes that are likely to have influenced the old figures in today’s values.
When costs occur in future years, present value, the amount one would have to invest today
in order to pay these costs when they come due, must be computed. The present value can be
derived from using an appropriate discount rate. The choice of an appropriate discount rate is
controversial, Burkhead & Miner. (1971). BITRE (2009) and BTRE (2006) used a discount
rate of 3%. This rate falls well within the range of discount rates used by other practitioners
to estimate human costs (Murray, Lopez and Jamison 1994; Vos and Begg 1999; BTRE
2006; Abelson 2008; Potter Forbes, Abelson, and Driscoll 2006). The inflation-free 3%
discount rate is often applied because it is recommended by the Panel on Cost-Effectiveness
in Health and Medicine (Gold et al. 1996; Weinstein et al. 1996). The use of a higher social
discount rate results in a lower estimate of the present value of the human losses, while a
lower social discount rate results in a higher present value. Hence, the final results could
change with the assumption made to value costs that occur in future years, which brings to
attention the importance of sensitivity analysis highlighted in the next methodological
imperative.
The best costing studies are the ones that are most inclusive of all costs. The costs of road
crashes should be considered from the broadest perspective, which is commonly understood
as the societal perspective. However, it is often not feasible to consider every single cost and
consequence of an intervention to all members of society, and some items may have to be
excluded for practical reasons. Some cost data may be too resource intensive to collect. The
effort to collect such data may not be justifiable especially if they tend to be so small that
they are unlikely to make any difference to the overall result (Drummond et al. 2005). The
quality of the costing study may be increased with more investment in the study but this extra
investment may not be worthwhile in situations where the benefits clearly outweigh the costs
and extra costs added may not change this fact for example. Cost items in Table 5.4 are
broadly listed in decreasing order of cost magnitude within fatalities, injuries, and other costs
respectively, as found for Australian road crash costs in 2006 by BITRE (2009). Another
option might be to exclude cost items that are too resource intensive to collect for the overall
value of the study results. However, any exclusion of societal cost items must be justified or
assumptions could be made based on previous empirical evidence (e.g. utilise figures from
other states or countries and convert them to AUD values in the present value of the study).
Although the estimation of them might not be pursued in great detail, it is still worthwhile to
identify such cost items (Drummond et al. 2005).
Chapter 5 – Options for cost benefit analysis of increased usage of protective clothing
71
Improving consumer information about motorcycle protective clothing Sensitivity analysis is necessary to adequately reflect uncertainty in evidence in the
conclusions of the analysis. Economic evaluation methods are not without limitations but
they can be managed in the methods. The limitations are largely due to the potential
fluctuations in monetary values assigned to the costs and gains. This is especially true when
the intervention evaluated requires an investment now but produces gains in the future when
the money values have changed. Discount rates are used to express values across different
years in the same single year to accommodate the temporal changes in money value. For
example, discount rates are used to estimate workplace and household losses over the years.
However, the final outcome of economic evaluation can change largely depending on the
discount rate used (e.g. 3% versus 10%). While the most appropriate discount rate is
unknown, conduct of sensitivity analysis using different discount rates is critical to
demonstrate the robustness of the cost estimates. It is important to present how much the
results would have changed if the discount rates of say 2% and 5% were used instead of 3%.
For example, BITRE estimates of total crash costs based on 3% discount rate would increase
by approximately $1.5 billion (8.4%) with a discount rate of 2%, and would decrease by
approximately $2 billion (11.2%) with a discount rate of 5% (BITRE. 2009). What sensitivity
analysis to conduct would depend on the nature of the data for each study. However the
results will commonly be sensitive to the discount rate used, gender, and age.
Options
1. Collect the most recent available data based on the definition of road crashes and
classifications of injuries used by either:
a. BITRE (2009);
b. Each and every jurisdiction or a representative jurisdiction/s;
c. The CTP schemes:
i. in the non-fault based states i.e. TAC of Victoria and ACC of New Zealand in the
fault-based states i.e. MAA of NSW.
ii. in all states and territories of Australia.
2. Some or all of the cost items in Table 5.3 may be used to quantify the crash costs
involving motorcyclists and pillion passengers. The inclusion and/or exclusion may be
based on:
a. The perspective taken in the study;
b. The relative cost saving impact they have in respect to increased use and quality of
protective clothing; and/or,
c. The likely impact of the items on the overall costing results in terms of the cost
magnitude;
d. The approach taken to value human life.
3. Approach taken to value human life:
a. Use the HCA approach and ignore the intangible costs of road crashes in the total
estimate; or,
b. Use the WTP approach; or,
c. Use the hybrid of HCA and WTP approach to include both the tangible and intangible
costs of road crashes.
4. Methods of valuing intangible costs of road crashes involving motorcyclists and pillion
passengers:
a. Contingent valuation survey or revealed preference studies may be developed to
obtain a WTP value; or,
b. The amount paid out by CTP insurance schemes may be used to obtain the proxy
value of the intangible costs.
Chapter 5 – Options for cost benefit analysis of increased usage of protective clothing
72
Improving consumer information about motorcycle protective clothing 5. Number of road crashes involving motorcyclists and pillion passengers could be obtained
from
a. Police crash records of each jurisdiction; (This may confront the perhaps slight
differences between the states in their definitions, and in the data they collect on crash
injury severity. Most states only distinguish minor and serious injuries without a clear
medical basis for this distinction.)
b. ABS;
c. CTP insurance data;
d. The Infrastructure Australian Road Deaths Database;
e. Hospital data; or,
f. A combination of all of the above.
6. Cost computation options:
a. Use the data sources and computation methods listed in Table 5.4 to value each cost
items relevant for road crashes involving motorcyclists and pillion passengers;
b. The most direct and simplest option may be to use BITRE (2009) data on crashes and
costs for 2006 and update it to 2010 values, given their use of sound definitions and
reasonably comprehensive ratings of severity. The adjustments could be made
through:
i. CPI adjustments and updating crashes by adjusting to the rates of motorcycle
crashes from 2006 to 2010. This in effect assumes the same ratio of injuries
occurred in 2010 as in 2006;
ii. CPI adjustments and research what other factors could have played a role in
changing these values besides CPI.
7. The final estimate:
a. Derive a single national estimate through collation of data from each and
every jurisdiction;
b. Make national range estimates from particular states;
c. Assume one of the jurisdictions as the representative value of Australia e.g.
Victoria
8. Assumptions:
a. When making national estimates from sum of each state and territory of Australia,
some data may be missing in particular jurisdictions. In such cases, use average
estimates from the jurisdictions that have the data.
b. When considering costs that occur in future years, use the recommended discount rate
of 3% and conduct sensitivity analysis of the results using other rates.
c. Other assumptions depend on the choices made in relation to other aspects of this
document. For example, if the expedient option of extrapolation from 2006 crash data
is adopted, then the assumptions entailed there must be spelt out.
9. Sensitivity analysis:
a. Investigate in the study what factors are most likely to influence the final results and
conduct sensitivity analysis accordingly.
b. Do not conduct sensitivity analysis.
Chapter 5 – Options for cost benefit analysis of increased usage of protective clothing
73
Improving consumer information about motorcycle protective clothing OPTIONS FOR QUANTIFYING THE POTENTIAL BENEFITS OF IMPROVED
QUALITY AND UPTAKE OF PROTECTIVE CLOTHING.
While costs are always quantified in monetary units, benefits can be quantified in various
units of measurement. Economic evaluation is a method of assessing different interventions
in terms of their relative costs and benefits. It is broadly categorised into four types
depending on the unit of measurement used for the benefits. When the benefits are expressed
in terms of the effectiveness of the intervention such as lives and/or injuries saved, or number
of life years gained the economic evaluation is called ‘cost-effectiveness analysis’ (CEA).
When the benefits are measured in terms of quality-adjusted life years (QALYs) or disabilityadjusted life years (DALYs), it is called ‘cost-utility analysis’ (CUA). When the benefits can
be expressed in monetary terms the economic evaluation is called ‘cost-benefit analysis’
(CBA). The default economic evaluation when the interventions under comparison are found
to have the same level of benefits, it is termed ‘cost-minimisation analysis’ (CMA).
The most apt unit of measurement for the benefits would depend on the nature of the
intervention, the availability of data, and the decision-making context. The aim of CBA is to
value the full range of health and other consequences of an intervention option and compare
this with resource costs (Briggs et al. 2006). When there are effects with several dimensions,
CBA is more suitable than CUA or CEA. For example, road safety interventions have effects
on mobility, environment, travel times, and safety against each other and against the costs
(Wijnen et al. 2009). Neither CEA nor CUA answer the question of whether an investment is
socially profitable while CBA does. The aim of CEA and CUA is to look at each and every
use of resources and select the intervention which maximises the health objective subject to
the budget constraint (Stinneett and Palitel 1996). Both CEA and CUA are useful when a
given end is deemed worthwhile (e.g. number of life years saved) and the remaining question
is what the best way is to achieve that end (e.g. primary prevention program A versus primary
prevention program B).
Benefits of protective clothing have been quantified in various ways in previous studies
(Table 5.5). Benefits of increased quality and uptake of protective clothing can be quantified
in similar ways. The most relevant and critical road safety gain to be had from protective
clothing is injury reduction benefits. These injury reduction benefits could also be monetised
through the WTP approach described in the costing section above. It is important to outline
three methodological implications that must be taken into consideration in order to quantify
the benefits of improved quality and uptake of protective clothing. The options to quantify
them will then be listed in light of these methodological imperatives.
Chapter 5 – Options for cost benefit analysis of increased usage of protective clothing
74
Improving consumer information about motorcycle protective clothing Table 5.5 The units of measurement used in previous studies to quantify the benefits of
protective clothing in comparison to no protective clothing
Outcome investigated
Hospital admission
Days in hospital
Days until return to work
Permanent physical defect
Soft tissue injury
Deep and extensive injury
Fractures (e.g. complex leg fractures, upper body,
hand/wrist, lower body, ankle/feet)
Cuts and abrasions
References
de Rome et al, 2011
Schuller et al. 1986, de Rome et al, 2011
Schuller et al.1986, de Rome et al, 2011
Schuller et al. 1986, de Rome et al, 2011
Schuller et al. 1986; de Rome et al, 2011
Schuller et al. 1986
Otte et al 2002; de Rome et al, 2011
Schuller et al, 1986; Pegg & Mayze,1983;
Otte & Middelhauve, 1987; Hell & Lob,1993;
de Rome et al, 2011
METHODOLOGICAL IMPERATIVE 1:
The current usage level of protective clothing by its current quality must be
measured.
Quantification of the gain from improved quality and uptake of protective clothing requires
the measurement the total injury reduction benefits as a function of quality and usage. Quality
of protective clothing would ideally be measured in terms of injury reduction efficacy. That
is, a piece that could reduce the injury risk by a larger margin (e.g. 30%) would have to be by
definition better quality than a piece that could reduce it by a lesser margin (e.g. 5%). A piece
of protective clothing may be capable of reducing the risk of injuries by 10% if it is worn at
the time of crash. However, this effect amongst motorcyclists would not be observed unless
all the motorcyclists wore this protective clothing every time they ride (100% usage rate). If
the uptake of protective clothing with an injury reduction capacity of 10% is increased from
50% to 80%, the overall injury reduction is increased by 3% from 5% to 8%. If the injury
reduction capacity is doubled to 20%, the usage rate only needs to increase from 50% to 65%
to obtain the same level of overall increase of 3% in injury reduction benefits. If the current
injury risk reduction capacity of protective clothing is 10% and the usage rate is 50%, either
the usage rate must be increased to 80% or the injury risk capacity (quality) must be
improved to 16% to gain the same overall injury reduction benefit. That is, the injury level by
the current level of quality and usage must be determined in order to measure the extent of
benefit gained from the improvement in quality and usage. Without the knowledge of the
current usage rate of protective clothing by each quality level, the costs and benefits
associated with the improvements in quality and usage cannot be determined.
METHODOLOGICAL IMPERATIVE 2:
The injury reduction benefits that arise from each type of protective clothing must
be determined independently in order to estimate the overall benefits of protective
clothing.
Quantification of the potential benefits of protective clothing per se is nearly impossible
without consideration of the differential benefits of each type of protective clothing for three
significant reasons.
First, the current usage rate for each type of clothing is likely to be vary (Table 5.6). For
example, a survey of 1300 Australian motorcyclists indicated that most riders wore a helmet
Chapter 5 – Options for cost benefit analysis of increased usage of protective clothing
75
Improving consumer information about motorcycle protective clothing (97-98%) and motorcycle jacket (82-95%), but fewer riders wore motorcycle pants and boots
(de Rome 2006). The usage rate also seems to vary with the purpose of the riding trip. The
same survey found that riders were most likely to wear more protective clothing when they
went on recreational rides followed by riding to work, and the least for short rides to the local
shops (de Rome 2006). To allow for such variations, the survey conducted for this project
asked riders which items of protective clothing they always wore when riding (see Table 5.6).
Second, the types of injuries prevented by the different types of clothing also vary according
to the region of the body protected (Table 5.6).
Third, the baseline rate of each injury type is highly variable. Reasons could include
differences in the clothing usage rate and differences in the sensitivity of the body region to a
motorcycle crash. For example, the variability in the body areas where injuries are sustained
by motorcyclists has been observed in previous studies (Otte and Middelhauve
1987){ACEM, 2004 #729. Therefore, the injury reduction benefits will to vary depending on
the type of clothing and part of the body protected
Table 5.6 Differences in the usage rate, region of injury protection, current injury rate,
and the possible reduction levels in relation to motorcycle protective clothing^
Type of protective
clothing
Current usage rate
Region of injury
prevented
Proportion of
unprotected
riders uninjured
Proportion of
protected riders
uninjured
Helmet
98%
Head
40%
84%
Jacket
78%
Chest & arms
8%
19%
Gloves
79%
Hands
33%
59%
Pants
61%
Legs
15%
31%
Boots
41%
Feet/ankles
57%
67%
^Source: de Rome et al, 2011
METHODOLOGICAL IMPERATIVE 3:
The impact of protective clothing use on risk taking behaviour amongst
motorcyclists must be accounted for in the injury reduction benefits measurement.
A motorcyclist who wears protective clothing may believe they can take more risks than
without it. Such a phenomenon known as the risk compensation theory has been theoretically
and empirically investigated for other road user behaviours (Wilde 1989; Wilde 2005).
If such increased risk were to be associated with usage of protective clothing this could
counteract the injury reduction effect reducing or even reversing the overall benefit of usage.
The increased quality of products may not necessarily have an increasing monotonic
relationship with injury reduction benefits. Observational studies of injury rates amongst
motorcyclists wearing clothing of different quality levels determined in labs may account for
the impact of clothing on risk taking behaviour. However there is little empirical evidence of
this phenomena and a recent Australian study found no association between other indicators
of risk taking (e.g. a history of traffic violations, pre-licence riding etc) and usage of
protective clothing by novice riders (de Rome, Ivers et al. 2011). The existence of risk
compensation amongst those who wear protective clothing may be examined with a research
design used in previous studies (Streff and Geller 1988; Underwood, Jiang et al. 1993;
Noland 1995; Weegels and Kanis 2000)
Chapter 5 – Options for cost benefit analysis of increased usage of protective clothing
76
Improving consumer information about motorcycle protective clothing Options
1. Approach to quantify the benefits of improved quality and uptake of protective
clothing:
a. If the choice is between two consumer information programs (e.g. star rating
system versus educational media campaign), CEA or CUA would be the most
appropriate economic evaluation to conduct.
b. On the other hand, if the decision is whether or not to introduce a consumer
information program at all while the current practice is no consumer program
information program, CBA would be the most appropriate.
2. The unit of measurement to quantify the benefits of improved quality and uptake of
protective clothing:
a. If CEA is used, outcome data such as the number of injuries saved by
protective clothing, number of days in hospital, and number of days taken to
return to work may be used to quantify the benefits of protective clothing.
b. If CUA is used, QALY or DALY gained may be used to quantify the benefits
of protective clothing.
c. If CBA is used, a monetised value of injuries and fatalities prevented by
protective clothing can be used to quantify the benefits of protective clothing.
The monetised value can be estimated through the HCA or WTP approach.
3. Computation of the benefits: The benefits of increased quality and uptake of
protective clothing can be quantified as:
a. The sum of the benefits of each type of protective clothing; or,
b. The benefits of at least one protective clothing worn versus none; or,
c. The benefits of at least one upper torso protective clothing versus benefits of
at least one lower torso protective clothing versus none.
Note: For the various methodological implications outlined above the first option
is strongly recommended.
4. Data collection:
a. A new study may be conducted to measure current usage rate and quality of
protective clothing products in the current market or data from previous
studies may be used.
b. A new study of the impact of increased quality of protective clothing on
motorcyclist riding behaviour may be conducted to measure the net benefit of
increased quality and uptake of protective clothing.
5. Sensitivity analysis:
a. Conduct sensitivity analysis of the benefit estimates. For example, in CUA
utility weights used to estimate QALYs can have a large influence on the final
outcome.
b. Do not conduct sensitivity analysis
Chapter 5 – Options for cost benefit analysis of increased usage of protective clothing
77
Improving consumer information about motorcycle protective clothing References
AAAM, (1990). The Abbreviated Injury Scale. Association for the Advancement of
Automotive Medicine, Des Plaines, IL.
Abelson, P. (2008), Establishing a Monetary Value for Lives Saved: Issues and
Controversies, Working Paper 2008–02, Office of Best Practice Regulation, Department
of Finance and Deregulation, Canberra.
ABS (2004), Disability, ageing and carers: Summary of findings, Australia 2003, Catalogue
number 4430.0, Canberra
http://www.abs.gov.au/AUSSTATS/[email protected]/DetailsPage/4430.02003?Open Document
ACEM (2004), MAIDS In-depth investigation of accidents involving powered two wheelers.
Association of European Motorcycle Manufacturers (ACEM), Brussels.
Alfaro, J.-L., Chapuis, M., Fabre, F. (Eds.), (1994). Socioeconomic cost of road accidents.
Transport Research COST 313. Report EUR 15464 EN, Commission of the European
Communities, Brussels.
Ashenfelter, O., (2006). Measuring the value of a statistical life: problems and prospects. The
Economic Journal 116, C10–C23.
Australian Bureau of Statistics (2008). Survey of motor vehicle use: 12 months ended 31
October 2007. Canberra, Australian Bureau of Statistics. 9208.0.
Australian Bureau of Statistics (2011). 9208.0 - Survey of Motor Vehicle Use, Australia, 12
months ended 31 October 2010. Canberra, Australian Bureau of Statistics.
Berry, J. G. and Harrison, J. E. (2008), Serious injury due to land transport accidents,
Australia, 2005–06, Injury Research and Statistics Series Number 42, Australian Institute
of Health and Welfare, Canberra
http://www.nisu.flinders.edu.au/pubs/reports/2008/injcat113.pdf
BTE (2000), Road crash costs in Australia, Report 102, Bureau of Infrastructure, Transport
and Regional Economics, Canberra http://www.bitre.gov.au/publications/47/Files/r102.pdf
BITRE (2009). Cost of road crashes in Australia 2006. Report 118,
http://www.bitre.gov.au/publications/48/Files/Cost_of_road_crashes_in_Australia.pdf.
Canberra, Australia, Bureau of Infrastructure Transport and Regional Economics.
BTRE (2006), Cost of Aviation Accidents and Incidents, BTRE Report 113, Bureau of
Infrastructure, Transport and Regional Economics, Canberra
http://www.btre.gov.au/publications/36/Files/BTRE_R113.pdf
Burkhead, J. and Miner, J. (1971), Public Expenditure, Chicago, Aldine Atherton.
Briggs AH, Sculpher MJ, Claxton K. (2006) Decision modelling for health economic
evaluation. Oxford: Oxford University Press.
Connelly, L. B. and R. Supangan (2006). "The economic costs of road traffic crashes:
Australia, states and territories." Accident Analysis & Prevention 38(6): 1087-1093.
de Rome, L. and Brandon, T. (2007) A Survey of Motorcyclists in NSW, 2006, A report to
the Motorcycle Council of NSW, November
de Rome, L., Ivers, R., Fitzharris, M., Du, W., Richardson, D., Haworth, N., Heritier, S.,
2011. Motorcycle protective clothing: Protection from injury or just the weather? Accident
Analysis and Prevention 43 (6), 1893-1900
de Rome, L (2006) Planning for motorcycle safety: measures of success,
www.rsconference.com , Road Safety Research, Policing and Education Conference,
Brisbane (unpublished).
Drummond, M. F., Sculfer, M. J., Torrance, G. W., O’Brien, B. J., & Stoddard, G. L. (2005).
Methods for the Economic Valuation of Health Care Programmes. Oxford: Oxford
University Press.
EEVC (1993). Report on Motorcycle Safety. An EEVC Paper, Report of the Ad-hoc Group
on Motorcycle Safety, 1993. Brussels, European Experimental Vehicles Committee 75.
Chapter 5 – Options for cost benefit analysis of increased usage of protective clothing
78
Improving consumer information about motorcycle protective clothing Elvik, R. (1995). An analysis of official economic valuations of traffic accident fatalities in
20 motorized countries. Accident Analysis and Prevention, 27(2), 237–347.
Elvik, R. (2000). How much do road accidents cost the national economy? Accident Analysis
and Prevention, 32(6), 849–851.
Evans, A. (2001). The economic appraisal of road traffic safety measures in Great Britain.
Paper for ECMT Round Table 117 ‘‘Economic evaluation of road traffic safety
measures’’. Paris: ECMT.
Gafni A. Using willingness-to-pay as a measure of benefits: What is the relevant question to
ask in the context of public decision making about health care programs. Med Care
1991;29: 1246–1252.
Garthe, E.A., Ferguson, S.A., Early, N., (1996). A method for converting injury severity in
NASS93 (AIS90) to NASS88 (AIS85). In: 40th Annual Proceedings. Association for the
Advancement of Automotive Medicine (AAAM), Des Plaines, IL, pp. 477–494.
Gold, M.R., Siegel, J.E., Russell, L.B., Weinstein, M.C., (1996). Cost-Effectiveness in Health
and Medicine. Oxford University Press, New York, NY.
Hensher, D. A. (2010). Hypothetical bias, choice experiments and willingness to pay. [doi:
10.1016/j.trb.2009.12.012]. Transportation Research Part B: Methodological, 44(6), 735752.
International Classification of Diseases Australian Modification version 10 (ICD-10 AM)
Koopmanschap, M.A., van Ineveld, B.M., (1992). Towards a new approach for estimating
indirect costs of disease. Soc. Sci. Med. 34 (9), 1005–1010.
Koopmanschap, M.A., Rutten, F.F.H., van Ineveld, B.M., van Roijen, L., (1995). The friction
cost method for measuring indirect costs of disease. J. Health Econ. 14 (2), 171–189.
Lin, M. R. and J. F. Kraus (2008). "Methodological issues in motorcycle injury
epidemiology." Accident Analysis and Prevention 40(5): 1653-1660.
Max, W., Stark, B., & Root, S. (1998). Putting a lid on injury costs: the economic impact of
the California motorcycle helmet law. Journal of Trauma-Injury Infection & Critical Care,
45(3), 550-556.
McClure, R. J. and R. M. Douglas (1996). "The public health impact of minor injury." Accid
Anal Prev 28: 443-451.
Ministry of Transport. (2004). Nota Mobiliteit; Naar een betrouwbare en voorspelbare
bereikbaarheid. Mobility Policy Document; Towards a Reliable and Predictable
Accessibility. The Hague: Ministry of Transport, Public Works and Water Management.
Murray, C. J. L., Lopez, A. D., Jamison, D. T. (1994), The Global Burden of Disease in 1990:
Summary Results, Sensitivity Analyses, and Future Directions, Bulletin of the World
Health Organization 72(3), pp.495–5 08
Noordzij, P., E. Forke, et al. (2001). Integration of needs of moped and motorcycle riders into
safety measures. Review and statistical analysis in the framework of the European
research project PROMISING, Workpackage 3, Report D-2001_5. Leidschendam, The
Netherlands, SWOV Institute for Road Safety Research. Report D-2001_5: 212.
Otte, D. and V. Middelhauve (1987). Quantification of protective effects of special synthetic
protectors in clothing for motorcyclists. Proceedings of the International Conference of the
Research Council on the Biomechanics of Impact. D. Cesari and A. Charpenne.
Birmingham, UK, IRCOBI: 1-18.
Persson, U., & Odegaard, K. (1995). External cost estimates of road traffic accidents: An
international comparison. Journal of Transport Economics and Policy, 29(3), 291–304.
Potter, M., Abelson, P. and Driscoll, T. (2006), Valuing the mortality and morbidity of work
related injury and illness: a life–cycle costing of incidents reported in NSW in 2000–2001,
Injury Risk Management Research Centre, The University of New South Wales, Sydney
Chapter 5 – Options for cost benefit analysis of increased usage of protective clothing
79
Improving consumer information about motorcycle protective clothing http://www.irmrc.unsw.edu.au/documents/IRMRC%20Work%20Cover%20Report%20Se
pt06.pdf
Ride (2005). Two piece leathers. Essential Gear Guide. T. Hoare. London, Ride Magazine.
http://www.motorcyclenews.com/MCN/Products/productsresults/ Last accessed 24 April
2011. UK, Bauer Media.
Ride (2008). All season boots. Ride Magazine, http://www.motorcyclenews.com/MCN/
Products/productsresults/ Last accessed 24 April 2011. UK, Bauer Media..
Ride (2009a). Textile Suits. Ride Magazine, http://www.motorcyclenews.com/MCN/
Products/productsresults/ Last accessed 24 April 2011. UK, Bauer Media.
Ride (2009b). Winter Gloves. Ride Magazine, http://www.motorcyclenews.com/MCN/
Products/productsresults/ Last accessed 24 April 2011. UK, Bauer Media.
Rosman D.L. (2001), The Western Australian road injury database (1987 – 1996): Ten Years
of linked police, hospital and death records of road crashes and injuries. Journal of
Accident Analysis and Prevention. Vol. 33(1), pp.81–88.
Rosman, D. L. and M. W. Knuiman (1994). "A comparison of hospital and police road injury
data." Accident Analysis and Prevention 26(2): 215-222.
Streff, F. M. and E. S. Geller (1988). "An experimental test of risk compensation: Betweensubject versus within-subject analyses." Accident Analysis & Prevention 20(4): 277-287.
Underwood, G., C. Jiang, et al. (1993). "Modelling of safety measure effects and risk
compensation." Accident Analysis & Prevention 25(3): 277-288.
Vos, T. and Begg, S. (1999), The Victorian Burden of Disease Study: Mortality, Department
of Human Services, Melbourne
Weegels, M. F. and H. Kanis (2000). "Risk perception in consumer product use." Accident
Analysis & Prevention 32(3): 365-370.
Wijnen, W., Wesemann, P., & de Blaeij, A. (2009). Valuation of road safety effects in costbenefit analysis. Evaluation & Program Planning, 32(4), 326-331.
Wilde, G. J. S. (1989). "Accident countermeasures and behavioural compensation: The
position of risk homeostasis theory." Journal of Occupational Accidents 10(4): 267-292.
Wilde, G. J. S. (2005). On the homeostasis of risk. Contemporary Issues in Road User
Behavior. D. A. Hennessy and D. L. Wiesenthal. New York, Nova Science Publishers,
Hauppauge: 3-12.
Zaloshnja, E., T. Miller, et al. (2004). "Crash costs by body part injured, fracture
involvement, and threat-to-life severity, United States, 2000." Accident Analysis &
Prevention 36(3): 415-427.
Chapter 5 – Options for cost benefit analysis of increased usage of protective clothing
80
Improving consumer information about motorcycle protective clothing CHAPTER 6 – CONCLUSIONS AND
RECOMMENDATIONS
INTRODUCTION
The options for providing improved consumer information about motorcycle clothing have
been derived in consideration of a number of factors. These include the features of existing
consumer information programs both in relation to motorcycle clothing and other types of
products, the features of the local motorcycle clothing market and the availability of test
facilities.
CURRENT SOURCES OF CONSUMER INFORMATION ABOUT MOTORCYCLE SAFETY CLOTHING
Six types of consumer information provision about motorcycle protective clothing were
identified. The only sources to currently provide independent evidence based information
about the protective performance of individual products are described at (d.) CE labels on
certified products and (f.) product test results published by Ride magazine (UK).
The six types of information programs are:
a.
Programs which promote usage of protective clothing in general as a means of
preventing injury, but do not distinguish between the types or qualities of different
products. Media used include advertisements, print products and websites (e.g. ,
ACEM Protective Equipment for Riders, VicRoads, TAC, QLD TMR and RTA).
b.
Programs which provide detailed information on the features to look for when
buying specific items of protective clothing. The information is provided to help
identify and avoid those garments least likely to provide injury protection, but
emphasises that only evidence from independent tests is an assurance of a product’s
likely performance in a crash. These include websites (e.g. ACC Ride for ever, TAC
SPOKES, MCC Protective Clothing, MACSA Gear Up) and print products (e.g.
Good Gear Guide).
c.
Advertising and marketing material provided by manufacturers and retailers about
the features and benefits of their products, but which does not include evidence of
independent assessment (e.g. standards numbers, CE marked labels).
d.
Appropriately numbered CE labels attached by manufacturers which provide
independent evidence of their compliance with the European standards for
motorcycle protective clothing.
e.
Product reviews published by motorcycle magazines and websites. The majority of
protective clothing product reviews rely on information provided by the
manufacturer. Many include the results of rider assessments from road tests under
different riding conditions. They relate to comfort and practicality but do not include
any assessment of injury protection performance.
f.
Product test results published by Ride (UK) motorcycle magazine. No other similar
objective assessments were identified as being currently available. Motorrad
motorcycle magazine (Germany) uses the European Standard’s test for impact
protectors (EN-1621-1), but relies on rider wearer assessments from road tests under
different riding conditions for other features reviewed but do not include any
assessment of injury protection performance.
Chapter 6 – Options for a consumer rating system
83
Improving consumer information about motorcycle protective clothing MOTORCYCLE CLOTHING TEST AND EVALUATION REGIMES
The only comprehensive testing systems for motorcyclists’ protective clothing found worldwide, are the European Standards produced by standards agency CEN (Comité Européen de
Normalisation). The European Standards for Motorcycle Protective Clothing include separate
standards for each type of garment: jackets and pants, boots, gloves, impact protectors for the
limbs and impact protectors for the back. Standards for impact protection for the chest and
inflatable body protectors (airbags) are currently under development. (See Appendix A).
Each of the European Standards specify the test methodology and equipment required to
assess the protective performance of garments in relation to: abrasion, cut, tear resistance,
burst strength and impact resistance as defined appropriate according to garment type. The
Standards also include basic ergonomic assessments that replicate a series of movements
commonly used when riding a motorcycle, to provide an indication of comfort and fitness for
purpose. In addition they evaluate the innocuousness of the materials used in the garments, to
ensure exposure to these does not constitute a hazard to the health of the wearer. However the
European Standards do not consider issues of heat, cold or cost. The footwear standard – EN
13634 – is the only document to consider waterproofing and only then as an optional test.
The standards do not evaluate the compatibility of the various garments, for example the
integration of the gloves with the cuffs of the jackets.
There are a number of international and Australian standards that specify tests for the
suitability of clothing for various weather conditions, which could be used to complement the
tests included in the European Standards for motorcycle clothing. (See Appendix G).
TEST FACILITIES
Injury protection performance: There are a number of accredited test facilities in Europe
with the current capacity to conduct the tests required under the European Standards for
motorcycle clothing, but none in the Southern Hemisphere. (See Appendix F).
Thermal comfort assessment: Thermal comfort tests require the use either of human
subjects or thermal manikins to measure heat loss/gain in an environmental chamber using
different conditioning such as heat, cold, wind and solar load.
There are a number of test facilities with environmental chambers in Australia, some of
which use human subjects and others use thermal manikins. (See Appendix H). A sweating
thermal manikin would be the preferred option in terms of obtaining reliable results although
initial set up costs would be higher than with human subjects. Whereas there may be added
advantage of human subjects as they are required for the ergonomic tests under the European
standards for protective clothing.
Chapter 6 – Options for a consumer rating system
84
Improving consumer information about motorcycle protective clothing RELEVANT FEATURES OF THE MOTORCYCLE CLOTHING MARKET IN AUSTRALASIA.
a. The motorcycle clothing and accessories industry operates in an international market
with a substantial proportion of that sold in Australia and New Zealand being
imported, principally from Europe and the US although mostly manufactured in
Taiwan, Vietnam or Pakistan. Hence any rating or testing system would need to be
locally based to capture products regardless of their origins.
b. Tailor-made clothing accounts for a small proportion of the market but is essential for
those riders who are unable to buy ready-made garments that fit appropriately.
Correct fit is an important factor in order to ensure that protective features (impact
protectors or abrasion resistant linings) stay in place during the crash. This is a
particular issue for women riders, as the majority of the garments available are
designed to be worn by men, who comprise between 80-90% of the customer market
c. There can be a wide range of models within each manufacturer’s range of protective
clothing (jackets, pants, gloves and boots). Unlike helmets, riders require different
garments for different riding conditions (hot, wet and cold weather). For example, one
Australian brand currently has over 40 different garments in their range including 10
different models of motorcycle fabric jackets/pants, 15 models of leather suits/pants
and 6 models of gloves.
d. Most of the research and development leading to technological advances in protective
clothing has been conducted in Europe. Any quality control or standards system
implemented here would need to be sufficiently flexible to accommodate new
technologies so as not to preclude the availability of improved products in the local
market.
e. Survey results suggest that a substantial proportion of riders would be willing to pay
higher prices for protective clothing that has been independently tested and accredited
(see Chapter 4, page 58).
MODELS OF CONSUMER INFORMATION PROGRAMS
Consumer information programs were examined in terms of whether they assess products on
single or multiple dimensions, how the ratings are communicated to consumers, whether the
system is mandatory or voluntary, the related issue of the completeness of coverage, how the
program relates to any existing standards and who funds the assessment program. Five
distinct mechanisms or business models were identified:
A. Performance League Tables. Analysis of real-world safety performance of products
and publication of results as league tables (e.g. Used Car Safety Ratings) by external
stakeholder organisation (e.g. motorists associations)
B. Independent Stakeholders Funded Tests. Purchase and testing of products funded
by external stakeholder organisations (e.g. road authorities, motorists associations).
Tests generally based on standards and results made available to the public though
stakeholder communication networks (e.g. ANCAP, CREP, CRASH).
C. Consumer Funded Tests. Purchase and testing of products funded by consumer
organisations and results made available to members (e.g. Australian Consumer
Association (Choice magazine), Ride (UK motorcycle magazine).
Chapter 6 – Options for a consumer rating system
85
Improving consumer information about motorcycle protective clothing D. Voluntary Industry Funded Tests. Voluntary system under which individual
companies pay to have their products assessed by an independent organisation with
results published and often displayed (e.g. EU Standards for Motorcycle Protective
Clothing, AAA accommodation ratings).
E. Mandatory Industry Tests. Mandatory testing and display of ratings (e.g. appliance
energy ratings, vehicle fuel consumption) at the cost of industry and conducted either
by industry or independent facilities (e.g. Australian Consumer Association (Choice
magazine)).
THE FEASIBILITY IN THE AUSTRALIAN AND NEW ZEALAND CONTEXT
Model A – Performance league tables - would require the comprehensive and available
crash and injury data that identified the items of motorcycle protective clothing used in crash
to be available. This model is not viable for motorcycle protective clothing due to the
impracticality of sourcing crashed clothing and obtaining reliable information about the crash
kinematics (impact types and forces involved).
Model B - Independent Stakeholders Funded Tests is commonly used in road safety and
requires external organisations to provide funding for purchase, testing to specified
performance criteria and promotion of results. Tests are generally based on standards and
results made available to the public though stakeholder communication networks. While this
model requires significant input of resources from the accrediting body, it has several
important advantages. It is not dependent on the support of either industry or consumers but,
as the ANCAP program has demonstrated, this approach operates most effectively by
educating consumers and thus shaping market demand for higher quality products. Over time
the changing market demand would be expected to create a more inviting business case for
industry to engage proactively with the program. As with ANCAP it would be recommended
that manufacturer be encouraged to take part by paying for the testing of their product rather
than waiting to be independently selected.
Model B also has the potential to avoid the problems that have arisen in Europe where many
of the largest manufacturers have avoided the requirements of compliance with the European
Standards by not describing their motorcycle clothing products as protective.
With a funding base that is independent of industry, a star system may be more able than a
voluntary industry standard to withstand pressure to water down the performance
requirements for award of particular numbers of stars. Thus, the independent star system
would potentially have greater safety benefits for motorcyclists.
Current examples include ANCAP, CREP, CRASH which are based on the test
methodologies of the relevant standards, but use a higher performance level than the
minimum required. A standard is useful to set the minimum performance levels but does not
need to be mandatory in a market-driven rather than regulatory-driven model. The essential
features are that the tests are objectively validated and the methodology and criteria
transparent.
Model C- Consumer Funded Tests is similar to Model B and has the same constraints but is
conducted and funded by consumer organisations. The disadvantage of this system is that it is
dependent on the commercial capacity of the organisation to cover the range of products
required. In addition such consumer organisations restrict access to the testing outcomes to
Chapter 6 – Options for a consumer rating system
86
Improving consumer information about motorcycle protective clothing those who subscribe or purchase their magazine. This limits the range of consumers to whom
the information is available.
Model D - Voluntary Industry Funded Tests would perhaps be easy to introduce but would
only be useful if a large proportion of motorcycle protective clothing industry were
committed to this approach. The extremely low up-take by the industry in Europe, over ten
years after their standards were released, suggests that this is unlikely to have sufficient reach
to be useful. However, there are grounds to believe that consumer demand may lead to
change over time, as increasing numbers of the European companies have been putting
garments through the European tests although not using the results to market their products
with the CE mark.
Consultation with the local industry indicates that there may be some support for a program
of testing to determine the relative protective performance and quality of products. A
potential benefit being a possible reduction in competition from cheap low quality imports
particularly those bought on-line. There was significant concern and resistance to any
suggestions that industry should fund the tests.
Model E - Mandatory Industry Tests has the advantage of covering the widest range of
products and ensuring that purchasers are aware of the performance of the products. This was
the intention for the European Standards for Motorcycle Protective Clothing, however as the
European experience has demonstrated, there are a number of significant disincentives and
barriers.
A standards approach distinguishes only between those that failed and those that passed, but
does not give any indication of relative or superior performance. Such systems exclude failed
products from sale, but do not enable consumers to identify superior products from those
available, nor does it offer any incentive to industry to improve performance.
Mandatory testing would require the development of an Australian standard against which
products would be tested. The process of developing a standard, or even the adoption of the
existing European Standards, is very time consuming and expensive, and would require the
cooperation of industry.
The European Standards took some 11 years to be approved from the time of initial
development, largely due to the difficulties of obtaining agreement between stakeholders,
particularly industry and the rider community. Whereas the industry did not wish to be
regulated, the focus of rider concern was that standards would be used by authorities and
insurance companies to mandate rider usage. This is also a concern that has been expressed in
Australia and will need to be addressed in order to persuade the rider community of the
benefits of such a system.
Mandatory testing would also impose a heavy cost burden on the local industry, including
both manufacturers and importers in what is a very small market. This is due to the wide
variety of motorcycle clothing products (jackets, pants, gloves and boots). The process and
cost of testing could price many products out of the market particularly for importers and
those who provide tailor-made clothing. Imports represent a substantial proportion of the
products locally available, but the Australasian market is relatively small and unlikely to
provide an incentive to international companies (e.g. Europe and US), to comply with our test
Chapter 6 – Options for a consumer rating system
87
Improving consumer information about motorcycle protective clothing requirements. Due to the wide range of types of clothing products involved, the situation
cannot be compared to helmets.
The outcome would not just reduce the range of products locally available to riders, but
would also reduce local access to new developments and technological advances in protective
clothing, most of which research is conducted in Europe. The outcome could be to subvert
the objectives of the testing program by encouraging riders to buy un-tested clothing on-line
from other countries.
It would require a strong degree of government commitment to its introduction and to devise
the means of monitoring, labeling and enforcement, which is difficult to justify when the
objectives of increasing usage of protective clothing may be achieved through other means.
Chapter 6 – Options for a consumer rating system
88
Improving consumer information about motorcycle protective clothing RECOMMENDED APPROACH AND MECHANISMS
BUSINESS MODEL
Model B is the model recommended to meet the objectives of this project. Testing for this
model relies on some independently determined criteria such as a standard and while there
are no Australasian standards for motorcycle protective clothing, the European standards
provide a viable alternative when complemented by the recommended user comfort
standards.
ADMINISTRATION
1. Products to be purchased anonymously and tested by an independent body under
contract to the administering agency/-ies.
2. Funding by independent stakeholder agencies – CTP insurers, health insurance
companies and motoring organizations.
3. Program to be overseen by a steering committee of stakeholders including
representatives of the industry and rider community.
TESTING
1. Ratings to be based on two separate dimensions A. injury protection and B. user
comfort (including weather protection, water penetration, thermal comfort and
ergonomics).
2. Injury protection performance and ergonomics to be evaluated using the equipment
and test methodologies specified for the European standards for motorcycle protective
clothing.
3. The volume of testing required for the rating scheme makes it necessary to have a
local test facility able to test to the European standards for motorcycle protective
clothing.
4. Once established, the capability of this local test facility to test to the European
standards for motorcycle protective clothing will require qualification with the test
results of other international laboratory/ies. A possible inter-laboratory comparison
could make use of the of the motorcycle jackets test results being done for the TAC
by SATRA in the UK as a comparison.
5. Water penetration testing will simply extend the test methodology already used in the
European motorcycle boot standard to the other garments. This test will expose the
garment when worn by an assessor to a controlled spray of water.
6. The selection of the thermal comfort test method for the evaluation of the user
comfort of the protective equipment by means of a sweating thermal manikin will be
made by comparison with the results obtained from the manikin with a group of
volunteers . The expertise to do this work is possessed by the group under Associate
Professor Nigel Taylor at the University of Wollongong. This group has an
environmental test facility which allows control of temperature, humidity, wind speed
and solar load. For Australian use of the garments the emphasis of the testing will be
on hot weather use. The assessor for the ergonomic testing of the garments to the
Chapter 6 – Options for a consumer rating system
89
Improving consumer information about motorcycle protective clothing European standards will also investigate the compatibility of the various garments,
such as gloves and jacket sleeve and boots and pant leg.
7. The star scheme for reporting the user comfort (including weather protection, water
penetration, thermal comfort and ergonomics) results will be similar in concept to that
for the injury protection tests.
8. A rolling program of tests by type of garment (e.g. summer jackets), be established
over a twelve month cycle so that consumers can predict and base their purchasing
decisions on when results for a specific type of product will be available.
9. The selection of items for testing should be determined to reduce the risk of bias.
Minimum sample sizes should be determined using statistical methods and may be
stratified to compare garments of specific type. (e.g. winter versus summer weight).
10. Testing methodology, results and rating systems to be transparent and made publically
available as a part of the assessment.
PUBLICATION OF RESULTS
1. Results to be published and promoted through the internet, using a variety of
stakeholder website including motorcycle community networks.
2. Print material requirements for promoting the program results are likely to be minimal
due to the limited range of suitable outlets where such materials would be acceptable
for commercial reasons. Posters promoting the program and the internet sites for the
results may be the only print materials required.
3. Opportunities to recover costs may include the provision of detailed reports on results
made available to manufacturers on request and payment of a fee. Labels certifying
test results could also be made available for display at the point of sale.
RATING AND REPORTING
As discussed earlier, test results may be reported in terms of the relative performance of
different products or a pass/fail criteria.
Relative performance scores report the actual numerical outcome (e.g. time for abrasion to
destruction). This approach allows for comparisons to be made between different products
and encourages consumer demand for higher levels of performance.
Pass/ fail assessments report only whether the item passed at the minimum level of acceptable
performance, below which the product is deemed to have failed (i.e. a standards approach). A
standards approach distinguishes only between those that failed and those that passed, and
does not give any indication of relative or superior performance. Such systems exclude failed
products from sale, but do not enable consumers to identify superior products from those
available, nor do they offer any incentive to industry to improve performance.
However, where multiple factors are involved (e.g. abrasion, burst, tear and cut strength and
impact resistance), a star rating system can more readily be calculated on the basis of pass/fail
criteria (standards) on each factor than on relative performance scores (ratings). Accordingly
it is recommended that:
Chapter 6 – Options for a consumer rating system
90
Improving consumer information about motorcycle protective clothing 1. Results for performance on each individual test (abrasion resistance, impact
resistance, water penetration, etc) to be reported as a score (for example - time to
destruction).
2. Scores to also be converted into pass/fail criteria in order to construct relative
performance ratings (star ratings) on the two dimensions (injury protection and user
comfort).
3. Pass/fail ratings for abrasion, cut, burst and impact resistance to be based on those
required under the European Standards at Levels 1 and 2. Note: it is proposed that
performance on the two levels could be represented as corresponding to Silver and
Gold stars. However, further work, including market testing, would be required to
develop the most appropriate means of representing test results visually.
4. Integrity of design to be based on compliance with all of the restraint and coverage
requirements specified under the European Standards.
5. Products that have already been tested and accredited under the European Standards
to be rated on injury protection measures without further testing, but would still
require water penetration and thermal comfort tests.
6. Products tested by other consumer organisations (e.g. Ride magazine), may also be
included if a commercial arrangement for exchange of test results and consistency of
test methodologies can be agreed.
7. Performance on the user comfort dimension to be based on the relevant test standards
and reported in comparable format to the injury protection test results as both a
numerical score and a star rating for user comfort.
Table 6.1 illustrates how the test results for the injury protection dimensions may be
converted into star ratings
Chapter 6 – Options for a consumer rating system
91
Improving consumer information about motorcycle protective clothing Table 6.1
Test specifications for injury protection star rating scheme
Fail
Level 1
Silver stars
Level 2
Gold stars
< 4 secs
> 25 mm
4 ≥ 6 secs
≤ 25 mm
7 ≤ secs
≤ 15 mm
< 700 kPa
No
≥700 kPa
Yes
≥800 kPa
Yes
Fail
Exposed
Fail
Pass
Covered
Pass
Pass
Covered
Pass
> 35 kN and
> 50 kN
≤ 35 kN and
≤ 50 kN
≤ 35 kN and
≤ 50 kN
< 2.5 secs
> 25 mm
≥ 2.5 secs
≤ 25 mm
≤ 2.5 secs
≤ 15 mm
<600 kPa
<40 N
≥600 kPa
≥40 N
≥600 kPa
≥40 N
Fail
Exposed
Fail
Pass
Covered
Pass
Pass
Covered
Pass
>4 kN
≤4 kN
≤4 kN
JACKETS AND PANTS AS PER EN 13595-1:2002
Abrasion resistance (Zone 1 & 2 only)
Impact cut resistance - maximum knife penetration
(Zone 1 & 2 only)
Minimum burst strength (seams and fastenings)
Impact protection present in Zone 1 and conforming to
EN 1621_1
Integrity of design as per EN 13595-1:
Fit & ergonomics
Coverage
Restraint systems
IMPACT PROTECTORS (LIMBS) AS PER EN 1621-1*
Impact resistance – force of transmission
Mean of 9 points tested
Highest single value
GLOVES AS PER EN 13594: 2002
Abrasion resistance
Impact cut resistance - maximum knife penetration as
per EN 388:1994
Burst strength (seams and fastenings)
Tear strength as per EN 388:1994
Integrity of design as per EN 13594: 2002
Fit & ergonomics
Coverage
Restraint systems
Impact energy attenuation – Knuckles (Optional) Impact energy 5 J.
Mean peak transmitted force for 5 points tested
FOOTWEAR AS PER EN 13634: 2002
Abrasion resistance - Upper
< 5 secs
≥ 5 secs
≥ 12 secs
Upper cut resistance – minimum blade cut resistance
> 2, 5
≤ 2,5
≤ 5,0
as per EN 388:1994
Transfers rigidity
>1.5 kN
≤ 1.5kN
≤ 1.5kN
Integrity of design as per EN 13594: 2002
Pass
Fail
Pass
Fit & ergonomics
Covered
Coverage
Exposed
Covered
Pass
Restraint systems
Fail
Pass
Impact energy attenuation – Ankle and shin (Optional)
- Impact energy 10 J.
Transmitted force
>5 kN
≤5 kN
≤5 kN
*Note: In relation to Impact protection an option to be considered for the impact test could be to award points
on the basis of five impacts – at the shoulder, elbow, hip, knee and shin – and awarded up to three
points per test based on the force transmitted. One mark to show the armour meets the CE standard
(35kN or less transmitted), two marks go to armour transmitting 25kN or less and three marks go to
protectors that transmit 15kN or less. The transmission limits to be in accord with the proposed
changes to the CE standard if these do come into force. This is intended to reflect and accommodate
improvements in armour technology.
Chapter 6 – Options for a consumer rating system
92
APPENDICES
A.
European Standards for Motorcycle Protective Equipment (PPE)
93
B.
RIDE test results
94
C.
Rating schemes - decision matrix
103
D.
Rider survey
113
E.
Data for cost estimates
123
F.
Test Facilities for EU Motorcycle PPE Standards
128
G.
Standards for Thermal and Water Penetration test
129
H.
Facilities for Thermal and Water Penetration tests
130
Appendices
92
APPENDIX A EUROPEAN STANDARDS FOR MOTORCYCLE PERSONAL
PROTECTIVE EQUIPMENT
Standard
Number
Standard Name
Protective gloves for
professional motorcycle riders
EN 13594
- Requirements and test
methods
Protective clothing for
professional motorcycle riders
EN 13595
- Jackets, trousers and one
piece or divided suits
Test Parameter
Injury Prevention
Relevance
1: no effect, 2: some
effect, 3: effective
Dye Fastness
1
pH of Leather
1
Chromium (VI) content of leather
1
Hard Inclusions (e.g studs, buckles)
3
Ergonomic requirements
2
Sizing
2
Coverage
2
Restraint
3
Tear Strength
3
Strength of seams
3
Cut resistance
3
Abrasion resistance
3
Optional additional protection, impact
energy attenuation
Effect of Cleaning
3
Tear Strength
3
Impact energy absorption
3
Impact protector attachment
3
Abrasion resistance
3
Impact cut resistance
3
Burst strength
3
Dye Fastness
1
pH of Leather
1
Ergonomics
2
Restraint
3
Design and zoning
2
2
Appendix A - European Standards for Motorcycle Personal Protective Equipment
93
Standard
Number
Standard Name
Protective footwear for
professional motorcycle riders
EN 13634
- Requirements and test
methods
EN 340
Protective clothing – General
requirements
EN 471
High-visibility warning
clothing for professional use.
Test methods and
requirements
EN 1621
Motorcyclists' protective
clothing against mechanical
impact
Test Parameter
Injury Prevention
Relevance
1: no effect, 2: some
effect, 3: effective
Design
2
Whole Footwear
3
Uppers pH Value
1
Linings
3
Insoles
2
Outsoles
3
Fit and Ergonomics
2
Size Marking
1
Dye fastness
1
Abrasion resistance of the upper
3
Cut resistance of the upper
3
Transverse rigidity of footwear bottom
3
Impact energy protection of ankle and
shin
3
Zones of Protection
2
Water resistance
1
Resistance to fuel oil of outsole
2
Innocuousness
Surface of Fluorescent and
Retroreflective Material (3 Levels)
Quality of the Retroreflective Material
(2 Levels)
Testing of impact protection inserts in
clothing
3
Back Protector impact testing
3
Appendix A - European Standards for Motorcycle Personal Protective Equipment
94
APPENDIX B - REVIEWS OF MOTORCYCLE CLOTHING PRODUCTS AS
REPORTED BY CONSUMER TESTING PROGRAMS.
The latest available product test reviews were obtained from Ride magazine in the UK. These
included reviews of eleven two piece leather suits (2005), ten two-piece textile suits (2008),
fourteen pairs of winter gloves (2009) and twelve pairs of boots (2008). The results of testing
are reported as a 50 word review, test results are reported as separate scores for each test but
the actual test results are not provided.
CONSUMER TESTS FOR MOTORCYCLE JACKETS, PANTS OR SUITS
The description of the testing and how the results are reported is based on articles
accompanying the test results in Ride magazine (Hoare 2005a, 2008b, Hull 2010).
Abrasion resistance
Three samples from each suit, one each from the shoulder, elbow and hip, were tested on the
abrasion rig specified in EN 13595-2:2002 for impact abrasion. The rig impacts the sample
against an abrasion belt at a controlled amount of force and then measures the time it takes to
wear through. The longer the time, the higher the score that was achieved.
Seams burst resistance
Seams strength was tested using the rig specified in EN 13595-3:2002. Seamed samples of
material from the hip and elbow were clamped over diaphragm which is inflated until the suit
seam either bursts or the machine is in danger of breaking. The rig measures how much force
was required to burst the seam. The higher the pressure required, the higher the score that was
achieved.
Impact resistance
Using the impact strength test specified in EN 1621-1:1998, body armour was tested to assess
how much energy it absorbed. The armour is placed over an anvil and a striker is dropped
onto it from a controlled height using a standard amount of force each time. A sensor in the
anvil works out how much force was transmitted through the armour.
Impacts were conducted at the shoulders, elbow, hip, knee and shin and awarded three points
per test based on the force transmitted. Under EN 1621-1:1998, the average force transmitted
over the combined tests cannot exceed 35 kN and no single impact may exceed 50 kN.
Waterproof test
The suits were worn by a tester who was also wearing winter gloves, boots, a neck warmer
and a helmet. Printed sheets of paper are also placed in the suits’ external pockets to see how
effective they were at keeping out water. The tester was sprayed all over with a pressure
washer while sitting on a motorcycle. After five minutes the suits were removed to check for
patches of water on light-coloured clothing worn underneath. Points were awarded based on
how much water got through. There are no requirements set for water proofing performance
under the European Standards, for motorcycle clothing.
Warmth
Mannequins fitted with thermal sensors were warmed in a 20°C room, then suited and placed
in a room with a temperature of -20°C. Thermocouples measured the rate and amount of heat
loss over a 90-minute period. Jackets and pants were ranked separately into three groups
Appendix B – Reviews of motorcycle clothing products
93
according to results. There are no requirements set for thermal protection performance under
the European Standards.
Road test
Suits were worn by Ride staff over two months and a minimum of 1000 miles to assess
practicality in use. Points scores were based on general impression, comfort, warmth and
breathability.
TWO PIECE LEATHER SUITS, 2005
The scoring system conducted in 2010 on two-piece leather suits, used results from four
laboratory tests for abrasion, burst and impact resistance, based on those specified under the
European Standard EN 13959 1-4:2002 (Hoare 2005b, Hull 2010). The actual scores on
abrasion, burst and impact test were not reported but were scaled as scored out of 20 each for
jacket and pants. The relationship of scores to the requirements of the EU standards was not
described. Comfort tests were also conducted by being worn by a member of the Ride team
for a minimum of 1000 miles. The total possible score achievable was 140 including 20 for
the comfort test.
Of the thirteen suits, none achieved full marks and the average was only just over half of the
possible score (71.5/140) with particularly poor performances on the abrasion and impact
tests.
Table 1
Product tests comparing two-piece leather suits, Ride, 2005
Abrasion
Burst
Impact
Comfort
Price £
20
Total
Score
140
Model/ Possible score
40
40
40
Hein Gericke PSX competition
40
40
28
13
121
£500
Hideout Classic
37
40
21
15
113
£800
BKS Lynx
23
40
23
15
101
£510
Weise
18
36
24
15
93
£350
RST Razor
28
34
11
15
88
£330
Frank Thomas T1 11
21
40
11
7
79
£480
Held Street
20
35
16
16
87
£418
Richa TG-1
19
40
10
12
81
£530
Berik 8323
21
30
14
17
82
£400
Alpinestars SP-1
24
10
20
18
72
£700
Spada Predator
16
30
8
8
62
£360
Bering Rafal
23
26
3
19
71
£554
Dainese Stripes
14
21
15
18
68
£660
Scores on injury protective performance and cost
Figure 1 shows the scores on comfort, injury protection and price. Higher scores for comfort
tended to associated with lower scores on injury protection, particularly low abrasion
resistance. It was also apparent that cost was not a predictor of protective performance for the
majority of suits. In fact the suit with the highest protective performance score was almost
half the price of the second best performer. Three of the most expensive suits had the lowest
scores.
Appendix B – Reviews of motorcycle clothing products
94
Figure 1.
Performance score and price of leather two-piece suits, Ride, 2010
Injury protection
300
250
200
150
100
50
0
Comfort
Price
900
800
£800
700
£700
£660
600
£554
£530
£510
500
£500
£480
£418
108
400
£400
98
£360
86
£330
78 £350
73
72
71
300
69
65
54
54
52
50
200
17
19
18
18
16
15
15
15
15
13
100
12
8
7
0
TWO PIECE TEXTILE SUITS, 2008
The tests of two-piece textile suits in 2008, used a different scoring system although the test
methodologies were those specified by European Standards for abrasion, burst and impact
resistance (Hoare 2008b). As in 2005, the authors used test performance to produce relative
scores rather than pass/fail criteria. Table 3 shows scores on each test for the ten textile twopiece suits.
Table 2
Product tests comparing textile two-piece suits, Ride, 2008
Abrasion Burst Impact
Water
proof
Warmth
Road Total
Price
test Score
Model/ Possible score
15
10
15
10
10
10
70
£
1. Spada Highland/Milan
4
4
6
10
7
4
35
£180
2. Dainese Panama/Hooper
10
2
5
8
6
6
37
£520
3. Alpinestars Jet Road Gore-Tex
8
3
4
8
6
8
37
£560
4. Rukka Armax
10
0
6
9
4
10
39
£1,400
5. Halvarssons Medusa/Cobra
8
5
8
8
3
8
40
£370
6. Held Oasis/Dakar
5
5
7
9
8
10
44
£314
7. Weise Dynastar II/Psycho
7
8
7
10
4
10
46
£310
8. BMW Streetguard 2
12
4
9
10
3
8
46
£690
9. Aerostich Roadcrafter two-piece
10. Hein Gericke Master V GTX
ProShell
15
8
9
5
4
6
47
£400
12
4
12
7
6
10
51
£850
Appendix B – Reviews of motorcycle clothing products
95
Abrasion resistance
Samples were taken from the shoulders, elbows, hips, knees and shins of each suit and scored
on a scale between 1 and 5. Samples that lasted seven seconds or more scored five out of five.
Those that lasted only one and half seconds scored 1 out of 5. Total possible score for a suit
was 15. As the actual times are not reported, this scoring system does not allow for
interpretations as to likely compliance with the European Standards, Level 1 (minimum
required 4 seconds), but may imply compliance with Level 2 for those suits which lasted
seven or more seconds. It was apparent from these tests that at least 5 of these suits were
unlikely to have provided the abrasion resistance required for compliance with Level 1 and
only one suit met the higher requirement of seven seconds,
Seams burst resistance
No information was provided as to any correspondence between the burst strength
performance required for compliance with the Standard and scores reported on these tests.
The range of performance suggests wide variability in the quality of construction, particularly
with less than half the suits achieving more than half the potential score.
Impact resistance
Impacts were conducted at the shoulders, elbow, hip, knee and shin and awarded three points
per test based on the force transmitted. Under EN 1621-1:1998, the average force transmitted
over the combined tests cannot exceed 35 kN and no single impact may exceed 50 kN.
Armour that met this standard scored one points, two points were awarded for transmitting
25kN or less and three marks for transmitting 15kN or less. The last two scores were in line
with proposals to change the CE standard to reflect improvements in armour technology.
All but one of the suits met the EU standard, and it would appear that most achieved at least
the higher level of 25kN.
Waterproof test
The suits were worn by a tester who was also wearing winter gloves, boots, a neck warmer
and a helmet. Printed sheets of paper are also placed in the suits’ external pockets to see how
effective they were at keeping out water. The tester was sprayed all over with a pressure
washer while sitting on a motorcycle. After five minutes the suits were removed to check for
patches of water on light-coloured clothing worn underneath. Points were awarded based on
how much water got through.
There are no requirements set for water proofing performance under the European Standards,
for motorcycle clothing. In these tests, most of the suits received good or acceptable
waterproofing scores with only one product considered to have been poor.
Warmth
Mannequins fitted with thermal sensors were warmed in a 20°C room, then suited and placed
in a room with a temperature of 20°C. Thermocouples measured the rate and amount of heat
loss over a 90-minute period. Jackets and pants were ranked separately into three groups
according to results. The warmest jackets or pants were given a score of five, the next group
scored three and the lowest received two. The total maximum score for a suit was 10.
There are no requirements set for thermal protection performance under the European
Standards. Half of the suits tested achieved less than half of the possible score.
Appendix B – Reviews of motorcycle clothing products
96
Road test
Suits were worn by Ride staff over two months to assess practicality in use. Points scores
from 10 are based on general impression, comfort, warmth and breathability. Four suits
scored full marks, but there appeared to be little relationship between these subjective
judgements and scores on injury protection
Scores on injury protective performance and cost
As with the leather suits, it was apparent that cost was not a predictor of protective
performance for the majority of suits. See Figure 2.
Figure 2.
Performance score and price of textile two-piece suits, Ride, 2008
Injury protection
100
90
80
70
60
50
40
30
20
10
0
Comfort
Price £
£1,400
£1,400
£1,200
£850
£690
£520
£180
14
4
17
15
6
£800
£560
8
16
10
£370
21
8
32
£314
17
£310
22
10
10
£1,000
25
28
£600
£400
8
£400
6
10
£200
£0
CONSUMER TESTS FOR MOTORCYCLE GLOVES
The following outlines the testing and scoring procedures used to review winter gloves as
reported in Ride magazine (Hoare 2009). Test results were provided in a 50 word review with
separate scores for palm abrasion, knuckle impact, seam strength, wrist restraint,
waterproofing, warmth and road test.
The tests for abrasion, burst and impact used the procedures specified under the European
Standards EN 13594:2002. The authors did not report the actual test performance results but
scaled them to produce relative scores.
Appendix B – Reviews of motorcycle clothing products
97
Table 3
Product tests comparing winter gloves, Ride, 2009
Impact
Water
Abrasion Wrist
Warmth Road Total s
restraint protection proofing
testing
Model/ Possible score
1. Oxford Bone Dry
10
10
10
Price
10
10
10
70
£
1
1
3
10
4
6
26
£18
2. Lewis Glacier
4
3
2
4
4
8
30
£35
3. Komeni
2
1
6
10
8
6
34
£15
4. Joe Rocket Nitrogen
2
7
1
10
9
7
39
£60
3
10
3
10
1
9
42
£70
5
1
8
10
8
9
43
£60
2
9
3
10
8
9
43
£65
8. Tech 7 Sonic
7
2
9
6
10
8
48
£30
9. Tuzo TZG-5
8
4
10
10
10
6
51
£30
6
8
10
7
9
10
52
£60
10
7
9
10
7
7
53
£45
3
10
6
10
9
9
53
£100
6
4
10
10
6
9
55
£120
9
10
10
10
3
9
57
£140
5. Hein Gericke X-Trafit
Leather
6. Frank Thomas Force
Aqua
7. Ixon Pro Special
10. Triumph Sympatex
Expedition
11. Spada Enforcer
12. Racer Pluvio
13. Dainese Jerico-R
Gore-Tex
14. Alpinestars 365
Gore-Tex
Abrasion resistance
Gloves were opened flat and secured, palm down, on a metal anvil. The anvil was then
dropped onto a moving abrasive belt and the time it took for the glove to wear through was
recorded. Under EN 13594, gloves are required to last a minimum of 2.5 seconds. Any glove
that failed to achieve 2.5 seconds was scored 0, others score higher the longer they lasted.
The total possible score was 10. While none of the gloves scored zero, half scored less than
five out of a possible ten, only one achieved full marks.
Seams burst
Seam strength was tested by clamping gloves samples over a rubber diaphragm, which was
inflated under the seam until either the material tore or the stitching gave way. The rig
measures the pressure required to burst the seam. The higher the pressure required, the higher
the score achieved. Eight gloves scored three or less out of ten and only one achieved full
marks.
Wrist restraint
Straps are done up comfortably tight, then a digital balance is taped to the fingers and pulled
to remove the glove. The balance records the separation force required to remove the gloves.
The test is repeated three times for each glove. Under EN 13594, glove restraint systems are
required to resist a force of 35 N to minimise the danger of being pulled off in a crash. Half
of the gloves achieved less than half the possible score but three did achieve full marks.
Appendix B – Reviews of motorcycle clothing products
98
Impact strength.
Gloves are tested to see how much energy they transmitted through the knuckles in an
impact. The test involves placing the glove over a knuckle shaped anvil and dropping a 2.5kg
striker onto the first and second knuckles and then the third and fourth knuckles, using a
standard drop energy each time. A sensor beneath the anvil measured how much force was
absorbed by the glove armour and how much would be transferred to the rider’s hand. Four
gloves achieved full possible marks and a further three scored eight or nine out of ten. Five
scored three or less.
Waterproofing
Gloves were worn by a tester on a stationary bike and subjected to a controlled, three-minute
jet-washer torrent. While being doused, the tester operated the bike’s controls to aggravate
seams. The tester wore satin inner gloves so leaks could be detected and recorded. A
waterproof over suit was worn over the glove cuffs to eliminate cuff leakage.
The majority of gloves scored full marks on these tests and only one failed to achieve even
half marks.
Warmth
Steel rods were inserted into the middle finger of each glove which was then placed in a chest
freezer. With the cuff sealed and temperature sensitive probes attached to the steel rod, the
drop in temperature was recorded over a five-minute period.
The majority of gloves scored reasonably well on these tests with only four pairs achieving
less than half marks.
Road testing
Gloves are road tested to check for feel and comfort. Testers check fit with leather jacket
sleeves and whether armour restricts movement. Each glove is worn well after wearing-in so
it is not assessed for initial discomfort. Testers then complete a questionnaire so all gloves are
assessed on the same criteria. All the gloves achieved over half the possible scores on these
tests.
Scores on injury protective performance and cost
While three gloves scoring highest on injury protection were also the most expensive, there
were also much cheaper gloves with similar protective scores. As noted earlier it appears that
price is not predictive of protective performance. See Figure 3.
Appendix B – Reviews of motorcycle clothing products
99
Performance score and price of winter gloves Ride, 2009
Injury protection
Total score
Price £
£140
250
140
£120
120
£100
200
100
150
£60
100
50
26
£18
6
£35
30
34
14
£15
10
£70
39
42
13
22
£60
£65
43
43
16
16
48
51
£30
£30
24
25
£60
52
26
53
£45
53
55
29
25
30
57
35
80
60
40
20
0
0
CONSUMER TESTS FOR MOTORCYCLE BOOTS
Tests of 12 motorcycle boots were reported in Ride magazine (Hoare 2008a). Results were
reported as a 50 word review with separate scores for abrasion, impact, sole crush, sole
durability, waterproofing, warmth and road testing, Table 4. The tests for abrasion resistance,
impact, cut and crush were based on the applicable European Standards procedures. The test
performance scores were not reported, but relative scores were determined on a scale from
one to ten and one to twenty for waterproofing and road testing.
Table 4 Product tests comparing boots, Ride, 2008
Water
Abrasion impact Sole Sole
Warmth Road Total Price
cut
crush durability proofing
testing
£
Model/ Possible score
1. Oxford Bone Dry
10
10
10
10
20
10
20
90
1
5
1
1
10
6
16
40
£60
2. Frank Thomas Aquatec
2
6
2
7
11
1
15
44
£100
3. Forma Arrow SX Dry
3
1
2
3
15
5
19
48
£130
2
6
3
7
20
4
11
53
£70
1
1
6
5
20
8
13
54
£55
2
5
5
9
20
3
14
58
£140
4
3
2
7
17
6
19
58
£200
4. RS Performance
Protection Eagle Pro
5. Spada Thunder Boot
6. Hein Gericke Tour
GTX
7. Alpinestars SMX3 R
Gore-Tex
8. Axo Primato
4
6
1
8
16
6
18
59
£110
9. Sidi Vertigo Gore
3
9
2
9
20
3
13
59
£230
10. BMW Santiago
2
9
8
10
15
5
19
68
£205
6
1
10
10
20
8
15
70
£180
10
10
7
10
20
10
13
80
£190
11. Alt-Berg Clubman
Roadster
12. TCX Infinity GTX
Appendix B – Reviews of motorcycle clothing products
100
Abrasion resistance
Samples of the outer material was tested on the abrasion rig specified in EN 13634:2002
which is the same test rig as specified in EN 13595-2:2002. The rig impacts the sample
against an abrasion belt with a force of 100 Newtons and measures the time it takes to wear
through. Under EN 13634, boot uppers are required to last a minimum of 5 seconds. While
the presentation of scores does not allow for direct comparison with the performance required
under the Standard, it is apparent that the majority of these boots performed poorly in this
test.
Impact cut
This is conducted at a point on the inside of the leg, where the boots are considered to give
the lowest level of protection. The samples are placed over a modelling clay base and a 1 kg
mass, with a sharp blade is dropped on to the boot sample. The less penetration, the better.
Sole crush
The test requires the boots to be crushed between two parallel plates using a compressive test
machine, the peak force being recorded as the structure of the boot gradually deformed. The
higher the recorded force, the greater the protection offered by the boot. The peak force
required is measured to provide a score. Under EN 13634, transverse rigidity is required to be
not less than 1.5 kN.
Sole durability
A sample from the sole was lowered onto an abrasive drum, and travelled 40 metres under a
load of 10 Newtons. The lower the amount of material abraded, the more durable the sole.
Water proofing
A jet washer is used to drench boots for four minutes and any leakage on socks noted. A
second test involves boots being soaked in ankle deep water (65 mm) for twelve hours and
any leakage points noted. These tests are more stringent than those required by EN 13634:
2002.
Warmth
A temperature probe is inserted into each boot, which is then filled with 4 kg of 3mm
stainless steel ball bearings and placed in a freezer at -17°C for 30 minutes. The temperature
drop in the foot area is measured.
Road testing
Each boot was worn for hundreds of miles in all sorts of weather. The ease of putting them on
and the walk and riding comfort was investigated. The testers were asked whether the soles
were slippery, their feet were warm and whether they had enough feel for gear changes and
braking.
Scores on injury protective performance and cost
As with the other products tested it was apparent that cost was not a predictor of protective
performance for the majority of boots. See Figure 4.
Appendix B – Reviews of motorcycle clothing products
101
Figure 3.
Performance score and price of boots Ride, 2008
Injury protection
Total score
Price £
£230
250
250
£205
£200
£180
200
£130
150
£140
£190
200
150
£110
£100
100
50
£60
40
8
44
17
48
9
£70 £55
58
54
53
21
18
13
58
59
59
68
70
16
19
23
29
27
0
80
37
100
50
0
REFERENCES
Hoare, T., 2005a. All Weather Suits Test. Ride
http://www.motorcyclenews.com/ride/product-tests/ Bauer Consumer Media Limited,
Peterborough, UK, Pp. 80-86.
Hoare, T., 2005b. Two Piece Leathers. Ride http://www.motorcyclenews.com/ride/producttests/ Bauer Consumer Media Limited, Peterborough, UK, Pp. 84-92.
Hoare, T., 2008a. All Season Boots http://www.motorcyclenews.com/ride/product-tests/ Ride
Bauer Consumer Media Limited, Peterborough, UK,, Pp. 48-52.
Hoare, T., 2008b. Textile Suits. Ride Magazine,
http://www.motorcyclenews.com/ride/product-tests/ Bauer Consumer Media Limited,
Peterborough, UK, Pp. 62-67.
Hoare, T., 2009. Winter Gloves. Ride Magazine,
http://www.motorcyclenews.com/mcn/products/productsresults/ Last Accessed 24 April
2011. Bauer Consumer Media Limited, Peterborough, UK, Pp. 57-61.
Hull, M., 2010. Two Piece Leathers. Ride. Bauer Consumer Media Limited, Peterborough,
UK, Pp. 35-42.
Appendix B – Reviews of motorcycle clothing products
102
Appendix C- Rating Schemes - Decision Matrix
Rating Schemes A. SAFETY PERFORMANCE
PPE type
Body
Region
EN 13595
Clothing
EN 13594
Type of injury
Test method
Does this replicate real world injury?
Torso, arms Abrasions, cuts contusions,
and legs
bruising
Impact abrasion, impact cut, burst strength, tear
strength, design features (sizing and coverage),
restraint, ergonomics, dye-fastness and chemical
innocuousness to wearer
Correlation with data provided by
examination and assessment of crashdamaged suits
Gloves
Hands and
wrists
Impact abrasion, impact cut, strength of seams,
Yes.
tear strength, design features (sizing and
coverage), restraint, ergonomics, dye-fastness and
chemical innocuousness to wearer
EN 13634
Boots
Feet, ankles, Specified as ambient and
lower legs
'mechanical' (impacts with
obstacles, parts of the
motorcycle and the road
surface).
EN 1621-1
Limb protectors
Shoulders, Not specified in standard, but Impact energy attenuation
elbows, hips, inferred as bruising, contusions
knees
and some minor fractures
Ambient weather conditions,
abrasions, cuts, impacts
Impact abrasion, impact cut resistance, tear
strength, construction performance, transverse
rigidity, design features (sizing and coverage),
restraint, ergonomics, breathability, dye-fastness
and chemical innocuousness to wearer. Optional
impact protection, waterproofness and resistance
to fuel oil of outsole.
pages 103-112
Yes.
Yes.
Appendix C- Rating Schemes - Decision Matrix
Rating Schemes A. SAFETY PERFORMANCE
EN 1621-2
PPE type
Body
Region
Type of injury
Test method
Does this replicate real world injury?
Back protectors
Back
Bruises and strains specified.
Neurological spinal injuries
excluded.
Impact energy attenuation
Yes.
As specified by standards plus additional
journal;istic opinion and feedback from
consumers.
Yes
Torso, arms Not specified
and legs
Abrasion, tear
No
Head to foot Not specified
None
Unknown
prEN 1621-3 (in Chest protectors
preparation)
prEN 1621-4 (in Inflatable body protectors
preparation)
(in preparation)
Chest
Torso
Head to foot As specified by standards
RiDE (consumer Helmets, clothing
magazine)
(including fitted limb
protectors as components of
clothing), boots, gloves and
back protectors.
SFI 40.1 (SFI
Foundation,
Inc.)
Clothing
FIM (Federation Helmets, clothing, boots,
Internationale de gloves, back protector
Motorcycling)
pages 103-112
Appendix C- Rating Schemes - Decision Matrix
Rating Schemes B. USER PERFORMANCE
Comfort
Weight
Fit
Waterproofing
Heat
Heat/cold
Not assessed.
Not assessed.
Some ergonoic
penalties may be
involved.
Ease of use
Noise
Basic ergonomic assessment
based on a range of
movements which are
commonly used in the
operation of a motorcycle.
Not applicable
EN 13595
Some weight and
See comfort Sizing requirements
movement restriction
scaled pro rata user
penalties, increasing
body dimensions
through performance
levels recognised by the
standard
Assessed by
other PPE
standards not
normatively
referenced in EN
13595
EN 13594
Assessed in Annex B
Not assessed Normative reference
to glove standard
EN 420 and hand
length as defining
measurement for
glove size.
Assessed by
Not assessed
other PPE
standards not
normatively
referenced in EN
13595
Not assessed.
Annex B provides a basic
Not applicable
ergonomic assessment based
on a range of movements
which are commonly used in
the operation of a motorcycle.
EN 13634
Assessed in Annex A
Not assessed Established
footwear sizing
standards quoted.
Optional
requirement.
Not assessed
Not assessed.
Annex A provides a basic
Not applicable
ergonomic assessment based
on a range of movements
which are commonly used in
the operation of a motorcycle.
EN 1621-1
Not assessed
Not assessed Minimum sizes
specified. No
assessment of
adaptation to user
morphology
Not applicable
Not assessed.
Not assessed.
Some ergonoic
penalties may be
involved.
pages 103-112
No assessment
Not applicable
Appendix C- Rating Schemes - Decision Matrix
Rating Schemes B. USER PERFORMANCE
13595
EN 1621-2
Comfort
Weight
Fit
Waterproofing
Assessed in Annex A
Not assessed Sizing requirements Not applicable
scaled pro rata user
body dimensions.
Heat
Heat/cold
Ease of use
Noise
Not assessed.
Not assessed.
Annex A provides a basic
Not applicable
ergonomic assessment based
on a range of movements
which are commonly used in
the operation of a motorcycle.
prEN 1621-3 (in
preparation)
prEN 1621-4 (in
preparation)
RiDE (consumer Yes
magazine)
Yes, as a
component
of comfort.
Yes (although
comments may be
subjective).
Where applicable Yes, as a
(generally on
component of
textile clothing, comfort.
boots and winter
gloves).
Where
Yes, as a component of
applicable
comfort.
(generally when
winter-weight
textile clothing,
boots and gloves
are subject of
the reports).
In helmet evaluations
only.
Not assessed
Not assessed Not assessed
Not assessed
Not assessed
Not assessed
Not assessed
Not applicable
FIM (Federation Not assessed
Internationale de
Motorcycling)
Not assessed Not assessed
Not assessed
Not assessed
Not assessed
Not assessed
Not assessed
SFI 40.1 (SFI
Foundation,
Inc.)
pages 103-112
Appendix C- Rating Schemes - Decision Matrix
Rating Schemes C. USER EDUCATION - DISSEMINATION OF RESULTS
Explanation of assessment. Explanation of results.
Transparency of
results.
Level of results available to user. Advice given on important things to look
for when purchasing?
EN 13595
None for consumers unless
covered in manufacturer's
information or in press
features
Some mandatory provision a Independent third party Low to moderate
requirement within
assessment
manufacturer's information to
users
Dependant upon manufacturer's information
and retailer advice, therefore may be subject
to inaccuracy, bias and lack of objectivity.
EN 13594
Minimum requirements
specified in clause 8 of the
standard
Minimum requirements
specified in clause 8 of the
standard
Independent third party Moderate
assessment
Dependant upon manufacturer's information
and retailer advice, therefore may be subject
to inaccuracy, bias and lack of objectivity
EN 13634
Minimum requirements
specified in clause 8 of the
standard.
Minimum requirements
specified in clause 8 of the
standard.
Independent third party Moderate
assessment.
Dependant upon manufacturer's information
and retailer advice, therefore may be subject
to inaccuracy, bias and lack of objectivity.
EN 1621-1
None for consumers unless
covered in manufacturer's
information or in press
features
No requirements
Independent third party Low to moderate
assessment
Dependant upon manufacturer's information
and retailer advice, therefore may be subject
to inaccuracy, bias and lack of objectivity
(although less pronounced than for EN
13595).
pages 103-112
Appendix C- Rating Schemes - Decision Matrix
Rating Schemes C. USER EDUCATION - DISSEMINATION OF RESULTS
Explanation of assessment. Explanation of results.
Transparency of
results.
Minimum requirements
specified in clause 8 of the
standard
Minimum requirements
specified in clause 8 of the
standard
Independent third party Low to moderate
assessment
Dependant upon manufacturer's information
and retailer advice, therefore may be subject
to inaccuracy, bias and lack of objectivity
(although less pronounced than for EN
13595).
Yes. Explanatory text and
star rating system.
Independent laboratory Moderate to good
testing plus
publication's remarks.
Good, although extent of objectivity versus
subjectivity may vary.
No
No
No
No
No
FIM (Federation No
Internationale de
Motorcycling)
No
None
No
No
13595
EN 1621-2
Level of results available to user. Advice given on important things to look
for when purchasing?
prEN 1621-3 (in
preparation)
prEN 1621-4 (in
preparation)
RiDE (consumer Yes. Side column to article
magazine)
explaining parameters.
SFI 40.1 (SFI
Foundation,
Inc.)
pages 103-112
Appendix C- Rating Schemes - Decision Matrix
Rating Schemes D. HISTORY
E. PRICE
History or
Is price
recalls/problems assessed?
available?
F. AVAILABILITY/SELECTION
Previous results
remain available?
How often is the
review done?
EN 13595
No. Manufacturer's
test results are
commercially
confidential.
Five yearly systematic Limited or no
review.
information.
No
Limited choice as only a
few specialist
manufacturers have
manufactured conforming
garments.
EN 13594
No. Manufacturer's
test results are
commercially
confidential
Five yearly systematic Limited or no
review
information
No
No. Possibly only one or
two manufacturers have
produced conforming
products
EN 13634
No. Manufacturer's
test results are
commercially
confidential.
Five yearly systematic Limited or no
review. May also be information.
significantly affected
by reviews of
normative reference
documents.
No
Possibly ranked third after
limb and back protectors in
terms of industry
compliance. Conforming
models generally form
niche ranges within
manufacturer's full product
ranges.
EN 1621-1
No. Manufacturer's
test results are
commercially
confidential
Five yearly systematic Limited or no
review
information
No
Yes. Protectors fitted as
standard feature to a
significant number of
garments
pages 103-112
Easily accessible to users? Range of models
tested?
Garment manufacturers
determine type of
protectors fitted to their
products. Several
independent
manufacturers exist and
can supply retro-fit
components.
Popular models choosen?
Appendix C- Rating Schemes - Decision Matrix
Rating Schemes D. HISTORY
13595
EN 1621-2
E. PRICE
History or
Is price
recalls/problems assessed?
available?
F. AVAILABILITY/SELECTION
Previous results
remain available?
How often is the
review done?
Easily accessible to users? Range of models
tested?
No. Manufacturer's
test results are
commercially
confidential
Five yearly systematic Limited or no
review
information
No
Yes.
Originally on an
annual basis. Up to
date information
requested.
Question not
entirely relevant
to scheme.
Yes
Yes
Bi-annually
No information
No
Unknown
Annual
No information
No
Yes, where regulations
incorporated into national
sporting codes. Available
on the Internet.
Popular models choosen?
prEN 1621-3 (in
preparation)
prEN 1621-4 (in
preparation)
RiDE (consumer Yes. Regularly
magazine)
referred to in
subsequent evaluation
reports.
SFI 40.1 (SFI
Foundation,
Inc.)
No
FIM (Federation No
Internationale de
Motorcycling)
pages 103-112
Leading brands with
test purchases when
suppliers have proven
reluctant to participate.
Popular models or those in a
particular price bracket or
where specifications are
comparable with competing
products.
Appendix C- Rating Schemes - Decision Matrix
Rating Schemes G. RATING SCHEME
EN 13595
H. DEGREE OF OBLIGATION
I. JURISDICTION
How are the rated? Eg score, pass/fail, star
rating etc.
Voluntary/ mandatory
International/ nationa// sub-national
Pass/fail based on conformity to specified
minimum performance values.
Voluntary - compliance carries a presumption of conformity with European, although quoted internationally
EU Directive 89/686/EEC where products claimed to be protective
clothing and equipment.
EN 13594
Voluntary - compliance carries a presumption of conformity with European
EU Directive 89/686/EEC where products claimed to be protective
clothing and equipment. (although this appears to have been
widely ignored by industry and unenforced by the authorities).
EN 13634
Pass/fail on normative and optional requirements. Voluntary - compliance carries a presumption of conformity with European
EU Directive 89/686/EEC where products claimed to be protective
clothing and equipment.
EN 1621-1
Pass/fail based on conformity to specified
minimum performance values.
Voluntary - compliance carries a presumption of conformity with European, although quoted internationally
EU Directive 89/686/EEC where products claimed to be protective
clothing and equipment.
pages 103-112
Appendix C- Rating Schemes - Decision Matrix
Rating Schemes G. RATING SCHEME
13595
EN 1621-2
H. DEGREE OF OBLIGATION
I. JURISDICTION
How are the rated? Eg score, pass/fail, star
rating etc.
Voluntary/ mandatory
International/ nationa// sub-national
Pass/fail based on conformity to specified
minimum performance values
Voluntary - compliance carries a presumption of conformity with European, although quoted internationally
EU Directive 89/686/EEC where products claimed to be protective
clothing and equipment.
prEN 1621-3 (in
preparation)
prEN 1621-4 (in
preparation)
RiDE (consumer Star rating with highest scoring products awarded Consumer magazine initiative.
magazine)
'Best Buy' or 'Recommended' (when price is also
factored into decision to award these accolades).
SFI 40.1 (SFI
Foundation,
Inc.)
Pass/fail based on conformity to specified
minimum performance values.
National (UK only)
Voluntary. (SFI) is a non-profit organization established to issue
USA
and administer standards for specialty/performance automotive and
racing equipment.)
FIM (Federation Subjective assessment by FIM Technical Director Mandatory
Internationale de or Chief Scrutineer.
Motorcycling)
International
pages 103-112
Confidential
Page 1 of 10
Motorcycle Protective Clothing - Consumer Information
Project
If you ride a motorcycle or scooter in Australia or New Zealand, we are interested in your views about motorcycle
clothing and the information that is available to you as a consumer.
This five minute survey is part of a wider study into the potential for an Australasian program to provide evidence-based
information on the quality and effectiveness of motorcycle protective clothing products. We are also looking at consumer
ratings and testing systems used overseas and their applicability in Australasia. The study will not make
recommendations about regulating or mandating motorcycle clothing.
You will not be asked for your name or contact details. The survey includes questions about you, your opinions and
experience with motorcycle clothing. Your answers will be used to assist in finding the best ways to provide and promote
reliable information to riders about effective motorcycle protective clothing.
Taking part in this survey is voluntary. You can withdraw at any time prior to submitting your completed survey, however
your responses cannot be withdrawn once you have submitted them.
The study has been commissioned by the Motor Accidents Authority(NSW) and is being conducted by The George
Institute for Global Health, University of Sydney. If you would like to know more about the study, please feel free to
contact Liz de Rome (02) 9657 0300 or email: [email protected]
Any person with concerns or complaints about the conduct of a research study can contact the Manager of Human
Ethics, Office of Research Integrity, University of Sydney onTelephone +61(02) 8627 8111; Facsimile: +61 (02) 8627
8177 or email: [email protected]
Q1.Do you currently own a motorcycle or scooter?
Yes
No
Q2.Have you ridden a motorcycle or scooter on a
public road at least once in the last 12 months?
Yes
No
Q3. What is your age?
__________________________________
(Years)
www.project-redcap.org
Confidential
Page 2 of 10
Section 2
If you have answered 'No' to Q1 or Q2 or if you are aged under 16 years, you are not eligible to take part in this survey.
Thank you for your interest.
www.project-redcap.org
Confidential
Page 3 of 10
Please tell us a little about your self as a rider
Q4. What is your sex?
Male
Female
Q5a. Country of residence
Australia
New Zealand
Other country
Q5b. What is your postcode?
Q6. What type of motorcycle licence do you have?
Q6a. If other licence, please give details.
Q7. What type of motorcycle do you ride most
frequently on public roads?
Q7a. If other type of motorcycle, please specify
Q8. Are you a member of any motorcycle clubs?
Q8a. Which club do you have most contact with
Q9. Do you visit any internet motorcycle discussion
forums?
Q9a. What is the name of the forum you visit most
often?
__________________________________
Learner licence
Probationary/ Provisional licence
Restricted motorcycle licence
Full licence
Other motorcycle licence/permit
Suspended/cancelled
I do not have a motorcycle licence
Other.
__________________________________
Sports (including Super sports /super motard)
Cruiser
Standard (including Naked)
Touring (jncluding Sports tourer)
Adventure/ adventure tourer/ dual sport
Off road - Trail/ enduro/ mx
Scooter
Moped/ mofa
Other type
__________________________________
Yes
No
__________________________________
Yes
No
__________________________________
www.project-redcap.org
Confidential
Page 4 of 10
Do you own any of the following motorcycle protective clothing items? If yes, how many of each do
you have? Please count only those that you still wear.
Do not include wet weather gear.
Q10a. Motorcycle helmets (road riding)
0
1
4 or more
2
3
Q10b. Motorcycle protective jackets
0
1
4 or more
2
3
Q10c. Motorcycle protective pants
0
1
4 or more
2
3
Q10d. Motorcycle boots.
0
1
4 or more
2
3
Q10e. Motorcycle protective gloves.
0
1
4 or more
2
3
Q1f. MC one-piece suit
0
1
4 or more
2
3
Q11. Which of these items do you always wear when riding on-road?
Note: a one piece suit is equal to wearing both a jacket and pants)
MC Helmet
MC Jacket
MC Pants
MC Boots
MC Gloves
www.project-redcap.org
Confidential
Page 5 of 10
By wearing 'full rider protective gear', we mean wearing helmet, boots, gloves, jacket and pants that
are designed to protect a rider in a crash.
Q12. How much do you agree or disagree with the following statements?
Q12a. Full rider protective gear can reduce your risk of injury in a crash
Strongly agree
Agree
Neutral
Disagree
Strongly disagree
Q12b. Full rider protective gear is not necessary on short trips around town
Strongly agree
Agree
Neutral
Disagree
Strongly disagree
Q12c. Wearing full rider protective gear makes you feel safer
Strongly agree
Agree
Neutral
Disagree
Strongly disagree
Q12d. Full rider protective gear is bulky and uncomfortable to wear.
Strongly agree
Agree
Neutral
Disagree
Strongly disagree
Q12e. It is not necessary for scooter riders to wear full rider protective gear
Strongly agree
Agree
Neutral
Disagree
Strongly disagree
Q12f.In summer I do not wear full rider protective gear if it is too hot
Strongly agree
Agree
Neutral
Disagree
Strongly disagree
Q12g. The protective gear that is available is not suitable for the sort of riding that I do on my motorcycle/ scooter
Strongly agree
Agree
Neutral
Disagree
Strongly disagree
Q12h. I do not wear full protective gear when riding to work because it is not suitable for wearing while at work.
Strongly agree
Agree
Neutral
Disagree
Strongly disagree
Q12i. There is no point in spending a lot of money on protective clothing because it cannot protect you in a serious
crash.
Strongly agree
Agree
Neutral
Disagree
Strongly disagree
Q12j. It is too much trouble to get dressed in full rider protective gear except when I am going on a long ride.
Strongly agree
Agree
Neutral
Disagree
Strongly disagree
Q13. When did you last buy any motorcycle protective clothing? Within the last:
Month
12 months
Three years
Five years
None in the last 5 years
www.project-redcap.org
Confidential
Page 6 of 10
Q14. Thinking about the motorcycle protective clothing you have bought in the last 5 years.
Approximately how much came from each of the following types of stores. Your answers must add
up to a total of 100%
In a retail shop
__________________________________
(If none, please put zero)
On-line (Australian company)
__________________________________
(If none, please put zero)
On-line from overseas supplier (non-Australian)
__________________________________
(If none, please put zero)
On-line (dont know where)
__________________________________
(If none, please put zero)
Other
__________________________________
(If none please put zero)
Total purchases (click in box to sum your answers)
__________________________________
(Your answers must add to 100)
Please go back and check that your answers to each part of question 14 add up to 100%.
www.project-redcap.org
Confidential
Page 7 of 10
How much do you agree or disagree with the following statements?
When buying motorcycle clothing, one of the most important features is:
Q15a. Protection from rain (e.g water resistance)
Strongly agree
Agree
Neither agree or disagree
Disagree
Strongly disagree
Neither agree or disagree
Disagree
Strongly disagree
Neither agree or disagree
Disagree
Strongly disagree
Q15b. Design (suitability for wear at my destination)
Strongly agree
Agree
Q15c. Brand name (reputation)
Strongly agree
Agree
Q15d. Breathability (does it make me sweat)
Strongly agree
Agree
Neither agree or disagree
Disagree
Strongly disagree
Agree
Neither agree or disagree
Disagree
Strongly disagree
Disagree
Strongly disagree
Disagree
Strongly disagree
Q15e. Riding comfort
Strongly agree
Q15f. Ease of cleaning/maintenance
Strongly agree
Agree
Neither agree or disagree
Q15g. Conspicuity (Bright colours, contrasts, reflection)
Strongly agree
Agree
Neither agree or disagree
Q15h. Ease of usage (e.g. fastenings/unfastening)
Strongly agree
Agree
Neither agree or disagree
Disagree
Strongly disagree
Agree
Neither agree or disagree
Disagree
Strongly disagree
Disagree
Strongly disagree
Disagree
Strongly disagree
Q15i. Durability
Strongly agree
Q15j. Injury protection (e.g. Abrasion resistant material)
Strongly agree
Agree
Neither agree or disagree
Q15k. Impact protection (i.e. body armour)
Strongly agree
Agree
Neither agree or disagree
Q15l. Construction strength (seams and fabric burst and tear strength)
Strongly agree
Agree
Neither agree or disagree
Disagree
Strongly disagree
Disagree
Strongly disagree
Disagree
Strongly disagree
Q15m. Protection from cold (e.g. Insulation)
Strongly agree
Agree
Neither agree or disagree
Q15n. Protection from heat/hot weather comfort (e.g ventilation)
Strongly agree
Agree
Neither agree or disagree
www.project-redcap.org
Confidential
Page 8 of 10
Q15o. Price
Strongly agree
Agree
Neither agree or disagree
Disagree
Strongly disagree
Agree
Neither agree or disagree
Disagree
Strongly disagree
Q15p. Appearance
Strongly agree
Q16. In your opinion is adequate information about
the most important features generally available to
riders when they are deciding which motorcycle
clothing to buy?
Yes
No
Dont know
Q16a. Please explain why you think this.
__________________________________
Q17. What information do you think should be made
available to riders when they are deciding which
motorcycle clothing to buy?
__________________________________
www.project-redcap.org
Confidential
Page 9 of 10
Q18. When deciding which motorcycle clothing to buy, I can obtain reliable advice/information from:
Q18a. Websites selling motorcycle clothing
Strongly agree
Agree
Neither agree or disagree
Disagree
Strongly disagree
Disagree
Strongly disagree
Disagree
Strongly disagree
Disagree
Strongly disagree
Neither agree or disagree
Disagree
Strongly disagree
Agree
Neither agree or disagree
Disagree
Strongly disagree
Agree
Neither agree or disagree
Disagree
Strongly disagree
Neither agree or disagree
Disagree
Strongly disagree
Neither agree or disagree
Disagree
Strongly disagree
Neither agree or disagree
Disagree
Strongly disagree
Agree
Neither agree or disagree
Disagree
Strongly disagree
Agree
Neither agree or disagree
Disagree
Strongly disagree
Q18b. Staff in motorcycle clothing shops
Strongly agree
Agree
Neither agree or disagree
Q18c. Australian motorcycle magazines product reviews
Strongly agree
Agree
Neither agree or disagree
Q18d. Overseas motorcycle magazines product reviews
Strongly agree
Agree
Neither agree or disagree
Q18e. Government websites/ print materials
Strongly agree
Agree
Q18f. Rider community websites
Strongly agree
Q18g. Other riders
Strongly agree
Q18h. Advertisements in motorcycle magazines
Strongly agree
Agree
Q18i. The Spokes website
Strongly agree
Agree
Q18j. The Good Gear Guide
Strongly agree
Agree
Q18k.The Ride Forever website
Strongly agree
Q18l. Rider trainers
Strongly agree
Q18m. Other (please give details)
__________________________________
Q19. If you needed to buy some new motorcycle
clothing, where would you look for advice/
information? Please give details.
__________________________________
Q20. Please explain why you think that would be a
good source of information?
__________________________________
Q21. Do you think anything more should be done to provide riders with independent evaluations of the quality of
motorcycle clothing before they buy?
Yes
No
Don't know
Q21a. Please explain what should be done.
__________________________________
www.project-redcap.org
Confidential
Page 10 of 10
Q21b. Please explain who you think should be
responsible.
Q22. Would you be prepared to pay more for gear that
had been independently tested and accredited?
Q23.What do you think would encourage more riders to
always wear motorcycle clothing?
Q24. Into which of the following ranges would your
gross annual household income fall, that is before
tax?
__________________________________
Yes
No
Don't know
__________________________________
Less than $30,000
$30,001-$50,000
$50,001 - $75,000
$75,001 - $100,000
$100,001 - $125,000
$125,001 - $150,000
$150,001 +
Prefer not to answer
www.project-redcap.org
APPENDIX E.
DATA VARIABLES TO COLLECT AND DATA SOURCES TO
ASSIGN VALUES FOR EACH COST ITEM BY INJURIES, AND OTHER PROPERTY
AND GENERAL COSTS .
Fatality (Cost per fatality) x (number of motorcycle fatality)
Cost item
Data to collect and calculations
Data source
Workplace and
household output
losses
Compute lifetime wage and household work
Department of Families, Community
Services and Indigenous Affairs
(2007)
losses due to a death or permanent total
disability and discounted them to present
value (BITRE, 2009)
Household work can be valued based on the
cost of hiring people to perform household
tasks (e.g. cooking, cleaning, yard work) and
the hours typically devoted to each task
(BITRE, 2009).
The average annual cost of raising a child
from birth to 17 years
Plus (+ ) losses in income from employment
Plus (+ ) losses in voluntary and household
work
Quality of life
losses for the
victim
A value is not directly observable. Hence,
statutory value placed on damages paid to
100% impairment for a non-fatal road crash
casualty can be used as a proxy value (BTE,
2000; BITRE, 2009).
Transport Accident Commission
(TAC) of Victoria
Australian Institute of Health and
Welfare (AIHW)
Berry and Harrison (2008)
ABS
Pain, grief, and
suffering by the
family and
friends of the lost
one
This intangible cost can be valued as the
statutory-determined lump sum
compensation awarded to families and
dependents of a deceased person (BITRE,
2009).
NSW Victim Support and
Rehabilitation Act 1996 (NSW,
1997)
Criminal legal
costs
Costs of prosecuting individuals charged
with criminal offences following road
crashes (e.g. homicide related charges,
negligent or reckless driving charges,
culpable driving causing death).
ABS - number of victims
Appendix E – Data for cost estimates
A review of the payments to relatives
in Australian jurisdictions (Standing
Committee on Legal Affairs, 2004)
Victorian Sentencing Advisory
Council - number of charges
Victorian Bar (2008) - Indicative cost
for a case that goes for a week in the
Victorian Supreme Court
123
Civil legal cost
Cost of claims for compensation (lower and
upper bounds of claims, total number of
claims, percentage of claims in dispute, legal
expenses born by plaintiff)
TAC of Victoria and relevant
literature (Latham and Playford,
2002)
Workplace
disruption and
replacement
Gross earning of the employee during the
average period that lapses before a deceased
person is replaced.
Australian Safety and Compensation
Council (2008) - Replacement period
Victorian Auditor General’s Office
(2005) - published recruitment costs
Department of the Premier and
Cabinet Western Australia (2005) published retraining costs
Imprisonment
Costs of correctional services and workplace
and household losses for imprisoned persons
due to culpable driving offences.
Victorian Sentencing Advisory
Council (2007) - Imprisonment
period
General Purpose Standing
Committee (2001) - Daily cost of
imprisonment for NSW
Workplace and household losses BITRE (2009)
Cost of processing claims for fatalities
(included in the cost of administering
statutory insurance schemes)
Auditor General’s Office
Premature
funerals
The difference between estimated cost of a
funeral at the time of premature death and the
discounted future value of a funeral at the
end of a person’s normal expected life
Costs of burials and cremations in
different jurisdictions
Fire and
emergency
response
The number of crashes requiring fire and
rescue services and their unit cost.
Victorian Metropolitan Fire and
Emergency Services Board
Number of crashes requiring fire and rescue
services
Victorian Country Fire Authority
Insurance
administration
TAC of Victoria
NSW Rural Fire Service
Multiplied by (X) Unit cost of fire and rescue
services
Ambulance costs
Aggregation of the costs of transporting
casualties from crash sites to hospitals;
providing medical and respite care to injured
persons at the crash site and until being taken
to a hospital; and transferring injured people
between hospitals where required.
Appendix E – Data for cost estimates
Steering Committee for the Review
of Government Service Provision
(SCRGSP, 2006)
SCRGSP (2006)
Audit Office of NSW (2003)
Note. Significant variability across
jurisdictions in costs and crash
attendance exist due to variations in
the average number of injured people
per crash, the level of air and
helicopter ambulance use across
jurisdictions.
124
Medical and
hospital costs
Costs of treatment for casualties who
survived and were admitted to hospital, but
died within 30 days from injuries sustained in
the crash.
Berry and Harrison, 2008
Mean hospital stay
Multiplied by (X) Mean hospital cost per day
Coronial costs
Administrative costs, autopsies/pathologist
examination (for approximately 80% of
deaths), coronial inquest (for approximately
2% of deaths)
National Coroners Information
System (2008)
NSW Health (2007)
Magistrates Court Tasmania (2007)
Police services
costs
Total time costs of on-site interviews,
inspection, measurements at the crash site,
writing notes, management and other on-site
and off-site activities, plus hourly cost of
police equipment.
Howard, Young and Ellis (1977)
NT Government Budget Papers
(2004)
[Number of crashes attended by police
Multiplied by (X) Number of officers
attending a crash
Multiplied by (X) Number of hours spent per
crash
Multiplied by (X) Value of police services
per hour]
Plus (+)
[Number of crashes attended by police
Multiplied by (X) Number of hours spent per
crash
Multiplied by (X) Equipment cost per crash]
Appendix E – Data for cost estimates
125
Injuries (costs are estimated by non-hospitalised and hospitalised injuries, which is further broken down
by level of disability and impairment)
Cost item
Data to collect and calculations
Data source
Workplace and
household losses
and workplace
disruption losses
Disability weights in conjunction with age and
body region are used in the estimation.
ABS
For non-hospitalised injuries, assumptions can
be made e.g. five days of lost output for each
injured person (see Australian Safety and
Compensation Council 2009).
Standard age-earnings model
described in Miller et al. (1998).
Number of disabled persons by age group and
body region affected
Multiplied by (X) Years lost due to disability by
age group and body region affected
Multiplied by (X) Average annual earnings by
gender by age group
Multiplied by (X) Average participation rate
adjusted for return to work by age group
Long-term care
cost
Costs of providing care for people who suffer a
disability (payment to carers) and the cost of
disability services (specialist accommodation,
aids and equipment, alterations to housing,
therapy and specialist services, day programs).
ABS
Price Waterhouse Coopers (2008)
Care hours can be valued by self-valuation,
opportunity cost or replacement cost
methodologies. The cost is sensitive to the
method used (Access Economics 2005). BITRE
used a replacement cost method to estimate
future care costs where the cost of both informal
and formal care is estimated using a market
benchmark.
Cost of care =
Number of persons with disability
Multiplied by (X) Average years for which care
is received
Plus (+ ) Hours of care needed per year
Multiplied by (X) Average hourly wage rate
Quality of life
losses
Costs of pain and suffering of people injured in
road crashes. Award payment can be used as a
notional value.
Sum of (number affected by type of disability)
Multiplied by (X) Average award per person)
Medical and
other related
costs (e.g.
in/outpatient
hospital and
The medical costs of treating non-hospitalised
injuries can be assumed to be the same as
treating persons with impairment ratings less
than 10 per cent (BITRE, 2009). Estimates were
made from interpolation of TAC data by BITRE
Appendix E – Data for cost estimates
TAC of Victoria
AIHW
Berry and Harrison (2008)
ABS
Berry and Harrison (2008)
BITRE (2009)
TAC of Victoria
126
rehabilitation
costs)
(2009).
AIHW
Number affected by degree of impairment
Multiplied by (X) Medical costs by degree of
impairment
Plus (+)
Total days spent in public and private hospitals
— excluding same day separations
Multiplied by (X) Average cost per day of
hospital stay
Plus (+)
Number of affected by degree of impairment
Multiplied by (X) Paramedical costs by degree
of impairment
Insurance
administration
Costs associated with administering compulsory
third party (CTP) systems.
TAC of Victoria
Number of claims made for each road crash
resulting in an injury.
Multiplied by (X) The cost of administering
injury claims
Legal costs
Road crash injury claims that are litigated.
TAC of Victoria
The number of claims in dispute for 2006 was
estimated by assuming that disputed claims are
skewed towards the higher value claims and that
the weighted average of all claims in dispute is
about 21.5 per cent (BITRE, 2009).
Latham & Playford (2002)
Sum of (Average size of claims within each
claim band
Multiplied by (X) % in dispute)
Ambulance costs
See fatality
See fatality
Emergency
services costs
Costs of police services and fire and rescue
services; See fatality.
See fatality
Recruitment and
re-training cost
[Recruitment cost per person for replacement
and training of the new recruit
Office of Workplace
Development (2004)
Multiplied by (X) Number who could not return
to work]
TAC of Victoria
ABS
Plus (+)
[Retraining cost
Multiplied by (X) Number who could have
returned to work]
Appendix E – Data for cost estimates
127
Property and general costs (same definition for fatal, non-fatal injury and property damage only crashes)
Vehicle repairs
Cost to repair the damage caused to vehicles involved in
road crashes. Cost of insurance claims includes towing
costs as well.
Swan Motorcycle Insurance
(IAG, 2008)
Insurance
administration
The costs of administering the motor vehicle property
damage insurance system and processing claims
(underwriting and general administration costs)
Australian Prudential
Regulatory Authority
(APRA)
Travel delay
Non-recurrent congestion costs including time lost due
to queuing in traffic or from reduced travel speed. Total
cost per crash has been estimated by BITRE (2009)
through complex modelling and assumptions.
BITRE (2009)
Vehicle
unavailability
Costs to the owner of the unavailable vehicle. For
commercial vehicle owners costs include lost business.
For private vehicle owners costs include hiring a
replacement vehicle or inconvenience of changing to
public transport etc. Assumptions may be made for the
number of unavailable days depending on whether the
vehicle was towed or untowed.
Market value motorcycle
hiring rates including full
insurance costs (Hertz,
Budget, Europcar, Avis).
Health costs of
additional local
air pollution
Additional exhaust emissions to the atmosphere from
time queuing in traffic with the engine running,
contributing to local air pollution and imposing
additional health costs on society (BTRE 2005).
BTRE (2007)
Additional
vehicle operating
costs
Vehicle operating costs including additional petrol use
from extra time spent in congested traffic caused by road
crashes (BTRE 2005).
BTRE (2007)
Property damage
Cost of damage to non-vehicle property (often referred
to as road furniture) due to road crashes i.e. the
estimated cost of repairs or replacement of crash
damaged items.
Number and type of items
reported damaged by type of
crash in the ACT, and
various data on repair and
replacement costs published
by state and territory
governments.
Non-vehicle objects include light or telephone poles,
sign or signal poles, buildings or structures, kerbs or
guard rails, signs, guide posts and other items including
trash bins.
Motorcycle
protective
clothing
replacement cost
Failure rate of clothing worn by Australian riders (Gear
study) or of products reported by international consumer
testing programs
Appendix E – Data for cost estimates
de Rome et al. (2011)
Ride Magazine (various)
128
REFERENCES
Australian Safety and Compensation Council (2008), The Health of Nations: The Value of a
Statistical Life, review undertaken by Access Economics, July.
http://www.safeworkaustralia.gov.au/swa/aboutus/publications/researchreports/thehealthofnations
thevalueofastatisticallife.htm
Audit Office of New South Wales (2003), Ambulance Service of New South Wales, Financial
report for the year ended 30 June 2003,
http://www.audit.nsw.gov.au/publications/reports/financial/2003/vol5/679_AmbulanceServiceNS
W.pdf
APRA (2007), Statistics – Half Yearly General Bulletin, Australian Prudential Regulatory
Authority, Sydney Australia
Berry, J. G. and Harrison, J. E. (2008), Serious injury due to land transport accidents,
Australia, 2005–06, Injury Research and Statistics Series Number 42, Australian Institute of
Health and Welfare, Canberra
http://www.nisu.flinders.edu.au/pubs/reports/2008/injcat113.pdf
Bureau of Infrastructure, Transport and Regional Economics [BITRE] (2009). Road crash
costs in Australia 2006, Report 118, Canberra, November.
BTRE (2007), Estimating urban traffic and congestion cost trends for Australian cities,
Working Paper No 71, Canberra ACT.BTE Report 102, BTE, Canberra, Australia,
http://www.btre.gov.au/docs/reports/r102/r102.pdf.
Department of the Premier and Cabinet Western Australia (2005), Profile of the Western
Australian State Government Workforce June 2005, Western Australia
http://www.wagiv.wa.gov.au/documents/training2005_000.pdf
Department of Families, Community Services and Indigenous Affairs (2007), Costs of children:
Research commissioned by the Ministerial Taskforce on Child Support, Occasional Paper No. 18,
Canberra
http://www.fahcsia.gov.au/about/publicationsarticles/research/occasional/documents/op18/oip18.
pdf
de Rome, L., Ivers, R., Fitzharris, M., Du, W., Richardson, D., Haworth, N., Heritier, S.,
2011. Motorcycle protective clothing: Protection from injury or just the weather? Accident
Analysis and Prevention 43 (6), 1893-1900
General Purpose Standing Committee GPSC (2001) ), Budget estimates—Fair Trading,
Corrective Services, and Sport and Recreation, report of the General Purpose Standing
Committee No.3, Government of New South Wales
http://www.parliament.nsw.gov.au/prod/parlment/committee.nsf/0/c6f5b03808da505cca256a6b0
023c7c8/
FILE/Fair%20Trading,%20Corrective%20Services,%20Sport%20&%20REcreation.PDF
Howard, B. V. Young, M. F. and Ellis, J. P. (1977), Appraisal of the existing traffic accident data
collection and recording system – South Australia, Office of Road Safety, Department of
Transport, Canberra
Appendix E – Data for cost estimates
129
Insurance Australia Limited (IAG) (2008), Motorcycle tip–over testing repair costs, Crash
Research Centre http://www.iagresearch.com.au/content/view/72/91/, accessed 8 May 2009
Latham, C. and Playford, M. (2002), Report to the Insurance Issues Working Group of Heads of
Treasuries—Actuarial assessment of the recommendations of the IPP Report,
PricewaterhouseCoopers Actuarial Pty Ltd
Magistrates Court Tasmania (2007), Magistrates Court Annual Report 2006—2007, Magistrates
Chambers, Launceston
http://www.magistratescourt.tas.gov.au/__data/assets/pdf_file/0004/98320/20062007_Annual_Re
port.pdf
Miller, T. R. (2000). Variations between countries in values of statistical life. Journal of
Transport Economics and Policy, 34(2), 169–188.
National Coroners Information System (2008), The Coronial Process—web publication, National
Coroners Information System
http://www.vifp.monash.edu.au/ncis/web_pages/the_coronial_process.htm
NSW Health (2007), Ten–year services plan for forensic pathology services in NSW, Final
Consultants Report to Forensic Pathology Service Plan Steering Committee, NSW Health,
Sydney http://www.health.nsw.gov.au/pubs/2007/pdf/forensic_serviceplan.pdf
NT (2004), Northern Territory Budget Paper No. 3: The Budget, NT Government, Darwin
http://www.nt.gov.au/ntt/financial/budget04–
05/papers/bp3/nt_police_fire_emergency_services.pdf
Office of Workplace Development (2004), Consolidated business case for the acquisition
and implementation of an effective e–Recruitment System, Office of Workforce Development,
Melbourne
PNSW (1997), Second Interim Report: The long–term financial viability of the Victims
Compensation Fund, Joint Select Committee on Victims Compensation, Parliament of New
South Wales, Sydney
Price Waterhouse Coopers (2008), Critique of assessment of conventional costs and benefits,
report prepared for the Victorian Department of Premier and Cabinet, Pricewaterhouse
Coopers
Standing Committee on Legal Affairs LAACT (2004) ), Victims of Crime (Financial
Assistance) Amendment Bill 2003, Standing Committee on Legal Affairs, Legislative
Assembly for the ACT, Canberra, June
http://www.parliament.act.gov.au/downloads/reports/la08victimsofcrimebill.pdf
Steering Committee for the Review of Government Service Provision (SCRGSP), (2006),
Report on Government Services 2006, Productivity Commission, Canberra.
http://www.pc.gov.au/gsp/reports/rogs/2006
Appendix E – Data for cost estimates
130
Victorian Auditor General’s Office (2005), Performance audit reports, Melbourne
http://archive.audit.vic.gov.au/reports_par/agp10503.html
Victorian Bar 2008, Review of fees paid by Victoria Legal Aid to barristers in criminal cases,
April, report by PricewaterhouseCoopers.
Victorian Sentencing Advisory Council (2007), Sentencing trends for culpable driving
causing death in Victoria, Sentencing Snapshot No.29, August.
(www.sentencingcouncil.vic.gov.au)
Appendix E – Data for cost estimates
131
APPENDIX F TEST FACILITIES FOR EUROPEAN MOTORCYCLE
PERSONAL PROTECTIVE EQUIPMENT STANDARDS
Body Type
Certification Facility Name
Country
NB 0072
Institut Français de Textile et de l'Habillement (IFTH)
France
NB 0075
CTC
France
NB 0120
SGS United Kingdom Limited
United Kingdom
nb 0160
Instituo Español Del Calzado Y Conexas, Asociacion
De Investigacion
Spain
nb 0161
Asociacion De Investigacion De La Industria Textil
Spain
nb 0162
Leitat Technological Center
Spain
mb 0164
Leitat Technological Center
Spain
mb 0193
Pfi - Prüf-Und Forschungsinstitut Pirmasens E.V.
Germany
nb 0197
Tüv Rheinland Lga Products Gmbh
Germany
nb 0299
Dguv Test Prüf- Und Zertifizierungsstelle
Fachausschuss Persönliche Schutzausrüstungen
Germany
nb 0302
Anccp - Agenzia Nazionale Certificazione Componenti
E Prodotti Srl
Italy
nb 0321
Satra Technology Centre
United Kingdom
nb 0397
Organismo Di Certificazione Europea Srl
Italy
nb 0403
Finnish Institute Of Occupational Health
Finland
nb 0426
Italcert Srl
Italy
nb 0496
Det Norske Veritas Italia Srl
Italy
nb 0499
Societe Nationale De Certification Et D'homologation
S.À.R.L. (Snch)
Luxembourg
nb 0501
C.R.I.T.T. Sports Et Loisirs
France
nb 1024
Vyzkumny Ustav Bezpecnosti Prace, V. V. I.
Czech republic
nb 1296
Vutch - Chemitex Spol. S R.O.
Slovakia
Test
Capabilities
?
Yes
Yes
Yes
Note: The Certification Facilities listed in the table above are able to certify garments to EU
Motorcycle PPE standards. Those further listed as having test capabilities are known to have
the required test facilities to perform testing to the relevant standards. This listing is correct at
time of writing but may be subject to change.
Appendix F – Test facilities for the EU Motorcycle PPE standards
132
APPENDIX G STANDARDS FOR THERMAL AND WATER PENETRATION TESTS
Standard
Number
Standard Name
Description
Test Parameter
Thermal insulation
EN 342
Protective clothing – Garments and clothing
combinations for protection against cold
Air permeability (3 Levels)
Breathing properties (3 Levels)
Waterproof Properties (3 Levels)
EN 343
Protective clothing – Protection against rain
Breathing properties (3 Levels)
Thermal insulation (3 Levels)
EN 14058
Protective clothing – Garments for protection
against cool environments
Air Permeability, optional (2 Levels)
Waterproofness, optional (2 Levels)
EN 14360
Protective clothing against rain. Test method
for readymade garments. Impact from above
with high energy droplets.
Thermal Manikin
ASTM F1291-10
Temp Controlled Environment
ASTM F2370-10
Sweating Thermal Manikin
ASTM F2371-10
Sweating Thermal Manikin
ThermoAnalytics
Human Thermal Comfort Module
Standing thermal manikin specifications
including surface area, height, average skin
temperature and measurement methods.
Controlled environment chamber
specifications, including dimensions, air
temperature, humidity and air velocity and
measurement methods.
Same as ASTMF-1291-10 thermal manikin
plus sweat generation specifications and
systems.
Same as ASTM F1291-10 and ASTM F237010 plus sweat generation example of cotton
body suit saturated with water.
Virtual heat comfort analysis system. This is
a software dummy which is useful for
designing protective clothing, but not for
producing comparative results between
different products.
Note: This listing is correct at time of writing but may be subject to change.
Appendix G – Standards for thermal and water penetration tests
133
APPENDIX H TEST FACILITIES FOR THERMAL AND WATER PENETRATION TESTS
Test
Capabilities?
Facility Name
Country
IRCM ISTITUTO DI RICERCHE E
COLLAUDI MASINI S.R.L.
Italy
(Certifies for high visibility clothing and
protective clothing against cold >-50°C)
CENTRO TECNOLÓGICO DAS
INDÚSTRIAS TÊXTIL E DO
VESTUÁRIO DE PORTUGAL CITEVE
Portugal
(Certifies for high visibility clothing and
protective clothing against cold >-50°C)
Poland
Yes
Tests to EN 342 Protective clothing – Garments
and clothing combinations for protection against
cold, using thermal mannequin and volunteers
in climatic chamber
Central Institute for Labor Protection
- National Research Institute
Scope of Capabilities
University of Wollongong
Australia
Yes
Thermal Physiology Laboratory conducting a
range of thermal testing. Includes thermal
evaluation of clothing and PPE, and a range of
thermal mannequins
Defence Science and Technology
Organisation (DSTO) Melbourne
Australia
Yes
Walking and sweating mannequin used to test
thermal insulation and evaporative cooling
properties of military clothing ensembles
Yes
Climate control chamber and thermal sweating
mannequin used in testing to simulate human
body skin responses to the wearing of clothing
and apparel.
Royal Melbourne Institute of
Technology (RMIT)
Australia
Note: The Facilities listed in the table above as having test capabilities, are known to have
the required test facilities to perform testing to the relevant standards. This listing is correct at
time of writing but may be subject to change.
Appendix H– Test facilities for thermal and water penetration tests
134