Process Manual - Dietitians Association of Australia

Transcription

Process Manual - Dietitians Association of Australia
A review of the evidence to address targeted
questions to inform the revision of the
Australian dietary guidelines 2009
Process manual
Associate Professor Peter Williams, PhD, FDAA (Research Leader)
Associate Professor Margaret Allman-Farrinelli, PhD, AdvAPD (Research Leader)
Professor Clare Collins, PhD, FDAA (Research Leader)
Dr Janelle Gifford, PhD, AdvAPD (Project Officer)
Annette Byron, MPH, APD (Project Manager)
Dietitians Association of Australia
ABN 34 008 521 480
Acknowledgements
ADA Evidence Analysis Manual, Steps in the ADA Evidence Analysis Process, 2008. © American Dietetic
Association. Pages 43–48 reprinted with permission.
© Copyright 2011 Dietitians Association of Australia
A review of the evidence to address targeted questions to inform the revision of the Australian dietary guidelines 2009:
Process Manual
You may download, store in cache, display, print and copy a single copy or part of a single copy of the Guidelines from
this site or printed material only for your personal, non-commercial use and only in an unaltered form.
This manual may be used for the purposes of private study, research, criticism or review , as permitted under the
Copyright Act 1968 and may only be reproduced as permitted under the Copyright Act 1968 (a copy of the Act is
available at http://www.comlaw.gov.au)
Permission for reproduction of any of the material must be sought from the Dietitians Association of Australia (DAA) and
acknowledge the DAA as source of any selected passage, extract, diagram or other information of material reproduced.
Any reproduction made of the information or material must include a copy of the original copyright and disclaimer
notices as set out here.
Contents
Introduction
1
Section 1
Overall process
2
Section 2
Data extraction
3
Section 3
Quality assessment
16
Section 4
Forming a Body of Evidence statement
17
Section 5
Creating citation lists
18
Section 6
NHMRC submitted literature
21
Section 7
Submitting documents to the Project Officer
22
Section 8
Appendices
23
Appendix 1
Reviewers‘ Tips
23
Appendix 2
Search strategy for Systematic Literature Review to Update the Dietary Guidelines
24
Appendix 3
Decision tree for study selection
53
Appendix 4
Example body of evidence chapter: Fruit
54
Appendix 5
Sample Data Extraction – RCT
56
Appendix 6
Sample Data Extraction – Review
58
Appendix 7
NHMRC Levels of Evidence
61
Appendix 8
NHMRC explanatory notes on effect size
64
Appendix 9
NHMRC explanatory notes on relevance of evidence
65
Appendix 10
Guide to filling out the Quality Criteria Checklist
66
Appendix 11
How to assess the body of evidence and formulate recommendations
73
Appendix 12
NHMRC citations inclusions/exclusions proforma
77
Section 9
References
78
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
Introduction
The Review of the evidence to address targeted questions to inform the revision of the Australian dietary
guidelines was a complex undertaking of the Dietitians Association of Australia under contract to the
National Health and Medical Research Council (NHMRC) with contributions from more than thirty
Australian Accredited Practising Dietitians/academic reviewers in diverse locations. Training,
communication and implementation of common process and tools for this project was crucial to a high
quality review. This manual was developed by the Review Leadership Team with the assistance of the
Project Officer and Project Manager for the purpose of guiding the people undertaking the review and to
provide a common point of reference over the duration of the project. The manual evolved as the process
was developed and fine-tuned and was shaped by feedback from reviewers to the Review Leadership
Team and from NHMRC Dietary Guidelines Working Committee (DGWC).
The Review Leadership Team wish to acknowledge and thank the team of reviewers and the
DGWC/NHMRC for their assistance and support.
Introduction
1
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Dietitians Association of Australia
Section 1 Overall process
Figure 1 gives an overview of the review process for systematic and umbrella reviews.
Figure 1
Review process
Data
Extraction
Quality
Assessment
Body of Evidence
Matrix
·
·
·
Receive Endnote Libraries from librarian
Identify studies for inclusion in review
Extract data into data extraction spreadsheet
·
Use modified ADA Checklist/spreadsheet for Quality Assessment – enter
assessment of all papers on the one spreadsheet
·
Summarise data extraction and quality assessment into the summary of
included studies
Collate results from the summary into the Overall Rating of the Body of
Evidence spreadsheet.
·
·
Table of Evidence
Statements
·
Research Leadership team to review the Body of Evidence Matrix and
recommendation statements for consistency with the evidence
Send all required documents to the Project Officer
Recommendations for
NHMRC
Reviewers‘ tips have been developed and included in Appendix 1 in order to assist with questions that
may arise as reviewers work through the process.
2
Section 1 Overall process
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
Section 2 Data extraction
2.1
EndNote libraries and identifying studies for inclusion
The first step of the review process is to identify a set of articles for inclusion in the review. To do this
1.
2.
3.
4.
You will receive an EndNote (VX4, Thomson Reuters, New York, NY, USA) database with all the
references retrieved using the project search strategy.
The EndNote database needs to be customised to include several fields unique to the review
(see 2.1.1).
You will need to cull (identify) articles for retrieval/non-retrieval, inclusion/exclusion. You will need to
record several related keys in customised fields (see 2.1.2).
Retrieve the final included articles for data extraction and quality rating.
Steps 2–3 are outlined below as well as instructions on searching using customised fields.
2.1.1 Customising your EndNote database
There are several customised fields within EndNote that will be used to store information for reference and
searching for this review. These fields are:
·
Study/Review/Other
·
Retrieve/Not Retrieve
·
Not Retrieve Reason
·
Include/Exclude
·
Exclude Reason
·
Inclusion – Population Subgroup
·
Inclusion – Outcome Condition
We need you to use these customised fields for consistency across the review process and for ease of
searching in reporting on this information.
For you to use the customised fields within your EndNote database, you will need to import an XML file
with the formatted reference template for journal articles. The process for importing the XML file is (also
see ―notes‖ at the end of this section if you can‘t locate the EndNote files referred to here):
Backup Current XML file for safety
·
for XP it is located at: Documents and Settings\[your name]\Application Data\EndNote
·
for Vista it is located at: [your name]\AppData\Roaming\EndNote
·
find the file RefTypeTable.xml and rename to RefTypeTableOriginal.xml
For EndNote X1 (Windows XP)
·
Save the attached file to your USB or disk
·
Open your EndNote library.
·
Click on Edit\Preferences, then click on Reference Types
·
Click on Import, and import the saved XML file.
·
This will overwrite the current file of the same name, so all your future libraries will use this.
For EndNote X (Windows XP)
·
Save the attached file to your disk at the following location: Documents and Settings\[your
name]\Application Data\EndNote
·
Open your EndNote library.
For EndNote X (Windows Vista)
·
Save the attached file to your disk at the following location: [your name]\AppData\Roaming\EndNote
Section 2 Data extraction
3
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
·
Open your EndNote library as above.
Notes
·
If you can‘t find your EndNote files, they may be ―hidden‖. Try following these steps to display hidden
files and folders.
1.
2.
3.
In Documents and Settings or subfolders as required, open Folder Options.
Click the View tab.
Under Advanced settings, click Show hidden files and folders, and then click OK.
·
Reviewers will need to consistently use the same version of EndNote on the same computer OR
implement the same steps on PCs in use for the review in order to pick up the customised fields – the
XML file is not transferred with the EndNote library across PCs or versions of EndNote on the same
PC.
·
In order to view the customisations, the reference type must be ―journal article‖. Reviewers will need to
alter this if individual references have come through as a different reference type.
4
Section 2 Data extraction
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
2.1.2 Culling articles
The process for culling papers is shown in Figure 2 below and notes on process and documentation at
each step follow.
Figure 2
Process for culling articles contributing to body of evidence statements and required documentation
Process
Documentation
Search Information
Topic search
Step 1
Step 2
Step 3
Step 4
Step 5
· Appendix: Search strategy from librarian
· Topic Chapter: Search summary paragraph from
reviewer
Classify
Retrieve / Not
Retrieve
· Statistics Flowchart: add total number obtained
from search
Retrieve
CLASSIFY
Include / Exclude
Not Retrieve
CLASSIFY
Note reason for
non-retrieval
Include
Note population
Subgroup and
Outcome
Exclude
Note reason for
exclusion
Include/Exclude
· Statistics Flowchart: add number included and
excluded, and reason for exclusion
· Data Extraction: one data extraction sheet (tab) for
each included study within one excel spreadsheet
for each topic
· Summary of Included Studies: Summarise results
of all included studies.
Include
CLASSIFY
Include in BOE /
Not include in BOE
Include in BOE
Create BOE for
each outcome
Retrieve/Not Retrieve
· Statistics Flowchart: add number retrieved and not
retrieved, and reason for non-retrieval
· Quality Criteria Checklist: One spreadsheet (tab)
for each included study within one Excel
spreadsheet for each topic.
Not include in BOE
Include in BOE/not include in BOE
· Statistics Flowchart: add number included in BOE,
not included in BOE and reason for non-inclusion in
BOE
· Citation list included studies not in BOE: Extract
citation list for I studies
· Citation list all excluded studies: Extract citation
list for I and E studies.
Include in BOE
· BOE and Summary of Included Studies: one Excel
file for each BOE
· Topic Chapter: For each BOE statement include
statement with consistent wording as specified,
grade, BOE matrix, summary paragraph, reference
list
Section 2 Data extraction
5
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
Step 1
·
·
·
Record in the field Study/Review/Other one of the following:
S
if the article is a study
R
if the article is a review
O
if the article is neither a study nor a review
The decision to not retrieve an article should be based on obvious exclusion criteria in the abstract.
Where there is doubt, retrieve the article. When reviewing abstracts, each study should be recorded in
the Retrieve/Not Retrieve field as
R
if the study is to be retrieved
N
if the study is not to be retrieved
If classified as N reason(s) for non-retrieval should be recorded in the field Not Retrieve Reason as
(Note: there may be several reasons for a single study to be excluded but only one reason code need
be given)
NS
Not a study (e.g. editorial)
NP
Not a relevant population (e.g. animal study, particular disease group)
NO
Not a relevant outcome (i.e. the study does not report any of the defined outcomes e.g.
risk of chronic disease, environmental impacts, social equity and health and well bring OR
e.g. RCTs that studied the effects of isolated extracts were excluded as NO: e.g. betaglucan (rather than whole oats); isoflavones (rather than soy).
Dup
Article is a duplicate of another article already identified for retrieval
XS
Cross-sectional study
Step 2
·
When reviewing full articles that have been retrieved, apply exclusion criteria and record one of the
following in the Include/Exclude field:
I
if the article is to be included in the review
E
if the article is to be excluded from the review
Step 3
·
If the article has been excluded record one of the following as a reason for exclusion in the Exclude
Reason field:
(Note: there may be several reasons for a single study to be excluded but only one reason code need
be given)
6
NS
Not a study (e.g. editorial)
NP
Not a relevant population (e.g. animal study, particular disease group)
NO
Not a relevant outcome (i.e. the study does not report any of the defined
outcomes e.g. risk of chronic disease, environmental impacts, social equity and
health and wellbeing) OR e.g. RCTs that studied the effects of isolated extracts
were excluded as NO: e.g. beta-glucan (rather than whole oats); isoflavones
(rather than soy).
Dup
Article is a duplicate of another article already identified for retrieval
XS
Cross-sectional study
<5 studies
less than 5 studies – cannot form BOE
inc in review
where a single study is already covered by an included review article
Section 2 Data extraction
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
·
If the article has been included, a code needs to be recorded in the Inclusion – Population Subgroup
and the Inclusion – Outcome Condition fields:
1.
Inclusion – Population Subgroup codes:
I0
if the study population includes those age 0–6 months
I7
if the study population includes those aged 7–12 months
C1
if the study population includes those aged 1–3 years
C4
if the study population includes those aged 4–8 years
B9
if the study population includes those aged 9–13 years who are male
B14
if the study population includes those aged 14–18 years who are male
G9
if the study population includes those aged 9–13 years who are female
G14
if the study population includes those aged 14–18 years who are female
M19
if the study population includes those aged 19–30 years who are male
M31
if the study population includes those aged 31–50 years who are male
M51
if the study population includes those aged 51–65 years who are male
M65
if the study population includes those age 65+ years who are male
W19
if the study population includes those aged 19–30 years who are female
W31
if the study population includes those aged 31–50 years who are female
W51
if the study population includes those aged 51–65 years who are female
W65
if the study population includes those age 65+ years who are female
P14
if the study population includes pregnant women aged 14–18 years
P19
if the study population includes pregnant women aged 19–30 years
P31
if the study population includes pregnant women aged 31–50 years
L14
if the study population includes lactating women aged 14–18 year
L19
if the study population includes lactating women aged 19–30 years
L31
if the study population includes lactating women aged 31–50 years
Section 2 Data extraction
7
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
Inclusion – Outcome Condition codes:
2.
Ob
if the study measures risk of obesity
CVD
if the study measures risk of CVD
St
if the study measures risk of stroke
T2D
if the study measures risk of Type 2 Diabetes
Ca
if the study measures risk of cancers
HT
if the study measures risk of hypertension
COPD if the study measures risk of chronic obstructive pulmonary disease
Eye
if the study measures risk of eye diseases
Bo
if the study measures risk of bone diseases
Dl
if the study measures risk of dental diseases
Me
if the study measures risk of mental illness
En
if the study measures environmental impacts (over the life of the food, i.e. production,
packaging, distribution, consumption, waste products)
SE
if the study measures outcomes related to social equity.
HWB
if the study measures outcomes related to health and wellbeing (e.g. life expectancy,
DALY/QALYS)
Oth
if the outcome is included for outcomes in Appendix 2 (Table 2), but is not specific for the
question of interest.
Step 4
·
Although a study may meet inclusion criteria, Body of Evidence (BOE) statements can only be made if
the volume of evidence exists to support it. BOE statements will be formed according to the volume of
evidence indicated in the Decision Tree (Appendix C in the SLR Project Plan; see Appendix 3). At least
five individual studies are needed to form a BOE statement. For all studies that remain after these
criteria update the Include/Exclude field in the EndNote database to IBOE. Possible values in the
Include/Exclude field are now E, I, or IBOE.
·
Remove individual studies from the Summary of Included Studies where they are also referenced in an
included systematic review. This is so they are not counted twice and is a request from NHMRC.
Modify the Include/Exclude field in the EndNote database to E (for exclude) and modify the Exclude
Reason field to Dup.
Step 5
·
Complete the BOE matrix (see Section 4).
·
Form a BOE statement based on all the IBOE studies (see Section 4).
·
Write a summary paragraph.
·
Create a citation list for all studies contributing to the BOE statement (see Section 4).
Documentation/files to be submitted
Refer also to process diagram at the beginning of this section.
·
Data Extraction File – one Excel File with one tab for each study.
·
Summary of Included Studies – one Excel File for each of: Reviews, RCTs & Case Controls, All
other studies.
·
Quality Criteria Checklist – one Excel File with one tab for each study.
·
BOE and Summary of Included Studies – one Excel File for each BOE statement. Within each file
there should be one tab for the BOE statement/grading/matrix, and one tab for the summary of studies
contributing to the BOE statement. For the Summary of Included Studies ensure:

8
all cells are filled. Include ―n/a‖ in cells where applicable and do not leave any blank.
Section 2 Data extraction
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009

Add the reference number from EndNote in square brackets in the first row after the author name
and year i.e. Bloggs et al. 2006 [9999] or Bloggs & Cloggs 2006 [9999].

Add all the reference numbers related to the BOE under the BOE grading.
·
Topic Chapter – one word document modelled on the Fruit topic (Appendix 4) including a summary
search paragraph, the work found in the BOE tab in each of the BOE and Summary of Included
Studies files (above), summary paragraph for each BOE statement, reference list for each BOE
statement (see Creating Citation Lists).
·
NHMRC Literature Table (See Section 6)
·
Submit documents (see Section 7)
2.1.3 Searching using customised fields
Searching customised fields will be needed to provide statistics to the NHMRC on the review process. A
search on customised fields can be conducted by clicking on References/Search References to find the
references with all the search keys entered in the preceding section. However the search fields are still
named ―Custom 1–7‖ and not the names allocated to the customised fields. To search on the customised
fields reviewers need to be aware that:
·
Custom 1=Study/Review/Other
·
Custom 2=Retrieve/Not Retrieve
·
Custom 3=Not Retrieve Reason
·
Custom 4=Include/Exclude
·
Custom 5=Exclude Reason
·
Custom 6=Inclusion – Population Subgroup
·
Custom 7=Inclusion – Outcome Condition
Section 2 Data extraction
9
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
2.2
Data extraction and summary of included studies
Three spreadsheets have been provided for data extraction. These are for Randomised Controlled Trials
and Case-Control Studies, Reviews, and All Other Studies. Refer to Figure 3 for an example showing the
spreadsheet for Randomised Controlled Trials and Case-Control Studies.
Figure 3
Data extraction template for randomised controlled trials and case-control studies
The worksheets are as follows:
·
Overall Rating BOE (Body of Evidence). This is to be filled in last (see Section 4).
·
Summary of Inc Studies. This may be filled in as you go OR after you have completed data extraction
for all studies. It may be more efficient to fill it out for each study as you go. This worksheet has been
based on guidance provided by the NHMRC1 and has associated notes modified for the current review.
These are found in Table 1. Please refer to these notes as you are working through the data extraction
process.
·
nameYYYYa. This will be the name of the third tab when the data extraction table first comes to you.
Rename the tab with the First Author, Year (and letter a–z if the author has published more than one
study in the same year). This worksheet has been based on guidance provided by the NHMRC1 and
has associated notes modified for the current review. These are found in Tables 2 (for Randomised
Controlled Trials and Case-Control Studies) and 3 (for Reviews). Please refer to these notes as you
are working through the data extraction process. Also note that drop-down menus have been provided
for the rows Level of Evidence, Study Design, Allocation, Clinical Importance, and Relevance to assist
with your selection of these fields. Examples of data extraction for an RCT and a Review can be found
in Appendices 5 and 6 respectively.
·
Template. You will need to create a new worksheet for each study that is included. To do this, click on
the ―Insert worksheet tab at the bottom of the worksheet (or F11). Click on the Template tab, place
your cursor in the top left hand corner of the spreadsheet (to the left of column A and above row 1),
right-click and select copy. Move to the newly inserted worksheet, click on the top left hand corner of
the spreadsheet (to the left of column A and above row 1), right-click and select paste. Rename the tab
of your new sheet with the First Author, Year (and letter a–z if the author has published more than one
study in the same year). Please ensure you follow the copy/paste process outlined here as data
10
Section 2 Data extraction
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
validation lists for the drop-down menus are contained (hidden) within the sheet outside the table rows.
The drop down menus will not function unless the entire worksheet is copied.
Section 2 Data extraction
11
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
Table 1
Data extraction notes for summary worksheet
Data Extraction Notes
[1]
Authors, e.g. Smith et al (1999)
[2]
Type of study (RCT, case-control, etc)
[3]
As per the NHMRC levels of evidence, provided at p. 8 of the NHMRC toolkit publication: How to use the
evidence: assessment and application of scientific evidence. See Appendix 7.
[4]
Intervention (e.g. treatment with a pharmaceutical agent, surgery, a dietary supplement, psychotherapy)
and comparator(s).
[5]
Number of participants in each group
[6]
Brief information relevant to the particular study (e.g. participants, methods, outcomes, length of follow up)
[7]
Assessment (in words) of the overall quality of the study. Is the study quality good enough that you have
confidence in the results?
[8]
Size of the summary measure (or point estimate) plus the 95% CI (confidence interval) and/or P-value
[9]
The words corresponding to the appropriate rating from the scale provided at p. 23 of the NHMRC toolkit
publication: How to use the evidence: assessment and application of scientific evidence. See Appendix 8.
[10]
The words corresponding to the appropriate rating from the scale provided at p. 28 of the NHMRC toolkit
publication: How to use the evidence: assessment and application of scientific evidence. See Appendix 9.
Table 2
Data extraction notes for randomised controlled trials and case-control studies
Data Extraction Notes
[1]
Full reference citation details
[2]
Details of how the study was funded or other relevant affiliations of the authors (designed to expose
potential conflicts of interest, such as drug company funding for the drug being trialed)
[3]
The study type (eg RCT, case-control study, cohort study), with additional detail where relevant
[4]
As per the NHMRC levels of evidence, provided at pg. 8 of the NHMRC toolkit publication: How to use the
evidence: assessment and application of scientific evidence. Appendix 7.
[5]
Country/setting (eg hospital, primary care, hospice)
[6]
Provide detail on the intervention. This will generally be a therapeutic procedure such as treatment with a
pharmaceutical agent, surgery, a dietary supplement, a dietary change or psychotherapy. Some other
interventions are less obviously categorised as interventions, such as early detection (screening) and
patient educational materials. The key characteristic is that a person or their environment is manipulated in
the hope of benefiting that person or reducing harm. Particular reference should be made to any
differences from Australian current practice. Key factors in the dietary intervention can be listed here if it is
helpful in giving better context of the study.
[7]
Number of participants enrolled in the intervention/treatment group
[8]
The intervention (eg drug, therapy, placebo) used as a comparison in the study. There may be more than
one comparator. Particular reference should be made to any differences from Australian current practice.
[9]
Number of participants enrolled in the comparison/control group(s)
12
Section 2 Data extraction
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
Table 2
Data extraction notes for randomised controlled trials and case-control studies (continued)
Data Extraction Notes
[10]
Any factors that may confound/influence the results and/or the external validity (see below) of the results
(e.g. mean age, mean BMI, sex, co-morbidities, obesity, existing medications, previous surgery). List all
potential confounders since these relate to study quality. Give baseline data where relevant.
[11]
Length of follow-up of the participants. Note that this is follow-up after study completion.
[12]
The outcomes studied (list all outcomes in terms of primary and secondary outcomes). Indicate which
outcomes are relevant to the review/guidelines inclusion criteria. Copy EndNote inclusion code here. Also
note whether the outcome is a primary or secondary outcome in the study of interest.
[13]
The method used to assign patients to treatment or control groups (eg coin toss, random number table,
computer-generated random numbers, sealed envelopes). Also indicate whether the allocation list was
concealed (e.g. computerised random number generation, administered from a central trial office, assigned
locally)
[14]
The results of the group analysis, noting any clinically or statistically significant differences between the
groups at study inception
[15]
Whether the participants, outcome assessors and (if different) investigators were blinded to the group
allocation. Insert Y/N/NR/NC (for yes/no/not reported/not clear). To add further detail/comment on blinding,
add a comment by right click on the cell and ―insert comment‖
[16]
(a) Indicate whether, aside from the experimental treatment, the groups were treated and measured the
same. Insert Y/N/NR/NC (for yes/no/not reported/not clear); (b) N/NR (for no/not reported) OR overall
number; (c) actual intake achieved by the intervention group (as opposed to the planned intervention
intake)
[17]
The proportion of participants that were followed up and whether all participants were analysed according
to the group to which they were initially allocated, regardless of whether or not they dropped out, fully
complied with the treatment, or crossed over and received the other treatment (‗intention to treat analysis‘ ITT)
[18]
Summarise the quality rating using the ADA assessment tool, and if necessary add further assessment (in
words) of the overall quality of the study. Is the study quality good enough that you have confidence in the
results?
[19]
The outcome relevant for this entry in the database (Note: more than one table may be required if there
are several outcomes relevant to different clinical questions/guidelines)
[20]
For binary outcomes, show numbers of patients with the outcome. For continuous outcomes, show means
± standard deviations; or medians and interquartile ranges
[21]
For binary outcomes, show numbers of patients with the outcome. For continuous outcomes, show means
± standard deviations; or medians and interquartile ranges. Add number of columns as needed , e.g. 3-arm
trials
[22]
Absolute and relative measures of effect and measure of variability eg risk differences (absolute risk
reduction or absolute risk increase), mean differences, relative risk, odds ratio
[25]
95% confidence interval (CI) for all measures, if available, otherwise use P-value (be explicit on what
comparison the P-value relates to)
[23]
A measure of benefit, when the treatment increases the probability of a good event. The number needed to
treat to benefit (NNT) = the number of participants who must receive the treatment to create one additional
improved outcome in comparison with the control treatment; calculated as 1/absolute benefit increase,
rounded up to the next highest whole number
[25]
95% confidence interval (CI) for all measures, if available, otherwise use P-value (be explicit on what
comparison the P-value relates to)
Section 2 Data extraction
13
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
Table 2
Data extraction notes for randomised controlled trials and case-control studies (continued)
Data Extraction Notes
[24]
A measure of harm, when the treatment increases the risk of specified adverse outcomes of a condition or
reduces the probability of a good event. The number needed to treat to harm (NNH) = the number of
patients who, if they receive the treatment, would lead to one additional person being harmed compared
with patients who receive the control treatment; calculated as 1/absolute risk increase, rounded up to the
next highest whole number
[25]
95% confidence interval (CI) for all measures, if available, otherwise use P-value (be explicit on what
comparison the P-value relates to)
[26]
Insert the words corresponding to the appropriate rating from the scale provided at p. 23 of the NHMRC
toolkit publication: How to use the evidence: assessment and application of scientific evidence
[27]
Insert the words corresponding to the appropriate rating from the scale provided at p. 28 of the NHMRC
toolkit publication: How to use the evidence: assessment and application of scientific evidence
[28]
Information on any adverse events mentioned in the study
[29]
Are the patients in the study so different from those being considered for the guideline that the results may
not be applicable to them? i.e. is the study generalisable? Insert Y/N
[30]
Will the potential benefits outweigh any potential harms of treatment in the guideline population? i.e. is the
study applicable? Insert Y/N
[31]
Add your overall comments regarding the interpretation or implications of this study. This should include
―flags‖ or questions for the Review Leadership Team. Comments on the actual intake achieved should be
included here.
[32]
Statement on main conclusion. This can be copied from the study or a summary statement
14
Section 2 Data extraction
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
Table 3
Data extraction notes for reviews
Data Extraction Notes
[1]
Full reference citation details
[2]
Details of how the study was funded or other relevant affiliations of the authors (designed to expose
potential conflicts of interest, such as drug company funding for the drug being trialed)
[3]
The study type (e.g. systematic review, meta-analysis, systematic review of cohort, meta-analysis of
cohort), with additional detail where relevant
[4]
As per the NHMRC levels of evidence, provided at p. 8 of the NHMRC toolkit publication: How to use the
evidence: assessment and application of scientific evidence. Appendix 7.
[5]
Date range of search
[6]
Total number of studies included in the review
[7]
Total number of participants included in review from all studies
[8]
Gender (insert M,F, or M+F), Country/Region, age range, plus characteristics considered to be important
by the reviewer. Range of exposure should be a summary of exposures i.e. minimum exposure of all
studies and maximum exposure of all studies.
[9]
The outcomes studied (list all outcomes in terms of primary and secondary outcomes). Indicate which
outcomes are relevant to the review/guidelines inclusion criteria. Copy EndNote inclusion code here. Also
note whether the outcome is a primary or secondary outcome.
[10]
Range of length of follow-up of the participants. Note that this is follow-up after study completion.
[11]
List all databases included in the search for studies.
[12]
Statistical tests/methods used to analyse and summarise data.
[13]
Summarise the quality rating using the ADA assessment tool, and if necessary add further assessment (in
words) of the overall quality of the study. Is the study quality good enough that you have confidence in the
results?
[14]
Copy and paste the main/relevant results table from the pdf of the review. Within the pdf, choose
Tools/Select&Zoom/Snapshot Tool to copy, then paste into this row of the Excel document. The size of the
selected table may need to be reduced and the Excel row height may need to be expanded to fit the table.
[15]
Are the patients in the review so different from those being considered for the guideline that the results
may not be applicable to them? i.e. is the review generalisable? Insert Y/N
[16]
Will the potential benefits outweigh any potential harms of treatment in the guideline population? i.e. is the
review applicable? Insert Y/N
[17]
Add your overall comments regarding the interpretation or implications of this review. This should include
―flags‖ or questions for the Review Leadership Team. Comments on the actual intake achieved should be
included here.
[18]
Statement on main conclusion. This can be copied from the study or a summary statement.
Section 2 Data extraction
15
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
Section 3 Quality assessment
The ADA Quality Assessment Checklist will be used for quality assessment for Primary Studies (S
questions) and Reviews (U questions). Worksheets with both checklists are housed in an Excel
spreadsheet (note the tabs at the base of the spreadsheet). This will be sent to reviewers separately.
Guidance on how to answer the questions can be found in Appendix 10.
Perform the following steps for Primary Studies:
1.
2.
3.
4.
5.
Enter first author, year in Row 4
Enter a sequential reference number in Row 5
Answer questions 1, 2, 4–10 as y or n (yes or no)
Answer question 3 as y, n or na (yes, no or not applicable)
Using criteria in Rows 19–21, rate the paper in Row 18 as n, 0, or p (negative, neutral or positive).
Questions 2, 3, 6 and 7 are grouped/shaded and counts of ―y‖ and ―n‖ are automated and included at
the bottom of the spreadsheet for ease of assessment.
Perform the following steps for Review Studies:
1.
2.
3.
4.
16
Enter first author, year in Row 4
Enter a sequential reference number in Row 5
Answer questions 1–10 as y or n (yes or no)
Using criteria in Rows 19–21, rate the paper in Row 18 as n, 0, or p (negative, neutral or positive).
Questions 1–4 are shaded and counts of ―y‖ and ―n‖ are automated and included at the bottom of the
spreadsheet for ease of assessment.
Section 3 Description of key components of nutrition and dietetic services
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
Section 4 Forming a Body of Evidence statement
1.
2.
Fill in the Body of Evidence matrix in the Excel spreadsheet
For statement based on Level II intervention studies, the evidence statement will take the following
form:
Consumption of [x food] reduces/increases [insert outcome]
E.g. In individuals with elevated BP, a median reduction in salt of 4.6g/day 78mmol sodium/day)
reduces blood pressure by around 5mmHg for systolic and 2.7mmHg for diastolic BP)
3.
When the body of evidence statement is informed by Level III evidence, form the Body of Evidence
statement using the following consistent wording:
a.
Where there is an association and no quantification:
Consumption of [x food] is associated with [reduced risk of/increased risk of]
[insert outcome]
b.
Where there is an association and quantification:
Consumption of [insert amount in serves/g/mL as appropriate] [insert
frequency] of [x food] is associated with [reduced risk of/increased risk of]
[insert outcome]
c.
Where there is no association late BOE statement submissions were worded as follows:
Consumption of [x food] is not associated with [insert outcome]
For BOE statements submitted prior to November 2009, general wording of the evidence
statement was in the direction expected (even if there were no clear outcome). For example it
would be expected that fruit intake would be beneficial so wording of the statement would be
Consumption of fruit is not associated with reduced risk of cancer
NOT
Consumption of fruit is not associated with increased risk of cancer
Wording of statements over the different submissions will be aligned for consistency for the final
submission.
4.
5.
6.
Grade the statement according to the NHMRC system (see Appendix 11). Generally:
·
Grade A required Excellent for both evidence base and consistency
·
Grade B requires Excellent or Good for both evidence base and consistency
·
Grade C requires Good or Satisfactory for both evidence base and consistency
·
Grade D requires Satisfactory or Poor for both evidence base and consistency
Note: when evaluating the consistency and clinical impact of contradictory evidence, much more
weight should be given to meta-analysis results than to individual additional studies, and the reasoning
for final judgements should be explained in the text under evidence tables.
Where dose response ranges are given in the BOE statement but there are many studies underpinning
the statement, include the lowest and highest doses from the selection of papers supporting the
statement (the lowest and highest number do not need to come from the same paper.
Section 4 Forming a Body of Evidence statement
17
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
Section 5 Creating citation lists
5.1
Format for citation lists
A special Output Style for EndNote has been developed (file name Author–Date SLR.ens). This is in the
format required for NHMRC as follows in alphabetical Author–Date sequence, for example:
Affinito, P., Palomba, S., Bonifacio, M., Fontana, D., Izzo, R., Trimarco, B., & Nappi, C. 2001,
―Effects of hormonal replacement therapy in postmenopausal hypertensive patients‖, Maturitas,
vol. 40, no. 1, pp. 75–83.
To use the Output Style file in EndNote:
1.
2.
3.
Ensure EndNote is closed.
Save the Author–Date SLR.ens file in C drive/program files/EndNote X1/Styles
When you open EndNote click on Edit/Output Styles and click on Author–Date SLR
You will need to create a citation list for:
1.
2.
3.
Included studies (to be included in the BOE in the Topic Chapter (See Appendix 4)
Included studies not included in the BOE (to be included in the Topic Chapter (See Appendix 4)
All retrieved but excluded studies
5.2
Creating citation lists for included and excluded studies
Create the citation lists as follows:
1.
For included studies contributing to the BOE
a.
Figure 4
b.
c.
d.
18
Go to the References tab and select Search References (Figure 4)
Searching references
Under the References
tab, select Search
References
Under Search, type IBOE
Under In, select Custom 4
Click on the Search tab at the bottom of the screen (Figure 5)
Section 5 Creating citation lists
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
Figure 5
Searching for IBOE references
Under Search,
type IBOE
Under In, type
Custom 4
Click on
Search
e.
f.
2.
3.
Export the references as per instructions in Section 5.3.
Create the heading Included Studies at the top of the file.
For included studies not contributing to the BOE, repeat the above steps, except put I under Search
instead of IBOE. Use the heading Included Studies (not contributing to BOE).
For all studies NOT contributing to the BOE, repeat the above steps except
a.
b.
c.
d.
e.
under Search, type I.
under Search in the second field down, type E
under Search in the second field down, type IBOE
Under In in the second field down, select Custom 4
for the Boolean conditions select Or in the first field and Not for the second, and search (Figure 6).
Section 5 Creating citation lists
19
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
Figure 6
Searching for all excluded references
Under Search, type
I
Under Search, type
E
Under Search,
type IBOE
under In, type
Custom 4
type Or for
first condition
type Not for
second
condition
click on
Search
f.
g.
5.3
1.
2.
Export the references as per instructions in Section 5.3.
Create the heading Excluded Studies at the top of the resulting file.
Exporting your file
Ensure the Output Style customised for this project (Author–Date SLR) has been chosen.
To export your file, select File/Export and save your file as in rich text format (rtf), NOT text format (txt).
Figure 7
Exporting your file
Under File, select
Export
3.
Format paragraphs within the file as follows:
a.
b.
20
Ensure Author-Date SLR
has been selected as the
output style
no indentation
6pt after each paragraph
Section 5 Creating citation lists
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
Section 6 NHMRC submitted literature
NHMRC Dietary Guidelines Working Committee submitted some literature to be considered in the review.
The same inclusion/exclusion criteria employed in Section 2.1.2 Step 3 is to be applied. Reviewers are to
complete a table describing the results of this process as shown in Appendix 12.
Section 6 NHMRC submitted literature
21
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
Section 7 Submitting documents to the
Project Officer
Documents can be submitted by e-mail, post (on USB/CD/DVD), or using Dropbox (Dropbox Inc. Los Altos,
CA 94022. The Dropbox facility is free of charge up to 2GB and allows sharing of very large files without
the need for e-mailing and USB/DVD/CD. You can read about Dropbox here:
https://www.getdropbox.com/features.
If you wish to use Dropbox, notify the project officer and please follow these instructions:
1.
An invitation will be received from the Project Officer to join Dropbox.
a.
b.
c.
Download the program onto your PC; and
Create an account with your e-mail address.
In your "My Documents" or "Documents" folder on your PC you will notice a new box called "My
Dropbox".
2.
The Project Officer will add names of reviewers to a share file their specific question and each reviewer
will receive an e-mail saying that they have been invited to share this Folder. You should just need to
click the link provided in the e-mail to access the folder. The folder contains individual folders for each
question.
3.
In the My Dropbox folder on your PC, find the folder for your question and copy the relevant documents
into this folder.
Please do not delete or change what is inside your My Dropbox folder. This changes versions of the
same file on all PCs that share the folder.
22
Section 4 Workforce planning
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
Section 8 Appendices
Appendix 1
Reviewers‘ Tips
Retrieval/Non-Retrieval
·
Individual articles referenced within systematic reviews that are included in the review should not be
retrieved.
·
In the ―reason for non-retrieval‖ field, code irrelevant papers in EndNote as N and then NS, NP or NO
as appropriate.
Inclusion/Exclusions
·
Include studies on food and exclude studies on nutrients or food components delivered in a different
form. Trials where fats and oils are administered in capsule form can be included.
·
Include studies if the amount of food (dose) is not included in the study as this still informs about the
effect of the food.
·
Include studies where subjects have a health condition (e.g. hyperinsulinaemia/obesity/CHD/
hypercholesterolaemia) if these subjects happen to be part of the study group and the condition is not
a focus of the study. If the study is about effect of food/nutrient on the disease state, then exclude it...
Inclusion Codes
·
Report baseline age group for longitudinal studies in the inclusion code.
·
Outcomes that are important but not in the inclusion list should be coded as ―Oth‖ in the Inclusion
Outcome Condition. Restrict the use of ―Oth‖ as an outcome code (―Inclusion - Outcome Condition‖) to
outcomes already included in Table 2 (Appendix 2) of Process Manual.
Data Extraction
·
Do not calculate results between groups in the outcomes [19] of the Data Extraction Table for RCTs
and Case Controls.
·
Where there are multiple outcomes for data extraction, results should be entered in whichever way is
easiest for the reviewer to understand, for example outcome and age group within population or
population and age group within outcome etc.
Section 8 Appendices
23
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Appendix 2
Dietitians Association of Australia
Search strategy for Systematic Literature Review to Update the Dietary Guidelines
Table A2.1 Table of search questions and keywords for population, intervention, comparator, and outcome
Question
S.1.1
Population
Intervention
Comparator
Outcome
Includes:
General population in the following
subgroups:
·
Infants 0–6 months
·
Infants 7–12 months
·
Children 1–3 years
·
Children 4–8 years
·
Boys 9–13 years
·
Boys 14–18 years
·
Girls 9–13 years
·
Girls 14–18 years
·
Men 19–30 years
·
Men 31–50 years
·
Men 51–65 years
·
Men >65 years
·
Women 19–30 years
·
Women 31–50 years
·
Women 51–65 years
·
Women >65 years
·
Pregnant women 14–18 years
·
Pregnant women 19–30 years
·
Pregnant women 31–50 years
·
Lactating women 14–18 years
·
Lactating women 19–30 years
·
Lactating women 31–50 years
See Table 1 Fruit
Levels of
consumption
See Table 2
Outcomes for
Obesity, CHD,
Stroke, Type 2
Diabetes, Cancer,
Hypertension,
Chronic
obstructive
pulmonary
disease, Eye
health, Bone
health, Dental
health, Mental
health, Other
Systematic literature review – assessing the primary
literature
Fruit
In these population groups, does a particular intake of fruit
affect the risk of [each condition listed in Table 2]?
For each of the topics under S1.1 use the same question
format. In this example search for fruit for each intervention
inclusions and exclusions (Table 1), according to each
population group for all outcomes as listed in separate outcome
table (Table 2).
Includes:
· Fruit as a food
and juice in total
· Fruit as a food
only
Excludes:
·
·
24
Serious medical conditions
Elite athletes
Section 8 Appendices
Dietitians Association of Australia
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Table A2.1 Table of search questions and keywords for population, intervention, comparator, and outcome (continued)
S.1.1
(cont.)
Question
Population
Intervention
Comparator
Outcome
Vegetables
As for S1.1 Fruit
See Table 1
Vegetables
Level of
consumption
See Table 2
Outcomes for
Obesity, CHD,
Stroke, Type 2
Diabetes, Cancer,
Hypertension,
Chronic
obstructive
pulmonary
disease, Eye
health, Bone
health, Dental
health, Mental
health, Other
No red meat or
one intake level of
red meat
compared to
higher intake of
red meat
See Table 2
Outcomes for
Obesity, CHD,
Stroke, Type 2
Diabetes, Cancer,
Hypertension,
Chronic
obstructive
pulmonary
disease, Eye
health, Bone
health, Dental
health, Mental
health, Other
‗In these population groups, does a particular intake of
vegetables affect the risk of [each condition listed in Table 2]?‘
What is the association between intake of vegetables and risk
of [each condition listed in Table 2]?
Meat
‗In these population groups, does a particular intake of meat
affect the risk of [each condition listed in Table 2]?‘
Can absorb S.1.6 into this question but need to answer dose in
wording, i.e. specific quantity of meat and related beneficial or
detrimental effect.
Section 8 Appendices
NB look at
vegetables as a
food and juice in
total and as a food
only.
As for S1.1 Fruit
See Table 1 Meat
25
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Dietitians Association of Australia
Table A2.1 Table of search questions and keywords for population, intervention, comparator, and outcome (continued)
S.1.1
(cont.)
Question
Population
Intervention
Comparator
Outcome
Dairy (cheese, milks and yoghurt)
As for S1.1 Fruit
See Table 1 Dairy
Levels of
consumption
See Table 2
Outcomes for
Obesity, CHD,
Stroke, Type 2
Diabetes, Cancer,
Hypertension,
Chronic
obstructive
pulmonary
disease, Eye
health, Bone
health, Dental
health, Mental
health, Other
As for S1.1 Fruit
See Table 1
Cereals/grains
Levels of
consumption
See Table 2
Outcomes for
Obesity, CHD,
Stroke, Type 2
Diabetes, Cancer,
Hypertension,
Chronic
obstructive
pulmonary
disease, Eye
health, Bone
health, Dental
health, Mental
health, Other
‗In these population groups, does a particular intake of dairy
affect the risk of [each condition listed in Table 2]?‘
Cereals/grains
‗In these population groups, does a particular intake of
cereals/grains affect the risk of [each condition listed in Table
2]?‘
26
and
Compare cereals
high or low in
added sugar
Section 8 Appendices
Dietitians Association of Australia
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Table A2.1 Table of search questions and keywords for population, intervention, comparator, and outcome (continued)
S.1.1
(cont.)
Question
Population
Intervention
Comparator
Outcome
Legumes
As for S1.1 Fruit
See Table 1
Legumes
Levels of
consumption
See Table 2
Outcomes for
Obesity, CHD,
Stroke, Type 2
Diabetes, Cancer,
Hypertension,
Chronic
obstructive
pulmonary
disease, Eye
health, Bone
health, Dental
health, Mental
health, Other
As for S1.1 Fruit
See Table 1 Nuts
and seeds
Levels of
consumption
See Table 2
Outcomes for
Obesity, CHD,
Stroke, Type 2
Diabetes, Cancer,
Hypertension,
Chronic
obstructive
pulmonary
disease, Eye
health, Bone
health, Dental
health, Mental
health, Other
‗In these population groups, does a particular intake of
legumes affect the risk [each condition listed in Table 2]?‘
Nuts and seeds
‗In these population groups, does a particular intake of nuts
and seeds affect the risk of [each condition listed in Table 2]?‘
Section 8 Appendices
27
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Dietitians Association of Australia
Table A2.1 Table of search questions and keywords for population, intervention, comparator, and outcome (continued)
S.1.1
(cont.)
Question
Population
Intervention
Comparator
Outcome
Fish
As for S1.1 Fruit
See Table 1 Fish
Levels of
consumption
See Table 2
Outcomes for
Obesity, CHD,
Stroke, Type 2
Diabetes, Cancer,
Hypertension,
Chronic
obstructive
pulmonary
disease, Eye
health, Bone
health, Dental
health, Mental
health, Other
As for S1.1 Fruit
See Table 1
Poultry
Levels of
consumption
See Table 2
Outcomes for
Obesity, CHD,
Stroke, Type 2
Diabetes, Cancer,
Hypertension,
Chronic
obstructive
pulmonary
disease, Eye
health, Bone
health, Dental
health, Mental
health, Other
‗In these population groups, does a particular intake of fish
affect the risk of [each condition listed in Table 2]?‘
Poultry
‗In these population groups, does a particular intake of poultry
affect the risk of [each condition listed in Table 2]?‘
28
Section 8 Appendices
Dietitians Association of Australia
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Table A2.1 Table of search questions and keywords for population, intervention, comparator, and outcome (continued)
S.1.1
(cont.)
Question
Population
Intervention
Comparator
Outcome
Eggs
As for S.1.1 Fruit
See Table 1 Eggs
Levels of
consumption
See Table 2
Outcomes for
Obesity, CHD,
Stroke, Type 2
Diabetes, Cancer,
Hypertension,
Chronic
obstructive
pulmonary
disease, Eye
health, Bone
health, Dental
health, Mental
health, Other
As for S1.1 Fruit
See Table 1
Fat/oil
Levels of
consumption
See Table 2
Outcomes for
Obesity, CHD,
Stroke, Type 2
Diabetes, Cancer,
Hypertension,
Chronic
obstructive
pulmonary
disease, Eye
health, Bone
health, Dental
health, Mental
health, Other
‗In these population groups, does a particular intake of eggs
affect the risk of [each condition listed in Table 2]?‘
Fat/oil
‗In these population groups, does a particular intake of fat/oil
affect the risk of [each condition listed in Table 2]?‘
Try clustering for
some outcomes
Section 8 Appendices
29
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Dietitians Association of Australia
Table A2.1 Table of search questions and keywords for population, intervention, comparator, and outcome (continued)
S.1.1
(cont.)
Question
Population
Intervention
Comparator
Outcome
Salt/sodium
As for S.1.1 Fruit
See Table 1
Salt/sodium
Levels of
consumption
See Table 2
Outcomes for
Obesity, CHD,
Stroke, Type 2
Diabetes, Cancer,
Hypertension,
Chronic
obstructive
pulmonary
disease, Eye
health, Bone
health, Dental
health, Mental
health, Other
As for S.1.1 Fruit
See Table 1
Sugars
Levels of
consumption
See Table 2
Outcomes for
Obesity, CHD,
Stroke, Type 2
Diabetes, Cancer,
Hypertension,
Chronic
obstructive
pulmonary
disease, Eye
health, Bone
health, Dental
health, Mental
health, Other
‗In these population groups, does a particular intake of
salt/sodium affect the risk of [each condition listed in Table 2]?‘
Move this question to the umbrella review only but identify
amount of salt because salt assessed in Kids Eat Kids Play.
Sugars
‗In these population groups, does a particular intake of sugars
affect the risk of [each condition listed in Table 2]?‘
Consider whether S1.7 can be absorbed into S1.1
30
Section 8 Appendices
Dietitians Association of Australia
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Table A2.1 Table of search questions and keywords for population, intervention, comparator, and outcome (continued)
S.1.1
(cont.)
Question
Population
Intervention
Comparator
Outcome
Beverages (including water)
As for S1.1 Fruit
See Table 1
Beverages
Levels of
consumption
See Table 2
Outcomes for
Obesity, CHD,
Stroke, Type 2
Diabetes, Cancer,
Hypertension,
Chronic
obstructive
pulmonary
disease, Eye
health, Bone
health, Dental
health, Mental
health, Other
As for S1.1 Fruit
See Table 1
Alcohol
Levels of
consumption
See Table 2
Outcomes for
Obesity, CHD,
Stroke, Type 2
Diabetes, Cancer,
Hypertension,
Chronic
obstructive
pulmonary
disease, Eye
health, Bone
health, Dental
health, Mental
health, Other
‗In these population groups, does a particular intake of
beverages affect the risk of [each condition listed in Table 2]?‘
Alcohol
‗In these population groups, does a particular intake of alcohol
affect the risk of [each condition listed in Table 2]?‘
Section 8 Appendices
31
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Dietitians Association of Australia
Table A2.1 Table of search questions and keywords for population, intervention, comparator, and outcome (continued)
S.1.1
(cont.)
Question
Population
Social distribution of dietary intake
See Table 2 Social equity
Intervention
Looking for amounts of foods to inform Core Food Group
modelling.
Comparator
Outcome
High and low
intakes for major
food groups
See Table 2
Outcomes for
Obesity, CHD,
Stroke, Type 2
Diabetes, Cancer,
Hypertension,
Chronic
obstructive
pulmonary
disease, Eye
health, Bone
health, Dental
health, Mental
health, Other
Includes:
· Other
· Dietary patterns
· Food groups
· Whole foods
· Food
components
· Beverages.
See Table 2
Environmental
impacts
Limit studies to Australia. Narrative reviews likely to be most
relevant.
Include data gaps in report to NHMRC.
S.1.2
What are the greenhouse gas emissions, water use and
biodiversity implications of different dietary patterns, food
groups, whole groups, food components and beverages?
What is the relative greenhouse gas production and water use
of different dietary patterns, food groups, whole foods, food
components and beverages?
Search strategy to include studies from 1980 onwards. Include
Australian and international studies.
32
Includes:
· General population.
Excludes:
· People with serious medical
conditions.
Includes:
· Dietary patterns
· Food groups
· Whole foods
· Food
components
· Beverages.
Section 8 Appendices
Dietitians Association of Australia
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Table A2.1 Table of search questions and keywords for population, intervention, comparator, and outcome (continued)
S.1.3
Question
Population
Intervention
What factors lead to children adopting appropriate life course
food consumption and dietary patterns?
Includes:
· General population
· Children aged 4–18 years
· Overweight children
Includes:
· Parenting,
Environment
· Education
experience
· Geographical
mapping
· School based
interventions
· Food
interventions
· Behavioural
interventions
· Body image
· Eating with
family
· Psychosocial
functioning
· Self-esteem
· Perceived
dietary
competence
· Health beliefs
· Parental control
of eating
· Economic
factors
· Socioeconomic
status
· Food insecurity
· Marketing
methods
· Advertising
Exclude studies with less than 12 month follow-up.
Excludes:
· People with serious medical
conditions.
Section 8 Appendices
Comparator
Outcome
Includes:
· Health
· Diet quality
· Diet variety
· BMI
· Fruit and
vegetables
(Table 2)
· Sugar
sweetened
beverages
(Table 2)
· High fat foods
· Life course food
consumption
and dietary
patterns, for
example food
consumption
and dietary
patterns in
childhood and
adulthood.
33
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Dietitians Association of Australia
Table A2.1 Table of search questions and keywords for population, intervention, comparator, and outcome (continued)
S.1.4
Question
Population
Intervention
What are the economic, physical and psycho-social barriers
and the enablers to different population groups achieving diets
consistent with the dietary guidelines?
Includes:
Includes:
· Income –
personal and
household
· Social
disadvantage
· Poverty
· Food prices
· Food costs
· Access
· Rural
· Urban
· Geographic
· Transport
· Urban planning
· Psychosocial
Education
· Language
· Migrant status
Mental health
state
· Addictions
· Family situation
(living alone/
married/single)
Limit studies primarily to those from Australia from 2003.
If not many RCT, go down cascade of evidence.
General population, in the
following subgroups:
· Infants;
· Children;
· Adolescents;
· Adults;
· Older adults;
· Pregnant and lactating women;
· Low socioeconomic status
groups;
· Aboriginals and Torres Strait
Islanders;
· Culturally and linguistically
diverse groups; and
· People living in rural and remote
areas.
Excludes:
· Those with serious medical
conditions
34
Comparator
Outcome
Includes:
· Eating patterns
· Consistency of
diet with the
Dietary
Guidelines for
Australian
Adults (2003)
and the Dietary
Guidelines for
Children and
Adolescents
incorporating
the Infant
Feeding
Guidelines for
Health Workers
(2003)
Section 8 Appendices
Dietitians Association of Australia
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Table A2.1 Table of search questions and keywords for population, intervention, comparator, and outcome (continued)
S.1.5
Question
Population
Intervention
Comparator
Outcome
What is the most appropriate age to introduce solid foods to
infants?
Includes:
· Breast fed 4/12 to 6/12
· Breast fed around 6/12 to 8/12
· Infant formula fed 4/12 to 6/12
· Infant formula fed around 6/12 to
8/12
· Children
Introduction of
solid foods
(subgroups of
different foods,
method of
introduction,
method of
preparation)
a) Introduction of
solid foods at
different ages;
Risk of:
·
·
Does the introduction of solid foods at different ages change
the risk to the infant of developing allergic syndromes, for
example eczema, wheezing, gastro intestinal tract
symptoms?
- Which solids?
- How many different foods?
- Effect of method of introduction – one at a time, length of
time for one food, length of time before another food is
introduced, mixed food products?
- Effect of method of preparation of solids – cooked, mixed
with breastmilk, infant formula or cow‘s milk?
Does the earlier introduction of solids result in:
- Decreased breastmilk production for the lactating mother?
- Increased risk of overweight and/or obesity over the short
term and long term for the infant?
- Increased morbidity and mortality over the short term and
long term for the infant?
Section 8 Appendices
·
b) Comparison of
different types
of foods;
c) Comparison of
different
methods of
introduction;
and
d) Comparison of
different
methods of
preparation of
solids.
·
·
·
The infant
developing
allergic
syndromes, for
example
eczema,
wheezing,
gastro intestinal
tract symptoms;
Reduction of
breastmilk
production;
Overweight
and/or obesity
over the short
term and long
term for the
infant; and
Morbidity and
mortality over
the short term
and long term
for the infant.
35
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Dietitians Association of Australia
Table A2.1 Table of search questions and keywords for population, intervention, comparator, and outcome (continued)
S.1.6
Question
Population
Intervention
Comparator
Outcome
Is there a dose response relationship between consuming red
meat (not including processed meat as red meat) and an
increased risk of cancer?
Includes:
Table 1 Meat
No red meat or
small amount or
more serves red
meat compared to
another dose of
red meat.
See Table 2
Cancer
Can be absorbed into S.1.1 but need to identify the doseresponse.
General population in the following
subgroups:
· Infants;
· Children;
· Adolescents;
· Adults;
· Older adults; and
· Pregnant and lactating women.
Compare different
cooking methods
Excludes:
Those with serious medical
conditions
S.1.7
Is there a dose response relationship of sucrose or other
refined sugars in foods or beverages on body weight indices
over the long term (1 year +)?
This may also be able to be absorbed into S.1.1
Includes:
General population in the following
subgroups:
· Infants;
· Children;
· Adolescents;
· Adults;
· Older adults; and
· Pregnant and lactating women.
Includes:
· Sucrose or other
refined sugars in
foods and
beverages
(Table 1)
· Sugar as a
marker of food
type
Different doses of
sucrose or other
refined sugars.
See Table 2
Obesity
Excludes:
· Those with serious medical
conditions
36
Section 8 Appendices
Dietitians Association of Australia
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Table A2.1 Table of search questions and keywords for population, intervention, comparator, and outcome (continued)
S.1.8
Question
Population
Intervention
Comparator
Outcome
What is the effect of sugar sweetened beverages (including
those sweetened with high fructose corn syrup) on total energy
intake, body weight indices and dental health in the diet? Is
there a difference between fruit juice, flavoured milk and other
beverages?
Includes:
Includes:
General population in the following
subgroups:
· Infants;
· Children;
· Adolescents;
· Adults;
· Older adults; and
· Pregnant and lactating women.
Sugar sweetened
beverages (see
Table 1), including
beverages
sweetened with
intrinsic and added
sugars, for
example:
For body weight
question:
Includes:
· Total energy
intake
· See Table 2
Obesity
· See Table 2
Dental health
Excludes:
· Those with serious medical
conditions
·
·
·
·
Soft drink;
Fruit juice;
Flavoured milk;
and
Other sugar
containing
beverages
(including high
fructose corn
syrup
sweetened
beverages).
Excludes:
· Sugar
sweetened
foods
Section 8 Appendices
Sugar sweetened
beverages
compared to
beverages without
sugar, e.g. water
and diet drinks, or
compared to other
types of sugarsweetened
beverage
(including high
fructose corn
syrup sweetened
beverages). (See
Table 1)
For dental health
question:
Sugar sweetened
beverages
compared to
beverages without
sugar with at least
equal acidity or
compared to other
types of sugarsweetened
beverage
(including high
fructose corn
syrup sweetened
beverages).
37
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Dietitians Association of Australia
Table A2.1 Table of search questions and keywords for population, intervention, comparator, and outcome (continued)
S.1.9
Question
Population
Intervention
Comparator
Outcome
What are the health benefits of grain-based foods (including
bread, breakfast cereals, oats, pasta and rice) in both refined
and wholegrain forms?
Includes:
Includes:
· Table 1
Cereals/grains
· Excludes:
treatment eg
oats for
cholesterol
Wholegrain forms
compared with
refined forms.
Includes:
Risk of chronic
diseases listed in
Table 2
Is there an association between intake of grain based foods in
both refined and wholegrain forms and reduced risk of
disease?
Does the health benefit/risk of disease differ between refined
grain and wholegrain forms?
General population in the following
subgroups:
· Infants;
· Children;
· Adolescents;
· Adults;
· Older adults; and
· Pregnant and lactating women.
Excludes:
·
S.1.10
Is there an association between specific or subgroups of fruits
and vegetables, for example brassica vegetables, tomatoes,
cruciferous vegetables and citrus etc, and:
·
·
·
·
·
·
·
·
·
·
·
38
Obesity;
Cardio Vascular Disease (including hyperlipidemias);
Stroke;
Diabetes;
Cancer;
Hypertension;
Chronic Obstructive Pulmonary Disease;
Eye health;
Bone health;
Dental health; and
Mental health.
Table 2 Health
and wellbeing
Table 2 Obesity
Those with serious medical
conditions
Includes:
General population in the following
subgroups:
· Infants;
· Children;
· Adolescents;
· Adults;
· Older adults; and
· Pregnant and lactating women.
Excludes:
· Those with serious medical
conditions
See Table 1
Subgroups of fruits
and vegetables
Low versus high
consumption of
specific or
subgroups of fruits
and vegetables.
See Table 2
Outcomes for
Obesity, CHD,
Stroke, Type 2
Diabetes, Cancer,
Hypertension,
Chronic
obstructive
pulmonary
disease, Eye
health, Bone
health, Dental
health, Mental
health, Other
Section 8 Appendices
Dietitians Association of Australia
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Table A2.2 Umbrella review – a systematic review of systematic reviews (including assessing the quality of the reviews to determine whether the conclusions are subject to
bias)
Question
U.1.1
Population
What dietary patterns, food groups including:
·
·
·
·
·
·
·
·
Fruit;
Vegetables;
Meat;
Dairy (cheese, milks and
yoghurt);
Cereals/grains;
Legumes;
Nuts and seeds;
Fish;
·
·
·
·
·
·
·
Poultry;
Eggs;
Fat/oil;
Salt/sodium;
Sugars;
Beverages (including
water); and
Alcohol
·
Health and wellbeing (Life Expectancy/ DALY/QALYs);
and
Reduced risk of chronic diseases including:
- Obesity;
- Cardio Vascular Disease
(including
hyperlipidemias);
- Stroke;
- Diabetes;
- Cancer;
- Hypertension;
Vulnerable populations
including:
·
·
·
·
And whole foods and food components (not nutrients) are
associated with:
·
Includes:
General population
- Chronic Obstructive
Pulmonary Disease;
- Eye health;
- Bone health;
- Dental health; and
- Mental health;
·
Low socioeconomic
status groups;
Aboriginals and Torres
Strait Islanders;
Culturally and
linguistically diverse
groups; and
People living in rural and
remote areas.
Intervention
See Table 1 Dietary
patterns, food groups
Comparator
Consumption high in one
type of dietary pattern,
food group, whole foods
Consider processed and and food component
other meat, and processed compared to a different
meat separately
consumption of a dietary
pattern, food group, whole
foods and food
component.
Outcome
See Table 2 Outcomes for
Obesity, CHD, Stroke,
Type 2 Diabetes, Cancer,
Hypertension, Chronic
obstructive pulmonary
disease, Eye health, Bone
health, Dental health,
Mental health, Other
Excludes:
Those with serious
medical conditions
in the general population and vulnerable groups including
low socioeconomic status, Aboriginals and Torres Strait
Islanders and culturally and linguistically diverse groups,
and those living in rural and remote areas, without serious
disease?
Emphasis on whole dietary patterns, not single foods as
S.1.1.
Section 8 Appendices
39
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Dietitians Association of Australia
Table A2.2 Umbrella review – a systematic review of systematic reviews (including assessing the quality of the reviews to determine whether the conclusions are subject to
bias) (continued)
U.1.2
Question
Population
Intervention
What is the inter-relationship between dietary patterns,
food groups, whole foods, food components and
beverages and environmental sustainability?
Includes:
· General population.
e) Dietary patterns, food
groups, whole foods,
food components and
beverages; and
a) Dietary patterns, food
groups, whole foods,
food components and
beverages; and
f) Environmental
sustainability, for
example ecological
footprint, water
quality, natural
resources, air quality,
soil quality and
underlying fish stocks
b) Environmental
sustainability –
agriculture and
fisheries
What is the impact of climate change and other aspects
of environmental degradation on the capacity to sustain
production in Australia of food groups, whole foods, food
components and beverages?
Focus on Australian food and agricultural industry, not
international.
Category 2 S2.1 is not covered in contract. However,
when analysing material for U1.2 the reviewer will look
at the material from the environment on food perspective
and provide a narrative summary of anything which is
found.
40
Comparator
Outcome
Section 8 Appendices
Dietitians Association of Australia
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Table A2.2 Umbrella review – a systematic review of systematic reviews (including assessing the quality of the reviews to determine whether the conclusions are subject to
bias) (continued)
U.1.3
Question
Population
What are the most recent data on dietary patterns and
intakes of foods and food components (including
nutrients) in Australia? How does the data vary across
age/sex groups in the general population and vulnerable
groups including low socioeconomic status, Aboriginals
and Torres Strait Islanders and culturally and
linguistically diverse groups, and those living in rural and
remote areas?
Includes:
General population in
the following subgroups:
· Infants;
· Children;
· Adolescents;
· Adults;
· Older adults;
· Pregnant and lactating
women;
· Low socioeconomic
status groups;
· Aboriginals and Torres
Strait Islanders;
· Culturally and
linguistically diverse
groups; and
· People living in rural
and remote areas.
From these, what are the normal ranges of intakes of
different key food groups in different Australian
populations?
How much physical activity is needed at each age to
balance energy intake for reducing metabolism.
Include studies from 1995 onwards
Intervention
Comparator
Outcome
Includes:
· Dietary patterns
· Food intakes
· Food components
Nutrients
Excludes:
· Those with serious
medical conditions.
Section 8 Appendices
41
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Dietitians Association of Australia
Table A2.2 Umbrella review – a systematic review of systematic reviews (including assessing the quality of the reviews to determine whether the conclusions are subject to
bias) (continued)
U.1.4
Question
Population
Intervention
Comparator
Outcome
What is the relationship between dietary intake and
physical activity in promoting health and wellbeing?
Includes:
General population in
the following subgroups:
Balance of food intake
and physical activity
used to maintain healthy
body weight, maintain
muscle strength and
support normal growth
and development.
Unbalanced levels of
food intake and physical
activity.
Includes:
· Measures of health
· DALY, QALY, body
weight, muscle
strength, growth and
development in
children, life
expectancy, morbidity,
and mortality.
· Are there outcomes
more relevant to the
question than those
given – these don‘t
seem related to the
question
Not breastfeeding.
See Table 2
Infants;
Children;
· Adolescents;
· Adults;
· Older adults; and
· Pregnant and lactating
women.
Excludes:
·
·
·
U.1.5
What are the benefits of breastfeeding (partial and
exclusive) and the risks of not breastfeeding (any and
exclusive), to infants and mothers, both in the short term
and long term?
Include studies from 1988 onwards.
42
Two types of physical
activity – to maintain
muscle strength and
prevent obesity
Those with serious
medical conditions
Includes:
· General population
· Aboriginals & Torres
Strait Islander
· CALD
· Lactating women
· Mothers
· Infants
· Postpartum
· Perinatal
Breastfeeding – look at
literature and advise on
short term and long
term.
Risk of exposure to
nicotine and alcohol;
breastfeeding, breast
milk, human milk,
colostrum, lactation,
infant formula, artificial
feeding, breastfeeding
initiation, breastfeeding
duration, exclusive
breastfeeding, partial
breastfeeding, weaning
Section 8 Appendices
Dietitians Association of Australia
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Table A2.2 Umbrella review – a systematic review of systematic reviews (including assessing the quality of the reviews to determine whether the conclusions are subject to
bias) (continued)
U.1.6
Question
Population
Intervention
What nutritional factors are important in optimising
pregnancy outcomes?
Includes:
· General population
· Aboriginals & Torres
Strait Islander
· CALD
· Lactating women
· Mothers
· Infants
· Postpartum
· Perinatal
Includes:
· diet
· dietary intake
· food
· food habits
· eating patterns
· food patterns
· diet quality
· diet variety
· diet score
· alcohol
· caffeine
· nutrients
· vitamins
· minerals
· Supplements
- Folic acid
- Iron
- Calcium
- Iodine
- Vitamin D
- Fluoride
Will need to include a statement re. supplements – look
at what NZ used in their DG
Section 8 Appendices
Comparator
Outcome
See Table 2
43
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Dietitians Association of Australia
Table A2.2 Umbrella review – a systematic review of systematic reviews (including assessing the quality of the reviews to determine whether the conclusions are subject to
bias) (continued)
U.1.7
Question
Population
Intervention
What nutritional factors are important in optimising
breastfeeding outcomes?
Includes:
·
General population
·
Aboriginals &
Torres Strait
Islander
·
CALD
·
Lactating women
·
Mothers
·
Infants
·
Postpartum
·
Perinatal
Includes:
·
Diet
·
Dietary intake
·
Food
·
Food habits
·
Eating patterns
·
Food patterns
·
Diet quality
·
Diet variety
·
Diet score
Will need to include a statement re. supplements – look
at what NZ used in their DG
U.1.8
How does the processing, preparation and cooking of
food, including:
Frozen/ canned/ dried/ juice; and
Cooking methods, for example boiling, stir frying,
roasting, microwaving, steaming etc;
change the bioavailability/nutritional value of the food,
food safety and environmental impact?
·
·
What is the impact of processing on nutritional value,
food safety and bioavailability? (intervention =
processing)
What is the impact of transporting and packaging food
on the environment? (interventions = packaging and
transport)
What is the impact of processing on food safety in rural
and remote areas, and in locations of lower
socioeconomic status. (interventions = processing,
transport and market access (mode of purchase)).
44
Includes:
·
Food processing
·
Food preparation
Cooking
·
Frozen food
·
Canned food
·
Dried food
·
Juice
·
Cooking method
·
Boiling
·
Stir frying
·
Roasting
·
Microwaving
·
Steaming
·
Grilling
·
Industrial food production
·
Food service and Food
manufacturing
·
Domestic cooking
Includes fruit, vegetables,
milk, grains, meat, fish and
poultry.
Comparator
Outcome
See Table 2
Methods of
processing,
preparation and
cooking of methods
compared against
each other.
Includes:
·
Bioavailability
·
Nutritional value
·
Biologically active
substances
·
Food safety
·
Environmental
impact
Section 8 Appendices
Dietitians Association of Australia
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Table A2.3 Narrative review – comprehensive review of the literature
Question
N.1.1
What current and past national food selection guides are
used/have been used in Australia?
N.1.2
What are the major national food selection guides currently
used internationally?
N.1.3
What methods have been used to develop national food
selection guides?
N.1.4
What indices and references are used for the assessment of
body weight, growth rates and obesity in children in Australia?
What are the current opinions on which indices and references
are best?
N.1.5
What are the appropriate food safety processes, for example in
food preparation and storage, to maintain a safe food supply
for individuals and groups of individuals, including children and
adults?
Population
Intervention
Comparator
Outcome
Restrict to studies of healthy
children
Include pregnant women
Section 8 Appendices
45
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Dietitians Association of Australia
Category 2
Table A2.4 Systematic literature review – assessing the primary literature
S.2.6
Question
Population
Intervention
Comparator
Outcome
What is the dose response relationship between different types
of milk intake and weight change in adults?
May be able to be a subset of S.1.1.
Includes:
· General adult population,
Dose of milk
intake (cow‘s milk,
goat‘s milk,
sheep‘s milk, soy
milk, full fat,
reduced fat, low
fat, flavoured milk,
almond milk and
rice milk, sugar
sweetened).
One type of milk
compared to
another type of
milk,
See Table 2
Obesity
Excludes:
· Those with serious medical
conditions
· Excludes pregnant and lactating
women.
and
compare different
levels of milk
consumption.
Includes: liquid
milk
Excludes: cheese,
yoghurt
46
Section 8 Appendices
Dietitians Association of Australia
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Table A2.5 Key words for interventions (food terms) for question S1.1, S1.6, S1.7, S1.10, U1.1
Vegetables
Meat
Poultry
Dairy
Fat/oil
Fish
Includes:
· Raw
· Cooked
· Canned
· Juice
· Dried
· pastes (eg tomato
paste)
· potato
· corn on the cob
Includes:
· all or part of the muscle
of any meat (cattle,
sheep, goat, buffalo,
kangaroo, camel, deer,
goat, pig rabbit).
· Different cooking
methods (grilling, frying,
braising, roasting,
baking, broiling,
stewing)
Includes:
· carcass muscle only of
chicken, duck, turkey
and other avian foods).
Includes:
· Cow, goat, sheep milk
· skim, full fat, low fat
· Milk
· Yogurt
· Cheese
· Custard
Includes:
· coconut cream
· cream
· butter
· lard
· dripping
· copha
· oils
· sesame oil
· margarines
Includes:
· Fish (fresh, frozen,
tinned, dried, smoked)
· Seafood
· fin fish
· shellfish
· crustaceans
· fish fingers
Excludes:
· Powders
· Extracts
· sauces based on
vegetables
· soups
· potato/vegetable crisps,
soy and soy products,
legumes
· seaweed
Excludes:
· Offal
· processed meat
products (such as ham)
meat alternatives (such
as TVP)
· mixed foods including
meat (such as pies)
Excludes:
· Offal
· processed meat
products (such turkey
roll,
· chicken nuggets),
· eggs
· mixed foods including
poultry (such as pies)
· paté
Excludes:
· ice confection
· icecream
· cream
· sour cream
· butter
· eggs
· added CLA
· A1 & A2 milk
Excludes:
· designer fats (e.g.
MCT/CLA/diacyl glycerol
phytosterol margarine)
· fish oil supplements,
phytosterol margarine
Excludes:
· Processed seafood
products (such as crab
sticks)
· mixed foods including
fish (such as pies)
· fish oil supplements
· seaweed
Section 8 Appendices
47
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Dietitians Association of Australia
Table A2.5 Key words for interventions (food terms) for question S1.1, S1.6, S1.7, S1.10, U1.1 (continued)
Fruit
Legumes
Eggs
Salt/sodium
Nuts and seeds
Alcohol
Includes:
· Raw
· Whole
· Canned
· Juice
· Dried
Includes:
· soy
· soy products (milk, tofu,
tempeh, yogurt etc)
Includes:
· fresh, dried, liquid,
frozen,
· cooked, e.g. omelette/
scrambled,
(predominately egg)
Includes:
· Sodium
· sodium chloride
· other salts including
sodium (eg sodium
bicarbonate)
· flavoured salts (such as
celery or chicken salt)
Includes:
· Peanuts
· nut butters
· tahini
Includes:
· Alcohol
· Alcoholic beverages
· Wine
· Beer
· Spirits
· Pre-mixed drinks
· Alcopop
Excludes:
· fruit extracts
· fruit flavoured drinks
· fruit flavoured
confectionery
· coconut
Excludes:
· Peanuts
· green peas
· green beans
Excludes:
· mixed dishes
· quiche
Excludes:
· Potassium salts
Excludes:
· Oils
· Coconut
· legumes
Excludes:
· Mouthwash
· Cooking essence
48
Section 8 Appendices
Dietitians Association of Australia
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Table A2.5 Key words for interventions (food terms) for question S1.1, S1.6, S1.7, S1.10, U1.1 (continued)
Cereals/grains
Sugars
Subgroups of fruits and
vegetables
Dietary patterns, food
groups
Beverages
Sugar sweetened
beverages
Includes:
· Whole or partially
processed grains (eg
rice, wheat, oats, corn,
barley)
· Breads
· breakfast cereals
(distinguish between
high and low added
sugar if possible)
· pasta and noodles
· flour
· polenta
· semolina
· bran
· wheatgerm
· corn cakes
· scones
· couscous
· pikelets
· crumpets
Includes:
· hexose
monosaccharides and
disaccharides, including
dextrose,
· fructose, sucrose and
lactose
· starch hydrolysate
glucose syrups,
maltodextrin and similar
products
· products derived at a
sugar refinery, including
brown sugar and
· molasses
· icing sugar
· invert sugar
· fruit sugar syrup;
· Glucose
· Galactose
· Maltose
· trehalose
· Xylose
· Sucrose
· Malt
· Sugar
· Honey
· Corn syrup
· High fructose corn syrup
(also consider colour, or
root vs leafy veg)
Includes:
· Fruit
· Vegetables
· Meat
· Dairy (cheese, milks and
yoghurt);
· Cereals/grains
· Legumes
· Nuts and seeds
· Fish
· Poultry
· Eggs
· Fat/oil
· Salt/sodium
· Sugars
· Beverages (including
water)
· Alcohol
· Whole foods
· food components
· diet
· dietary pattern
· local foods
· variety
· diet quality score
· dietary index
· food habits
· factor analysis
· cluster analysis
· principal component
Includes:
· water
· mineral water
· tap water
· soda water
· flavoured waters
· vitamin waters
· electrolyte replacement
drinks
· sports drinks
· energy drinks
· soft drinks
· artificially sweetened
drinks
· non-caloric soft drinks
· artificially sweetened
cordials
· non-caloric cordials
· tea
· iced teas
· flavoured teas
· coffee
· iced coffee
· coffee extracts
· chocolate drinks
· fruit juice
· fruit drinks
· fruit aides
· fruit punches
· low-calorie beverages
Includes:
· Flavoured waters
· Vitamin waters
· Electrolyte replacement
drinks
· Sports drinks
· Energy drinks
· Iced teas
· Iced coffee
· Chocolate drinks
· Fruit juice with added
sugar
· Fruit drink
· Fruit aides
· Fruit punches
· Flavoured milk
· Soft drinks
Excludes:
· corn on the cob
· cereal based products
with a significant amount
of added fat or sugar
(such as cakes,
pastries, pies or biscuits,
pancakes)
Section 8 Appendices
Includes:
· Fruit:
- Pome
- Berry
- Citrus
- Stone
- Tropical
- Other
· Vegetables:
- Potatoes
- Brassica/cruciferous
(inc cabbage,
cauliflower)
- Carrot and other root
- Leaf and stalk
- Tomato and products
(eg tomato paste)
- Other
Excludes:
· supplements of nutrients
or extracts
· fruit extracts
· fruit flavoured drinks
· fruit flavoured
confectionery
· coconut
· powders
· extracts
· sauces based on
49
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Dietitians Association of Australia
Table A2.5 Key words for interventions (food terms) for question S1.1, S1.6, S1.7, S1.10, U1.1 (continued)
Cereals/grains
(continued)
Sugars
(continued)
Wholegrain will be defined
as:
·
"the intact grain or the
dehulled, ground, milled,
cracked or flaked grain
where the constituents –
endosperm, germ and
bran – are present in such
proportions that represent
the typical ratio of those
fractions occurring in the
whole cereal, and includes
wholemeal"
Wholegrain Foods will be
defined as those
containing at least 51%
wholegrain (based on the
FDA definition to allow
wholegrain health claims)
50
·
·
·
·
·
·
·
·
·
·
Erythritol
Glycerol
Isomalt
Lactitol
Maltitol
Mannitol
Organic acids
Polydextrose
Sorbitol
D-Tagatose
Xylitol
Subgroups of fruits and
vegetables (continued)
·
·
·
·
·
vegetables
soups
potato/vegetable crisps
soy and soy products
legumes
seaweed
Dietary patterns, food
groups (continued)
·
·
·
analysis
DASH
Mediterranean diet
Beverages
(continued)
·
Sugar sweetened
beverages (continued)
flavoured milk drinks,
cow goat, soy
Excludes:
· alcohol
· alcoholic beverages
· liquid dietary
supplements
· liquid nutritional
supplements
· milk, whole
· milk, fat reduced
Excludes:
· non-nutritive sweeteners
Section 8 Appendices
Dietitians Association of Australia
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Table A2.6 Keywords for outcomes for questions S1.1, S1.2, S1.10, U1.1, U1.5, U1.6, U1.7
CHD
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
heart disease
vascular disease
atheroma
atherosclerosis
arteriosclerosis
HDL
LDL
VLDL
cholesterol
hypercholesterolemia
coronary heart disease
lipoproteins
lipids
triacylglycerol
triglycerides
Cancer
(relate to ICD terminology)
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
Chronic obstructive
pulmonary disease
·
·
·
emphysema
chronic obstructive
airways disease
sleep apnoea
Health and wellbeing
·
·
·
·
·
·
·
Section 8 Appendices
malignancy
neoplasm
carcinoma
breast cancer
prostate cancer
colon cancer
endometrial cancer
adenoma
polyps
colorectal cancer
oral cancer
pharyngeal cancer
lung cancer
oesophageal/esophageal cancer
gastric cancer /cancer of the
stomach
renal/ kidney cancer
ovarian cancer
cervical cancer
bladder cancer
skin cancer
melanoma
Life expectancy
DALY
QALYs
QoL
SF36
SF12
Malnutrition
Obesity
(interpret broadly)
·
·
·
·
·
·
·
·
·
·
·
Overweight
BMI
waist:hip ratio
WHR
waist circumference
weight gain
body weight
skinfold thickness
body size
lean body mass
body fat
energy expenditure
Mental health
·
·
·
·
·
·
·
·
·
·
·
·
·
·
Eye Health
·
·
·
·
·
·
vision
blindness
cataract
glaucoma
macular degeneration
retinopathy
mental health
mental illness
mental hygiene
depression
depressive
symptoms
physiological
stresses
dementia
dementias
cognition
cognitive
impairment
schizophrenia
bipolar disorder
ADHD
MMA
Hypertension
·
·
·
blood pressure
systolic blood
pressure
diastolic blood
pressure
Social equity
·
·
·
·
·
·
·
·
·
·
·
·
·
social disadvantage
socioeconomic status
social gradient
household income
personal income
Indigenous
Aboriginals
Torres Strait Islanders
rural
poverty
low income
culturally and
linguistically diverse
groups
migrants
Bone health
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
Other
·
·
·
·
·
constipation
inflammatory bowel
disease
immune function
hydration status
kidney stones
bone
bones
bone tissue
skeleton
osteoblasts
osteocytes
osteoclasts
bone matrix
bone density
bone mineral density
bone mineral content
bone resorption
bone loss
fracture
trabecular
cortical
osteoporosis
Stroke
·
·
·
·
·
CVA
cerebrovascular stroke
vascular accident
ischemia
TIA
51
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
Dietitians Association of Australia
Table A2.6 Keywords for outcomes for questions S1.1, S1.2, S1.10, U1.1, U1.5, U1.6, U1.7 (continued)
Environmental impacts
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
Waste products
2
C0
Methane
Greenhouse gas
emissions
Water use
Biodiversity
Carbon footprints
Life cycle analysis
Environmental impact
Soil quality
Sustainability
Transport
Storage
Packaging
Food processing
Energy cost
Energy consumption
Nitrous oxide
Dental health
·
·
·
·
·
·
·
·
·
·
·
·
·
·
oral health
mouth disease
halitosis
tooth
dentition
tooth components
teeth
dental erosion
dental decay
caries
caries increments
DMFT
Gingival bleeding
% of surfaces with plaque
Type 2 Diabetes
·
·
·
·
·
·
·
·
·
·
·
·
glucose
insulin
insulin resistance
HbA1
glycemic index
glycaemia
insulinemia
GI
HOMA
QICKI
Metabolic syndrome
fructosamine
Pregnancy
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
52
Pregnancy
outcomes
Fertility rates
Birth weight
Preterm
delivery.
Weight gain in
pregnancy
Foetal alcohol
syndrome
Conception
Miscarriage
Spontaneous
abortion
Birth defect
Congenital
abnormality
Congenital
malformation
Neural tube
defect
Pregnancy
complications
Pregnancy
hypertension
Hypermesis
Foetal growth
Small for
gestation age
Pre-term
delivery
Breastfeeding
(infant harm & benefit)
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
Infant nutrition
Infant bonding
Rates of infections infants
Allergy
Eczema
Risk of chronic disease
in adulthood
Smoking
Nicotine
Alcohol
Bonding
Infection
Immunity
Atopic
Type 2 diabetes
Overweight
Obesity
Breastfeeding
(maternal harm & benefit)
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
Maternal discomfort;
Maternal bonding
Wellbeing
Mental health
DALY
QALY
SF36
SF12
maternal nutrition
Post-partum depression
Maternal weight loss
Pre-menopausal breast
cancer
Ovarian cancer.
Maternal overweight
Maternal obesity
Postpartum
Psycho-social
breastfeeding initiation
breastfeeding duration
breastfeeding success
Breastfeeding problems
Engorgement
Nipple
Type 2 diabetes
Gestational diabetes
Cancer
Section 8 Appendices
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
Appendix 3
Decision tree for study selection
Decision tree for study selection
Systematic review of systematic reviews
If <3 studies go to
systematic review
Systematic reviews
If <10 systematic go to
RCTs studies
Umbrella
Reviews
Randomised Controlled Trials (RCTs)
(Dietary Interventions)
- RCTs
- Pseudo RCTs
- Clustered RCTs
If <10 RCTs go to
observational studies
Systematic
Reviews
A comparative study with concurrent controls:
- Non-randomised, experimental trial
- Cohort study
- Case-control study
- Interrupted time series with a control group
A comparative study with concurrent controls:
- Historical control study
- Two or more single arm study
- Interrupted time series without a parallel control group
If <10 observational studes
go to ecological studies
Case series with either post-test or pre-test/post-test
outcomes
Ecological studies
Narrative
Reviews
Narrative/Qualitative Studies
Footnotes
1. Criteria to screen studies will be determined and applied on the following principles if large numbers of studies are identified
- Minimum number of subjects
- Length of study follow-up
- Characteristics of study i.e. limit on number of studies from the same research group which have similar content.
2. Key literature
- Key literature may include reports by government authorities, highly respected national and international health agencies
(Australia, UK, Europe, New Zealand, Canada, and USA), peer-reviewed systematic literature reviews or as provided by
the NHMRC. The preferred Tenderer will seek advice from the NHMRC and the Working Committee on key literature
to be included.
- Other reports or expert opinion will be for listing only, not review, and may be useful in identifying studies and
interpreting the findings
Section 8 Appendices
53
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
Appendix 4
Example body of evidence chapter: Fruit
Fruit
Search results
The initial search of the data bases included 3691 references for fruit and the specified disease outcomes.
The detailed search is included in Appendix 1. As there were 2,714 duplicates with the vegetable data base
the two were combined in one EndNote library and coded as one. In all 97 references concerning fruit and
vegetables had data extracted and 57 papers were used to form the body of evidence statements for fruit.
Sufficient evidence was found to make statements for fruit and cardiovascular disease, stroke, weight loss
and obesity, type 2 diabetes and a range of cancers including gastric, breast, lung, colorectal, oesophageal
and oral and nasopharyngeal, ovarian, endometrial and bladder cancer.
Fruit and coronary heart disease
Table A4.1 Body of Evidence and Statement for fruit and coronary heart disease
Does a particular intake of fruit affect the risk of coronary heart disease in adults?
Evidence
statement
Consumption of each additional daily serve of fruit is associated with a
reduced risk of coronary heart disease.
Grade
C
Component
Rating
Notes
Evidence Base
good
Level III evidence from two meta analyses each with 9 cohort studies (with most
studies in common and medium risk bias) 2 individual cohorts (with low risk bias)
and 1 case control (medium risk bias)
Consistency
good
Two meta analyses and one cohort protective but 1 case control increased risk
and other cohort describes protection when on a 40–55% energy from
carbohydrate but not higher or lower
Clinical impact
satisfactory
Meta analyses protective for each additional serve fruit (7%)
Generalisability
good
Populations from US Europe Japan
Applicability
good
Australian adults
The studies used to make the body of evidence statements are shown in the Table 1. The two meta
analyses are in agreement but have 6 of 9 studies in common, with most studies being from the USA. The
Japanese cohort study demonstrated a stronger association between fruit and cardiovascular disease. The
analysis of the Nurses Health and Male Health Professionals cohorts stratified by the percentage energy
from carbohydrate indicated that the protective effect is only found when carbohydrate intakes are between
40 and 55% energy. The hospital-based case control study showing that fruit increases the risk of acute
myocardial infarction was of a poorer quality because of the instrument used to measure fruit intake and
the bias in selection of controls.
References
Dauchet, L., Amouyel, P., Hercberg, S. & Dallongeville, J. 2006, "Fruit and vegetable consumption and risk
of coronary heart disease: a meta-analysis of cohort studies", Journal of Nutrition, vol. 136, no. 10, pp.
2588–93.
He, F. J., Nowson, C. A., Lucas, M. & MacGregor, G. A. 2007, "Increased consumption of fruit and
vegetables is related to a reduced risk of coronary heart disease: meta-analysis of cohort studies", Journal
of Human Hypertension, vol. 21, no. 9, pp. 717–28.
Joshipura, K. J., Hung, H.-C., Li, T. Y., Hu, F. B., Rimm, E. B., Stampfer, M. J., Colditz, G. & Willett, W. C.
2009, "Intakes of fruits, vegetables and carbohydrate and the risk of CVD", Public Health Nutrition, vol. 12,
no. 1, pp. 115–21.
Rastogi, T., Reddy, K. S., Vaz, M., Spiegelman, D., Willett, W. C., Stampfer, M. J. & Ascherio, A. 2004,
"Diet and risk of ischemic heart disease in India.[see comment]", American Journal of Clinical Nutrition, vol.
79, no. 4, pp. 582–92.
Takachi, R., Inoue, M., Ishihara, J., Kurahashi, N., Iwasaki, M., Sasazuki, S., Iso, H., Tsubono, Y. &
Tsugane, S. 2008, "Fruit and vegetable intake and risk of total cancer and cardiovascular disease: Japan
54
Section 8 Appendices
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
Public Health Center-Based Prospective Study", American Journal of Epidemiology, vol. 167, no. 1, pp. 59–
70.
Section 8 Appendices
55
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
Appendix 5
56
Sample Data Extraction – RCT
Section 8 Appendices
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
Section 8 Appendices
57
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
Appendix 6
58
Sample Data Extraction – Review
Section 8 Appendices
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
Section 8 Appendices
59
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
60
Section 8 Appendices
Dietitians Association of Australia
Appendix 7
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009
NHMRC Levels of Evidence
From: NHMRC 2000, How to use the evidence: assessment and application of scientific evidence. http://nhmrc.gov.au/publications/categories/information.htm.
Retrieved 24 March 2009
Section 8 Appendices
61
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
*NOTE: See Table 1.2 below
62
Section 8 Appendices
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
xx
Section 8 Appendices
63
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
Appendix 8
NHMRC explanatory notes on effect size
The following tables are from p. 23:
NHMRC 2000, How to use the evidence: assessment and application of scientific evidence.
http://nhmrc.gov.au/publications/categories/information.htm
Retrieved 24 March 2009
64
Section 8 Appendices
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
Appendix 9
NHMRC explanatory notes on relevance of evidence
The following table is from p. 28:
NHMRC 2000, How to use the evidence: assessment and application of scientific evidence.
http://nhmrc.gov.au/publications/categories/information.htm
Retrieved 24 March 2009
Section 8 Appendices
65
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
Appendix 10
Guide to filling out the Quality Criteria Checklist
The following guide is from p. 43–48:
American Dietetic Association. 2008, Evidence Analysis Manual. Steps in the ADA Evidence Analysis
Process. Scientific Affairs and Research. Chicago2.
In using the guide, please note:
·
for the current review, the Relevance questions have been excluded from the Dietary Guidelines
Review Process quality criteria assessment as they appear in the checklist since the process of
excluding studies assumes that all included studies are relevant;
·
answer ―y‖ OR ―n‖ and not ―yes‖ OR ―no‖ in the spreadsheet provided;
·
answer ―n‖, ―0‖ OR ―p‖ and not ―–―, ―0‖ OR ―+‖in the spreadsheet provided.
66
Section 8 Appendices
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
Section 8 Appendices
67
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
68
Section 8 Appendices
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
Section 8 Appendices
69
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
70
Section 8 Appendices
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
Section 8 Appendices
71
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
72
Section 8 Appendices
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
Appendix 11
How to assess the body of evidence and formulate
recommendations
From: Part B of NHMRC 2008, How to use the evidence: assessment and application of scientific
evidence3.
http://www.nhmrc.gov.au/guidelines/consult/consultations/add_levels_grades_dev_guidelines2.htm
. Retrieved 14 September 2009. It is recommended that reviewers utilise the tools within this document to
assist with understanding and undertaking the grading of the body of evidence.
This part of the document describes how to grade the ‗body of evidence‘ for each guideline
recommendation. The body of evidence considers the evidence dimensions of all the studies relevant to
that recommendation. To assist guideline developers, the NHMRC GAR consultants have developed an
approach for assessing the body of evidence and formulating recommendations. This will ensure that while
guidelines may differ in their purpose and formulation, their developmental processes are consistent, and
their recommendations are formulated in a consistent manner.
Consequently, the NHMRC Evidence Statement Form is intended to be used for each clinical question
addressed in a guideline. Before completing the form, each included study should be critically appraised
and the relevant data extracted and summarised as shown in the NHMRC standards and procedures for
externally developed guidelines (NHMRC 2007)4. This information assists in the formulation of the
recommendation, and in determining the overall grade of the ‗body of evidence‘ that supports that
recommendation.
The NHMRC Evidence Statement Form sets out the basis for rating five key components of the ‗body of
evidence‘ for each recommendation. These components are:
1.
2.
3.
4.
5.
The evidence base, in terms of the number of studies, level of evidence and quality of studies (risk of
bias).
The consistency of the study results.
The potential clinical impact of the proposed recommendation.
The generalisability of the body of evidence to the target population for the guideline.
The applicability of the body of evidence to the Australian healthcare context.
The first two components give a picture of the internal validity of the study data in support of efficacy (for an
intervention), accuracy (for a diagnostic test), or strength of association (for a prognosis or aetiological
question). The third component addresses the likely clinical impact of the proposed recommendation. The
last two components consider external factors that may influence the effectiveness of the proposed
recommendation in practice, in terms of the generalisability for the intended population and setting of the
proposed recommendation, and applicability to the Australian (or other local) health care system.
Definitions of the components of the evidence statement3
1.
Evidence base
The evidence base is assessed in terms of the quantity, level and quality (risk of bias) of the included
studies:
Quantity of evidence reflects the number of the studies that have been included as the evidence base for
each guideline (and listed in the evidence summary table or text). The quantity assessment also takes into
account the number of patients in relation to the frequency of the outcomes measured (ie the statistical
power of the studies). Small, underpowered studies that are otherwise sound may be included in the
evidence base if their findings are generally similar — but at least some of the studies cited as evidence
must be large enough to detect the size and direction of any effect. Alternatively, the results of the studies
could be considered in a meta-analysis to increase the power and statistical precision of the effect
estimate.
Level of evidence reflects the best study types for the specific type of question (see Table 1). The most
appropriate study design to answer each type of clinical question (intervention, diagnostic accuracy,
aetiology or prognosis) is level II evidence. Level I studies are systematic reviews of the appropriate level II
studies in each case. Study designs that are progressively less robust for answering each type of question
are shown at levels III and IV.
Quality of evidence reflects how well the studies were designed in order to eliminate bias, including how the
subjects were selected, allocated to groups, managed and followed up (see Part A, Dimensions of
evidence, and Table 2 for further information).
Section 8 Appendices
73
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
2.
Consistency
The consistency component of the ‗body of evidence‘ assesses whether the findings are consistent across
the included studies (including across a range of study populations and study designs). Ideally, for a metaanalysis of randomised studies, there should be a statistical analysis of heterogeneity showing little
statistical difference between the studies. However, given that statistical tests for heterogeneity are
underpowered, presentation of an I2 statistic as well as an appraisal of the reasons for the heterogeneity
between studies, would be useful. Heterogeneity between studies may be due to differences in the study
design, the quality of the studies (risk of bias), the population studied, the definition of the outcome being
assessed, as well as many other factors. Non-randomised studies may have larger estimates of effect as a
result of the greater bias in such studies; however, such studies may also be important for confirming or
questioning results from randomised trials in larger populations that may be more representative of the
target population for the proposed guideline.
3.
Clinical impact
Clinical impact is a measure of the potential benefit from application of the guideline to a population.
Factors that need to be taken into account when estimating clinical impact include:
·
the relevance of the evidence to the clinical question, the statistical precision and size of the effect
(including clinical importance) of the results in the evidence-base, and the relevance of the effect to the
patients, compared with other management options (or none)
·
the duration of therapy required to achieve the effect, and
·
the balance of risks and benefits (taking into account the size of the patient population concerned).
4.
Generalisability
This component covers how well the subjects and settings of the included studies match those of the
recommendation. Population issues that might influence the relative importance of recommendations
include gender, age or ethnicity, baseline risk, or the level of care (e.g. community or hospital). This is
particularly important for evidence from randomised controlled trials (RCTs), as the setting and entry
requirements for such trials are generally narrowly based and therefore may not be representative of all the
patients to whom the recommendation may be applied in practice. Confirmation of RCT evidence by
broader-based population studies may be helpful in this regard (see ‗2. Consistency‘).
In the case of studies of diagnostic accuracy, a number of additional criteria also need to be taken into
account, including the stage of the disease (eg early versus advanced), the duration of illness and the
prevalence of the disease in the study population as compared to the target population for the guideline.
5.
Applicability
This component addresses whether the evidence base is relevant to the Australian health care setting
generally, or to more local settings for specific recommendations (such as rural areas or cities).
Factors that may reduce the direct application of study findings to the Australian or more local settings
include organisational factors (e.g. availability of trained staff, clinic time, specialised equipment, tests or
other resources) and cultural factors (e.g. attitudes to health issues, including those that may affect
compliance with the recommendation).
How to use the NHMRC Evidence Statement Form
Step 1 — Rate each of the five components
Applying evidence in real clinical situations is not usually straightforward. Consequently guideline
developers find that the body of evidence supporting a recommendation rarely consists of entirely one
rating for all the important components (outlined above). For example, a body of evidence may contain a
large number of studies with a low risk of bias and consistent findings, but which are not directly applicable
to the target population or Australian healthcare context and have only a limited clinical impact.
Alternatively, a body of evidence may only consist of one or two randomised trials with small sample sizes
that have a moderate risk of bias but have a very large clinical impact and are directly applicable to the
Australian healthcare context and target population. The NHMRC evidence grading system is designed to
allow for this mixture of components, while still reflecting the overall body of evidence supporting a
guideline recommendation.
74
Section 8 Appendices
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
The components described above should be rated according to the matrix shown in Table 3. Enter the
results into the NHMRC Evidence Statement Form along with any further notes relevant to the discussions
for each component.
The Evidence Statement Form also provides space to enter any other relevant factors that were taken into
account by the guideline developers when judging the body of evidence and developing the wording of the
recommendation.
Step 2 — Prepare an evidence statement matrix
In the ‗Evidence statement matrix ‘ section of the form, summarise the guideline developers‘ synthesis of
the evidence relating to each component at the right hand side of the form, and fill in the evidence matrix at
the left hand side of the form. Each recommendation should be accompanied by this matrix as well as the
overall grade given to the recommendation (see Step 3). Developers should indicate dissenting opinions or
other relevant issues in the space provided under the evidence matrix.
Step 3 — Formulate a recommendation based on the body of evidence
Develop wording for the recommendation. This should address the specific clinical question and ideally be
written as an action statement. The wording of the recommendation should reflect the strength of the body
of evidence. Words such as ‗must‘ or ‗should‘ are used when the evidence underpinning the
recommendation is strong, and words such as ‗might‘ or ‗could‘ are used when the evidence body is
weaker.
Step 4 — Determine the grade for the recommendation
Determine the overall grade of the recommendation based on a summation of the rating for each
individual component of the body of evidence. A recommendation cannot be graded A or B unless the
evidence base and consistency of the evidence are both rated A or B.
NHMRC overall grades of recommendation are intended to indicate the strength of the body of evidence
underpinning the recommendation. This should assist users of the clinical practice guidelines to make
Section 8 Appendices
75
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
appropriate and informed clinical judgments. Grade A or B recommendations are generally based on a
body of evidence that can be trusted to guide clinical practice, whereas Grades C or D recommendations
must be applied carefully to individual clinical and organisational circumstances and should be interpreted
with care (see Table 4).
Implementing guideline recommendations
How the guideline will be implemented should be considered at the time that the guideline
recommendations are being formulated. Guidelines require an implementation plan that ensures
appropriate roll out, supports and evaluation of guideline effectiveness in improving practice, and guideline
uptake. The Evidence Statement Form asks developers to consider four questions related to the
implementation of each recommendation:
·
Will this recommendation result in changes in usual care?
·
Are there any resource implications associated with implementing this recommendation?
·
Will the implementation of this recommendation require changes in the way care is currently
organised?
·
Are the guideline development group aware of any barriers to the implementation of this
recommendation?
Conclusion
This paper outlines an approach piloted and refined over two years by NHMRC GAR consultants. This
approach reflects the concerted input of experience in assisting a range of guideline developers to develop
guidelines for a range of conditions and purposes. This approach provides a way forward for guideline
developers to appraise, classify and grade evidence relevant to the purpose of a guideline. With further
application of these levels and grades of evidence, modifications will inevitably be made to further improve
guideline development processes.
76
Section 8 Appendices
Dietitians Association of Australia A review of the evidence to address targetedquestions to inform the revision of the Australian
dietary guidelines 2009
Appendix 12
NHMRC citations inclusions/exclusions proforma
NHMRC Submitted Citations Inclusions/Exclusions list
Incl
Supports
BOE?
Excl XS
Excl NP
Excl NO
Included
Already
Citation
Excl Not
In
Timefram
NS
Excl
e frame
[insert question number and topic here]
[insert full citation here]
[insert full citation here]
[insert full citation here]
[insert full citation here]
[insert full citation here]
[insert full citation here]
Fill in Y or N in one column for each citation as follows:
·
Included already
BOE
Article was retrieved in the systematic search and was included in the
·
Excl not in timeframe
Article did not fit within the date range supplied by NHMRC
·
Other Exclusion codes
As defined and applied for main body of literature
·
Incl Supports BOE?
Y if the citation supports the BOE,N if it does not
Section 8 Appendices
77
A review of the evidence to address targetedquestions to inform the revision of the Australian dietary guidelines 2009 Dietitians
Association of Australia
Section 9 References
1. NHMRC 2000, How to use the evidence: assessment and application of scientific evidence.
http://nhmrc.gov.au/publications/categories/information.htm. Retrieved 24 March 2009.
2. American Dietetic Association. 2008, Evidence Analysis Manual. Steps in the ADA Evidence Analysis
Process. Scientific Affairs and Research. Chicago.
3. From: Part B of NHMRC 2008, How to use the evidence: assessment and application of scientific
evidence.
http://www.nhmrc.gov.au/guidelines/consult/consultations/add_levels_grades_dev_guidelines2.
htm. Retrieved 14 September 2009.
4. NHMRC 2007, NHMRC standards and procedures for externally developed guidelines.
http://www.nhmrc.gov.au/publications/synopses/nh56syn.htm. Retrieved 14 September 2009.
78
Section 9 References