George Wells - International Society of Evidence

Transcription

George Wells - International Society of Evidence
3rd International Society for Evidence-Based
Health Care Conference
NTUH International Convention Center
Taipei, Taiwan
November 9, 2014
George Wells
Application of Systematic
Review and Meta-Analysis in
Health Technology Assessment
Does HTA ‘need’ SR-MA-NMA?
INAHTA
“Health technology can be defined broadly as: any
intervention that may be used to promote health, to prevent,
diagnose or treat disease or for rehabilitation or long-term
care. This includes the pharmaceuticals, devices, procedures
and organizational systems used in health care.”
“Health technology assessment is a multi-disciplinary field of
policy analysis that studies the medical, social, ethical, and
economic implications of development, diffusion, and use of
health technology.”
EUnetHTA
INAHTA
“Despite its policy goals, HTA must always be firmly rooted
in research and the scientific method.”
Does HTA ‘need’ SR-MA-NMA?
•
Health Technology Assessment Process - 2 of the steps identified by
CADTH in the process are:
•
“A protocol is established for the assessment, describing the strategy
to identify and select clinical and economic information, and how this
information will be quality-rated, abstracted, and synthesized. The
protocol may also describe how a primary economic evaluation or
survey will be conducted.”
•
“Data from research studies and other scientific sources are
systematically gathered, analyzed, and interpreted by the review team.
Well-defined and transparent processes are used to minimize potential
bias.”
Outline
Topic
Content
Illustration 1




Illustration 2

Illustration 3

Illustration 4

Review of the fundamentals
Systematic review (SR)
Meta-analysis (MA)
Network meta-analysis (NMA)
New oral anticoagulants for patients with atrial
fibrillation
Antithrombotic therapies for patients with
atrial fibrillation
Triptans for the treatment of acute migraines
in adults
Risk of serious infection with biologics in
treating patients with rheumatoid arthritis
Types of Reviews
Scoping Review
• a quick literature review to provide an overview of the type, extent
and quantity of evidence available on a given topic
• undertaken when feasibility is an issue - either because the
potentially relevant literature is thought to be vast and diverse or
there is suspicion that not enough literature exists
• entails systematic selection, collection and summaries of existing
knowledge to identify where there is sufficient evidence to conduct a
full synthesis or identify evidence gaps and future research needs
Rapid Review
• a streamlined approach to synthesizing evidence in a timely manner,
typically for the purpose of informing emergent decisions faced by
decision makers in health care settings
• uses methods to accelerate or streamline traditional systematic
review processes
• need to establish transparent methodologies and understand
implications of what is lost when methods associated with full
systematic review are streamlined
Systematic Review
Application of scientific strategies that limit bias to the systematic assembly,
critical appraisal and synthesis of all relevant studies on a specific topic
Steps in a Systematic Review
Clearly formulated
question
Pose question using PICO
Comprehensive data
search
Need well formulated/coordinated effort; various sources; usually begin with
searches of bibliographic databases; publication bias and considering unpublished research
Unbiased selection and
extraction process
Do independently in duplicate for study selection and data extraction; selection
based on PICOS; data extraction includes PICO characteristics, study design/methods,
study results, quality items, all relevant benefits and harms
Critical appraisal of data
Report: Description of Studies - table of characteristics of included studies (reference,
design, PICO elements, quality assessment); Quality Assessment - Report quality
assessment instrument/risk of bias used
Analysis of data
MA and/or NMA
Sensitivity and subgroup
analyses
Subgroup analysis - pre-specify hypothesis-testing subgroup analyses; Sensitivity analysis test robustness of results relative to key features of the studies and key assumptions and
decisions
Interpretation of results
PRISMA; interpret results in context of current health care; state methodological limitations;
interpret results in light of other available evidence; make recommendations clear and
practical; propose research agenda
Types of Analysis
complexity
no
analysis
study
level
analysis
metaanalysis
network
metaanalysis
Meta-Analysis
Outcome: effect estimate (EE)
Binary
Continuous
Odds Ratio (OR)
Risk Ratio (RR)
Risk Difference( RD)
EE, se(EE)
or basic data:
frequency e/n
Mean Difference (MD)
Standardized Mean Difference (SMD)
EE, se(EE)
or basic data:
n, mean, sd
Time to Event
Hazard Ratio
(HR)
EE,
se(EE)
Count
Rate Ratio
Rate Difference
EE, se(EE)
or basic data:
n, count,
duration
Heterogeneity: clinical (PICO), methodological (design/conduct)
Procedures: do not pool, meta-regression, sensitivity, subgroup
Fixed effects model (FE); Random effects model (RE)
Procedures: subgroup
Overall estimates and analyses
Display: Forest Plots, Summary of Findings (SoF) tables
Methods to combine and summarize
the results of several studies
• methods focus on contrasting and
comparing results in anticipation
of identifying consistent patterns
and sources of disagreements
Network Meta-Analysis
Outline
Topic
Content
Illustration 1




Illustration 2

Illustration 3

Illustration 4

Review of the fundamentals
Systematic review (SR)
Meta-analysis (MA)
Network meta-analysis (NMA)
New oral anticoagulants for patients with atrial
fibrillation
Antithrombotic therapies for patients with
atrial fibrillation
Triptans for the treatment of acute migraines
in adults
Risk of serious infection with biologics in
treating patients with rheumatoid arthritis
Illustration 1:
NEW ORAL ANTICOAGULANTS FOR
PATIENTS WITH ATRIAL FIBRILLATION
New oral anticoagulants
• Novel agents have been developed to replace vitamin K
antagonists (VKAs) such as warfarin
– direct thrombin inhibitor, dabigatran
– direct FXa inhibitors, rivaroxaban and apixaban
• Novel agents
– Orally administered
– Do not require monitoring of the anticoagulant effect
– Few drug interactions and no food interactions
– Can be applied at a fixed dose;
– Do not have an antidote in case of bleeding and need
to discontinue the medication in an urgent situation
Questions - clinical evaluation
• What is the clinical effectiveness and safety of new oral
anticoagulants compared to warfarin?
• How do the new oral anticoagulants compare to
warfarin when considering the time spent in the
therapeutic range (TTR)?
• How do the new oral anticoagulants compare to
warfarin by risk level (CHADS2 score ) and age?
Systematic Review - PICO
Inclusion criteria
Population
Patients with non-valvular atrial fibrillation
Intervention
 Apixaban
 Dabigatran
 Rivaroxaban
Comparator
 Warfarin
Outcomes
Stroke or systemic embolism, major bleeding, all-cause mortality,
gastrointestinal bleeding, myocardial infarction, intracranial
hemorrhage, etc.
Study design
Published active and non-active controlled RCTs and Non
Randomized studies of at least 12 weeks in duration
Key Studies
Study
Treatments Compared
N
Design
RE-LY
• Warfarin
• Dabigatran 150mg bid
• Dabigatran 110mg bid
18,113
Randomized, openlabel with blinded
endpoint evaluation,
non-inferiority
ROCKET-AF
• Warfarin
• Rivaroxaban 20mg qd
14,264
Randomized, double
blind, non-inferiority
ARISTOTLE
• Warfarin
• Apixaban 5 mg bid
18,201
Randomized, double
blind, non-inferiority
Evidence Network
Bayesian Mixed Treatment
Comparison (MTC) Network
Meta-Analysis
Network meta-analysis results
*ITT: 0.88
(0.75, 1.04)
Questions – economic evaluation
• What is the cost-effectiveness of the new oral
anticoagulants compared to warfarin?
• What is the cost effectiveness of the new oral
anticoagulants compared to warfarin stratified by TTR,
age and CHADS2 score
Cost Effectiveness Acceptability Curve
100%
Probability Treatment is Optimal
90%
Warfarin
80%
70%
60%
Dabigatran 150mg
50%
Apixaban
40%
30%
20%
10%
Rivaroxaban
Dabigatran 110mg
0%
$0
$20,000
$40,000
$60,000
$80,000
Threshold Value for a QALY
$100,000
Conclusion
• Rivaroxaban and dabigatran 110mg were unlikely to be cost
effective
• In different scenarios, apixaban or dabigatran 150mg were
optimal
• Choice between these two options may come down to the
price of apixaban and further evidence on the impact of major
and minor bleeds with dabigatran
CADTH Recommendations for NOACs in AF
Therapeutic Review
Title
Date
NOACs for the Prevention
of Thromboembolic Events
in Patients with AF
Recommendation
June, 2012 Recommendation 1:
CDEC recommends that new oral anticoagulant agents should be
considered for the prevention of SSE in patients with non-valvular
AF in whom warfarin is indicated, and who meet all of the following
criteria:
1. Are unable to achieve adequate anticoagulation with warfarin,
and
2. Have a CHADS2 score ≥ 2*.
*Of Note: Patients with a CHADS2 score of 1 may be considered for
treatment with warfarin or an appropriate dose of dabigatran, based
on individual clinical factors.
Recommendation 2:
CDEC recommends that the selection of a new oral anticoagulant
agent should be made based on individual clinical factors
.
AF = atrial fibrillation; CADTH = Canadian Agency for Drugs and Technologies in Health; INR = international normalized
ratio; NOAC = new oral anticoagulants; SSE = stroke and systemic embolism; TIA = transient ischemic attack; VEF =
ventricular ejection fraction.
‡Targeted date.
Illustration 2:
ANTITHROMBOTIC THERAPIES FOR
PATIENTS WITH ATRIAL FIBRILLATION
Aims
• To conduct a systematic review and network metaanalysis of the clinical evidence pertaining to
antithrombotic agents for the prevention of morbidity
and mortality in patients with non-valvular AF.
• To assess the impact of age, CHADS2 score and time
spent in the therapeutic range (TTR) on the clinical
safety and efficacy of antithrombotic agents.
• To conduct a cost-effectiveness analysis of
antithrombotic agents based on the results of the
network meta-analysis.
Antithrombotic Drugs Used in AF
Drug Class
Anticoagulants
Generic Drug Name
Mechanism of Action
Dosage and
Administration*
Warfarin
VKA
Dose adjusted to a target
INR of 2.0 to 3.0
Dabigatran
Direct thrombin inhibitor
150 mg BID†
Apixaban
5 mg BID
Direct Factor Xa inhibitor
Rivaroxaban
Antiplatelet
Agents
ASA
Clopidogrel
20 mg OD
Platelet aggregation
inhibitor
80 mg – 325 mg OD
75 mg OD
ASA = acetylsalicylic acid; BID = twice daily; INR = international normalized ratio; OD = once daily; VKA = vitamin K
antagonist.
* All drugs are administered orally.
† Dabigatran 110 mg BID may be considered in elderly patients at risk of bleeding.
Evidence Network
NMA Results - Comparison to standard
dose VKA: OR (95%credible interval)
All cause stroke or
systemic embolism
Major bleeding
NMA Results - Comparison between
antithrombotic therapies: OR (95%credible
interval)
Major Bleeding
Stroke or Systemic Embolism
Summary - Anticoagulants
• Overall, NOACs compare favorably with warfarin:
– NOACs are associated with lower rates of SSE and/or major bleeding
– Different NOACs are not readily distinguishable among one another
• CHADS2 <2
– The benefit/risk of the NOACs is positive compared to warfarin, more
so in terms of reduced bleeding than enhanced prevention of SSE, but
largely similar among the NOACs
– This conclusion should be limited to patients with a CHADS2 score = 1
• CHADS2 ≥2
– As for CHADS2 <2, the benefit/risk of the NOACs is positive compared
to warfarin
Summary - Anticoagulants vs.
Antiplatelets
• Overall, antiplatelets have a less favorable benefit/risk
profile than the NOACs or warfarin
• CHADS2 <2
– Less favorable benefit/risk profile due to failing to reduce the risk of
SSE while being associated with a similar or increased risk of major
bleeding
– This conclusion should be limited to patients with a CHADS2 score = 1
• CHADS2 ≥2
– Consistent CHADS2 <2 subgroup
Cost Effectiveness Acceptability Curve:
CHADS2 score <2
Cost Effectiveness Acceptability Curve:
CHADS2 score ≥2
Conclusions
• Uncertainty over whether apixaban or dabigatran is cost
effective
– Probability of cost effectiveness similar for both
– Each is favoured in different potential sub groups
Major Clinical Recommendations for
Antithrombotic Management in AF
Risk of
stroke
American
Guidelines
ACCP
European Guidelines
ECS
No therapy
Higher risk* = OAC
Lowest risk* = No therapy
OAC
OAC
OAC
Dabigatran, rivaroxaban, apixaban
recommended over warfarin.†
Dabigatran recommended
over warfarin.‡
Dabigatran, rivaroxaban, apixaban
recommended over warfarin.
OAC
OAC
OAC
Dabigatran, rivaroxaban, apixaban
recommended over warfarin.†
Dabigatran recommended
over warfarin.‡
Dabigatran, rivaroxaban, apixaban
recommended over warfarin.
Canadian Guidelines
CCS
Higher risk* = OAC
Low
(CHADS2 = 0)
Intermediate
(CHADS2 = 1)
High
(CHADS2 ≥2)
Dabigatran, rivaroxaban, apixaban
recommended over warfarin.†
Lower risk* = ASA
Lowest risk* = No therapy
ASA = acetylsalicylic acid; OAC = oral anticoagulants; VKA = vitamin K antagonist.
* Based on the consideration of other risk factors (age 65-74 years, female sex and presence of vascular
disease).
† Preference for newer agents less clear in patients under warfarin with stable INR and no bleeding
complications.
‡ At the time the American Guidelines were published (2012), only dabigatran received regulatory approval
for use in AF4 and therefore, the Guidelines do not make recommendations for apixaban and rivaroxaban.
Illustration 3:
TRIPTANS FOR THE TREATMENT OF
ACUTE MIGRAINES IN ADULTS
Question – clinical evaluation
• What is the evidence for the efficacy and safety of triptans
(alone or in combination with other drugs) for acute
treatment of migraines in adults compared to: other
triptans agents, nonsteroidal anti-inflammatory drugs
(NSAIDs), acetylsalicylic acid (ASA), acetaminophen,
ergots, opioids, or antiemetics?
Systematic Review - PICO
Study Population
Adult patients with acute migraine headache
Index Node
Placebo
Comparisons
Triptans: almotriptan, eletriptan, frovatriptan, naratriptan, rizatriptan, sumatriptan,
zolmitriptan.
•
Triptans vs. placebo
•
Triptans vs. triptans (alone or in combination with other acute migraine
therapies) (e.g., NSAIDs, ASA, acetaminophen, ergots, opioids, antiemetics)
•
Triptans vs. other acute pharmacologic migraine treatment options (e.g.,
NSAIDs, ASA, acetaminophen, ergots, opioids, antiemetics)
•
Self-administered
Outcomes
Efficacy: All headache relief outcomes
will be considered.
•
•
•
•
•
•
•
•
Time to freedom from pain
Headache relief within 2/4 hrs
Freedom from pain within 2 /4 hrs
Sustained headache response at 24
hrs
Sustained freedom from pain at 24
hrs
Use of rescue medication
Headache specific quality of life
(QOL)
Functional health status and health
related QOL
Safety: All drug safety and adverse event
outcomes will be considered.
•
•
•
Participants with any adverse event
during the 24 hours post-dose
Participants with particular adverse
events during the 24 hours post-dose
Withdrawals due to adverse events
Identification
Additional records identified
through other sources
(n = 78 )
Eligibility
Screening
Records after duplicates removed
(n = 1,142 )
Records screened
(n = 1,142)
Records excluded
(n = 730)
Full-text articles assessed
for eligibility
(n = 412)
Full-text articles excluded,
w/ reasons
(n = 210)
Studies included in
qualitative synthesis
(n = 202)
Included
Search
Results
Records identified through
database searching
(n = 1,694 )
Studies included in metaanalysis
(n = 202)
(n = 134 w/ single attack
data)
Abstract = 30
Duplicate = 34
Population = 10
Non-English = 9
Study Design = 108
Intervention = 15
Could not locate = 4
Outcomes Evaluated
Meta-Analysis
Network Meta-Analysis
No Analysis
2h headache relief
2h headache relief
Time to freedom from pain
2h freedom from pain
2h freedom from pain
Headache-specific QOL
24h sustained headache relief
24h sustained headache relief
Absenteeism
24h sustained freedom from pain
24h sustained freedom from pain
Medication Overuse Headache
Withdrawals due to AE
Use of rescue medications
Functional status
AEs
Use of rescue medications
SAEs
Common AEs
NMA Results - 2h headache relief
NMA Results - Comparisons between Triptans
– SD Tablets
Almotriptan
Elitriptan
Frovatriptan
Naratriptan
Almotriptan
Elitriptan
Frovatriptan
Naratriptan
Rizatriptan
Sumatriptan
Zolmitriptan
2h
2h
24h
24h
Rescue
Relief F Pain Relief F Pain Meds
Rizatriptan
Sumatriptan Zolmitriptan
MA Results - Withdrawals due to AEs
Some high level thoughts on results of the
NMA analysis
•
SD triptans
– relieved headaches within 2 hours in 43 to 76% of patients
– freedom from pain within 2 hours was less common, with only about 18 to
50% of patients
– provided sustained headache relief at 24 hours in 29 to 50% of patients
– sustained freedom from pain at 24 hours was less common, with only
about 18 to 33% of patients
– significant effect on reducing the use of rescue medications compared to
placebo ranging from 20 to 34%
•
•
•
More favorable results observed for rizatritan and elitriptan
Less favorable results for naratriptanes
SD triptan tablets were associated with equal or more favorable results than
NSAIDs, aspirin, acetaminophen for 2h outcomes; the exception being
naratriptan and frovatriptan
SD triptans were associated with more favorable results than ergots for 2
hour and 24hour outcomes
Limited data for sub-groups and side effects
•
•
ODPRN (Ontario Drug Plan Research
Network)
http://www.odprn.ca/wp-content/uploads/2014/04/triptanconsolidated-final-april-7-21.pdf
Illustration 4:
RISK OF SERIOUS INFECTION WITH
BIOLOGICS IN TREATING PATIENTS
WITH RHEUMATOID ARTHRITIS
Aim – clinical evaluation
• To compare the risk of serious infections with biologics with
non-biologic traditional DMARDs for the treatment of RA
and subpopulations within RA (MTX experienced, MTX
naïve, TNF experienced) using network meta-analysis to
synthesize data from randomized controlled trials
Systematic Review - PICOS
Inclusion criteria
Population
Adults with RA
Intervention
Biologics in any dose included
 tumor necrosis factor blockers (etanercept,
adalimumab, infliximab, golimumab, certolizumab
pegol)
 IL-1 antagonist (anakinra)
 IL-6 antagonist (tocilizumab)
 anti-CD28 (abatacept)
 anti-B cell (rituximab)
Tofacitinib
Comparator
Placebo, traditional DMARDs (including MTX, alone or in
combination), another biologic
Outcomes
Serious infection (mostly included infections associated
with death, hospitalization, or the use of intravenous
antibiotics)
Study design
RCTs
Selection of studies
Records identified through
database searching
(n = 6,474)
Additional records identified
through other sources
(n = 22)
Records after duplicates removed
(n = 5,763)
Records screened
(n = 5,785)
Full-text articles assessed
for eligibility
(n = 324)
Studies eligible for inclusion
(any outcome)
(n = 148)
Eligible studies reporting
data for serious infection
(n = 106)
Records excluded
(n = 5,461)
Full-text articles excluded:
176
Abstracts (n = 27),
Long-term extension (n =
2), Duplicates (n = 18)
Not one of biologics (n =
15),
No reportable Outcome (n
= 32),
Not randomized (n = 71),
Not RA (n = 5),
Pooled/post-hoc analysis
(n = 5),
Escalation dose (n = 1)
Evidence networks for serious infection
Combined Population
(106 RCTs, N=42,330)
Evidence networks for serious infection
MTX experienced
(71 RCTs, N=29,167)
Evidence networks for serious infection
MTX naïve
(24 RCTs, N=8,375)
Evidence networks for serious infection
TNF Experienced
(11 RCTs, N=4,788)
Summary NMA results – comparison of serious
risk infection with traditional DMARD
monotherapy
Summary NMA results – risk of serious
infection (OR, 95% Crl), all populations
OR for serious infections are
calculated based on rowdefining treatment versus
column-defining treatment
Significant results are in bold
Summary of results
SR identified 106 trials that included any of the biologic and serious
infections
Compared to traditional DMARDs,
• standard-dose biologic and high-dose biologic were associated with
an increased risk of serious infections
• low-dose biologics were not
The risk was lower in patients who are MTX naïve compared with
traditional DMARD- or anti-TNF-biologic-experienced
Next steps …
• Analysis of efficacy and other safety outcomes
• Economic evaluation
• Recommendation to be made by
• Drug Safety and Effectiveness Network (DSEN)
Outline
Topic
Content
Illustration 1




Illustration 2

Illustration 3

Illustration 4

Review of the fundamentals
Systematic review (SR)
Meta-analysis (MA)
Network meta-analysis (NMA)
New oral anticoagulants for patients with atrial
fibrillation
Antithrombotic therapies for patients with
atrial fibrillation
Triptans for the treatment of acute migraines
in adults
Risk of serious infection with biologics in
treating patients with rheumatoid arthritis
Canadian Collaboration for Drug Safety, Effectiveness and Network Meta-Analysis
Questions or Thoughts
Outline
Topic
Content
Review of the fundamentals



Systematic review (SR)
Meta-analysis (MA)
Network meta-analysis (NMA)
Illustration 1

Illustration 2

Illustration 3

Illustration 4

Illustration 5

New oral anticoagulants for patients with atrial
fibrillation
Antithrombotic therapies for patients with
atrial fibrillation
Triptans for the treatment of acute migraines
in adults
Risk of serious infection with biologics in
treating patients with rheumatoid arthritis
Testosterone replacement therapies for men
with androgen deficiency
Illustration 5:
TESTOSTERONE REPLACEMENT
THERAPIES FOR MEN WITH ANDROGEN
DEFICIENCY
Question – clinical evaluation
• What is the current evidence for the efficacy and
safety of testosterone replacement therapy in
adult men with androgen deficiency?
Systematic Review - PICO
Population
Adult men with androgen deficiency (serum total testosterone ≤ 12 nmol/L)
Index Node
Placebo
Comparisons
Testosterone replacement therapies currently available in Canada: testosterone undecanoate (Andriol),
testosterone cypionate (Depo-Testosterone), testosterone enanthate (Delatestryl), testosterone (Androderm,
Testim 1%, Androgel 1%, Axiron).

TRT v. placebo

TRT v. TRT (same TRT at different dose or different TRT)
Outcomes:
Efficacy



Serum testosterone level
Quality of life
Resolution of symptoms (erectile dysfunction, libido, depression, fractures, activities of daily living)
Outcomes:
Safety

Cardiovascular death, myocardial infarction, stroke, erythrocytosis, serious adverse, events, newly
diagnosed disease (diabetes, heart disease, or prostate cancer), skin or site reactions
Study Types:
Efficacy
Randomized controlled trials (RCTs)
Study Types:
Safety
RCTs and non-randomized studies with a comparator
Exclusions






Studies not conducted in English
Testosterone products or delivery formulations (e.g., buccal cavity, implantable pellets) not currently
approved by Health Canada.
Studies published only in abstract format
Uncontrolled non-randomized studies
Studies involving less than 10 men
Duration shorter than 3 months
Identification
Additional records identified
through other sources
(n = 0)
Eligibility
Screening
Records after duplicates removed
(n = 6,140)
Included
Search
Results
Records identified through
database searching
(n = 9,149)
Records screened
(n = 6,140)
Full-text articles assessed
for eligibility
(n = 868)
Included
• RCTs: n = 55 reports
(n = 39 unique RCTs)
• NRS: n = 25 reports
(n = 24 unique studies
Records excluded
(n = 5272)
Full-text articles excluded
(n = 788)
Women or children = 17
Not low T = 190
Did not evaluate TRT = 59
Study design = 208
Non-HC TRT = 64
No original data = 51
Less than 10 participants = 30
Less than 3 mo = 70
Non-English = 57
Other = 39
No full text = 3
Treatments Evaluated
TRT product
Brand specified
Andriol
Included doses
Route
20 mg/d, 40 mg/d, 120–160 mg/d
Oral
Depo-Testosterone
No studies
Intramuscular injection
Delatestryl
125 mg/wk, 150 mg/2 wk, 200 mg/2 wk Intramuscular injection
Androderm
Testim 1%
Androgel 1%
Axiron
Brand not specified
5 mg/d
50–150 mg/d
5 mg/d, 25–100 mg/d
No studies
Patch
Topical gel
Topical gel
Topical solution
Testosterone gel
Testosterone enanthate
125 mg/d
100 mg/wk, 200 mg/2wk, 50–400
mg/1–2 wk, 250 mg/3wk, 300 mg/3wk
Topical gel
Intramuscular injection
Testosterone undecanoate 160 mg/d
Oral
Testosterone cypionate
Intramuscular injection
200 mg/2wk
Outcomes Evaluated
Network
Meta-Analysis
Testosterone level,
Quality of life
Erectile dysfunction
Libido
Meta-Analysis
No Analysis
Cardiovascular death
Myocardial infarction
Stroke
Newly diagnosed prostate cancer
Fracture
Activities of daily living
Newly diagnosed diabetes
Newly diagnosed heart disease
Depression
Serious adverse events
Erythrocytosis
Skin reactions
Evidence network: Total testosterone level at
3 months
• 638 people
• 13 comparisons
• 10 two-arm studies
• 1 three-arm study
NMA Results: Total testosterone level
at 3 months (v. placebo)
Mean difference (SD)
Treatment
Androderm, patch, 5 mg/d
Androgel 1%, gel, 50 mg/d
Androgel 1%, gel, 100 mg/d
Testim 1%, gel, 50–150 mg/d + sildenafil
Testim 1%, gel, 50 mg/d
Androgel 1%, gel, 75 mg/d
Andriol, oral, 120 mg/d
Delatestryl, IM, 200 mg/2wk
Testosterone enanthate, IM, 100 mg/wk
Testosterone enanthate, IM, 200 mg/2wk
Testosterone cypionate, IM, 200 mg/2wk
Andriol, oral, 160 mg/d
Testim 1%, gel, 100 mg/d
Andriol, oral, 120–160 mg/d
Testosterone undecanoate, oral, 160 mg/d
Andriol, oral, 40 mg/d
Testosterone enanthate, IM, 300 mg/3wk
Androgel 1%, gel, 5 mg/d
*Statistically significant (p < 0.05).
Serum
testosterone
level, 3 mo
Quality of life
(AMS)
Erectile
dysfunction
(IIEF, ED
domain)
Libido (IIEF,
sexual
function
domain)
Depression
(Beck)
5.35 (2.52)*
10.34 (2.72)*
18.46 (3.41)*
10.21 (2.81)*
2.26 (2.77)
7.56 (3.51)*
–4.34 (2.68)
15.66 (3.88)*
6.30 (3.17)
8.66 (2.91)*
–0.16 (3.26)
---------------
--1.53 (19.54)
--1.05 (18.87)
--2.49 (19.16)
----------–0.77 (13.51)
--–18.78 (18.97)
–0.29 (19.35)
----–3.16 (18.78)
--3.29 (8.31)
--1.40 (11.41)
--------------–0.13 (11.48)
----3.62 (8.18)
-------
–0.94 (4.26)
–1.65 (4.30)
--0.28 (5.24)
–0.14 (5.03)
--0.97 (5.22)
--------–1.11 (5.18)
0.51 (7.31)
-----------
–2.01 (4.75)
0.02 (3.41)
------–0.69 (3.43)
------–2.29 (3.36)
--------–3.10 (3.39)
–4.08 (3.40)
–1.20 (3.38)
---
NMA Results: Total testosterone level at 3 mo
Head-to-head comparisons
1
2
3
4
5
6
7
8
9
10
11
1
2
3
The red cell indicates that
the ‘row’ treatment is
significantly worse than
the ‘column’ treatment.
4
5
6
7
8
The grey cell indicates that
there is no significant
difference between the
‘row’ and ‘column’
treatment.
9
10
11
1.
2.
3.
4.
5.
6.
Androderm patch 5 mg/d
Androgel 1% gel 50 mg/d
Androgel 1% gel 100 mg/d
Testim 1% gel 50-150 mg/d+sildenafil
Testim 1% gel 50 mg/d
Androgel 1% gel 75 mg/d
The green cell indicates
that the ‘row’ treatment is
significantly better than
the ‘column’ treatment.
7.
8.
9.
10.
11.
Andriol oral 120 mg/d
Delatestryl, IM, 200 mg/2wk
Testosterone enanthate IM 100 mg/wk
Testosterone enanthate IM 200 mg/2wk
Testosterone cypionate IM 200 mg/2wk
MA Results: Safety outcomes
Outcome
CV death
MI
Stroke
Prostate cancer
SAE
Comparison
No. of studies
(no. estimable)
OR (95% CI)
I2
TRT v. placebo
5 (2)
8.62 (1.17–63.77)*
0%
T gel v. placebo
3 (2)
8.62 (1.17–63.77)*
0%
TRT v. placebo
3 (2)
1.85 (0.19–17.86)
64%
T gel v. placebo
2 (2)
1.85 (0.19–17.86)
64%
TRT v. placebo
4 (3)
0.50 (0.05–4.85)
25%
T gel v. placebo
2 (2)
1.04 (0.06–16.60)
47%
TRT v. placebo
7 (6)
1.17 (0.42–3.27)
0%
T gel v. placebo
4 (2)
1.80 (0.19–17.48)
0%
IM v. placebo
2 (2)
0.78 (0.20–3.08)
0%
TRT v. placebo
4 (3)
1.61 (0.77–3.36)
30%
T gel v. placebo
4 (3)
1.61 (0.77–3.36)
30%
Narrative Results: Skin reactions
• 10 studies
• Mild skin irritation, rashes, allergic contact dermatitis,
moderate skin erythema, intense edema, blistering
• Most commonly associated with topical preparations
Summary of efficacy results:
Network Meta-Analysis
Compared to placebo:
– Several TRTs were associated with a substantive increase in
serum testosterone level at 3 months.
– No significant effects in quality of life, erectile dysfunction, libido,
or depression were identified.
Head-to-head comparisons:
– Androgel 1% (100 mg/d) was associated with more favourable
serum testosterone levels at 3 months than the other TRTs.
– Andriol (120 mg/d) was associated with less favourable serum
testosterone levels at 3 months than the other TRTs.
– No significant differences among the TRTs were identified for
quality of life, erectile dysfunction, libido, and depression.
Summary of safety results:
Meta-Analysis/Narrative
•
Serious adverse events: T gel (19 SAEs) v. placebo (12 SAEs)
OR 1.61 (95% CI 0.77–3.36).
•
Other safety data were limited:
• CV death – 4 deaths in T gel group and zero in placebo.
• MI - 2 events in T gel group and 1 in placebo.
• Stroke – 1 event in T gel group and 1 in the placebo.
• Prostate cancer - 2 cases in T gel group and 1 in placebo; 4 in
testosterone IM and 5 in placebo.
• Heart disease (1 study) – 2 cases in testosterone and 4 in
placebo.
•
Skin reactions ranged from mild irritation to intense edema and blistering
and were primarily associated with topical preparations
ODPRN (Ontario Drug Plan Research
Network)
Recommendation in process
Outline
Topic
Content
Review of the fundamentals



Systematic review (SR)
Meta-analysis (MA)
Network meta-analysis (NMA)
Illustration 1

Illustration 2

Illustration 3

Illustration 4

Illustration 5

New oral anticoagulants for patients with atrial
fibrillation
Antithrombotic therapies for patients with
atrial fibrillation
Triptans for the treatment of acute migraines
in adults
Risk of serious infection with biologics in
treating patients with rheumatoid arthritis
Testosterone replacement therapies for men
with androgen deficiency
Features of Various Reviews
Narrative
Rapid
Systematic
QUESTION
Broad
Specified a priori (may
include broad PICOS)
Focused (PICOS)
SOURCES
Usually unspecified;
possibly biased
Sources may be limited
but sources/strategies
made explicit
Comprehensive sources
searched and explicit
strategies
SELECTION
Unspecified;
possibly biased
Criterion-based;
uniformly applied
Criterion-based;
uniformly applied
APPRAISAL
Variable
Rigorous
Rigorous; critical appraisal
SYNTHESIS
Usually qualitative
Descriptive summary/
categorization of data
Quantitative summary +/meta-analysis
INFERFENCE
Sometimes evidence
based
Limited/cautious
interpretation of findings
Usually evidence based
Summary