a downloadable pdf of the conference program sans ads

Transcription

a downloadable pdf of the conference program sans ads
Evaluation 2010 President’s Welcome
On behalf of the American Evaluation Association’s Board of Directors, the AEA staff, and many
volunteers, I am delighted to welcome you to the 2010 AEA Annual Conference. The conference
provides wonderful opportunities for sharing our work, learning from others, developing and
strengthening professional relationships, renewing old and starting new friendships, and experiencing
San Antonio, our host city.
This year, the Presidential Strand theme is “Evaluation Quality.” Evaluation quality is an umbrella
theme, with room underneath for all kinds of ideas – quality from the perspective of different
evaluation approaches, the role of certification in quality assurance, metaevaluation and the
standards used to judge quality, and so on. The call for proposals encouraged us to think of quality
broadly. Following that guidance, my Presidential Strand Co-Chairs, Valerie Caracelli and Rodney
Hopson, have organized three wonderful Plenary sessions.
At Wednesday’s opening Plenary, we have three luminaries in the field who will highlight a timely
topic for our nation, the world and especially our field. Eleanor Chelimsky, Laura Leviton and Michael
Quinn Patton offer diverse perspectives in a discussion entitled Tensions Among Evaluative
Perspectives in the Age of Obama: Influences on Evaluation Quality, Thinking and Values. The
Thursday Plenary offers perspectives from outside the evaluation profession: James E. Davis, a long
time member of AEA, will facilitate a discussion with Crispin Sartwell, a philosopher who has written
about justice and beauty, most recently in a book titled Political Aesthetics, and Psyche WilliamsForson, an expert in American material culture, whose book Building Houses out of Chicken Legs
received the American Folklore Society’s book prize. I am excited to share my thoughts on Evaluation
Quality: The Good, the Bad, the Beautiful and the Ugly in my session on Friday. And, the final plenary
will be Saturday afternoon, when the 2005-2009 Presidents will briefly reflect on the conference
theme. We will conclude with a toast to celebrate our days together engaged in conversation about
evaluation quality.
The Presidential Strand sessions have a similar diversity of perspectives from within and across
disciplinary and practical boundaries. For example, sessions on Design Thinking from the world of
business and industry) and quality from the perspective of anthropology will bring ideas from outside
the field, while sessions on quality in the international context and in mixed-method evaluation,
among other topics, will explore evaluation quality in more familiar terms. The Presidential Strand
also includes sessions highlighting the statement on Culturally Competent Evaluation and the new
edition of the Program Evaluation Standards. In addition, Ernest House will hold an informal
conversation about his conceptions of evaluation quality, including the “Truth, Beauty, and Justice”
dimensions that were part of my inspiration for the theme.
Evaluation quality will also be addressed in panels and presentations outside the Presidential Strand
and, I hope, in conversations at the receptions and various other gathering places.
I hope you have a great time, professionally and personally, at Evaluation 2010. And may we all leave
with an enriched way of thinking about evaluation quality and with new skills for making our
evaluations as good as they can be!
Leslie J. Cooksy
American Evaluation Association Annual Conference
BOARD OF DIRECTORS
TABLE OF CONTENTS
PAGE
OFFICERS
 President
Leslie Cooksy
 Past-President/Secretary
Debra Rog
 President-elect
Jennifer Greene
 Treasurer
Brian Yates
President‘s Welcome
Inside Front Cover
Board Member directory
1
Table of Contents
1
Conference Program Schedule Detail
2
Conference Hotel Map
3
Registration Information
4
Career Boards Information
4
Future Conferences
4
Hospitality Suites
4
FAQs About the Conference and AEA
5-6
Topical Interest Group (TIG) directory
7-8
Sponsors and Acknowledgements
9-11
Professional Development Sessions
12-13
Wednesday, November 10 Sessions
15-32
Thursday, November 11 Sessions
33-84
Friday, November 12 Sessions
85-126
Saturday, November 13 Sessions
127-170
BOARD MEMBERS
Katrina Bledsoe
Stewart Donaldson
Mike Hendricks
Elmima Johnson
Rakesh Mohan
Tristi Nichols
Beverly Parsons
Patricia Rogers
Veronica Thomas
ANNUAL MEETING
 Chair
Katherine McKnight
JOURNAL EDITORS
Appendix A: Index of Presenters & Contributors 171-215
Appendix B: Directory of Sessions by Sponsor
216-245
Appendix C: Directory of Exhibitors
246-249
Advertisements
250-258
Looking Toward 2011
Inside Back Cover
American Journal of Evaluation
Thomas Schwandt
New Directions for Evaluation
Sandra Mathison
If you are in need of assistance as you prepare for the conference,
please call the AEA office at 1-508-748-3326,
or email us at [email protected].
Conference Program Schedule Detail
Timeslot
Activity
Page
Monday, November 8, 9:00 am to 4:00 pm
Concurrent Pre-conference Workshops (Ticketed)
12
Tuesday, November 9, 9:00 am to 4:00 pm
Concurrent Pre-conference Workshops (Ticketed)
12
Wednesday, November 10, 8:00 am to 3:00 pm
Concurrent Pre-conference Workshops (Ticketed)
12-13
Wednesday, November 10, 3:15 pm to 4:15 pm
Opening Plenary (All Welcome)
18
Wednesday, November 10, 4:30 pm to 6:00 pm
Concurrent Sessions (All Welcome)
18-23
Wednesday, November 10, 6:10 pm to 6:40 pm
New Member/Attendee Orientation (All Welcome)
23
Wednesday, November 10, 6:30 pm to 8:00 pm
Opening Reception and Exhibition (All Welcome)
24-31
Thursday, November 11, 8:00 am to 8:45 am
Second Plenary (All Welcome)
36
Thursday, November 11, 9:15 am to 10:45 am
Concurrent Sessions (All Welcome)
36-42
Thursday, November 11, 10:55 am to 12:25 pm
Concurrent Sessions (All Welcome)
46-53
Thursday, November 11, 12:35 pm to 1:30 pm
AEA Business Meeting (All Welcome)
53
Thursday, November 11, 1:40 pm to 3:10 pm
Concurrent Sessions (All Welcome)
56-62
Thursday, November 11, 3:35 pm to 4:20 pm
Concurrent Sessions (All Welcome)
66-70
Thursday, November 11, 4:30 pm to 6:00 pm
Concurrent Sessions (All Welcome)
74-80
Thursday, November 11, 6:10 pm to 7:00 pm
Concurrent TIG Meetings (All Welcome)
82-83
Friday, November 12, 7:00 am to 7:50 am
Concurrent TIG Meetings (All Welcome)
87
Friday, November 12, 8:00 am to 8:45 am
Third Plenary (All Welcome)
87
Friday, November 12, 9:15 am to 10:45 am
Concurrent Sessions (All Welcome)
90-95
Friday, November 12, 10:55 am to 11:40 am
Concurrent Sessions (All Welcome)
98-101
Friday, November 12, 11:50 am to 1:30 pm
Awards Luncheon (Ticketed)
104
Friday, November 12, 1:40 pm to 3:10 pm
Concurrent Sessions (All Welcome)
104-110
Friday, November 12, 3:35 pm to 4:20 pm
Concurrent Sessions (All Welcome)
114-117
Friday, November 12, 4:30 pm to 6:00 pm
Concurrent Sessions (All Welcome)
120-126
Friday, November 12, 6:30 pm to 8:00 pm
Reception and Silent Auction (All Welcome)
126
Saturday, November 13, 8:00 am to 9:30 am
Concurrent Sessions (All Welcome)
130-136
Saturday, November 13, 10:00 am to 10:45 am
Concurrent Sessions (All Welcome)
140-145
Saturday, November 13, 10:55 am to 12:25 pm
Concurrent Sessions (All Welcome)
148-153
Saturday, November 13, 12:35 pm to 1:30 pm
TIG Business Meeting / Lunch Break (On own)
153
Saturday, November 13, 1:40 pm to 2:25 pm
Concurrent Sessions (All Welcome)
156-160
Saturday, November 13, 2:50 pm to 4:20 pm
Concurrent Sessions (All Welcome)
164-170
Saturday, November 13, 4:30 pm to 5:30 pm
Fourth Plenary (All Welcome)
170
Sunday, November 14, 9:00 am to 12:00 pm
Concurrent Post-conference Workshops (Ticketed)
13
Evaluation 2010
Page 2
Grand Hyatt San Antonio Hotel Map
Registration Desk and Career Boards
Registration: Conference sessions will be held exclusively at the Grand Hyatt. The Registration Desk for Evaluation 2010 is located
on the fourth level adjacent to the escalators.
Day
Monday, November 8
Tuesday, November 9
Wednesday, November 10
Thursday, November 11
Friday, November 12
Saturday, November 13
Sunday, November 14
Registration Desk Hours
8:00 am – 5:30 pm
8:00 am – 5:30 pm
7:00 am – 6:30 pm
7:00 am – 6:30 pm
7:00 am – 6:30 pm
7:00 am – 5:00 pm
8:00 am – 12:00 pm (Noon)
Career Boards: Our career services will be provided this year via career boards. Look for Job Boards and Resume Boards at one end
of the Exhibits in the fourth floor on the same level as the AEA Registration Area. You may bring your resume or position descriptions
on site and add them to one of the pockets there yourself. The Career Boards will be available Thursday through Saturday. Be sure to
peruse the position and resume listings!
Future Conferences
Plan ahead and save the dates! The sites have already been selected for the following conferences.
Evaluation 2011
Dates: Wednesday, November 2 through Saturday, November 5, 2011
Location: Hilton Anaheim – Anaheim, California
Evaluation 2012
Dates: Wednesday, October 24 through Saturday, October 27, 2012
Location: Hilton Minneapolis and Minneapolis Convention Center – Minneapolis, Minnesota
Diversity and International Hospitality Suites
Are you a member of a diversity-focused TIG or an evaluator working with issues of culture and diversity? We welcome your use of
the Diversity Hospitality Suite. Suite locations will appear in the addendum and posted on site.
Are you one of the over 300 international attendees at Evaluation 2010, a member of the Research, Technology and Development
Evaluation TIG or the International and Cross-cultural TIG, or an evaluator working in international contexts? We welcome your use
of the International Hospitality Suite. Suite locations will appear in the addendum and posted on site.
Day
Hospitality Suite Hours
Wednesday, November 8
Thursday, November 9
Friday, November 10
Saturday, November 11
6:00 pm – 7:00 pm Open House
7:00 am – 6:00 pm
7:00 am – 6:00 pm
7:00 am – 11:00 am
Evaluation 2010
Page 4
Frequently Asked Questions About the AEA Annual Conference
What should I do when I arrive at the conference? Begin by checking in, and picking up your nametag and materials, at the
AEA conference registration desk located on the fourth floor of the Grand Hyatt, 600 East Market Street, San Antonio, Texas.
May I register or make purchases on site? You may register for the conference, or add to your existing conference registration,
on site at the conference registration desk. You may enroll in any open professional development workshops, but many have
filled before the conference. Lunch tickets for the Friday awards luncheon are usually available through noon on Thursday or
until sold out. A limited number of t-shirts are available for on site purchase as well.
What is included in my registration? Standard conference registration includes admission to all of the sessions held after 3:10
pm on Wednesday through 5:30 pm on Saturday with the exception of Friday‘s awards luncheon, which is a separate ticketed
event. Registration includes the receptions Wednesday and Friday evenings. Meals are not included, but beverages are
available in the foyers each morning after the plenary and each afternoon before the penultimate session.
Do I need to sign up for sessions in advance? The professional development workshops that precede and follow the
conference require a separate registration and are filled on a first-come, first-served basis. All other sessions held during the
conference are open to all attendees. You may attend any session by arriving at the appropriate room before the session
begins. We make every effort to ensure that the room size is adequate for the attendance; however, occasionally, a session‘s
seating will fill. If there is a session that you especially wish to see, it is a good idea to arrive at the beginning of the break
rather than at the end.
What is the Presidential Strand? The Presidential Strand is a set of sessions highlighting the year‘s conference theme of
Evaluation Quality. There is one Strand session during each set of concurrent sessions, plus four plenary, or general sessions –
one opening the conference, one each on Thursday and Friday mornings at 8:00 a.m., and one closing the conference on
Saturday afternoon.
What is a TIG and what do they do? AEA has 45 Topical Interest Groups, or TIGs. One of the major activities of each TIG is to
review conference proposals and sponsor conference sessions. Under each session in the program you will see the sponsoring
group, and the program is indexed by TIG in Appendix B. Checking the TIG sponsor will give you an idea as to the topical bent
of the overall session. Each TIG also holds a business meeting during the conference, and attending one is a great way to
connect with others who share your interests and to learn of the TIG‘s plans for the coming year. Many TIG members may be
identified by ribbons attached to their nametags stating TIG affiliations. Pick up free ribbons showing your topical interests
when you check in at the registration desk and look for others throughout the conference who share your interests.
How can I meet people? It can be difficult to connect with others your first time at a conference. One great way to meet
colleagues is to attend the Wednesday Reception and Poster Exhibition and take the opportunity to connect with over 100
poster presenters sharing their work as well as AEA leaders and authors. Purchase a ticket to Friday‘s awards luncheon and sit
with colleagues to enjoy a good meal and great company while honoring the best in the field. Friday is topped off by a
reception and silent auction hosted by the International and Cross-Cultural Evaluation TIG. Meet attendees from around the
world and bid on a range of items from texts to talismans. Finally, attending a TIG business meeting will help you to connect
with people who share your disciplinary interests.
What should I do if I have questions during the conference? Please feel free to come to the registration desk at any time. We‘re
happy to answer your questions, give a little advice, or point you in the right direction. When out and about, look for attendees
with ―Ambassador‖ ribbons. These past and present Association leaders will be happy to help.
Be sure to attend the first-time attendee‘s orientation session held in the Lonestar Ballroom from 6:10 to 6:40 pm on
Wednesday evening to learn more about the Association and the Conference.
Evaluation 2010
Page 5
Frequently Asked Questions About AEA
How long has AEA been around? The American Evaluation Association (AEA) came into being in 1986 out of the merger of two
existing evaluation groups: The Evaluation Network and the Evaluation Research Society.
What is the mission of AEA? AEA‘s mission is to:




Improve evaluation practice and methods
Increase evaluation use
Promote evaluation as a profession, and
Support the contribution of evaluation to the generation of theory and knowledge about effective human action.
Why should I become a member? Membership in AEA signifies to yourself and to others that you consider yourself an evaluation
professional. The Association‘s two journals, subscriptions to both of which come with full membership, provide you with up-to-date
information on current theory and practice. The American Journal of Evaluation includes articles on topics of current interest,
information about upcoming conferences, book reviews, and more. Published quarterly, New Directions for Evaluation focuses on
various aspects of a single salient topic with each issue. AEA members also receive electronic access to two additional journals Evaluation and the Health Professions and Evaluation Review, a listing on AEA‘s ―Find an Evaluator‖ pages, free registration for
monthly coffee break webinars and the thought leaders forum, access to the online member directory, and informational materials.
Finally, AEA members enjoy considerable discounts on conference and professional development workshop registrations.
Where can I turn with professional questions? EVALTALK is the official listserv of AEA. Subscribers to EVALTALK engage in lively,
sometimes heated, usually thought provoking, discussions of topics related to evaluation. EVALTALK can be received in real time via
ongoing emails throughout the day, or as a digest so that you receive one email each day that includes the indexed, full discussion
from the past 24 hours. The AEA office can direct you to information on how to sign on to EVALTALK or check the AEA website at
www.eval.org. Another option for your professional questions is to connect with a Topical Interest Group either through attending
TIG-sponsored sessions at the annual conference or communicating with the TIG leaders.
What is a TIG? AEA‘s 45 Topical Interest Groups (TIGs) span the methodological, disciplinary, and ideological gamut. These
subgroups of the Association allow members to connect with others who share their interests as well as provide a forum for sharing
knowledge and skills during the annual conference. Some TIGs are very active and produce a newsletter, manage their own website,
and solicit and develop special conference sessions. Other TIGs focus primarily on providing reviewers for topical presentations for
the annual conference. AEA members may be members in up to five TIGs and may change their TIG choices at any time by
contacting the AEA office or making the changes on your membership renewal form.
What is a Local Affiliate? AEA‘s Local Affiliates (LAs) are independent associations that provide a regional home to evaluators. You
do not need to be a member of AEA to join an Affiliate and you do not need to participate in an Affiliate to be a member of AEA.
Affiliates provide their own programming and outreach activities, yet share with AEA a focus on serving evaluators and the
evaluation community.
How can I get involved? AEA is a professionally run, volunteer lead association. The most obvious way to get involved is to
participate: submit a proposal to present at the conference, vote in AEA elections, nominate a colleague for an award, or fill out an
online volunteer profile. Share your knowledge by submitting an article to The American Journal of Evaluation – manuscript
guidelines can be found online or through the AEA office. Become a leader by attending a TIG business meeting at the annual
conference and offering your services. TIGs are seeking people to do everything from design websites to write newsletters to review
conference proposals. If you want to influence the actions of the Association, consider running for office on the AEA Board or
connecting with an AEA Board member or TIG leader at the Wednesday evening Info Fair. Only members may serve on the AEA Board
or as Topical Interest Group leaders.
Where should I turn with questions outside of the conference? A good place to start is with Heidi Nye, AEA‘s Member Services
Director in our AEA office. Heidi can answer most administrative or member services questions and will point you in the right
direction for other resources. She may be reached at [email protected] or 1-508-748-3326.
Evaluation 2010
Page 6
Topical Interest Group Directory
AEA‘s 45 Topical Interest Groups are the primary reviewers and sponsors of sessions. All attendees are welcome at their business meetings!
Topical Interest Group
Chair(s)
Program Chair(s)
Business Meeting Time
Location
Advocacy and Policy Change
Ehren Reed
Jackie Williams Kaye
Annette Gardner
James Riedel
Thu, 6:10 PM to 7:00 PM
Goliad
Alcohol, Drug Abuse, and Mental
Health
Marge Cawley
Diana Seybolt
Marge Cawley
Diana Seybolt
Fri, 10:55 AM to 11:40 AM
Presidio C
Assessment in Higher Ed
Rhoda Risner
Audrey Rorrer
George Reinhart
Thu, 6:10 PM to 7:00 PM
Travis A
Business and Industry
Eric Abdullateef
Thomas Ward
Tala Davidson
Jennifer Martineau
Thu, 6:10 PM to 7:00 PM
Crockett C
Cluster, Multi-site and Multi-level
Rene Lavinghouze
Martha Ann Carey
Thu, 4:30 PM to 6:00 PM
Lone Star F
Collaborative, Participatory &
Empowerment Evaluation
David Fetterman
Liliana Rodriguez-Campos
Liliana Rodriguez-Campos
Thu, 6:10 PM to 7:00 PM
Lone Star C
College Access Programs
Rita O'Sullivan
Kurt Burkum
Thu, 6:10 PM to 7:00 PM
Bonham B
Costs, Effectiveness, Benefits, Econ
Ronald Scott Visscher
Nadini Persaud
Thu, 6:10 PM to 7:00 PM
Texas C
Crime and Justice
Roger K Przybylski
Roger K Przybylski
Thu, 3:35 PM to 4:20 PM
Crockett D
Disabilities and Other Vulnerable
Populations
June Gothberg
Jennifer Sullivan Sulewski
Patricia Mueller
Fri, 7:00 AM to 7:50 AM
Mission B
Disaster & Emergency Management
Evaluation
S Scott Aminov
Karen Pendleton
Patricia (Trish) Bolton
Brandi R Gilbert
Thu, 6:10 PM to 7:00 PM
Crockett D
Distance Ed & Other Ed Tech
Talbot Bielefeldt
Talbot Bielefeldt
Thu, 3:35 PM to 4:20 PM
Presidio A
Environmental Program Evaluation
Annelise Carleton-Hug
Kara Crohn
Mary McEathron
Thu, 6:10 PM to 7:00 PM
Bonham E
Evaluating the Arts & Culture
Kathlyn Steedly
Ching Ching Yap
Thu, 6:10 PM to 7:00 PM
Travis D
Evaluation Managers and Supervisors
Ann Maxwell
Sue Hewitt
Laura L Feldman
Thu, 4:30 PM to 6:00 PM
Travis B
Evaluation Policy
Lisa Rajigah
Kristin Kaylor Richardson
Thu, 6:10 PM to 7:00 PM
Texas F
Evaluation Use
J Bradley Cousins
Susan Tucker
Fri, 7:00 AM to 7:50 AM
Seguin B
Extension Education Eval
Lisa Townson
Joseph Donaldson
Thu, 6:10 PM to 7:00 PM
Crockett A
Feminist Issues in Evaluation
Kathryn Bowen
Michael Bamberger
Linda Thurston
Sat, 12:35 PM to 1:30 PM
Goliad
Government Evaluation
Stan Capela
David J Bernstein
Sam Held
Thu, 4:30 PM to 6:00 PM
Texas A
Graduate Student and New Evaluators
Gargi Bhattacharya
Nora Gannon
Jason Burkhardt
Thu, 3:35 PM to 4:20 PM
Seguin B
Health Evaluation
Robert G LaChausse
Jenica Huddleston
Debora Goldberg
Thu, 4:30 PM to 6:00 PM
Republic B
Evaluation 2010
Page 7
Topical Interest Group
Chair(s)
Program Chair(s)
Business Meeting Time
Location
Human Services Evaluation
Tania Rempert
Todd Michael Franke
Vajeera Dorabawila
Barry Cohen
Thu, 6:10 PM to 7:00 PM
Independence
Independent Consulting
Fred Glantz
Rita S Fierro
Michelle Baron
Thu, 4:30 PM to 6:00 PM
Bowie A
Indigenous Peoples
Katherine Tibbetts
Kalyani Rai
Joan LaFrance
Thu, 4:30 PM to 6:00 PM
Bowie C
Integrating Tech Into Evaluation
Margaret Lubke
Nathan Balasubramanian
Thu, 6:10 PM to 7:00 PM
Travis B
Internal Evaluation
Boris B Volkov
Wendy M DuBow
Boris B Volkov
Thu, 10:55 AM to 12:25 PM
Lone Star F
International and Cross Cultural
Evaluation
Tessie Tzavaras Catsambas
Mary Crave
Paula Bilinsky
Thu, 6:10 PM to 7:00 PM
Republic A
Lesbian, Gay, Bisexual, and
Transgender Issues
Kari Greene
John Daws
Joe E Heimlich
Kathleen McKay
Thu, 6:10 PM to 7:00 PM
Presidio A
Mixed Methods Evaluation
Donna Mertens
Mika Yamashita
Fri 7:00 AM to 7:50 AM
Crockett A
Multiethnic Issues in Evaluation
Tamara Bertrand Jones
Leona Johnson
Stella L Hargett
Pamela Frazier-Anderson
Thu, 6:10 PM to 7:00 PM
Bowie B
Needs Assessment
Hsin-Ling (Sonya) Hung
Janet Matulis
Ann Del Vecchio
Thu, 6:10 PM to 7:00 PM
Travis C
Non-profit and Foundations Eval
Lester Baxter
Charles Gasper
Joanne G Carman
Helen Davis Picher
Thu, 4:30 PM to 6:00 PM
Lone Star D
Organizational Learning and
Evaluation Capacity Building
Michelle Baron
Gary Skolits
Stephen J Ruffini
Megan Bennett
Wed, 4:30 PM to 6:00 PM
Presidio B
Pre-K - 12 Educational Evaluation
Anane Olatunji
Antionette (Toni) Stroter
Tom McKlin
Chad T Gree
Fri, 7:00 AM to 7:50 AM
Bonham C
Program Theory & Theory-Driven
John A Gargani
Katrina Bledsoe
Sat, 10:00 AM to 10:45 AM
Lone Star A
Qualitative Methods
Jennifer Jewiss
Leslie Goodyear
Janet Usinger
Eric Barela
Thu, 6:10 PM to 7:00 PM
Texas B
Quantitative Methods: Theory and
Design
Patrick McKnight
George Julnes
Karen Larwin
Ray Hart
Thu, 10:55 AM to 12:25 PM
Lone Star E
Research on Evaluation
Christina Christie
Tarek Azzam
Thu, 3:35 PM to 4:20 PM
Texas F
Research, Technology, and
Development Evaluation
Cheryl J Oros
Brian Zuckerman
George Teather
Juan D Rogers
Thu, 6:10 PM to 7:00 PM
Texas D
Social Network Analysis
Maryann Durland
Stacey Friedman
Thu, 6:10 PM to 7:00 PM
Bowie A
Social Work
Donna Parrish
Tracy C Wharton
Karen Anderson
Aisha Tucker Brown
Thu, 6:10 PM to 7:00 PM
Mission B
Systems in Evaluation
Jan Noga
Meg Hargreaves
Mary McEathron
Thu, 4:30 PM to 6:00 PM
Lone Star B
Teaching of Evaluation
Linda B Schrader
Neva Nahan
Thu, 6:10 PM to 7:00 PM
Crockett B
Theories of Evaluation
James Griffith
Bianca Montrosse
James Griffith
Bianca Montrosse
Thu, 3:35 PM to 4:20 PM
Republic C
Evaluation 2010
Page 8
Thank you to our sponsors
AEA would like to thank the following parties for contributing funds and services as sponsors of this year‘s annual conference. The
contributions of people and groups such as these allow the Association to keep registration fees as low as possible. If you know of
anyone who would like to sponsor next year‘s conference in Anaheim, California, please contact the AEA office.





Annie E Casey Foundation: National Science Foundation Reception and Student Attendance
Gravic Inc: Conference Evaluations
National Science Foundation: Pens/Highlighters for Each Attendee
Sage Publications: Meet the Author Reception
Westat: Evaluation Futures, Student Registrant Sponsorships
Thank you to our volunteers
AEA would like to thank the many people who lend their time and talents to making Evaluation 2010 an event to remember.
Conference Chair
Katherine McKnight
Presidential Strand Co-chairs
Valerie Caracelli
Rodney Hopson
Professional Development Program Reviewers
Katherine McKnight (Chair)
Derrick Gervin
Victor Kuo
Leigh Wang
Art Hernandez
Silent Auction Coordinator
Tessie Catsambas
Thank you to our on site staff
Cady Berkel
Aleise Matheson
Marcus Bolton
Gwen Fariss Newman
Susan Kistler
Heidi Nye
Thank you to our amazing presenters
Of course, the most thanks must go to the 1,000+ people who contribute their time, knowledge, and expertise as presenters for this
year‘s conference. Their names and contributions appear in the body of this program.
Evaluation 2010
Page 9
Thank you to all 702 conference proposal reviewers!
The following 702 individuals contributed their knowledge and expertise as reviewers for the Evaluation 2010 program.
Eric Abdullateef
Lois Abel
Yvonne Abel
Margot Ackermann
Sandra Adams
Omolola Adedokun
Lokman Akbay
Liya Aklilu
Salvatore Alaimo
Flanny Alamparambil
Kasia Alderman
Asma Ali
Metta Alsobrook
Eusebio Alvaro
S Scott Aminov
Courtney Amo
Trena Anastasia
Laura Anderson
Shirley Anderson
Karen Anderson
Andrea AndersonHamilton
Nanette Antwi-Donkor
Sarah Appleton-Dyer
Sheila Arens
Amy Laura Arnold
Elise Arruda Laorenza
Kas Aruskevich
Elizabeth Autio
Tarek Azzam
EunKyeng Baek
RichAnn Baetz
Haiyan Bai
Anita Baker
Michelle Bakerson
Nathan
Balasubramanian
Michael Baldwin
Dorene Balmer
Michael Bamberger
Lennise Baptiste
Eric Barela
Zoe Barley
Susan Barnes
Michelle Baron
Catherine Batsche
Joseph Bauer
Herb Baum
Lester Baxter
Rachel Becker-Klein
Barbara Bedney
Aarti Bellara
Carolla Belle
Lehn Benjamin
Gregory Benjamin
Megan Bennett
Rusti Berent
Evaluation 2010
Dale Berger
Nancy Berglas
David Bernstein
Tiffany Berry
Tamara Bertrand
Jones
Hannah Betesh
Stevens Beth
Amee Bhalakia
Gargi Bhattacharya
William Bickel
Talbot Bielefeldt
Gretchen Biesecker
Margaret Biggerstaff
Yakup Bilgili
Diane Binder
Pamela Bishop
Katrina Bledsoe
Marcie Bober-Michel
Patricia Bolton
Sally Bond
Robert Boody
Roger Boothroyd
John Bosma
Kathryn Bowen
Ann Brackett
Wendy Bradshaw
Margaret Braun
Ann Briehan
Edward Broughton
Courtney Brown
Lisanne Brown
Clete Bulach
Michael Burke
Jason Burkhardt
Kurt Burkum
Amy Burns
Erin Burr
Ellie Buteau
William Cabin
Eric Canen
Stanley Capela
Gisela Cardoso
Martha Ann Carey
Annelise Carleton-Hug
Joanne Carman
Deborah Carran
Nancy Carrillo
Frances Carter
Karen Carter
Imelda CastañedaEmenaker
Tessie Tzavaras
Catsambas
Sharon Caudle
Marge Cawley
Melissa Chapman
SeriaShia Chatters
Scott Chazdon
Mei-kuang Chen
Lynn Chen
Soon Cheon Byeon
Karen Childs
Pedro Paulo Chrispim
Christina Christie
Seung Youn Chyung
Kristen Cici
Nolan Clare
Laura Clark
Janet Clinton
Jamie Coburn
Michael Coe
Julia Coffman
Barry Cohen
Benjamin Cohen
Sarah Cohn
Emil Coman
Tiffany Comer Cook
Susan Connors
Chris L S Coryn
Humphrey Costello
Bridget Cotner
J Bradley Cousins
Pamela Cox
Mary Crave
Senobia Crawford
Kara Crohn
Jodi Cullum
Rebecca Culyba
Leigh D'Amico
Evangeline Danseco
Kamarrie Davis
Mende Davis
Helen Davis Picher
John Daws
H Pamela De La
Cerda
Karen Debrot
Lauren Decker
Dana DeHart
Laura Deitrick
Ann Del Vecchio
Connie Della-Piana
Gabe Della-Piana
Amy Dellinger
David Devlin-Foltz
Caroline DeWitt
Marycruz Diaz
Rebeca Diaz
Virginia Dick
Tammiee Dickenson
David Diehl
David Dobrowski
Denece Dodson
Joseph Donaldson
Stewart Donaldson
Vajeera Dorabawila
Ann Doucette
Malinda Douglas
Nevein Dous
Linda Drach
Mary Drake
Christie Drew
Wendy DuBow
River Dunavin
Kristin Duppong
Hurley
Maryann Durland
Sandra Eames
Adam Eckerd
Ligia Elliot
Katrina Ellis
Molly Engle
Mariana EnriquezOlmos
Melissa Evenson
Stephanie Evergreen
Bellarmine Ezumah
Anupa Fabain
Didi Fahey
Mary Kay Falconer
Beverlie Fallik
Kevin Favor
Laura Feldman
David Fetterman
Marta Fetterman
Leslie Fierro
Rita Fierro
Pamela Finney
Robert Fischer
Dreolin Fleischer
Lynette Fleming
Lisa Flowers
Cynthia Flynn
Shannon Flynn
Susan Foutz
Judith Francis
Karen Franck
Todd Franke
James Frasier
Pamela FrazierAnderson
Kimberly Fredericks
Melissa Freeman
Stacey Friedman
David Frood
Stephanie Fuentes
Nick Fuhrman
Karu Gajaweera
Matt Galen
Nora Gannon
Annette Gardner
John Gargani
Wendy Garrard
Pamela Garrett
Charles Gasper
Marie Gervais
Diane Gibbs
Brandi Gilbert
Karen Given Larwin
Johanna Gladfelter
Morariu
Fred Glantz
Marlene Glassman
Rebecca GloverKudon
Darlene Goetzman
Debora Goldberg
Ricardo Gomez
Alfredo Gonzalez
Cambero
Ayo Gooden
Warren Gooden
Leslie Goodyear
June Gothberg
Michele Graham
Eric Graig
Douglas Grane
Billie-Jo Grant
Nicole Gray
Tom Grayson
Chad Green
Joelle Greene
Kari Greene
Lija Greenseid
James Griffith
Gwenn Grondal
Luisa Guillemard
Amy Gullickson
Otto Gustafson
Jessica Hafetz
Emily Hagstrom
Meg Haller
Sue Hamann
Jennifer Hamilton
Marie Hammond
Tanis Hampe
Mark Hansen
Stella Hargett
Meg Hargreaves
Michael Harnar
Raymond Hart
Kathy Hayes
Kathleen Haynie
Barbara Heath
Debra Heath
Anne Heberger
John Hecklinger
Ferrari Heidrun
Joe Heimlich
Sam Held
Gerd-Michael
Hellstern
Barbara Helms
Susan Henderson
Astrid Hendricks
Tabia Henry Akintobi
Se Jin Heo
Stephanie Herbers
Anne Hewitt
Sue Hewitt
Susan Hibbard
Alexandra Hill
John Hitchcock
Lisle Hites
Sheryl Hodge
Cheri Hoffman
Joann Hoffman
Elaine Hogard
William Holmes
Stafford Hood
Rodney Hopson
Christopher Horne
John Hornik
David Hough
Duane House
Ray Howard
Tina Howard
Tamika Howell
Jeanne Hubelbank
Jenica Huddleston
Douglas Huffman
Bob Hughes
Mary Beth Hughes
Campbell
Richard
Hummelbrunner
Hsin-Ling Hung
Yvonne Hunter
Marlene Hurley
Marthe Hurteau
Claire Hutchings
Melanie Hwalek
Jari Hyvärinen
Marta Induni
Jo Ann Intili
Jennifer Elise Iriti
Miriam Jacobson
Nakia James
Valerie Janesick
Tania Jarosewich
Michelle Jay
Koralalage Jayaratne
Jessica Jerney
Jennifer Jewiss
Page 10
Beth Johnson
Chantall Johnson
Elmima Johnson
Kelli Johnson
Leona Johnson
Robert Johnson
Andrea Johnston
George Julnes
Susanne Kaesbauer
James Kakooza
Leanne Kallemeyn
Mustafa Karakus
Jacob Kawonga
Jacqueline Kaye
Kaylor Richardson
Kristin
Mansoor Kazi
Tom Kelly
Sarah Kershner
Sheila Kessler
Teserach Ketema
Nicki King
Georgia Kioukis
Randahl Kirkendall
Anita Kliewer
Naoto Kobayashi
Sarah Kohler
Chrestman
Shelia Kohn
Karen Kortecamp
Julien Kouame
Howard Kress
Richard Kunkel
Candace Lacey
Robert LaChausse
Joan LaFrance
Michel Lahti
Undurthy Lakshmi
Narayana
Tony Lam
Glenn Landers
Ann Landy
R Sam Larson
David Larwin
Karen Larwin
John LaVelle
Rene Lavinghouze
Nikki Lawhorn
Tanner LeBaron
Wallace
Israel Lederhendler
Andrea Lee
Chris Lee
Janet Lee
Yoon Been Lee
Ligia Leite
Kristi Lekies
Suzanne LeMenestrel
Tara Leung
Deborah Lewis
Rhonda Lewis-Moss
Edward Liebow
Cindy Lin
Tob Lippin
Evaluation 2010
Adele Liskov
Sean Little
Che-Hao Liu
Sunny Liu
Shanna Livermore
Anna Lobosco
Jill Lohmeier
Paul Lorton Jr
Margaret Lubke
Jane Nell Luster
Linda Lynch
Stephen Magura
Janet Mahowski
Brigitte Maicher
Ayanava Majumdar
Sheetal Malhotra
Leslie Mandel
Colleen Manning
Cat Marlow
Ian Martin
Jennifer Martineau
Zoe Masonsong
Oliver Massey
Linda Masters
Sandra Mathison
Janet Matulis
Ann Maxwell
Donna McBey
Dominica McBride
Sheena McConnell
Marci McCoy-Roth
Mary McEathron
Richard McGahey
Mark McGivern
Kathleen McKay
Tom McKlin
Patrick McKnight
Ed McLain
Shannan McNair
Miles McNall
Keith McNeil
Goutham Menon
Gale Menzer
Lynn Merkin
Stacy Merola
Donna Mertens
R Gregory Michaels
William Michaud
Rochelle Michel
Jan Middendorf
Eleanore Miller
M David Miller
Dale Miller Hill
Cheryl Milloy
Christine MinjaTrupin
Roger Miranda
Rakesh Mohan
David Mohr
Ruth Mohr
Melinda Mollette
Bianca Montrosse
Angela Moore
Garrett Moran
Jon Morell
Dewayne Morgan
Unique Morris
Shannon Morrison
Dieudonne Mouafo
Patricia Mueller
April Munson
Ottis Murray
Carol Mutch
Kristina Mycek
Barry Nagel
Neva Nahan
Julius Najab
John Nash
Randi Nelson
Leah Neubauer
Frederick Newman
James Newman
Jan Noga
Emma Norland
Kathleen Norris
Kim Norris
Karen Odhiambo
Saori Ohkubo
Olaoye Olanrewaju
Anane Olatunji
Pablo Olmos-Gallo
So O'niel
Carlyn Orians
Cheryl Oros
Sandra Ortega
Rita O'Sullivan
Corina Owens
Elizabeth Oyer
Mehmet Dali Ozturk
Dale Pahl
Kirimatao Paipa
Lyn Paleo
Hui-Ling Pan
Susan Parker
Donna Parrish
Serafina Pastore
Christine Paulsen
Tara Pearsall
Daniel Pearson
Karen Pendleton
Nadini Persaud
Rajinder Peshin
James Petrovich
Carrie Petrucci
John Pfaff
Nevein Philip
Laura Pinsoneault
Mary Piontek
Paula Plonski
Margaret Polinsky
Elena Polush
Branco Ponomariov
Paul Pope
Charles Potter
Shana Pribesh
Ali Protik
Roger Przybylski
Marylynn Quartaroli
Martha Quinn
Linnea Rademaker
Kalyani Rai
Lisa Rajigah
Jared Raynor
Ehren Reed
John Reed
Jennifer Reeves
George Reinhart
Tania Rempert
Weijia Ren
Rose Ann Renteria
Adrian Reyes
Jessica Rice
Margaret Richardson
James Riedel
Martina Rillo Otero
Rhoda Risner
Melissa Rivera
Cynthia Roberts-Gray
Jane Rodd
Joseph Rodriguez
Liliana RodriguezCampos
Elizabeth Roen
Willem Roestenburg
Debra Rog
Juan Rogers
Kate Rohrbaugh
Magdalena Rood
Audrey Rorrer
Denise Roseland
Wim Rostenburg
Laurie Ruberg
Maureen Rubin
Jonathan Rubright
Stephen Ruffini
Craig Russon
Katherine Ryan
Maurice Samuels
Jafeth Sanchez
Edgar Sanchez
Meenakshi Sankar
Tobey Sapiano
Sue Ann Sarpy
Mildred Savidge
Monika Schaffner
David Scheie
Rhonda Schlangen
Evanthia Schmidt
Lisa Schmitt
Heather Scholz
Linda Schrader
Daniela Schröter
Russell Schuh
Diana Seybolt
Julie Shaftel
Vidhya Shanker
Katherine Shaw
Jeffrey Sheldon
David Shellard
Tara Shepperson
Scott Sheri
Kate Shimshock
Gitanjali Shrestha
Lyn Shula
Juan Shu-Ping
Aimee Sickels
Mary Siegrist
Benjamin Silliman
Kisira Simon
Gary Skolits
Christa Smith
Michael Smith
Veronica Smith
Juna Snow
Necole Sommersell
John Spence
Sarah Stachowiak
Robert Stake
Kathlyn Steedly
Marla Steinberg
Nicole Stephens
Beth Stevens
Joseph Stevens
Xuan Stevens
Jacqueline Stillisano
Ramona Stone
Brenda StoneWiggins
Sharon Stout
Antionette Stroter
Jennifer Sullivan
Sulewski
Sandra Sundeen
Stephanie
Sutherland
Mary Sutter
Mary Anne Sydlik
Michael Szanyi
Laura Tagle
Cynthia Tananis
Li Tang
Michele Tarsilla
Erica Taylor
George Teather
Bing-ru Teh
Lois Thiesson
Kelly Thomas
Yelena Thomas
Linda Thurston
Katherine Tibbetts
Minakshi Tikoo
Kate Tinley
Kathleen Toms
Lisa Townson
Keith Trahan
Rosanna Tran
Jeanette Treiber
Tina Trent
Suprabha Tripathi
Jeannette Truxillo
Susan Tucker
Aisha Tucker Brown
Christina Tuttle
Zita Unger
Janet Usinger
Kim Van Der Woerd
Gita Varagoor
Stanley Varnhagen
Delores Vaughn
Rodolfo Vega
Jon Vencil
Keren Vergon
Nicole Vicinanza
Ronald Scott Visscher
Boris Volkov
Gary Walby
Elaine Walker
Kate Walker
Uda Walker
Connie Walker-Egea
Michael Wallace
Lihshing Wang
Thomas Ward
Lora Warner
Yukiko Watanabe
Kenneth Watson
Hillel Weinberg
Staci Wendt
Carl Westine
Tracy Wharton
David White
Jianglan White
Bessa Whitmore
Maria Whitsett
Belinda Wholeben
Gwen Willems
Machteld Willemse
Bob Williams
Jackie Williams Kaye
Lori Wingate
Linda Winges
Werner Wittmann
Mike Wolf-Branigin
Susan Wolfe
Cindy Wong
Anne Worthington
Mary Worzala
Francesca Wright
Yiyan Wu
Biligi Yakup
Kai Chi Yam
Mika Yamashita
Bo Yan
Ching Ching Yap
SeungJun Yoo
Jennifer Young
Ping Yu
Hugh Yuan
Ronda Zakocs
Karen Zannini Bull
Jie Zhang
Jinhai Zhang
Jing Zhao
Kristen Zimmerman
Debbie Zorn
Brian Zuckerman
Keith Zvoch
Victor Zvonnikov
Page 11
Professional Development Workshops
Professional development workshops precede and follow the conference. They require a separate registration fee and are filled on a
first-come, first-served basis. We expect that most of the workshops will be full prior to the event. For those workshops that have not
filled, on-site registration is available in San Antonio. Rooms are assigned at the conference and appear on your conference
nametag. Full descriptions of these workshops may be found online or requested from the registration desk. Since most people have
pre-registered for workshops, the full descriptions are not included in this program but may be found online or at the registration
desk.
Two-day Workshops, Monday and Tuesday, November 8 and 9, 9 am to 4 pm
1. Qualitative Methods in Evaluation, with Raymond Maietta
2. Quantitative Methods for Evaluators, with Katherine McKnight
3. Evaluation 101: Intro to Evaluation Practice, with John McLaughlin
4. Logic Models for Program Evaluation and Planning, with Thomas Chapel
5. Participatory Evaluation, with Jean King and Laurie Stevahn
6. Consulting Skills for Evaluators: Getting Started, with Gail Barrington
7. Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use, with Michael Quinn Patton
8. Building Evaluation Capacity of Community Organizations, with Ellen Taylor-Powell
Tuesday Workshops, November 9, 9 am to 4 pm
9. Reconceptualizing Evaluation, with Michael Scriven
10. Experimental and Quasi-experimental Designs for Evaluation, with Chris Coryn
11. RealWorld Evaluation: Practical Tips for Doing Evaluation in Spite of Constraints, with Jim Rugh
12. Advanced Focus Group Moderator Training, with Nancy-Ellen Kiernan
13. Introduction to GIS and Spatial Analysis in Evaluation, with Arlene Hopkins and Stephen Maack
14. Systems Thinking and Evaluation Practice: Tools to Bridge the Gap, with Noga, Hargreaves, Hummelbrunner and Williams
15. Creative Surveys to Measure Performance and Assess Needs, with Michelle Kobayashi
16. Longitudinal Analysis Using Structural Equation Models, with Manuel Voelkle and Werner Wittmann
Wednesday Full Day Workshops, November 10, 8 am to 3 pm
17. Collaborative Evaluations: A Step-by-Step Model for the Evaluator, with Liliana Rodriguez-Campos
18. Needs Assessment, with James Altschuld and Jeffry White
19. Logic Models - Beyond the Traditional View, with Jonathan Morell
20. Transformative Mixed Methods Evaluations, with Donna Mertens and Katrina Bledsoe
21. How to Prepare an Evaluation Dissertation Proposal, with Nick Smith
22. Utilization-focused Evaluation, with Michael Quinn Patton
23. Advanced Topics in Concept Mapping for Evaluation, with Mary Kane
24. Evaluating Organizational Collaboration, with Rebecca Woodland
25. Using Effect Size and Association Measures in Evaluation, with Jack Barnette
Evaluation 2010: Pre- and Post-Conference Workshops
Page 12
Wednesday Full Day Workshops, November 10, 8 am to 3 pm, continued
26. Canceled
27. Multilevel Models in Program and Policy Evaluation, with Sanjeev Sridharan
28. Getting Actionable Answers for Real-World Decision Makers, with E Jane Davidson
29. Theory-driven Evaluation for Assessing and Improving Planning, Implementation, and Effectiveness, with Huey Chen
30. Identifying, Naming, Measuring and Interpreting Racism in Contexts of Evaluations, with Pauline Brooks
31. Navigating the Waters of Evaluation Consulting Contracts, with Kristin Huff
32. Survey Design 101, with Courtney Malloy and Harold Urman
33. Operations Research (OR) Techniques for Program Evaluation, with Edith Cook
34. Tools for Integrating System Dynamics and System Intervention Elements,with Margaret Hargreaves and Bevery Parsons
35. Social Network Analysis: Theories, Methods, and Applications, with Kimberly Fredericks
36. Practical Propensity Score Analysis, with Jason Luellen and MH Clark
37. Qualitative Tools for Deeper Understanding, with Deborah Potts
Wednesday Half Day Workshops, November 10, 8 am to 11 am
38. Empowerment Evaluation, with David Fetterman
39. Rethinking Fidelity of Implementation (FOI), with Jeanne Century
40. Practical Strategies for Moderating Meaningful Focus Groups, with Robert Kahle
41. Nonparametric Statistics: When Your Data is Skewed or Your Sample Size is Small, with Jennifer Camacho Catrambone
42. Increasing 'Interpersonal Validity' and Ethical Practice: An Integral Evaluator Model, with Hazel Symonette
43. Impact Evaluation of International Development Programs: The Heifer Hoofprint Model, with M Scriven, T Chianca, & R Kern
Wednesday Half Day Workshops, November 10, 12 pm to 3 pm
44. An Executive Summary is Not Enough: Effective Reporting Techniques for Evaluators, with Kylie Hutchinson
45. Integrated Data Analysis in Mixed Methods Evaluation, with Jennifer Greene
46. The Basics of Using Theory to Improve Evaluation Practice, with Stewart Donaldson and John LaVelle
47. The Tools and Techniques of Gender Responsive Evaluation, with M Bamberger, K Bowen, B San Luque, and T Catsambas
48. Methods for Evaluating RTD Projects and Programs with Gretchen Jordan, Rosalie Ruegg, and Cheryl Oros
49. Cost-Effectiveness Analysis of Health and Human Services Programs, with Edward Broughton
Sunday Half Day Workshops, November 14, 9 am to 12 pm
50. Doing Cost-Inclusive Evaluation: We Should, You Can, and Here's How, with Brian Yates
51. Hearing Silenced Voices: Using Visual Methods to Include Traditionally Disenfranchised Populations, with Linda Lee
52. Participatory Program Implementation Tools for Evaluators and M&E Personnel, with Scott Yetter and Carlene Baugh
53. Purposeful Program Theory, with Patricia Rogers
54. Data Preparation and Management, and Allison Minugh, Susan Janke and Nicoletta Lomuto
Evaluation 2010: Pre- and Post-Conference Workshops
Page 13
Notes:
Evaluation 2010: Pre- and Post-Conference Workshops
Page 14
Wednesday, November 10, 2010: Overview of Schedule
7:00 am to 6:30 pm
Registration Desk Open
8:00 am to 5:00 pm
Exhibits Open at Exhibitor Discretion
8:00 am to 11:00 am
Professional Development Workshops (Require separate registration)
12:00 pm to 3:00 pm
Professional Development Workshops (Require separate registration)
3:15 pm to 4:15 pm
Opening Plenary
4:30 pm to 6:00 pm
Concurrent Conference Sessions
6:10 pm to 6:40 pm
Orientation for First Time Attendees and New Members
6:30 pm to 8:00 pm
AEA Poster Exhibition and Reception
My Schedule:
Evaluation 2010: Wednesday, November 10
Page 15
Summary of Sessions for Wednesday, November 10, 4:30 PM to 6:00 PM
No Primary Sponsor
Type
Session Title
Room
102 Presidential Strand
Panel
Improving the Quality of Evaluation Practice by Attending to Context
Lone Star A
103 Indigenous Peoples in Evaluation TIG
Skill-building
Waawiyeyaa (Circular) Evaluation Tool
Lone Star B
104 Collaborative, Participatory & Empowerment
Panel
Building a Learning Culture Within Community Initiatives and Organizations
Lone Star C
105 Non-profit and Foundations Evaluation TIG
Think Tank
Successful Outcome Measurement in Nonprofits: Overcoming Challenges
Lone Star D
106 Quantitative Methods: Theory and Design TIG
Panel
Place Randomized Trials and Alternatives in a Field Setting: Examples From Psychotherapy Research
Lone Star E
107 Cluster, Multi-site & Multi-level Evaluation TIG MultiPaper
Balancing Autonomy and Uniformity in a Multi-site Evaluation: Evaluation of Program Integration Efforts at the CDC
Lone Star F
108 Distance Education & Other Ed Technologies
Roundtable
Rotation I: Using Technological Pedagogical Content Knowledge and an Evaluation Framework to Evaluate Online Courses…
Rotation II: REMOTE Messages: The Job Value of a Distance Learning Graduate Program for the Pacific Region
Mission A
109 Mixed Methods Evaluation TIG
Roundtable
Rotation I: Increasing Nonprofit Sustainability Activities With Effective RFP's: A Mixed Methods Evaluation…
Rotation II: Improving the Process of Reviewing Research Proposals: Reflections of a Research Review Committee
Mission B
110 Systems in Evaluation TIG
Skill-building
A Tool for Designing Evaluations of Paradigm Shifts in Complex System Interventions
Bowie A
111 Multiethnic Issues in Evaluation TIG
Mega-roundtable Maximizing Our Collective Talent: Conversations With Senior Evaluators
Bowie B
112 Advocacy and Policy Change TIG
MultiPaper
Understanding, Building, and Evaluating Advocacy Capacity
Bowie C
113 Government Evaluation TIG
Roundtable
Rotation I: A Conceptual Framework to Assess the Sustainability of Community Coalitions Post-Federal Funding
Rotation II: Using Community Partnerships to Reach Hard-to-Reach Populations in Health-Related Evaluations
Goliad
114 Quantitative Methods: Theory and Design TIG
Roundtable
Rotation I: Non-response Bias a Limitation: Practical Perspectives of Evaluation Quality Using Survey and Questionnaire Data
Rotation II: Coding Open-Ended Survey Items: A Discussion of Codebook Development and Coding Procedures
San Jacinto
115 Assessment in Higher Education TIG
Multipaper
Assessing Student Learning Outcomes I: Incorporating Feedback
Travis A
116 Integrating Technology Into Evaluation
Multipaper
Viabilities of Technologies in Evaluation Research
Travis B
117 Needs Assessment TIG
Multipaper
Planning Programs: Allocating Scarce Resources Based on Needs Assessment
Travis C
118 Health Evaluation TIG
MultiPaper
Emerging Strategies and Tools for Evaluating Environmental and Policy Change Approaches to Chronic Disease Prevention
Travis D
119 Human Services Evaluation TIG
MultiPaper
Are Universal School-based Prevention Programs Effective? It Depends on the Students and Outcomes Targeted
Independence
120 Quantitative Methods: Theory and Design TIG
Panel
Innovative Applications of Propensity Scores and Propensity Score Methodology Adjustments to Address Data Constraints
Presidio A
121 Org Learning & Evaluation Capacity Bldg
Business Meeting TIG Business Meeting and Presentations: Advancing Quality in Evaluation Capacity Building
Presidio B
122 Alcohol, Drug Abuse, and Mental Health TIG
Skill-building
Presidio C
Integrating Realist Evaluation Strategies in a SAMHSA System of Care Local Evaluation
Evaluation 2010: Wednesday, November 10, 2010 4:30 – 6:00 PM Timeslot Overview
Page 16
Summary of Sessions for Wednesday, November 10, 4:30 PM to 6:00 PM, Continued
No Primary Sponsor
Type
Session Title
Room
123 Pre-K - 12 Educational Evaluation TIG
Roundtable
Rotation I: Evaluating the Effects of Year-Long Professional Development on Teachers…
Rotation II: Evaluation Quality in Measuring Teacher Quality: The Impact of the Targeted Assistance Coaching Model on LEA…
Bonham A
124 Non-profit and Foundations Evaluation TIG
Panel
The Intersection of Strategy and Evaluation: What Are We Learning?
Bonham B
125 Pre-K - 12 Educational Evaluation TIG
Panel
Managing Quality Through the Stages of Science, Technology, Engineering and Mathematics (STEM) Educational Evaluation
Bonham C
126 Pre-K - 12 Educational Evaluation TIG
Multipaper
Evaluating Supplementary Programs in Educational Settings
Bonham D
127 Environmental Program Evaluation TIG
Multipaper
Environmental and Energy Evaluations: Strategies for Pursuing Innovative Approaches…
Bonham E
128 Extension Education Evaluation TIG
Panel
Standards of Evidence for Evaluating Extension Programs: A Changing Picture?
Crockett A
129 Teaching of Evaluation TIG
Demonstration
Using an Interest-Driven Project to Teach Program Planning and Evaluation
Crockett B
130 Graduate Student and New Evaluator TIG
Skill-building
Networking and Getting Involved With the American Evaluation Association
Crockett C
131 Government Evaluation TIG
MultiPaper
Informing Government Policy Through Evaluation: A Cross-site Evaluation of the Self-Employment Initiative (Start-Up USA)
Crockett D
132 International and Cross-cultural Evaluation TIG Multipaper
Evaluation and the Complexities of International Financial Assistance Programs
Republic A
133 Health Evaluation TIG
Panel
Evaluation of the Clinical and Translational Science Awards (CTSA) Programs: A Focus on Quality
Republic B
134 Collaborative, Participatory & Empowerment
Skill-building
Round Robin Focus Groups: Participatory Inquiry - From Data Gathering to Reporting in an Hour
Republic C
Evaluation 2010: Wednesday, November 10, 2010 4:30 – 6:00 PM Timeslot Overview
Page 17
Wednesday, 3:15 pm to 4:15 pm
100 – Tensions Among Evaluative Perspectives in the Age of
Obama: Influences on Evaluation Quality,
Thinking and Values
Plenary to be held in Texas A
Sponsored by the Presidential Strand
 Chair - Leslie Cooksy, University of
Delaware
 Presenters – Eleanor Chelimsky, Independent Consultant;
Laura Leviton, Robert Wood Johnson Foundation; Michael
Quinn Patton, Utilization-Focused Evaluation
Wednesday, 4:30 pm to 6:00 pm
102 - Improving the Quality of Evaluation Practice by
Attending to Context
Panel to be held in Lone Star A
Sponsored by the Presidential Strand
 Chair - George Julnes, University of
Baltimore
 Discussant - Eleanor Chelimsky, Independent Consultant
Striving for Truth, Beauty, and Justice in Evaluation Practice: A
Methodological Analysis of Contextually Sensitive Practice
 Debra Rog, Westat
Recognizing and Reconciling Differences in Stakeholders‘
Contexts as a Prelude to High Quality Evaluation: The Cases of
Cultural and Community Contexts
 Ross Conner, University of California, Irvine
Comparative Evaluation Practice and Politics: The Role of
Political Context in Influencing Quality
 Jody Fitzpatrick, University of Colorado, Denver
103 - Waawiyeyaa (Circular) Evaluation Tool
Skill-building Workshop to be held in Lone Star B
Sponsored by the Indigenous Peoples in Evaluation TIG
 Andrea LK Johnston, Johnston Research Inc
104 - Building a Learning Culture Within Community
Initiatives and Organizations
Panel to be held in Lone Star C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Chair - David Scheie, Touchstone Center for Collaborative
Inquiry
 Discussant - Prudence Brown, Independent Consultant
Cultivating a Learning Culture in a Community Development
Corporation
 Kate Tilney, Hope Community Inc
Building a Learning Partnership in a Neighborhood
Transformation Initiative
 Sue Tripathi, Making Connections, Denver
Developing a Learning and Evaluation Partnership in a
Regional Capacity Building Initiative
 David Scheie, Touchstone Center for Collaborative Inquiry
105 - Successful Outcome Measurement in
Nonprofits: Overcoming Challenges
Think Tank to be held in Lone Star D
Sponsored by the Non-profit and Foundations Evaluation TIG
 Lora Warner, University of Wisconsin, Green Bay
106 - Place Randomized Trials and Alternatives in a
Field Setting: Examples From Psychotherapy Research
Panel to be held in Lone Star E
Sponsored by the Quantitative Methods: Theory and Design TIG
 Chair - Lee Sechrest, University of Arizona
 Discussant - Frederick Newman, Florida International
University
Evaluating a Feedback System in Ambulatory Psychotherapy
Using a Longitudinal Place Randomized Trial
 Manuel Voelkle, Max-Planck-Institute for Human
Development Berlin
Evaluating a Feedback System in Ambulatory Psychotheray Using
a Classical Pre-Post Test Design With a One Year Follow-up
 Andrés Steffanowski, University of Mannheim
Comparing Two Different Research Designs in Program
Evaluation: Problems, Advantages, Pitfalls and Implications for
Causal Evidence
 Werner Wittmann, University of Mannheim
107 - Balancing Autonomy and Uniformity in a Multisite Evaluation: Evaluation of Program Integration
Efforts at the Centers for Disease Control and
Prevention (CDC)
MultiPaper to be held in Lone Star F
Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG
 Chair - Thomas Chapel, CDC
On Rowing in the Right Direction: Creating an Evaluation
Design for a Program Integration Effort
 Thomas Chapel, CDC
Measuring Program Integration at the State Level: Wisconsin
 Alison Bergum and Amanda Jovaag, University of
Wisconsin
Using Social Network Analysis to Measure Integration
 April Reese and Jennifer Woody, North Carolina
Department of Health
Evaluation 2010: Wednesday, November 10, 3:15 – 4:15 PM, 4:30 – 6:00 PM
Page 18
108 - Roundtables in Mission A
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Distance Education & Other Educational
Technologies TIG
Rotation 1: Using Technological Pedagogical Content
Knowledge and an Evaluation Framework to Evaluate Online
Courses and Tools
 Andrea Velasquez and David D Williams, Brigham Young
University
Rotation 2: Regional Education Master‘s Online Training in
Evaluation (REMOTE) Messages: The Job Value of a
Distance Learning Graduate Program for the Pacific Region
 Charles Giuli, Pacific Resources for Education and
Learning (PREL)
109 - Roundtables in Mission B
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Mixed Methods Evaluation TIG and the Pre-K
- 12 Educational Evaluation TIG
Rotation 1: Increasing Nonprofit Sustainability Activities With
Effective Request for Proposals (RFP's): A Mixed Methods
Evaluation of RFPs as an Instrument for Success
 Nakia James, Western Michigan University
Rotation 2: Improving the Process of Reviewing Research
Proposals: Reflections of a Research Review Committee
 River Dunavin, Nancy Carrillo, and Ranjana Damle,
Albuquerque Public Schools
110 - A Tool for Designing Evaluations of Paradigm
Shifts in Complex System Interventions
Skill-building Workshop to be held in Bowie A
Sponsored by the Systems in Evaluation TIG
 Beverly A Parsons and Pat Jessup, InSites; Marah Moore,
i2i Institute Inc
111 - Maximizing Our Collective Talent:
Conversations With Senior Evaluators
Mega-roundtable to be held in Bowie B
Sponsored by the Multiethnic Issues in Evaluation TIG
 Tamara Bertrand Jones, Florida State University; Pamela
Frazier-Anderson, Lincoln University; Stafford Hood, University
of Illinois at Urbana-Champaign; Kevin E Favor, Lincoln
University; Elmima Johnson, National Science Foundation;
Henry Frierson, University of Florida; Ceasar Jackson, National
Science Foundation; Rodney Hopson, Duquesne University;
Michelle Jay, University of South Carolina; Katherine A
Tibbetts, Kamehameha Schools
112 - Understanding, Building, and Evaluating
Advocacy Capacity
MultiPaper to be held in Bowie C
Sponsored by the Advocacy and Policy Change TIG
 Chair - Brian Quinn, Robert Wood Johnson Foundation
What is Advocacy Capacity?
 Susan Sherry and Jacquie Anderson, Community Catalyst
What Does Advocacy Capacity Mean to Consumer Advocates?
 Cathy Levine, The Universal Health Care Action Network of
Ohio; Elizabeth Doyle, Take Action Minnesota; Kathleen
Gmeiner, Universal Health Care Action Network of Ohio
Measuring Advocacy Capacity
 Jung Kim and Debra Strong, Mathematica Policy Research
113 - Roundtables in Goliad
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Roundtable to be held in Goliad
Sponsored by the Government Evaluation TIG and the Health
Evaluation TIG
Rotation 1: A Conceptual Framework to Assess the
Sustainability of Community Coalitions Post-Federal Funding
 Alycia Infante, Jennifer Benz, Hilary Scherer, and Caitlin
Oppenheimer, NORC at the University of Chicago; Wilma
Tilson, United States Department of Health and Human
Services
Rotation 2: Using Community Partnerships to Reach Hard-toReach Populations in Health-Related Evaluations
 Julia Alvarez and Nancy Zuercher, JVA Consulting LLC
114 – Roundtables in San Jacinto
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Quantitative Methods: Theory and Design TIG
Rotation 1: Non-response Bias a Limitation: Practical
Perspectives of Evaluation Quality Using Survey and
Questionnaire Data
 Michelle Bakerson, Indiana University South Bend
Rotation 2: Coding Open-Ended Survey Items: A Discussion of
Codebook Development and Coding Procedures
 Heather Bennett, Joanna Gilmore, and Grant Morgan,
University of South Carolina
Evaluation 2010: Wednesday, November 10, 4:30 – 6:00 PM
Page 19
Wednesday, 4:30 pm to 6:00 pm, continued
115 - Assessing Student Learning Outcomes I:
Incorporating Feedback
Multipaper to be held in Travis A
Sponsored by the Assessment in Higher Education TIG
 Chair - Jean-Marc Wise, Florida State University
Determining the Quality of Student Feedback in Course
Evaluations
 Jean-Marc Wise, Florida State University
Student Perceptions of Providing Quality Feedback in Course
Evaluations
 Jean-Marc Wise, Florida State University
Maximizing Evaluation Impact in Higher Education: Using
Program Evaluation Results to Measure Student Learning
Outcomes
 Joel Heikes and Jeanette Herman, University of Texas,
Austin
Adding an Evaluative Focus to Assessment of Higher Education
Student Learning Outcomes
 Jeanne Hubelbank, Independent Consultant
116 - Viabilities of Technologies in Evaluation
Research
Multipaper to be held in Travis B
Sponsored by the Integrating Technology Into Evaluation TIG
 Chair - Margaret Lubke, Utah State University
Improving Evaluation Quality Through Use of an Interactive
Database
 Jan Middendorf, Aaron Schroeder, Sarah Bradford, and
Valerie York, Kansas State University
Lessons Learned From Using Technology to Increase Study
Participation Among Child Welfare Service Recipients
 Lara Kaye, Center for Human Services Research; Lynn
Warner, State University of New York at Albany; Rose Greene
and Corinne Noble, Center for Human Services Research
Database Use in Evaluation Research: Opportunities and
Challenges for Supporting Continuous Improvement of
Partnerships, Programs, and Projects
 William R Penuel and Barbara Means, SRI International
Evaluating Technology in Health Care: Testing the Usability of a
Clinical Trial Query Tool Using Think Aloud Methods
 Stuart Henderson, Estella Geraghty, and Julie Rainwater,
University of California, Davis
Women Religious in a Changing Urban Landscape
 Rob Fischer, and Jenni Bartholomew, Case Western
Reserve University
Evaluation Learning Needs, Assets, and Interests of National
Science Foundation (NSF) Principal Investigators and
Evaluators
 Daniela Schroeter, Western Michigan University; Alyssa
Na'im, Education Development Center; and Lori Wingate and
Mohammed Alyami, Western Michigan University
Needs Assessment as a Precursor to Quality Program and
Evaluation of the Mt. Healthy Ohio Mathematics and Science
Partnership (OMSP) Program
 Imelda Castañeda-Emenaker, University of Cincinnati;
Hsin-Ling Hung, University of North Dakota; Ted Fowler and
Kathie Maynard, University of Cincinnati
118 - Emerging Strategies and Tools for Evaluating
Environmental and Policy Change
Approaches to Chronic Disease Prevention
MultiPaper to be held in Travis D
Sponsored by the Health Evaluation TIG
 Chair - Nicola Dawkins, ICF Macro
 Discussant - Laura Leviton, Robert Wood Johnson Foundation
Shifting Landscapes: Overview of Environmental and Policy
Change Approaches and Measurement Tools for Chronic
Disease Prevention
 Dana Keener and Amber Robinson, ICF Macro
Evaluating New York City Daycare Regulations to Prevent
Childhood Obesity
 Kenneth Goodman, ICF Macro; Lillian L Dunn, New York
City Department of Health and Mental Hygiene; L Beth Dixon,
New York University; Nicola Dawkins and Andrew Breck, ICF
Macro; Laura Lessard, Emory University; and Laura Leviton,
Robert Wood Johnson Foundation
Evaluating Efforts to Impact Federal Transportation Policy
 Nicole Lezin, Cole Communications Inc
Did you know? There are 636 Sessions on this year‘s
conference program.
117 - Planning Programs: Allocating Scarce
Resources Based on Needs Assessment
Multipaper to be held in Travis C
Sponsored by the Needs Assessment TIG
 Chair - Sue Hamann, National Institutes of Health
 Discussants - James Altschuld, The Ohio State University;
and Sue Hamann, National Institutes of Health
Evaluation 2010: Wednesday, November 10, 4:30 – 6:00 PM
Page 20
119 - Are Universal School-based Prevention
Programs Effective? It Depends on the Students and
Outcomes Targeted
MultiPaper to be held in Independence
Sponsored by the Human Services Evaluation TIG
 Chair - Wendy Garrard, University of Michigan
 Discussant - Ann Doucette, George Washington University
Second Step Violence Prevention: A Meta-analysis of Thirty
Treatment\Control Studies
 Stephanie Reich, University of California, Irvine; and
Wendy Garrard, University of Michigan
I Can Problem Solve: A Meta-analysis of 25 Treatment\Control
Studies
 Sarah Domoff, Bowling Green State University; Wendy
Garrard, University of Michigan; and Stephanie Reich,
University of California, Irvine
Conflict Resolution Education: A Meta-analysis of 60
Treatment\Control Studies
 Wendy Garrard, University of Michigan
120 - Innovative Applications of Propensity Scores
and Propensity Score Methodology Adjustments to
Address Data Constraints
Panel to be held in Presidio A
Sponsored by the Quantitative Methods: Theory and Design TIG
 Chair - Vajeera Dorabawila, New York State Office of
Children and Family Services
 Discussant - MH Clark, University of Central Florida
A Step-by-Step Application of Propensity Score Matching With
ACT Data
 Oksana Wasilik and Anita Drever, University of Wyoming
Multiple Imputation and Propensity Scores Matching to
Address Data Constraints in Constructing a Control Group to
Evaluate an Intervention to Reduce Recidivism of Juvenile
Delinquents Released From Residential Facilities
 Vajeera Dorabawila, Leigh Bates, Susan Mitchell-Herzfeld,
Therese Shady, and Do Han Kim, New York State Office of
Children and Family Services
An Innovative Use of Propensity Score Matching to Evaluate
Alcoholics Anonymous‘ Effect on Drinking
 Stephen Magura, Western Michigan University
121 – Organizational Learning and Evaluation
Capacity Building TIG Business Meeting and
Presentations: Advancing Quality in Evaluation
Capacity Building
Business Meeting to be held in Presidio B
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG
 TIG Leaders - Michelle Baron, The Evaluation Baron LLC;
Gary Skolits, University of Tennessee, Knoxville; Stephen J
Ruffini, Wested; Megan Bennett, Training Evaluation and Metrics
 Chairs - Michelle Baron, The Evaluation Baron LLC; and
Gary Skolits, University of Tennessee, Knoxville
Evaluation Capacity and Quality in Evaluation: Exploring
Interrelations
 Sebastian Lemire and Steffen Bohni Nielsen, Rambøll
Management Consulting
What, Me Evaluate? Building the Evaluation Capacity of
School District Personnel
 Patricia Lauer, Rocky Mountain Center for Health
Promotion and Education
122 - Integrating Realist Evaluation Strategies in a
Substance Abuse and Mental Health Services
Administration (SAMHSA) System of Care Local
Evaluation
Skill-building Workshop to be held in Presidio C
Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG
 Mansoor Kazi, State University of New York at Buffalo;
Connie Maples, ICF Macro; Rachel Ludwig, Chautauqua
Tapestry
123 – Roundtable in Bonham A
Sponsored by the Pre-K - 12 Educational Evaluation TIG
Evaluating the Effects of Year-Long Professional Development
on Teachers: Final Refinement of the University of California,
Los Angeles (UCLA) Center X and Social Research Methodology
(SRM) Evaluation Group Teacher Pre/Post Survey
 Nicole Gerardi and Janet Lee, University of California, Los
Angeles
124 - The Intersection of Strategy and Evaluation:
What Are We Learning?
Panel to be held in Bonham B
Sponsored by the Non-profit and Foundations Evaluation TIG
 Chair - Sarah Stachowiak, Organizational Research
Services
 Discussant - Julia Coffman, Center for Evaluation Innovation
Perspectives From Hallie Preskill, Foundation Strategy Group
(FSG) Social Impact Advisors
 Hallie Preskill, Strategic Learning & Evaluation Center
Perspectives From Lance Potter, Bill & Melinda Gates
Foundation
 Lance Potter, Bill & Melinda Gates Foundation
Strategy, Evaluation and Strategic Learning at the Packard
Foundation, Perspectives From Gale Berkowitz
 Gale Berkowitz, David and Lucile Packard Foundation
Perspectives From Mayur Patel, Knight Foundation
 Mayur Patel, John S and James L Knight Foundation
Perspectives From Organizational Research Services
 Sarah Stachowiak, Organizational Research Services
Perspectives from Tom Kelly, Annie E Casey Foundation
 Thomas Kelly, Annie E Casey Foundation
Evaluation 2010: Wednesday, November 10, 4:30 – 6:00 PM
Page 21
Wednesday, 4:30 pm to 6:00 pm, continued
125 - Managing Quality Through the Stages of
Science, Technology, Engineering and
Mathematics (STEM) Educational Evaluation
Panel to be held in Bonham C
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Leslie Goodyear, National Science Foundation
Planning for Quality: Balancing Partner Needs in a Multi-site
Evaluation of Science Education
 Ardice Hartry, University of California, Berkeley
Relation of Data Quality and Participant Burden in a Sciencecentered Leadership Evaluation Design
 Juna Snow, University of California, Berkeley
Not My Plan: Executing Someone Else‘s Analysis Design While
Balancing Partner Needs and Communicating Useable
Findings
 Ellen Middaugh, University of California, Berkeley
Attention to Quality in Reporting Evaluation Findings in STEM
Education Programs
 Bernadette Chi, University of California, Berkeley
126 - Evaluating Supplementary Programs in
Educational Settings
Multipaper to be held in Bonham D
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Sheila A Arens, Mid-Continent Research for
Education and Learning
 Discussant - Javan Ridge, Colorado Springs School
District 11
Aligning Evaluation Tools in Curriculum and Non-curriculumbased After School Programs
 Kelly Murphy, Tiffany Berry and Krista Collins, Claremont
Graduate University
Understanding Bullying Program Implementation
 Benjamin Cohen and Heather Cecil, Center for Schools
and Communities
The Playworks Evaluation: A Randomized Study of a Schoolbased Intervention to Promote Physical Activity and Play
 Daniel Finkelstein, Susanne James-Burdumy, and Martha
Bleeker, Mathematica Policy Research
Quality Assessment of Woodcraft Rangers After-School
Program: Challenges and Solutions
 Lisa Garbrecht, EVALCORP, Cathie Mostovoy, Woodcraft
Rangers; Julie Slay, Kristen Donovan, and Mona Desai,
EVALCORP
127 - Environmental and Energy Evaluations:
Strategies for Pursuing Innovative Approaches That
Demonstrate Impact, Promote Continuous
Improvement and Foster Organizational Learning
Multipaper to be held in Bonham E
Sponsored by the Environmental Program Evaluation TIG
 Chair - Mary McEathron, University of Minnesota
Adapting Interdisciplinary Methods to Evaluate the Social
Outcomes of Environmental Programs: Five Lessons from
Minnesota
 Karlyn Eckman, University of Minnesota; Erika Rivers,
Minnesota Department of Natural Resources; Kimberly
Nuckles, Minnesota Pollution Control Agency; Valerie Were,
University of Minnesota
Methodological Reflections and Organizational Learning
Generated by a Qualitative Evaluation of a Leadership
Development Program of the United States National Park
Service
 Jennifer Jewiss, University of Vermont; Daniel Laven and
Nora Mitchell, National Park Service
Continuous Improvement in Energy Efficiency: Helping Clients
Shift From One-Shot Evaluations Towards Assessing the
Effectiveness Within and Across Programs
 Marjorie McRae and Jane Peters, Research Into Action
128 - Standards of Evidence for Evaluating Extension
Programs: A Changing Picture?
Panel to be held in Crockett A
Sponsored by the Extension Education Evaluation TIG
 Chair - Nicki King, University of California, Davis
Randomized Trials in Extension Evaluation: How Big a Tool in
the Tool Chest?
 Marc Braverman, Oregon State University
Cooperative Extension Programs‘ Capacity to Produce
Evidence of Effectiveness
 Suzanne Le Menestrel, United States Department of
Agriculture
The Role of Evidence in Building Mature Program Theory
 Roger Rennekamp, Oregon State University
129 - Using an Interest-Driven Project to Teach
Program Planning and Evaluation
Demonstration to be held in Crockett B
Sponsored by the Teaching of Evaluation TIG
 David Diehl, University of Florida
Evaluation 2010: Wednesday, November 10, 4:30 – 6:00 PM
Page 22
130 - Networking and Getting Involved With the
American Evaluation Association
133 - Evaluation of the Clinical and Translational
Science Awards (CTSA) Programs: A Focus on Quality
Skill-building Workshop to be held in Crockett C
Sponsored by the Graduate Student and New Evaluator TIG
 Nicole Cundiff, University of Alaska, Fairbanks; and Cady
Berkel, Arizona State University
MultiPaper to be held in Crockett D
Sponsored by the Government Evaluation TIG
 Chair - Teserach Ketema, United States Department
of Labor
 Discussant - Richard Horne, United States Department
of Labor
Evaluation of Research Demonstration Programs: Self
Employment
 Richard Horne, United States Department of Labor
Cross-site Evaluation of Start-Up USA: Self-Employment for
People With Disabilities
 Doug Klayman, Social Dynamics LLC
Evaluation Methodology and Factors Contributing to
Entrepreneurial Success
 Laura F Skaff, Altarum Institute
Panel to be held in Republic B
Sponsored by the Health Evaluation TIG
 Chair - D Paul Moberg, University of Wisconsin
 Discussant - William M Trochim, Cornell University
Using the Program Evaluation Standards, Third Edition, to
Investigate and Improve CTSA Program Evaluation
 Emily Lai, Melissa Chapman, and Donald Yarbrough,
University of Iowa
External Advisory Committee Recommendations Incorporated
Into Utilization-Focused Evaluation
 Janice A Hogle, D Paul Moberg, and Christina Spearman,
University of Wisconsin, Madison; and Jennifer L Bufford,
Marshfield Clinic
In-depth Interviews With CTSA Investigators: Contributions to
Quality Evaluation
 Christine Weston and Jodi B Segal, Johns Hopkins
University
Linking Clinical and Translational Science Evaluation Purpose
to Quality
 Christine Minja-Trupin, Meharry Medical College
―And So It Is Written‖: Publication Data as a Measure of
Quality and the Quality of Publication Data as an Evaluative
Tool
 Cathleen Kane, Cornell University
132 - Evaluation and the Complexities of
International Financial Assistance Programs
134 - Round Robin Focus Groups: Participatory
Inquiry - From Data Gathering to Reporting in an Hour
131 - Informing Government Policy Through
Evaluation: A Cross-site Evaluation of the SelfEmployment Initiative (Start-Up USA)
Multipaper to be held in Republic A
Sponsored by the International & Cross-cultural Evaluation TIG
 Chair - Zenda Ofir, Evalnet South Africa
A Look Inside Development: What Do the Monitoring and
Evaluation Framework Designs of Foreign-Funded Urban
Development Programs in Metro Manilla, Philippines Reveal?
 Romeo Santos, University of the Philippines
Does Aid Evaluation Work? Meta-evaluation of Aid
Evaluation Quality
 Ryoh Sasaki, International Development Center of Japan;
Paul Clements, Western Michigan University; Michael Scriven,
Claremont Graduate University; and Liliana RodriguezCampos, University of South Florida
Evaluation of the Performance-based Concessionary
Resources Allocation Systems of the Multilateral Development
Banks and Funds
 Kenneth Watson, International Monetary Fund
Improving Development Evaluation Product Quality in Africa:
Experience From the African Development Bank
 Foday Turay, James Edwin, Mohamed Manai, and Colin
Kirk, African Development Bank
Doing Better at Doing Well by Doing Good: Evaluating Corporate Social Responsibility Projects in Developing Countries
 Catherine Elkins, RTI International
Skill-building Workshop to be held in Republic C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Cynthia Tananis, and Cara Ciminillo, University of
Pittsburgh
Wednesday, 6:10 pm to 6:40 pm
First Time Attendee and New Member Orientation
Orientation to be held in Lone Star A
Join us for this short orientation to the conference and the
association in order to make the most of the event. We will
then proceed to the evening‘s reception and poster exhibition.
Evaluation 2010: Wednesday, November 10, 4:30 – 6:00 PM, 6:10 – 6:40 PM
Page 23
Wednesday, 6:30 pm to 8:00 pm
137 - Opening Reception, Poster
Exhibition, and Meet the Authors
Exhibition to be held in Texas A
Admission to the Reception and Poster
exhibition is included in conference
registration. All attendees are encouraged to attend, to view
the work represented in over 150 poster presentations, to meet
the authors at our author tables, and to build your professional
network in this social setting. This is the most widely attended
event of the conference and we hope to see you there.
Colleagues from the Visitor Studies Association will be
performing a live demonstration during the Poster Exhibition –
look for their display at the front of the ballroom to learn more
Evaluation in Action Skill-building: Tracking and Timing With
the Visitor Studies Association
 Cheryl Kessler, Independent Consultant; Joe E Heimlich,
Ohio State University; Carey Tisdal, Tisdal Consulting; Cláudia
Figueiredo, Institute for Learning Innovation; and Kathleen
Tinworth, Denver Museum of Nature & Science
Poster 1: A Quantitative Approach to Program Dosage and
Fidelity for Substance Abuse and Mental Health Treatment
Programs
 Robert Orwin, Westat; Carrie Petrucci, Evaluation,
Management & Training Associates Inc; and Timothy Ho,
University of California, Los Angeles
Poster 2: Strategies for Quantitative Analysis of Student and
Teacher Longitudinal Outcomes in K-12 Settings
 Amy Overbay, Melinda Mollette, and Shevaun Neupert,
North Carolina State University
Poster 3: Using Network Analysis in the Evaluation of
Community Partnership Building
 Heather Clark, Monica Wendel, and Corliss Outley, Texas
A&M University
Poster 4: Evaluating Nursing Education at the Program Level
 Susan Forneris, Suellen Campbell, Vicki Schug, Linda
Blazovich, Suzanne Lehman, and Linda Blazovich, St Catherine
University
Poster 5: Using Technology to Improve Collaboration and
Stakeholder Communication
 Anna de Guzman, Laricia Longworth-Reed, and Kathryn
Schroeder, University of Denver
Poster 6: Conducting Comprehensive Workforce Assessments
of Public and Tribal Child Welfare Agencies: Lessons Learned
 Kathryn Schroeder, Laricia Longworth-Reed, Anna de
Guzman, Sheridan Green, Julie Morales, Robin Leake,
University of Denver; and Joe Walker, Native American Training
Institute
Poster 7: The DoView Generic Outcomes Model for a Country: A
Generic Outcomes Model From Which You Can Borrow Parts to
Quickly Build Your Own Outcomes Models (Logic Models)
 Paul Duignan, Parker Duignan Consulting
Poster 8: How to Quickly Assess the Quality of Any Performance
Indicator List
 Paul Duignan, Parker Duignan Consulting
Poster 9: Best Practices for Web-based Surveys
 Deborah K Lewis, Ohio State University
Poster 10: Educator Sexual Abuse in Virginia: A Policy Study
 Billie-Jo Grant, University of Virginia
Poster 11: The Impact of Food Supplementation on Infant
Weight Gain in Rural Bangladesh: An Assessment of the
Bangladesh Integrated Nutritional Program (BINP)
 Begum Housne, University of Dhaka; and Mascie Taylor,
University of Cambridge, United Kingdom
Poster 12: Evaluation and Organizational Learning and Use
 Fahad Khan, Catholic Relief Services
Poster 13: The Matthew Effect: Enhancing Internal Evaluation
Credibility Using an External Regulatory Instrument
 William Cabin, Richard Stockton College
Poster 14: Strategies and Principles Which Guide the Work of
the Staff in Branco Weiss Schools for Youth at Risk: What Have
We Learned From Our Successes and Identifying Future
Challenges?
 Chen Lifshitz and Michal Yaacov, Branco Weiss Institute
Poster 15: Lessons Learned in the School Evaluations: An
Evaluation of a Counter-Marketing Student-Led Campaign to
Decrease Sedentary Behavior and Fast Food Intake Among
Fourth and Fifth Grade Students
 Mary Martinasek and Karen Perrin, University of South
Florida; and Marisa Mowat and Melanie Hall, St Joseph's
Children's Advocacy Center; Dewey Carouthers, 180 Degree
Change
Poster 16: Methods of Monitoring and Evaluation of
Community Projects
 Ngole Masango Eugene, Non-governmental Organization
(NGO)
Poster 17: Dimensions in Self-Assessment Research
 Tony Lam, University of Toronto
Poster 18: Heroin Dependent Offenders‘ Assessment of
Buprenorphine Versus Methadone Treatment in Jail
 Ezechukwu Awgu and Stephen Magura, Western Michigan
University; Andrew Rosenblum, National Development and
Research Institutes (NDRI)
Poster 19: An Evaluation Coaching Model That Encourages
Prolonged Stakeholder Involvement
 Tania Rempert, University of Illinois at Urbana-Champaign
Poster 20: Are Natural Family Planning Methods Viable Birth
Control Options? Providers and Clients Perspectives
 Afsaneh Rahimian, Karen Deluhosh, Sarah Goldenkranz,
and David Fine, Center for Health Training
Evaluation 2010: Wednesday, November 10, 6:30 – 8:00 PM Exhibition
Page 24
Poster 21: Leading in the New Learning Ecology: A Leadership
Framework for Technology Innovation Projects in Schools
 Jenifer Corn, North Carolina State University
Poster 22: Iterative Reasoning: The Art of Determining Good
Enough
 Karen Zannini Bull, Syracuse University
Poster 23: The Critical Role of Process Evaluation in Telling the
Story
 Linda Winges, Battelle Memorial Institute; Margaret J
Gunter, LCF Research; Judith Lee Smith, Centers for Disease
Control and Prevention; Katarzyna Alderman, Gary Chovnick,
and Susan Pearce, Battelle Memorial Institute; April Salisbury,
LCF Research; Deirdre Shires, Henry Ford Health System;
Danuta Kasprzyk and Daniel Montano, Battelle Memorial
Institute; and Jennifer Elston Lafata, Virginia Commonwealth
University
Poster 24: External Validity: Documenting Replicability and
Transferability in Technology Programs
 Meghan Morris and Kevin Murphy, State University of New
York at Albany
Poster 25: Using Qualitative Methods to Assess Effectiveness
of a Public-Private Collaboration to Ensure Healthy and Active
Living Through Land Use
 Marina Kaplan, Patricia Miller, and Gregory Benjamin,
Nemours Health and Prevention Services
Poster 26: Healthy Eating and Physical Activity Policy and
Practice Changes in Delaware Schools: 2006 - 2008
 Gregory Benjamin, Vonna Drayton, and Zhongcui Gao,
Nemours Health and Prevention Services
Poster 27: Caught in the Middle: Turning Around Middle
School Performance
 Gary Timko, Community Research Partners
Poster 28: Participatory Evaluation for Organizational Learning
in an Inquiry-based Chemistry Laboratory Curriculum
 Hui-Jung Chen and Mei-Hung Chiu, National Taiwan
Normal University
Poster 29: Evaluation of a Social Justice Leadership Institute in
Higher Education: Learning From the First Year
 Nicole Cundiff, University of Alaska, Fairbanks; Roy Joy,
Jennifer Beckjord, and Andrea Coulter, Southern Illinois
University Carbondale
Poster 30: Economic Analysis of National Research and
Development (R&D) Program Developing a Geostationary
Satellite: The Case of Korea
 Yoon Been Lee, Jiyoung Park, and Jiho Hwang, Korea
Institute of Science & Technology Evaluation and Planning
(KISTEP)
Poster 31: Developing Quality Assessments of Observational
Research
 John Pfaff, Fordham Law School
Poster 32: An Evaluation of a Capacity Building Performance
Management Project: Results From the First Two Years
 Lauren Decker and Leslie Grunden, Edvance Research
Poster 33: New Logic Model Approach
 Fayez Shafloot, Western Michigan University
Poster 34: Embracing the Context of Pediatric Rehabilitation
Programs: A Survey Investigating the Role of Family-Centered
Philosophy in Program Evaluation
 Katherine Moreau and J Bradley Cousins, University of
Ottawa
Poster 35: Using Case Studies to Assess Promising Practices
and Lessons Learned in Comprehensive Evaluations of Multilevel Tobacco Control and Childhood Obesity Interventions
 Jenica Huddleston, University of California, Berkeley
Poster 36: Evaluation is a Program Requirement, Now, How Do
You Ensure Quality? Evaluation Technical Assistance: An
Approach for Center for Disease Control and Prevention's
(CDC) National Heart Disease and Stroke Prevention Program
 Eileen Chappelle and Diane Dunet, Centers for Disease
Control and Prevention
Poster 37: Overcoming Authoritarian Approach to School
Evaluation: Systemic Change Towards Democratization - Polish
Case
 Grzegorz Mazurkiewicz, Jagiellonian University
Poster 38: Applying Program Evaluation Standards to Improve
Education Through Meta-evaluation: The Brazilian Experience
 Thereza Penna-Firme and Ana Carolina Letichevsky,
Cesgranrio Foundation
Poster 39: Creating Sustainable Structural Changes in State
Mental Health and Substance Abuse Systems: Findings From
the National Evaluation of the Substance Abuse and Mental
Health Services Administration‘s (SAMHSA) Co-occurring State
Incentive Grant Program
 John Hornik, Advocates for Human Potential
Poster 40: The Importance of Context in Understanding Career
Academies: A Case Study Approach
 Bridget Cotner, Maressa Dixon, Margaret Allsopp, TashaNeisha Wilson, Margeaux Chavez, and Kathryn Borman,
University of South Florida
Poster 41: National Institute of Environmental Health Sciences
(NIEHS) Small Grants: Do They Lead Down the Intended Path?
 Jerry Phelps and Elizabeth Ruben, National Institute of
Environmental Health Sciences; Joshua D Schnell and Duane E
Williams, Discovery Logic
Poster 42: The Road to Behavior Change is Both Bumpy and
Smooth: Barriers and Facilitators of Patient Safety Training
Outcomes
 Kristina Moster, Stacey Farber, and Britteny Howell,
Cincinnati Children's Hospital Medical Center
Poster 43: Using Bibliometric Information for Benchmarking
and Research and Development (R&D) Portfolio Management
 Brian Zuckerman, Science and Technology Policy Institute;
and Kevin Wright and Brandie Taylor, National Institutes of
Health
Evaluation 2010: Wednesday, November 10, 6:30 – 8:00 PM Exhibition
Page 25
Poster 44: Evaluation Capacity Building at the National
Institute of Allergy and Infectious Diseases (NIAID): One Block
at a Time
 Brandie K Taylor, Tarsha McCrae, and Kevin Wright,
National Institutes of Health
Poster 45: One Central Florida School District‘s Efforts to Help
Struggling Readers: An Evaluation of the Effectiveness of the
READ 180 Reading Intervention Program on Student
Achievement and Student Perceptions on Reading
 Yakup Bilgili, Polk County Public Schools
Poster 46: Evaluating Program Impact in Alignment With
Cultural Expectations of Success
 Leigh D'Amico and Robert Petrulis, University of South
Carolina; and Cynthia Bolton-Gary, University of South
Carolina, Beaufort
Poster 47: Lessons Learned Coordinating Evaluations of Multisite Community-based Initiatives
 Laurie Carpenter and Martha Quinn, University of
Michigan
Poster 48: Using Mixed Methods to Develop and Evaluate a
Safe-Ride Program for Tweens
 Krystall Dunaway, Kelli Will, and Edward Lorek, Eastern
Virginia Medical School
Poster 49: The Texas Strategic Prevention Framework State
Incentive Grant (SPF-SIG): How the Keep It Simple Stupid
(KISS) Principle Works in Evaluation
 Daniel Jorgensen, Texas A&M University
Poster 50: Effect of Read180 Program on Incarcerated Youth‘s
Reading Performance: An Evaluation Study
 Weijia Ren, William Loadman, Raeal Moore, Jing Zhao,
Deborah Kwon, and Charles Okonkwo, The Ohio State
University
Poster 51: Using Developmental Evaluation to Inform
Development of a Complex Education Program
 Gretchen Biesecker, City Year Inc; Belle Brett, Brett
Consulting Group; Kathryn Race, Race & Associates Ltd; and
Dannalea D'Amante, City Year Inc
Poster 52: A Person-Oriented Approach to Evaluation: Profiles
of Young Adult Volunteers in a National Nonprofit
 Gretchen Biesecker and Tavia Lewis, City Year Inc
Poster 53: Enhancing Evaluation Capacity of a Tribal Juvenile
Justice Program: Evaluating Creating Restitution and Following
Traditions (C.R.A.F.T.)
 Melissa Boeke, Minnesota Institute of Public Health; and
Sharon Rosebear, Red Lake Band of Chippewa Indians
Poster 54: Assessing Reasons for High School Dropout:
Dropout Typologies
 Stacey Merola, Allan Porowski, and Kazuaki Uekawa, ICF
International
Poster 55: From Smolt to Salmon Project: Lessons Learned
From a Culturally Responsive Mentoring Project
 Annie Woo, Education Northwest
Poster 56: Evaluating the Effectiveness of Warning Systems in
Extreme Weather Events
 Brandi Gilbert, Liesel Ritchie, and Alexandra Jordan,
University of Colorado, Boulder
Poster 57: Understanding the Structure and Operations of
State Offices in a Large-Scale Youth-Serving Organization: A
Multi-state Study of Communities In Schools
 Heather Clawson, Aikaterini Passa, and Sarah Decker, ICF
International; and Susan Siegel, Communities In Schools
Poster 58: Put Your Money Where Your Fat is: Evaluating
Healthy Communities Funding and Obesity Rate Patterns,
2000-2010
 Dave Brewington and Andrea Lee, YMCA of the USA
Poster 59: Exploring Technology Access and Adoption With
Low-Income Families
 Carlin Llorente, Ann House, Gabe Novais, Patrik Lundh,
and Vera Michalchik, SRI International
Poster 60: Using Collaborative Evaluation Approaches to
Improve Implementation and Understanding of a 3-D Virtual
World Initiative in Schools
 Nita Matzen, Appalachian State University; Rita
O'Sullivan, University of North Carolina at Chapel-Hill; Sean
Williams, Clemson University; and Lauren Kendall and
Johnavae Campbell, University of North Carolina at Chapel-Hill
Poster 61: Evaluation Techniques to Assess Behavioral
Changes Related to the Adoption of Best Management
Practices by New Landowners
 Philip Shackelford, Theresa Murphrey, and Jeff Ripley,
Texas A&M University
Poster 62: Measuring Treatment Outcomes Across Two
Substance Abuse Treatment Programs for Adults and
Adolescents
 Charles Brown, Gisoo Barnes, and Catherine Sewall,
Centerstone Research Institute
Poster 63: Evaluation of Online Extension Programs for
Improvement and Accountability: Challenges and Alternatives
 Koralalage Jayaratne, North Carolina State University
Poster 64: Teaching an Evaluation Graduate Course: Use of
Learning Assessment as a Teaching Strategy
 Koralalage Jayaratne, North Carolina State University
Poster 65: Developing Core Competence Indicators for General
Education
 Che-Hao Liu, National Normal University; and Chin-Wen
Chang, National Applied Research Laboratories
Poster 66: On Q: Promoting Quality in Basic Education Through
Positive Incentives
 Monika Schaffner, Planning and Learning Technologies
Inc; and Abdel-Kareem Badran, National Center for
Examinations & Educational Evaluation
Poster 67: Strengthening Impact Evaluation Quality in Africa
Through Partnerships: A Pathway to Sustainable Development
 Winston Allen, Heartlands International
Evaluation 2010: Wednesday, November 10, 6:30 – 8:00 PM Exhibition
Page 26
Poster 68: Improving Effectiveness of Household Treatment of
Diarrhea of Young Children in Nepal: Increasing Use of Zinc to
Reduce Severity of Diarrhea While Maintaining Use of Oral
Rehydration Solution (ORS) to Reduce Dehydration – Results
From a Population-based Household Survey
 Prakash Dev Pant, N-MARC Project; and Lonna B Shafritz
and Peter Oyloe, Academy for Educational Development
Poster 69: Using Archival Public School Data In Cross-State
Evaluations
 Philip Nickel and Dennis Johnston, AVID Center
Poster 70: Experiences of Program Personnel From an Intimate
Partner Violence Prevention Program
 Lennise Baptiste, Kent State University
Poster 71: An Empirical Study to Develop and Pilot an
Instrument to Validate the Essential Competencies for
Evaluators
 Yuanjing Xue and Jean A King, University of Minnesota;
and Laurie Stevahn, Seattle University
Poster 72: Adherence to the Directly Observed Treatment
Short-Course's (DOTs) Strategy: An Evaluative Approach From
Actors Perspective
 Gisela Cardoso, National School of Public Health
(ENSP/Fiocruz), Marly Cruz, and Pedro Paulo Chrispim,
National School of Public Health (ENSP/Fiocruz), Dolores
Abreu, Laboratório de Avaliação de Situações Endêmicas
Regionais; and Paula Vita Decotelli, and Juliana Borenstein,
National School of Public Health (ENSP/Fiocruz)
Poster 73: Effectiveness Evaluation of Brazilian Nongovernmental Organizations (NGO) STD/AIDS Prevention
Programs Targeting Men Who Have Sex With Men
 Marly Cruz, National School of Public Health
(ENSP/Fiocruz); Elizabeth Moreira dos Santos, Oswaldo Cruz
Foundation (Fiocruz); Paula Vita Decotelli, Sonia Santos,
Raquel Torres, and Ana Reis, National School of Public Health
(ENSP/Fiocruz)
Poster 74: Using the Leprosy Control Program Evaluation in a
Timely
 Elizabeth Moreira dos Santos, Oswaldo Cruz Foundation
(Fiocruz); Maria Aparecida Patroclo, Rafaela Souza, Ana Reis,
and Gisela Cardoso, National School of Public Health
(ENSP/Fiocruz)
Poster 75: A Commented Review on Cost-Effectiveness of
Directly Observed Treatment (DOTs) in Tuberculosis Control
Programs
 Pedro Paulo Chrispim, National School of Public Health
(ENSP/Fiocruz); Luisa Oliveira, Fluminense Federal University;
and Elizabeth Moreira dos Santos, Oswaldo Cruz Foundation
(Fiocruz)
Poster 76: Implementation Evaluation of the Disability
Prevention in Leprosy in the Cabo Frio, Rio de Janeiro, Brazil
 Rafaela Souza, National School of Public Health
(ENSP/Fiocruz); Elizabeth Moreira dos Santos, Oswaldo Cruz
Foundation (Fiocruz); and Marly Cruz, National School of Public
Health (ENSP/Fiocruz)
Poster 77: Evaluation of the Implementation of an Education
Program in Nutrition in Order to Control Obesity in Rio De
Janeiro
 Aline Leal, National School of Public Health
(ENSP/Fiocruz); and Elizabeth Moreira dos Santos, Oswaldo
Cruz Foundation (Fiocruz); and Marly Cruz, National School of
Public Health (ENSP/Fiocruz)
Poster 78: Performance Evaluation of a Cervical Cancer
Screening Program: An Integrated Model for Local Analysis at
Rio De Janeiro, Brazil
 Oliveira Thais, Elizabeth Moreira dos Santos, and Marly
Cruz, Oswaldo Cruz Foundation
Poster 79: Are Workshops Effective? Assessing the Quality and
Impact of Evaluation Training Workshops in New Zealand
 Jeffery Adams and Pauline Dickinson, Massey University
Poster 80: The Critical Role of Data Use in Instructional
Improvement and Innovation
 Xinsheng Cai, Daniel Aladjem, Sarah Bardack, and
Victoria R Marks, American Institutes for Research
Poster 81: A Birdseye View of One Community‘s Success in
Preventing and Ending Homelessness
 Margot Ackermann, Homeward
Poster 82: Evaluating School-based Arts Integration Projects:
Opportunities and Challenges
 Elaine Walker and Martin Finkelstein, Seton Hall
University; and Carmine Tabone, Education Arts Team
Poster 83: A Tool for Monitoring and Evaluating Pre-service
Teachers in Field Experiences
 Susan Hibbard, Robert Triscari, and Diane Kratt, Florida
Gulf Coast University
Poster 84: Conducting Anonymous Focus Groups: Escaping
Politics and Bias?
 Susan Hibbard, Florida Gulf Coast University
Poster 85: Improving Evaluation Quality: Challenges for
Evaluating Community Initiatives During Economic Downturns
 Brandy Pratt, Diane Rogers, and Mohammed Alyami,
Western Michigan University
Poster 86: Evidence-based Guidelines: Evaluating Diffusion in
State Tobacco Control Programs
 Max Bryant, Stephanie Herbers, Lana Wald, Douglas Luke,
and Jennifer Hobson, Washington University in St Louis
Poster 87: So Much Information, So Little Time: Evaluating the
Impact of Using Brief Addiction Curriculum Infusions as a
Teaching Method in Criminal Justice, Nursing, and Social Work
Courses
 Joyce Hartje, Nancy Roget, and Michelle Berry, University
of Nevada, Reno
Poster 88: Assessing the Quality of Instrumentation Using IRT
 Kristina Mycek and Susan Rogers, State University of New
York at Albany
Poster 89: Teaching Program Evaluation to Novices: Steps,
Pitfalls, and Lessons Learned
 Susan Rogers, State University of New York at Albany
Evaluation 2010: Wednesday, November 10, 6:30 – 8:00 PM Exhibition
Page 27
Poster 90: Development of an Implementation Fidelity
Framework: Implications for District-wide Multi-classroom
Interventions
 Cindi Dunn and Sheryl Hodge, Kansas State University
Poster 91: Investigation Into Delivery Modes of Adult
Education Programs by a Cooperative Extension
 Jane A Rodd and Dianna L Newman, State University of
New York at Albany
Poster 92: Developing an Objective Measuring of Tempo
Consistency
 Tara Pearsall, Savannah College of Art and Design
Poster 93: Linking Communities to Advance Evaluation
Capacity Building in Historically Black Colleges and
Universities (HBCUs)
 Ruth Greene, Johnson C Smith University
Poster 94: Implementation Fidelity of Environmental
Strategies: The Strategic Prevention Framework – State
Incentive Grant (SPF-SIG) Experience
 Phillip Graham and A Monique Clinton-Sherrod, RTI
International
Poster 95: Comparing Comparisons: Contrasting EthnicSpecific Factor Coefficient Weighted Depression With the
Invariant Unit-Weight Measure and Comparing Puerto-Rican
and African-American Elderly on on Depression Development
Processes
 Emil Coman and Jay Schensul, Institute for Community
Research
Poster 96: Assessing the Impact of Career Academies on
Student Achievement
 Becky Smeardon, Frances Burden, and Aimee Evan, Quill
Research Associates; Rheta Lanehart, University of South
Florida; and Kellie Kim, Quill Research Associates
Poster 97: Impact of School Based Evaluation on Learning
Outcomes
 Undurthy Lakshmi Narayana, Regional Institute of
Education
Poster 98: Assessing the Impact of a National Teacher
Evaluation Pilot Program
 Hui-Ling Pan, National Taiwan Normal University
Poster 99: Enhancing the Quality of a National Multi-site
Evaluation Through Involvement of Site Participants
 Frances Lawrenz, University of Minnesota
Poster 100: The Strategy for Implementation of Evaluation
Methods in the Specific Conditions of Universities for the
Increase of Evaluation Culture and Successful Implementation
of Their Development Projects: The Case Study of Institute of
Tropics and Subtropics in the Czech University of Life Sciences
in Prague, Czech Republic (ITS CULS)
 Jirina Svitakova, Czech University of Life Sciences
Poster 101: How Much Do HIV/AIDS Service Providers
Evaluate Their Programs?
 Kylie Hutchinson, Community Solutions Planning &
Evaluation; and Bubli Chakraborty and Francisco IbanezCarrasco, Provincial Health Services Authority of Bristish
Columbia
Poster 102: Workable Strategies for Assessing Change Among
Health Care Professionals Following Continuing Education
 Heather Becker, University of Texas, Austin; and Kristin
Hamlett, Nurse Oncology Education Program
Poster 103: Using an Empowerment Approach to Plan and
Evaluate a Sexual Health Education Summit for Minority Teens
 Lynn Chen, Adama Brown, and Heather Becker, University
of Texas, Austin
Poster 104: Approach: Analysis of Needs Assessments to
Assess Availability of Mental Health and Substance Abuse
Services for HIV Infected Individuals in Texas
 Michele Rountree and Lynn Chen, University of Texas,
Austin
Poster 105: The Amazing You: An External Evaluation of
Museum-based Exhibits About the Human Body
 Wendy Dickinson, Ringling College of Art and Design;
Bruce Hall, University of South Florida; and Dave Conley,
Museum of Science and Industry
Poster 106: A-Tv-S-Gv Capacity in Cherokee Community
Organizations
 Mark Parman, Cherokee Nation; dn Ronetta Briggs, O Si
Yo Communications
Poster 107: The Assessment of a Professional Development
Workshop: Emic and Etic Perspectives on Junior Faculty
Experiences
 Deborah Bennett and Susan Geier, Purdue University
Poster 108: The Evaluation of the Geology, Environmental
Science and Meteorology (GEM) Scholar Program: A
Participatory Approach
 Susan Geier, Deborah Bennett, and Suzanne M ZurnBirkhimer, Purdue University
Poster 109: An Evaluation of the Introduction of Concurrency
Concepts Across a Four-Year Postsecondary Curriculum
 Melissa Yale and Deborah Bennett, Purdue University
Poster 110: An Evaluation Study of a Multicultural Student
Mentoring Program
 Kai Chi Yam, Gitanjali Shrestha, and Laura Hill,
Washington State University
Poster 111: The Role of Exploratory Factor Analysis in
Evaluation
 Kai Chi Yam, Brian French,and Laura Hill, Washington
State University
Poster 112: Examining Aspirations and Expectations for Youth
in Foster Care: An Evaluation of Kansas Kids at Gaining Early
Awareness and Readiness for Undergraduate Programs (GEAR
UP)
 Rhonda Lewis-Moss, Chris Kirk, Corinne Nilsen, and Delta
Q Colvin, Wichita State University
Evaluation 2010: Wednesday, November 10, 6:30 – 8:00 PM Exhibition
Page 28
Poster 113: Challenges and Good Practices in Evaluating AntiChild Labor and Basic Education Programs Worldwide
 Mary Anne Anderson, ICF Macro International
Poster 114: Three Levels of Change on a Retrospective Post as
a Program Improvement Tool
 Paul Pope, Texas A&M University
Poster 115: Another Side of Program Effectiveness: Percent
Potential Improvement
 Paul Pope, Texas A&M University
Poster 116: Educational Evaluation‘s History: Present and
Future in Mainland China
 Gang Wu and Huihua He, Shanghai Normal University
Poster 117: Evaluating Social Media Use and Nonprofits‘
Quest for Effectiveness
 Kristen Cici, University of Minnesota
Poster 118: Evaluating Communities of Practice in Academic
Medicine
 Dorene Balmer, Boyd Richards, and Rita Charon,
Columbia University
Poster 119: Evaluating Social Networks using InFlow and
Network Genie
 Oliwier Dziadkowiec, Trisha Peaster and Scott Wituk,
Wichita State University
Poster 120: A Cost Analysis of the Tandem Teen Parenting
Program
 Toni Watt, Texas State University
Poster 121: Energy Program Evaluation Building Blocks
 Lark Lee and Laura Schauer, PA Consulting Group
Poster 122: Using Systems Engineering Tools to Inform a
Geographic Needs Assessment
 Angela Snyder and Natalie Towns, Georgia State
University; and Christina Scherer, Southern Polytechnic State
University
Poster 123: A Statewide Evaluation of Supplemental
Educational Services (SES) Programming: Challenges and
Lessons Learned
 Pamela B Finney, Melissa Williams, and Alexa Edwards,
University of North Carolina at Greensboro
Poster 124: Informing Truth Through Formative Evaluation: A
Needs Assessment of One Federally Funded Homeless
Education Center
 Alexa Edwards and Lynn Amwake, University of North
Carolina at Greensboro
Poster 125: Process Evaluation of Data Collection and
Reporting Systems for United States Environmental Protection
Agency Office of Brownfields and Land Revitalization
 David Shellard, SRA International Inc
Poster 126: Optimizing the Baseline Phase of a Pay for
Performance Multi-Year Evaluation in the Federal Government
 Heather Prather and Sarah Johnson, United States Office
of Personnel Management
Poster 127: Promoting Sound Evaluation Practices in the Field
of Suicide Prevention
 Philip Rodgers, American Foundation for Suicide
Prevention
Poster 128: Longitudinal Changes in Capacity and Readiness
to Provide Training and Technical Assistance (TA): Developing
Effective TA Providers
 Catherine Lesesne, Duane House, Kristin Brown, Kim
Burley, and Ndidi Nwangwu, Centers for Disease Control and
Prevention
Poster 129: Evaluation of the Satisfaction Level Among
Pregnant Patients Who Attended the Prenatal Care Clinics in a
Teaching Hospital
 Ida Sanabria and Ruth Ríos, University of Puerto Rico
Poster 130: Evaluation and Adjustment of Performance
Evaluation System in a Middle-Size East European Industrial
Organization
 Jana Kotrcova, University of Saskatchewan
Poster 131: Enhancing Traditional and Innovative Approaches
to Advanced Composition in Academic Disciplines
 Maria Jimenez and Ayesha Boyce, University of Illinois at
Urbana-Champaign
Poster 132: A Crucial Issue of Evaluation: Technological
Universities Reevaluation in Taiwan
 Shu-Hui Tseng and Shu-Ping Juan, National Taipei
University of Technology
Poster 133: Facilitating Data Interpretation With Preschool
Teachers
 Juanita Pelt and Joel Philp, The Evaluation Group
Poster 134: Measuring and Reporting on School Climate in a
Rigorous Magnet Evaluation
 Bianca Montrosse, Western Carolina University; Jane Meli
and Holli Bayonas, University of North Carolina at Greensboro
Poster 135: Evaluation of Adherence to AIDS Treatment in
Patients Suffering Variation in the Distribution of Body Fat Due
to Lypodistrophy
 Rachel Baccarini, Ministry of Health of Brazil
Poster 136: Using Propensity Scores and the National
Educational Longitudinal Survey, 88:2000, to Evaluate the
Effectiveness of Upward Bound Programs
 Bradley Coverdale, University of Maryland, College Park
Poster 137: Disproportionality in the Child Welfare System:
Using Geographic Information Systems (GIS) to Evaluate
Differences in Child Welfare Outcomes
 Virginia Dick, University of Georgia
Poster 138: Parents as Reporters on Program Effectiveness:
The Need to Disaggregate by Parent and Child Characteristics
 Tiffany Berry, Susan Menkes, and Desiree Nangle,
Claremont Graduate University
Poster 139: The Development and Validation of an Evaluation
Tool Designed to Measure the Distinctive Needs of High School
Students After School
 Tiffany Berry and John Coffey, Claremont Graduate
University
Evaluation 2010: Wednesday, November 10, 6:30 – 8:00 PM Exhibition
Page 29
Poster 140: Connecting Evaluation Quality and Object
Effectiveness: Evaluative Inquiry Practice Patterns in a High
Performing School
 Kathryn Hill, Minnesota Office of Higher Education
Poster 141: Using Evaluation to Strengthen Program Quality in
New Models of Teacher Preparation
 Edith Stevens, ICF Macro
Poster 142: Using Observational Methods and Geographic
Information Systems (GIS) to Evaluate Relationships Between
Physical and Social Environmental Features and Community
Walking
 Duncan Meyers and Dawn Wilson, University of South
Carolina
Poster 143: Two-Year Evaluation of an Initiative Designed to
Encourage Young Women to Seek Engineering Careers: The
Engineer Your Life Initiative
 Christine Paulsen and Christopher Bransfield, Concord
Evaluation Group LLC
Poster 144: A Culturally Sensitive Community-Participative
Program to Promote Minority Support for HIV/AIDS Vaccine
Research: A Social Networking Approach
 Robin Kelley, National Minority AIDS Council
Poster 145: Strengths, Weaknesses, Opportunities, Threats
(SWOT) Improving Evaluation Quality by Engaging Community
Agencies in the Evaluation Process
 Korinne Chiu and Kelly Graves, University of North Carolina
at Greensboro
Poster 146: Technology-Enabled Evaluation: Advantages and
Disadvantages
 Kristy Jang, Arwa Alkhalaf and Sandra Mathison,
University of British Columbia
Poster 147: Meta-evaluation Model for Assessing Evaluations
of Professional Development Programs
 Julie Sexton, University of Northern Colorado; Leslie Reid,
University of Calgary; and Erin Dokter, University of Arizona
Poster 148: Assessing Context and Culture to Evaluate Sexual
Health Programs for African American Youth in Metropolitan
Atlanta
 Tabia Henry Akintobi, Cagney Stigger, Nastassia Laster,
DeBran Jacobs, and Donoria Evans, Morehouse School of
Medicine; and Jennie Trotter, Tarita Johnson, Melody Jackson,
Jewel Crawford, and Audra Woodard, Wholistic Stress Control
Institute Inc
Poster 149: Impact of Support on Application of Training
 Sandhya Rao Hermon and Steven Torkel, Pricewaterhouse
Coopers LLP
Poster 150: Finding the Right Target: The Case for Informal
Science Education
 Chris Caveny-Cox and Benjamin Silliman, North Carolina
State University
Poster 151: Mapping Teacher Education Evaluative Use to
Evaluation Use Standards
 Georgetta Myhlhousen-Leak, University of Iowa
Poster 152: Assessing Individual Substance Use Based on
Information from Multiple Data Sources: Lessons for
Evaluation About Understanding and Reconciling Differences
 Lynn Wallisch, Thomas Bohman, and Kristin Christensen,
University of Texas, Austin; and Dena Stoner, Texas
Department of State Health Services
Poster 153: Linking Evaluation Quality and Program
Implementation: A Quasi-Study of A National Implementation
 Melissa Rivera and Scott Steger, National Center for
Prevention and Research Solutions
Poster 154: Evaluating Teachers‘ Use of Technology for
Improving High School Academic Achievement: A Multi-level
Analysis
 George Chitiyo, Jamie Coburn, Diana Wood, Tennessee
Technological University
Poster 155: Randomized Control Evaluation of a Farm Safety
Intervention: Using Theory of Planned Behavior for Changing
Power-Take Off (PTO) Related Behaviors of Youth on Farms
 Haminda JIinnah-Ghelani and Zolinda Stoneman,
University of Georgia
Poster 156: The Program Might Work, but Does it Fit the
Context? Looking at One Special Education Leadership
Program in Terms of National Policy and Research Priorities
 Matthew Linick, Cristin Geoghegan, Kim Wolowiec-Fisher
and Daniel Araya, University of Illinois at Urbana-Champaign
Poster 157: Monitoring and Evaluation Network to Control
Tuberculosis in Brazil
 Verônica Machado, Independent Consultant; Claudia
Fonseca, Independent Consultant
Poster 158: Constructivist Success Case Method (SCM): An
Alternative Use of the SCM for the Evaluation of New Initiatives
 Julien Kouame, Western Michigan University
Poster 159: Quality Evaluation and Dynamic Initiatives: Mixing
Methods and Creativity
 Shaunti Knauth, National Louis University; and Maryann
Durland and John Durland, Durland Consulting
Poster 160: Striving for a Safer Campus Alcohol Environment:
A Process Evaluation
 Jason Black, Daniel Reilly, and Jennifer Morrow, University
of Tennessee, Knoxville
Poster 161: Metaphors We Evaluate By: Randomized
Controlled Trials and the Definition of Evaluands
 Aaron Pannone and Walter Heinecke, University of Virginia
Poster 162: Evaluating Recidivism and Risk Factors of Juvenile
Offenders Participating in Jail Diversion Programs
 Xuan Stevens, Florida International University; Jesus
Perez, Lou Panci, Citrus Health Network; and Nicole DavisWhite, Family Resource Center of South Florida
Poster 163: The Importance of Using Multiple Metrics to
Investigate a Single Program Goal
 Carl Westine, Lori Wingate, and Arlen Gullickson, Western
Michigan University
Evaluation 2010: Wednesday, November 10, 6:30 – 8:00 PM Exhibition
Page 30
Poster 164: Co-constructing Knowledge in Participatory
Evaluation: A Case Study of Logic Model Development for a
Power-based Community Organization
 Charles Collins and Tiffeny Jimenez, Michigan State
University
Poster 165: Decision Process for Integration of Design and
Methods
 Jason Burkhardt and Lee Balcom, Western Michigan
University
Poster 166: Evaluating the Diffusion and Implementation of
Health Policies Within and Across School Districts
 Jennifer Mortensen, Michigan State University
Poster 167: Revisiting the Post Plus Retrospective Pretest: Its
Use in Evaluating a National Health Training Program for
Health Care Professionals
 Elaine Cohen, National Parkinson Foundation; Gladys
Gonzalez-Ramos, New York University; and Ruth Hagestuen,
National Parkinson Foundation
Poster 168: The Value of Impact Statements to Evaluate
Participants‘ Experience in a National Interdisciplinary Training
Program for Health Care Professionals
 Elaine Cohen, National Parkinson Foundation; Gladys
Gonzalez-Ramos, New York University; Ruth Hagestuen,
National Parkinson Foundation
Poster 169: A Culturally Responsive Evaluation of a Historically
Black Colleges and Universities (HBCU) Health Service
 April Waterford, Anthony Fluellen, Pamela FrazierAnderson, and Kevin E Favor, Lincoln University
Poster 170: Learning From Change: A Collaborative Evaluation
of a Community-Focused Cancer Outreach Program
 Carolla Belle, and Lokman Akbay, Huaye Li, and Jane-Van
Trumpet, University of South Florida
Poster 171: Overcoming Barriers: A Case Study in a Program
Evaluation of Alcohol and Other Drug Abuse Outpatient
Treatment
 Linda Jourdan and Lora Warner, University of Wisconsin,
Green Bay
Poster 172: Essential Nutrition Action (ENA) in Bangladesh:
Using Administrative Data to Show Evidence of Impact
 Jillian Waid, Washington University in St Louis
Poster 173: Assessing the Quality of the Program: Preparation
for Work in Southern Mexico
 Miguel Sosa-Molina and Edith J Cisneros-Cohernour,
University of Yucatan
Poster 174: A Review of Three Decades of Evaluations of
Research Center and Network Programs at the National
Institutes of Health: Lessons Learned and Recommendations
for Future Evaluations
 Jack Scott and Margaret Blasinsky, The Madrillon Group
Inc; Brooke Stipelman, Kara Hall, Amanda Vogel, and Annie
Feng, National Institutes of Health; and Dan Stokols, University
of California, Irvine
Poster 175: A Multi-method Evaluation of a Large National
Institutes of Health-Funded Transdisciplinary Research and
Training Center Program
 Annie Feng, Amanda Vogel, Kara Hall, and Brooke
Stipelman, National Institutes of Health; and Dan Stokols,
University of California, Irvine
Poster 176: Building Multi-cultural and Cross-Cultural Aspects
of Evaluation Through a Values-based Holistic Community
Development Model: Sixty Years of Heifer International‘s
Experiences in International Development
 Tererai Trent, Western Michigan University
Poster 177: Deconstructing Caribbean Masculinity to End
Domestic Violence
 Cecilia Hegamin-Younger, TUI University; and Rohan
Jeremiah, St George's University
Evaluation 2010: Wednesday, November 10, 6:30 – 8:00 PM Exhibition
Page 31
Notes:
Evaluation 2010: Wednesday, November 10, 6:30 – 8:00 PM Exhibition
Page 32
Thursday, November 11, 2010: Overview of Schedule
7:00 am to 6:30 pm
Registration Desk Open
8:00 am to 8:45 am
Plenary Session
9:15 am to 10:45 am
Concurrent Conference Sessions
10:55 am to 12:25 pm
Concurrent Conference Sessions
12:35 pm to 1:30 pm
AEA Business Meeting
1:40 pm to 3:10 pm
Concurrent Conference Sessions
3:35 pm to 4:20 pm
Concurrent Conference Sessions
4:30 pm to 6:00 pm
Concurrent Conference Sessions
6:10 pm to 7:00 pm
TIG Business Meetings and Socials
My Schedule and Notes:
Evaluation 2010: Thursday, November 11
Page 33
Summary of Sessions for Thursday, November 11, 9:15 AM to 10:45 AM
No Primary Sponsor
Session
Session Title
Room
202 Presidential Strand
Panel
Rigor at Stake: Quality Evaluation of Change and Impact in a Complex World
Lone Star A
203 Program Theory and Theory-driven Eval TIG
Panel
Implementation From the Ground Up: Defining, Promoting, and Sustaining Fidelity at All Levels of a State Program
Lone Star B
204 Collaborative, Participatory & Empowerment
MultiPaper
The Essential Features of Collaborative, Participatory, and Empowerment Evaluation
Lone Star C
205 Non-profit and Foundations Evaluation TIG
Think Tank
Nonprofit Rating Systems and Implications for Evaluation
Lone Star D
206 Quantitative Methods: Theory and Design TIG
Panel
Comparative Effectiveness Research in Program Evaluation
Lone Star E
207 Cluster, Multi-site & Multi-level Evaluation TIG Panel
Serving Two Masters: Local Evaluators Trying to Maintain Evaluation Quality and Use While Participating in a National…
Lone Star F
208 Graduate Student and New Evaluator TIG
Roundtable
Rotation I: Truth, Beauty, and Justice for All: A Conversation With Graduate Students Examining Issues of Power, Control…
Rotation II: The Role of Evaluation and Research Support in Ensuring Evaluation Quality
Mission A
209 Social Work TIG
Multipaper
Evaluating the Intervention: A Look at Clinical Treatments and Client Implications
Mission B
210 Systems in Evaluation TIG
MultiPaper
Using a Multi-stage, Mixed Methods Approach to Improve the Design of System Change Evaluations
Bowie A
211 Multiethnic Issues in Evaluation TIG
Think Tank
Third Annual Asa G. Hilliard III Think Tank on Culture and Evaluation
Bowie B
212 Advocacy and Policy Change TIG
Multipaper
Maintaining Quality in Challenging Contexts
Bowie C
213 Teaching of Evaluation TIG
Roundtable
Rotation I: Engaging Social Justice in a Graduate Course on Program Evaluation
Rotation II: Issues of Quality: Guiding Principles for Culturally Competent Teaching and Practice
Goliad
214 Integrating Technology Into Evaluation
Roundtable
Rotation I: Using Technology for Efficiency in Evaluation
Rotation II: Integrating Website Use Analytics into a Mixed Method Evaluation of a Professional Development Website
San Jacinto
216 Evaluation Managers and Supervisors TIG
Demonstration
Project Management Software: An Important Multi-Purpose Tool in an Evaluation Unit‘s Toolbox
Travis B
217 Org Learning & Evaluation Capacity Bldg TIG
Demonstration
Assessing Evaluation Capacity: Using the Evaluation Capacity Diagnostic Tool
Travis C
218 Evaluating the Arts and Culture TIG
Multipaper
Improving Evaluation Quality Through and In the Arts
Travis D
219 Human Services Evaluation TIG
MultiPaper
Mixed-Method Evaluation in Human Services Settings
Independence
220 Quantitative Methods: Theory and Design TIG
Multipaper
Back to the Basics and Beyond
Presidio A
221 Org Learning & Evaluation Capacity Bldg TIG
Skill-building
The Power of Metaphor: Using Images for Organizational Analysis
Presidio B
222 Alcohol, Drug Abuse, and Mental Health TIG
Multipaper
Evaluation of Youth Mental Health and Substance Abuse Interventions
Presidio C
223 Pre-K - 12 Educational Evaluation TIG
Roundtable
Rotation I: Learning About Educational Reform From a Seven-Year Math-Science Partnership
Rotation II: When Quality and Policy Collide in Evaluating Math-Science Partnership Programs: Strategies for Resolution
Bonham A
224 Non-profit and Foundations Evaluation TIG
Multipaper
How Did You Do It? Implementing Performance Measurement and Monitoring Systems
Bonham B
225 Pre-K - 12 Educational Evaluation TIG
Multipaper
Evaluating K-8 Literacy Programs: Methods and Models
Bonham C
226 Pre-K - 12 Educational Evaluation TIG
Multipaper
Methods Leading to Higher Quality Evaluations in Education Evaluation
Bonham D
Evaluation 2010: Thursday, November 11, 9:15 – 10:45 AM
Page 34
Summary of Sessions for Thursday, November 11, 9:15 AM to 10:45 AM, Continued
No Primary Sponsor
Session
Session Title
Room
227 Collaborative, Participatory & Empowerment
Panel
Enhancing the Quality of Evaluation Through Collaboration Among Funders, Programs, and Evaluators…
Bonham E
228 Government Evaluation TIG
Panel
Methodological Choices in Assessing the Quality and Strength of Evidence on Effectiveness
Texas A
229 Theories of Evaluation TIG
Panel
Evaluating With Validity: Truth, Justice, and the Beautiful Way
Texas B
230 Mixed Methods Evaluation TIG
Multipaper
Dealing With Technical Challenges in Mixed Methods Evaluation
Texas C
231 Research, Technology, and Development Eval
Panel
Analysis and Evaluation of Research Portfolios Using Quantitative Science Metrics: Practice
Texas D
232 Evaluation Use TIG
Demonstration
Why Evaluators Need Graphic Design Skills
Texas E
233 Research on Evaluation
Panel
New Directions for Research on Evaluation
Texas F
234 AEA Conference Committee
Think Tank
Respecting and Protecting Boundaries: Social Evaluation Competencies
Crockett A
235 Business and Industry TIG
Panel
Evaluation Utilization and the Story of the Federal Railroad Administration‘s 10 Year Research and Development Effort…
Crockett B
236 International and Cross-cultural Evaluation TIG Think Tank
Assessing Impacts in Real World Evaluations: Alternatives to the Conventional Statistical Counterfactual
Crockett C
237 Government Evaluation TIG
Evaluation and Quality: Examples From Government
Crockett D
238 International and Cross-cultural Evaluation TIG Multipaper
Navigating the Intricacies of Culture and Context in International Program Evaluation
Republic A
239 Health Evaluation TIG
Think Tank
Evaluating Health Program Sustainability: Improving the Quality of Methods and Measures
Republic B
240 Collaborative, Participatory & Empowerment
Demonstration
Using a Practical Lens to Develop National-Level Participatory Projects
Republic C
Multipaper
Evaluation 2010: Thursday, November 11, 9:15 – 10:45 AM
Page 35
Thursday, 8:00 am to 8:45 am
200 - Interdisciplinary Perspectives on
Evaluation Quality
Plenary to be held in Texas A
Sponsored by the Presidential Strand
 Chair - Rodney Hopson,
Duquesne University
 Discussant - James Earl Davis, Temple University
 Presenters - Psyche Williams-Forson, University of
Maryland; and Crispin Sartwell, Dickinson College
Thursday, 8:45 am to 9:15 am – Coffee Break!
Thursday, 9:15 am to 10:45 am
202 - Rigor at Stake: Quality Evaluation of Change
and Impact in a Complex World
Panel to be held in Lone Star A
Sponsored by the Presidential Strand
 Chair - Indran Naidoo, Office of the South
African Public Service Commission
 Discussant - Patricia Rogers, Royal
Melbourne Institute of Technology
Impact Evaluation: Serving Development?
 Zenda Ofir, Evalnet South Africa
The Social Transformation of Evaluation?
 Thomas Schwandt, University of Illinois at UrbanaChampaign
Rigorous Evaluative Practice That Embraces Complexity:
Reflections from ‗Evaluation Revisited‘
 Irene Guijt, Learning by Design
203 - Implementation From the Ground Up: Defining,
Promoting, and Sustaining Fidelity at All Levels of a
State Program
Panel to be held in Lone Star B
Sponsored by the Program Theory and Theory-driven
Evaluation TIG
 Chair - Elizabeth Oyer, EvalSolutions Inc
Understanding State-level Program Impact: Leveraging State
Policies and Resources for Effective Implementation
 Elizabeth Oyer, EvalSolutions Inc; and Marica Cullen and
Gilbert Downey, Illinois State Board of Education
Understanding the Forest by Examining the Trees: Creating
Profiles of Local Grantees to Develop Themes in Implementation
of a State Mathematics and Science Partnership Program
 Tania Jarosewich, Censeo Group and Debra Greaney, Area
V Learning Technology Center
Measuring Implementation and Building Adherence: Assessing
Fidelity and Improving Understanding in an Illinois
Mathematics and Science Program
 James Salzman, Ohio University
204 - The Essential Features of Collaborative,
Participatory, and Empowerment Evaluation
MultiPaper to be held in Lone Star C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Chair - Abraham Wandersman, University of South Carolina
Collaborative Evaluation Essentials: Highlighting the Essential
Features of Collaborative Evaluation
 Liliana Rodríguez-Campos, University of South Florida;
and Rita O'Sullivan, University of North Carolina at Chapel-Hill
Participatory Evaluation Essentials: Highlighting the Essential
Features of Participatory Evaluation
 Lyn Shulha, Queen's University at Kingston
Empowerment Evaluation Essentials: Highlighting the Essential
Features of Empowerment Evaluation
 David Fetterman, Fetterman & Associates; and Abraham
Wandersman, University of South Carolina
205 - Nonprofit Rating Systems and Implications for
Evaluation
Think Tank to be held in Lone Star D
Sponsored by the Non-profit and Foundations Evaluation TIG
 Debra Natenshon, The Center for What Works; and
Johanna Morariu, Innovation Network
206 - Comparative Effectiveness Research in
Program Evaluation
Panel to be held in Lone Star E
Sponsored by the Quantitative Methods: Theory and Design TIG
 Chair - James Michael Menke, University of Arizona
Epistemological and Methodological Issues in Comparative
Effectiveness Research
 Lee Sechrest, University of Arizona
Comparisons and Second Order Comparisons of Comparisons
 James Michael Menke, University of Arizona
Comparative Effectiveness in Educational Settings
 Katherine McKnight, Pearson Corporation
Comparing Tobacco Control Interventions
 Frederic Malter, University of Arizona
207 - Serving Two Masters: Local Evaluators Trying to
Maintain Evaluation Quality and Use While
Participating in a National Multi-site Evaluation
Panel to be held in Lone Star F
Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG
 Chair - Thomas Kelly, Annie E Casey Foundation
 Discussant - Mary Achatz, Westat
Evaluation 2010: Thursday, November 11, 8:00 – 8:45 AM, 9:15 – 10:45 AM
Page 36
Two Bosses, Two Clients, Two Timetables: Local Evaluators‘
Challenges in Meeting Expectations of Community Partners
and National Funder and Evaluators
 Sue Tripathi, Making Connections, Denver
Building Local Evaluation Capacity of Coalition Partners
 Sebastian Schreiner, City of San Antonio
Defining and Measuring Community Engagement at Local and
National Levels
 Tanja Kubas-Meyer, Independent Consultant
Using Qualitative Methods to Identify System Dynamics and
Inform System Evaluation Design
 Margaret Hargreaves, Mathematica Policy Research
Using Quantitative Research Methods in Evaluations of
Simple, Organized Systems
 Heather Koball, Mathematica Policy Research
Applying Social Network Analysis to Evaluations of
Complicated Systems
 Todd Honeycutt, Mathematica Policy Research
208 – Roundtables in Mission A
211 - Third Annual Asa G. Hilliard III Think Tank on
Culture and Evaluation
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Graduate Student and New Evaluator TIG
Rotation 1: Truth, Beauty, And Justice For All: A Conversation
With Graduate Students Examining Issues of Power, Control,
and Evaluation Quality Within the Realm of Graduate
Assistantships
 Ayesha Boyce, Maria Jimenez, Jeehae Ahn, and Holly
Downs, University of Illinois at Urbana-Champaign
Rotation 2: The Role of Evaluation and Research Support in
Ensuring Evaluation Quality
 Laricia Longworth-Reed, Kathryn Schroeder, and Anna de
Guzman, University of Denver
209 - Evaluating the Intervention: A Look at Clinical
Treatments and Client Implications
Multipaper to be held in Mission B
Sponsored by the Social Work TIG
 Chairs - Derrick Gervin, The Evaluation Group; Jenny Jones,
Virginia Commonwealth University
Evaluating the Implementation of a Trauma-Informed and
Human Rights Curriculum in a School of Social Work
 Thomas H Nochajski and Bincy Wilson, State University of
New York at Buffalo
Exploring Behavioral Health Perceptions of United States Army
Chaplains: Incorporating Quality From Conceptualization to
Conclusion
 Kimberly Farris, United States Army
Integrating Realist Evaluation in Social Work Practice
 Mansoor Kazi, State University of New York at Buffalo
Evaluating Mental Health Instruments Within a Cultural
Context
 Maureen Rubin and Goutham Menon, University of Texas,
San Antonio
210 - Using a Multi-stage, Mixed Methods Approach
to Improve the Design of System Change Evaluations
MultiPaper to be held in Bowie A
Sponsored by the Systems in Evaluation TIG
 Chair - Beth Stevens, Mathematica Policy Research
Think Tank to be held in Bowie B
Sponsored by the Multiethnic Issues in Evaluation TIG
 Presenter - Cindy A Crusto, Yale University
 Discussants- Julie Nielsen, NorthPoint Health and
Wellness Center Inc; Katherine A Tibbetts, Kamehameha
Schools; Joanne Farley, Human Development Institute; Jenny
Jones, Virginia Commonwealth University; and Itihari Toure,
The Jegna Collective
212 - Maintaining Quality in Challenging Contexts
Multipaper to be held in Bowie C
Sponsored by the Advocacy and Policy Change TIG
 Chair - Julia Coffman, Center for Evaluation Innovation
Quality Seems to Be the Hardest Word: How One United
Kingdom (UK) Funder Uses Evaluation to Achieve Policy Change
 Andrew Cooper, Diana, Princess of Wales Memorial Fund
Building the Advocacy Evaluation Capacity of Community
Coalitions: Lessons Learned From the Northwest Community
Changes Initiative
 Ronda Zakocs, Independent Consultant; Christopher
Kabel, Northwest Health Foundation; Noelle Dobson,
Community Health Partnership; and Susan Briggs,
Independent Consultant
Agent-based Modeling as a Tool for Evidence-based Public
Policy Analysis
 Andrea Hegedus and Jay Schindler, Northrop Grumman
Corporation
213 – Roundtables in Goliad
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Teaching of Evaluation TIG and the
Multiethnic Issues in Evaluation TIG
Rotation 1: Engaging Social Justice in a Graduate Course on
Program Evaluation
 Leanne Kallemeyn, Loyola University, Chicago
Rotation 2: Issues of Quality: Guiding Principles for Culturally
Competent Teaching and Practice
 Arthur Hernandez, Texas A&M University; and JoAnn Yuen,
University of Hawaii, Manoa
Evaluation 2010: Thursday, November 11, 9:15 AM – 10:45 AM
Page 37
Thursday, 9:15 am to 10:45 am, continued
214 – Roundtables in San Jacinto
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Integrating Technology Into Evaluation TIG
Rotation 1: Integrating Website Use Analytics into a Mixed
Method Evaluation of a Professional Development Website
 Randahl Kirkendall, Ellen Iverson, and Monica Bruckner,
Carleton College
Rotation 2: Using Technology for Efficiency in Evaluation
 Marycruz Diaz and Donna Winston, WestEd
Employee Satisfaction and Retention in Human Services
 Erin Farr and John Lodge, Wright State University
Program Evaluation of a Youth Partial Hospitalization Program
 Dustin Hamilton and Stephanie Gemmer, Wright State
University
220 - Back to the Basics and Beyond
Demonstration to be held in Travis C
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG
 Lande Ajose, BTW Informing Cchange; and Kristi Kimball,
William and Flora Hewlett Foundation
Multipaper to be held in Presidio A
Sponsored by the Quantitative Methods: Theory and Design TIG
 Chair - Raymond Hart, Georgia State University
Consequences of Violating Fundamental Assumptions of the
Central Limit Theorem in Evaluation and Research Practice
 Raymond Hart, Georgia State University
The Chi-Square Test: Often Used and More Often
Misinterpreted
 Todd Franke and Christina Christie, University of
California, Los Angeles
Data Reduction and Classification Decisions: Using a Factor
Analytic Approach to Examine Exemplary Teaching
Characteristics
 Sheryl Hodge and Jan Middendorf, Kansas State
University; Linda Thurston, National Science Foundation; and
Cindi Dunn, Kansas State University
Estimating Program Impact Using the Bloom Adjustment for
Treatment No-Shows: Evaluation of a Literacy Intervention With
Hierarchical Linear Modeling
 Jing Zhu, Jonathan Tunik, and Alan Simon, Metis
Associates
218 - Improving Evaluation Quality Through and In
the Arts
221 - The Power of Metaphor: Using Images for
Organizational Analysis
216 - Project Management Software: An Important
Multi-Purpose Tool in an Evaluation Unit‘s Toolbox
Demonstration to be held in Travis B
Sponsored by the Evaluation Managers and Supervisors TIG
 Stacey Farber, Tracy Gnadinger, and Janet Matulis,
Cincinnati Children's Hospital Medical Center
217 - Assessing Evaluation Capacity: Using the
Evaluation Capacity Diagnostic Tool
Multipaper to be held in Travis D
Sponsored by the Evaluating the Arts and Culture TIG
 Chair - Ashlee Lewis, University of South Carolina
 Discussant - Debra Smith, Lesley University
Arts Integration to Enhance Learning Outcomes
 Dawson Hancock, University of North Carolina at Charlotte
The Potential for Arts-Informed Inquiry in Educational Program
Evaluation
 Michelle Searle, Queen's University at Kingston
State of the Arts: Evaluation of a K-12 Arts Education Program
 Janet Mahowski, University of South Florida
219 - Mixed-Method Evaluation in Human Services
Settings
MultiPaper to be held in Independence
Sponsored by the Human Services Evaluation TIG
 Chair - Cheryl Meyer, Wright State University
Program Evaluation of Multidisciplinary Training on Trauma
Informed Care
 Jessica Heschel and Anne Willis, Wright State University
Skill-building Workshop to be held in Presidio B
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG
 Maggie Huff-Rousselle and Bonnie Shepard, Social
Sectors Development Strategies
222 - Evaluation of Youth Mental Health and
Substance Abuse Interventions
Multipaper to be held in Presidio C
Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG
 Chair - Melissa Rivera, National Center for Prevention and
Research Solutions
Out-of-Home Treatment for Youth With Mental Health Needs
and Juvenile Justice Involvement
 John Robst, Mary Armstrong, and Norin Dollard, University
of South Florida
Establishing Quality Evaluation Methods in New Terrain:
Lessons Learned From a Social Host Ordinance Impact
Evaluation
 Kristen Donovan, Shanelle Boyle, and Julie Slay,
EVALCORP, and Dan Hicks, Ventura County Behavioral Health
Department
Evaluation 2010: Thursday, November 11, 9:15 AM – 10:45 AM
Page 38
Reducing School Violence to Improve Mental Health and
Scholastic Achievement in New Orleans High Schools
 Marsha Broussard and Lisanne Brown, Louisiana Public
Health Institute; Paul Hutchinson and Nathalie Ferrell, Tulane
University; and Sarah Kohler Chrestman, Louisiana Public
Health Institute
Evaluation of School Counseling Programs in Rural Middle
Tennessee
 Randall Reiserer, Ajanta Roy, and Brad Martin,
Centerstone Research Institute
225 - Evaluating K-8 Literacy Programs: Methods
and Models
Sponsored by the Pre-K - 12 Educational Evaluation TIG and
the Independent Consulting TIG
Rotation 1: Learning About Educational Reform From a SevenYear Math-Science Partnership
 Cynthia Tananis, Cara Ciminillo, Tracy Pelkowski, Keith
Trahan, Yuanyuan Wang, Gail Yamnitzky, and Rebecca Price,
University of Pittsburgh
Rotation 2: When Quality and Policy Collide in Evaluating
Math-Science Partnership Programs: Strategies for Resolution
 MaryLynn Quartaroli, Professional Evaluation &
Assessment Consultants; and Hollace Bristol, Coconino County
Education Services Agency
Multipaper to be held in Bonham C
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Andrea Beesley, Mid-continent Research for
Education and Learning
 Discussant - Lizanne Destefano, University of Illinois at
Urbana-Champaign
Challenges to the Utility of Evaluation of Early Elementary
Tutoring and Learning Support Services
 Magdalena Rood and Cindy Roberts-Gray, Third Coast
R&D Inc
Evaluation of Reading Intervention Effectiveness Using Growth
Models
 Tammiee Dickenson, University of South Carolina; and
Jennifer Young, South Carolina Department of Education
Impact of READ180 on At-Risk Middle School Students‘
Literacy Outcomes
 Margaret Gheen and Shahpar Modarresi, Montgomery
County Public Schools
Evaluating Professional Development Training in Early Literacy:
Alternatives for Measuring Participant Use of New Skills Post
Training– Use of Action Plans and Levels of Use Indicators
 Ann Zukoski, Rainbow Research Inc; Joanne Knapp-Philo,
National Head Start Family Literacy Center; and Kim Stice,
National Head Start Family Literacy Center
224 - How Did You Do It? Implementing Performance
Measurement and Monitoring Systems
226 - Methods Leading to Higher Quality Evaluations
in Education Evaluation
Multipaper to be held in Bonham B
Sponsored by the Non-profit and Foundations Evaluation TIG
 Chair - Eric Barela, Partners in School Innovation
Monitoring and Evaluation (M&E) at Room to Read: Concepts
and Practice in an International Non-Profit Educational
Organization
 Michael Wallace, Rebecca Dorman, and Peter Cooper,
Room to Read
Approach to Performance Measurement and Effectiveness of
the Children‘s Investment Fund Foundation
 Nalini Tarakeshwar, Peter McDermott, Anna Hakobyan,
and Tomohiro Hamakawa, Children's Investment Fund
Foundation
A Strategic Planning Case Study: Implementing a Data
Dashboard for a Nonprofit Board‘s Self-Evaluation, Monitoring,
and Evidence-based Decision Making
 Veronica Smith, data2insight
Building and Implementing a Performance Management
System to Inform Evaluation: Lessons Learned
 Eric Barela, Partners in School Innovation
Multipaper to be held in Bonham D
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Tom McKlin, The Findings Group LLC
 Discussant - Anane Olatunji, Fairfax County Public Schools
Maturation Effects of Multi-cycle Initiatives: The Importance of
Time Sensitive Indicators When Evaluating Impact
 Lindsey Rosecrans and Kathy Gullie, State University of
New York at Albany
Enhancing Evaluation Quality of Programs Serving Youth: Data
Collection Strategies and Ethical Issues
 Katherine LaVelle, Five Acres; and Tiffany Berry, Susan
Menkes, and Krista Collins, Claremont Graduate University
Impacts of Comprehensive Teacher Induction: Results From
the Second Year of a Randomized Controlled Study
 Eric Isenberg, Steven Glazerman, Martha Bleeker, Amy
Johnson, Julieta Lugo-Gil, Mary Grider, and Sarah Dolfin,
Mathematica Policy Research; and Edward Britton, WestEd
Using a Mixed Methods Design to Identify Exemplary College
Access Centers in Texas High Schools
 Jacqueline Stillisano, Hersh Waxman, Yuan-Hsuan Lee,
Kayla Braziel Rollins, Rhonda Goolsby, and Chyllis Scott, Texas
A&M University
223 – Roundtables in Bonham A
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Evaluation 2010: Thursday, November 11, 9:15 AM – 10:45 AM
Page 39
Thursday, 9:15 am to 10:45 am, continued
227 - Enhancing the Quality of Evaluation Through
Collaboration Among Funders, Programs, and
Evaluators: The Example of the New York City Health
Bucks Program Evaluation
Panel to be held in Bonham E
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Chair - Jan Jernigan, Centers for Disease Control and
Prevention
The Intersection of Quality and Collaboration: From a Funder's
Perspective
 Gayle Payne and Jan Jernigan, Centers for Disease Control
and Prevention
The Intersection of Quality and Collaboration: From a
Program's Perspective
 Sabrina Baronberg, New York City Department of Health
and Mental Hygiene
The Intersection of Quality and Collaboration: From an
Evaluator's Perspective
 Yvonne Abel, Lauren Olsho, Debbie Walker, Cristina
Booker, Jacey Greece, Cheryl Hewitt, and Leah Staub-DeLong,
Abt Associates Inc
228 - Methodological Choices in Assessing the
Quality and Strength of Evidence on Effectiveness
Panel to be held in Texas A
Sponsored by the Government Evaluation TIG
 Chair - Valerie J Caracelli, United States Government
Accountability Office
Comparing the Top Tier Evidence Approach to Other Systematic
Evidence Reviews
 Stephanie Shipman and Valerie J Caracelli, United States
Government Accountability Office
Methodological Considerations in Selecting Programs for the
Model Programs Guide
 Marcia Cohen, Development Services Group Inc
National Registry of Evidence-based Programs and Practices
Approach to Evaluating the Evidence
 Kevin Hennessy, United States Department of Health and
Human Services
The Evidence-based Practice Centers: A National Approach to
Systematically Assessing Evidence of
Effectiveness of Health Care Interventions
 Jean Slutsky, United States Department of Health and
Human Services
229 - Evaluating With Validity: Truth, Justice, and the
Beautiful Way
Panel to be held in Texas B
Sponsored by the Theories of Evaluation TIG
 Chair - James Griffith, Claremont Graduate University
 Discussant - Ernest House, University of Colorado
Truth, Beauty, and Justice: Conceptualizing House‘s
Framework for Evaluation in Community-based Settings
 Katrina Bledsoe, Walter R McDonald and Associates Inc
Truth, Beauty, and Justice: The Best Way to Spot a Real,
Genuine, Authentic Evaluation?
 Jane Davidson, Real Evaluation Ltd
Whose Roots? Pushing the Justice Envelope in Evaluation
 Rodney Hopson, Duquesne University
230 - Dealing With Technical Challenges in Mixed
Methods Evaluation
Multipaper to be held in Texas C
Sponsored by the Mixed Methods Evaluation TIG
 Chair - Virginia Dick, University of Georgia
 Discussant - Susan Labin, Independent Consultant
A Mixed Methods Toolkit for Evaluating Translational Science
Education Programs
 Julie Rainwater and Stuart Henderson, University of
California, Davis
The Tale of Two Mixed Methods Projects
 Jori Hall, University of Georgia; and Katherine Ryan,
University of Illinois at Urbana-Champaign
231 - Analysis and Evaluation of Research Portfolios
Using Quantitative Science
Panel to be held in Texas D
Sponsored by the Research, Technology, and Development
Evaluation TIG
 Chair - Laurel Haak, Discovery Logic
Practical Applications of Bibliometrics: What Makes Sense in
Different Contexts?
 Frédéric Bertrand and David Campbell, Science-Metrix
Corporation
Applying Metrics to Evaluate the Continuum of Research
Outputs: Near to Long-term Impact
 Joshua Schnell, Beth Masimore, Laurel Haak, Matt
Probus, and Michael Pollard, Discovery Logic
232 - Why Evaluators Need Graphic Design Skills
Demonstration to be held in Texas E
Sponsored by the Evaluation Use TIG
 Stephanie Evergreen, Western Michigan University
Evaluation 2010: Thursday, November 11, 9:15 AM – 10:45 AM
Page 40
233 - New Directions for Research on Evaluation
Panel to be held in Texas F
Sponsored by the Research on Evaluation TIG
 Chair - John LaVelle, Claremont Graduate University
Research on Evaluation Context: Examples and Ideas
 Michael Szanyi, Claremont Graduate University
Research on Evaluation Consequences: A Meta-analysis of
Evaluation Use
 Mark Hansen and Anne Vo, University of California, Los
Angeles
Research on Professional Issues in Evaluation: Next Steps
 John LaVelle, Claremont Graduate University
234 - Respecting and Protecting Boundaries: Social
Evaluation Competencies
Think Tank to be held in Crockett A
Sponsored by the AEA Conference Committee
 Presenter - Phyllis Clay, Albuquerque Public Schools
 Discussants - Ranjana Damle, River Dunavin, Debra
Heath, and Nancy Carillo, Albuquerque Public Schools
235 - Evaluation Utilization and the Story of the
Federal Railroad Administration‘s 10 Year Research
and Development Effort to Change Safety Culture in
the United States Rail Industry
Panel to be held in Crockett B
Sponsored by the Business and Industry TIG
 Chair - Michael Quinn Patton, Utilization-Focused
Evaluation
 Discussant - Deborah Bonnet, Fulcrum Corporation
High Quality Evaluation Utilization as a Method to Improve
Safety Culture Change in the United States Railroad Industry:
Challenges, Opportunities, Failures, and Success
 Michael Coplen, United States Department of
Transportation
Overview of Safety Culture Evaluation Designs
 Jonathan Morell, Vector Research Center; and Joyce
Ranney and Michael Zuschlag, Volpe National Transportation
Systems Center
Empirical Findings of Safety Culture Initiatives: Data Sources,
Analyses, and Findings
 Joyce Ranney and Michael Zuschlag, Volpe National
Transportation Systems Center; and Jonathan Morell, Vector
Research Center
Promoting Industry-wide Impact: Safety Culture Policy, Current
Accomplishments, and Plans for the Future
 Stephanie Morrow, Volpe National Transportation Systems
Center; Michael Coplen, United States Department of
Transportation; and Joyce Ranney, Volpe National
Transportation Systems Center
236 - Assessing Impacts in Real World Evaluations:
Alternatives to the Conventional Statistical
Counterfactual
Think Tank to be held in Crockett C
Sponsored by the International & Cross-cultural Evaluation TIG
 Presenter - Michael Bamberger, Independent Consultant
 Discussant - Jim Rugh, Independent Consultant; Megan
Steinke, Save the Children; and J Bradley Cousins, University of
Ottawa
237 - Evaluation and Quality: Examples From
Government
Multipaper to be held in Crockett D
Sponsored by the Government Evaluation TIG
 Chair - Sam Held, Oak Ridge Institute for Science and
Education
The Long and Winding Road: How the Integration of Evaluation
Performance Measures and Results Can Lead to Better Quality
Evaluations
 Gale Mentzer, University of Toledo
The External Reviewer's Role in Helping to Promote Evaluation
Quality: Examples From the Government Accountability
Office's (GAO) Recent Experience
 Martin de Alteriis, United States Government
Accountability Office
Evaluating Data Quality in the Veterans Health Administration
All Employee Survey
 Katerine Osatuke, Scott C Moore, Boris Yanovsky, and Sue
R Dyrenforth, United States Department of Veterans Affairs
Employment and Training Administration: Increased Authority
and Accountability Could Improve Evaluation and Research
Program
 Kathleen White and Ashanta Williams, United States
Government Accountability Office
238 - Navigating the Intricacies of Culture and
Context in International Program Evaluation
Multipaper to be held in Republic A
Sponsored by the International & Cross-cultural Evaluation TIG
 Chair - Mary Crave, University of Wisconsin
Personalizing Outcomes: Feasibility and Utilization of
Individual Goal-Setting in an International Context
 Melissa Velazquez, Christian Foundation for Children and
Aging
Do Evaluation Frameworks Support Equity and Social Justice?
Lessons Learned in East Central and South-Eastern Europe
 Linda E Lee and Larry K Bremner, Proactive Information
Services Inc
Evaluation 2010: Thursday, November 11, 9:15 AM – 10:45 AM
Page 41
Thursday, 9:15 am to 10:45 am, continued
239 - Evaluating Health Program Sustainability:
Improving the Quality of Methods and Measures
Think Tank to be held in Republic B
Sponsored by the Health Evaluation TIG and the Non-profit and
Foundations Evaluation TIG
 Mary Ann Scheirer, Scheirer Consulting
240 - Using a Practical Lens to Develop NationalLevel Participatory Projects
Demonstration to be held in Republic C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Tobi Lippin, New Perspectives Consulting Group; Thomas
McQuiston, Tony Mazzocchi Center for Health, Safety and
Environmentt; and Kristin Bradley-Bull, New Perspectives
Consulting Group
Evaluation 2010: Thursday, November 11, 9:15 AM – 10:45 AM
Page 42
Notes:
Evaluation 2010: Thursday, November 11, 9:15 AM – 10:45 AM
Page 43
Summary of Sessions for Thursday, November 11, 10:55 AM to 12:25 PM
No Primary Sponsor
Session
Session Title
Room
242 Presidential Strand
Think Tank
Cultural Competency in Evaluation: Discussion of the American Evaluation Association's Public Statement…
Lone Star A
243 Program Theory and Theory-driven Eval TIG
Multipaper
Improving the Practice of Theory-driven Evaluation: Understanding the Role of Stakeholders and Context in Evaluation…
Lone Star B
244 Collaborative, Participatory & Empowerment
Think Tank
What We Don‘t Say Can Hurt Us: Working with Undiscussables
Lone Star C
245 Non-profit and Foundations Evaluation TIG
Multipaper
Evaluating Social Service Programs for Government and Foundations
Lone Star D
246 Quantitative Methods: Theory and Design TIG
Business Meeting Business Meeting and Presentation: What is New in Multiple Comparison Procedures
Lone Star E
247 Internal Evaluation TIG
Business Meeting Business Meeting and Presentation: A Decade of Internal Evaluation in One School District - How Times Changes
Lone Star F
248 Graduate Student and New Evaluator TIG
Roundtable
Rotation I: Grad Students on Grad Students: Evaluating Peers in a Professional Context
Rotation II: A Student-Generated Collaborative Approach to Developing New Evaluator Competencies
Mission A
249 Disabilities and Other Vulnerable Populations
Panel
Issues and Models: Evaluating Universal Design for Learning
Mission B
250 Systems in Evaluation TIG
Think Tank
Systems Theories in Evaluation Planning: Differentiating Planning Process from Evaluation Plan
Bowie A
251 Multiethnic Issues in Evaluation TIG
Panel
Race, Class, and Power: Bringing The Issues Into Discussion and Evaluation
Bowie B
252 Indigenous Peoples in Evaluation TIG
Multipaper
Culturally Responsive Evaluation: Three Cases From Aboriginal Peoples and First Nations in Canada
Bowie C
253 Advocacy and Policy Change TIG
Roundtable
Rotation I: Theory of Change Evaluation in the Real World: Lessons Learned from Applying (and Modifying) the TOC Approach… Goliad
Rotation II: Evaluating Foundation Advocacy Strategies: When Theory and Practice Collide
254 Research, Technology, and Development Eval
Roundtable
Rotation I: Choices of R&D Evaluation Approaches in Chinese Academy of Sciences (CAS) Institutes….
Rotation II: Producing Evidence of Effectiveness Data in the Real World of Early Childhood Education
San Jacinto
255 Assessment in Higher Education TIG
Multipaper
Assessing Student Learning Outcomes II: Three Sides of the Coin
Travis A
256 Integrating Technology Into Evaluation
Multipaper
Visualizing Data for Strategic Planning
Travis B
257 Non-profit and Foundations Evaluation TIG
Panel
Measuring the Immeasurable: Lessons for Building Grantee Capacity to Evaluate Hard-to-assess Efforts
Travis C
258 Evaluating the Arts and Culture TIG
Panel
Evaluation in Action: A Sampler of Tracking and Timing Methodologies in Museums, Culturals, and Informal Education…
Travis D
259 Human Services Evaluation TIG
Multipaper
Implementing Quality Randomized Control Trials in Human Service Evaluations: Applications Addressing Challenges…
Independence
260 Lesbian, Gay, Bisexual, Transgender Issues TIG Multipaper
Including Everyone: Lesbian, Gay, Bisexual, Transgender, People of Color, and Double Winners
Presidio A
261 Org Learning & Evaluation Capacity Bldg TIG
Multipaper
Building, Enhancing, and Sustaining Evaluation Quality for Organizational Learning
Presidio B
262 Alcohol, Drug Abuse, and Mental Health TIG
Multipaper
Analytic and Measurement Approaches in Substance Abuse and Mental Health Evaluation
Presidio C
Evaluation 2010: Thursday, November 11, 10:55 AM – 12:25 PM
Page 44
Summary of Sessions for Thursday, November 11, 10:55 AM to 12:25 PM, Continued
No Primary Sponsor
Session
Session Title
Room
263 Non-profit and Foundations Evaluation TIG
Roundtable
Rotation I: Evaluation as a Management and Learning Tool for the Successful Development and Scaling of Innovative…
Rotation II: Evaluating Enterprising Nonprofits: The Social Return on Investment
Bonham A
264 Non-profit and Foundations Evaluation TIG
Panel
Using Evaluation to Improve the Quality of the Initial Implementation of a Statewide Community and State Level Policy…
Bonham B
265 Pre-K - 12 Educational Evaluation TIG
Multipaper
Group and Cluster Randomized-Control Experimental Interventions in Educational Evaluation Studies
Bonham C
266 Pre-K - 12 Educational Evaluation TIG
Panel
Integrating High Quality Evaluation Into a National Integrated Services in Schools Initiative
Bonham D
267 Environmental Program Evaluation TIG
Multipaper
Environmental Education Evaluation: Examining Citizen Collected Data, Mixed Method Designs, and Professional Dev…
Bonham E
268 Government Evaluation TIG
Multipaper
International Approaches to Government Evaluation
Texas A
269 Qualitative Methods TIG
Skill-building
Circular Dialogue and Other Dialectical Methods of Inquiry
Texas B
270 Mixed Methods Evaluation TIG
Demonstration
Better Evaluation - A Toolbox of Evaluation Methods and Applications That Supports Quality and Methodological Diversity
Texas C
271 Research, Technology, and Development Eval
Panel
Analysis and Evaluation of Research Portfolios Using Quantitative Science Metrics: Theory
Texas D
272 Evaluation Use TIG
Panel
Mainstreaming Evaluation in Diverse Organizational Contexts
Texas E
273 AEA Conference Committee
MultiPaper
Truth, Beauty, and Justice: Thirty Years Later
Texas F
274 Extension Education Evaluation TIG
Panel
The Role of Evaluation During Tough Fiscal Times: Sage Advice From Evaluation Leaders
Crockett A
275 Business and Industry TIG
Multipaper
Evaluating Leadership Development in Organizations
Crockett B
276 International and Cross-cultural Evaluation TIG Panel
National Evaluation Capacity Development
Crockett C
277 Government Evaluation TIG
NASA Office of Education‘s Portfolio Evaluation Approach: Focus on Questions That Provide High Value Answers
Crockett D
278 International and Cross-cultural Evaluation TIG Multipaper
Evaluating Education, Health Education and Agriculture Education Around the Globe
Republic A
279 Health Evaluation TIG
Panel
Keep an Eye on the Basics: The Importance of Evaluating Public Health Program Infrastructure
Republic B
280 Collaborative, Participatory & Empowerment
Multipaper
A Checklist for Planning, Implementing and Evaluating Implementation Quality
Republic C
MultiPaper
Evaluation 2010: Thursday, November 11, 10:55 AM – 12:25 PM
Page 45
Thursday, 10:55 am to 12:25 pm
242 - Cultural Competency in Evaluation: Discussion
of the American Evaluation Association's Public
Statement on the Importance of Cultural
Competence in Evaluation
Think Tank to be held in Lone Star A
Sponsored by the Presidential Strand
 Presenter - Cindy A Crusto, Yale University
 Discussants - Katrina Bledsoe, Walter R
McDonald and Associates Inc; Karen E Kirkhart,
Syracuse University; Bessa Whitmore, Carleton University;
Jenny Jones, Virginia Commonwealth University; and Katherine
A Tibbetts, Kamehameha Schools
 Visual Recorder - Terry Uyeki, Humboldt State University
243 - Improving the Practice of Theory-driven
Evaluation: Understanding the Role of
Stakeholders and Context in Evaluation Settings
Multipaper to be held in Lone Star B
Sponsored by the Program Theory & Theory-driven Evaluation TIG
 Chairs- Cindy Gilbert, United States Government
Accountability Office; and Uda Walker, Gargani + Company
Learning for and From Change: Application of Theory of
Change-based Monitoring and Evaluating (M&E) to FastTracking Capacities of African Women Scientists in Agricultural
Research and Development
 James Kakooza and Margaret Kroma, African Women in
Agricultural Research and Development; Zenda Ofir, Evalnet
South Africa
Theory-based Stakeholder Evaluation
 Morten Balle Hansen, University of Southern Denmark;
and Evert Vedung, Uppsala University
Issues on Social Science Theory Versus Stakeholder Theorybased Interventions: Leasons Learned From Evaluating an
Environmental Tobacco Smoke Intervention Program
 Huey Chen, Centers for Disease Control and Prevention;
and Nannette Turner, Mercer University
Evidence-based Interventions in the Context of Program
Evaluation: A Critique and Alternative Perspective
 Huey Chen and Paul Garbe, Centers for Disease Control
and Prevention
Did you know? AEA received over 1100 proposals to
present at Evaluation 2010.
244 - What We Don‘t Say Can Hurt Us: Working with
Undiscussables
Think Tank to be held in Lone Star C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Presenter - Alexis Kaminsky, Kaminsky Consulting
 Discussants - Hazel Symonette, University of Wisconsin;
Jennifer Dewey, James Bell Associates; Virginia Dick, University
of Georgia; Maggie Dannreuther, Stennis Space Center;
Ranjana Damle, Albuquerque Public Schools; and Elena Polus,
Iowa State University
245 - Evaluating Social Service Programs for
Government and Foundations
Multipaper to be held in Lone Star D
Sponsored by the Non-profit and Foundations Evaluation TIG
 Chair - Beth Stevens, Mathematica Policy Research
Foundation Requests for Rigorous Evaluation and the
Response of Their Community-based Grantees
 Beth Stevens, Daniel Finkelstein, Jung Kim, Michaella
Morzuch, and Cicely Thomas, Mathematica Policy Research
Evaluating Programs Funded by Government and Delivered by
Nonprofits: A Grounded Model for More Accurate and Useful
Evaluation of Contracted Social Services
 Christopher Horne, University of Tennessee, Chattanooga
Successes and Challenges of a Nonprofit Organization‘s Effort
to Improve Evaluation Quality by Adopting a Client Information
System (CIS)
 Adrienne Adams and Nidal Karim, Michigan State University;
Sue Coats, Turning Point Inc; Sallay Barrie, Nkiru Nnawulezi, Cris
Sullivan, and Katie Gregory, Michigan State University
246 - Quantitative Methods Theory and Design TIG
Business Meeting and Presentation: What is New in
Multiple Comparison Procedures
Business Meeting to be held in Lone Star E
Sponsored by the Quantitative Methods: Theory and Design TIG
 Chair - Dale Berger, Claremont Graduate University
 Presenter - Roger Kirk, Baylor University
 TIG Leaders - Patrick McKnight, George Mason University;
George Julnes, University of Baltimore; Karen Larwin, Youngstown
State University; and Raymond Hart, Georgia State University
247 - Internal Evaluation TIG Business Meeting and
Presentation: A Decade of Internal Evaluation in One
School District - How Times Change
Business Meeting to be held in Lone Star F
Sponsored by the Internal Evaluation TIG
 Presenter - Jean A King, University of Minnesota
 TIG Leaders - Boris Volkov, University of North Dakota;
and Wendy DuBow, National Center for Women and
Information Technology
Evaluation 2010: Thursday, November 11, 10:55 AM – 12:25 PM
Page 46
248 – Roundtables in Mission A
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Graduate Student and New Evaluator TIG
Rotation 1: Grad Students on Grad Students: Evaluating Peers
in a Professional Context
 Matthew Linick, Marjorie Dorime-Williams, and Seung
Won Hong, University of Illinois at Urbana-Champaign
Rotation 2: A Student-Generated Collaborative Approach to
Developing New Evaluator Competencies
 Jason Black, Pamela Bishop, Shayne Harrison, Susanne
Kaesbauer; and Thelma Woodard, University of Tennessee,
Knoxville
249 - Issues and Models: Evaluating Universal
Design for Learning
Panel to be held in Mission B
Sponsored by the Disabilities & Other Vulnerable Populations TIG
 Chair - Bob Hughes, Seattle University
Assessment of Learning in Universal Design for Learning
 Tracey Hall, Center for Applied Special Technology
Logic Model and Evaluation Plan of a Universal Design for
Learning Project at the University of Vermont
 David Merves, Evergreen Educational Consulting LLC
Evaluating the Impact of Universal Design for Learning in Early
Childhood Education
 Donald Smith, Texas Early Childhood Education Coalition
Addressing the Complexity: A Model for Designing Universal
Design for Learning Evaluations
 Bob Hughes, Seattle University
250 - Systems Theories in Evaluation Planning:
Differentiating Planning Process from Evaluation Plan
Think Tank to be held in Bowie A
Sponsored by the Systems in Evaluation TIG
 Presenters - Claire Hebbard, Cornell University
 Discussants - William M Trochim, Thomas Archibald, and
Monica Hargraves, Cornell University
251 - Race, Class, and Power: Bringing The Issues
Into Discussion and Evaluation
Panel to be held in Bowie B
Sponsored by the Multiethnic Issues in Evaluation TIG
 Chair - Dawn Smart, Clegg & Associates
Race, Class, and Power in Rural Development
 Tracey Greene-Dorsett, National Rural Funders Collaborative
Developing Tools to Measure Race, Class and Power
 Jessica Anders, NeighborWorks America
Evaluating Race, Class and Power
 Dawn Smart, Clegg & Associates
252 - Culturally Responsive Evaluation: Three Cases
From Aboriginal Peoples and First Nations in Canada
Multipaper to be held in Bowie C
Sponsored by the Indigenous Peoples in Evaluation TIG
 Chair and Discussant- Andrea LK Johnston, Johnston
Research Inc
The Aboriginal ActNow Health Promotion Initiative: The Role of
Context
 Kim van der Woerd, Reciprocal Consulting; and Donna
Atkinson, University of Northern British Columbia
Deconstructing and Rebuilding Evaluation Practices With
Indigenous Communities: Examples From the Canadian
Context
 Larry K Bremner, Proactive Information Services Inc
A Journey Toward Understanding Evaluation Quality and
Complexity in Aboriginal Communities: A Discussion of Three
National Evaluation Initiatives
 Jill Anne Chouinard and Katherine Moreau, University of
Ottawa
253 – Roundtables in Goliad
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Advocacy and Policy Change TIG and the
Evaluation Policy TIG
Rotation 1: Theory of Change Evaluation in the Real World:
Lessons Learned from Applying (and Modifying) the TOC
Approach in the Evaluation of the Tobacco Policy Change
Program
 Andrea Anderson-Hamilton, Anderson Hamilton
Consulting
Rotation 2: Evaluating Foundation Advocacy Strategies: When
Theory and Practice Collide
 Catherine Borgman-Arboleda and Rachel Kulick, City
University of New York (CUNY)
254 – Roundtables in San Jacinto
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Research, Technology, and Development
Evaluation TIG and the Pre-K - 12 Educational Evaluation TIG
Rotation 1: Choices of Research and Development (R&D)
Evaluation Approaches in Chinese Academy of Sciences
(CAS) Institutes: We Reap What We Sow?
 Xiaoxi Xiao, Changhai Zhou, and Tao Dai, Chinese
Academy of Sciences
Rotation 2: Producing Evidence of Effectiveness Data in the
Real World of Early Childhood Education
 Cindy Lin and Marijata Daniel-Echols, HighScope
Educational Research Foundation
Evaluation 2010: Thursday, November 11, 10:55 AM – 12:25 PM
Page 47
Thursday, 10:55 am to 12:25 pm, continued
255 - Assessing Student Learning Outcomes II: Three
Sides of the Coin
Multipaper to be held in Travis A
Sponsored by the Assessment in Higher Education TIG
 Chair - Audrey Rorrer, University of North Carolina at
Charlotte
 Discussant - Jeanne Hubelbank, Independent Consultant
Assessing Student Engagement in the Classroom: Pilot Studies
of an Instrument for Studying Student Engagement and Its
Determinants in Higher Education
 Rick Axelson, University of Iowa; and Arend Flick, Norco
College
End of Course Evaluations: Enhancing the Curriculum
Evaluation Process Through Faculty Feedback
 Katherine Shaw, Westwood College
Organizational Readiness for Outcomes Assessment in Higher
Education
 Yukiko Watanabe, University of Hawaii, Manoa
256 - Visualizing Data for Strategic Planning
Multipaper to be held in Travis B
Sponsored by the Integrating Technology Into Evaluation TIG
 Chair - Metta Alsobrook, University of Texas, Dallas
Creating a Comprehensive Dashboard for Strategic Planning:
Inception to Implementation
 Jennifer Reeves, Barbara Packer-Muti, and Candace
Lacey, Nova Southeastern University
Listserv Activity as an Indicator of Vitality and Growth in
International Community of Practice Networks
 Stacey Friedman, Page Morahan, Williams Burdick, and
Deborah Diserens, Foundation for Advancement of
International Medical Education & Research; Avinash Supe,
GS Medical College; Tejinder Singh, Christian Medical College;
Thomas Chacko, PSG Institute of Medical Sciences and
Research; Eliana Amaral, Universidade Estadual de Campinas;
Henry Campos, Universidade Federal do Ceará; Vanessa
Burch, University of Cape Town; and Gboyega Ogunbanjo,
University of Limpopo
Public Comprehension of Published Data: Technology to the
Rescue?
 Paul Lorton Jr, University of San Francisco
257 - Measuring the Immeasurable: Lessons for
Building Grantee Capacity to Evaluate
Hard-to-Assess Efforts
Panel to be held in Travis C
Sponsored by the Non-profit and Foundations Evaluation TIG
 Chair - Lande Ajose, BTW Informing Cchange
The Hewlett Foundation‘s Education Program Grantee
Evaluation
 Kristi Kimball, William and Flora Hewlett Foundation;
Jennifer Curry Villeneuve, Lande Ajose, and Kim Ammann
Howard, BTW Informing Change
Evaluation Capacity Building: A Grantee‘s Perspective
 John Affeldt, Public Advocates
Measuring the Immeasurable: Lessons for Building Grantee
Capacity to Evaluate Hard-to-Assess Efforts
 Lande Ajose, Kim Ammann Howard, and Ellen Irie, BTW
Informing Change
258 - Evaluation in Action: A Sampler of Tracking and
Timing Methodologies in Museums, Culturals, and
Informal Education Settings
Panel to be held in Travis D
Sponsored by the Evaluating the Arts and Culture TIG
 Chair and Discussant - Kathleen Tinworth, Denver Museum
of Nature & Science
Tracking Among the Ruins: Informing Interpretive Planning at
Eastern State Penitentiary
 Cheryl Kessler, Independent Consultant
Reflective Tracking: When It‘s Simply too Large
 Joe E Heimlich, Ohio State University
Unspoken Narratives: What Visitor Behavior Reveals About
Exhibit Usage and Selection
 Carey Tisdal, Tisdal Consulting
Analysis and Visualization of Timing and Tracking Data:
Examples From Two Exhibit Evaluations
 Cláudia Figueiredo, Institute for Learning Innovation
259 - Implementing Quality Randomized Control
Trials in Human Service Evaluations: Applications
Addressing Challenges and Barriers
Multipaper to be held in Independence
Sponsored by the Human Services Evaluation TIG and the
Quantitative Methods: Theory and Design TIG
 Chair - Todd Franke, University of California, Los Angeles
 Discussant - Tania Rempert, University of Illinois at
Urbana-Champaign
Determining the Impact of Communities In Schools, Inc (CIS)
Programs: Student-level Randomized Controlled Trials
 Heather Clawson, Allan Porowski, Felix Fernandez,and
Christine Leight, ICF International
Perils, Pitfalls, and Successes: The Implementation of a
Randomized Controlled Trial (RCT) to Examine the Effects of
Alternative Response in Child Welfare
 Madeleine Kimmich and Linda Newton-Curtis, Human
Services Research Institute
Evaluation 2010: Thursday, November 11, 10:55 AM – 12:25 PM
Page 48
260 - Including Everyone: Lesbian, Gay, Bisexual,
Transgender, People of Color, and Double Winners
Multipaper to be held in Presidio A
Sponsored by the Lesbian, Gay, Bisexual, and Transgender
Issues TIG
 Chair and Discussant - Kathleen McKay, Connecticut
Children's Medical Center
The Meeting of Minds: Integrating Collaborative and
Anthropological Evaluation to Improve the Lives of Men Who
Sleep With Men (MSM) of Color in Tampa, Florida
 Candace Sibley and Matthew Hart, University of South
Florida
Engaging the Transformative Paradigm to Assess the HIV
Prevention Needs of Young Gay and Bisexual Black Men
 Robin Lin Miller and Miles McNall, Michigan State
University
261 - Building, Enhancing, and Sustaining
Evaluation Quality for Organizational Learning
Multipaper to be held in Presidio B
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG
 Chair - Imelda Castañeda-Emenaker, University of
Cincinnati
 Discussant - Beverly A Parsons, InSites
Enhancing Evaluation Quality and Use for Dynamic
Organizations: Lessons Learned from a Developmental
Evaluation of a Competency-based Medical Education
Innovation
 Cheryl Poth, Shelley Ross, Rebecca Georgis, Mike Donoff,
Paul Humphries, and Ivan Steiner, University of Alberta
The Challenge of Secondary School Reform: When Evaluation
Improves Practice
 Cathleen Armstead, Ann G Bessell, and Sabrina F
Sembiante University of Miami
Sustainable Quality Evaluation: Evaluating Continuous Quality
Improvement Processes
 Matthew Galen, Claremont Graduate University; Deborah
Grodzicki, University of California, Los Angeles
Building Evaluation Culture and Evaluation Quality in Brazil
 Daniel Brandão and Martina Otero, Fonte Institute
262 - Analytic and Measurement Approaches in
Substance Abuse and Mental Health Evaluation
Multipaper to be held in Presidio C
Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG
 Chair - Roger Boothroyd, University of South Florida
Evaluating Intervention Effects On Marijuana Use Among Youth
by Comparing Alternative Structural Equation Modeling:
Decision-Trees Based On Formal Model Comparisons
 Marlene Berg and Emil Coman, Institute for Community
Research
Finding Meaning in Numbers: How Well Do Our Measures
Capture What We Evaluate?
 Ann Doucette, George Washington University
Barriers to Treatment of the Chronic Homeless with Cooccurring Disorders
 M David Miller, University of Florida
263 – Roundtables in Bonham A
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Roundtable to be held in Bonham A
Sponsored by the Non-profit and Foundations Evaluation TIG
Rotation 1: Evaluation as a Management and Learning Tool for
the Successful Development and Scaling of Innovative
Program Models
 Helen Davis Picher and Sandra Adams, William Penn
Foundation
Rotation 2: Evaluating Enterprising Nonprofits: The Social
Return on Investment
 Goutham Menon and Maureen Rubin, University of Texas,
San Antonio
264 - Using Evaluation to Improve the Quality of the
Initial Implementation of a Statewide Community
and State Level Policy and Systems Change Initiative
Panel to be held in Bonham B
Sponsored by the Non-profit and Foundations Evaluation TIG
 Chair - Astrid Hendricks, California Endowment
 Discussant - Marie Colombo, Skillman Foundation
Positioning the Foundation to Use Evaluation for Learning and
Improved Performance
 Astrid Hendricks, Mona K Jwahar, and Lori Nascimento,
California Endowment
The California Endowment‘s Building Healthy Communities:
Lessons From the Site-selection Process
 Hanh Cao Yu, Social Policy Research Associates
Use of Logic Models to Structure a Cohesive Planning
Approach and an Evaluable Cross-site Comprehensive
Community Initiative
 Jared Raynor, TCC Group
The Planning Phase Evaluation: Getting Ready for
Implementation of the California Endowment Building Healthy
Communities Comprehensive Community Initiative
 Denise L Baer, Johns Hopkins University; and David M
Chavis, Community Science
Evaluation 2010: Thursday, November 11, 10:55 AM – 12:25 PM
Page 49
Thursday, 10:55 am to 12:25 pm, continued
265 - Group and Cluster Randomized-Control
Experimental Interventions in Educational Evaluation
Studies
Multipaper to be held in Bonham C
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Anane Olatunji, Fairfax County Public Schools
 Discussant - Melissa Chapman, University of Iowa
Lessons Learned from the Implementation of Randomized
Trials in the Field of Education
 Jessaca Spybrook, Anne Cullen, and Monica Lininger,
Western Michigan University
Effectiveness of Selected Supplemental Reading
Comprehension Interventions: Impacts on Two Cohorts of FifthGrade Students
 Susanne James-Burdumy, John Deke, and Julieta LugoGil, Mathematica Policy Research
Rigor Is Only Half the Story: Design Decisions and Context
Influences in a Cluster-Randomized Evaluation Study
 Andrea Beesley, Mid-continent Research for Education
and Learning
Comparative Advantage in Teaching: A Randomized
Experiment
 Steven Glazerman, Jeffrey Max, and Ali Protik,
Mathematica Policy Research
266 - Integrating High Quality Evaluation Into a
National Integrated Services in Schools Initiative
Panel to be held in Bonham D
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Keith McNeil, University of Texas, El Paso
Overview of the Elev8 Model and Evaluation Plan
 Jacqueline Williams Kaye, Atlantic Philanthropies
Crucial Role of Relationship Building in a Multilayered
Evaluation
 Maria Luisa Gonzalez, University of Texas, El Paso
Relationship Between Maximizing Integration and Maximizing
Effects of the Program
 Lauren Rich, Chapin Hall
Making the Case for Qualitative, Formative Evaluation in a
Quantitative, Outcomes-driven Environment
 Stephen La France, LFA Group
267 - Environmental Education Evaluation:
Examining Citizen Collected Data, Mixed Method
Designs, and Professional Development
Multipaper to be held in Bonham E
Sponsored by the Environmental Program Evaluation TIG
 Chair - Annelise Carleton-Hug, Trillium Associates
A National Study of the Professional Development Needs of
Formal, Informal, and Nonformal Environmental Educators
 Lynette Fleming, Research, Evaluation & Development
Services
A Grounded Theory Exploration of Science Identity in Informal
Contexts
 Tina Phillips, Cornell Univeristy; Elizabeth Danter and John
Fraser, Institute for Learning Innovation; and Richard Bonney,
Cornell Univeristy
Walking in the Footsteps of Aldo Leopold: Evaluation of an
Environmental Education Initiative Using a Mixed Method
Design
 Nancy Carrillo, Albuquerque Public Schools
268 - International Approaches to Government
Evaluation
Multipaper to be held in Texas A
Sponsored by the Government Evaluation TIG
 Chair - Jennifer Bisgard, Khulisa Management Services
(Pty) Ltd
How has Twenty Years of Educational Evaluation Contributed to
Lifting the Quality of Government Evaluation in New Zealand?
 Kathleen Atkins and Steffan Brough, Education Review
Office
Recommendations That Catch the Eye, Stimulate the Grey
Cells and Generate Change: What Makes a Good Evaluation
Recommendation? Lessons from the United Kingdom‘s
Department for International Development (DFID)
 Jonathan Patrick, Department for International
Development
Implementing Government of Canada Evaluation Policy
Requirements: Using Risk to Determine Evaluation Approach
and Level of Effort
 Courtney Amo and Shannon Townsend, National Research
Council Canada
Government, Implementation And Evaluation: The Viability and
Evaluability of National Policy Programs
 Anna Petersén, Lars Oscarsson, and Christian Kullberg,
Orebro University; and Ove Karlsson Vestman, Malardalen
University
Whose Fault is It? A Federal Government's Effort to Improve
Evaluation Quality
 Laura Tagle, Italy's Ministry for Economic Development;
and Massimiliano Pacifico, Evaluation Unit of Region Lazio
269 - Circular Dialogue and Other Dialectical
Methods of Inquiry
Skill-building Workshop to be held in Texas B
Sponsored by the Qualitative Methods TIG
 Richard Hummelbrunner, OEAR Regional Development
Consultants
Evaluation 2010: Thursday, November 11, 10:55 AM – 12:25 PM
Page 50
270 - Better Evaluation - A Toolbox of Evaluation
Methods and Applications That Supports Quality and
Methodological Diversity
Demonstration to be held in Texas C
Sponsored by the Mixed Methods Evaluation TIG
 Patricia Rogers, Royal Melbourne Institute of Technology;
and Suman Sureshbabu, Rockefeller Foundation
271 - Analysis and Evaluation of Research Portfolios
Using Quantitative Science Metrics: Theory
Panel to be held in Texas D
Sponsored by the Research, Technology, and Development
Evaluation TIG
 Chair - Israel Lederhendler, National Institutes of Health
 Discussant - Gretchen Jordan, Sandia National
Laboratories
How Can Portfolio Analysis Assist Government Research
Agencies to Make Wise Research Investments?
 Wagner Robin and Matthew Eblen, National Institutes of
Health
Limits of Portfolio Analysis to Address Evaluation Questions
 Brian Zuckerman, Science and Technology Policy Institute
Reinventing Portfolio Analysis at the National Institutes of
Health: Explorations in the Structure and Evolution of
Biomedical Research
 Israel Lederhendler, Kirk Baker, Archna Bhandari, and
Carole Christian, National Institutes of Health
Intersections Among Scientometrics, Science Portfolio
Analysis, and Research Evaluation: Does Complex Systems
Science Offer Workable Theory?
 Caroline Wagner, Science-Metrix Corp
272 - Mainstreaming Evaluation in Diverse
Organizational Contexts
Panel to be held in Texas E
Sponsored by the Evaluation Use, Organizational Learning &
Evaluation Capacity Building and Research on Evaluation TIGs
 Chair - Gloria Sweida-DeMania, Claremont Graduate
University
Mainstreaming Evaluation: Practices and Innovations
 Amy Gullickson, Western Michigan University
Mainstreaming Evaluation Into Faculty Professional
Development Programs
 Randahl Kirkendall and Ellen R Iverson, Carleton College
Mainstreaming Evaluation in Agricultural Research and
Development
 Rachel Muthoni, International Center for Tropical
Agriculture
Working Backwards: Using the Evaluation Report to Write
Evaluation Questions
 Sam Held, Oak Ridge Institute for Science and Education
273 - Truth, Beauty, and Justice: Thirty Years Later
MultiPaper to be held in Texas F
Sponsored by the AEA Conference Committee
 Chair - Timothy Cash, University of Illinois at UrbanaChampaign
Vitality and Disorder Thirty Years Later: Reflections Inspired by
House (1980)
 Melvin Mark, Pennsylvania State University
An Examination of Validity in Evaluation: Reflections Inspired
by House (1980)
 Laura Peck, Arizona State University
Evidence-based Policy and Practice and the Idea of Social
Justice
 Thomas Schwandt and Timothy Cash, University of Illinois
at Urbana-Champaign
Democratizing Evaluation and Its Pitfalls
 Beth Weitzman, Tod Mijanovich, and Diana Silver, New
York University
274 - The Role of Evaluation During Tough Fiscal
Times: Sage Advice From Evaluation Leaders
Panel to be held in Crockett A
Sponsored by the Extension Education Evaluation TIG
 Chair - Joseph Donaldson, University of Tennessee
 Discussant - Nancy Franz, Virginia Tech
Evaluator‘s Role in Building Capacity and Demonstrating
Public Value
 Joseph Donaldson, University of Tennessee
Evaluator‘s Role in Organizational Transformation
 Molly Engle, Oregon State University
275 - Evaluating Leadership Development in
Organizations
Multipaper to be held in Crockett B
Sponsored by the Business and Industry TIG
 Chairs - Ray Haynes, Indiana University; and Eric
Abdullateef, Directed Study Services
Assessing a High Performing Organization‘s Leadership
Selection and Development: The Use of the Leadership3
Instrument as an Evaluation Tool in Organizational
Development
 Darryl Jinkerson and Phil Vardiman, Abilene Christian
University
Evaluation and Performance of University Boards: A Framework
for Analysis
 Zita Unger, Evaluation Solutions Pty Ltd
Leader Development and Leadership Development Programs:
The Must Haves in Determining Program Value
 Ray Haynes, Barbara Bichelmeyer, and Ria Roy, Indiana
University
Evaluation Quality as Authentic Alignment Between People and
Goals
 Eric Abdullateef, Directed Study Services
Evaluation 2010: Thursday, November 11, 10:55 AM – 12:25 PM
Page 51
Thursday, 10:55 am to 12:25 pm, continued
276 - National Evaluation Capacity Development
Panel to be held in Crockett C
Sponsored by the International & Cross-cultural Evaluation TIG
 Chair - Hallie Preskill, FSG Social Impact Advisors
 Discussant - Michael Quinn Patton, Utilization-Focused
Evaluation
Towards a Conceptual Framework for National Evaluation
Capacity Development
 Marco Segone, United Nations Children's Fund
Successes and Failures in Development of Citizens‘ and Their
Representatives‘ Evaluative Capacities
 Christina Bierring, United Nations Children's Fund
Use of Training in Evaluation Capacity Building
 Alexey Kuzmin, Process Consulting Company
277 - National Aeronautics and Space
Administration (NASA) Office of Education‘s
Portfolio Evaluation Approach: Focus on Questions
That Provide High Value Answers
MultiPaper to be held in Crockett D
Sponsored by the Government Evaluation TIG
 Chair - Brian Yoder, National Aeronautics and Space
Administration
NASA‘s Requirements for and Uses of Program Evaluation
 Brian Yoder, National Aeronautics and Space
Administration
Evaluation of NASA‘s Higher Education Portfolio
 Clemencia Cosentino de Cohen, Urban Institute; and
Jennifer Carney, Abt Associates Inc
Evaluation of NASA‘s Science, Engineering, Mathematics, and
Aerospace Academy (SEMAA) Program: A National Program
Impact and Implementation Study
 Alina Martinez, Abt Associates Inc; and Clemencia
Cosentino de Cohen, Urban Institute
Evaluation of NASA's Informal Education Program: A
Qualitative Approach
 Alyssa Rulf Fountain and Hilary Rhodes, Abt Associates
Inc; and Abigail Levy, Education Development Center
278 - Evaluating Education, Health Education and
Agriculture Education Around the Globe
Multipaper to be held in Republic A
Sponsored by the International & Cross-cultural Evaluation TIG
 Chair - Maria Whitsett, Moak, Casey and Associates
Satisfaction of Employers for Agricultural Graduates:
Perspective for the Future
 Virginia Gravina, University of the Republic
A Cross-Case Analyses of Different Stakeholders‘ Perceptions
About the Quality of an Evaluation Program: Colombia‘s
National Bilingual Program
 Alexis Lopez, University of Los Andes, Colombia
Balancing Global Focus With Local Perspectives: A
Comparative Study of Innovative Teaching and Learning in Four
Countries
 Presenters - Corinne Singleton, Savitha Moorthy, and
Linda Shear, SRI International
Use of the Task Analysis Methodology to Strengthen Education
of Nurses, Midwives, and Physician Assistants in Liberia
 Presenters - Mary Drake, A Udaya Thomas, and Marion
Subah, Jhpiego
279 - Keep an Eye on the Basics: The Importance of
Evaluating Public Health Program Infrastructure
Panel to be held in Republic B
Sponsored by the Health Evaluation TIG
 Chair - Leslie Fierro, SciMetrika
Evaluation in Support Of High-quality Asthma Partnerships
 Carlyn Orians, Shyanika Wijesinha Rose, and Linda Winges,
Battelle Memorial Institute; Sarah Gill, Cazador; and Robin
Shrestha-Kuwahara, Centers for Disease Control and Prevention
The Value and Utility of Evaluating Public Health Partnerships:
An Example From Utah
 Rebecca Giles, Utah Department of Health Asthma Program
Evaluation as a Program Improvement Tool: Evaluation of
Asthma Surveillance Systems
 Amanda Savage Brown, Cazador; Leslie Fierro,
SciMetrika; Linda Winges, Battelle Memorial Institute
The Value and Utility of Evaluating Public Health Surveillance:
Asthma Mortality Rates Among Seniors in Minnesota
 Wendy Brunner, Minnesota Department of Health
280 - A Checklist for Planning, Implementing and
Evaluating Implementation Quality
MultiPaper to be held in Republic C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Chair - Jason Katz, University of South Carolina
 Discussant - Sandra Naoom, National Implementation
Research Network
The Getting to Outcomes (GTO) Implementation and Process
Evaluation Tools: Conceptual Basis and Overview
 Jason Katz, Victoria Chien, Duncan Meyers, Jonathan
Scaccia, Annie Wright, Sheara Fernando, Pamela Imm, and
Abraham Wandersman, University of South Carolina
Planning and Monitoring Implementation: The Maternal
Outreach Management Services (MOMS) Project
 Jonathan Scaccia, Jennifer Castellow, Isha W Metzger,
Aimee Sickels, John D Terry, Jason Katz, and Abraham
Wandersman, University of South Carolina
Implementing a Community-driven Project With Quality to
Enhance Client Outcomes in a University-based Community
Mental Health Facility
 Duncan Meyers and Abraham Wandersman, University of
South Carolina
Evaluation 2010: Thursday, November 11, 10:55 AM – 12:25 PM
Page 52
Thursday, 12:35 pm to 1:30 pm
American Evaluation Association Annual Business
Meeting
Business Meeting to be held in Lone Star A
 Leslie J Cooksy, University of Delaware; Jennifer Greene,
University of Illinois at Urbana-Champaign; Debra Rog,
Westat; Brian Yates; American University; Katherine
McKnight; Pearson Corporation
Evaluation 2010: Thursday, November 11, 12:35 PM – 1:30 PM
Page 53
Summary of Sessions for Thursday, November 11, 1:40 PM to 3:10 PM
No Primary Sponsor
Session
Session Title
Room
281 Environmental Program Evaluation TIG
Demonstration
San Antonio River Improvements Project: Field Trip to Ecosystem Restoration Sites
Fieldtrip
282 Presidential Strand
Panel
The Role of Metaevaluation in Promoting Evaluation Quality: National and International Cases
Lone Star A
283 Systems in Evaluation TIG
Multipaper
From Agent-Based Modeling to Cynefin: The ABC's of Systems Frameworks for Evaluation
Lone Star B
284 Collaborative, Participatory & Empowerment
Think Tank
I See What You Mean: Applications of Visual Methods in Evaluation
Lone Star C
285 Non-profit and Foundations Evaluation TIG
Panel
Contextual Issues in a Randomized Control Group Evaluation of a School-based Intervention…
Lone Star D
286 Quantitative Methods: Theory and Design TIG
Demonstration
Estimating Rater Consistency: Which Method Is Appropriate?
Lone Star E
287 AEA Conference Committee
Panel
Influencing Evaluation Policy and Evaluation Practice: A Progress Report From AEA‘s Evaluation Policy Task Force
Lone Star F
288 Cluster, Multi-site & Multi-level Evaluation TIG Roundtable
Rotation I: Evaluating Twenty-first Century Community Learning Centers: Reconciling Evaluation Needs…
Rotation II: Simplifying the Complex: Creating Transparent Evaluation in Multi-institutional Education Partnerships
Mission A
289 Disabilities and Other Vulnerable Populations
Panel
Constructing Relevant Guidelines for Disability Program Evaluations
Mission B
290 Independent Consulting TIG
Panel
The Fight for Evaluation Quality: Perspectives From the Trenches
Bowie A
291 Multiethnic Issues in Evaluation TIG
Multipaper
Advancing Multiethnic Program Evaluation Through Theory and Practice: An Examination of Culture, Cultural Context…
Bowie B
292 Advocacy and Policy Change TIG
Think Tank
Who Are Champions, What Are Their Impact and How Do You Know? Considerations for Advocates, Funders, and Evaluators
Bowie C
293 Health Evaluation TIG
Roundtable
Measuring Communication Campaign Intermediate Outcomes: Tools and Techniques
Goliad
294 International and Cross-cultural Evaluation TIG Roundtable
Rotation I: Assessing Principals' Needs for Professional Development
Rotation II: Reflection on an Instrument for Capturing School Conditions in Developing Countries
San Jacinto
295 Social Network Analysis TIG
Demonstration
Why Settle for Silos? Four Applications of Social Network Analysis for Building More Effective Organizational Networks…
Travis A
296 Integrating Technology Into Evaluation TIG
Multipaper
Contribution of Technology to Evaluation Practice
Travis B
297 Needs Assessment TIG
Skill-building
Introduction to Designing Needs Assessment Surveys
Travis C
298 AEA Conference Committee
Multipaper
Attending to Context and Situation to Improve Evaluation Process and Reporting
Travis D
299 Human Services Evaluation TIG
Panel
Use of Fidelity Scores in Measuring Outcomes for Children Involved in the Child Welfare System
Independence
300 Quantitative Methods: Theory and Design TIG
MultiPaper
Propensity Score Matching: Further Methodological Development
Presidio A
301 Org Learning & Evaluation Capacity Bldg TIG
Multipaper
Improving Medical and Prevention Services Through Continuous Evaluation and Organizational Learning
Presidio B
302 Alcohol, Drug Abuse, and Mental Health TIG
Multipaper
Outcome Assessment in Substance Abuse and Mental Health
Presidio C
303 Non-profit and Foundations Evaluation TIG
Roundtable
Rotation I: Small Foundations With Big Learning Agenda: A Case of Using Analysis of Past Grant Making…
Rotation II: Challenges in Developing Multi-level Logic Models
Bonham A
304 Non-profit and Foundations Evaluation TIG
Multipaper
Insights Into Foundation Evaluation
Bonham B
305 Pre-K - 12 Educational Evaluation TIG
Multipaper
Current Topics in Educational Evaluation: An Eclectic Set of Noteworthy Projects
Bonham C
Evaluation 2010: Thursday, November 11, 1:40 PM – 3:10 PM
Page 54
Summary of Sessions for Thursday, November 11, 1:40 PM to 3:10 PM, Continued
No Primary Sponsor
Session
Session Title
Room
306 Pre-K - 12 Educational Evaluation TIG
Multipaper
Methods and Models for Evaluating Pre-Kindergarten and School Readiness Programs
Bonham D
307 Systems in Evaluation TIG
Panel
Grappling With Uncertainty in Innovative and Complex Settings: Weaving Quality in Developmental Evaluation
Bonham E
308 Government Evaluation TIG
Panel
Tips From the Trenches: The Role of the Evaluator in Designing a Quality Evaluation
Texas A
309 AEA Conference Committee
Panel
The Future of Knowledge Production and Dissemination in Evaluation
Texas B
310 Mixed Methods Evaluation TIG
Multipaper
Using Mixed Methods to Expand Frameworks for Program Evaluation
Texas C
311 Research, Technology, and Development Eval
Demonstration
Third Generation Research Knowledge Tracking: Citation Analyses
Texas D
312 Evaluation Use TIG
Panel
The Cycle of Evidence-based Policy and Practice: Synthesis, Translation, and Evaluation Capacity Building
Texas E
313 Evaluation Policy TIG
Think Tank
Change is a Process, Not An Outcome: Implication for Evolving Federal Evaluation Policy
Texas F
314 Qualitative Methods TIG
Panel
Quality in Evaluation: How Do We Know It When We See It in Qualitative Evaluations?
Crockett A
315 Teaching of Evaluation TIG
Multipaper
Strategies for Preparing Quality Evaluation Practitioners
Crockett B
316 International and Cross-cultural Evaluation TIG Panel
Evaluating Support to Poverty and Gender in Cross Country Aid Programs
Crockett C
317 Government Evaluation TIG
MultiPaper
Towards an Understanding of the Role of the Local Evaluator in Federally Funded Demonstration Projects…
Crockett D
318 Feminist Issues in Evaluation TIG
Panel
Gender and Human Rights Evaluation
Seguin B
319 International and Cross-cultural Evaluation TIG Panel
Reflections From Applying a Complexity Lens to Monitoring and Evaluation
Republic A
320 Health Evaluation TIG
Multipaper
Improving School-Based Health Through Campus Centers, Nursing, and Effective Interventions
Republic B
321 Collaborative, Participatory & Empowerment
Panel
Five Partners, One Evaluation: A Cohesive Evaluation of the Action Communities for Health, Innovation…
Republic C
Evaluation 2010: Thursday, November 11, 1:40 PM – 3:10 PM
Page 55
Thursday, 1:40 pm to 3:10 pm
281 - San Antonio River Improvements Project: Field
Trip to Ecosystem Restoration
Off Site Fieldtrip – Sign up at Wednesday‘s Reception
Sponsored by the Environmental Program Evaluation TIG
 Coordinator - Annelise Carleton-Hug, Trillium Associates
282 - The Role of Metaevaluation in Promoting
Evaluation Quality: National and International Cases
Panel to be held in Lone Star A
Sponsored by the Presidential Strand
 Chair - Leslie Cooksy, University of
Delaware
 Discussant - Donald Yarbrough,
University of Iowa
The Use of Evaluation Quality Assurance System in Metaevaluation at the United Nations Children's Fund (UNICEF)
(The opinions expressed are the personal thinking of the presenter and do
not necessarily reflect the policies or views of UNICEF)
 Marco Segone, United Nations Children's Fund
Can Metaevaluations be Helpful to International NGOs? A
Case Study From CARE International
 Jim Rugh, Independent Consultant
The Role of Metaevaluation in Promoting Evaluation Quality at
the International Labor Organization
 Daniela Schroeter, Anne Cullen, and Kelly Robertson,
Western Michigan University; and Craig Russon, International
Labor Organization Evaluation Unit
The Use of the Program Evaluation Standards in
Metaevaluation: Potential and Pitfalls
 Lori Wingate, Western Michigan University
283 - From Agent-Based Modeling to Cynefin: The
ABC's of Systems Frameworks for Evaluation
Multipaper to be held in Lone Star B
Sponsored by the Systems in Evaluation TIG
 Chair and Discussant - Mary McEathron, University of
Minnesota
Using the Cynefin Framework in Evaluation Planning: A Case
Study
 Heather Britt, Independent Consultant
Agent Based Modeling (ABM) Simulation for Program
Evaluation
 Stephen Magura, Western Michigan University; Rainer
Hilscher, Altarum Institute; Theodore Belding, TechTeam
Government Solutions; and Jonathan Morell, Vector Research
Center
Using Systems Thinking Concepts in Evaluation of Complex
Programs
 William M Trochim, Wanda Casillas, and Margaret
Johnson, Cornell University; and Jennifer Brown Urban,
Montclair State University
284 - I See What You Mean: Applications of Visual
Methods in Evaluation
Think Tank to be held in Lone Star C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Presenter - Terry Uyeki, Humboldt State University
 Discussants - Jara Dean-Coffey, jdcPartnerships; and Terry
Uyeki, Humboldt State University
285 - Contextual Issues in a Randomized Control
Group Evaluation of a School-based Intervention:
Fielding an Evidence-based Intervention to Reduce
Youth Gun Violence in Chicago
Panel to be held in Lone Star D
Sponsored by the Non-profit and Foundations Evaluation TIG
 Chair - Wendy Fine, Youth Guidance
Overcoming the Odds: Carrying Out a Large Scale Randomized
Control Evaluation of a Promising Youth Violence Prevention
Program in Chicago
 Roseanna Ander, University of Chicago
The Evaluator‘s Context: Challenges to the Design and
Implementation of an Experimental School-based Intervention
 Harold Pollack, University of Chicago
The Organization‘s Context: Evaluation Design‘s Affect on
Program Implementation, Ethics and Evaluation Utility
 Wendy Fine, Youth Guidance
286 - Estimating Rater Consistency: Which Method Is
Appropriate?
Demonstration to be held in Lone Star E
Sponsored by the Quantitative Methods: Theory and Design TIG
 Robert Johnson, Min Zhu, Grant Morgan, and Vasanthi
Rao, University of South Carolina
287 - Influencing Evaluation Policy and Evaluation
Practice: A Progress Report From the American
Evaluation Association's Evaluation Policy Task
Force
Panel to be held in Lone Star F
Sponsored by the AEA Conference Committee
 Chair - Patrick Grasso, World Bank
 Discussant - Jennifer Greene, University of Illinois at
Urbana-Champaign
Introduction to the Evaluataion Policy Task Force
 Patrick Grasso, World Bank
Activities and Plans for the Evaluation Policy Task Force
 George Grob, Center for Public Program Evaluation
Evaluation 2010: Thursday, November 11, 1:40 PM – 3:10 PM
Page 56
288 – Roundtables in Mission A
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG
Rotation 1: Simplifying the Complex: Creating Transparent
Evaluation in Multi-institutional Education Partnerships
 Dewayne Morgan, University System of Maryland; Susan
Tucker, Evaluation & Development Associates; and Jennifer
Frank, University System of Maryland
Rotation 2: Evaluating Twenty-first Century Community
Learning Centers: Reconciling Evaluation Needs and
Constraints at Multiple Systemic Levels
 Elizabeth Whipple and Mildred Savidge, Research Works Inc
289 - Constructing Relevant Guidelines for Disability
Program Evaluations
Panel to be held in Mission B
Sponsored by the Disabilities and Other Vulnerable
Populations TIG
 Chair - Mary Moriarty, Picker Engineering Program, Smith
College
Challenges and Expectations in Evaluating the National
Science Foundation (NSF) Funded Disability Education
Programs
 Linda Thurston, National Science Foundation
Evaluating Postsecondary Disability Programs: Answering
Questions and Monitoring Outcomes
 Joan McGuire, University of Connecticut
Ensuring Cultural Relevancy: Disability and Quality Evaluation
 Mary Moriarty, Smith College
290 - The Fight for Evaluation Quality: Perspectives
From the Trenches
Panel to be held in Bowie A
Sponsored by the Independent Consulting TIG
 Chair - Carol Haden, Magnolia Consulting LLC
Evaluation Quality and Local Context: When Anything Can
Happen in the Trenches
 Stephanie Wilkerson, Magnolia Consulting LLC
Evaluation Quality and Relationships: When Nurturing Makes a
Difference in the Trenches
 Lisa Shannon, Magnolia Consulting LLC
Evaluation Quality and Reporting: When Working Together
Improves the Trenches
 Mary Styers, Magnolia Consulting LLC
291 - Advancing Multiethnic Program Evaluation
Through Theory and Practice: An Examination of
Culture, Cultural Context, and Culturally Responsive
Evaluation
Multipaper to be held in Bowie B
Sponsored by the Multiethnic Issues in Evaluation TIG
 Chair - Pamela Frazier-Anderson, Lincoln University
Conducting Evaluations in a Multiethnic Context: Lessons from
a Hawaiian Experience
 Felix Blumhardt, The Evaluation Group
A Thematic Discussion of the Relational and Ecological
Dimensions of Cultural Context: Notes From Three
Interconnected Research Studies
 Jill Anne Chouinard and J Bradley Cousins, University of
Ottawa
Cultural Competence Versus Cultural Responsiveness: Seeking
True Evaluation Quality
 Tamara Bertrand Jones, Florida State University
Participatory Outreach: Methods of Increasing Minority
Participation in Agency Responsivenss to Community Racial
Change
 Asma Ali, University of Illinois at Chicago
292 - Who Are Champions, What Are Their Impact
and How Do You Know? Considerations for
Advocates, Funders, and Evaluators
Think Tank to be held in Bowie C
Sponsored by the Advocacy and Policy Change TIG
 Steve Mumford and Sarah Stachowiak, Organizational
Research Services; and Lance Potter, Bill & Melinda Gates
Foundation
293 – Roundtable in Goliad
Sponsored by the Health Evaluation TIG
Measuring Communication Campaign Intermediate Outcomes:
Tools and Techniques
 Michael Burke, RTI International
294 – Roundtables in San Jacinto
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the International & Cross-cultural Evaluation TIG
Rotation 1: Reflection on an Instrument for Capturing School
Conditions in Developing Countries
 Helene Jennings, ICF Macro
Rotation 2: Assessing Principals' Needs for Professional
Development
 Edith J Cisneros-Cohernour, University of Yucatan
Roger Patron-Cortes, Universidad Autonoma de Campeche
Evaluation 2010: Thursday, November 11, 1:40 PM – 3:10 PM
Page 57
Thursday, 1:40 pm to 3:10 pm, continued
295 - Why Settle for Silos? Four Applications of
Social Network Analysis for Building More Effective
Organizational Networks and Alignment Around
Outreach and New Initiatives
Demonstration to be held in Travis A
Sponsored by the Social Network Analysis TIG
 Tom Bartholomay, University of Minnesota
296 - Contribution of Technology to Evaluation
Practice
Multipaper to be held in Travis B
Sponsored by the Integrating Technology Into Evaluation TIG
 Chair - Paul Lorton Jr, University of San Francisco
Mapping Adolescent Substance Abuse Issues and Treatment in
Pima County, AZ: A Geographic Information System (GIS)
Spatial Analysis Strategy for Community Needs Assessment
 Judith Francis, Pima Prevention Partnership; and Matthew
Rahr, University of Arizona
Using Networked Technology for Quality Evaluation
 Colleen Manning and Rucha Londhe, Goodman Research
Group Inc; and Mary Dussault, Harvard-Smithsonian Center for
Astrophysics
Going Online With School-based Evaluations
 Janet Lee, Nicole Gerardi, and Minerva Avila, University of
California, Los Angeles
Validating Evaluations With Spatial Analysis
 Kristina Mycek, State University of New York at Albany
297 - Introduction to Designing Needs Assessment
Surveys
Skill-building Workshop to be held in Travis C
Sponsored by the Needs Assessment TIG
 James Altschuld, The Ohio State University; Yi-Fang Lee,
National Chi Nan University; Hsin-Ling Hung, University of
North Dakota; and Jeffry White, University of Louisiana,
Lafayette
298 - Attending to Context and Situation to Improve
Evaluation Process and Reporting
Multipaper to be held in Travis D
Sponsored by the AEA Conference Committee
 Chair - Judith Inazu, University of Hawaii at Manoa
To Communicate or Not to Communicate: How Communication
Within Organizations Affects Our Work as Evaluators
 Namrata Mahajan, Rebecca Eddy, and Hendrick Ruitman,
Cobblestone Applied Research & Evaluation Inc
Playing in the Intersection of Context and Validity
 Sheila A Arens and Andrea Beesley, Mid-Continent
Research for Education and Learning
299 - Use of Fidelity Scores in Measuring Outcomes
for Children Involved in the Child Welfare System
Panel to be held in Independence
Sponsored by the Human Services Evaluation TIG
 Chair - Madeleine Kimmich, Human Services Research
Institute
Integrating Child-level Fidelity Scores Into an Outcomes
Analysis: An Evaluation of Family Team Meetings
 Erin Singer, Human Services Research Institute
The Predictive Utility of a Child Level Measure of Fidelity: Its
Relevance to the Understanding of Outcomes Associated With
Enhanced Visitation Practices
 Linda Newton-Curtis, Human Services Research Institute
Kinship Support Index: Do More Intensive Programmatic
Efforts Result in Better Outcomes for Children?
 Kim Firth, Human Services Research institute
300 - Propensity Score Matching: Further
Methodological Development
MultiPaper to be held in Presidio A
Sponsored by the Quantitative Methods: Theory and Design TIG
 Chair - Ning Rui, Research for Better Schools
 Discussant - Frederick Newman, Florida International
University
On the Bandwidth of Propensity Score Caliper Matching
 Wei Pan, University of Cincinnati
Genetic Matching: A Better Matching Technique for
Assessment of Treatment Effects?
 Ning Rui, Research for Better Schools; and Haiyan Bai,
Universtiy of Central Florida
Propensity Score Matching With Replacement or Not?
 Haiyan Bai, Universtiy of Central Florida
301 - Improving Medical and Prevention Services
Through Continuous Evaluation and Organizational
Learning
Multipaper to be held in Presidio B
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG and the Health Evaluation TIG
 Chair - John Bosma, WestEd
 Discussant - Gayle Sulik, Texas Woman's University
Forming a Strategic Alliance: The Use of Collaboration Theory
to Evaluate and Improve Nurses‘ Safe Medication
Administration in Massachusetts‘ Nursing Homes
 Teresa Anderson, University of Massachusetts; Rebecca
Woodland, University of Massachusetts, Amherst; Michael
Hutton, The Blue Foundation for a Healthy Florida; and Carol
Silveira, Massachusetts Board of Registration in Nursing
Arizona's Quest for Quality: Improving Prevention Services
Through Evaluation and Capacity Building
 Holly Lewis and Aimee Sitzler, Arizona State University
Evaluation 2010: Thursday, November 11, 1:40 PM – 3:10 PM
Page 58
Evaluation Learning Cycle: Applying Evaluation Lessons to
Multi-year Long-Term Care Training and Organizational
Development Initiatives
 Marcia Mayfield, Malika Gujrati, and Ines Escandon,
Paraprofessional Healthcare Institute (PHI)
302 - Outcome Assessment in Substance Abuse and
Mental Health
Multipaper to be held in Presidio C
Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG
 Chair - Diana Seybolt, University of Maryland, Baltimore
Importance of Substance Abuse Treatment Outcome Proxies
 Lawrence Greenfield, Lawrence Greenfield Consulting
Douglas Fountain, Outpourings
The Perfect Couple: Clinical Quality and Program OutcomesUsing Data to Improve Clinical Practices
 Cathie McLean, Pablo Olmos-Gallo, and Christopher
McKinney, Mental Health Center of Denver
303 – Roundtables in Bonham A
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Non-profit and Foundations Evaluation TIG
Rotation 1: Small Foundations With Big Learning Agendas: A
Case of Using Analysis of Past Grant Making to Support Future
Organizational Learning
 William Bickel, Jennifer Iriti, and Julie Meredith, University
of Pittsburgh
Rotation 2: Challenges in Developing Multi-level Logic Models
 Barbara Wauchope and Curt Grimm, University of New
Hampshire
304 - Insights Into Foundation Evaluation
Multipaper to be held in Bonham B
Sponsored by the Non-profit and Foundations Evaluation TIG
 Chair - Ellie Buteau, Center for Effective Philanthropy
The Assessment Challenge for Foundations: Understanding
Impact
 Ellie Buteau and Andrea Brock, Center for Effective
Philanthropy
Benchmarking Foundation-level Evaluation: What are the Best
Practices?
 Jonathan Sachs, Kaye Phillips, and Werner Muller-Clemm,
Canadian Health Services Research Foundation
Foundation-Level Evaluation Approaches: Lessons Learned
About Quality in Practice
 Kaye Phillips and Werner Muller-Clemm, Canadian Health
Services Research Foundation; Kathryn Graham, Alberta
Innovates-Health Solutions; Jill Yegian, California HealthCare
Foundation; and Jonathan Sachs, Canadian Health Services
Research Foundation
305 - Current Topics in Educational Evaluation: An
Eclectic Set of Noteworthy Projects
Multipaper to be held in Bonham C
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - James S Sass, Research Support Services
Using A Mixed Methods Design to Conduct an Evaluation of
International Baccalaureate Programs in Texas Schools
 Jacqueline Stillisano, Hersh Waxman, Yuan-Hsuan Lee,
Judy Hostrup, Beverly Alford, and Kayla Braziel Rollins, Texas
A&M University
Alignment and Synthesis: Efforts to Improve the Quality of
Parent Engagement Evaluation in a Large Urban School District
 Wenhui Yuan, Fort Worth Independent School District; and
Susan M Wolfe, Susan Wolfe and Associates LLC
Profiles of Advocacy: Narrative Portrayals of School
Superintendents‘ Educational Practice and Social Action
 Keith Trahan, Cynthia Tananis, and Cara Ciminillo,
University of Pittsburgh
306 - Methods and Models for Evaluating PreKindergarten and School Readiness Programs
Multipaper to be held in Bonham D
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Katie Dahlke, Learning Point Associates
 Discussant - James P Van Haneghan, University of South
Alabama
Maintaining Validity in School Readiness Evaluation: A Multidimensional Approach in Methodology
 Summerlynn Anderson, Walter R McDonald and
Associates Inc; Gary Resnick, Harder+Company; Fred Molitor,
Walter R McDonald and Associates Inc; Julie Field, First 5
Sacramento
Getting Ready for School: Monitoring a User Productivity Kit
(UPK) Pilot Program in an Urban Setting
 Rob Fischer, Lance Peterson, Nina Lalich, and Claudia
Coulton, Case Western Reserve University
Crossing Borders: Evaluation of a Bi-lingual, Bi-cultural and Binational Kindergarten Readiness Programs
 Sharon DeJoy, Tina Runkles, and Stephanie Hawkins,
State University of New York College at Potsdam
Evaluating the Longitudinal Impact of Early Childhood
Professional Development Programs on K-3 Success
 Raymond Hart, Gary Bingham, and Nicole Patton-Terry,
Georgia State University
Evaluation 2010: Thursday, November 11, 1:40 PM – 3:10 PM
Page 59
Thursday, 1:40 pm to 3:10 pm, continued
307 - Grappling With Uncertainty in Innovative and
Complex Settings: Weaving Quality in Developmental
Evaluation
Panel to be held in Bonham E
Sponsored by the Systems in Evaluation and the Indigenous
Peoples in Evaluation TIGs
 Chair - Syd King, New Zealand Qualifications Authority
 Discussant - Michael Quinn Patton, Utilization-Focused
Evaluaton
Navigating Uncertainty: The Cross-site Evaluation of the
Supporting Evidence-based Home Visiting Grantee Cluster
 Margaret Hargreaves, Diane Paulsell, and Kimberly Boller,
Mathematica Policy Research; Deborah Daro, Chapin Hall; and
Debra Strong, Heather Zaveri, Heather Koball, Patricia Del
Grosso, and Russell Cole, Mathematica Policy Research
Drawing on Deep Values to Ensure Evaluation Quality in
Emergent and Uncertain Contexts
 Kate McKegg, The Knowledge Institute
Talking Past Each Other: The Language of the Developmental
Evaluator in Indigenous Contexts and Its Link to Quality
 Nan Wehipeihana, Research Evaluation Consultancy
Limited
What Does Quality Look Like in Developmental Evaluation in
Indigenous Contexts
 Kataraina Pipi, Independent Consultant
308 - Tips From the Trenches: The Role of the
Evaluator in Designing a Quality Evaluation
Panel to be held in Texas A
Sponsored by the Government Evaluation TIG
 Chair - Stanley Capela, HeartShare Human Services of
New York
 Discussant - Amy Germuth, EvalWorks LLC
Quality Perspectives in the Evaluation of a K-12 English
Language Proficiency Program
 Stephan Henry, REASolutions LLC
Real Time Peer Reviews: An Efficient Way to Ensure Evaluation
Quality
 Rakesh Mohan, Idaho State Legislature
Quality Evaluation Template: How to Develop a Utilization
Focused Evaluation System Incorporating Quality Improvement
and Quality Assurance Systems
 Stanley Capela, HeartShare Human Services of New York
309 - The Future of Knowledge Production and
Dissemination in Evaluation
Panel to be held in Texas B
Sponsored by the AEA Conference Committee
 Chair - Sandra Mathison, University of British Columbia
 Discussant - Patricia Rogers, Royal Melbourne Institute of
Technology
Knowledge Production and Dissemination in Evaluation
 Thomas Schwandt, University of Illinois at UrbanaChampaign
Knowledge Production and Dissemination in Evaluation
 Laura Leviton, Robert Wood Johnson Foundation
Knowledge Production and Dissemination in Evaluation
 Sandra Mathison, University of British Columbia
310 - Using Mixed Methods to Expand Frameworks
for Program Evaluation
Multipaper to be held in Texas C
Sponsored by the Mixed Methods Evaluation TIG
 Chair - Rita Fierro, Independant Consultant
 Discussant - Virginia Dick, University of Georgia
Unearthing Hidden Contexts in Evaluation Work: Using Brooks
5-Paths Analysis
 Pauline Brooks, Independent Consultant
A Multi-method Approach for Assessing Fidelity to an
Evidence-based Child Neglect Prevention Program
 Jill Filene, James Bell Associates; Lauren Kass, James Bell
Associates; and Elliott Smith, Cornell University
Compliance is Improving, Now What? Using the Guskey Model
in a Mixed Method Evaluation to Measure the Impact and
Effectiveness of a National Technical Assistance Center
 Paula Kohler and June Gothberg, Western Michigan
University
311 - Third Generation Research Knowledge
Tracking: Citation Analyses
Demonstration to be held in Texas D
Sponsored by the Research, Technology, and Development
Evaluation TIG
 Alan Porter and Stephen Carley, Georgia Institute of
Technology
312 - The Cycle of Evidence-based Policy and
Practice: Synthesis, Translation, and Evaluation
Capacity Building
Panel to be held in Texas E
Sponsored by the Evaluation Use TIG and the Organizational
Learning and Evaluation Capacity Building TIG and the Alcohol,
Drug Abuse, and Mental Health TIG
 Chair - Susan Labin, Independent Consultant
Importance and Usage of Synthesis in Public Policy:
Implications for Evaluation and Performance Measurement
 Joseph Wholey, University of Southern California
Research Synthesis: The Core Methodology in Evidence-based
Reviews
 Susan Labin, Independent Consultant
Evaluation 2010: Thursday, November 11, 1:40 PM – 3:10 PM
Page 60
Developing a Prevention Synthesis and Translation System to
Promote Science-based Approaches to Teen Pregnancy, HIV
and Sexually-transmitted Infections Prevention
 Kelly Lewis, Georgia State University; Catherine Lesesne,
Centers for Disease Control and Prevention; Abraham
Wandersman, University of South Carolina; S Christine
Zahniser, Global Evaluation and Applied Research Solutions
Inc; Mary Martha Wilson, Healthy Teen Network; Gina
Desiderio, Healthy Teen Network; Diane C Green, Centers for
Disease Control and Prevention
Service to Science: The Role of Evaluation Capacity Building in
Evidence-based Practice
 Pamela Imm, University of South Carolina
313 - Change is a Process, Not An Outcome:
Implication for Evolving Federal Evaluation Policy
Think Tank to be held in Texas F
Sponsored by the Evaluation Policy TIG
 Presenter - Dianna L Newman, State University of New York
at Albany
 Discussant - Dianna L Newman, State University of New
York at Albany; and Anna Lobosco, New York State
Developmental Disabilities Planning Council
314 - Quality in Evaluation: How Do We Know It When
We See It in Qualitative Evaluations?
Panel to be held in Crockett A
Sponsored by the Qualitative Methods TIG
 Chair - Leslie Goodyear, National Science Foundation
 Presenters - Leslie Goodyear, National Science
Foundation; Jennifer Jewiss, University of Vermont; Janet
Usinger, University of Nevada, Reno; and Eric Barela, Partners
in School Innovation
315 - Strategies for Preparing Quality Evaluation
Practitioners
Multipaper to be held in Crockett B
Sponsored by the Teaching of Evaluation TIG
 Chair - Gary Skolits, University of Tennessee, Knoxville
Teaching Program Evaluation with Quality in Mind: Challenges
Faced and Lessons Learned in Preparing Next Generation
Evaluators
 Sheila Kohn, University of Rochester; and Kankana
Mukhopadhyay, University of Rochester
Using Evaluation Activities to Teach Our Students About
Evaluator Roles
 Gary Skolits and Jennifer Morrow, University of Tennessee,
Knoxville; and Erin Burr, Oak Ridge Institute for Science and
Education
A Capacity Building Grant in Interdisciplinary Evaluation: A
Graduate Program With Focus on Assessment for Learning
Research
 Steven Ziebarth, Western Michigan University
316 - Evaluating Support to Poverty and Gender in
Cross Country Aid Programs
Panel to be held in Crockett C
Sponsored by the International & Cross-cultural Evaluation TIG
 Chair - Cheryl Gray, World Bank
Evaluating the Effects of Policy Reforms on the Poor Through
Analytic Work: Effectiveness of World Bank Support to Poverty
and Social Impact Analyses
 Soniya Carvalho, World Bank
Assessing Gender Dimensions of Aid Programs at the World
Bank
 Gita Gopal, World Bank
Assessing the Poverty and Human Development Outcomes of
Aid Through World Bank Supported Lending Programs
 Anjali Kumar, World Bank
317 - Towards an Understanding of the Role of the
Local Evaluator in Federally Funded Demonstration
Projects: The Perspectives of Federal Policymakers,
Community-based Organizations, and Evaluators
MultiPaper to be held in Crockett D
Sponsored by the Government Evaluation TIG
 Chair - Soundaram Ramaswami, Kean University
The Demonstration Project and Expectations for Evaluation:
The Policymaker‘s Perspective
 Alicia Richmond-Scott, United States Department of
Health and Human Services
Engaging in a Demonstration Project From the Nonprofit
Agency‘s Perspective: Weaving a Relationship Between
Program and Evaluation
 Nanci Coppola, Program Reach Inc; and Eunyoung Kim,
Seton Hall University
Understanding Role Orientations: An Examination of the
Evaluators‘ Role in Demonstration Project
 Elaine Walker, Martin Finkelstein, and Kevin Iglesias,
Seton Hall University
318 - Gender and Human Rights Evaluation
Panel to be held in Seguin B
Sponsored by the Feminist Issues in Evaluation TIG
 Chair - Divya Bheda, University of Oregon
 Discussant - Donna Podems, ICF Macro International; and
Divya Bheda, University of Oregon
United Nations Development Fund for Women (UNIFEM) and
United Nations Evaluation Group (UNEG): Evaluation in a
Human Rights Framework
 Belen Sanz, and Inga Sniukaite, United Nations
Development Fund for Women
Transformative Lens Applied to Gender Focused Evaluations
 Donna Mertens, Gallaudet University
Human Rights Enhancement From a Grassroots Community
Change Agent
 Denice Cassaro, Cornell University
Evaluation 2010: Thursday, November 11, 1:40 PM – 3:10 PM
Page 61
Thursday, 1:40 pm to 3:10 pm, continued
319 - Reflections From Applying a Complexity Lens
to Monitoring and Evaluation
Panel to be held in Republic A
Sponsored by the International & Cross-cultural Evaluation TIG
 Chair - Tricia Wind, International Development Research
Centre
The Challenges of Monitoring and Evaluating Development
Research in Complex Systems
 Tricia Wind, International Development Research Centre
The Specific Systemic and Complexity Challenges for the
Consortio por la Salud, Ambiente y Desarrollo (ECOSAD) Action
Research Project
 José Valle, Ruth Arroyo, Anita Lujan, Walter Varillas,
Magaly Oviedo, and Karim Castro, Consorcio por la Salud,
Ambiente y Desarrollo (ECOSAD)
The Strengths and Weaknesses of the Monitoring System
Adapted by ECOSAD to Meet the Special Challenges it Faces
 Ricardo Wilson-Grau, Ricardo Wilson-Grau Consulting
320 - Improving School-Based Health Through
Campus Centers, Nursing, and Effective Interventions
Multipaper to be held in Republic B
Sponsored by the Health Evaluation TIG
 Chair - Kim van der Woerd, Reciprocal Consulting
Factors Influencing Grantee Performance on Youth Outcomes
Targeted by the Safe Schools/Healthy Students (SS/HS)
Initiative: Results From an Exploratory Meta-regression
 Jim Derzon, Bruce Ellis, Sharon Xiong, Battelle Memorial
Institute; Danyelle Mannix, United States Department of Health
and Human Services; and Julia Rollison, MANILA Consulting
Group Inc
Evaluation of a Quitline-based Free Nicotine Replacement
Therapies (NRT) Program for College Students: Is Campus
Media Enough to Increase Quitline Utilization?
 Joseph Lee, University of North Carolina at Chapel-Hill;
and Kathryn Kramer, Anna McCullough, Leah Ranney, and
Adam Goldstein, University of North Carolina; Barbara
Moeykens, Nidu Menon, Tom Brown, North Carolina Health and
Wellness Trust Fund; Caroline Mage, University of North
Carolina; and Mark Ezzell, North Carolina Health and Wellness
Trust Fund
Evaluation of School Nursing in Underserved Schools: Truth,
Beauty, and Justice in the Evaluation of the San Jose Unified
School District (SJUSD) Nurse Demonstration Project
 Eunice Rodriguez, Stanford University; Diana Austria,
Stanford University; Melinda Landau, San Jose Unified School
District; Sue Lapp, School Health Clinics of Santa Clara County
Candace Roney and JoAnna Caywood, Lucile Packard
Foundation for Children's Health
The Impact of School Based Health Centers (SBHCs) on Access
to and Use of Health Services in New Orleans
 Lisanne Brown and Marsha Broussard, Louisiana Public
Health Institute; Paul Hutchinson and Nathalie Ferrell, Tulane
University; and Sarah Kohler Chrestman, Louisiana Public
Health Institute
321 - Five Partners, One Evaluation: A Cohesive
Evaluation of the Action Communities for Health,
Innovation, Environment Change (ACHIEVE) Healthy
Communities Initiative
Panel to be held in Republic C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Chair - Andrea Lee, YMCA of the USA
Young Men's Christian Association (YMCA) of the United
States of American (USA): Bringing Community Connections to
the ACHIEVE Partnership
 Andrea Lee, YMCA of the USA
National Recreation and Parks Association (NRPA): Solving
Chronic Disease Through Play and Space
 Melanie Chansky, National Recreation and Parks
Association
National Association of County and City Health Officials:
Bringing City and County Health Department Expertise to
ACHIEVE
 Sandra Silva, Altarum Institute
National Association of Chronic Disease Directors: New
Approaches and Partnerships to Fight Chronic Disease
 Ann Ussery-Hall, National Association of Chronic Disease
Directors
Evaluation 2010: Thursday, November 11, 1:40 PM – 3:10 PM
Page 62
Notes:
Evaluation 2010: Thursday, November 11, 1:40 PM – 3:10 PM
Page 63
Summary of Sessions for Thursday, November 11, 3:35 PM to 4:20 PM
No Primary Sponsor
Session
Session Title
Room
322 Presidential Strand
Panel
Truth, Beauty, and Justice: A Conversation With Plenary Speakers
Lone Star A
323 Systems in Evaluation TIG
Expert Lecture
Developmental Evaluation for Complex Systems: Quality as Speed and Adaptability
Lone Star B
324 Collaborative, Participatory & Empowerment
Think Tank
Exploring the Multiple Roles of Collaborative, Participatory, and Empowerment Evaluators
Lone Star C
325 Non-profit and Foundations Evaluation TIG
Multipaper
Evaluation and Nonprofits: Learning From Experience
Lone Star D
326 Quantitative Methods: Theory and Design TIG
MultiPaper
Bayesian Mixture Modeling Versus Traditional Meta-analysis: Examining the Treatment Advantage Research…
Lone Star E
327 Cluster, Multi-site & Multi-level Evaluation TIG Panel
Evaluating a Multi-site Twenty-first Century Learning Program: Strategies and Results
Lone Star F
328 Evaluation Use TIG
Roundtable
What Role Should the Evaluator Take When a Project Is Off-Track?
Mission A
329 Disabilities and Other Vulnerable Populations
Skill-building
Quality Evaluation Includes Everyone! Using Universal Design to Make Your Evaluation More Accessible
Mission B
330 Independent Consulting TIG
Demonstration
Marketing the Online You: Developing and Maintaining a Professional Online Presence
Bowie A
331 Multiethnic Issues in Evaluation TIG
Multipaper
Overcoming Specific Challenges to Service Delivery Within Hispanic-American Communities
Bowie B
332 Advocacy and Policy Change TIG
Panel
Advocacy Capacity Nuance: Helpful, or Too Much? Considering the Cases of Assessing Coalitions Versus Networks…
Bowie C
333 Social Work TIG
Roundtable
Enhancing Evaluation Quality in a Developing Context: A South African Case Study
Goliad
334 Disaster and Emergency Management Eval
Roundtable
Being on Target: Evaluation Techniques for Disaster Relief Agencies
San Jacinto
335 Assessment in Higher Education TIG
Panel
Using Business Frameworks to Evaluate Program Impact on Student Learning
Travis A
336 Integrating Technology Into Evaluation TIG
Demonstration
… The Benefits, Challenges, and Logistics of Using Audience Response System ("Clickers") as an Evaluation Tool…
Travis B
337 Org Learning & Evaluation Capacity Bldg TIG
Demonstration
CES‘s Professional Designation Program - How Our Members Are Applying to be Designated as a Credentialed Evaluator
Travis C
338 Health Evaluation TIG
Demonstration
Environmental Scans Using State Legislative Databases for Health Policy Research
Travis D
Including Sexual Orientation Information in an Evaluation: When, Why, and How?
Independence
339 Lesbian, Gay, Bisexual, Transgender Issues TIG MultiPaper
340 Distance Ed. & Other Educational Technologies Business Meeting Distance Education and Other Educational Technologies TIG Business Meeting
Presidio A
341 AEA Conference Committee
Think Tank
The United States Government Accountability Office's (GAO) New Yellow Book: What's in It for Evaluators?
Presidio B
342 College Access Programs TIG
Multipaper
Science, Technology, Engineering, and Mathematics (STEM) Recruitment Programs: Evaluation of Effectiveness
Presidio C
343 Research, Technology, and Development Eval
Roundtable
Methodological Issues in Evaluating Potentially Transformative Research
Bonham A
344 Non-profit and Foundations Evaluation TIG
Multipaper
Evaluation: Understanding the Context and Managing Tensions
Bonham B
345 Pre-K - 12 Educational Evaluation TIG
MultiPaper
Concordances: Development and Appropriate Uses
Bonham C
346 Pre-K - 12 Educational Evaluation TIG
Multipaper
Building Evaluation Capacity Among School Leaders
Bonham D
347 Environmental Program Evaluation TIG
Demonstration
Toolkit for Evaluating Impacts of Public Participation in Scientific Research
Bonham E
348 Government Evaluation TIG
MultiPaper
Strategies for Evaluation Quality in Government
Texas A
349 Qualitative Methods TIG
Demonstration
Techniques and Tools for Reporting and Communicating Evaluation Findings Using NVivo
Texas B
350 Costs, Effectiveness, Benefits, and Economics Skill-building
New Cost Tools for The Evaluator‘s Toolkit
Texas C
352 Evaluation Use TIG
Panel
Evaluating Program Interventions in a Rapidly Changing World: Exploring the Potential of Mid-term Reviews…
Texas E
353 Research on Evaluation TIG
Business Meeting Research on Evaluation TIG Business Meeting
Evaluation 2010: Thursday, November 11, 3:35 PM – 4:20 PM
Texas F
Page 64
Summary of Sessions for Thursday, November 11, 3:35 PM to 4:20 PM, Continued
No Primary Sponsor
Session
Session Title
Room
354 Extension Education Evaluation TIG
Think Tank
Thinking Again About Concept Mapping
Crockett A
355 Business and Industry TIG
Multipaper
Behavioral and Systematic Causal Influences in Health and Safety
Crockett B
356 AEA Conference Committee
MultiPaper
Differing Perspectives of Quality Throughout an Evaluation
Crockett C
357 Crime and Justice TIG
Business
Crime and Justice TIG Business Meeting and Paper Presentations
Crockett D
358 Graduate Student and New Evaluator TIG
Business Meeting Graduate Student and New Evaluators TIG Business Meeting
Seguin B
359 International and Cross-cultural Evaluation TIG Expert Lecture
Julia Child and Richard Feynman: An Oblique Approach to Evaluation Quality
Republic A
360 Health Evaluation TIG
Panel
Improving the Design, Methods, and Data Quality of a Public Health Outcome Monitoring Project
Republic B
361 Theories of Evaluation TIG
Business Meeting Theories of Evaluation TIG Business Meeting
Evaluation 2010: Thursday, November 11, 3:35 PM – 4:20 PM
Republic C
Page 65
Thursday, 3:35 pm to 4:20 pm
322 - Truth, Beauty, and Justice: A Conversation With
Plenary Speakers
Panel to be held in Lone Star A
Sponsored by the Presidential Strand
 Chair - Valerie J Caracelli, United States
Government Accountability Office
 Chair - Rodney Hopson, Duquesne University
 Discussant - James Earl Davis, Temple University
Truth, Beauty, and Justice: A Conversation With Plenary
Speakers
 Crispin Sartwell, Dickinson College; and Psyche WilliamsForson, University of Maryland
323 - Developmental Evaluation for Complex
Systems: Quality as Speed and Adaptability
Expert Lecture to be held in Lone Star B
Sponsored by the Systems in Evaluation TIG
 Michael Quinn Patton, Utilization-Focused Evaluation
324 - Exploring the Multiple Roles of Collaborative,
Participatory, and Empowerment Evaluators
Think Tank to be held in Lone Star C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Presenter - David Fetterman, Fetterman & Associates
 Discussants - Abraham Wandersman, University of South
Carolina; Liliana Rodriguez-Campos, University of South
Florida; Lyn Shulha, Queen's University at Kingston; and Rita
O'Sullivan, University of North Carolina at Chapel-Hill
325 - Evaluation and Nonprofits: Learning From
Experience
Multipaper to be held in Lone Star D
Sponsored by the Non-profit and Foundations Evaluation TIG
 Chair - Charles Gasper, Missouri Foundation for Health
Outcome Measurement and Nonprofit Relational Work
 Lehn Benjamin, George Mason University
Enriching the Quality of Consultation and Research With Small
Community-based Nonprofit Organizations: Ten Insights and
Understandings From the Work of a University-based
Consulting Center
 Leah Neubauer, Douglas Cellar, and Gary Harper, DePaul
University
326 - Bayesian Mixture Modeling Versus Traditional
Meta-analysis: Examining the Treatment Advantage
Research Using Three Meta-analytic Approaches
MultiPaper to be held in Lone Star E
Sponsored by the Quantitative Methods: Theory and Design TIG
 Chair - Karen Larwin, Youngstown State University
Bayesian Mixture Modeling: Also Known as Bayesian Metaanalysis
 James Michael Menke, University of Arizona
Traditional Meta-Analytic Approach for Comparative
Effectiveness Research (CER)
 Karen Larwin, Youngstown State University
327 - Evaluating a Multi-site Twenty-first Century
Learning Program: Strategies and Results
Panel to be held in Lone Star F
Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG
 Chair - Mary Nistler, Learning Point Associates
Order From Chaos: Building a Framework for the Evaluation of
a Multi-site School Reform Initiative
 Mary Nistler and Manolya Tanyu, Learning Point
Associates
Strategies for Evaluating Online Communities of Practice
 Jonathan Margolin, Learning Point Associates
328 – Roundtable in Mission A
Sponsored by the Evaluation Use TIG
What Role Should the Evaluator Take When a Project Is OffTrack?
 Robert J Ruhf and Mary Anne Sydlik, Western Michigan
University
329 - Quality Evaluation Includes Everyone! Using
Universal Design to Make Your Evaluation More
Accessible
Skill-building Workshop to be held in Mission B
Sponsored by the Disabilities and Other Vulnerable
Populations and the Graduate Student and New Evaluator TIGs
 Jennifer Sulewski, University of Massachusetts, Boston;
Richard Petty, Independent Living Research Utilization; and
June Gothberg, Western Michigan University
330 - Marketing the Online You: Developing and
Maintaining a Professional Online Presence
Demonstration to be held in Bowie A
Sponsored by the Independent Consulting TIG
 Shelly Mahon, University of Wisconsin, Madison
Evaluation 2010: Thursday, November 11, 3:35 PM – 4:20 PM
Page 66
331 - Overcoming Specific Challenges to Service
Delivery Within Hispanic-American Communities
335 - Using Business Frameworks to Evaluate
Program Impact on Student Learning
Multipaper to be held in Bowie B
Sponsored by the Multiethnic Issues in Evaluation TIG
 Chair - Leona Johnson, Hampton University
Different Strokes for Different Folks: Designing a Culturally
Grounded Implementation Evaluation of Grantees Serving a
Diverse Minority
 Luis R Torres, University of Houston; Karen Gardiner, The
Lewin Group; Luis H Zayas, Washington University in St Louis;
and Allison Hyra, Cara Kundrat, and Whitney Engstrom, The
Lewin Group
Issues in Evaluating Service Delivery to Migrant Farm Workers
With Disabilities
 Karen Cinnamond and Joanne Farley, Human
Development Institute
Panel to be held in Travis A
Sponsored by the Assessment in Higher Education TIG
 Chair - Norena Norton Badway, San Francisco State
University
Using Business Frameworks to Evaluate Program Impact on
Student Learning
 Norena Norton Badway, San Francisco State University
Challenges in Data Collection Using Kirkpatrick's Model
 Rachel Rich, University of the Pacific
332 - Advocacy Capacity Nuance: Helpful, or Too
Much? Considering the Cases of Assessing
Coalitions Versus Networks and Grassroots
Mobilization Versus Community Organizing
Panel to be held in Bowie C
Sponsored by the Advocacy and Policy Change TIG
 Chair and Discussant - Astrid Hendricks, California
Endowment
You Say Network, I Say Coalition: What is the Difference and
Why Should Evaluators Care?
 Jared Raynor, TCC Group
You Say Power, I Say Influence: How Helpful Is It to Link or
Separate Community Organizing and Advocacy Evaluation
Approaches?
 Susan Hoechstetter, Alliance for Justice
333 – Rounddtable in Goliad
Sponsored by the Social Work TIG
Enhancing Evaluation Quality in a Developing Context: A South
African Case Study
 Willem Roestenburg, University of Johannesburg; and
Emmerentie Oliphant, Stephen F Austin State University
334 – Roundtable in San Jacinto
Sponsored by the Disaster and Emergency Management
Evaluation TIG
Being on Target: Evaluation Techniques for Disaster Relief
Agencies
 LaJuana Hector, Texas A&M University
336 - From Game Shows, to Universities, to
Cooperative Extension: The Benefits, Challenges, and
Logistics of Using an Audience Response System
("Clickers") as an Evaluation Tool in Extension
Programs
Demonstration to be held in Travis B
Sponsored by the Integrating Technology Into Evaluation TIG
 Michelle Currie, Cornell University
337 - Canadian Evaluation Society's Professional
Designation Program - How Our Members Are
Applying to be Designated as a Credentialed
Evaluator
Demonstration to be held in Travis C
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG
 Presenters - Keiko Kuji-Shikatani, Ontario Ministry of
Education; Christine Frank, Christine Frank & Associates; and
Martha McGuire, Cathexis Consulting
 Discussant - Jean A King, University of Minnesota
Presenters - Keiko Kuji-Shikatani, Ontario Ministry of Education
338 - Environmental Scans Using State Legislative
Databases for Health Policy Research
Demonstration to be held in Travis D
Sponsored by the Health Evaluation TIG
 Sasigant O'Neil and Mindy Lipson, Mathematica Policy
Research
339 - Including Sexual Orientation Information in an
Evaluation: When, Why, and How?
MultiPaper to be held in Independence
Sponsored by the Lesbian, Gay, Bisexual, and Transgender
Issues TIG
 Chair - Joe E Heimlich, Ohio State University
Gay and Lesbian Visitors in Museum Evaluation
 Joe E Heimlich, Ohio State University
Measuring Sexual Orientation in the Arizona Health Survey
 John T Daws, University of Arizona
c
Evaluation 2010: Thursday, November 11, 3:35 PM – 4:20 PM
Page 67
Thursday, 3:35 pm to 4:20 pm, continued
340 - Distance Education and Other Educational
Technologies TIG Business Meeting
Business Meeting to be held in Presidio A
Sponsored by the Distance Education and Other Educational
Technologies TIG
 TIG Leader - Talbot Bielefeldt, International Society for
Technology in Education
341 - The United States Government Accountability
Office's (GAO) New Yellow Book: What's in It for
Evaluators?
Think Tank to be held in Crockett D
Sponsored by the AEA Conference Committee
 Michael Hendricks, Independent Consultant; and Rakesh
Mohan, Idaho State Legislature
342 - Science, Technology, Engineering, and
Mathematics (STEM) Recruitment Programs:
Evaluation of Effectiveness
Multipaper to be held in Presidio C
Sponsored by the College Access Programs TIG
 Chair - Kurt Burkum, ACT
Measurable Indicators of Effectiveness for National Science
Foundation Advanced Technological Education Centers/
Projects
 Kelly Robertson and Stephen Magura, Western Michigan
University
Beyond the Program: Evaluating the Institutional Impact of
Initiatives to Increase the Participation of Underrepresented
Minority College Students in Biomedical and Behavioral Science
 Jack Mills, Independent Consultant; and Maria Elena
Zavala, California State University, Northridge
343 – Roundtable in Bonham A
Sponsored by the Research, Technology, and Development
Evaluation TIG
Methodological Issues in Evaluating Potentially Transformative
Research
 Mary Beth Hughes, Bhavya Lal, and Asha Balakrishnan,
Science and Technology Policy Institute
344 - Evaluation: Understanding the Context and
Managing Tensions
Multipaper to be held in Bonham B
Sponsored by the Non-profit and Foundations Evaluation TIG
 Chair - David Campbell, University of California, Davis
In Praise of Going Local: The Promise of Workarounds as
Evaluative Indicators
 David Campbell, University of California, Davis
Strengths and Limitations of Nonprofit Evaluations in Times of
Organizational Change: The Case of a Volunteer Service and a
Disability Advocacy Organization Evaluating Their Programs
Concurrently With the Revision of Their Strategic Plan
 Michele Tarsilla, Western Michigan University
345 - Concordances: Development and Appropriate
Uses
MultiPaper to be held in Bonham C
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Rochelle Michel, Educational Testing Service
The Concordance Development Process
 Rochelle Michel, Educational Testing Service
Proper Use of Concordances
 Michael Walker, Educational Testing Service
346 - Building Evaluation Capacity Among School
Leaders
Multipaper to be held in Bonham D
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Phyllis Clay, Albuquerque Public Schools
 Discussant - Sheryl Gowen, Georgie State University
The Role of Evaluation in Educational Reform: What Evaluation
Skills Should Be Required of School Leaders?
 Tara Shepperson, Eastern Kentucky University
Evaluation Quality and Program Evaluation Skills for School
Leaders: An Analysis of School Improvement Plans
 Tamara M Walser, University of North Carolina at Wilmington
347 - Toolkit for Evaluating Impacts of Public
Participation in Scientific Research
Demonstration to be held in Bonham E
Sponsored by the Environmental Program Evaluation TIG
 Tina Phillips and Richard Bonney, Cornell Univeristy
348 - Strategies for Evaluation Quality in Government
MultiPaper to be held in Texas A
Sponsored by the Government Evaluation TIG and the Crime
and Justice TIG
 Chair - Margaret Braun, Oregon Department of Corrections
Approaching Multi-site Evaluations in Government: A Process
Evaluation of Drug Court and Treatment as Usual
 Shannon Myrick, Oregon Youth Authority; and Margaret
Braun, Oregon Department of Corrections
Implementing a Randomized Evaluation Design: Toward a
Higher Level of Evaluation Quality
 Margaret Braun, Oregon Department of Corrections;
Shannon Myrick, Oregon Youth Authority; and Kelly Officer,
Oregon Criminal Justice Commission
Evaluation 2010: Thursday, November 11, 3:35 PM – 4:20 PM
Page 68
349 - Techniques and Tools for Reporting and
Communicating Evaluation Findings Using NVivo
356 - Differing Perspectives of Quality Throughout an
Evaluation
Demonstration to be held in Texas B
Sponsored by the Qualitative Methods TIG
 Kari Greene, Oregon Public Health Division
MultiPaper to be held in Crockett C
Sponsored by the AEA Conference Committee
 Chair - Andrew Lejeune, University of Alberta
Examining Evaluators‘ and Stakeholders‘ Perspectives of Quality
 Stanley Varnhagen, Jason Daniels, Andrew Lejeune, and
Cheryl Poth, University of Alberta
How Perspectives of Quality Can Change as Evaluations Evolve
 Jason Daniels, Stanley Varnhagen, Andrew Lejeune, and
Cheryl Poth, University of Alberta
350 - New Cost Tools for The Evaluator‘s Toolkit
Skill-building Workshop to be held in Texas C
Sponsored by the Costs, Effectiveness, Benefits, and
Economics TIG
 Nadini Persaud, University of the West Indies
352 - Evaluating Program Interventions in a Rapidly
Changing World: Exploring the Potential of Mid-term
Reviews, Real Time and Prospective Evaluation
Panel to be held in Texas E
Sponsored by the Evaluation Use TIG
 Chair - Marvin Taylor-Dormond, World Bank
 Discussant - Patrick Grasso, World Bank
Evaluating Program Interventions in a Rapidly Changing World:
Exploring the Potential of Mid-term Reviews
 Chris Olson, European Bank for Reconstruction and
Development
Evaluating Program Interventions in a Rapidly Changing World:
Exploring the Potential Real Time and Prospective Evaluation
 Stoyan Tenev, World Bank
353 - Research on Evaluation TIG Business Meeting
Business Meeting to be held in Texas F
Sponsored by the Research on Evaluation TIG
 TIG Leaders - Christina Christie, University of California,
Los Angeles; and Tarek Azzam, Claremont Graduate University
354 - Thinking Again About Concept Mapping
Think Tank to be held in Crockett A
Sponsored by the Extension Education Evaluation TIG
 Benjamin Silliman, North Carolina State University
357 - Crime and Justice TIG Business Meeting and
Paper Presentations
Business Meeting to be held in Crockett D
Sponsored by the Crime and Justice TIG
 TIG Leader - Roger Przybylski, RKC Group
Drug Court Evaluation on a Shoestring Budget
 Roger Przybylski, RKC Group
Lessons Learned Evaluating an International Domestic
Violence Program
 Cecilia Hegamin-Younger, TUI University; and Rohan
Jeremiah, St George's University
358 - Graduate Student and New Evaluators TIG
Business Meeting
Business Meeting to be held in Seguin B
Sponsored by the Graduate Student and New Evaluator TIG
 TIG Leaders - Gargi Bhattacharya, Southern Illinois
University Carbondale; Nora Gannon, University of Illinois at
Urbana-Champaign; and Jason Burkhardt, Western Michigan
University
359 - Julia Child and Richard Feynman: An Oblique
Approach to Evaluation Quality
Expert Lecture to be held in Republic A
Sponsored by the International & Cross-cultural Evaluation TIG
 Alice Willard, International Relief & Development
355 - Behavioral and Systematic Causal Influences
in Health and Safety
Multipaper to be held in Crockett B
Sponsored by the Business and Industry TIG
 Chair - Thomas Ward, United States Army
Evaluation of Health and Safety Incidents: The Search for
Systemic Causes and Solutions
 Katherine King and Judith Daltuva, University of Michigan
Organizational Assessment for Finding the Right Mode of
Human-Robot Interaction
 Se Jin Heo and Jim Brown, University of Minnesota
Did you know? AEA has over 6500 members, up 14%
from last year at this time.
Evaluation 2010: Thursday, November 11, 3:35 PM – 4:20 PM
Page 69
Thursday, 3:35 pm to 4:20 pm, continued
360 - Improving the Design, Methods, and Data
Quality of a Public Health Outcome
Panel to be held in Republic B
Sponsored by the Health Evaluation TIG
 Chair and Discussant - Gary Uhl, Centers for Disease
Control and Prevention (CDC)
The Community-based Organizations Behavioral Outcomes
Project: Identifying Challenges and Lessons Learned to
Improve Evaluation Design, Methods, and Data Quality
 Andrea Moore and Elizabeth Kalayil, MANILA Consulting
Group Inc; and Tobey Sapiano, Holly Fisher, Alpa Patel-Larson,
and Gary Uhl, Centers for Disease Control and Prevention
The Application of Lessons Learned to the Design, Methods
and Data Quality of The Community-based Organizations
Outcome Monitoring Project
 Tobey Sapiano and Gary Uhl, Centers for Disease Control
and Prevention; Andrea Moore, Elizabeth Kalayil, and Adanze
Eke, MANILA Consulting Group Inc; Holly Fisher, and Tanisha
Grimes, Centers for Disease Control and Prevention; Tamika
Hoyte, MANILA Consulting Group Inc; Alpa Patel-Larson,
Centers for Disease Control and Prevention; Ekaterine
Shapatava, Northrop Grumman Corporation
361 - Theories of Evaluation TIG Business Meeting
Business Meeting to be held in Republic C
Sponsored by the Theories of Evaluation TIG
 TIG Leaders - James Griffith, Claremont Graduate
University; and Bianca Montrosse, Western Carolina University
Evaluation 2010: Thursday, November 11, 3:35 PM – 4:20 PM
Page 70
Notes:
Evaluation 2010: Thursday, November 11, 3:35 PM – 4:20 PM
Page 71
Summary of Sessions for Thursday, November 11, 4:30 PM to 6:00 PM
No Primary Sponsor
Session
Session Title
Room
362 Presidential Strand
Skill-building
Using the Program Evaluation Standards, Third Edition, to Define and Enhance Evaluation Quality
Lone Star A
363 Systems in Evaluation TIG
Business Meeting Systems in Evaluation TIG Business Meeting and Presentation: Meet and Greet With Systems in Evaluation Authors
Lone Star B
364 Collaborative, Participatory & Empowerment
Skill-building
Lone Star C
365 Non-profit and Foundations Evaluation TIG
Business Meeting Non-profits & Foundations Evaluation TIG Business Meeting
Lone Star D
366 Quantitative Methods: Theory and Design TIG
Demonstration
Lone Star E
The Biggest Winners: Empowerment Evaluation Exercises to Strengthen Primary Prevention Capacity
Fundamentals of Power Analysis and Sample Size Determination
367 Cluster, Multi-site & Multi-level Evaluation TIG Business Meeting TIG Business Meeting and Demonstration: A Mixed Methods Approach to Measurement for Multi-site Evaluation
Lone Star F
368 Disabilities and Other Vulnerable Populations
Roundtable
Rotation I: Special Populations: Strategies for Collecting Data, Giving Voice
Rotation II: Toward Universal Design for Evaluation: Continuing the Conversation
Mission A
369 Evaluation Policy TIG
Multipaper
Historical Shifts in Evaluation Policy and Evaluation Practice: What We've Learned About Quality Evaluation
Mission B
370 Independent Consulting TIG
Business Meeting Independent Consulting TIG Business Meeting
Bowie A
371 Multiethnic Issues in Evaluation TIG
Panel
Bowie B
372 Indigenous Peoples in Evaluation TIG TIG
Business Meeting Indigenous Peoples in Evaluation TIG TIG Business Meeting
Bowie C
373 Alcohol, Drug Abuse, and Mental Health TIG
Roundtable
Rotation I: Designing for Change: The Experience of the Quitline Iowa Evaluation
Rotation II: Adapting the Strategic Prevention Framework Model for Use in Suicide Prevention…
Goliad
374 Evaluating the Arts and Culture TIG
Roundtable
Rotation I: The Beauty of Internal Evaluation in the Arts: Using Metaphors and Symbols to Develop the Evaluation Capacity…
Rotation II: Evaluating Innovation and Capacity Building in Arts Organizations: Challenges and Lessons Learned…
San Jacinto
375 Assessment in Higher Education TIG
Multipaper
Evaluation Without Borders: Lessons From Other Countries
Travis A
376 Evaluation Managers and Supervisors TIG
Business Meeting TIG Business Meeting and Panel: Reflections on Evaluation Management Expertise and Competencies…
Travis B
377 Needs Assessment TIG
Panel
Face to Face With the Authors of the Needs Assessment Kit: Challenging Questions (With a Twist)…
Travis C
378 Health Evaluation TIG
MultiPaper
Health Indicator Systems for Evaluation of Local, State, and National Chronic Disease Prevention and Control Initiatives
Travis D
379 Human Services Evaluation TIG
Panel
Quality by Design: Statewide Human Services Workforce Evaluation Using an Integrated Framework
Independence
380 Quantitative Methods: Theory and Design TIG
Multipaper
Assessing Change Over Time
Presidio A
381 Org Learning & Evaluation Capacity Bldg TIG
Panel
A Systems Approach to Building and Assessing Evaluation Plan Quality
Presidio B
382 AEA Conference Committee
Demonstration
Data for All: Democratizing Data Without Compromising Quality
Presidio C
383 Collaborative, Participatory & Empowerment
Roundtable
Rotation I: Evaluation Goes to College: The Collaborative Evaluation of a Graduate Program
Rotation II: Working Together to Design Effective Evaluation Tools
Bonham A
385 Pre-K - 12 Educational Evaluation TIG
Multipaper
Education Evaluation: Connecting Professional Development to Changes in Classroom Practice
Bonham C
386 Pre-K - 12 Educational Evaluation TIG
Multipaper
Addressing Schools as Organizations in Educational Evaluation
Bonham D
387 Research, Technology, and Development
Panel
Evaluating the Science of Discovery in Complex Health Systems: Challenges and Opportunities
Bonham E
Evaluation Quality From a Federal Perspective
Evaluation 2010: Thursday, November 11, 4:30 PM – 6:00 PM
Page 72
Summary of Sessions for Thursday, November 11, 4:30 PM to 6:00 PM, Continued
No Primary Sponsor
Session
Session Title
Room
388 Government Evaluation TIG
Business
TIG Business Meeting and Panel: Happy Anniversary to Us! Celebrating Twenty Years of Government Evaluation
Texas A
389 Theories of Evaluation TIG
MultiPaper
Using Logic Models to Facilitate Comparisons of Evaluation Theory
Texas B
390 Mixed Methods Evaluation TIG
Multipaper
Examining the Mixing in Mixed Methods Evaluation
Texas C
391 Research, Technology, and Development
Panel
Linking Professional Associations to Advance the Study of Science and Innovation Policy
Texas D
392 Evaluation Use TIG
Multipaper
Case Studies in Evaluation Use
Texas E
393 Research on Evaluation TIG
Multipaper
Research on Evaluation Standards and Methods
Texas F
394 Extension Education Evaluation TIG
Multipaper
Evaluation Methodology
Crockett A
395 Business and Industry TIG
Demonstration
Process Lessons for Applied Research and Evaluation from Capital Projects
Crockett B
396 International and Cross-cultural Evaluation TIG Demonstration
Improving the Quality of Peacebuilding Evaluation
Crockett C
397 Disaster and Emergency Management Eval
Panel
Haiti: Challenges in Emergency Response and Recovery Bring Challenges (and Innovation) in Evaluation
Crockett D
398 Graduate Student and New Evaluator TIG
Multipaper
Student Centered Issues in Evaluation
Seguin B
Impact Evaluation at the Millennium Challenge Corporation (MCC): Theory, Application, and Complications
Republic A
399 International and Cross-cultural Evaluation TIG Panel
400 Health Evaluation TIG
Business Meeting TIG Business Meeting and Presentation: Bridging the Evidence Gap in Obesity Prevention – A Framework to Inform…
Republic B
401 Collaborative, Participatory & Empowerment
Panel
Republic C
Building Capacity for Youth Participatory Evaluation
Evaluation 2010: Thursday, November 11, 4:30 PM – 6:00 PM
Page 73
Thursday, 4:30 pm to 6:00 pm
362 - Using the Program Evaluation Standards, Third
Edition, to Define and Enhance Evaluation Quality
Skill-building Workshop to be held in Lone Star A
Sponsored by the Presidential Strand
 Donald Yarbrough, University of Iowa; Lyn
Shulha, Queen's University at Kingston;
Rodney Hopson, Duquesne University; Flora
Caruthers, Florida Legislature
363 - Systems in Evaluation TIG Business Meeting
and Presentation: Meet and Greet With Systems in
Evaluation Authors
Business Meeting to be held in Lone Star B
Sponsored by the Systems in Evaluation TIG
 TIG Leaders - Janice Noga, Pathfinder Evaluation and
Consulting; Margaret Hargreaves, Mathematica Policy
Research; and Mary McEathron, University of Minnesota
Presenter - Janice Noga, Pathfinder Evaluation and Consulting
364 - The Biggest Winners: Empowerment Evaluation
Exercises to Strengthen Primary Prevention Capacity
Skill-building Workshop to be held in Lone Star C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Sandra Ortega, Ohio DELTA and Rape Prevention
Education; Rebecca Cline, The Ohio Domestic Violence
Network; and Amy Bush Stevens, Owl Creek Consulting
365 - Non-profits & Foundations Evaluation TIG
Business Meeting
Business Meeting to be held in Lone Star D
Sponsored by the Non-profit and Foundations Evaluation TIG
 TIG Leaders - Lester Baxter, Pew Charitable Trusts;
Charles Gasper, Missouri Foundation for Health; Joanne
Carman, University of North Carolina at Charlotte; and Helen
Davis Picher, William Penn Foundation
366 - Fundamentals of Power Analysis and Sample
Size Determination
Demonstration to be held in Lone Star E
Sponsored by the Quantitative Methods: Theory and Design TIG
 Steven Pierce, Michigan State University
367 - Cluster, Multi-site, and Multi-level TIG
Business Meeting and Demonstration: A Mixed
Methods Approach to Measurement for Multi-site
Evaluation
Business Meeting to be held in Lone Star F
Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG
 TIG Leaders - Rene Lavinghouze, Centers for Disease
Control and Prevention; and Martha Ann Carey, Maverick
Solutions
 Presenters - Fred Springer, Wendi Siebold, and Carrie
Petrucci, Evaluation, Management & Training Associates Inc
368 – Roundtables in Mission A
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Disabilities and Other Vulnerable
Populations TIG
Rotation 1: Toward Universal Design for Evaluation: Continuing
the Conversation
 Jennifer Sulewski, University of Massachusetts, Boston
Rotation 2: Special Populations: Strategies for Collecting
Data, Giving Voice
 Sheila A Arens and Andrea Beesley, Mid-Continent
Research for Education and Learning
369 - Historical Shifts in Evaluation Policy abnd
Evaluation Practice: What We've Learned About
Quality Evaluation
Multipaper to be held in Mission B
Sponsored by the Evaluation Policy TIG
 Chair - Ruth Anne Gigliotti, Synthesis Professional
Services Inc.
 Discussant - Catherine Callow-Heusser, EndVision
Research and Evaluation LLC
The Interface Between Evaluation Policy, Quality Evaluation,
and Mission/Service Alignment: A Comparative Analysis of
Human Service Organizations
 Kristin Kaylor Richardson, Western Michigan University
The Interplay of Evaluation Requirements and Political,
Economic, and Technological Developments: A Historical
Study of the Elementary and Secondary Education Act From
1965 to 2005
 Maxine Gilling, Western Michigan University
Importing Randomized Evaluations From Medicine to
Education and International Development:
Pitfalls, Policy Implications, and Recommendations
 Rahel Kahlert, University of Texas, Austin
Evaluation 2010: Thursday, November 11, 4:30 PM – 6:00 PM
Page 74
370 - Independent Consulting TIG Business Meeting
374 – Roundtables in San Jacinto
Business Meeting to be held in Bowie A
Sponsored by the Independent Consulting TIG
 TIG Leaders - Frederic Glantz, Kokopelli Associates LLC;
Rita Fierro, Independant Consultant; and Michelle Baron, The
Evaluation Baron LLC
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
371 - Evaluation Quality From a Federal Perspective
Panel to be held in Bowie B
Sponsored by the Multiethnic Issues in Evaluation TIG
 Chair - Elmima Johnson, National Science Foundation
Evaluation for Science, Technology, Engineering and Math
Education (STEM) Education Research and Development
 Bernice Anderson, National Science Foundation
National Science Foundation Committee of Visitors: Evalaution
by Experts
 Fay Korsmo and Connie Kubo Della-Piana, National
Science Foundation
Evaluation Quality: Threats and Solutions
 Clemencia Cosentino de Cohen, Urban Institute
Comparing Quality Standards in Audit and Evaluation
 Valerie J Caracelli, United States Government
Accountability Office
Assessment of Federal Contractor Evaluation Services
 Elmima Johnson, National Science Foundation
372 - Indigenous Peoples in Evaluation TIG Business
Meeting
Business Meeting to be held in Bowie C
Sponsored by the Indigenous Peoples in Evaluation TIG
 TIG Leaders - Katherine A Tibbetts, Kamehameha
Schools; Kalyani Rai, University of Wisconsin, Milwakee; and
Joan LaFrance, Mekinak Consulting
373 – Roundtables in Goliad
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG
Rotation 1: Designing for Change: The Experience of the
Quitline Iowa Evaluation
 Disa Cornish and Gene Lutz, University of Nothern Iowa
Rotation 2: Adapting the Strategic Prevention Framework
Model for Use in Suicide Prevention and Other Abbreviated
Funding Cycles Benefiting From Grantee, Stakeholder,
Evaluator Collaboration
 Trena Anastasia and Trish Worley, University of Wyoming
Sponsored by the Evaluating the Arts and Culture TIG
Rotation 1: Evaluating Innovation and Capacity Building in Arts
Organizations: Challenges and Lessons Learned in Capturing
the Complexity
 Mary Piontek, EmcArts Inc
Rotation 2: The Beauty of Internal Evaluation in the Arts: Using
Metaphors and Symbols to Develop the Evaluation Capacity of
the Board and Staff
 Kathleen Norris, Plymouth State University
375 - Evaluation Without Borders: Lessons From
Other Countries
Multipaper to be held in Travis A
Sponsored by the Assessment in Higher Education TIG
 Chair - George Reinhart, University of Maryland
Quality and University Didactic: The Students‘ Perspectives
Cues for Evaluation
 Serafina Pastore, University of Bari
Conducting Meta-evaluation for Receiving Valid Information in
Student's Assessment of the Base of Competence‘s
 Victor Zvonnikov and Marina Chelyshkova, State University
of Management
Lessons Learned From an Improvement of Student Evaluations
of Faculty
 Yi-Hsing Chung and Yi-Fang Lee and Shiuh-Sheng Yu,
National Chi Nan University
376 - Evaluation Managers and Supervisors TIG
Business Meeting and Panel: Reflections on
Evaluation Management Expertise and
Competencies From Two Perspectives
Business Meeting to be held in Travis B
Sponsored by the Evaluation Managers and Supervisors TIG
 TIG Leaders - Ann Maxwell, United States Department of
Health and Human Services; Sue Hewitt, Health District of
Northern Larimer County; and Laura Feldman, University of
Wyoming
 Chair - Thomas Horwood, ICF International
Reflections on Evaluation Management Expertise and
Competencies From the Perspective of Public Agency
 Jennifer Broussard, Texas Education Agency
Reflections on Evaluation Management Expertise and
Competencies From the Perspective of a Consultant
 Thomas Horwood, ICF International
Evaluation 2010: Thursday, November 11, 4:30 PM – 6:00 PM
Page 75
Thursday, 4:30 pm to 6:00 pm, continued
377 - Face to Face With the Authors of the Needs
Assessment Kit: Challenging Questions (With a Twist)
and Hopefully Meaningful Answers
Panel to be held in Travis C
Sponsored by the Needs Assessment TIG
 Chair - James Altschuld, The Ohio State University
 Discussant - Hsin-Ling Hung, University of North Dakota
A Quick Overview of the Kit
 James Altschuld, The Ohio State University
Pesky Analysis and Prioritization in Needs Assessment
 Jeffry White, University of Louisiana, Lafayette
Where the Rubber Meets the Road: Taking Action for Change
 Laurie Stevahn, Seattle University; and Jean A King,
University of Minnesota
378 - Health Indicator Systems for Evaluation of
Local, State, and National Chronic Disease
Prevention and Control Initiatives
MultiPaper to be held in Travis D
Sponsored by the Health Evaluation TIG
 Chair - Todd Rogers, Public Health Institute
The First Illusion of Tobacco: Monitoring and Countering
Tobacco Industry Influence Through the Application of
Evaluation Indicators
 Erika Fulmer, Centers for Disease Control and Prevention;
Todd Rogers, Public Health Institute; and Martha Engstrom,
Shanta Dube, and Steven Babb, Centers for Disease Control
and Prevention
Using a Modified Community of Practice Approach to
Operationalize Indicators for Heart Disease and Stroke
Prevention
 Hilary Wall, Centers for Disease Control and Prevention;
Todd Rogers, Public Health Institute; and Susan Ladd, Centers
for Disease Control and Prevention
Development and Implementation of Community Strategies
and Measurements to Prevent Obesity
 Rosanne Farris, Laura Kettel Khan, and Jan Jernigan,
Centers for Disease Control and Prevention
379 - Quality by Design: Statewide Human Services
Workforce Evaluation Using an Integrated Framework
Panel to be held in Independence
Sponsored by the Human Services Evaluation TIG
 Chair - Chris Mathias, California Social Work Education
Center
 Discussant - Todd Franke, University of California,
Los Angeles
Evaluating a Statewide Public Child Welfare Education Program
 Susan Jacquet and Elizabeth Gilman, California Social
Work Education Center
Statewide Evaluation of In-service Training
 Barrett Johnson, Leslie Zeitler, and Chris Lee, California
Social Work Education Center
Evaluation of the Mental Health Educational Stipend Program
 Gwen Foster and Sevaughn Banks, California Social Work
Education Center
Integration Framework
 Sherrill Clark and Amy Benton, California Social Work
Education Center
380 - Assessing Change Over Time
Multipaper to be held in Presidio A
Sponsored by the Quantitative Methods: Theory and Design TIG
 Chair - Wendy Garrard, University of Michigan
Event History Analysis: Modeling Occurrences of Events Over
Time
 Blair Stephenson, Christine Starr, and Melissa SchaumNguyen, Los Alamos National Laboratory
The Use of Piecewise Growth Models to Estimate a Staggered
Interrupted Time Series
 Keith Zvoch and Joseph Stevens, University of Oregon; and
Drew Braun, Bethel School District
The Z-Kids: What Happens to Individual Clients Over Time?
Outcomes With Clinical, Program, and Evaluation Salience
 Richard Wood and Judith Francis, Pima Prevention
Partnership
381 - A Systems Approach to Building and Assessing
Evaluation Plan Quality
Panel to be held in Presidio B
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG and the Systems in Evaluation TIG
 Chair - Jennifer Urban, Montclair State University
 Discussant - William M Trochim, Cornell University
The Systems Evaluation Protocol and Evaluation Plan Quality:
Introduction and Definition
 Monica Hargraves and Margaret Johnson, Cornell
University
Capturing Quality: Rubrics for Logic Models, and Evaluation
Plans
 Margaret Johnson and Wanda Casillas, Cornell University
Inquiry in Evaluation: Connecting Capacity Building to
Education Research
 Jane Earle and Thomas Archibald, Cornell University
Early Indications of Process Use Outcomes Associated With
Evaluation Planning Through the Systems Evaluation Protocol
 Thomas Archibald, Jane Earle, and Monica Hargraves,
Cornell University
Evaluation 2010: Thursday, November 11, 4:30 PM – 6:00 PM
Page 76
382 - Data for All: Democratizing Data Without
Compromising Quality
386 - Addressing Schools as Organizations in
Educational Evaluation
Demonstration to be held in Presidio C
Sponsored by the AEA Conference Committee
 Presenters - Sarah Kohler Chrestman and Lisanne Brown,
Louisiana Public Health Institute
Multipaper to be held in Bonham D
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Diane Binder, The Findings Group LLC
 Discussant - Chad Green, Loudoun County Public Schools
Documenting Patterns in Teacher‘s Relationships: Their Impact
on K-12 Education
 Kathy Gullie, State University of New York at Albany
The Use of School Climate Data for School Improvement
 Sarah Gareau, South Carolina Educational Policy Center;
Diane Monrad and John May, University of South Carolina; Karen
Price and Diana Mindrila, South Carolina Educational Policy
Center; and Tomonori Ishikawa, University of South Carolina
From Monitoring to Evaluation and Back Again: Implications
for Organizational Leadership, Budget, and Success
 Lisa Schmitt, Karen Cornetto, and Lindsay Lamb, Austin
Independent School District
The Utility of Situation Models for Capturing the Present State
of School-wide Initiatives
 Chad Green, Loudoun County Public Schools
383 – Roundtables in Bonham A
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
Rotation 1: Evaluation Goes to College: The Collaborative
Evaluation of a Graduate Program
 Seriashia Chatters, EunKyeng Baek, Thanh Pham, and
Yvonne Hunter, University of South Florida
Rotation 2: Working Together to Design Effective Evaluation
Tools
 Rebeca Diaz, WestEd
385 - Education Evaluation: Connecting Professional
Development to Changes in Classroom Practice
Multipaper to be held in Bonham C
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Bianca Montrosse, Western Carolina University
 Discussant - Susan Connors, University of Colorado,
Denver
Applying Guskey‘s Model for Evaluating Professional
Development to a Math and Science Partnership Program:
Successes and Challenges in Collecting Data Across Schools
and Grade Levels
 Carol Haden, Magnolia Consulting LLC; and Jane Kirkley,
Northern Arizona University
Using the Transtheoretical Model of Readiness for Change to
Evaluate the True Impact of Evidence-based Professional
Development in the K-12 Setting
 Christa Smith and Katherine Sprott, Kansas State
University
Determining the Validity of Teacher Self-Reports as a CostEffective Strategy to Evaluate Teacher Performance
 Kasey McCracken, Oregon Health & Science University;
Gina Magharious, David Heil & Associates Inc; and Joe Sciulli,
National Science Teachers Association
Qualitative Analysis of Changes in Teachers' Knowledge,
Beliefs and Classroom Practices Based on Three Years of
Professional Development
 Carol Baldassari, Sabra Lee, and Rosalie Torres, Torres
Consulting Group
387 - Evaluating the Science of Discovery in Complex
Health Systems: Challenges and Opportunities
Panel to be held in Bonham E
Sponsored by the Research, Technology, and Development
Evaluation TIG
 Chair and Discussant - Alison Buchan, University of British
Columbia
An Evaluation Framework for Advancing the Science of
Evaluating Team Science: The Research on Academic Research
Initiative (RoAR)
 Cameron Norman, University of Toronto; Timothy Huerta,
Texas Tech University; Sharon Mortimer and Allan Best,
Michael Smith Foundation for Health Research; and Alison
Buchan, University of British Columbia
Advancing the Science of Evaluating Team Science: Psychosocial Factors and Related Outcomes From the RoAR Initiative
 Cameron Norman, University of Toronto; Timothy Huerta,
Texas Tech University; Sharon Mortimer, Michael Smith
Foundation for Health Research; and Alison Buchan, University
of British Columbia
Advancing the Science of Evaluating Team Science: Social
Network Outcomes From the RoAR Initiative
 Timothy Huerta, Texas Tech University; Cameron Norman,
University of Toronto; Sharon Mortimer, Michael Smith
Foundation for Health Research; and Alison Buchan, University
of British Columbia
Advancing the Science of Evaluating Team Science:
Scientometric-related Outcomes From the RoAR Initiative
 Sharon Mortimer, Michael Smith Foundation for Health
Research; Timothy Huerta, Texas Tech University; and Bianca
Cervantes and Alison Buchan, University of British Columbia
Evaluation 2010: Thursday, November 11, 4:30 PM – 6:00 PM
Page 77
Thursday, 4:30 pm to 6:00 pm, continued
388 - Government Evaluation TIG Business Meeting
and Panel: Happy Anniversary to Us! Celebrating
Twenty Years of Government Evaluation
Business Meeting to be held in Texas A
Sponsored by the Government Evaluation TIG
 TIG Leaders - Stanley Capela, HeartShare Human Services
of New York; David J Bernstein, Westat; and Sam Held, Oak
Ridge Institute for Science and Education
 Chair - Stanley Capela, HeartShare Human Services of
New York
Panel Discussion: How Has Government Evaluation Changed in
the Last Twenty Years?
 David J Bernstein, Westat; Maria Whitsett, Moak, Casey
and Associates; Rakesh Mohan, Idaho State Legislature;
Stanley Capela, HeartShare Human Services of New York
Keynote Address: How Has Evaluation Changed in the Last 20
to 50 Years?
 Joseph Wholey, University of Southern California
389 - Using Logic Models to Facilitate Comparisons
of Evaluation Theory
MultiPaper to be held in Texas B
Sponsored by the Theories of Evaluation TIG
 Chair - Marv Alkin, University of California, Los Angeles
 Discussant - Robin Lin Miller, Michigan State University
Visual Representations of Evaluation Theories
 Tanner LeBaron Wallace, University of Pittsburgh; and
Mark Hansen, University of California, Los Angeles
Visualizing Context Through Theory Decomposition
 Anne Vo, University of California, Los Angeles
Comparing Evaluation Activities Across Multiple Theories of
Practice
 Lisa Dillman, University of California, Los Angeles
Comparing the Intended Consequences of Various Theories of
Evaluation
 Rebecca JC Luskin, University of California, Los Angeles
The Utility of Visual Representations of Evaluation Theories
 Timothy Ho, University of California, Los Angeles
390 - Examining the Mixing in Mixed Methods
Evaluation
Multipaper to be held in Texas C
Sponsored by the Mixed Methods Evaluation TIG
 Chair - Jori Hall, University of Georgia
 Discussant - Mika Yamashita, Academy for Educational
Development
Improving Public Awareness Campaign Evaluation Using Mixed
Methods Design
 Mary Kay Falconer, Ounce of Prevention Fund of Florida; W
Douglas Evans, George Washington University
What‘s the Right Mix? Lessons Learned Using A Mixed
Methods Evaluation Approach
 Nicole Leacock, Virginia Houmes, Nancy Mueller, and Gina
Banks, Washington University in St Louis; Amy Stringer-Hessel,
Missouri Foundation for Health; and Cheryl Kelly, Saint Louis
University
Triangulation in Evaluation Practice
 Hongling Sun, Nora Gannon, and Jennifer Greene,
University of Illinois at Urbana-Champaign
391 - Linking Professional Associations to Advance
the Study of Science and Innovation Policy
Panel to be held in Texas D
Sponsored by the Research, Technology, and Development
Evaluation TIG
 Chair - Susan Cozzens, Georgia Institute of Technology
View From the Atlanta Science and Technology Policy (S&T)
Conference and Others
 Susan Cozzens, Georgia Institute of Technology
View From the American Evaluation Association's Research,
Technology and Development Evaluation TIG
 Gretchen Jordan, Sandia National Laboratories
View From the Association for Public Policy Analysis and
Management
 Julia Melkers, Georgia Institute of Technology
View From the Academy of Management
 Gordon Kingsley, Georgia Institute of Technology
392 - Case Studies in Evaluation Use
Multipaper to be held in Texas E
Sponsored by the Evaluation Use TIG
 Chair - Jennifer Iriti, University of Pittsburgh
Process Evaluation for Program Improvement: Lessons From
the Interns for Indiana Program
 Omolola A Adedokun, Loran Carleton Parker, and Wilella
Burgess, Purdue University
Ensuring Program Quality: Lessons Learned From
Implementation Evaluation of the Kentucky Alternative
Certification in Special Education (KACSE) Program
 Imelda Castañeda-Emenaker, University of Cincinnati; and
Norma Wheat, Campbellsville University
Evaluation Synergy: A Multi-purpose Evaluation Design for
Fundraising, Applied Learning, and Community Service
 Nancy Rogers, Jennifer Williams, and Brian Powell,
University of Cincinnati
The Use of Evaluation in Agricultural Policy Making: The Case
of Mexico
 Alfredo Gonzalez Cambero and Salomon Salcedo Baca,
Food and Agriculture Organization of the United Nations
Evaluation 2010: Thursday, November 11, 4:30 PM – 6:00 PM
Page 78
393 - Research on Evaluation Standards and
Methods
Multipaper to be held in Texas F
Sponsored by the Research on Evaluation TIG
 Chair - Matthew Galen, Claremont Graduate University
Social Science Standards and Ethics: Development,
Comparative Analysis, and Issues for Evaluation
 Linda Mabry, Washington State University, Vancouver
Insight Into Evaluation Practice: Results of a Content Analysis
of Designs and Methods Used in Evaluation Studies Published
in North American Evaluation Focused Journals
 Christina Christie, University of California, Los Angeles;
and Dreolin Fleischer, Claremont Graduate University
The Dependability of Campbell Collaboration, Cochrane
Collaboration, and What Works Clearinghouse Reviews
 Chris Coryn, Michele Tarsilla, and Kristin Hobson, Western
Michigan University
Can Systematic Measurement of an Evaluations‘ Goodness of
Fit and Its Influence Determine Quality?
 Janet Clinton, University of Auckland
394 - Evaluation Methodology
Multipaper to be held in Crockett A
Sponsored by the Extension Education Evaluation TIG
 Chair - Paul Pope, Texas A&M University
Developing Surveys for Low-Literate Adults Receiving Extension
Education Classes
 Karen Franck, University of Tennessee, Knoxville
Optimizing Conditions for Success: An Extension Case Study in
Cross-program Surveys
 Gwen Willems, University of Minnesota
Creating a Cost-Benefits Analysis Calculator for Extension
Nutrition Education Programs
 Karen Franck and Joseph Donaldson, University of
Tennessee
Utilizing the Delphi Method to Identify Competencies and
Training to Help Reduce Turnover Among County Extension
Faculty
 Presenters - Diane Craig, University of Florida
397 - Haiti: Challenges in Emergency Response and
Recovery Bring Challenges (and Innovation) in
Evaluation
Panel to be held in Crockett D
Sponsored by the Disaster and Emergency Management
Evaluation TIG
 Chair - Amy Gaver, American Red Cross
Six Weeks After Haiti Disaster: The Challenge of Leading a
Multi-donor Emergency Recovery Needs Assessment
 Michael Zeleke, American Red Cross
Innovation in Collecting and Analyzing Geographic
Information: Immediate Contributions to Recovery Efforts and
Potential Contributions to Monitoring and Evaluation of
Results in Haiti
 Dale Hill, American Red Cross
Haiti: From Response to Recovery: Determining Sectoral
Priorities and Beginning the Monitoring Process
 Dale Hill and Michael Zeleke, American Red Cross
Recovery Program Monitoring and Evaluation Design:
Challenge of an Impacted Population on the Move in Haiti
 Christine Connor, American Red Cross
398 - Student Centered Issues in Evaluation
Multipaper to be held in Seguin B
Sponsored by the Graduate Student and New Evaluator TIG
 Chair - Thelma Woodard, University of Tennessee,
Knoxville
Guidelines for Conducting a High-Quality Mixed Methods
Dissertation
 Rebecca Glover-Kudon, University of Georgia
Assessing the Needs of Students in an Evaluation: Statistics
and Measurement Doctoral Program - Results and Lessons
Learned
 Susanne Kaesbauer and Thelma Woodard, University of
Tennessee, Knoxville
Evaluation Quality: A Model for Reflecting on Evaluation for
Evaluation Students
 Thelma Woodard, University of Tennessee, Knoxville;
Andrea Souflee, United Way of Dallas
395 - Process Lessons for Applied Research and
Evaluation from Capital Projects
Demonstration to be held in Crockett B
Sponsored by the Business and Industry TIG
 Kate Rohrbaugh, Independent Project Analysis
396 - Improving the Quality of Peacebuilding
Evaluation
Did you know? The President sets the Conference
Theme each year. This year‘s Presidential Strand
Theme is Evaluation Quality, chosen by 2010 AEA
President Leslie Cooksy.
Demonstration to be held in Crockett C
Sponsored by the International & Cross-cultural Evaluation TIG
 Cheyanne Scharbatke-Church, Besa Consulting
Evaluation 2010: Thursday, November 11, 4:30 PM – 6:00 PM
Page 79
Thursday, 4:30 pm to 6:00 pm, continued
399 - Impact Evaluation at the Millennium Challenge
Corporation (MCC): Theory, Application, and
Complications
Panel to be held in Republic A
Sponsored by the International & Cross-cultural Evaluation TIG
 Chair - Marc Shapiro, Millennium Challenge Corporation
 Discussant - Jack Molyneaux, Millennium Challenge
Corporation
MCC Project Evaluations: To Err Is Human
 Jack Molyneaux, Millennium Challenge Corporation
On the Rights Path to Evaluating a Property Rights Project
 Marc Shapiro, Millennium Challenge Corporation
A Scholarly Assessment of the Impact of Scholarships
 Rebecca Tunstall, Millennium Challenge Corporation
An Agricultural Evaluation Standing Out, If Not Outstanding, in
the Field
 Mamuka Shatirishvili, Millennium Challenge AccountGeorgia; and Marc Shapiro, Millennium Challenge Corporation
Participatory Evaluation With Youth: Education, Training, and
Capacity Building for Change
 Katie Richards-Schuster and Berry Checkoway, University
of Michigan
Enhancing Program Quality Through Engaging Youth in
Evaluation
 Jane Powers, Cornell University; and Shep Zeldin,
University of Wisconsin, Madison
400 - Health Evaluation TIG Business Meeting and
Presentation: Bridging the Evidence Gap in Obesity
Prevention - A Framework to Inform Decision Making
Business Meeting to be held in Republic B
Sponsored by the Health Evaluation TIG
 TIG Leaders - Robert LaChausse, California State
University, San Bernardino; Jenica Huddleston, University of
California, Berkeley; Debora Goldberg, Virginia Commonwealth
University Chair - Laura Leviton, Robert Wood Johnson
Foundation
 Presenter - Christina Economos, Tufts University
 Discussants - Jennifer Greene, University of Illinois at
Urbana-Champaign; and Madhabi Chatterji, Columbia
University
401 - Building Capacity for Youth Participatory
Evaluation
Panel to be held in Republic C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Chair - Jane Powers, Cornell University
 Discussant - Shep Zeldin, University of Wisconsin,
Madison
Putting Evaluation Into the Hands of Children and Youth: Are
We Ready?
 Kim Sabo Flores, Evaluation Access and ActKnowledge
Personal and Contextual Relationships That Affect Youth
Participatory Evaluation
 David White, Oregon State University
Evaluation 2010: Thursday, November 11, 4:30 PM – 6:00 PM
Page 80
Summary of Sessions for Thursday, November 11, 6:10 PM to 7:00 PM
No Primary Sponsor
Session
Session Title
Room
404 Collaborative, Participatory & Empowerment
Business Meeting Collaborative, Participatory, and Empowerment TIG Business Meeting
Lone Star C
409 Social Work TIG
Business Meeting Social Work TIG Business Meeting and Presentation: Evaluation in Social Work Education Practice
Mission B
410 Social Network Analysis TIG
Business Meeting Social Network Analysis TIG Business Meeting
Bowie A
411 Multiethnic Issues in Evaluation TIG
Business Meeting Multiethnic Issues in Evaluation TIG Business Meeting
Bowie B
413 Advocacy and Policy Change TIG
Business Meeting Advocacy and Policy Change TIG Business Meeting
Goliad
415 Assessment in Higher Education TIG
Business Meeting Assessment in Higher Education TIG Business Meeting
Travis A
416 Integrating Technology Into Evaluation TIG
Business Meeting Integrating Technology Into Evaluation TIG Business Meeting
Travis B
417 Needs Assessment TIG
Business Meeting Needs Assessment TIG Business Meeting
Travis C
418 Evaluating the Arts and Culture TIG
Business Meeting Evaluating the Arts and Culture TIG Business Meeting
Travis D
419 Human Services Evaluation TIG
Business Meeting Human Services Evaluation TIG Business Meeting
Independence
420 Lesbian, Gay, Bisexual, Transgender Issues TIG Business Meeting Lesbian, Gay, Bisexual and Transgender Issues TIG Business Meeting
Presidio A
424 College Access Programs TIG
Business Meeting College Access Programs TIG Business Meeting
Bonham B
427 Environmental Program Evaluation TIG
Business Meeting Environmental Program Evaluation TIG Business Meeting
Bonham E
429 Qualitative Methods TIG
Business Meeting Qualitative Methods TIG Business Meeting
Texas B
430 Costs, Effectiveness, Benefits, and Economics Business Meeting Costs, Effectiveness, Benefits, and Economics TIG Business Meeting
Texas C
431 Research, Technology, and Development
Business Meeting Research, Technology and Development Evaluation TIG Business Meeting
Texas D
433 Evaluation Policy TIG
Business Meeting TIG Business Meeting and Presentation: Evaluation Policy - Where Might We Want To Go, & How Might We Get There?
Texas F
434 Extension Education Evaluation TIG
Business Meeting Extension Education Evaluation TIG Business Meeting
Crockett A
435 Teaching of Evaluation TIG
Business Meeting TIG Business Meeting and Presentations: Critical Concepts for Introductory Evaluation Courses: Perspectives…
Crockett B
436 Business and Industry TIG
Business Meeting Business and Industry TIG Business Meeting
Crockett C
437 Disaster and Emergency Management Eval
Business Meeting TIG Business Meeting and Discussion – Lessons From the Tsunami Recover in the Indian Ocean and Earthquake…
Crockett D
439 International and Cross-cultural Evaluation TIG Business Meeting International and Cross-cultural TIG Business Meeting
Evaluation 2010: Thursday, November 11, 6:10 PM – 7:00 PM
Republic A
Page 81
Thursday, 6:10 pm to 7:00 pm
404 - Collaborative, Participatory, and
Empowerment TIG Business Meeting
Business Meeting to be held in Lone Star C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 TIG Leaders - David Fetterman, Fetterman & Associates;
and Liliana Rodriguez-Campos, University of South Florida
409 - Social Work TIG Business Meeting and
Presentation: Evaluation in Social Work Education
Practice
Business Meeting to be held in Mission B
Sponsored by the Social Work TIG
 TIG Leaders - Donna Parrish, Clark Atlanta University;
Tracy C Wharton, University of Michigan; Karen Anderson, Clark
Atlanta University; and Aisha Tucker Brown, Northrop
Grumman Corporation
 Presenter - Kathleen Bolland, University of Alabama
410 - Social Network Analysis TIG Business Meeting
Business Meeting to be held in Bowie A
Sponsored by the Social Network Analysis TIG
 TIG Leaders - Maryann Durland, Durland Consulting; and
Stacey Friedman, Foundation for Advancement of International
Medical Education & Research
411 - Multiethnic Issues in Evaluation TIG Business
Meeting
Business Meeting to be held in Bowie B
Sponsored by the Multiethnic Issues in Evaluation TIG
 TIG Leaders - Tamara Bertrand Jones, Florida State
University; Leona Johnson, Hampton University; Stella L
Hargett, Morgan State University; and Pamela FrazierAnderson, Lincoln University
413 - Advocacy and Policy Change TIG Business
Meeting
Business Meeting to be held in Goliad
Sponsored by the Advocacy and Policy Change TIG
 TIG Leaders - Ehren Reed, Innovation Network; Jacqueline
WIlliams Kaye, Atlantic Philanthropies; Annette Gardner,
University of California, San Francisco; and James Riedel, Girl
Scouts of the United States of America
415 - Assessment in Higher Education TIG Business
Meeting
Business Meeting to be held in Travis A
Sponsored by the Assessment in Higher Education TIG
 TIG Leaders - Rhoda Risner, United States Army; Audrey
Rorrer, University of North Carolina at Charlotte; and George
Reinhart, University of Maryland
416 - Integrating Technology Into Evaluation TIG
Business Meeting
Business Meeting to be held in Travis B
Sponsored by the Integrating Technology Into Evaluation TIG
 TIG Leaders - Margaret Lubke, Utah State University; and
Nathan Balasubramanian, Centennial Board of Cooperative
Educational Services
417 - Needs Assessment TIG Business Meeting
Business Meeting to be held in Travis C
Sponsored by the Needs Assessment TIG
 TIG Leaders - Hsin-Ling Hung, University of North Dakota;
Janet Matulis, Cincinnati Children's Hospital Medical Center;
and Ann Del Vecchio, Alpha Assessment Associates
418 - Evaluating the Arts and Culture TIG Business
Meeting
Business Meeting to be held in Travis D
Sponsored by the Evaluating the Arts and Culture TIG
 TIG Leaders - Katie Steedly, Steedly Consulting; and
Ching Ching Yap, Savannah College of Art and Design
419 - Human Services Evaluation TIG Business
Meeting
Business Meeting to be held in Independence
Sponsored by the Human Services Evaluation TIG
 TIG Leaders - Tania Rempert, University of Illinois at
Urbana-Champaign; Todd Franke, University of California, Los
Angeles; Vajeera Dorabawila, New York State Office of Children
and Family Services; and Barry Cohen, Rainbow Research Inc
420 - Lesbian, Gay, Bisexual and Transgender Issues
TIG Business Meeting
Business Meeting to be held in Presidio A
Sponsored by the Lesbian, Gay, Bisexual, and Transgender
Issues TIG
 TIG Leaders - Kari Greene, Oregon Public Health Division;
John T Daws, University of Arizona; Joe E Heimlich, Ohio State
University; and Kathleen McKay, Connecticut Children's
Medical Center
Evaluation 2010: Thursday, November 11, 6:10 PM – 7:00 PM
Page 82
424 - College Access Programs TIG Business
Meeting
434 - Extension Education Evaluation TIG Business
Meeting
Business Meeting to be held in Bonham B
Sponsored by the College Access Programs TIG
 TIG Leaders - Rita O'Sullivan, University of North Carolina
at Chapel-Hill; and Kurt Burkum, ACT
Business Meeting to be held in Crockett A
Sponsored by the Extension Education Evaluation TIG
 TIG Leaders - Lisa Townson, University of New Hampshire;
and Joseph Donaldson, University of Tennessee
427 - Environmental Program Evaluation TIG
Business Meeting
435 - Teaching of Evaluation TIG Business Meeting
and Presentations: Critical Concepts for Introductory
Evaluation Courses: Multiple Perspectives – Part 1
Business Meeting to be held in Bonham E
Sponsored by the Environmental Program Evaluation TIG
 TIG Leaders - Annelise Carleton-Hug, Trillium Associates;
Kara Crohn, Research Into Action; and Mary McEathron,
University of Minnesota
429 - Qualitative Methods TIG Business Meeting
Business Meeting to be held in Texas B
Sponsored by the Qualitative Methods TIG
 TIG Leaders - Jennifer Jewiss, University of Vermont; Leslie
Goodyear, National Science Foundation; Janet Usinger,
University of Nevada, Reno; and Eric Barela, Partners in School
Innovation
430 - Costs, Effectiveness, Benefits, and Economics
TIG Business Meeting
Business Meeting to be held in Texas C
Sponsored by the Costs, Effectiveness, Benefits, and
Economics TIG
 TIG Leaders - Ron Visscher, Aquinas College; and Nadini
Persaud, University of the West Indies
431 - Research, Technology and Development
Evaluation TIG Business Meeting
Business Meeting to be held in Texas D
Sponsored by the Research, Technology, and Development
Evaluation TIG
 TIG Leaders - Cheryl Oros, Oros Consulting LLC; Brian
Zuckerman, Science and Technology Policy Institute; George
Teather, George Teather and Associates; and Juan Rogers,
School of Public Policy Georgia Institute of Technology
433 - Evaluation Policy TIG Business Meeting and
Presentation: Evaluation Policy - Where Might We
Want To Go, and How Might We Get There?
Business Meeting to be held in Texas F
Sponsored by the Evaluation Policy TIG
 TIG Leaders - Lisa Rajigah, International Initiative for
Impact Evaluation (3ie); and Kristin Kaylor Richardson,
Western Michigan University
 Chair - Lisa Rajigah,3ie
 Presenters - Melvin Mark, Pennsylvania State University
Business Meeting to be held in Crockett B
Sponsored by the Teaching of Evaluation TIG
 TIG Leaders - Linda Schrader, Florida State University;
and Neva Nahan, Wayne State University
 Presenters - Katye Perry, Oklahoma State University;
Randy Davies, Brigham Young University; Jose Maria Diaz
Puente, Polytechnic University of Madrid; Cheryl Meyer, Wright
State University; Theresa Pesl Murphrey, Texas A&M University;
Antoinette Stoter, University of Iowa; Bonnie Stabile, George
Mason University; Kim Nimon, University of North Texas; and
Tara Shepperson, Eastern Kentucky University
436 - Business and Industry TIG Business Meeting
Business Meeting to be held in Crockett C
Sponsored by the Business and Industry TIG
 TIG Leaders - Eric Abdullateef, Directed Study Services;
Thomas Ward, United States Army; Tala Davidson, Western
Michigan University; and Jennifer Martineau, Center for
Creative Leadership
437 - Disaster and Emergency Management
Evaluation TIG Business Meeting and Discussion –
Lessons From the Tsunami Recovery in the Indian
Ocean and Earthquake Recovery in Haiti
Business Meeting to be held in Crockett D
Sponsored by the Disaster and Emergency Management
Evaluation TIG
 TIG Leaders - Scott Aminov, Food For The Hungry; Karen
Pendleton, University of South Carolina; Patricia Bolton,
Battelle Memorial Institute; and Brandi Gilbert, University of
Colorado, Boulder
 Presenter - Robert Ondrusek, International Federation of
Red Cross and Red Crescent Societies
439 - International and Cross-cultural TIG Business
Meeting
Business Meeting to be held in Republic A
Sponsored by the International & Cross-cultural Evaluation TIG
 TIG Leaders - Tessie Catsambas, EnCompass LLC; Mary
Crave, University of Wisconsin; Paula Bilinsky, United States
Department of State
Evaluation 2010: Thursday, November 11, 6:10 PM – 7:00 PM
Page 83
Notes:
Evaluation 2010: Thursday, November 11, 6:10 PM – 7:00 PM
Page 84
Friday, November 12, 2010: Overview of Schedule
7:00 am to 6:30 pm
Registration Desk Open
7:00 am to 7:50 am
TIG Business Meetings
8:00 am to 8:45 am
Plenary Session
9:15 am to 10:45 am
Concurrent Conference Sessions
10:55 am to 11:40 am
Concurrent Conference Sessions
11:50 am to 1:30 pm
Awards Luncheon
1:40 pm to 3:10 pm
Concurrent Conference Sessions
3:35 pm to 4:20 pm
Concurrent Conference Sessions
4:30 pm to 6:00 pm
Concurrent Conference Sessions
6:30 pm to 8:00 pm
Reception and Silent Auction
My Schedule and Notes
Evaluation 2010: Friday, November 12, Overview
Page 85
Summary of Sessions for Friday, November 12, 7:00 AM to 7:50 AM
No Primary Sponsor
Session
Session Title
495 Disabilities and Other Vulnerable Populations
Business Meeting TIG Business Meeting and Presentation: Disability-related Funding Opportunities at the NSF - What Evaluators Have…
Mission B
496 Pre-K - 12 Educational Evaluation TIG
Business Meeting PreK-12 Educational Evaluation TIG Business Meeting
Bonham C
497 Mixed Methods Evaluation TIG
Business Meeting Mixed Methods TIG Business Meeting
Crockett A
498 Evaluation Use TIG
Business Meeting TIG Business Meeting and Presentation: Recapturing the "Golden Age" of Research on Evaluation Use
Seguin B
Evaluation 2010: Friday, November 12, 7:00 AM – 7:50 AM
Room
Page 86
Friday, 7:00 am to 7:50 am
Friday, 8:00 am to 8:45 am
495 - Disabilities and Other Vulnerable Populations
TIG Business Meeting and Presentation: Disabilityrelated Funding Opportunities at the National Science
500 – AEA Presidential Address - Evaluation Quality:
The Good, the Bad, the Beautiful, and
the Ugly
Foundation - What Evaluators Have to Offer
Plenary to be held in Texas A
Sponsored by the Presidential Strand
 Chair - Debra Rog, Westat
 Presenter - Leslie Cooksy, University of Delaware
Business Meeting to be held in Mission B
Sponsored by the Disabilities and Other Vulnerable
Populations TIG
 TIG Leaders - June Gothberg, Western Michigan
University; Jennifer Sulewski, University of Massachusetts,
Boston; and Patricia Mueller, Evergreen Educational
Consulting LLC
 Presenters - Linda Thurston, National Science Foundation
Friday, 8:45 am to 9:15 am – Coffee Break!
496 - PreK-12 Educational Evaluation TIG Business
Meeting
Business Meeting to be held in Bonham C
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 TIG Leaders - Anane Olatunji, Fairfax County Public
Schools; Antionette Stroter, University of Iowa; Tom McKlin,
The Findings Group LLC; and Chad Green, Loudoun County
Public Schools
497 - Mixed Methods TIG Business Meeting
Business Meeting to be held in Crockett A
Sponsored by the Mixed Methods Evaluation TIG
 TIG Leaders - Donna Mertens, Gallaudet University; and
Mika Yamashita, Academy for Educational Development
498 - Evaluation Use TIG Business Meeting and
Presentation: Recapturing the "Golden
Age" of Research on Evaluation Use
Business Meeting to be held in Seguin B
Sponsored by the Evaluation Use TIG
 TIG Leaders - J Bradley Cousins, University of Ottawa; and
Susan Tucker, Evaluation & Development Associates
 Discussants - Christina Christie, University of California,
Los Angeles; Melvin Mark, Pennsylvania State University
 Presenter - J Bradley Cousins, University of Ottawa
Notes:
Evaluation 2010: Friday, November 12, 7:00 AM – 7:50 AM, 8:00 AM – 8:45 AM
Page 87
Summary of Sessions for Friday, November 12, 9:15 AM to 10:45 AM
No Primary Sponsor
Session
Session Title
Room
502 Presidential Strand
Panel
Equity and Quality in Evaluation: Ideas and Illustrations From the Field
Lone Star A
503 Systems in Evaluation TIG
Think Tank
Model Forms, Program Theory, and Unexpected Behavior: What Are the Implications for Program Implementation…
Lone Star B
504 Collaborative, Participatory & Empowerment
Demonstration
Youth Led Evaluation in Action: Stomping Out the Stigma of Mental Illness
Lone Star C
505 Non-profit and Foundations Evaluation TIG
Panel
Strategic Learning: An Embedded Approach for Evaluating Complex Change
Lone Star D
506 Quantitative Methods: Theory and Design TIG
Panel
Promoting Quality Impact Studies: Constructive, Context-Appropriate Policies for Strengthening Research Designs…
Lone Star E
507 AEA Conference Committee
Think Tank
The American Evaluation Association and Its Local Affiliates: Shaping Our Future Together
Lone Star F
508 Human Services Evaluation TIG
Roundtable
Making Decisions About Program Continuation: A Step-by-Step Process
Mission A
509 Evaluation Policy TIG
Panel
How Evaluation Policies Affect Evaluation Quality in a Texas Public School District
Mission B
510 Independent Consulting TIG
Think Tank
Enhancing the Quality of Evaluation Design, Data Collection, and Reports Through Peer Review
Bowie A
511 Multiethnic Issues in Evaluation TIG
Multipaper
Utilizing Evaluation Methods to Provide Quality Health Care Services to Underserved Populations
Bowie B
512 Internal Evaluation TIG
Multipaper
Improving Quality of Programs and Evaluation: Examples From the Field
Bowie C
513 Advocacy and Policy Change TIG
Roundtable
Rotation I: Big Money, More Scrutiny: How to Forge Evaluator-Early Childhood Education Program Partnerships…
Rotation II: A Study on the Indicator of High Quality Papers: The Case of Casualty Actuarial Society (CAS)
Goliad
514 International and Cross-cultural Evaluation TIG Roundtable
Rotation I: Exploring Evaluation Quality in International Development Evaluation: An Examination of How International…
Rotation II: Practices for Working With and Building Capacity of Local Evaluation Consultants in International Development
San Jacinto
515 Assessment in Higher Education TIG
Beyond the Classroom: Assessment in Non-Traditional Settings
Travis A
517 Lesbian, Gay, Bisexual, Transgender Issues TIG MultiPaper
Evaluation of Efforts to Create Safer Environments for Lesbian, Gay, Bisexual, and Transgender (LGBT) Youth
Travis C
518 Evaluating the Arts and Culture TIG
Multipaper
Ecologies of Collaboration in the Arts
Travis D
519 Human Services Evaluation TIG
Multipaper
Challenges and Solutions in Implementing and Conducting Quality Evaluations on Children, Youth, and Families
Independence
520 Systems in Evaluation TIG
Demonstration
Does Sensemaker Make Sense? Evaluating Development Initiatives Through Narrative Capture and Tagging in Kenya…
Presidio A
521 Org Learning & Evaluation Capacity Bldg TIG
Panel
Evaluation Capacity Building (ECB) Models, Measures, and Outcomes: Taking Stock to Forge Ahead
Presidio B
522 Alcohol, Drug Abuse, and Mental Health TIG
Multipaper
Evaluating National Substance Abuse Prevention Programs
Presidio C
523 Theories of Evaluation TIG
Roundtable
Towards Translational Process Evaluation: Implementation, Fidelity, Integration, and Sustainability
Bonham A
524 Non-profit and Foundations Evaluation TIG
Think Tank
Aligning Priorities of Diverse Stakeholders Using Collaborative Evaluation Planning
Bonham B
525 Pre-K - 12 Educational Evaluation TIG
Multipaper
Evaluating Science, Technology, Engineering, and Mathematics (STEM) Initiatives in K-12 Education
Bonham C
526 Pre-K - 12 Educational Evaluation TIG
Panel
Evaluating Literacy Curricula for Adolescents: Results From Three Years of Striving Readers
Bonham D
527 Research, Technology, and Development
Panel
Challenges and Best Practices in Benefit Cost Studies of Research and Technology Programs
Bonham E
528 Government Evaluation TIG
Skill-building
The Weakest Link: Does Good Evaluation Lead to Good Decisions? How to Assess Your Organization
Texas A
Multipaper
Evaluation 2010: Friday, November 12, 9:15 AM – 10:45 AM
Page 88
Summary of Sessions for Friday, November 12, 9:15 AM to 10:45 AM, Continued
No Primary Sponsor
Session
Session Title
Room
529 Evaluation Managers and Supervisors TIG
Skill-building
Taking Control of Your Evaluation Career
Texas B
530 Mixed Methods Evaluation TIG
MultiPaper
Ensuring High-Quality Data Processes in Evaluation: Examples From Qualitative, Quantitative and Mixed Methods Work
Texas C
531 Research, Technology, and Development
MultiPaper
Recent Developments in Research and Development Evaluation: The Academic Side
Texas D
532 Evaluation Use TIG
Multipaper
Clients Speak Out About Evaluation
Texas E
533 College Access Programs TIG
Panel
The GEAR UP Experience: Exploring the Promise of Multi-site Evaluation
Texas F
534 Extension Education Evaluation TIG
Multipaper
Evaluation and Program Quality
Crockett A
535 Teaching of Evaluation TIG
Multipaper
Teaching About Specific Aspects of Evaluation
Crockett B
536 International and Cross-cultural Evaluation TIG Panel
Evaluation Within Contested Spaces
Crockett C
537 Government Evaluation TIG
Panel
Assessing the Health of and Improving the Evaluation Function Across the Government of Canada Through the Management… Crockett D
538 Qualitative Methods TIG
Demonstration
Assessing the Quality of Research Instruments Using Cognitive Lab Methodology: A Practical Discussion and Lessons…
Seguin B
539 International and Cross-cultural Evaluation TIG Panel
Complementary Approaches to Evaluating Social Safety Nets at the World Bank
Republic A
540 Health Evaluation TIG
Skill-building
Tools for Aligning National-Level and Local-Level Evaluations: Helping Grantees Evaluate Their Public Health Interventions
Republic B
541 Collaborative, Participatory & Empowerment
Multipaper
Engaging Participants in the Evaluation Process: A Participatory Approach
Republic C
Evaluation 2010: Friday, November 12, 9:15 AM – 10:45 AM
Page 89
Friday, 9:15 am to 10:45 am
502 - Equity and Quality in Evaluation: Ideas and
Illustrations From the Field
Panel to be held in Lone Star A
Sponsored by the Presidential Strand and
the Research on Evaluation TIG
 Chair - Jennifer Greene, University of
Illinois at Urbana-Champaign
 Discussant - Valerie Williams, The Globe Program
What is Equity in Educational Evaluation and How Does It
Matter in Evaluation Quality?
 Jennifer Greene, University of Illinois at Urbana-Champaign
Educative and Values-Engaged Evaluation Approach (EVEN) We
Can Use Values
 Jeremiah Johnson and Maria Jimenez, University of Illinois
at Urbana-Champaign
Forewarned Is Forearmed: A Tale of Two EVEN Evaluations
 Jeehae Ahn and Ayesha Boyce, University of Illinois at
Urbana-Champaign
503 - Model Forms, Program Theory, And Unexpected
Behavior: What Are the Implications For Program
Implementation and Evaluation?
Think Tank to be held in Lone Star B
Sponsored by the Systems in Evaluation TIG
 Presenter - Jonathan Morell, Vector Research Center
 Discussants - Jonathan Morell, Vector Research Center;
and Sanjeev Sridharan, University of Toronto
504 - Youth Led Evaluation in Action: Stomping Out
the Stigma of Mental Illness
Demonstration to be held in Lone Star C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Cheri Hoffman, Centerstone Research Institute; James
Martin, Mule Town Family Network
505 - Strategic Learning: An Embedded Approach for
Evaluating Complex Change
Panel to be held in Lone Star D
Sponsored by the Non-profit and Foundations Evaluation TIG
 Chair and Discussant - Gale Berkowitz, David and Lucile
Packard Foundation
The Packard Foundation: Strategic Learning and Systems
Change
 Julia Coffman, Center for Evaluation Innovation
The Colorado Trust: Strategic Learning and Advocacy
 Ehren Reed, Innovation Network
The California Endowment: Strategic Learning and Multicultural
Interventions
 Hanh Cao Yu, Social Policy Research Associates
506 - Promoting Quality Impact Studies: Constructive,
Context-Appropriate Policies for Strengthening
Research Designs for Impact Evaluations
Panel to be held in Lone Star E
Sponsored by the Quantitative Methods: Theory and Design TIG
 Chair - George Julnes, University of Baltimore
What's in an Evaluation Design? Matching the Policy Questions
to the Program and Evaluation Context Before Making
Methodological Choices
 Eleanor Chelimsky, Independant Consultant
A Variety of Rigorous Methods Can Help Identify Effective
Interventions
 Stephanie Shipman, United States Government
Accountability Office
Mixed-methods Evaluation Design for a Complex, Evolving
Systems Initiative
 Debra Rog, Westat
Designing for Success With Impact Evaluations: Dimensions of
Quality for Evidence to Be Actionable
 George Julnes, University of Baltimore
507 - The American Evaluation Association and Its
Local Affiliates: Shaping Our Future Together
Think Tank to be held in Lone Star F
Sponsored by the AEA Conference Committee
 Presenter - Rachel Hickson, Montgomery County Public Schools
 Discussants - Michael Hendricks, Independent Consultant;
Beverly A Parsons, InSites; and Stewart Donaldson, Claremont
Graduate University
508 – Roundtable in Mission A
Sponsored by the Human Services Evaluation TIG
Making Decisions About Program Continuation: A Step-by-Step
Process
 Carla Clasen, Betty Yung, Carl Brun, Katherine Cauley, and
Cheryl Meyer, Wright State University
509 - How Evaluation Policies Affect Evaluation
Quality in a Texas Public School District
Panel to be held in Mission B
Sponsored by the Evaluation Policy TIG
 Chair - Karen Looby, Austin Independent School District
 Discussant - Whitsett Maria, Moak, Casey & Associates
Setting Evaluation Priorities in a Public School District: Who
Decides What Gets Evaluated?
 Karen Looby, Austin Independent School District
Policy Influences on the Evaluation of a Teacher Incentive Pay
Program and Program Decision Making
 Lisa Schmitt, Austin Independent School District
Addressing Challenges Associated With the Mandated
Evaluation of Projects Funded by Federal Stimulus Dollars
 Martha Doolittle, Austin Independent School District
Evaluation 2010: Friday, November 12, 9:15 AM – 10:45 AM
Page 90
Creating a Partnership: How a School District Helps Community
Based Service Providers Evaluate Their Programs
 Cinda Christian, Austin Independent School District
510 - Enhancing the Quality of Evaluation Design,
Data Collection, and Reports Through Peer Review
Think Tank to be held in Bowie A
Sponsored by the Independent Consulting TIG
 Presenter - Sally Bond, The Program Evaluation Group LLC
 Discussants - Sally Bond, The Program Evaluation Group
LLC; and Courtney Malloy, Vital Research LLC
511 - Utilizing Evaluation Methods to Provide Quality
Health Care Services to Underserved Populations
Multipaper to be held in Bowie B
Sponsored by the Multiethnic Issues in Evaluation TIG
 Chair - Kevin E Favor, Lincoln University
Implementation Evaluation of HIV/AIDS Non-government
Organization's (NGOs) Legal Assistance Services in Brazil
 Paula Vita Decotelli, Marly Cruz, and Miriam Ventura,
National School of Public Health (ENSP/Fiocruz)
Evaluation of an Entertainment-Education Intervention
Targeting the Latino Spanish Speaking Community of Colorado:
Challenges and Accomplishments
 Mariana Enriquez-Olmos, Independent Consultant; and
Cristina Bejarano, Independent Consultant
A Culturally Responsive Process: Using Sociocultural Theory as
a Guide to Program Development and Evaluation
 Dominica McBride, Center for African American Health
Out of the Crossfire: Evaluating Fundraising Materials for a
Hospital-based Violence Intervention Program Serving
Stigmatized Populations
 Jennifer Williams, Nancy Rogers, and Brian Powell,
University of Cincinnati
512 - Improving Quality of Programs and Evaluation:
Examples From the Field
Multipaper to be held in Bowie C
Sponsored by the Internal Evaluation TIG
 Chair - Lennise Baptiste, Kent State University
 Discussant - Wendy DuBow, National Center for Women
and Information Technology
The Impact of Participant Feedback on Program Outcomes: A
Program Evaluation Consideration
 Candace Lacey, Barbara Packer-Muti, and Jennifer Reeves,
Nova Southeastern University
Using Appreciative Inquiry Focus Groups to Engage Members in
Planning for the National Network of Libraries of Medicine
Middle Atlantic Region
 Sue Hunter, New York University; and Cynthia Olney,
National Network of Libraries of Medicine
Meta-evaluation Quality in Brazil: A Mamdani Hierarchical Fuzzy
Inference System
 Ana Carolina Letichevsky and Thereza Penna-Firme,
Cesgranrio Foundation
513 – Roundtables in Goliad
Sponsored by the Advocacy and Policy Change TIG and the
Research, Technology, and Development Evaluation TIG
Rotation 1: Big Money, More Scrutiny: How to Forge EvaluatorEarly Childhood Education Program Partnerships in Order to
Produce Clear, Relevant, and Useful Data to Inform Policy and
Practice
 Marijata Daniel-Echols, HighScope Educational Research
Foundation
Rotation 2: A Study on the Indicator of High Quality Papers: The
Case of Chinese Academy of Sciences (CAS)
 Haijun Zheng, Zhongcheng Guan, Haiyang Hu, and Bing
Shi, Chinese Academy of Sciences
514 – Roundtables in San Jacinto
Sponsored by the International & Cross-cultural Evaluation TIG
Rotation 1: Practices for Working With and Building Capacity of
Local Evaluation Consultants in International Development
 Elizabeth Hutchinson, Land O'Lakes International
Development; and Meredith Blair, Humanity United
Rotation 2: Exploring Evaluation Quality in International
Development Evaluation: An Examination of How International
Development Organizations Issue and Contract Evaluations
 Anne Cullen, Daniela Schroeter, and Michele Tarsilla,
Western Michigan University; Jim Rugh, Independent
Consultant; and Kelly Robertson, Western Michigan University
515 - Beyond the Classroom: Assessment in NonTraditional Settings
Multipaper to be held in Travis A
Sponsored by the Assessment in Higher Education TIG
 Chair - Howard Mzumara, Indiana University-Purdue
University Indianapolis
A Look at the Efficacy of Guided Self-Placement for First-Year
Writing Courses
 Howard Mzumara, Indiana University-Purdue University
Indianapolis
Creating the Global Student: Increasing Competency,
Preparation, and Personal Growth of Students in a University
International Certificate Program
 Yuanyuan Wang, Keith Trahan, and Cara Ciminillo,
University of Pittsburgh
Creating Valued Field Placement Feedback: Making the Forms
Meaningful and Useful for Evaluators and Educators
 Julia Williams, University of Minnesota, Duluth
Evaluation 2010: Friday, November 12, 9:15 AM – 10:45 AM
Page 91
Friday, 9:15 am to 10:45 am, continued
517 - Evaluation of Efforts to Create Safer
Environments for Lesbian, Gay, Bisexual, and
Transgender (LGBT) Youth
MultiPaper to be held in Travis C
Sponsored by the Lesbian, Gay, Bisexual, and Transgender
Issues TIG
 Chair - Joseph Kosciw, Gay, Lesbian & Straight Education
Network
An Evaluation of a National Leadership Development Program
for LGBT Youth and Their Allies
 Elizabeth Diaz, Gay, Lesbian & Straight Education Network
Evaluation of a District-wide Training Program to Create Safer
Schools for Lesbian, Gay, Bisexual, Transgender, and
Questioning Youth
 Emily Greytak, Gay, Lesbian & Straight Education Network
Effectiveness of a Public Communication Campaign About
Homophobic Language
 Joseph Kosciw, Gay, Lesbian & Straight Education Network;
and Sheri Klein, AdCouncil
518 - Ecologies of Collaboration in the Arts
Multipaper to be held in Travis D
Sponsored by the Evaluating the Arts and Culture TIG
 Chair - Min Zhu, University of South Carolina
 Discussant - Katie Steedly, Steedly Consulting
Documenting Collabroation as a Process in an Art and Design
Context
 Ching Ching Yap, Tara Pearsall, and Mary Taylor, Savannah
College of Art and Design
Evaluating Collaboration in Design Teams: A Multi Method
Approach
 Robyn Richardson, Dustin Larimer, and Yushi Wang,
Savannah College of Art and Design
Youth Education in the Arts: New Collaboration Model for
Funders, Arts Organizations, and Evaluators
 Lora Warner, University of Wisconsin, Green Bay
519 - Challenges and Solutions in Implementing and
Conducting Quality Evaluations on Children, Youth,
and Families
Multipaper to be held in Independence
Sponsored by the Human Services Evaluation TIG
 Chair - Margaret Polinsky, Parents Anonymous Inc
Field Study Evaluation of a Comprehensive Sexual Abstinence
Program: Methodology Challenges, Approaches, and
Implications
 Virginia Dick, Ann Peisher, and Amy Laura Arnold,
University Of Georgia; and Robetta McKenzie, and Katrina
Davidson, Augusta Partnership for Children Inc; and Don Bower,
University of Georgia
From Champions to Change: The Role of Quality Evaluation in
Implementing a Child Welfare System Change Initiative
 Margaret Richardson and James Henry, Western Michigan
University
Developing a Shared Understanding of Evaluation Quality: The
Case of a Sexual Abuse Prevention Program
 Beth Johnson, EMJ Associates; and Stephen Leaver,
Imagination Theater
520 - Does Sensemaker Make Sense? Evaluating
Development Initiatives Through Narrative Capture
and Tagging in Kenya and Latin America
Demonstration to be held in Presidio A
Sponsored by the Systems in Evaluation TIG and the Qualitative
Methods TIG
 John Hecklinger, GlobalGiving Foundation; and Irene Guijt,
Learning by Design
521 - Evaluation Capacity Building (ECB) Models,
Measures, and Outcomes: Taking Stock to Forge
Ahead
Panel to be held in Presidio B
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG
 Chair - Tina Taylor-Ritzler, Dominican University
 Discussant - Hallie Preskill, FSG Social Impact Advisors
Research Synthesis of ECB Literature: An Evidence-based Review
 Susan Labin, Independent Consultant; and Jennifer Duffy
and Abraham Wandersman, University of South Carolina
Results and Implications of a Mixed-methods ECB Model
Validation Study
 Tina Taylor-Ritzler, Dominican University; Yolanda SuarezBalcazar, University of Illinois at Chicago; and Edurne GarcíaIriarte, Trinity College Dublin
Using Qualitative Methods to Further Specify Contextual and
Cultural Elements of ECB Processes
 Yolanda Suarez-Balcazar, University of Illinois at Chicago;
and Tina Taylor-Ritzler, Dominican University
522 - Evaluating National Substance Abuse
Prevention Programs
Multipaper to be held in Presidio C
Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG
 Chair - Trena Anastasia, University of Wyoming
Effects of the Strategic Prevention Framework State Incentives
Grant (SPFSIG) on State Prevention Infrastructure in Twenty-six
States
 Robert Orwin, Westat; Alan Stein-Seroussi and Jessica
Edwards, Pacific Institute for Research and Evaluation (PIRE);
and Ann Landy, Westat
Evaluating Large Scale Technical Assistance Centers: The Case
of the Center for Substance Abuse Prevention's Centers for the
Application of Prevention Technologies
 Tom James, University of Oklahoma; and Wayne Harding,
Social Science Research and Evaluation
Evaluation 2010: Friday, November 12, 9:15 AM – 10:45 AM
Page 92
Implementing An Evidence-based Prevention Program Nationally Using A Multi-tier Approach: Helping Youth Stay on Track
 Melissa Rivera and Scott Steger, National Center for
Prevention and Research Solutions
523 – Roundtable in Bonham A
Sponsored by the Theories of Evaluation TIG and the Health
Evaluation TIG
Towards Translational Process Evaluation: Implementation,
Fidelity, Integration, and Sustainability
 Oliver Massey, university of South Florida
524 - Aligning Priorities of Diverse Stakeholders
Using Collaborative Evaluation
Think Tank to be held in Bonham B
Sponsored by the Non-profit and Foundations Evaluation TIG
 Presenter - Randi Nelson, JVA Consulting LLC
 Discussants - Nancy Zuercher and Julia Alvarez, JVA
Consulting LLC
525 - Evaluating Science, Technology, Engineering,
and Mathematics (STEM) Initiatives in K-12
Education
Multipaper to be held in Bonham C
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - James P Van Haneghan, University of South
Alabama
 Discussant - Tom McKlin, The Findings Group LLC
Planning Evaluations for Discovery Research K-12 (DR K-12)
Design Projects
 Kathleen Haynie, Haynie Research and Evaluation
Evaluation Methodology and Results of the Building Science
Teaching Capacity Project
 Robert Owens and Mike Trevisan, Washington State
University
Longitudinal Evaluation of Project Lead The Way in Iowa: Using
Interdisciplinary Collaboration as a Method of Quality
 Melissa Chapman and David Rethwisch, University of Iowa;
Tom Schenk Jr, Iowa Department of Education; and Frankie
Laanan, Soko Starobin, and 'Leaf' Yi Zang, Iowa State
University
Measuring Change in Middle Schools Girls‘ Knowledge and
Perceptions of Science, Technology, Engineering and Math
(STEM) Related to Intervention: Implications for School Reform
 Carol Nixon, Edvantia Inc
526 - Evaluating Literacy Curricula for Adolescents:
Results From Three Years of Striving Readers
Panel to be held in Bonham D
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Stefanie Schmidt, United States Department of
Education
 Discussant - David Francis, University of Houston
Striving Readers: Results From Ohio
 William Loadman, Ohio State University
Striving Readers: Results From Newark
 Jennifer Hamilton and Matthew Carr, Westat
Striving Readers: Results From the Mid-South
 Debra Coffey, Research for Better Schools
Striving Readers: Results From Portland
 Bonnie Faddis and Margaret Beam, RMC Research
Corporation
Results from Springfield/Chicopee
 Kimberly Sprague, Brown University
527 - Challenges and Best Practices in Benefit Cost
Studies of Research and Technology Programs
Panel to be held in Bonham E
Sponsored by the Research, Technology, and Development
Evaluation TIG
 Chair - Rosalie Ruegg, TIA Consulting Inc
A Case Study: A Benefit-cost Analysis of Department of
Education's Investment in Solar Photovoltaic Energy Systems
 Alan O'Connor, Ross J Loomis, and Fern M Braun, RTI
International
View From Studies Done by the Advanced Technology Program
 Rosalie Ruegg, TIA Consulting Inc
Perspectives From Europe
 Isabelle Collins, Technopolis
View of the Chairman of the Expert Review Panel
 Irwin Feller, Pennsylvania State University
528 - The Weakest Link: Does Good Evaluation Lead
to Good Decisions? How to Assess Your Organization
Skill-building Workshop to be held in Texas A
Sponsored by the Government Evaluation TIG
 Thea C Bruhn, United States Department of State
529 - Taking Control of Your Evaluation Career
Skill-building Workshop to be held in Texas B
Sponsored by the Evaluation Managers and Supervisors TIG
 George Grob, Center for Public Program Evaluation; and
Ann Maxwell, United States Department of Health and Human
Services
Evaluation 2010: Friday, November 12, 9:15 AM – 10:45 AM
Page 93
Friday, 9:15 am to 10:45 am, continued
530 - Ensuring High-Quality Data Processes in
Evaluation: Examples From Qualitative, Quantitative
and Mixed Methods Work
MultiPaper to be held in Texas C
Sponsored by the Mixed Methods Evaluation TIG
 Chair - Lorena Ortiz, Berkeley Policy Associates
Quality Control Methods With Quantitative Data in a
Randomized Control Trial Study for a Teacher Professional
Development Evaluation
 Lorena Ortiz, Berkeley Policy Associates
Qualitative Data Management, Analysis and Synthesis: Lessons
From a Team-based Process Using Multiple Qualitative Data
Sources
 Tommy Smith, Berkeley Policy Associates
531 - Recent Developments in Research and
Development Evaluation: The Academic Side
MultiPaper to be held in Texas D
Sponsored by the Research, Technology, and Development
Evaluation TIG
 Chair and Discussant- Juan Rogers, School of Public Policy
Georgia Institute of Technology
Science Overlay Maps: A New Research Evaluation Tool
 Alan Porter, Georgia Institute of Technology; and Ismael
Rafols, University of Sussex
Tracking Knowledge and Collaborative Development in
Research and Development: Combining Social Network and
Bibliometric Analysis in the Evaluation of Research Centers
 Julia Melkers and Jan Youtie, Georgie Institute of Technology
Bibliometric Analysis as a Methodology for Research Evaluation
and Mapping of Science
 Anthony van Raan and Thed van Leeuwen, University of
Leiden
532 - Clients Speak Out About Evaluation
Multipaper to be held in Texas E
Sponsored by the Evaluation Use TIG
 Chair - Susan Tucker, Evaluation & Development Associates
 Discussant - Lyn Shulha, Queen's University at Kingston
Exploring Evaluation Use: Multiple Representations of
Evaluation Findings
 Michelle Searle, Christine Doe, and Lyn Shulha, Queen's
University at Kingston; and Susan Elgie, Independant Consultant
Enhancing Evaluation Quality Through Client-Centered
Reporting
 Micheline Magnotta, 3D Group
Measuring Evaluation Use and Influence Among Project
Directors of State Gaining Early Awareness and Readiness for
Undergraduate Programs Grants
 Erin Burr, Oak Ridge Institute for Science and Education;
and Jennifer Morrow and Gary Skolits, University of Tennessee
Chilean Evaluated Teachers Give Their Opinions About the
National Teacher Evaluation System
 Dante Cisterna-Alburquerque, Michigan State University
533 - The Gaining Early Awareness and Readiness for
Undergraduate Programs (GEAR UP) Experience:
Exploring the Promise of Multi-site Evaluation
Panel to be held in Texas F
Sponsored by the College Access Programs TIG
 Chair - Yvette Lamb, Academy for Educational Development
 Discussant - Melissa Panagides-Busch, Academy for
Educational Development
Overview of the GEAR UP Multi-site Evaluation
 Yvette Lamb, Academy for Educational Development
GEAR UP Programs: Similarities and Differences Across Sites
 David Jochelson, Susanna Kung, and Arati Singh, Academy
for Educational Development
Designs for Cluster and Multi-site Evaluation for GEAR UP Program
 Mika Yamashita, Academy for Educational Development
534 - Evaluation and Program Quality
Multipaper to be held in Crockett A
Sponsored by the Extension Education Evaluation TIG
 Chair - Lisa Townsend, University of New Hampshire
Organizational Impacts of Extension State Systems on
Evaluation Practice in the Field
 Alexa J Lamm, Glenn D Israel, and Tracy Irani, University of
Florida
Applying Extension Methodology in an African Education and
Food Security Program: Lessons Learned About Maintaining
Quality From a Distance
 Mary Crave, University of Wisconsin
Assessing Youth Program Quality in 4-H Club Settings:
Outcomes from Four Arizona Counties
 Amy Schaller, Christine Bracamonte-Wiggs, and Lynne
Borden, University of Arizona
A Systems Perspective on the Challenges in Finding Measures
for High-Quality Evaluation
 Monica Hargraves, Cornell University
535 - Teaching About Specific Aspects of Evaluation
Multipaper to be held in Crockett B
Sponsored by the Teaching of Evaluation TIG
 Chair - John Stevenson, University of Rhode Island
Teaching Qual Inside a Quant World
 John Stevenson, University of Rhode island
Integrating Social Justice Into Evaluation Teaching:
Opportunities and Strategies
 Veronica Thomas, Howard University; and Anna Madison,
University of Massachusetts, Boston
Developing Evaluation Reports That Are Useful, User-Friendly,
and Used
 Tamara M Walser, University of North Carolina at Wilmington
Evaluation 2010: Friday, November 12, 9:15 AM – 10:45 AM
Page 94
536 - Evaluation Within Contested Spaces
Panel to be held in Crockett C
Sponsored by the International & Cross-cultural Evaluation TIG
 Chair - Ross VeLure Roholt, University of Minnesota
Doing Evaluation and Being an Evaluator in Violently Contested
Spaces
 Michael Baizerman, University of Minnesota
Crafting High Quality Evaluations in Contested Spaces: Lessons
From the Field
 Barry Cohen, Rainbow Research Inc
Show Me Your Impact: Evaluating Transitional Justice in
Contested Spaces
 Colleen Duggan, International Development Research
Centre
Being Practical, Being Safe: Doing Evaluations in Contested
Spaces
 Ross VeLure Roholt, University of Minnesota
537 - Assessing the Health of and Improving the
Evaluation Function Across the Government of
Canada Through the Management Accountability
Framework (MAF)
Panel to be held in Crockett D
Sponsored by the Government Evaluation TIG
 Chair - Anne Routhier, Treasury Board of Canada
Overview of the Government of Canada‘s MAF's Area of
Management 6 (AoM6) (Quality and Use of Evaluation) and Its
Use in Assessing the Health of the Evaluation Function
 Anne Routhier and Brian Moo Sang, Treasury Board of
Canada
Department of Canadian Heritage‘s Experience in MAF to
Inform Continuous Improvement of the Evaluation
 Paule-Anny Pierre, Department of Canadian Heritage
Building Evaluation Excellence at Indian and Northern Affairs
Canada: Using the the MAF as a Roadmap
 Tamara Candido and Judith Moe, Indian and Northern
Affairs Canada
Use of the MAF at Industry Canada in Improving the Evaluation
Function
 Kim Bachmann and Beate Schiffer-Graham, Industry
Canada
538 - Assessing the Quality of Research Instruments
Using Cognitive Lab Methodology: A Practical
Discussion and Lessons Learned
Demonstration to be held in Seguin B
Sponsored by the Qualitative Methods TIG
 Presenters - Joanna Gilmore, Heather Bennett, and Karen
Price, University of South Carolina
539 - Complementary Approaches to Evaluating
Social Safety Nets at the World Bank
Sponsored by the International & Cross-cultural Evaluation TIG
 Chair - Cheryl Gray, World Bank
Evaluation Questions and Approaches
 Jennie Litvack, World Bank
Country Case Studies – The Case of Jamaica
 Victoria Monchuk, World Bank
Impact Evaluation for Assessing Sustainability of Program
Effects – The Case of Colombia
 Javier Baez, World Bank
540 - Tools for Aligning National-Level and LocalLevel Evaluations: Helping Grantees
Evaluate Their Public Health Interventions
Skill-building Workshop to be held in Republic B
Sponsored by the Health Evaluation TIG
 Shyanika Rose, Joanne Abed, Carlyn Orians, and Linda
Winges, Battelle Memorial Institute
541 - Engaging Participants in the Evaluation
Process: A Participatory Approach
Multipaper to be held in Republic C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Chair - Seriashia Chatters, University of South Florida
Evaluating a Community Partnership Using a Community-based
Participatory Approach: The Men‘s Health League Partnership in
Cambridge, Massachusetts
 Omonyele Adjognon, Shalini Tendulkar, and Elisa
Friedman, Institute for Community Health; Claude- Alix Jacob,
Marsha Lazar, and Albert Pless Jr, Cambridge Public Health
Department; and Barbara Kibler, Margaret Fuller Neighborhood
House
To Tell or Not to Tell: Strategies of Breaking Through the Walls
and Gaining the Trust of Evaluation Participants
 Bellarmine Ezumah, Howard University
Utilizing Participatory Processes in Program Design and
Implementation Sets the Framework for a More Streamlined
Evaluation Process Especially for Participatory Evaluations
 Carlene Baugh and Scott Yetter, CHF International
Assessing a Model to Support Community-Driven Research
Initiatives: The Atlanta Clinical and Translational Science
Institute‘s Community Engagement and Research Mini-grant
Program
 Tabia Henry Akintobi, Morehouse School of Medicine;
Lewis Autor, Rock of Escape; Jacqueline Brown, Empowerment
Resource Center for Women Inc; Joyce Essien, Emory University;
Katherine Erwin and Daniel Blumenthal, Morehouse School of
Medicine; and Michelle C Kegler and Winifred W Thompson,
Emory University
Utilizing Participatory Action Research Framework to Prevent
HIV Infection Among Youth Living in Public Housing
 Meelee Kim and Peter Kreiner, Brandeis University;
Suzanne Boucher, Wayside Youth and Family Support Network
Panel to be held in Republic A
Evaluation 2010: Friday, November 12, 9:15 AM – 10:45 AM
Page 95
Summary of Sessions for Friday, November 12, 10:55 AM to 11:40 AM
No Primary Sponsor
Session
Session Title
Room
542 Presidential Strand
Expert Lecture
President Obama's Evaluation Policies
Lone Star A
543 Program Theory and Theory-driven Evaluation
Multipaper
Examples From the Field: Using Mixed Methodological Frameworks in Theory-Driven Evaluations
Lone Star B
544 Collaborative, Participatory & Empowerment
Think Tank
Youth Participatory Evaluation: Entering the Age of the Internet
Lone Star C
545 Non-profit and Foundations Evaluation TIG
Panel
Funder‘s Use of Network Analysis to Build Intentional Collaboration
Lone Star D
546 Quantitative Methods: Theory and Design TIG
Demonstration
Using Latent Class Analysis to Target and Tailor Programs to Specific Populations
Lone Star E
547 Cluster, Multi-site & Multi-level Evaluation TIG Multipaper
Multi-method Approaches
Lone Star F
548 Evaluation Managers and Supervisors TIG
Roundtable
Controlling Quality Within Museums: Coordinating Internal Evaluation Departments
Mission A
550 Systems in Evaluation TIG
Panel
The Adaptive Action Cycle: Bridging the Gap Between Lessons Learned and Lessons Applied
Bowie A
551 Multiethnic Issues in Evaluation TIG
Multipaper
Using Evaluation to Enhance Program Participation With Underrepresented Groups in STEM Fields
Bowie B
552 Advocacy and Policy Change TIG
Panel
How Does Evidence Influence Policy Change? Examining Two Complementary Approaches With Two Complementary Evals
Bowie C
553 Feminist Issues in Evaluation TIG
Roundtable
Incorporating Gender into Mainstream Projects
Goliad
554 Research on Evaluation TIG
Roundtable
Utilizing Metaevaluation to Validate Evaluation Quality: Study of a Grant-Funded Graduate Program for Minority Group…
San Jacinto
556 Costs, Effectiveness, Benefits, and Economics Panel
Using Cost --> Procedure --> Process --> Outcome Analysis (CPPOA) Data to Improve Substance Abuse Prevention…
Travis B
557 Org Learning & Evaluation Capacity Bldg TIG
Multipaper
Communication: At What Level Does It Help or Hinder Evaluation Capacity?
Travis C
558 Health Evaluation TIG
Expert Lecture
Is Quality Improvement In Healthcare Cost-Effective?
Travis D
559 Lesbian, Gay, Bisexual, Transgender Issues TIG Multipaper
None of the Above: Expanding Binary Categorizations
Independence
560 Distance Ed & Other Educational Technologies Multipaper
Technology and Student Outcomes: Mathematics, Language Arts, and Big-District Diversity
Presidio A
561 Org Learning & Evaluation Capacity Bldg TIG
Demonstration
Herding Cats: Improving the Quality and Quantity of Decentralized Evaluation in a Global Organization Through Capacity Bldg Presidio B
562 Alcohol, Drug Abuse, and Mental Health TIG
Business Meeting Alcohol, Drug Abuse and Mental Health TIG Business Meeting
Presidio C
563 Business and Industry TIG
Roundtable
Assessing Board Performance: Challenges and Constraints
Bonham A
564 Non-profit and Foundations Evaluation TIG
Panel
Low-cost, High-Quality Assessments for Nonprofit Adolescent Pregnancy Prevention Program Planning
Bonham B
565 Pre-K - 12 Educational Evaluation TIG
Expert Lecture
Is Working Together Worth It? The Process and Findings of a Longitudinal Evaluation of a Districtwide Professional…
Bonham C
566 Pre-K - 12 Educational Evaluation TIG
Multipaper
Evaluating Education Programs for English Language Learners
Bonham D
567 Research, Technology, and Development
Multipaper
From Research to Commercialization: Impact Evaluation of Portfolios of Research
Bonham E
569 Research, Technology, and Development
Multipaper
Evaluating Government Research and Technology Policies: Traditional and Emerging Methods
Texas D
570 Evaluation Use TIG
Panel
Joint Evaluation of Private Sector Development Projects: Benefits and Challenges
Texas E
571 Graduate Student and New Evaluator TIG
Demonstration
Using R for Statistical Analysis
Texas F
Evaluation 2010: Friday, November 12, 10:55 AM – 11:40 AM
Page 96
Summary of Sessions for Friday, November 12, 10:55 AM to 11:40 AM, Continued
No Primary Sponsor
Session
Session Title
Room
572 AEA Conference Committee
Panel
The American Evaluation Association's Journal Editors Discuss Publishing in AEA's Journals
Crockett A
573 Business and Industry TIG
Demonstration
How to Use Evaluation to Achieve Human Resources (HR) System Alignment
Crockett B
574 Indigenous Peoples in Evaluation TIG
Multipaper
Translating Evaluation to Enhance Its Meaning and Use: Examples From Two Indigenous Communities - Urban US and Rural… Crockett C
576 Qualitative Methods TIG
Multipaper
Using Qualitative Methods in Evaluations With Limited Resources
Seguin B
577 International and Cross-cultural Evaluation TIG Demonstration
Peace Corps‘ Volunteer Reporting Tool: Increasing the Capacity for Evidence-based Decision-Making at Multiple Levels…
Republic A
578 Health Evaluation TIG
Demonstration
Online Visual System for Strategic Planning and Performance Monitoring: iProgress √ Check
Republic B
579 Theories of Evaluation TIG
Multipaper
The Basis for Good Judgment in Evaluation
Republic C
Evaluation 2010: Friday, November 12, 10:55 AM – 11:40 AM
Page 97
Friday, 10:55 am to 11:40 am
542 - President Obama's Evaluation Policies
Expert Lecture to be held in Lone Star A
Sponsored by the Presidential Strand, and
the Government Evaluation and the
Evaluation Policy TIGs
 Chair - Jennifer Greene, University of
Illinois at Urbana-Champaign
 Discussants - Patrick Grasso, World Bank; and George
Grob, Center for Public Program Evaluation
 Presenters - Stephanie Shipman, United States
Government Accountability Office; and Katherine Dawes,
United States Environmental Protection Agency
543 - Examples From the Field: Using Mixed Methodological Frameworks in Theory-Driven Evaluations
Multipaper to be held in Lone Star B
Sponsored by the Program Theory and Theory-driven
Evaluation TIG
 Chair - Katrina Bledsoe, Walter R McDonald and
Associates Inc
The Mix of Methods: Towards a Framework to Anticipate
Validity Threats When Evaluating Agricultural Value Chain
Development Interventions
 Giel Ton and Marieke De Ruijter De Wildt, LEI
Wageningen UR
Team Process Factors in the Evaluation of a Community-Teambased Entrepreneurial Development Initiative
 Laurie Van Egeren, Meenal Rana, Diane Doberneck, and
Miles McNall, Michigan State University
544 - Youth Participatory Evaluation: Entering the
Age of the Internet
Think Tank to be held in Lone Star C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Presenter - Robert Shumer, University of Minnesota
 Discussants - Robert Shumer, University of Minnesota;
and Kim Sabo Flores, Evaluation Access and ActKnowledge
545 - Funder‘s Use of Network Analysis to Build
Intentional Collaboration
Panel to be held in Lone Star D
Sponsored by the Non-profit and Foundations Evaluation TIG
 Chair - David J Dobrowski, First 5 Monterey
Funder‘s Perspective on Practical Use of Network Analysis
Findings With Funded Agencies
 David J Dobrowski, First 5 Monterey
Evaluator‘s Perspective on Practical Use of Network Analysis
Findings With Funded Agencies
 Raul Martinez, Harder+Company
546 - Using Latent Class Analysis to Target and Tailor
Programs to Specific Populations
Demonstration to be held in Lone Star E
Sponsored by the Quantitative Methods: Theory and Design TIG
 Humphrey Costello and Reese Jenniges, University
of Wyoming
547 - Multi-method Approaches
Multipaper to be held in Lone Star F
Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG
 Chair - John Hitchcock, Ohio University
A Mixed Methods Approach to Measurement for Multi-site
Evaluation
 Carlos Bravo and Fred Springer, Evaluation, Management
& Training Associates Inc
Using Mixed Methods to Examine and Interpret the Impact of a
National Science Foundation (NSF) Geosciences MultiInstitution, Multi-site Teacher Professional Development
Program
 Susan Henderson and Dan Mello, WestEd
548 – Roundtable in Mission A
Sponsored by the Evaluation Managers and Supervisors TIG
Controlling Quality Within Museums: Coordinating Internal
Evaluation Departments
 Sarah Cohn, Science Museum of Minnesota; and Anna
Lindgren-Streicher, Museum of Science, Boston
550 - The Adaptive Action Cycle: Bridging the Gap
Between Lessons Learned and Lessons Applied
Panel to be held in Bowie A
Sponsored by the Systems in Evaluation TIG and the Human
Services Evaluation TIG
 Chair and Discussant - Mallary Tytel, Healthy Workplaces
A Case Study on Adaptive Action in Education
 Royce Holladay, Human Systems Dynamics Institute
Translating Lessons Learned Into Lessons Applied
 Mallary Tytel, Healthy Workplaces
551 - Using Evaluation to Enhance Program
Participation With Underrepresented Groups in
Science, Technology, Engineering and Mathematics
(STEM) Fields
Multipaper to be held in Bowie B
Sponsored by the Multiethnic Issues in Evaluation TIG
 Chair - Tamara Bertrand Jones, Florida State University
Experiences of a Culturally Responsive Evaluator in Analyzing
Scientific Self-Efficacy and Scientific Research Proficiency as
Benefits of Summer Research Participation for
Underrepresented Minorities
 Frances Carter, University of Maryland, Baltimore County
Evaluation 2010: Friday, November 12, 10:55 AM – 11:40 AM
Page 98
Enhancing Minority Representation in the Sciences: Results
From the Evaluation of the Minority Opportunities in Research
(MORE) Programs at Three Universities
 Simeon Slovacek and Jonathan Whittinghill, California
State University, Los Angeles
552 - How Does Evidence Influence Policy Change?
Examining Two Complementary Approaches With Two
Complementary Evaluations
Panel to be held in Bowie C
Sponsored by the Advocacy and Policy Change TIG
 Chair - Carlisle Levine, CARE
 Discussants - Ehren Reed and Veena Pankaj, Innovation
Network
Using Complementary Evaluations to Assess Policy Change
and Build Internal Advocacy Monitoring Capacity
 Carlisle Levine, CARE
Defining and Evaluating Change Agents/Champions: An
Evaluator‘s Perspective
 Lisa Molinaro and David Devlin-Foltz, Aspen Institute
553 – Roundtable in Goliad
Sponsored by the Feminist Issues in Evaluation TIG
Incorporating Gender into Mainstream Projects
 Judith Russell, Independent Consultant; Sathi Dasgupta,
SONA Consulting Inc; Ronda Schlagen, Independent
Consultant; Jim Rugh, Independent Consultant
554 – Roundtable in San Jacinto
Sponsored by the Research on Evaluation TIG
Utilizing Metaevaluation to Validate Evaluation Quality: Study
of a Grant-Funded Graduate Program for Minority Group
Students in Science, Technology, Engineering, and
Mathematics (STEM)
 Angela Watson and Katye Perry, Oklahoma State
University
556 - Using Cost --> Procedure --> Process -->
Outcome Analysis (CPPOA) Data to Improve Substance Abuse Prevention Programs and Portfolios
Panel to be held in Travis B
Sponsored by the Costs, Effectiveness, Benefits, and
Economics TIG
 Chair - Michael Langer, State of Washington
 Discussant - Beverlie Fallik, United States Department of
Health and Human Services
CPPOA of a Fourth Grade Intervention for Preventing Use of
Alcohol, Tobacco, and Other Drugs
 Brian Yates, American University
Secure CPPO Data Sharing Techniques that Efficiently Support
Analysis of Substance Abuse Prevention Policies and Portfolios
 Ron Visscher, Aquinas College
557 - Communication: At What Level Does It Help or
Hinder Evaluation Capacity?
Multipaper to be held in Travis C
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG
 Chair - Eric Barela, Partners in School Innovation
 Discussant - Susan Parker, Clear Thinking Communications
Communicating Versus Real Work? The Communication Burden
on Volunteer Board Members of Growing Evaluation Organizations
 Williams Benita, Feedback Research & Analytics
When a Program Evaluation Goes to a Small Town: Unique
Opportunities in Communication, Accessibility, and Decisionmaking
 Ann G Bessell, Valerntina I Kloosterman, and Sabrina F
Sembiante, University of Miami
558 - Is Quality Improvement In Healthcare CostEffective?
Expert Lecture to be held in Travis D
Sponsored by the Health Evaluation TIG
 Chair - Mary Gutmann, EnCompass LLC
 Edward Broughton, University Research Company LLC
559 - None of the Above: Expanding Binary
Categorizations
Multipaper to be held in Independence
Sponsored by the Lesbian, Gay, Bisexual, and Transgender
Issues TIG
 Chair and Discussant- John T Daws, University of Arizona
Beyond the Binary: Expanding Our Categories of Gender
Identity and Sexual Orientation
 Linda Drach and Kari Greene, Oregon Public Health Division
Queering/ Querying Evaluation: Moving Beyond Political
Correctness and the Binary State of Mind
 Denice Cassaro, Cornell University
560 - Technology and Student Outcomes: Mathematics, Language Arts, and Big-District Diversity
Multipaper to be held in Presidio A
Sponsored by the Distance Education and Other Educational
Technologies TIG
 Chair - Talbot Bielefeldt, International Society for
Technology in Education
Classroom Network Technology as a Support for Systemic
Mathematics Reform: Examining the Effects of Texas
Instruments' MathForward Program on Student Achievement
in a Large, Diverse District
 Corinne Singleton and William R Penuel, SRI International
Effects of Fast ForWord Language Computer-based Training
Program on Student Performance in a Large Central Florida
School District
 Yakup Bilgili, Polk County Public Schools
Evaluation 2010: Friday, November 12, 10:55 AM – 11:40 AM
Page 99
Friday, 10:55 am to 11:40 am, continued
561 - Herding Cats: Improving the Quality and
Quantity of Decentralized Evaluation in a Global
Organization Through Capacity Building
Demonstration to be held in Presidio B
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG
 Thea C Bruhn, United States Department of State
562 - Alcohol, Drug Abuse and Mental Health TIG
Business Meeting
Business Meeting to be held in Presidio C
Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG
 TIG Leaders - Marge Cawley, National Development and
Research Institutes (NDRI); and Diana Seybolt, University of
Maryland, Baltimore
563 – Roundtable in Bonham A
Sponsored by the Business and Industry TIG
Assessing Board Performance: Challenges and Constraints
 Zita Unger, Evaluation Solutions Pty Ltd
564 - Low-cost, High-Quality Assessments for
Nonprofit Adolescent Pregnancy Prevention Program
Planning
Panel to be held in Bonham B
Sponsored by the Non-profit and Foundations Evaluation TIG
 Chair - Shannon Flynn, South Carolina Campaign to
Prevent Teen Pregnancy
Bread, Milk, Condoms: Using Low-cost Strategies to Assess
Youth Experiences with Condom Purchasing in Two
Communities
 Shannon Flynn, Sarah Kershner, and Dana Becker, South
Carolina Campaign to Prevent Teen Pregnancy
Older Youth Pregnancy Prevention: Using Low-cost Methods to
Assess Sexual Health Services in Institutions of Higher
Learning and Identify Outreach Opportunities
 Sarah Kershner, Shannon Flynn, and Mary Prince, South
Carolina Campaign to Prevent Teen Pregnancy
565 - Is Working Together Worth It? The Process and
Findings of a Longitudinal Evaluation of a Districtwide
Professional Learning Community Initiative
566 - Evaluating Education Programs for English
Language Learners
Multipaper to be held in Bonham D
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Courtney Brown, Indiana University
 Discussant - Julie Sugarman, Center for Applied
Linguistics
Multi-dimensional Evaluation of School-wide Intervention for
English Language Learners
 Ginger Gossman, Austin Independent School District
Comparative Effectiveness of the Rosetta Stone Dynamic
Immersion Program: A Report of a Randomized Experiment
 Sara Atienza, Sandy Philipose, Xiaohui Zheng, and Denis
Newman, Empirical Education Inc
567 - From Research to Commercialization: Impact
Evaluation of Portfolios of Research
Multipaper to be held in Bonham E
Sponsored by the Research, Technology, and Development
Evaluation TIG
 Chair - Israel Lederhendler, National Institutes of Health
Tracing From Applied Research Programs to Downstream
Applications: Approach and Findings
 Rosalie Ruegg, TIA Consulting Inc; and Patrick Thomas,
1790 Analytics LLC
Evaluating Ohio's Portfolio of Technology Programs
 David Cheney, Jennifer Ozawa, and Chris Ordowich, SRI
International
569 - Evaluating Government Research and
Technology Policies: Traditional and Emerging
Methods
Multipaper to be held in Texas D
Sponsored by the Research, Technology, and Development
Evaluation TIG
 Chair - Cheryl Oros, Oros Consulting LLC
Quality Evaluations of Government Policies in Research
Science and Technology Sector
 Yelena Thomas, Ministry of Research Science and
Technology
Applications of Agent-based Simulations in Evaluating Science
and Technology Policies
 Branco Ponomariov, University of Texas, San Antonio; and
Craig Boardman, Ohio State University
Expert Lecture to be held in Bonham C
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Rebecca Woodland, University of Massachusetts,
Amherst
 Discussant - Mark Zito, East Hartford Public School District
 Presenter - Rebecca Woodland, University of
Massachusetts, Amherst
Evaluation 2010: Friday, November 12, 10:55 AM – 11:40 AM
Page 100
570 - Joint Evaluation of Private Sector Development
Projects: Benefits and Challenges
Panel to be held in Texas E
Sponsored by the Evaluation Use TIG and the Organizational
Learning and Evaluation Capacity Building TIG
 Chair - Ade Freeman, World Bank
 Discussant - Cheryl Gray, World Bank
Joint Evaluation of Private Sector Development Projects:
Methodological Issues
 Chris Olson, European Bank for Reconstruction and
Development
Joint Evaluation of Private Sector Development Projects:
Practical Applications and Lessons
 Stephen Pirozzi, World Bank
571 - Using R for Statistical Analysis
Demonstration to be held in Texas F
Sponsored by the Graduate Student and New Evaluator TIG
 Kristen Cici, University of Minnesota
572 - The American Evaluation Association's Journal
Editors Discuss Publishing in AEA‘s Journals
Panel to be held in Crockett A
Sponsored by the AEA Conference Committee
 Chair - Thomas Schwandt, University of Illinois at UrbanaChampaign
Publishing in the American Journal of Evaluation
 Thomas Schwandt, University of Illinois at UrbanaChampaign
Publishing in New Directions for Evaluation
 Sandra Mathison, University of British Columbia
573 - How to Use Evaluation to Achieve Human
Resources (HR) System Alignment
Demonstration to be held in Crockett B
Sponsored by the Business and Industry TIG
 Stephanie Fuentes, Inventivo Design LLC
574 - Translating Evaluation to Enhance Its Meaning
and Use: Examples From Two Indigenous
Communities - Urban United States of America and
Rural Uganda
Multipaper to be held in Crockett C
Sponsored by the Indigenous Peoples in Evaluation TIG
 Chair and Discussant - Joan LaFrance, Mekinak
Consulting
Indigenous Approaches to Evaluation in Urban Settings: Theory
Into Practice
 Julie Nielsen, NorthPoint Health and Wellness Center Inc
The Place-Value of Indigenous Knowledge in a Promoting the
Use of Evaluation Findings: A Case Study on Using Qualitative
Measures to Assess the (Potential) Impact of Public Works
Programmes on the Lives of the Poor and the Vulnerable in a
Post-conflict Environment
 Simon Kisira, Evaluation Resource Group
576 - Using Qualitative Methods in Evaluations With
Limited Resources
Multipaper to be held in Seguin B
Sponsored by the Qualitative Methods TIG
 Chair and Discussant - Jennifer Jewiss, University of
Vermont
Surveys: A Tool for Building a Case Study?
 Natalya Gnedko, Chicago Public Schools; and Denise
Roseland, University of Minnesota
Are Surveys Enough? A Case Study in Employing User Tests
and Focus Groups to Improve Website Evaluation
 Michael Porter, Dawn Aguero, and Aimee Reist, College
Center for Library Automation
577 - Peace Corps‘ Volunteer Reporting Tool:
Increasing the Capacity for Evidence-based DecisionMaking at Multiple Levels of the Peace Corps
Demonstration to be held in Republic A
Sponsored by the International & Cross-cultural Evaluation TIG
 Eleanor Shirley, Peace Corps
578 - Online Visual System for Strategic Planning
and Performance Monitoring:
Demonstration to be held in Republic B
Sponsored by the Health Evaluation TIG
 Jianglan White and Alex Cowell, Georgia Department of
Community Health
579 - The Basis for Good Judgment in Evaluation
Multipaper to be held in Republic C
Sponsored by the Theories of Evaluation and the Research on
Evaluation TIGs
 Chair - Bianca Montrosse, Western Carolina University
Ensuring Quality in Evaluation by Generating Credible
Judgment
 Marthe Hurteau, Sylvain Houle, Pascal NDinga, Michael
Schleifer, Véronique Lemieux, and Marie-Pier Marchand,
University of Quebec at Montreal
The Goal Standard, and Knowing Enough for Quality Evaluation
 James Griffith, Claremont Graduate University
Evaluation 2010: Friday, November 12, 10:55 AM – 11:40 AM
Page 101
Summary of Sessions for Friday, November 12, 1:40 PM to 3:10 PM
No Primary Sponsor
Session
Session Title
582 Presidential Strand
Think Tank
In the Multi-level Systemic Evaluation Universe, Whose Responsibility is Quality? A Discussion Among Respected Colleagues Lone Star A
583 Systems in Evaluation TIG
Skill-building
Fitting the Key to the Lock: Matching Systems Methods To Evaluation Questions
Lone Star B
584 Collaborative, Participatory & Empowerment
Think Tank
Youth Participatory Evaluation: Where Are We and Where Do We Go From Here?
Lone Star C
585 Non-profit and Foundations Evaluation TIG
Panel
Helping Nonprofit Agencies Move From Measuring Outcomes to Managing Them: A Budding Success Story…
Lone Star D
586 Quantitative Methods: Theory and Design TIG
Panel
Enhancing the Quality of Evaluations by Rational Planning
Lone Star E
587 AEA Conference Committee
Think Tank
AEA and Public Engagement: How Can AEA‘s Role in Public Engagement Contribute to Evaluation Quality?
Lone Star F
588 Evaluation Managers and Supervisors TIG
Roundtable
Rotation I: Directors of Research Ensuring Quality in Practice
Rotation II: Managing Evaluation: Continuing the Conversation
Mission A
589 Evaluation Policy TIG
Multipaper
Evaluation Management Policies: Examining Requirements of Quality Evaluation
Mission B
590 Independent Consulting TIG
Panel
Integrating Management Consulting Competencies into the Evaluation Process
Bowie A
591 Multiethnic Issues in Evaluation TIG
Panel
The Evolution and Revolution of Culturally Responsive Evaluation
Bowie B
592 Advocacy and Policy Change TIG
Multipaper
Health Matters: Evaluating Advocacy and Policy Change
Bowie C
593 Teaching of Evaluation TIG
Roundtable
Rotation I: The Essentials of a Quality Evaluation Capstone Project, Practicum or Internship: Students‘ Perspectives
Rotation II: An Evaluation Seminar: How our Students Gain Practical Experience in Evaluation and Research Methodology
Goliad
594 Assessment in Higher Education TIG
Roundtable
Rotation I: Conceptualizing the Quality of Assessment
Rotation II: Perspectives on Collaboration in Practice: Expanding the Role and Culture of Assessment in Academic Affairs…
San Jacinto
595 Social Network Analysis TIG
Multipaper
Social Network Analysis Across Disciplines and Purposes
Travis A
596 Integrating Technology Into Evaluation
Demonstration
Multimedia Advances in Evaluation: The Use of Skype, Elluminate, and Virtual World Technologies in Conducting Focus…
Travis B
597 Systems in Evaluation TIG
Multipaper
Real World Applications of System Concepts in Evaluation
Travis C
598 Evaluating the Arts and Culture TIG
Multipaper
Implication of Evaluation Approaches on Arts Organization Policies
Travis D
599 Human Services Evaluation TIG
Multipaper
Interesting Evaluations in Social Services and Welfare
Independence
600 Quantitative Methods: Theory and Design TIG
Multipaper
Structural Equation Modeling Solutions for Evaluators
Presidio A
601 Org Learning & Evaluation Capacity Bldg TIG
Demonstration
Improving the Quality of Analysis, Interpretation, and Reporting of Program Outcomes Through a Measurement, Evaluation… Presidio B
602 Alcohol, Drug Abuse, and Mental Health TIG
Panel
Assessing Implementation Fidelity of Substance Abuse Prevention Environmental Change Strategies: Lessons Learned…
Presidio C
603 Collaborative, Participatory & Empowerment
Roundtable
Rotation I: Slipping and Sliding Like a Weasel on the Run: Empowerment Evaluation and the Hawthorne Effect
Rotation II: Innovations in Youth Empowerment Evaluation
Bonham A
604 Non-profit and Foundations Evaluation TIG
Panel
Improving Evaluation in the Real World of Nonprofits and Foundations
Bonham B
605 Pre-K - 12 Educational Evaluation TIG
Think Tank
Teacher Effectiveness and Teacher Quality: What's the Difference?
Bonham C
606 Pre-K - 12 Educational Evaluation TIG
Multipaper
Fidelity of Program Implementation in Educational Evaluations
Bonham D
Evaluation 2010: Friday, November 12, 1:40 PM – 3:10 PM
Room
Page 102
Summary of Sessions for Friday, November 12, 1:40 PM to 3:10 PM, Continued
No Primary Sponsor
Session
Session Title
Room
607 Environmental Program Evaluation TIG
Multipaper
Key Issues in Evaluating Industrial and Commercial Energy Efficiency Programs and Technologies
Bonham E
609 Research, Technology, and Development
MultiPaper
Report on a Test of a General Method for Quick Evaluation of Medical Research by Morbidity
Texas D
610 Evaluation Use TIG
Think Tank
Taking a Good, Long Look In the Mirror: How Can We Hold Ourselves Accountable for Quality Recommendations?
Texas E
611 Research on Evaluation TIG
Panel
Snapshots of Exemplary Evaluations
Texas F
612 Extension Education Evaluation TIG
Multipaper
Extension Educators and Evaluation
Crockett A
613 Business and Industry TIG
Multipaper
Evaluating Effectiveness in Recruitment, Mentoring, and Human Resources' Functions
Crockett B
614 International and Cross-cultural Evaluation TIG MultiPaper
Impact of Social and Economic Development Interventions: Presentation of Synthetic Reviews of Education, Early Childhood.. Crockett C
615 Government Evaluation TIG
Panel
Perspectives on Conducting Quality Evaluations at Various Levels of Government
Crockett D
616 Qualitative Methods TIG
Multipaper
Reaching for the Pot of Gold: Tested Techniques for Enhancing Evaluation Quality With Trustworthiness and Authenticity
Seguin B
617 International and Cross-cultural Evaluation TIG Panel
Building Capacity to Monitor and Evaluate Development Policies, Programs, and Projects: Everyone Wants to do It, but…
Republic A
618 Health Evaluation TIG
Multipaper
Examining Heart Disease and Stroke: Sharing Lessons to Improve Evaluation Quality
Republic B
619 Collaborative, Participatory & Empowerment
MultiPaper
Preliminary Results of Prevention Capacity Building in Science-based Teen Pregnancy, HIV, and STI Prevention
Republic C
Evaluation 2010: Friday, November 12, 1:40 PM – 3:10 PM
Page 103
Friday, 11:50 am to 1:30 pm
580 - American Evaluation Association
Awards Luncheon
Luncheon to be held in Texas A
 Hosts - Katherine McKnight, Pearson Corporation; Tarek
Azzam, Claremont Graduate University; Leslie Cooksy,
University of Delaware
Friday, 1:40 pm to 3:10 pm
582 - In the Multi-level Systemic Evaluation
Universe, Whose Responsibility is
Quality? A Discussion Among
Respected Colleagues
Think Tank to be held in Lone Star A
Sponsored by the Presidential Strand and the
Cluster, Multi-site and Multi-level Evaluation TIG
 Presenter - Kathleen Toms, Research Works Inc
 Discussants - Sandra Mathison, University of British
Columbia; Michael Morris, University of New Haven; Linda E
Lee, Proactive Information Services Inc; and Josue De La Rosa,
Research Works Inc
583 - Fitting the Key to the Lock: Matching Systems
Methods To Evaluation Questions
Skill-building Workshop to be held in Lone Star B
Sponsored by the Systems in Evaluation TIG
 Bob Williams, Independent Consultnat
584 - Youth Participatory Evaluation: Where Are We
and Where Do We Go From Here?
Think Tank to be held in Lone Star C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Presenter - Kim Sabo Flores, Evaluation Access and
ActKnowledge
 Discussants - Jane Powers, Cornell Univeristy; and Katie
Richards-Schuster, University of Michigan
585 - Helping Nonprofit Agencies Move From
Measuring Outcomes to Managing Them: A Budding
Success Story From the United Way of Greater
Houston
The Exciting Shift From Outcomes Measurement to Outcomes
Management: The National, Cross-sectoral Perspective
 Michael Hendricks, Independent Consultant
The United Way of Greater Houston‘s Journey With Outcomes
Measurement and Management
 Amy Corron, United Way of Greater Houston
Facilitating the Journey: Making Sense of Outcomes
Measurement and Management With Agency Partners
 Najah Callander, United Way of Greater Houston
Helping Similar Agencies Manage Common Outcomes: The
Agency Perspective
 Abeer Monem, Fort Bend County Women's Center Inc
586 - Enhancing the Quality of Evaluations by
Rational Planning
Panel to be held in Lone Star E
Sponsored by the Quantitative Methods: Theory and Design TIG
 Chair - Frederic Malter, University of Arizona
Building Evaluations on Theories and Models
 Michele Walsh and Lee Sechrest, University of Arizona
Design and Methods in the Planning Stage of Evaluation
 Katherine McKnight, Pearson Corportation
What Happens When Measurement Planning Fails
 Patricia Herman and Mei-kuang Chen, University of Arizona
Data Analysis: Forethought, Not Afterthought
 Patrick McKnight, George Mason University
587 - AEA and Public Engagement: How Can the
American Evaluation Association‘s Role in Public
Engagement Contribute to Evaluation Quality?
Think Tank to be held in Lone Star F
Sponsored by the AEA Conference Committee
 Presenter - Thomaz Chianca, COMEA Evaluation Ltd
 Discussants - Nicki King, University of California, Davis;
and Jim Rugh, Independent Consultant
588 – Roundtables in Mission A
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Evaluation Managers and Supervisors TIG
Rotation 1: Managing Evaluation: Continuing the Conversation
 Donald Compton, Centers for Disease Control and
Prevention; Michael Baizerman, University of Minnesota; and
Michael Schooley, Centers for Disease Control and Prevention
Rotation 2: Directors of Research Ensuring Quality in Practice
 Colleen Manning, Goodman Research Group Inc
Panel to be held in Lone Star D
Sponsored by the Non-profit and Foundations Evaluation TIG
 Chair - Michael Hendricks, Independent Consultant
Evaluation 2010: Friday, November 12, 11:50 AM – 1:30 PM, 1:40 PM – 3:10 PM
Page 104
589 - Evaluation Management Policies: Examining
Requirements of Quality Evaluation
Multipaper to be held in Mission B
Sponsored by the Evaluation Policy TIG
 Chair - Lisa Rajigah, International Initiative for Impact
Evaluation (3ie)
 Discussant - Gary Miron, Western Michgian University; and
Leslie Fierro, SciMetrika
Sustaining School Reform: A Guide to Support Evaluation
Policy
 Louis Cicchinelli and Zoe Barley, Mid-continent Research
for Education and Learning
Effective Policy in Saudi Arabia's Gifted Organizations
 Fayez Shafloot, Western Michigan University
Blueprint for Quality Evaluation and Quality Services in Human
Service Organizations: Why Evaluation Policy Matters
 Kristin Kaylor Richardson, Western Michigan University
Evaluation Policy Inventory
 Margaret Johnson and William M Trochim, Cornell
University
Exploring Dueling Federal Funder Preferences and Program
Evaluation Needs: Challenges With Conflicting Interests and
Evaluator Roles
 Holly Downs, University of Illinois at Urbana-Champaign
590 - Integrating Management Consulting
Competencies into the Evaluation Process
Panel to be held in Bowie A
Sponsored by the Independent Consulting TIG
 Chair - Pamela Davidson, University of California, Los
Angeles
The Evaluator as a Consultant to Management
 Anthony Raia, University of California, Los Angeles
The Consultative Process and the Management of Change
 Kurt Motamedi, Pepperdine University
Consulting Competencies to Expand the Evaluator‘s Role
 Pamela Davidson, University of California, Los Angeles
Looking Within: Expressing Program Stories With Cultural
Metaphors
 Joan LaFrance, Mekinak Consulting
Tensions Between What Is Knowable From the Outside and
What is Knowable From the Inside
 Kataraina Pipi, Independent Consultant
Responsible Responsiveness in Evaluation: To Whom and to
What?
 Jennifer Greene, Jeehae Ahn, and Ayesha Boyce, University
of Illinois at Urbana-Champaign
592 - Health Matters: Evaluating Advocacy and
Policy Change
Multipaper to be held in Bowie C
Sponsored by the Advocacy and Policy Change and the Health
Evaluation TIGs
 Chair - Astrid Hendricks, California Endowment
Using Case Studies to Assess Longer: Term Outcomes of
Expanded Advocacy Capacity
 Annette Gardner and Claire Brindis, University of
California, San Francisco; Lori Nascimento, California
Endowment; and Sara Geierstanger, University of California,
San Francisco
Employing a Systems Change Framework to Evaluate Health
and Education Policy Advocacy in California
 Mary Kreger, Claire Brindis, Abigial Arons, Gaylen Mohre,
Elodia Villasenor, and Katherine Sargent, University of
California, San Francisco
Sara Truebridge and Bonnie Benard, WestEd; and Mona
Jhawar, California Endowment
Tracking and Assessing State Policies Related to Food and
Active Living
 Martha Quinn and Carpenter Laurie, University of
Michigan
Conducting Research to Advance Smoke-Free Air Legislation in
Louisiana
 Jenna Klink, Nikki Lawhorn, and Lisanne Brown, Louisiana
Public Health Institute
591 - The Evolution and Revolution of Culturally
Responsive Evaluation
593 – Roundtables in Goliad
Panel to be held in Bowie B
Sponsored by the Multiethnic Issues in Evaluation TIG
 Chair - Fiona Cram, Katoa Ltd
 Discussants - Karen E Kirkhart, Syracuse University; and
Nan Wehipeihana, Research Evaluation Consultancy Limited
Looking Back to Move Forward: The Visual Transition of the
African American Culturally Responsive Evaluation System
(ACESAS) Logic Model to Enhance Culturally Responsive
Evaluation in African American Communities
 Pamela Frazier-Anderson, Lincoln University; Stafford
Hood, University of Illinois at Urbana-Champaign; and Rodney
Hopson, Duquesne University
Sponsored by the Teaching of Evaluation TIG
Rotation 1: The Essentials of a Quality Evaluation Capstone
Project, Practicum or Internship: Students‘ Perspective
 Aubrey W Perry, Portland State University; Robert
Tornberg, University of Minnesota; and Veronica Smith,
data2insight
Rotation 2: An Evaluation Seminar: How Our Students Gain
Practical Experience in Evaluation and Research Methodology
 Jennifer Morrow, Gary Skolits, Thelma Woodard, and
Susanne Kaesbauer, University of Tennessee, Knoxville
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Evaluation 2010: Friday, November 12, 1:40 PM – 3:10 PM
Page 105
Friday, 1:40 pm to 3:10 pm, continued
594 – Roundtables in San Jacinto
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Assessment in Higher Education TIG
Rotation 1: Conceptualizing the Quality of Assessment
 Steve Culver and Ray Van Dyke, Virginia Tech
Rotation 2: Perspectives on Collaboration in Practice:
Expanding the Role and Culture of Assessment in Academic
Affairs and Student Services in Higher Education
 Ge Chen, Glen E Baumgart, and R Joseph Rodriguez,
University of Texas, Austin
595 - Social Network Analysis Across Disciplines and
Purposes
Multipaper to be held in Travis A
Sponsored by the Social Network Analysis TIG
 Chair and Discussant - Maryann Durland, Durland
Consulting
Use of Longitudinal Social Network Analysis: Examining
Changes in Networks Among Emerging Leaders in the Ladder
to Leadership Program
 Kimberly Fredericks, The Sage Colleges; Julia JacksonNewsom, University of North Carolina at Greensboro; Heather
Champion and Tracy Enright Patterson, Center for Creative
Leadership
Making Meaning: Participatory Social Network Analysis
 Susan Connors, Marc Brodersen, Kathryn Nearing, and
Bonnie Walters, University of Colorado, Denver
Bridges and Barriers to Nurturing Interdisciplinary Research:
Evaluating the Social Networks of Integrative Graduate
Education and Research Trainees and Their Comparative Peers
Over Time
 Megan Haller and Eric Welch, University of Illinois at
Chicago
Applying Social Network Analysis to Understand How YouthServing Agencies Collaborate to Connect Youth at Risk of
Suicide to Services
 Anupa Fabian, Elana Light, Christine Walrath-Greene,
Robert L Stephens, and Michael S Rodi, ICF Macro
A Social Network Perspective for Evaluating Transnational Policy Diffusion: The Case of the Hyogo Framework for Action (HFA)
 Aileen Lapitan, University of North Carolina at Charlotte
596 - Multimedia Advances in Evaluation: The Use of
Skype, Elluminate, and Virtual World Technologies in
Conducting Focus Group Interviews
Demonstration to be held in Travis B
Sponsored by the Integrating Technology Into Evaluation TIG
 Corliss Brown, Lauren Kendall, Taniya Reaves, Jessica
Milton, and Johnavae Campbell, University of North Carolina at
Chapel-Hill
597 - Real World Applications of System Concepts in
Evaluation
Multipaper to be held in Travis C
Sponsored by the Systems in Evaluation TIG
 Chair and Discussant - Janice Noga, Pathfinder Evaluation
and Consulting
Using Systems Concepts to Evaluate the iPlant Collaborative:
Quality, Implications, and Benefits
 Barbara Heath and Claire Stuebe, East Main Educational
Consulting
The iPlant Collaborative: Using Case Study Methodology in a
Systems-based Framework
 Claire Stuebe and Barbara Heath, East Main Educational
Consulting
Evaluating the Tennessee Lives Count Juvenile Justice Suicide
Prevention Project: Strategies for Incorporating System Level
Data in Evaluations of Complex Public Health Prevention
Programs
 Jennifer Lockman, Heather Wilson, and Kathryn A Bowen,
Centerstone Research Institute
598 - Implication of Evaluation Approaches on Arts
Organization Policies
Multipaper to be held in Travis D
Sponsored by the Evaluating the Arts and Culture TIG
 Chair - Ching Ching Yap, Savannah College of Art and
Design
 Discussant - Don Glass, VSA
Mission Conceived Versus Mission Achieved
 Paul Lorton Jr, University of San Francisco
Some Children Left Behind: Policy Implications for Children‘s
Museums Providing Educational Services to Minority Youth and
Children With Special Needs
 Deborah A Chapin, Excelsior College; Anna Lobosco, New
York State Developmental Disabilities Planning Council; and
Dianna L Newman, State University of New York at Albany
599 - Interesting Evaluations in Social Services and
Welfare
Multipaper to be held in Independence
Sponsored by the Human Services Evaluation TIG
 Chair - Lois Thiessen-Love, Uhlich Children's Advantage
Network
Come Together Now: Measuring the Level of Collaboration
 Yvonne Kellar-Guenther and William Betts, University of
Colorado, Denver
The Use of Time Series Design and Intervention Analysis in
Evaluating Welfare Policy
 Elizabeth Hayden, Northeastern University
Evaluation 2010: Friday, November 12, 1:40 PM – 3:10 PM
Page 106
600 - Structural Equation Modeling Solutions for
Evaluators
Multipaper to be held in Presidio A
Sponsored by the Quantitative Methods: Theory and Design TIG
 Chair - Frederick Newman, Florida International Unversity
Modeling Reciprocal Relationships Among Program Outcomes
 Omolola A Adedokun and Timothy J Owens, Purdue
University
Interpreting Differences in Covariance Structures Among
Clinical and Demographic Subgroups for a Model Describing
Perceived Barriers to Seeking Help for Abused Elder Women
 Frederick Newman, Laura Seff, and Richard Bealaurier,
Florida International Unversity
A Quantile Regression Analysis of Incarcerated Youth‘s
Reading Achievement: Compare and Contrast the Ordinary
Least Square Regression and Quantile Regression
 Weijia Ren, Ann O'Connell, William Loadman, and Raeal
Moore, The Ohio State University
Evaluating Potential Impact of Intervention in Community
Settings When No Comparison Data is Available: Mixture
Latent Growth Modeling for Exploring Differential Change in
Female Condom Use
 Maryann Abbott, Emil Coman, and Peg Weeks, Institute for
Community Research
601 - Improving the Quality of Analysis,
Interpretation, and Reporting of Program Outcomes
Through a Measurement, Evaluation, and Statistics
Training Course
Demonstration to be held in Presidio B
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG
 Yvonne Watson, United States Environmental Protection
Agency; Tracy Dyke Redmond, Industrial Economics Inc; and
Terell Lasane, United States Environmental Protection Agency
602 - Assessing Implementation Fidelity of
Substance Abuse Prevention Environmental
Change Strategies: Lessons Learned From the
Substance Abuse and Mental Health
Services Administration (SAMHSA), Center for
Substance Abuse Prevention (CSAP), Strategic
Prevention Framework State Incentive Grant (SPFSIG), and National Cross-site Evaluation
Panel to be held in Presidio C
Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG
 Chair - Kristi Pettibone, National Institute of
Environmental Health Sciences
A Process for Assessing Implementaion Fidelity for Substance
Abuse Prevention Environmental Change Strategies
 Ann Landy and Elisabeth Cook, Westat
Exploring the Relationship Between Implementation Fidelity
and Process and Outcome Data to Evaluate the Effectiveness
of Environmental Change Strategies
 Kristi Pettibone, National Institute of Environmental
Health Sciences
Adaptation of the Strategic Prevention Framework State
Incentive Grant (SPF SIG) Implementation Fidelity Assessment
User's Guide in Texas
 Adrian Reyes, Behavioral Assessment Inc
603 – Roundtables in Bonham A
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
Rotation 1: Innovations in Youth Empowerment Evaluation
 Kimberly Kay Lopez, Independent Consultant
Rotation 2: Slipping and Sliding Like a Weasel on the Run:
Empowerment Evaluation and the Hawthorne Effect
 Michael Matteson, University of Wollongong
604 - Improving Evaluation in the Real World of
Nonprofits and Foundations
Panel to be held in Bonham B
Sponsored by the Non-profit and Foundations Evaluation TIG
 Chair - Pamela Imm, University of South Carolina
 Discussant - Abraham Wandersman, University of South
Carolina
Intregrating Evaluation Into the Grantmaking Agenda
 Pamela Imm, University of South Carolina
Why and How Should Foundations Engage Skilled, Experienced
Program Evaluators in Their Grantmaking?
 Jan Yost, Health Foundation of Central Massachusetts
How Can Foundations Attract and Retain Skilled, Experienced
Program Evaluators for Local Projects?
 Emily Rothman, Boston University
605 - Teacher Effectiveness and Teacher Quality:
What's the Difference?
Think Tank to be held in Bonham C
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Presenter - Nathan Balasubramanian, Centennial Board of
Cooperative Educational Services
 Discussants - Nathan Balasubramanian, Centennial Board
of Cooperative Educational Services; Joy Perry, Fort Morgan
School District; and Roxie Bracken, Keenesburg School District
Evaluation 2010: Friday, November 12, 1:40 PM – 3:10 PM
Page 107
Friday, 1:40 pm to 3:10 pm, continued
606 - Fidelity of Program Implementation in
Educational Evaluations
Multipaper to be held in Bonham D
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Javan Ridge, Colorado Springs School District 11
 Discussant - Stacey Merola, ICF International
Measuring the Fidelity of Implementation of Response to
Intervention for Behavior (Positive Behavior Support) Across All
Three Tiers of Support
 Karen Childs, Florida Positive Behavior Support
A Practical Approach to Managing Issues in Implementation
Fidelity in K–12 Programs
 Hendrick Ruitman, Rebecca Eddy, and Namrata Mahajan,
Cobblestone Applied Research & Evaluation Inc
A Study of the Relationship Between Fidelity of Program
Implementation and Achievement Outcomes
 Sarah Gareau, Heather Bennett, Diane Monrad, Tammiee
Dickenson, and Tomonori Ishikawa, University of South
Carolina
Using an Innovation Configuration Map to Empirically Establish
Implementation Fidelity of an Intervention to Improve
Achievement of Struggling Adolescent Readers
 Jill Feldman and Ning Rui, Research for Better Schools
607 - Key Issues in Evaluating Industrial and
Commercial Energy Efficiency Programs and
Technologies
Multipaper to be held in Bonham E
Sponsored by the Environmental Program Evaluation TIG and
the Business and Industry TIG
 Chair - Mary Sutter, Opinion Dynamics Corporation
Evaluation Results Help Programs Cool Off!
 Lark Lee and Laura Schauer, PA Consulting Group
Evaluation of Progress to Develop and Evaluate Sustainable
Federal Facilities
 Dale Pahl, Dan Amon, Bill Ridge, Andy Miller, and Bob
Thompson, United States Environmental Protection Agency
Why Market Evaluations Matter! Significantly Improving Energy
Program Outcomes With Market Intelligence in the Large
Commercial Building Sector
 John Reed, Innovologie LLC
When Designing a High Quality Evaluation Involves Complex
and Evolving Program Issues: Strategies From an Evaluation of
an Industrial Process Energy Efficiency Program
 Kara Crohn and Marjorie McCrae, Research Into Action
609 - Report on a Test of a General Method for Quick
Evaluation of Medical Research by Morbidity
MultiPaper to be held in Texas D
Sponsored by the Research, Technology, and Development
Evaluation TIG and the Health Evaluation TIG
 Chair - Jerald Hage, University of Maryland
A Method for Quick Evaluation of Medical Research
 Jerald Hage, University of Maryland
A Quick Evaluation of Alzheimer‘s Disease Research
 Amber Nelson, University of Maryland
A Quick Evaluation of Breast Cancer Research
 J Alice Nixon, University of Maryland
A Quick Evaluation of Colorectal Cancer Research
 Joseph Waggle, University of Maryland
610 - Taking a Good, Long Look In the Mirror: How
Can We Hold Ourselves Accountable for Quality
Recommendations?
Think Tank to be held in Texas E
Sponsored by the Evaluation Use and the Organizational
Learning and Evaluation Capacity Building TIGs
 Presenter - Jennifer Iriti, University of Pittsburgh
 Discussants - Jennifer Iriti, University of Pittsburgh
Kari Nelsestuen, Education Northwest
611 - Snapshots of Exemplary Evaluations
Panel to be held in Texas F
Sponsored by the Research on Evaluation TIG
 Chair - Paul Brandon, University of Hawaii
 Discussant - Paul Brandon, University of Hawaii
Informing Policy in a Cultural Crossfire: The Title V Abstinence
Education Evaluation
 Christopher Trenholm and Barbara Devaney, Mathematica
Policy Research
Exemplariness as Engaging and Value-added Evaluation
 Melanie Hwalek, SPEC Associates
Curbing Home Health Care Costs While Improving Quality of
Care
 George Grob, Center for Public Program Evaluation
Exemplary Evaluations: Characteristics, Conditions, and
Considerations
 Nick Smith and Leigh M Tolley, Syracuse University
Did you know? AEA365 is a service that sends a tipa-day by and for evaluators right to your email. Want
to subscribe? Go to eval.org and you‘ll find
subscriptions options on the left-hand column.
Evaluation 2010: Friday, November 12, 1:40 PM – 3:10 PM
Page 108
612 - Extension Educators and Evaluation
Multipaper to be held in Crockett A
Sponsored by the Extension Education Evaluation TIG
 Chair - Karen Ballard, University of Arkansas
Beyond reporting: Do Extension Educators Use the Results of
Evaluations?
 Sarah Baughman and Heather Boyd, Virginia Polytechnic
Institute and State University; and Nancy Franz, Virginia Tech
Program Evaluation Competencies of Extension Educators:
Implications for Professional Development
 Megan McClure, Texas A&M University; and Nick Fuhrman
and Chris Morgan, University of Georgia
Online Learning Circles: Building Evaluation Capacity Out of
Thin Air
 Benjamin Silliman, North Carolina State University
613 - Evaluating Effectiveness in Recruitment,
Mentoring, and Human Resources' Functions
Multipaper to be held in Crockett B
Sponsored by the Business and Industry TIG
 Chair - Ray Haynes, Indiana University
Ascertaining the Comparative Yields of Alternate Methods of
Employment Recruitment: A Management Application of
Empirical Assessment Techniques
 Ann Breihan, College of Notre Dame of Maryland
Developmental Network Mentoring: A Logic Model Approach to
Evaluating This Form of Organizational Mentoring
 Ray Haynes, Indiana University; and Rajashi Ghosh, Drexel
University
An Historical Study of Effectiveness of Taiwanese Companies'
Human Resources (HR) Functions in China
 Chien Yu, National Taiwan Normal University
614 - Impact of Social and Economic Development
Interventions: Presentation of Synthetic Reviews of
Education, Early Childhood Development and Agricultural Extension Programs in Developing Countries
MultiPaper to be held in Crockett C
Sponsored by the International & Cross-cultural Evaluation TIG
 Chair - Marie Gaarder, International Initiative for Impact
Evaluation (3ie)
The Impact of Agricultural Extension Services
 Hugh Waddington, Birte Snilstveit, and Howard White,
International Initiative for Impact Evaluation (3ie); and Jock
Anderson, World Bank
The Effects of K-12 School Enrollment Policies in Developing
Countries
 Anthony Petrosino and Claire Morgan, WestEd; and Robert
F Boruch, University of Pennsylvania
The Impact of Daycare Programs on Child Health, Nutrition and
Development in Developing Countries
 Paola Gadsden, Instituto Nacional de Salud Publica
615 - Perspectives on Conducting Quality
Evaluations at Various Levels of Government
Panel to be held in Crockett D
Sponsored by the Government Evaluation TIG
 Chair - Rakesh Mohan, Idaho State Legislature
 Discussant - Kathryn Newcomer, George Washington
University
Quality Standards in International Development Evaluation
 Patrick Grasso, World Bank
A Pragmatic Approach to Ensuring Quality in County
Government Evaluation
 David J Bernstein, Westat
Rigorous Evaluation and City Government: Examples From New
York City's Center for Economic Opportunity
 Kathryn Henderson, Debra Rog, and Jennifer Hamilton,
Westat
616 - Reaching for the Pot of Gold: Tested
Techniques for Enhancing Evaluation Quality
With Trustworthiness and Authenticity
Multipaper to be held in Seguin B
Sponsored by the Qualitative Methods TIG
 Chair and Discussant - Eric Barela, Partners in School
Innovation
Lessons Learned From Planning and Conducting Site Visits
 Mika Yamashita, Academy for Educational Development
A Recipe for Success: Lessons Learned for Using Qualitative
Methods Across Project Teams
 Nicole Leacock, Stephanie Herbers, Nancy Mueller,
Virginia Houmes, Lana Wald, and Eric Ndichu, Washington
University in St Louis
Applications of Credibility Techniques to Promote
Trustworthiness of Findings in a Qualitative Program
Evaluation: A Demonstration
 John Hitchcock, Jerry Johnson, and Bonnie Prince, Ohio
University
Did you know? AEA‘s members have free electronic
access from the AEA website to over 20 years of
articles from the American Journal of Evaluation, New
Directions for Evaluation, Evaluation Review, and
Evaluation in the Health Professions.
Evaluation 2010: Friday, November 12, 1:40 PM – 3:10 PM
Page 109
Friday, 1:40 pm to 3:10 pm, continued
617 - Building Capacity to Monitor and Evaluate
Development Policies, Programs, and Projects:
Everyone Wants to do It, but How Should It Be Done
to Ensure High Quality?
Panel to be held in Republic A
Sponsored by the International & Cross-cultural Evaluation TIG
 Chair - Linda Morra Imas, World Bank
Evaluation Capacity Building: Lessons Learned From the Field
in Botswana
 Robert Lahey, REL Solutions Inc
Evaluation Capacity Building in the International Context: View
From the Academy
 Robert Shepherd, and Susan Phillips, Carleton University
Building Capacity in Development Evaluation: The
International Program in Development Evaluation Training
 Linda Morra Imas, World Bank
Regional Centers for Evaluation Capacity Development
 Nidhi Khattri, World Bank
618 - Examining Heart Disease and Stroke: Sharing
Lessons to Improve Evaluation
Multipaper to be held in Republic B
Sponsored by the Health Evaluation TIG
 Chair - Cindy Wong, Bradeis University
Evaluating a Statewide Health System Improvement Effort:
Reducing Time to Treatment for Heart Attack and Stroke
Patients
 Megan Mikkelsen, Washington State Department of
Health
Assuring Quality in the Design of a Multi-state Surveillance
Evaluation
 Monica Oliver and Rachel Barron-Simpson, Centers for
Disease Control and Prevention
Outcome Measurement in Health Evaluation: Evaluation of the
Heart & Stroke Foundation of Ontario‘s (HSFO) Hypertension
Management Initiative (HMI)
 Shirley Von Sychowski, Heart and Stroke Foundation of
Ontario
Evaluation at the Community Level: The Importance of Quality
 Aisha Tucker Brown and Alberta Mirambeau, Centers for
Disease Control and Prevention
619 - Preliminary Results of Prevention Capacity
Building in Science-based Teen Pregnancy, HIV, and
STI (Sexually Transmitted Infections) Prevention
MultiPaper to be held in Republic C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Chair - Duane House, Centers for Disease Control and
Prevention
 Discussant - Thomas Chapel, Centers for Disease Control
and Prevention
Capacity Change Over Time: Is Prevention Capacity and
Capacity Utilization Changing Across Local Partners?
 Duane House and Catherine Lesesne, Centers for Disease
Control and Prevention
Understanding Changes in Capacity to Use Science-based
Approaches Over Time
 Jennifer Duffy, Mary Prince, Erin Johnson, Chris Rollison,
and Forrest Alton, South Carolina Campaign to Prevent Teen
Pregnancy
Telling the Massachusetts Alliance Story: A Community Case
Study on Local Capacity Building
 Jessica Waggett, Omonyele Adjognon, and Elisa Friedman,
Institute for Community Health; and Erica Fletcher and
Consuela Greene, Massachusetts Alliance on Teen Pregnancy
Measuring and Understanding Promoting Science-Based
Approaches (PSBA) Local Capacity Building
 Afsaneh Rahimian, LaJuana Johnson, Kirsten Harris-Tally,
John Perkins, Jeana Johnson, and April Pace, Center for Health
Training Resource Group
Evaluation 2010: Friday, November 12, 1:40 PM – 3:10 PM
Page 110
Notes:
Evaluation 2010: Friday, November 12, 1:40 PM – 3:10 PM
Page 111
Summary of Sessions for Friday, November 12, 3:35 PM to 4:20 PM
No Primary Sponsor
Session
Session Title
Room
622 Presidential Strand
Think Tank
Exploring the Intersection of Beauty and Quality With the Student Travel Award Winners
Lone Star A
623 Program Theory and Theory-driven Evaluation
Multipaper
Using Quantitative Analyses in the Development and Testing of Theories of Change
Lone Star B
624 Collaborative, Participatory & Empowerment
Expert Lecture
Rights-based Evaluation and Active Citizenship in Development Contexts
Lone Star C
625 Non-profit and Foundations Evaluation TIG
Panel
Communities of Practice (CoP) as a Foundation Strategy
Lone Star D
626 Quantitative Methods: Theory and Design TIG
Demonstration
Using Regression Discontinuity Designs for Program Evaluation
Lone Star E
627 Cluster, Multi-site & Multi-level Evaluation TIG Multipaper
Exemplars of School Evaluations
Lone Star F
628 Lesbian, Gay, Bisexual, Transgender Issues TIG Roundtable
Improving the Quality of Evaluations That Include LGBT: Tools for the Evaluator?
Mission A
629 Social Work TIG
Multipaper
Program Fidelity and Development in Social Work
Mission B
630 Systems in Evaluation TIG
MultiPaper
The Role of Collaboratives in Promoting Community and Systems Changes
Bowie A
631 Multiethnic Issues in Evaluation TIG
Demonstration
How Well Are We Addressing Asthma Disparities? Demonstration of a New Evaluation Toolkit
Bowie B
632 AEA Conference Committee
Panel
High Flexibility and Low Fidelity: The Challenges of Evaluating Highly Adaptable Programs
Bowie C
633 Government Evaluation TIG
Roundtable
Celebrating Government Evaluation: Forging Links Among Research, Policy Decisions, and Evaluation to Protect Air Quality
Goliad
634 Evaluating the Arts and Culture TIG
Roundtable
The Evolution of Integrating Arts-based Inquiry in Evaluation
San Jacinto
635 Assessment in Higher Education TIG
Expert Lecture
Compared to What? Reconsidering Assessment in Higher Education
Travis A
636 Integrating Technology Into Evaluation TIG
Panel
Using New Technologies to Support Evaluation Quality and Organizational Learning
Travis B
637 Org Learning & Evaluation Capacity Bldg TIG
Demonstration
Creating Statewide Guidelines for Twenty First Century Community Learning Centers' Local Evaluation
Travis C
638 Health Evaluation TIG
Demonstration
Is Your Program Sustainable? A Practical Tool for Evaluating Sustainability
Travis D
639 Lesbian, Gay, Bisexual, Transgender Issues TIG Panel
Nerd Activism: Using Data as the Vehicle for Community Mobilization
Independence
640 Distance Ed. & Other Educational Technologies Think Tank
Digital Media and Learning for Youth: What Do They Know, When Do They Know It, How Do We Evaluate It?
Presidio A
641 Org Learning & Evaluation Capacity Bldg TIG
Multipaper
Engaging Practitioners in the Medical Field to Build Evaluation Capacity
Presidio B
642 Alcohol, Drug Abuse, and Mental Health TIG
Demonstration
Building a Flexible, Web-based Analysis Tool to Examine Person Level Changes Over Time in a Mental Health Outcomes…
Presidio C
643 Pre-K - 12 Educational Evaluation TIG
Roundtable
The Cost of Delayed Start: Effect of Early Algebra on End of High School, Transition to College, and End-of-College STEM…
Bonham A
645 Pre-K - 12 Educational Evaluation TIG
Multipaper
Meta-reviews in Rural Education and Reading Interventions
Bonham C
646 Pre-K - 12 Educational Evaluation TIG
MultiPaper
Applying Evaluation to Improve Learning Outcomes: Scaling Up From Small Schools to a Million Students
Bonham D
647 Environmental Program Evaluation TIG
Multipaper
Improving the Quality of Habitat and Biodiversity Conservation Program Evaluations Using Methodological and Budgetary…
Bonham E
649 Research, Technology, and Development
Demonstration
Assessing Faculty Productivity and Institutional Research Performance: Using Publication and Citation Key Performance…
Texas D
Evaluation 2010: Friday, November 12, 3:35 PM – 4:20 PM
Page 112
Summary of Sessions for Friday, November 12, 3:35 PM to 4:20 PM, Continued
No Primary Sponsor
Session
Session Title
Room
650 Evaluation Use TIG
Demonstration
Moving Beyond the Weighty Tome: New Approaches to Reporting Evaluation Findings
Texas E
651 Evaluation Policy TIG
Expert Lecture
Introduction to Evaluation and Public Policy
Texas F
652 Extension Education Evaluation TIG
Demonstration
Program Evaluation Network: Capacity and Creativity for Multi-Site Program Evaluation
Crockett A
653 Business and Industry TIG
Expert Lecture
Small Business Sustainability: A Systems Approach to Triple Bottom Line Success
Crockett B
654 Indigenous Peoples in Evaluation TIG
Multipaper
Understanding Indigenous Higher Education Expenses: Innovative Evaluations From New Zealand and Hawaii
Crockett C
655 Government Evaluation TIG
Expert Lecture
A Theory Driven Multi-year Strategic Evaluation Plan for a Multi-program Government Agency
Crockett D
656 Graduate Student and New Evaluator TIG
Multipaper
Advancing the Field of Evaluation
Seguin B
657 International and Cross-cultural Evaluation TIG Multipaper
Evaluation Capacity Building in International Contexts
Republic A
658 Health Evaluation TIG
Multipaper
Health Care Delivery, Effectiveness, and Reform: Where to Go From Here?
Republic B
659 Business and Industry TIG
Multipaper
Risk and Tension in Private Sector Development Project Evaluation
Republic C
Evaluation 2010: Friday, November 12, 3:35 PM – 4:20 PM
Page 113
Friday, 3:35 pm to 4:20 pm
622 - Exploring the Intersection of Beauty and
Quality With the Student Travel Award Winners
Think Tank to be held in Lone Star A
Sponsored by the Presidential Strand
 Chair - Leslie Cooksy, University of
Delaware
 Presenters - Jeehae Ahn, University of
Illinois at Urbana-Champaign; Stephanie Coleman, University
of Missouri; Brandi Gilbert, University of Colorado, Boulder;
Douglas Grane, University of Iowa; and Han-yun Tseng,
Washington State University
623 - Using Quantitative Analyses in the
Development and Testing of Theories of Change
Multipaper to be held in Lone Star B
Sponsored by the Program Theory and Theory-driven
Evaluation TIG
 Chair - John Gargani, Gargani + Company
Assessing a Theory of Change for the Choice to Be Sexually
Abstinent: Testing a Conceptual Model of Behavior Choices
Among Adolescents
 Amy Laura Arnold, Virginia Dick, Ann Peisher, University of
Georgia; Robetta McKenzie, Katrina Aaron, Augusta Partnership
for Children Inc; and Don Bower, University of Georgia
Quantitative Content Analysis for Developing a Competitive
Grant‘s Program Theory From its Request Applications
 Elena Polush and Carl Roberts, Iowa State University
624 - Rights-based Evaluation and Active Citizenship
in Development Contexts
Expert Lecture to be held in Lone Star C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Chair - Robert Stake, University of Illinois at UrbanaChampaign
 Saville Kushner, University of the West of England
625 - Communities of Practice (CoP) as a Foundation
Strategy
Panel to be held in Lone Star D
Sponsored by the Non-profit and Foundations Evaluation TIG
 Chair - Tania Jarosewich, Censeo Group
 Discussant - Nushina Mir, Lumina Foundation for
Education
Framework for Analyzing CoP in Foundation-led Initiatives
 Tania Jarosewich, Censeo Group
Assessing the Value of a Learning Community Strategy: An
Evaluation Framework Informed by Realistic Evaluation and
Systems Thinking
 Ruth Mohr, SPEC Associates
626 - Using Regression Discontinuity Designs for
Program Evaluation
Demonstration to be held in Lone Star E
Sponsored by the Quantitative Methods: Theory and Design TIG
 Joseph Stevens and Keith Zvoch, University of Oregon; and
Drew Braun, Bethel School District
627 - Exemplars of School Evaluations
Multipaper to be held in Lone Star F
Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG
 Chair - Rene Lavinghouze, Centers for Disease Control and
Prevention
Correlates of Perceived Effectiveness of the Safe Schools and
Healthy Students Initiative
 Bruce Ellis, Ping Yu, and Aaron Alford, Battelle Memorial
Institute; Danyelle Mannix, United States Department of Health
and Human Services; and Sharon Xiong, Battelle Memorial
Institute
County-level Versus State-level Results: Is It Worth the Effort?
 Susan Saka, University of Hawaii, Manoa
628 – Roundtable in Mission A
Sponsored by the Lesbian, Gay, Bisexual, and Transgender
Issues TIG
Improving the Quality of Evaluations That Include Lesbian, Gay,
Bisexual and Transgender People (LGBT): Tools for the
Evaluator?
 Kathleen McKay, Connecticut Children's Medical Center;
Joe E Heimlich, Ohio State University; and John T Daws,
University of Arizona
629 - Program Fidelity and Development in Social
Work
Multipaper to be held in Mission B
Sponsored by the Social Work TIG
 Chair - Sarita Davis, Georgia State University
Evaluating the Renewal and Evolution of a Behavioral
Intervention Modality
 David Wright and Darryl Jinkerson, Abilene Christian
University
The Development and Standardization of a Parent Partner
Fidelity Tool for Use in Wraparound Program Evaluation
 Margaret Polinsky, Parents Anonymous Inc
630 - The Role of Collaboratives in Promoting
Community and Systems Changes
MultiPaper to be held in Bowie A
Sponsored by the Systems in Evaluation TIG
 Chair - Evelyn Yang, Community Anti-Drug Coalitions of
America
Evaluation 2010: Friday, November 12, 3:35 PM – 4:20 PM
Page 114
Evaluation of a Model to Build Effective Community Coalition
Change Agents for Substance Abuse Prevention
 Evelyn Yang, Community Anti-Drug Coalitions of America;
Pennie Foster-Fishman and Erin Watson, Michigan State
University; and Jane Callahan, Community Anti-Drug Coalitions
of America
Building an Effective Early Childhood System: Evaluating the
Role of Early Childhood Collaboratives and Parent Coalitions
 Pennie Foster-Fishman, Michigan State University; Joan M
Blough, Great Start Early Childhood Investment Corporation;
and Charles Collins, Jennifer Mortensen, Hope Gerde, and
Jennifer Watling Neal, Michigan State University
636 - Using New Technologies to Support Evaluation
Quality and Organizational Learning
631 - How Well Are We Addressing Asthma Disparities? Demonstration of a New Evaluation Toolkit
637 - Creating Statewide Guidelines for Twenty First
Century Community Learning Centers' Local
Evaluation
Demonstration to be held in Bowie B
Sponsored by the Multiethnic Issues in Evaluation TIG
 Robin Shrestha-Kuwahara and Maureen Wilce, Centers for
Disease Control and Prevention
632 - High Flexibility and Low Fidelity: The
Challenges of Evaluating Highly Adaptable Programs
Panel to be held in Travis B
Sponsored by the Integrating Technology Into Evaluation TIG
 Chair - Lynn McCoy, Pact Inc
 Discussant - John Talieri, Pact Inc
Challenges and Lessons in Conducting Quality Evaluation of
the Short Message Service (SMS) Technology
 Maeve B de Mello, Pact Inc
Integrating Technology to Maximize Evaluation Quality and
Organizational Learning
 Mary Ngugi, Pact Inc
Demonstration to be held in Travis C
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG
 Wendy Tackett, iEval; and Laurie VanEgeren, Michigan
State University
Panel to be held in Bowie C
Sponsored by the AEA Conference Committee
 Chair - Ann House, SRI International
 Discussant - Leslie Goodyear, National Science Foundation
Focusing on Quality: Designing Research for an Adaptable
Program
 Ann House, SRI International
Finding the Core: Evaluating a Distributed Program
 Sophia Mansori, Education Development Center
638 - Is Your Program Sustainable? A Practical Tool
for Evaluating Sustainability
633 – Roundtable in Goliad
Panel to be held in Independence
Sponsored by the Lesbian, Gay, Bisexual, and Transgender
Issues TIG
 Chair - Kari Greene, Oregon Public Health Division
Developing a Community Needs Assessment by Consensus:
Why is Our Evaluator Tearing Her Hair Out?
 Linda Drach, Oregon Public Health Division
Coalitions Built Through Data: How a Survey Engaged a
Community
 Kari Greene, Oregon Public Health Division
Sponsored by the Government Evaluation TIG
Celebrating Government Evaluation: Forging Links Among
Research, Policy Decisions, and Evaluation to Protect Our
Nation's Air Quality
 Dale Pahl, United States Environmental Protection Agency
634 – Roundtable in San Jacinto
Sponsored by the Evaluating the Arts and Culture TIG
The Evolution of Integrating Arts-based Inquiry in Evaluation
 April Munson, Kennesaw State University
635 - Compared to What? Reconsidering
Assessment in Higher Education
Expert Lecture to be held in Travis A
Sponsored by the Assessment in Higher Education TIG
 Gary Brown, Washington State University
Demonstration to be held in Travis D
Sponsored by the Health Evaluation TIG
 Nancy Mueller, Stephanie Herbers, and Sarah Schell,
Washington University in St Louis
639 - Nerd Activism: Using Data as the Vehicle for
Community Mobilization
640 - Digital Media and Learning for Youth: What Do
They Know, When Do They Know It, How Do We
Evaluate It?
Think Tank to be held in Presidio A
Sponsored by the Distance Education and Other Educational
Technologies TIG
 Kristin Bass, Rockman et al
 Discussant s - Elizabeth Bandy, Brianna Scott, and
Jennifer Borland, Rockman et al
Evaluation 2010: Friday, November 12, 3:35 PM – 4:20 PM
Page 115
Friday, 3:35 pm to 4:20 pm, continued
641 - Engaging Practitioners in the Medical Field to
Build Evaluation Capacity
Multipaper to be held in Presidio B
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG
 Chair - Cynthia Tananis, University of Pittsburgh
Evaluation Capacity Building Writ Large
 Marla Steinberg and Diane Finegood, The CAPTURE
Project
Context and Considerations of Evaluating a Health
Professional Capacity-Building Program in Vietnam
 Katherine Williams, Meiwita Budiharsana, Quoc Mai Tung,
and John Townsend, Population Council
642 - Building a Flexible, Web-based Analysis Tool to
Examine Person Level Changes Over Time in a Mental
Health Outcomes Measurement System
Demonstration to be held in Presidio C
Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG
 Tim Santoni and Qiang Qian, University of Maryland
643 – Roundtable in Bonham A
Sponsored by the Pre-K - 12 Educational Evaluation TIG
The Cost of Delayed Start: Effect of Early Algebra on End of
High School, Transition to College, and End-of-College
Science, Technology, Engineering, and Mathematics (STEM)
Participation
 Xiaoxia Newton, Rosario Rivero, and Anthony Kim,
University of California, Berkeley
 Chair - Michael Furlong, University of California, Santa
Barbara
Improving Individual Student Performance in Schools in United
States Schools Through Response to Intervention (RTI)
Framework
 Matthew Quirk, University of California, Santa Barbara
Evaluation as a Tool to Ensure Performance of 1,000,000
Students in India: Lessons Learned and Road Ahead
 Prashant Rajvaidya, Mosaic Network Inc
647 - Improving the Quality of Habitat and
Biodiversity Conservation Program Evaluations Using
Methodological and Budgetary Techniques
Multipaper to be held in Bonham E
Sponsored by the Environmental Program Evaluation TIG
 Chair - Gitanjali Shrestha, Washington State University
Improving Impact Evaluations of Biodiversity Conservations
Projects
 Clemencia Vela, Independent Consultant
A Mixed Methods Approach to Evaluating Multi-site Habitat
Protection Programs
 Mark Braza and Michael Krafve, United States
Government Accountability Office
649 - Assessing Faculty Productivity and Institutional
Research Performance: Using Publication and
Citation Key Performance Indicators
Demonstration to be held in Texas D
Sponsored by the Research, Technology, and Development
Evaluation TIG
 Ann Kushmerick, Thomson Reuters
645 - Meta-reviews in Rural Education and Reading
Interventions
650 - Moving Beyond the Weighty Tome: New
Approaches to Reporting Evaluation Findings
Multipaper to be held in Bonham C
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Meltem Alemdar, Georgia Institute of Technology
An Evaluation of the Quality of Rural Education Research:
2006 to Present
 Zoe Barley and Louis Cicchinelli, Mid-continent Research
for Education and Learning
Reviewing Systematic Reviews: Meta-analysis of What Works
Clearinghouse Computer-Assisted Reading Interventions
 Andrei Streke and Tsze Chan, American Institutes for
Research
651 - Introduction to Evaluation and Public Policy
646 - Applying Evaluation to Improve Learning
Outcomes: Scaling Up From Small Schools to a
Million Students
Demonstration to be held in Texas E
Sponsored by the Evaluation Use TIG and the Integrating
Technology Into Evaluation TIG
 Eric Graig, Usable Knowledge LLC
Expert Lecture to be held in Texas F
Sponsored by the Evaluation Policy and the Government
Evaluation TIGs
 Chair - Stephanie Shipman, United States Government
Accountability Office
 Presenter - George Grob, Center for Public Program
Evaluation
MultiPaper to be held in Bonham D
Sponsored by the Pre-K - 12 Educational Evaluation TIG
Evaluation 2010: Friday, November 12, 3:35 PM – 4:20 PM
Page 116
652 - Program Evaluation Network: Capacity and
Creativity for Multi-Site Program Evaluation
657 - Evaluation Capacity Building in International
Contexts
Demonstration to be held in Crockett A
Sponsored by the Extension Education Evaluation TIG
 Joseph Donaldson, University of Tennessee
Multipaper to be held in Republic A
Sponsored by the International & Cross-cultural Evaluation TIG
 Chair - Nicole Lewis, University of Kentucky
Capacity Building in Monitoring and Evaluation: A Real
Challenge for Afghan Ministry of Education, International
Donors, and Evaluation Community
 Mohammad Javad and Sharon Rallis, University of
Massachusetts, Amherst
Practical Roles for Evaluation Partners: Challenges to and
Opportunities for Evaluation Quality When Evaluation
Responsibilities are Shared With Clients
 Patty Hill, EnCompass LLC
653 - Small Business Sustainability: A Systems
Approach to Triple Bottom Line Success
Expert Lecture to be held in Crockett B
Sponsored by the Business and Industry TIG
 Mallary Tytel, Healthy Workplaces
654 - Understanding Indigenous Higher Education
Expenses: Innovative Evaluations From New Zealand
and Hawaii
Multipaper to be held in Crockett C
Sponsored by the Indigenous Peoples in Evaluation TIG
 Chair and Discussant - Katherine A Tibbetts, Kamehameha
Schools
E Tu Kahikatea, Stand Tall Kahikatea: Evaluation of One of the
World's Largest Indigenous-Led Tertiary Education Providers,
Te Wânanga o Aotearoa
 Andrea Knox, Counterbalance Research and Evaluation;
Shaun Akroyd, Akroyd Research and Evaluation; Fraser Sloane,
Sloane Walker Ltd; and Chantalle Ngapo, Te Wananga o
Aotearoa
Relevance, Relationship, and Reciprocity: Evaluating the Role
of Non-Academic Factors in Improving Native Hawaiian
Students‘ College Retention
 Anna Ah Sam, University of Hawaii, Manoa
655 - A Theory Driven Multi-year Strategic Evaluation
Plan for a Multi-program Government Agency
Expert Lecture to be held in Crockett D
Sponsored by the Government Evaluation TIG
 Chair - Gretchen Jordan, Sandia National Laboratories
 Presenters - John Reed, Innovologie LLC
656 - Advancing the Field of Evaluation
Multipaper to be held in Seguin B
Sponsored by the Graduate Student and New Evaluator TIG
 Chair - A Rae Clementz, University of Illinois at UrbanaChampaign
Metaphors, Models, and Analogies as the Tools for
Constructing Understandings in an Evaluation
 A Rae Clementz, University of Illinois at UrbanaChampaign
Moving From Outputs to Outcomes and Impact: Accountability
and Evaluation Quality
 Korinne Chiu and Kelly Graves, University of North Carolina
at Greensboro
658 - Health Care Delivery, Effectiveness, and
Reform: Where to Go From Here?
Multipaper to be held in Republic B
Sponsored by the Health Evaluation TIG
 Chair - Michael Harnar, Claremont Graduate University
Evaluating Health Insurance Outreach and Enrollment Efforts
Associated With Massachusetts Health Care Reform
 Linda Cabral, Christine Clements, Michael Tutty, Ellen
Bhang, and Kathy Muhr, University of Massachusetts
Changing Nature of Healthcare Performance Measurement
 David Mohr, Katerine Osatuke, and Thomas Brassell,
United States Department of Veterans Affairs
659 - Risk and Tension in Private Sector
Development Project Evaluation
Multipaper to be held in Republic C
Sponsored by the Business and Industry TIG
 Chair - Zita Unger, Evaluation Solutions Pty Ltd
The Whole is Greater Than the Sum of Parts: Program
Evaluation of the Chad Cameroon Petroleum
Development and Pipeline Program
 Cherian Samuel, International Finance Corporation
Adjusting Development Outcomes by Riskiness of Private
Sector Investment Projects: Risk-Adjusted
Expected Development Outcome
 Hiroyuki Hatashima, International Finance Corporation
Evaluation 2010: Friday, November 12, 3:35 PM – 4:20 PM
Page 117
Summary of Sessions for Friday, November 12, 4:30 PM to 6:00 PM
No Primary Sponsor
Session
Session Title
Room
662 Presidential Strand
Panel
Evaluation Anthropology Praxis Today: Building the Future
Lone Star A
663 Systems in Evaluation TIG
Panel
Systems Perspectives on Using Logic Models to Improve Evaluation Quality
Lone Star B
664 Collaborative, Participatory & Empowerment
Demonstration
The Evaluative Journey: Implementing Evaluation Activities That Faciliate Ongoing Decision Making
Lone Star C
665 Non-profit and Foundations Evaluation TIG
Panel
Multiple Sites, Multiple Layers, Multiple Players: Lessons From the Field on Keeping Quality High and Frustration Low
Lone Star D
666 Quantitative Methods: Theory and Design TIG
Panel
The Case for Brief(er) Measures
Lone Star E
667 Cluster, Multi-site & Multi-level Evaluation TIG Skill-building
Evaluation 201: Evaluation Skills Needed After Coursework
Lone Star F
668 Mixed Methods Evaluation TIG
Roundtable
Rotation I: Examining Collaboration in an Evaluation of a Large Scale Civic Education Program
Rotation II: Using Mixed Methods to Evaluate a School Based Civic Engagement Initiative
Mission A
669 Disabilities and Other Vulnerable Populations
MultiPaper
Evaluating Community Capacity Building as a Prevention Strategy
Mission B
670 Independent Consulting TIG
MultiPaper
Evaluation Opportunities Within a National Science Foundation (NSF) Program
Bowie A
671 Multiethnic Issues in Evaluation TIG
MultiPaper
Practicing Culturally Responsive Evaluation: Graduate Education Diveristy Intership (GEDI) Program Intern Reflections…
Bowie B
672 Crime and Justice TIG
Multipaper
Evaluations of Court and Corrections Programs
Bowie C
673 Graduate Student and New Evaluator TIG
Roundtable
Rotation I: My First Year as an Internal Evaluator: What I Didn't Know That I Didn't Know
Rotation II: Evaluator/Practitioner Collaborations
Goliad
674 Assessment in Higher Education TIG
Roundtable
Rotation I: Accreditation as a Pathway to Build Community and Generate Renewal
Rotation II: Using Evaluation to Help Transform Departments in the Challenging Economic Environment of Higher Education
San Jacinto
675 Social Network Analysis TIG
Demonstration
How to Cast Your Net: Network Analysis Techniques in Public Health Evaluation
Travis A
676 Costs, Effectiveness, Benefits, and Economics Multipaper
Methodological Considerations: Choosing an Appropriate Cost Analysis Methodology for the Evaluation
Travis B
677 Evaluation Use TIG
Panel
From Compliance to Reliance: Critical Moments in Integrating Evaluation Into an Organization‘s Work
Travis C
678 Health Evaluation TIG
Multipaper
Working Together and Getting the Message Heard in Teen Pregnancy Prevention Programs
Travis D
679 Human Services Evaluation TIG
Think Tank
Beyond Fidelity: Evaluating the Implementation of Evidence-based Practices
Independence
680 Quantitative Methods: Theory and Design TIG
Demonstration
Basic Change: Examining a Simple Design From Multiple Approaches
Presidio A
681 Org Learning & Evaluation Capacity Bldg TIG
Demonstration
Using the Comprehensive Organizational Assessment Tool to Diagnose and Evaluate Organizational Capacity
Presidio B
682 Alcohol, Drug Abuse, and Mental Health TIG
Panel
National Evaluation of the Addiction Technology Transfer Center Network (ATTC): Findings and Observations…
Presidio C
683 Pre-K - 12 Educational Evaluation TIG
Roundtable
Rotation I: Evaluating K-12 Professional Development: Implementation of the Sheltered Instruction Observation…
Rotation II: School Climate: A Comprehensive Data Collection and School Improvement System
Bonham A
684 Non-profit and Foundations Evaluation TIG
Multipaper
Making Sense of the Relationships Between Nonprofits, Funders, and Evaluation
Bonham B
685 Pre-K - 12 Educational Evaluation TIG
Multipaper
Current Issues in Evaluating High School Programs
Bonham C
Evaluation 2010: Friday, November 12, 4:30 PM – 6:00 PM
Page 118
Summary of Sessions for Friday, November 12, 4:30 PM to 6:00 PM, Continued
No Primary Sponsor
Session
Session Title
Room
686 Pre-K - 12 Educational Evaluation TIG
MultiPaper
Improving Evaluation Quality: A Focus on Better Measures of Implementation
Bonham D
687 Environmental Program Evaluation TIG
Panel
The Environmental Evaluators Network: Quality in an Era of Results-based Performance
Bonham E
689 Research, Technology, and Development
Think Tank
Your Input, Please: Research, Technology and Development (RTD) Topical Interest Group (TIG) Draft User‘s Guide…
Texas D
690 Evaluation Use TIG
Panel
Strategy as Evaluand: Quality and Utilization Issues in Evaluating Strategy
Texas E
691 Research on Evaluation TIG
Multipaper
Research on Data Collection Approaches
Texas F
692 Extension Education Evaluation TIG
MultiPaper
Building Capacity for the 4-H Science, Engineering, and Technology Initiative to Get to Outcomes
Crockett A
693 Teaching of Evaluation TIG
Multipaper
Teaching Through an Interdisciplinary Focus
Crockett B
694 International and Cross-cultural Evaluation TIG Skill-building
Data Collection Instruments for Quality Evaluation
Crockett C
695 Government Evaluation TIG
Multipaper
Collaboration in Government-Sponsored Evaluations
Crockett D
696 Feminist Issues in Evaluation TIG
Multipaper
Theorectical Issues in Feminist Evaluation
Seguin B
697 International and Cross-cultural Evaluation TIG Multipaper
Export and Translation: Evaluating the Sharing of People, Programs, and Instruments Across Borders
Republic A
698 Health Evaluation TIG
Multipaper
Improving Evaluations of Nutrition, Physical Activity, & Obesity Programs Through Schools, Providers, and Statewide Efforts
Republic B
699 Collaborative, Participatory & Empowerment
Panel
Technical Assistance in Action: How Does the Practice Look?
Republic C
Evaluation 2010: Friday, November 12, 4:30 PM – 6:00 PM
Page 119
Friday, 4:30 pm to 6:00 pm
662 - Evaluation Anthropology Praxis Today:
Building the Future
Panel to be held in Lone Star A
Sponsored by the Presidential Strand
 Chair - Jacqueline Copeland-Carson,
Copeland Carson & Associates
 Discussants - David Fetterman, Fetterman & Associates;
and Rodney Hopson, Duquesne University
Ethnography and Mental Health Consumers
 Charity Goodman, United States Department of Health
and Human Services
What Evaluation Anthropologists Bring to the Party: A
Systems Approach to Context
 Michael D Lieber and Eve Pinsker, University of Illinois at
Chicago
Making Evaluation Real: Incorporating Praxis Into Graduate
Study of Evaluation Anthropology
 Mary Odell Butler, University of Maryland
663 - Systems Perspectives on Using Logic Models
to Improve Evaluation Quality
Panel to be held in Lone Star B
Sponsored by the Systems in Evaluation TIG and the Program
Theory and Theory-driven Evaluation TIG
 Chair - Patricia Rogers, Royal Melbourne Institute of
Technology
A Systems Perspective on Evaluation Quality and Logic
Models
 Bob Williams, Independent Consultant
Representing Simple, Complicated and Complex Aspects in
Logic Models for Evaluation Quality
 Patricia Rogers, Royal Melbourne Institute of Technology
Changing Institutional Approaches to Using Logic Models
 Richard Hummelbrunner, OEAR Regional Development
Consultants
664 - The Evaluative Journey: Implementing
Evaluation Activities That Faciliate Ongoing
Decision Making
Demonstration to be held in Lone Star C
Sponsored by the Collaborative, Participatory &
Empowerment Evaluation TIG
 Paul St Roseman, DataUse Consulting Group
665 - Multiple Sites, Multiple Layers, Multiple
Players: Lessons From the Field on Keeping Quality
High and Frustration Low
Panel to be held in Lone Star D
Sponsored by the Non-profit and Foundations Evaluation TIG
 Chair - Jacqueline WIlliams Kaye, Atlantic Philanthropies
Leveraging the Opportunity in Having Multiple Evaluation
Teams
 Jacqueline Williams Kaye, Atlantic Philanthropies;
Steven LaFrance, Learning for Action Group; Stephen Baker,
Chapin Hall; and Malu Gonzalez, University of Texas, El Paso
Aligning Interests, Needs and Methods: Managing Cross-site
Evaluation
 Meridith Polin, Public/Private Ventures
Evaluator Capacity and Evaluation Quality in a Multi-site
National Initiative
 Scott Hebert, Sustained Impact; and Thomas Kelly,
Annie E Casey Foundation
666 - The Case for Brief(er) Measures
Panel to be held in Lone Star E
Sponsored by the Quantitative Methods: Theory and Design
TIG
 Chair - Lee Sechrest, University of Arizona
Single Item Measures
 Lee Sechrest, University of Arizona
Very Brief Scales: Carved Out Scales
 Patrick McKnight, George Mason University
Abbreviated Omnibus Measures
 Mei-kuang Chen, University of Arizona
667 - Evaluation 201: Evaluation Skills Needed
After Coursework
Skill-building Workshop to be held in Lone Star F
Sponsored by the Cluster, Multi-site & Multi-level Evaluation
TIG
 Martha Ann Carey, Maverick Solutions; and Molly Engle,
Oregon State University
668 – Roundtables in Mission A
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Mixed Methods Evaluation TIG and the
Collaborative, Participatory & Empowerment Evaluation TIG
Rotation 1: Examining Collaboration in an Evaluation of a
Large Scale Civic Education Program
 Liliana Rodriguez-Campos, Connie Walker-Egea, and
Michael Berson, University of South Florida
Rotation 2: Using Mixed Methods to Evaluate a School Based
Civic Engagement Initiative
 Michael Berson, Liliana Rodriguez-Campos, and Aarti P
Bellara, University of South Florida
669 - Evaluating Community Capacity Building as a
Prevention Strategy
MultiPaper to be held in Mission B
Sponsored by the Disabilities and Other Vulnerable
Populations TIG
 Chair - Laura Leviton, Robert Wood Johnson Foundation
Evaluation 2010: Friday, November 12, 4:30 PM – 6:00 PM
Page 120
Community Capacity and Evaluation
 Carter Roeber and Niel Tashima, LTG Associates Inc
Building Community Capacity in Immigrant Faith-based
Communities: How Can We Tell?
 Mimi Kim, Korean Community Center of East Bay
Intimate Partner Violence Prevention at the Community Level:
Turning Practice Into Evidence
 Alberto Bouroncle and Cathleen Crain, LTG Associates
Inc
670 - Evaluation Opportunities Within a National
Science Foundation (NSF) Program
MultiPaper to be held in Bowie A
Sponsored by the Independent Consulting TIG
 Chair - Arlen Gullickson, Western Michigan University
 Discussant - Peter Saflund, The Saflund Institute
Wanted: Evaluators!
 Lori Wingate, Western Michigan University
Ten-year Trends in Evaluation Practice in an NSF Program
 Stephanie Evergreen and Carl Westine, Western
Michigan University
Evaluating in the Community College Context
 Peggie Weeks, Western Michigan University; and Peter
Saflund, The Saflund Institute
Evaluation Challenges and Innovations in NSF-Funded
Advanced Technological Education Centers
 Amy Gullickson, Western Michigan University
671 - Practicing Culturally Responsive Evaluation:
Graduate Education Diveristy Intership (GEDI)
Program Intern Reflections on the Role of
Competence, Context, and Cultural Perceptions
MultiPaper to be held in Bowie B
Sponsored by the Multiethnic Issues in Evaluation TIG
 Chair - Rita O'Sullivan, University of North Carolina at
Chapel-Hill
 Discussant - Michelle Jay, University of South Carolina
Being Culturally Responsive in the Digital World
 Larry Daffin, New York University
Strategies for Developing a Culturally Responsive Logic
Model
 Lisa Aponte-Soto, University of Illinois at Chicago
Considering Culture in the Development, Implementation,
and Interpretation of Focus Groups With Homeless Families
 Jessica Johnson, Virginia Commonwealth University
Examining the Sustainability of Campus Suicide Prevention
Programs Through a Cultural Lens
 Karen Anderson, Clark Atlanta University
An Intern‘s Perspective: Fostering Culturally Responsive
Evaluators of Color Through The Academic Pipeline
 Soria E Colomer, University of Georgia
672 - Evaluations of Court and Corrections
Programs
Multipaper to be held in Bowie C
Sponsored by the Crime and Justice TIG
 Chair - Roger Przybylski, RKC Group
An Innovative and Efficient Propensity Score Methodology for
Evaluating OVI Courts
 Robert Seufert and Kaitlin Kubilius, Miami University
Evaluation of Family Strengthening Services to Incarcerated
Fathers and Their Partners
 Christine Lindquist, Anupa Bir, Tasseli McKay, and Hope
Smiley-McDonald, RTI International
Implementation Evaluation of a Reading Intervention
Program for Incarcerated Youth
 Deborah Kwon, Raeal Moore, and William Loadman, The
Ohio State University
Using Logistic Regression to Predict Incarcerated Youth‘s
Reading Proficiency
 Jing Zhao, William Loadman, Raeal Moore, Weijia Ren,
Deborah Kwon, and Charles Okonkwo, The Ohio State
University
673 – Roundtables in Goliad
Roundtable to be held in Goliad
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Graduate Student and New Evaluator and
the Collaborative, Participatory & Empowerment Evaluation
TIGs
Rotation 1: My First Year as an Internal Evaluator: What I
Didn't Know That I Didn't Know
 Pamela Bishop, University of Tennessee, Knoxville
Rotation 2: Evaluator/Practitioner Collaborations
 Angela Moore and Winnie Reed, National Institute of
Justice; Carolyn Block, Illinois Criminal Justice Information
Authority; and Deshonna Collier-Goubil, National Institute of
Justice
674 – Roundtables in San Jacinto
Roundtable to be held in San Jacinto
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Assessment in Higher Education TIG
Rotation 1: Accreditation as a Pathway to Build Community
and Generate Renewal
 Lorna Escoffery, Escoffery Consulting Collaborative Inc
Rotation 2: Using Evaluation to Help Transform Departments
in the Challenging Economic Environment of Higher
Education
 Sabra Lee, Lesley University; and Ellen Iverson, Carleton
College
Evaluation 2010: Friday, November 12, 4:30 PM – 6:00 PM
Page 121
Friday, 4:30 pm to 6:00 pm, continued
675 - How to Cast Your Net: Network Analysis
Techniques in Public Health Evaluation
Demonstration to be held in Travis A
Sponsored by the Social Network Analysis TIG
 Lana Wald, Bobbi Carothers, and Douglas Luke,
Washington University in St Louis; and Jenine Harris, Saint
Louis University
676 - Methodological Considerations: Choosing an
Appropriate Cost Analysis Methodology for the
Evaluation
Multipaper to be held in Travis B
Sponsored by the Costs, Effectiveness, Benefits, and
Economics TIG
 Chair - Nadini Persaud, University of the West Indies
Sacrifices Must Be Made: Methodological Choices on a
Shoestring Cost-Benefit Analysis Budget
 Jeffrey Prottas and Melanie Gaiser, Brandeis University
Getting to Impact for a Know Thyself Leader Development
Program
 Stacey Farber, Scott Steel, Daniel McLinden, Britteny
Howell, and Janet Matulis, Cincinnati Children's Hospital
Medical Center
Economic Analyses in Program Evaluation: First
Approximations When Economists are Late on the Scene
 Mustafa Karakus, Westat
677 - From Compliance to Reliance: Critical
Moments in Integrating Evaluation Into an
Organization‘s Work
Panel to be held in Travis C
Sponsored by the Evaluation Use TIG and the Organizational
Learning and Evaluation Capacity Building TIG
 Chair - Jennifer Iriti, University of Pittsburgh
Evaluator Perspective
 Jennifer Iriti, University of Pittsburgh; and Catherine A
Nelson, Independent Consultant
Organization Leader Perspective
 Mary Hicks, Boundless Readers
Program Implementer Perspective
 Nancy Plaskett, Chicago Children's Museum
Program Funder Perspective
 Regina Dixon-Reeves, Lloyd A Fry Foundation
678 - Working Together and Getting the Message
Heard in Teen Pregnancy Prevention Programs
Multipaper to be held in Travis D
Sponsored by the Health Evaluation TIG
 Chair - Robert LaChausse, California State University,
San Bernardino
Reactance to Sexual Abstinence Education: A Method of
Assessment
 Ann Peisher, Amy Laura Arnold, Marcus Coleman, and
Virginia Dick, University of Georgia; Robetta McKenzie, Augusta
Partnership for Children Inc; Don Bower, University of Georgia;
and Katrina Aaron, Augusta Partnership for Children Inc
Effectiveness and Utilization of a Parent Education
Curriculum: A Two-Level Evaluation of Educators and Parents
 Sheetal Malhotra, Medical Institute for Sexual Health;
Diane Santa Maria, University of Texas; Melissa Steiner,
Medical Institute for Sexual Health
Evaluating Healthy Girls: Working With Community
Organizations to Design a City-wide Teen Pregnancy
Prevention Evaluation
 Jessica Rice and Melissa Lemke, University of
Wisconsin; and Nicole Angresano and Julie Rothwell, United
Way of Greater Milwaukee
Labor Pains: The Challenges of Developing an Evaluation
Instrument for a City-wide Teen Pregnancy Prevention
Evaluation
 Jessica Rice and Melissa Lemke, University of
Wisconsin; and Nicole Angresano and Julie Rothwell, United
Way of Greater Milwaukee
679 - Beyond Fidelity: Evaluating the
Implementation of Evidence-based Practices
Think Tank to be held in Independence
Sponsored by the Human Services Evaluation TIG
 Miles McNall, Michigan State University
680 - Basic Change: Examining a Simple Design
From Multiple Approaches
Demonstration to be held in Presidio A
Sponsored by the Quantitative Methods: Theory and Design
TIG
 Julius Najab, George Mason University; Caroline Wiley,
University of Arizona; Simone Erchov, George Mason
University
681 - Using the Comprehensive Organizational
Assessment Tool to Diagnose and Evaluate
Organizational Capacity
Demonstration to be held in Presidio B
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG
 Ashley Kasprzak and Randi Nelson, JVA Consulting LLC
Evaluation 2010: Friday, November 12, 4:30 PM – 6:00 PM
Page 122
682 - National Evaluation of the Addiction
Technology Transfer Center Network (ATTC):
Findings and Observations From a Contextually
Rich, Mixed Method Evaluation Study
Panel to be held in Presidio C
Sponsored by the Alcohol, Drug Abuse, and Mental Health
TIG
 Chair - Roy Gabriel, RMC Research Corporation
Substance Abuse and Mental Health Services Administration
(SAMHSA), Center for Substance Abuse Treatment (CSAT)
Overview of the ATTC Network and the Importance of
Evaluation
 Deepa Avula, United States Department of Health and
Human Services
Planning and Partnering Study: Overview and Key Findings
 Margaret Gwaltney and Cori Sheedy, Abt Associates Inc
Customer Satisfaction and Benefit Study: Overview and Key
Findings
 Andrea Muse, Megan Cummings, Cliff Chamberlin, and
Richard Finkbiner, MANILA Consulting Group Inc
Change in Practice Study: Overview and Key Findings
 Jeffrey Knudsen, RMC Research Corporation
Key Findings, Decisions and Challenges Accompanying the
National ATTC Evaluation
 Roy Gabriel, RMC Research Corporation
683 – Roundtables in Bonham A
Sponsored by the Pre-K - 12 Educational Evaluation TIG
Rotation 1: Evaluating K-12 Professional Development:
Implementation of the Sheltered Instruction Observation
Protocol (SIOP) Model
 Michelle Bakerson, Indiana University South Bend
Rotation 2: School Climate: A Comprehensive Data
Collection and School Improvement System
 Barbara Dietsch, Sandy Sobolew-Shubin, Rebeca Cerna,
and Greg Austin, WestEd
684 - Making Sense of the Relationships Between
Nonprofits, Funders, and Evaluation
Multipaper to be held in Bonham B
Sponsored by the Non-profit and Foundations Evaluation TIG
 Chair - Salvatore Alaimo, Grand Valley State University
The Relationship Between Evaluation Quality and Use: A
Foundation‘s Perspective
 Rosanna Tran, California HealthCare Foundation
Theory Usage in Nonprofit and Foundation Evaluation:
Theorists, Funders and Recipient Perspectives
 Anne Hewitt, Seton Hall University; and Charles Gasper,
Missouri Foundation for Health
The Role of the Funder in Evaluation Capacity Building for
Nonprofit Human Services Organizations
 Salvatore Alaimo, Grand Valley State University
Fostering and Measuring Nonprofit Networks to Inform
Grantmaking Decisions
 Patricia Zerounian, Monterey County Health Department;
Janet Shing and Jeff Bryant, Community Foundation for
Monterey County; and Krista Hanni, Monterey County Health
Department
685 - Current Issues in Evaluating High School
Programs
Multipaper to be held in Bonham C
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Manolya Tanyu, Learning Point Associates
 Discussant - Eric Barela, Partners in School Innovation
Increasing the Volume of Student Voice: Perceptions of
Personalization in High Poverty/Minority Schools
 Sabrina F Sembiante, Ann G Bessell, and Cathleen
Armstead, University of Miami
The Evaluation of a Model for Alternative Education
 Jessaca Spybrook, Margaret Richardson, and James
Henry, Western Michigan University
Cognitive Labs to Evaluate Test Items for Use on an Alternate
Assessments Based on Modified Academic Achievement
Standards (AA-MAS)
 Tammiee Dickenson, Karen Price, Heather Bennett, and
Joanna Gilmore, University of South Carolina
Assessing the Effectiveness of a School Connectedness
Scale for Evaluation
 Jill Lohmeier, University of Massachusetts, Lowell; and
Steven Lee, University of Kansas
686 - Improving Evaluation Quality: A Focus on
Better Measures of Implementation
MultiPaper to be held in Bonham D
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Helene Jennings, ICF Macro
Measuring the Quality of Implementation of Online Learning
Games in Instruction
 Shani Reid, ICF Macro
Studying Implementation Fidelity Using Qualitative Methods
in a Study of READ 180
 Emily Rosenthal, Berkeley Policy Associates; Savitha
Moorthy, SRI International; and Hannah Betesh, Berkeley
Policy Associates
Assessing the Quality of Collaboration Among Community
Partners
 Allan Porowski and Dan Cantillon, ICF International
Evaluation 2010: Friday, November 12, 4:30 PM – 6:00 PM
Page 123
Friday, 4:30 pm to 6:00 pm, continued
687 - The Environmental Evaluators Network:
Quality in an Era of Results-based Performance
Panel to be held in Bonham E
Sponsored by the Environmental Program Evaluation TIG
 Chair - Matt Keene, United States Environmental
Protection Agency
 Discussant - Kathryn Newcomer, George Washington
University
The Environmental Evaluators Network and Improving the
Quality of Evaluation at the United States Environmental
Protection Agency (EPA)
 Matt Keene and Katherine Dawes, United States
Environmental Protection Agency
Lessons Learned From the First Five Years of the
Environmental Evaluators Network
 Matt Birnbaum, National Fish and Wildlife Foundation
In Search of Quality and a Commitment to Evaluation: The
Environmental Evaluators Network and the National Oceanic
and Atmospheric Administration (NOAA)
 Kate Barba, Cassandra Barnes, and Ginger Hinchcliff,
National Oceanic and Atmospheric Administration
689 - Your Input, Please: Research, Technology and
Development (RTD) Topical Interest Group (TIG)
Draft User‘s Guide to Conducting Research and
Development Evaluation
Think Tank to be held in Texas D
Sponsored by the Research, Technology, and Development
Evaluation TIG
 Presenter - Gretchen Jordan, Sandia National
Laboratories
 Discussant - Brian Zuckerman, Science and Technology
Policy Institute; Cheryl Oros, Oros Consulting LLC; Juan
Rogers, School of Public Policy Georgia Institute of
Technology; and George Teather, George Teather and
Associates
690 - Strategy as Evaluand: Quality and Utilization
Issues in Evaluating Strategy
Panel to be held in Texas E
Sponsored by the Evaluation Use, and the Organizational
Learning and Evaluation Capacity Building, and the Nonprofit and Foundations Evaluation TIGs
 Chair - Michael Quinn Patton, Utilization-Focused
Evaluation
Evaluating Strategy: Issues in Treating Strategy as the
Evaluand
 Michael Quinn Patton, Utilization-Focused Evaluation
Strategy Evaluation Case Example: A Retrospective Strategy
Evaluation of a 20-year Philanthropic Grant Program
 Patricia Patrizi, Patrizi & Associates
Experience From the International Development Research
Centre in Doing and Using Strategic Evaluation
 Tricia Wind, International Development Research Centre
An Experiment in Evaluating Strategy: The WK Kellogg
Foundation‘s Devolution Initiative
 Kay Sherwood, Independent Consultant
691 - Research on Data Collection Approaches
Multipaper to be held in Texas F
Sponsored by the Research on Evaluation TIG
 Chair - Leslie Fierro, SciMetrika
On the Other Side of Recruitment: Participant Perceptions of
Risk During Disclosure for Biomedical Research
 Jonathan Rubright, Pamela Sankar, and Jason
Karlawish, University of Pennsylvania
Inclusion of People with Disabilities in Evaluation Practice
 Miriam Jacobson, Claremont Graduate University
Using Norm-based Appeals to Increase Response-Rate in
Evaluation Research: A Field Experiment
 Anne Heberger, National Academy of Sciences; and
Shalini Misra and Daniel Stokols, University of California,
Irvine
692 - Building Capacity for the 4-H Science,
Engineering, and Technology Initiative to Get to
Outcomes
MultiPaper to be held in Crockett A
Sponsored by the Extension Education Evaluation TIG
 Chair - Suzanne Le Menestrel, United States Department
of Agriculture
 Discussant - Martin Smith, University of California, Davis
The Power of Process Evaluation in Science, Engineering, and
Technology Programs
 Melissa Cater, Louisiana State University
What Have We Learned? Results From the Process Evaluation
of the 4-H Science, Engineering, and Technology Initiative
 Suzanne Le Menestrel, United States Department of
Agriculture; Jill Walahoski, University of Nebraska, Lincoln;
and Monica Mielke, Policy Studies Associates
Measuring Science Processing Skills in Middle School Youth:
The Science Process Skill Inventory (SPSI)
 Mary Arnold, Oregon State University
Evaluation 2010: Friday, November 12, 4:30 PM – 6:00 PM
Page 124
693 - Teaching Through an Interdisciplinary Focus
696 - Theorectical Issues in Feminist Evaluation
Multipaper to be held in Crockett B
Sponsored by the Teaching of Evaluation TIG
 Chair - Linda Schrader, Florida State University
 Discussant - Jean A King, University of Minnesota
Study of the Process and Effects of the Evaluation Fellows
Program
 Jean A King, Robert Tornberg, and Jeanne Zimmer,
University of Minnesota
Evaluation Training: Characteristics and Context in
Educational Administration Programs
 Tara Shepperson, Eastern Kentucky University
Finding Solutions: How Small Non-governmental
Organization's (NGOs) Can Partner With Universities
to Overcome Evaluation Challenges
 Tim Heaton, Kendal Blust, and Matt Cox, Brigham Young
University
Multipaper to be held in Seguin B
Sponsored by the Feminist Issues in Evaluation TIG
 Chair - Kathryn A Bowen, Centerstone Research Institute
 Discussant - Michael Bamberger, Independent
Consultant
The Role of Black Feminist Theory in Feminist Evaluation
 Sarita Davis, Georgia State University
Standpoint Theory(ies): A Pathway to Incorporating Social
Justice Into the Evaluation Process
 Denice Cassaro, Cornell University; and Divya Bheda,
University of Oregon
The Believer‘s Calling from a Gender Perspective: Evaluating
Presbyterian Church (United States of America) Participation
in the United Nations Commission on the Status of Women
Fifty-Fourth Annual Conference
 Cathryn Surgenor, New York Theological Seminary
694 - Data Collection Instruments for Quality
Evaluation
697 - Export and Translation: Evaluating the
Sharing of People, Programs, and Instruments
Across Borders
Skill-building Workshop to be held in Crockett C
Sponsored by the International & Cross-cultural Evaluation TIG
 Chung Lai and Mamadou Sidibe, International Relief &
Development
695 - Collaboration in Government-Sponsored
Evaluations
Multipaper to be held in Crockett D
Sponsored by the Government Evaluation TIG and the
Collaborative, Participatory & Empowerment Evaluation TIG
 Chair - Maria Whitsett, Moak, Casey and Associates
Some Evidence on Challenges in Government/Stakeholder
Partnerships: A Case Study of the Voluntary Sector Initiative
(VSI) and Networks
 Caroline DeWitt, Human Resources and Skills
Development
Assessing More Than Mortar and Bricks: Combining
Research, Theory, Politics, and Chaos in a HOPE VI
Community Revitalization Program Evaluation
 Andrew Scott Ziner, Atlantic Social Research
Corporation; and Ross Koppel, University of Pennsylvania
An Assessment of the Impact of Proactive Community
Partnerships on Census Quality
 Edward Kissam, JBS International Inc; Jesus MartínezSaldaña, Independent Consultant; Anna Garcia, Independent
Consultant; and JoAnn Intili, JBS International Inc
The Effects of Qualitative Feedback on Mid-Managers‘
Improvement on Performance Behaviors in the
Veterans Health Administration
 Thomas Brassell, Boris Yanovsky, Katerine Osatuke, and
Sue R Dyrenforth, United States Department of Veterans
Affairs
Multipaper to be held in Republic A
Sponsored by the International & Cross-cultural Evaluation TIG
 Chair - Mary Crave, University of Wisconsin
Evaluating the Effectiveness of Short Term Humanitarian
Trips to Another Country
 Christi Delgatty, Texas State University
Complexities of the Transition Framework: A Case Study of a
Civic Education Export
 Natalia Glebova, University of Massachusetts, Amherst
The Effect of Translation on Evaluation Instruments: Multiple
Group Confirmatory Factor Analysis (MGCFA) and Multiple
Indicators, Multiple Causes (MIMIC) Models Outcomes
 Fatma Ayyad and Brooks Applegate, Western Michigan
University
Did you know? AEA has 45 Topical Interest Groups
(TIGs) that span the breadth and depth of the field.
Each convenes a review team to review session
proposals and then sponsors a strand of sessions
within the conference program.
Evaluation 2010: Friday, November 12, 4:30 PM – 6:00 PM
Page 125
Friday, 4:30 pm to 6:00 pm, continued
698 - Improving Evaluations of Nutrition, Physical
Activity, and Obesity Programs Through Schools,
Providers, and Statewide Efforts
Multipaper to be held in Republic B
Sponsored by the Health Evaluation TIG
 Chair - Jenica Huddleston, University of California,
Berkeley
Early Indicators of Success With the Use of the Electronic
Medical Record (EMR) for Implementation of Expert Committee Recommendations on Childhood Overweight in
Delaware
 Gregory Benjamin, Vonna Drayton, Denise Hughes, and
Jia Zhao, Nemours Health and Prevention Services
A National Strategy to Enhance Quality State Evaluations:
The Case of the Division of Nutrition, Physical Activity and
Obesity
 Donald Compton, Centers for Disease Control and
Prevention; Michael Baizerman, University of Minnesota; and
Rosanne Farris, Centers for Disease Control and Prevention
2009 Delaware Child Care Provider Survey: Exploring the
Relationship Between Awareness, Policies, and Practices
and Behaviors
 Tiho Enev, and Alex Camacho, Nemours Health and
Prevention Services
Mixed Method Evaluation of a Multi-district Physical
Education Curriculum Intervention
 Randy Knuth, Knuth Research Inc; and Bob Lutz,
Gonzaga University
Measuring Technical Assistance Influence Using Project
Activity Networks
 Peter Kreiner, Brandeis University
Effectiveness of the Getting to Outcomes (GTO) Technical
Assistance Model to Reduce Underage Drinking
 Pamela Imm and Annie Wright, University of South
Carolina; and Matthew Chinman, RAND Corporation
Friday, 6:30 pm to 8:00 pm
Evening Reception and Silent Auction
Special event to be held in the Texas Ballroom
Admission to the Reception and Silent Auction
is included in the conference registration. All
attendees are encouraged to attend, to bid on
the many donated items from around the world,
and to build your professional network in this
social setting. Proceeds from the silent auction go to fund
travel awards for evaluators from developing countries.
699 - Technical Assistance in Action: How Does the
Practice Look?
Panel to be held in Republic C
Sponsored by the Collaborative, Participatory &
Empowerment Evaluation TIG
 Chair - Pamela Imm, University of South Carolina
Literature Review on Proactive Technical Assistance Systems
in Community Settings
 Jason Katz and Abraham Wandersman, University of
South Carolina
Notes From the Field: Lessons Learned From Using a
Participatory Approach to Evaluation
 Jessica Waggett, Emily Chiasson, Elisa Friedman, and
Karen Hacker, Institute for Community Health
Helping Practitioners Use Data for Planning and Evaluation
 Jane Powers, Cornell University
Training and Technical Assistance to Build Capacity of
Mental Health in Laos
 Paul Florin, University of Rhode Island
Evaluation 2010: Friday, November 12, 4:30 PM – 6:00 PM, 6:30 PM – 8:00 PM
Page 126
Saturday, November 13, 2010: Overview of Schedule
7:00 am to 5:00 pm
Registration Desk Open
8:00 am to 9:30 am
Concurrent Conference Sessions
10:00 am to 10:45 am
Concurrent Conference Sessions
10:55 am to 12:25 pm
Concurrent Conference Sessions
12:35 pm to 1:30 pm
Lunch Break and TIG Meeting
1:40 pm to 2:25 pm
Concurrent Conference Sessions
2:50 pm to 4:20 pm
Concurrent Conference Sessions
4:30 pm to 5:30 pm
Closing Plenary
My Schedule and Notes:
Evaluation 2010: Saturday, November 13, Overview
Page 127
Summary of Sessions for Saturday, November 13, 8:00 AM to 9:30 AM
No Primary Sponsor
Session
Session Title
Room
702 Presidential Strand
Panel
Design Thinking: The Art of Evaluation
Lone Star A
703 Program Theory and Theory-driven Evaluation
Panel
Theory of Change Online: Implications for Participatory Planning and Evaluation Using Technology
Lone Star B
704 Collaborative, Participatory & Empowerment
MultiPaper
Training in Evaluation: Formal and Informal Capacity Building
Lone Star C
705 Non-profit and Foundations Evaluation TIG
Demonstration
Foundation Effectiveness: Aligning Impact Strategy and Evaluation
Lone Star D
706 Quantitative Methods: Theory and Design TIG
Demonstration
Applications of Multiple Regression for Evaluators
Lone Star E
707 Cluster, Multi-site & Multi-level Evaluation TIG Panel
The Process of Evaluating Supporting Partnerships to Assure Ready Kids (SPARK) and Ready Kids Follow-Up (RKF)…
Lone Star F
708 Human Services Evaluation TIG
Roundtable
Rotation I: Measuring Success: Applying Short-Term Indicators to Measure Long-Term Success in Human Capital…
Rotation II: How to Maintain Evaluation Quality in a Changing Environment: The Importance of Mixed Methods
Mission A
709 Evaluation Policy TIG
Panel
From Deliverables to Strategies: Experience of Implementing a National Evaluation Policy via Statewide Asthma Programs
Mission B
710 Systems in Evaluation TIG
MultiPaper
Framework for Orchestrating Systems Transformation: Theory and Practice for Promoting Dynamic Systems Change
Bowie A
711 Advocacy and Policy Change TIG
Multipaper
Where Theory Meets Practice in Assessing Advocacy and Policy Change
Bowie C
712 International and Cross-cultural Evaluation TIG Roundtable
Rotation I: Improving Methods of Inquiry in Evaluation Practice: Issues and Recommendations to Incorporate Diverse…
Roundtable II: Investing in Long Term Capacity Building Initiatives for African-based Graduates and Professionals…
Goliad
713 Internal Evaluation TIG
Roundtable
Rotation I: Internal Evaluation: How to Keep the Fox Out of the Hen House
Rountable Rotation II: The Internal Evaluator's Dual Role as Project Manager and Evaluator: Lessons Learned…
San Jacinto
714 Assessment in Higher Education TIG
Skill-building
Leading Change Through Assessment
Travis A
715 Integrating Technology Into Evaluation TIG
Demonstration
Fewer Errors and Faster Results: How to Automate Production of Tables and Reports with Software You Already Own
Travis B
716 Multiethnic Issues in Evaluation TIG
Think Tank
Evaluating Social Change Programs: How Does a Culturally Responsive Approach Apply?
Travis C
717 Health Evaluation TIG
Panel
Moving Towards Improving the Quality of Our Evaluations: Approaches and Lessons Learned From Comprehensive Cancer…
Travis D
718 Human Services Evaluation TIG
Panel
Using Geographic Information Systems (GIS) to Enhance the Quality and Validity of Evaluations in Human Services
Independence
719 Quantitative Methods: Theory and Design TIG
MultiPaper
A Practical Comparison of Longitudinal Data Analysis Methods
Presidio A
720 Org Learning & Evaluation Capacity Bldg TIG
Panel
Measuring Evaluation Capacity to Enhance Quality of ECB Activities in Federal Pubilc Health and Systemic Change Programs Presidio B
721 Alcohol, Drug Abuse, and Mental Health TIG
Panel
Taking Stock of the Quality of Evaluation Research on School-Based Prevention Programs
Presidio C
722 Collaborative, Participatory & Empowerment
Roundtable
Rotation I: Wearing Different Hats: The Multiple Roles of an Evaluator
Rotation II: Valuing Stakeholders: Collaborative Evaluation of Professional Development Needs
Bonham A
723 Non-profit and Foundations Evaluation TIG
Panel
Beauty is in the Eye of the Beholder: Rationalizing Evaluation Needs Amongst Foundation Boards, Staff, and the Nonprofits… Bonham B
724 Pre-K - 12 Educational Evaluation TIG
Skill-building
Systems and Logic Models as Complementary Tools for Educational Evaluation
Evaluation 2010: Saturday, November 13, 8:00 AM – 9:30 AM
Bonham C
Page 128
Summary of Sessions for Saturday, November 13, 8:00 AM to 9:30 AM, Continued
No Primary Sponsor
Session
Session Title
Room
725 Pre-K - 12 Educational Evaluation TIG
Panel
Classroom Observations: Lessons Learned About Five Protocols From Five Multi-site Education Evaluations
Bonham D
726 Research, Technology, and Development
Panel
Interim Evaluation: The Quality of Research and the Quality of Evaluation - Case Study of the FP7 Interim Evaluation
Bonham E
727 Government Evaluation TIG
Panel
Use of Evaluation: Overcoming the Challenges
Texas A
729 Mixed Methods Evaluation TIG
MultiPaper
A Mixed Methods Assessment of the Impact of Three Dropout Prevention Strategies on Student Academic Achievement…
Texas C
730 Research, Technology, and Development
Panel
Metrics for the National Institute of Environmental Health Science (NIEHS): Measuring Outcomes to Advance Partnerships…
Texas D
731 Evaluation Use TIG
Demonstration
Strategies for Developing Evaluation Capacity in Educational Partnerships
Texas E
732 Research on Evaluation TIG
Multipaper
Studies of Evaluation Practice Across Multiple Contexts
Texas F
733 Extension Education Evaluation TIG
Demonstration
Mapping Extension‘s Networks: Using Social Network Analysis to Explore Extension Outreach
Crockett A
734 Teaching of Evaluation TIG
Demonstration
Critical Concepts for Introductory Evaluation Courses: Multiple Perspectives – Part 2
Crockett B
735 International and Cross-cultural Evaluation TIG Panel
The Role of Monitoring in Evaluation Quality
Crockett C
736 Government Evaluation TIG
Panel
Infusing Evaluation Theory Into Practice in Government Safety Programs: Process Examples From the US Dept of Transport…
Crockett D
737 Graduate Student and New Evaluator TIG
Panel
Emerging Evaluators and the Future of Culturally Responsive Evaluation
Seguin B
738 International and Cross-cultural Evaluation TIG Multipaper
Impact Evaluation and Beyond: Methodological and Cultural Considerations in Measuring What Works
Republic A
739 Health Evaluation TIG
MultiPaper
National Evaluation of Team Science in the Interdisciplinary Research Consortium Program
Republic B
740 Collaborative, Participatory & Empowerment
Multipaper
Collaborative Evaluations: Successes, Challenges, and Lessons Learned
Republic C
Evaluation 2010: Saturday, November 13, 8:00 AM – 9:30 AM
Page 129
Saturday, 8:00 am to 9:30 am
702 - Design Thinking: The Art of Evaluation
Panel to be held in Lone Star A
Sponsored by the Presidential Strand and
the Evaluating the Arts and Culture TIG
 Chair and Discussant - Ching Ching Yap,
Savannah College of Art and Design
Make the Familiar Strange, and Make the
Strange Familiar
 Christine Miller, Savannah College of Art and Design
The Breakthrough of Praxis
 Robert Fee, Savannah College of Art and Design
Taking the First Step Towards Design Thinking
 David Ringholz, Savannah College of Art and Design
703 - Theory of Change Online: Implications for Participatory Planning and Evaluation Using Technology
Panel to be held in Lone Star B
Sponsored by the Program Theory and Theory-driven
Evaluation TIG
 Chair and Discussant - Helene Clark, ActKnowledge
Using Technology to Enable Constituency Feedback
 David Bonbright, Keystone Accountability
Differences in Theory Development Before and After Using an
Online Theory of Change Application
 Abra McAndrew, University of Arizona
Using Theory of Change Online as Part of an Advocacy
Approach to the Needs of Children
 Jodie Langs, West Coast Children's Clinic
704 - Training in Evaluation: Formal and Informal
Capacity Building
MultiPaper to be held in Lone Star C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Chair - Stewart Donaldson, Claremont Graduate University
Innovative Approaches for Evaluation Education and Training:
Examples From the Claremont Graduate University (CGU)
Evaluation Programs
 John LaVelle and Stewart Donaldson, Claremont Graduate
University
Training in Informal Settings: From Workshops to Collaborative
Web Pages (With a Focus on Facilitated Thinking Skills)
 Linda Delaney, LFD Consulting LLC; and David Fetterman,
Fetterman & Associates
Training For Outcomes (TFO): Using the Getting to Outcomes®
Framework to Achieve Training Success
 Victoria Chien, University of South Carolina; and Abraham
Wandersman, University of South Carolina
Empowerment Evaluator: Critical Friend and Organizational
Counselor and Advisor
 Jose Maria Diaz Puente, Polytechnic University of Madrid
705 - Foundation Effectiveness: Aligning Impact
Strategy and Evaluation
Demonstration to be held in Lone Star D
Sponsored by the Non-profit and Foundations Evaluation TIG
 Dawn Martz, Foellinger Foundation Inc; and Mike Stone,
Impact Strategies Inc
706 - Applications of Multiple Regression for
Evaluators
Demonstration to be held in Lone Star E
Sponsored by the Quantitative Methods: Theory and Design TIG
 Dale Berger, Claremont Graduate University
707 - The Process of Evaluating Supporting
Partnerships to Assure Ready Kids (SPARK) and
Ready Kids Follow-Up (RKF): Embracing and
Informing Truth, Beauty, and Justice
Panel to be held in Lone Star F
Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG
 Chair - York Susan, University of Hawaii, Manoa
 Discussant - Huilan Krenn, W K Kellogg Foundation
Methodological Challenges to Initiative-level Evaluation
 Patrick Curtis, Walter R McDonald and Associates Inc
A So-called ―Improved‖ Evaluation Method Viewed Through an
Indigenous Lens
 Morris Lai, University of Hawaii, Manoa
The Tension Between Difference and Commonality in Multi-site
Initiative: What are the Challenges to Quality?
 Marah Moore, i2i Institute Inc
Including Evaluation From the Start: How Ohio SPARK Used
Evaluation for Program Planning and Program Expansion
 Peter Leahy, University of Akron
708 – Roundtables in Mission A
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Human Services Evaluation TIG and the
Mixed Methods Evaluation TIG
Rotation 1: Measuring Success: Applying Short-Term
Indicators to Measure Long-Term Success in Human Capital
Investment Programs
 Margaret McKenna, ConTEXT
Rotation 2: How to Maintain Evaluation Quality in a Changing
Environment: The Importance of Mixed Methods
 Michael Smith and Lisanne Brown, Louisiana Public
Health Institute; and Elmore Rigamer, Catholic Charities of
New Orleans
Evaluation 2010: Saturday, November 13, 8:00 AM – 9:30 AM
Page 130
709 - From Deliverables to Strategies: Experience of
Implementing a National Evaluation Policy via
Statewide Asthma Programs
Panel to be held in Mission B
Sponsored by the Evaluation Policy TIG
 Chair - Paul Garbe, Centers for Disease Control and
Prevention
Shaking It Up: A New Evaluation Policy for Strategic Evaluation
Planning
 Leslie Fierro, SciMetrika
Reality Check: Benefits and Limitations of Strategic Evaluation
Planning in Practice
 Eric Armbrecht, Open Health LLC; Peggy Gaddy and Sherri
Homan, Missouri Asthma Prevention and Control Program
Supporting Internal Evaluation Policy: Development of
Evaluation Technical Assistance Sub-team and Policy
Implementation Materials
 Sarah Gill and Amanda Savage Brown, Cazador
Providing Evaluation Technical Assistance: Are We Doing What
We Expected and What Exactly Are We Doing?
 Sheri Disler, Centers for Disease Control and Prevention;
and Amanda Savage Brown, Cazador
710 - Framework for Orchestrating Systems
Transformation: Theory and Practice for Promoting
Dynamic Systems Change
MultiPaper to be held in Bowie A
Sponsored by the Systems in Evaluation TIG
 Chair - Pennie Foster-Fishman, Michigan State University
An Overview of the Framework for Orchestrating Systems
Transformation
 Pennie Foster-Fishman and Erin Watson, Michigan State
University
Using the Framework for Orchestrating Systems
Transformation for Systemic Action Learning and Strategic
Change Processes
 Erin Watson and Pennie Foster-Fishman, Michigan State
University
Factors Affecting a Neighborhood Small Grants Program:
Application of the Framework for Orchestrating Systems
Transformation
 Jennifer Mortensen, Pennie Foster-Fishman, and Miles
McNall, Michigan State University
Considering Resident Engagement as a Systems Change
Process
 Charles Collins, Pennie Foster-Fishman, Steven Pierce,
Michigan State University
711 - Where Theory Meets Practice in Assessing
Advocacy and Policy Change
Multipaper to be held in Bowie C
Sponsored by the Advocacy and Policy Change TIG
 Chair - Ehren Reed, Innovation Network
How Do You Know You Are Making a Difference? A
Collaborative Study With Social Justice Advocacy
Organizations in Canada
 Bessa Whitmore, Carleton University; and Maureen
Wilson, and Avery Calhoun, University of Calgary
Hard Evidence for Hard Times: A Policy Analysis of the Rise of
Evidence-based Practice in Evaluation of Home Visiting
Programs Using Kingdon‘s Multiple Streams Model
 Stephen Edward McMillin, University of Chicago
The Politics and Ethics of Advocacy Evaluation
 Denise L Baer, Johns Hopkins University
712 – Roundtables in Goliad
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the International & Cross-cultural Evaluation TIG
Rotation 1: Investing in Long Term Capacity Building Initiatives
for African-based Graduates and Professionals Involved or
Interested in the Monitoring and Evaluating (M&E) of
Development, Business and Education
 Maureen Wang'ati, Measure Africa
Rotation 2: Improving Methods of Inquiry in Evaluation
Practice: Issues and Recommendations to Incorporate
Diverse Views and Perspectives in International and Domestic
Program Evaluation
 Nicole Jackson, University of California, Berkeley
713 – Roundtables in San Jacinto
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Internal Evaluation TIG
Rotation 1: The Internal Evaluator's Dual Role as Project
Manager and Evaluator: Lessons in Maintaining Evaluation
Quality
 Tamika Howell, Brian Mundy, and William Campbell,
Institute for Community Living Inc
Rotation 2: Internal Evaluation: How to Keep the Fox Out of the
Hen House
 Jane Nell Luster, Louisiana State University
714 - Leading Change Through Assessment
Skill-building Workshop to be held in Travis A
Sponsored by the Assessment in Higher Education TIG
 Patrice Lancey and Divya Bhati, University of Central
Florida
Evaluation 2010: Saturday, November 13, 8:00 AM – 9:30 AM
Page 131
Demonstration to be held in Travis B
Sponsored by the Integrating Technology Into Evaluation TIG
 Humphrey Costello, Eric Canen, and Reese Jenniges,
University of Wyoming
Using GIS to Locate and Evaluate Affordable, Safe, and
Effective Housing for Emancipated Youth
Leaving Foster Care: Project LEASE
 Catherine Batsche, University of South Florida
Using GIS to Locate a Community Mental Health Center: A
Case Illustration
 Roger Boothroyd, University of South Florida
A GIS Model to Reduce Risk Factors for Pregnant and
Parenting Mothers
 Robert Lucio, University of South Florida
716 - Evaluating Social Change Programs: How Does
a Culturally Responsive Approach Apply?
719 - A Practical Comparison of Longitudinal Data
Analysis Methods
Saturday, 8:00 am to 9:30 am, continued
715 - Fewer Errors and Faster Results: How to
Automate Production of Tables and Reports with
Software You Already Own
Think Tank to be held in Travis C
Sponsored by the Multiethnic Issues in Evaluation TIG
 Presenter - Deloris Vaughn, Innovation Network
 Discussant s- Laura Ostenso and Melisa March,
Innovation Network
717 - Moving Towards Improving the Quality of Our
Evaluations: Approaches and Lessons Learned From
Comprehensive Cancer Control at the Centers for
Disease Control and Prevention (CDC)
Panel to be held in Travis D
Sponsored by the Health Evaluation TIG
 Chair - Debra Holden, Research Triangle Institute
International
 Discussant - Phyllis Rochester, CDC
Performance Measures for the National Comprehensive Cancer
Control Program (NCCCP): Current State and Future Directions
 Julie Townsend, Chrisandra Stockmyer, Angela Moore, and
Phyllis Rochester, CDC
Comprehensive Cancer Control Evaluation Toolkit: A Resource
to Improve the Quality of Evaluation Plans
 Angela Moore, CDC; LaShawn Curtis and Cindy Soloe, RTI
International; and Phyllis Rochester, CDC
The Development of a Menu of Outcomes Database (MOD): A
Practical Evaluation Tool to Assist State, Tribal and Territorial
Comprehensive Cancer Control Programs
 Brenda Stone-Wiggins, RTI International; Phyllis
Rochester, Chrisandra Stockmyer, and Angela Moore, CDC;
and Janice Tzeng, Nathan Mann, and Debra Holden, RTI
International
718 - Using Geographic Information Systems (GIS) to
Enhance the Quality and Validity of Evaluations in
Human Services
Panel to be held in Independence
Sponsored by the Human Services Evaluation TIG
 Chair - Catherine Batsche, University of South Florida
MultiPaper to be held in Presidio A
Sponsored by the Quantitative Methods: Theory and Design TIG
 Chair - Mende Davis, University of Arizona
Traditional Approaches for Longitudinal Data
 Mende Davis and William Becker, University of Arizona
Newer Approaches for Longitudinal Data: General Linear
Models and Mixed Models
 Sally Olderbak and William Becker, University of Arizona
Tying It All together
 Sally Olderbak, Mei-kuang Chen, Aurelio Jose Figueredo,
and Mende Davis, University of Arizona
720 - Measuring Evaluation Capacity to Enhance
Quality of Evaluation Capacity Building (ECB)
Activities in Federal Public Health and Systemic
Change Programs
Panel to be held in Presidio B
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG and the Health Evaluation TIG
 Chair - Maureen Wilce, Centers for Disease Control and
Prevention
 Discussant - Hallie Preskill, FSG Social Impact Advisors
Measuring Evaluation Capacity: Development of a Tool
 Carlyn Orians, Battelle Memorial Institute
Building Evaluation Capacity for Asthma Control Programs:
Assessing What You Don‘t Know
 Kari Cruz and Maureen Wilce, Centers for Disease Control
and Prevention
Building Evaluation Capacity for State Oral Health Programs:
Using Data to Plan and Focus Initiatives
 Cassandra Martin, Centers for Disease Control and
Prevention
Targeting Evaluation Capacity Building (ECB) Needs in State
and Tribal Child Welfare Systemic Change Projects
 Julie Morales, University of Denver
Evaluation 2010: Saturday, November 13, 8:00 AM – 9:30 AM
Page 132
721 - Taking Stock of the Quality of Evaluation
Research on School-Based Prevention Programs
724 - Systems and Logic Models as Complementary
Tools for Educational Evaluation
Panel to be held in Presidio C
Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG
 Chair - Scott Crosse, Westat
The Methodological Quality of Evaluation Research on Schoolbased Prevention Programs: Where Are We Now?
 Carol Hagen, Scott Crosse, and Michele Harmon, Westat;
and Samantha Leaf and Rebekah Hersch, ISA Associates
Main Effects and Moderating Influences Among ‗Effective‘
School-based Programs
 Aaron Alford and Jim Derzon, Battelle Memorial Institute
Breadth and Depth of Evidence: Documenting Program
Effectiveness Across a Range of Behavioral Outcomes
 Jim Derzon and Aaron Alford, Battelle Memorial Institute
Skill-building Workshop to be held in Bonham C
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Janice Noga, Pathfinder Evaluation and Consulting
722 – Roundtables in Bonham A
Roundtable to be held in Bonham A
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
Rotation 1: Valuing Stakeholders: Collaborative Evaluation of
Professional Development Needs
 Wendy Bradshaw and Jeremy Lake, University of South
Florida
Rotation 2: Wearing Different Hats: The Multiple Roles of an
Evaluator
 Jeremy Lake and Wendy Bradshaw, University of South
Florida
723 - Beauty is in the Eye of the Beholder:
Rationalizing Evaluation Needs Amongst Foundation
Boards, Staff, and the Nonprofits They Fund
Panel to be held in Bonham B
Sponsored by the Non-profit and Foundations Evaluation TIG
 Chair - Charles Gasper, Missouri Foundation for Health
The Director of Evaluation: Part Negotiator, Part Salesman,
Part Educator, Part Evaluator, and 100% Facilitator
 Charles Gasper, Missouri Foundation for Health
The Vice President for Program: Looking for Impact, But Also
Looking to Learn Lessons That Can Be Applied to Other
Initiatives
 Martha Gragg, Missouri Foundation for Health
The Director of a Foundation: Strongly Interested in Knowing If
the Funding Has Made an Impact, but Open to Learning More
From Evaluations
 George Gruendel, Missouri Foundation for Health
The Contractor in the Middle: Balancing the Needs of Different
Organizations to Meet the Needs of All the Primary
Stakeholders
 Carol Brownson, Washington University in St Louis
725 - Classroom Observations: Lessons Learned
About Five Protocols From Five Multi-site Education
Evaluations
Panel to be held in Bonham D
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Elizabeth Autio, Education Northwest
Using the Classroom Assessment Scoring System (CLASS) to
Measure Classroom Organization, Interactions, and Support
 Jason Greenberg Motamedi, Education Northwest
Looking at Literacy With the Early Language and Literacy
Classroom Observation Tool (ELLCO) and the Sheltered
Instruction Observation Protocol (SIOP)
 Elizabeth Autio, Education Northwest
Development of an Observation Protocol for a Reading
Intervention
 Caitlin Scott, Education Northwest
Development of an Observation Protocol for Adolescent
Literacy Interventions
 Kari Nelsestuen, Education Northwest
726 - Interim Evaluation: The Quality of Research and
the Quality of Evaluation - Case Study of the FP7
Interim Evaluation
Panel to be held in Bonham E
Sponsored by the Research, Technology, and Development
Evaluation TIG
 Chair - Neville Reeve, European Commission
Case Study of the FP7 Interim Evaluation: Notions of Quality in
Evaluation Design
 Neville Reeve, European Commission
Evaluation Quality and Long-term Impact
 Peter Fisch, European Commission
The Use of Independent Experts to Verify Quality and
Strengthen Evaluation Process
 Wolfgang Polt, Joanneum Research
The Role of Stakeholders on the Quality of Evaluation Design,
Implementation and Impact
 Iain Begg, London School of Economics
Evaluation 2010: Saturday, November 13, 8:00 AM – 9:30 AM
Page 133
Saturday, 8:00 am to 9:30 am, continued
727 - Use of Evaluation: Overcoming the Challenges
Panel to be held in Texas A
Sponsored by the Government Evaluation TIG
 Chair - Joseph Wholey, University of Southern California
 Discussant - George Grob, Center for Public Program
Evaluation
The Challenge of Producing Credible Evaluations
 Kathryn Newcomer, George Washington University
The Challenge of Producing Useful Evaluations
 Harry Hatry, Urban Institute
Contracting for Credible, Useful Evaluations
 James Bell, James Bell Associates
729 - A Mixed Methods Assessment of the Impact of
Three Dropout Prevention Strategies on Student
Academic Achievement in Grades 6th through12th in
Texas
MultiPaper to be held in Texas C
Sponsored by the Mixed Methods Evaluation TIG
 Chair - Thomas Horwood, ICF International
 Discussant - Candace Macken, Texas Education Agency
An Evaluation of the Intensive Summer Program (ISP) in Texas
Schools
 Rosemarie O'Conner and Aikaterini Passa, ICF
International
An Evaluation of the Collaborative Dropout Reduction Program
in Texas Schools
 Allan Porowski and Sarah Decker, ICF International
An Evaluation of the Impact of Teacher Mathematics
Instructional Coaches Training on Teachers and Schools
 Stacey Merola and Aikaterini Passa, ICF International
730 - Metrics for the National Institute of
Environmental Health Science (NIEHS): Measuring
Outcomes to Advance Partnerships for Environmental
Public Health
Panel to be held in Texas D
Sponsored by the Research, Technology, and Development
Evaluation TIG
 Chair - Christie Drew, National Institute of Environmental
Health Sciences
 Discussant - Gretchen Jordan, Sandia National
Laboratories
Metrics and Examples for Evaluating Education and Training
Evaluation in Environmental Public Health Programs
 Helena L Davis, Beth Anderson, Sharon Beard, Caroline
Dilworth, Christie Drew, and Liam O'Fallon, National Institute
of Environmental Health Sciences; and Ashley Brenner, Cara
O'Donnell, Sarah Ryker, Stephanie Shipp, and Susannah T
Howieson, Science and Technology Policy Institute
Evaluating Partnerships in Environmental Health Programs
 Ashley Brenner, and Cara O'Donnell, Science and
Technology Policy Institute; Beth Anderson, Sharon Beard,
Helena L Davis, Caroline Dilworth, Christie Drew, and Liam
O'Fallon, National Institute of Environmental Health Sciences;
and Sarah Ryker, Stephanie Shipp, and Susannah T Howieson,
Science and Technology Policy Institute
Partnerships and Training: The United Steelworkers Health and
Safety Department Worker Training and Education Program
 Thomas McQuiston, United Steelworkers Health and
Safety Department
Environmental Health and the Navajo Nation: Products,
Dissemination, and Partnerships
 Johnnye Lewis, University of New Mexico
731 - Strategies for Developing Evaluation Capacity
in Educational Partnerships
Demonstration to be held in Texas E
Sponsored by the Evaluation Use, and the Pre-K - 12
Educational Evaluation, and the Indigenous Peoples in
Evaluation TIGs
 Ed McLain, University of Alaska, Anchorage; and Susan
Tucker, Evaluation & Development Associates
732 - Studies of Evaluation Practice Across Multiple
Contexts
Multipaper to be held in Texas F
Sponsored by the Research on Evaluation TIG
 Chair - Deborah Grodzicki, University of California, Los
Angeles
An Examination of the State and Quality of Monitoring and
Tracking (M&T) for Contemporary Program Evaluation
 Antionette Stroter and Douglas Grane, University of Iowa
Inquiry on the State of Evaluation Practice, Experience, and
Use in Kenya
 Douglas Grane, University of Iowa; and Karen Odhiambo,
University of Nairobi
The Role of Program Evaluation in Improving and Sustaining
State-Supported School Counseling Programs: A Cross Case
Analysis of Best Practices
 Ian Martin, University of San Diego
733 - Mapping Extension‘s Networks: Using Social
Network Analysis to Explore Extension Outreach
Demonstration to be held in Crockett A
Sponsored by the Extension Education Evaluation TIG
 Scott Chazdon, Tom Bartholomay, Mary Marczak, and
Kate Walker, University of Minnesota
Evaluation 2010: Saturday, November 13, 8:00 AM – 9:30 AM
Page 134
734 - Critical Concepts for Introductory Evaluation
Courses: Multiple Perspectives – Part 2
737 - Emerging Evaluators and the Future of
Culturally Responsive Evaluation
Demonstration to be held in Crockett B
Sponsored by the Teaching of Evaluation TIG
 Katye Perry, Oklahoma State University; David Diehl,
University of Florida; Maura Harrington, Center for Nonprofit
Management; Kathleen Bolland, University of Alabama; Shana
Pribesh, Old Dominion University; Faye Belgrave, Virginia
Commonwealth University; John Stevenson, University of
Rhode Island; Kathleen Norris, Plymouth State University;
Melissa Chapman, University of Iowa; David Nevo, Tel Aviv
University; Anne Hewitt, Seton Hall University; and Arthur
Hernandez, Texas A&M University
Panel to be held in Seguin B
Sponsored by the Graduate Student and New Evaluator TIG
 Chair - Helga Stokes, Duquesne University
 Discussant - Daniel McDonald, University of Arizona; Karol
K Harris, University of Texas, Austin; Michelle Jay, University of
South Carolina; and Ricardo Millett, Ricardo Millett and
Associates
Teaching a New Dog Old Tricks: Incorporating Evaluation Skills
Into Academic and Work Settings
 Natalie Alizaga, Amherst H Wilder Foundation; Monica
Getahun, OMG Center for Collaborative Learning; Denise
Herrera, Decision Information Resources Inc; and Afabwaje
Jatau, National Cancer Institute
Culturally Responsive Evaluation: Engaging Community
Members and Stakeholders Toward Meaningful Policy and
Systems Change
 Monica Getahun, OMG Center for Collaborative Learning
Mentoring Novice Evaluators Throughout the Evaluation
Process: An Investment Worth Making
 Denise Herrera, Decision Information Resources Inc
An Inconvenience or a Necessity?: The Role of Culturally
Responsive Evaluation in Agencies When Resources May Be
Limited
 Afabwaje Jatau, National Cancer Institute
735 - The Role of Monitoring in Evaluation Quality
Panel to be held in Crockett C
Sponsored by the International & Cross-cultural Evaluation TIG
 Chair - Chung Lai, International Relief & Development
Data Collection Instruments for Quality Evaluation
 Chung Lai, International Relief & Development
Monitoring Tools and Systems: Contributing to Better
Information for Program Teams and Evaluators
 Maurya West Meiers, World Bank
Monitoring: An Evaluator‘s Friend or Foe
 Cheyanne Scharbatke-Church, Besa Consulting
736 - Infusing Evaluation Theory Into Practice in
Government Safety Programs: Process Examples
From the United States Department of Transportation
Panel to be held in Crockett D
Sponsored by the Government Evaluation TIG
 Chair - Michael Quinn Patton, Utilization-Focused
Evaluation
 Discussant - Joyce Ranney, Volpe National Transportation
Systems Center
Planning for Quality: Creating an Evaluation-Focused Safety
Council for the United States Department of Transportation
 Michael Coplen, United States Department of
Transportation; and Stephen Popkin, Volpe National
Transportation Systems Center
Promoting Positive Utilization of Risk Analysis Findings
 Juna Snow, Innovated Consulting; Deborah Bonnet,
Fulcrum Corporation
From Research to Practice: The Utility of Evaluation With
International Fatigue Management Conference in
Transportation
 Michael Coplen, United States Department of
Transportation; and Stephen Popkin, Volpe National
Transportation Systems Center
738 - Impact Evaluation and Beyond:
Methodological and Cultural Considerations in
Measuring What Works
Multipaper to be held in Republic A
Sponsored by the International & Cross-cultural Evaluation TIG
 Chair - Tessie Catsambas, EnCompass LLC
Assessing the Relevance of International Development and
Humanitarian Response Projects at Aggregate Levels: A Key
Consideration in Achieving Equality of Wellbeing Outcomes
and Just Resource Allocation - An Example of Summary Child
Wellbeing Outcome Reporting From World Vision International
 Nathan Morrow, World Vision International; and Nancy
Mock, Tulane University
Taking the Long View in Evaluating International Development
Assistance
 R Gregory Michaels and Alphonse Bigirimana, Chemonics
International
Using Rubrics Methodology in Impact Evaluations of Complex
Social Programs: The Case of the Maria Cecilia Souto Vidigal
Foundation‘s Early Childhood Development Program
 Thomaz Chianca, COMEA Evaluation Ltd; and Marino
Eduardo, Independent Consultant
Quality is More Than Rigor: A Political and a Scientific
Perspective for Impact Evaluation in Development
 Rahel Kahlert, University of Texas, Austin
Evaluation 2010: Saturday, November 13, 8:00 AM – 9:30 AM
Page 135
Saturday, 8:00 am to 9:30 am, continued
Saturday, 9:30 am to 10:00 am – Coffee Break!
739 - National Evaluation of Team Science in the
Interdisciplinary Research Consortium Program
MultiPaper to be held in Republic B
Sponsored by the Health Evaluation TIG
 Chair - Sue Hamann, National Institutes of Health
Why Evaluating Team Science is Important: Perspectives of the
National Institutes of Health (NIH)
 Sue Hamann, National Institutes of Health
The Use of an Expert Panel to Advance the Evaluation of Team
Science
 Alina Martinez, Abt Associates Inc
The Utility of Social Network Analysis in the Evaluation of Team
Science
 Irina Agoulnik, Brigham and Women's Hospital
Comprehensive Mixed Methods for Evaluating Team Science:
Searching for "Truth" Versus ―Truthiness‖
 Jacob Tebes, Yale University
740 - Collaborative Evaluations: Successes,
Challenges, and Lessons Learned
Multipaper to be held in Republic C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Chair - Anne Cullen, Western Michigan University
Enhancing Evaluation Stakeholder Responsiveness Through
Collaborative Development of Data
 Karen Kortecamp, George Washington University
Reflecting on Practice in Evaluating Culturally Competent
Teaching Strategies
 Corina Owens, Michael Berson, and Liliana RodriguezCampos, University of South Florida
Summative Evaluation for Marketing of Science Teachers and
Induction (MOSTI): An Eclectic
Evaluation Approach to the Improvement of Science Teacher
Recruitment, Induction, and Retention
 Bryce Pride, Merlande Petit-Bois, Robert Potter, and John
Ferron, University of South Florida
Evaluation Capacity Building in Health Disparities Research:
Achieving Empowerment Using the Model for Collaborative
Evaluations (MCE)
 LaShonda Coulbertson and Desiree Rivers, Center for
Equal Health
Evaluation 2010: Saturday, November 13, 8:00 AM – 9:30 AM
Page 136
Notes:
Evaluation 2010: Saturday, November 13, 8:00 AM – 9:30 AM
Page 137
Summary of Sessions for Saturday, November 13, 10:00 AM to 10:45 AM
No Primary Sponsor
Session
Session Title
Room
742 Presidential Strand & Program Theory-Driven
Business
TIG Business Meeting and Panel: Improving Evaluation Quality by Improving Program Quality: A Theory-based…
Lone Star A
743 Systems in Evaluation TIG
Demonstration
Expanding Evaluation‘s Utility and Quality Through System-Oriented Data Synthesis
Lone Star B
744 Collaborative, Participatory & Empowerment
Panel
Racial and Ethnic Approaches to Community Health Across the United States (REACH US) Programs: Creating…
Lone Star C
745 Non-profit and Foundations Evaluation TIG
Panel
Evaluation in Foundations: The State of the Art
Lone Star D
746 Quantitative Methods: Theory and Design TIG
Expert Lecture
Ten Steps to Making Evaluations Matter: Designing Evaluations to Exert Influence
Lone Star E
747 Cluster, Multi-site & Multi-level Evaluation TIG Panel
Partner Roles in a Multi-site Evaluation: The Viewpoints and Experiences of the Cross-site Evaluator and the State Program… Lone Star F
748 Independent Consulting TIG
Roundtable
Translating Findings Into Client Action
Mission A
749 Disabilities and Other Vulnerable Populations
Multipaper
Evaluation of Interventions and Assessments of Individuals With Disabilities
Mission B
750 Independent Consulting TIG
Skill-building
Evaluations of Community Nonprofits and New Organizations or Developing Programs: Lessons From the Field
Bowie A
751 Advocacy and Policy Change TIG
Panel
Slow Down, You Move too Fast: Calibrating Evaluator Engagement to the Pace of Campaigners and Advocates…
Bowie C
752 Distance Ed. & Other Educational Technologies Roundtable
Increasing Access Through Openness? Evaluating Open Educational Resources (OER) in Himalayan Community Technology… Goliad
753 Evaluation Use TIG
Roundtable
Use, Ethics, and Not Giving Clients What They Ask For
San Jacinto
754 Assessment in Higher Education TIG
Multipaper
The Impact of Exogenous Factors in Classroom Evaluation
Travis A
755 Integrating Technology Into Evaluation TIG
Demonstration
Data Dashboard Design for Quality Monitoring and Decision Making
Travis B
756 Org Learning & Evaluation Capacity Bldg TIG
Think Tank
Strengthening the Learning Culture Within Organizations and Projects
Travis C
757 Org Learning & Evaluation Capacity Bldg TIG
Multipaper
Building Capacity in Community-Level Organizations
Travis D
758 Assessment in Higher Education TIG
Multipaper
Evaluation in Medical Education
Independence
759 Independent Consulting TIG
Demonstration
Guidelines for Independent Consultants/Evaluators Working With Universities: Complying With Federal Funding Source…
Presidio A
760 Org Learning & Evaluation Capacity Bldg TIG
Panel
Evaluation Capacity Building Through State Affiliates
Presidio B
761 Alcohol, Drug Abuse, and Mental Health TIG
MultiPaper
Evaluation Capacity in School Mental Health: Lessons From School Counseling
Presidio C
762 Non-profit and Foundations Evaluation TIG
Roundtable
Using Site Visits to Improve Programs
Bonham A
763 College Access Programs TIG
Multipaper
Control Groups and Cost Analysis: Innovative Approaches to College Access Program Evaluation
Bonham B
764 Pre-K - 12 Educational Evaluation TIG
MultiPaper
Promoting Truth and Justice: Evaluation‘s Role in Teacher Education Programs for Candidates From Underrepresented…
Bonham C
765 Pre-K - 12 Educational Evaluation TIG
Think Tank
Evaluating Twenty-first Century Skills
Bonham D
766 Research, Technology, and Development
Multipaper
Systems of Evaluation for Diverse National Portfolios of Research: Lessons From Russia and Finland
Bonham E
Evaluation 2010: Saturday, November 13, 10:00 AM – 10:45 AM
Page 138
Summary of Sessions for Saturday, November 13, 10:00 AM to 10:45 AM, Continued
No Primary Sponsor
Session
Session Title
Room
767 Government Evaluation TIG
Panel
Demonstrating Results for Federally Funded Programs
Texas A
768 Qualitative Methods TIG
Multipaper
Where Do Values Enter Into Evaluations?
Texas B
769 AEA Conference Committee
Panel
How to Get People to Read Your Research And Take Action on It
Texas C
770 Research, Technology, and Development
Multipaper
Evaluating Contributions to Knowledge Translation for New Technologies or Medical Treatments
Texas D
771 Evaluation Use TIG
Demonstration
Effectively Communicating Evaluation Results: Creative, Innovative, and Technological Ways to Share Evaluation Findings
Texas E
772 Evaluation Policy TIG
Expert Lecture
Quality Evaluation: Drivers and Objectives of the Renewed Canadian Federal Policy on Evaluation
Texas F
773 Extension Education Evaluation TIG
MultiPaper
Supporting Evaluation Capacity Building Within the Cooperative Extension System to Impact the Lives of Children, Youth…
Crockett A
774 Business and Industry TIG
Think Tank
Leading the Horse to Water, Part II: Winning the Front-end Needs Assessment Tug-of-War in a Knowledge Management…
Crockett B
775 Social Network Analysis TIG
Expert Lecture
Longitudinal Social Network Analysis: An Understanding of This Dynamic Network Approach
Crockett C
776 Government Evaluation TIG
MultiPaper
Evaluation Challenges in Designing and Implementing a Program Evaluation: The Experience of the CDC Colorectral Cancer… Crockett D
777 Qualitative Methods TIG
Multipaper
Exploring the Role of Software in Qualitative Analysis
Seguin B
778 International and Cross-cultural Evaluation TIG Demonstration
Simulation Model of Evaluation Biases Under Post Conflict Zones
Republic A
779 Health Evaluation TIG
Multipaper
Healthy Aging and Health Screenings: Lessons Learned Through Participatory Evaluations
Republic B
780 Theories of Evaluation TIG
Multipaper
Contextual Influences on the Evaluator, the Evaluation, and the Evaluation Design
Republic C
Evaluation 2010: Saturday, November 13, 10:00 AM – 10:45 AM
Page 139
Saturday, 10:00 am to 10:45 am
742 - Program Theory and Theory-driven Evaluation
TIG Business Meeting and Panel: Improving
Evaluation Quality by Improving Program Quality: A
Theory-based/Theory-driven Perspective
Business Meeting to be held in Lone Star A
Sponsored by the Presidential Strand and
the Program Theory and Theory-driven
Evaluation TIG
 TIG Leaders - John Gargani, Gargani +
Company; and Katrina Bledsoe, Walter R McDonald and
Associates Inc
 Chair - Katrina Bledsoe, Walter R McDonald and
Associates Inc
 Discussants - Michael Scriven, Claremont Graduate
University; David Fetterman, Fetterman & Associates; and
Charles Gasper, Missouri Foundation for Health
The Relationship Between Program Design and Evaluation
Design
 Stewart Donaldson, Claremont Graduate University
The Expanding Profession: Program Evaluators as Program
Designers
 John Gargani, Gargani + Company
743 - Expanding Evaluation‘s Utility and Quality
Through System-Oriented Data Synthesis
Demonstration to be held in Lone Star B
Sponsored by the Systems in Evaluation TIG
 Beverly A Parsons and Pat Jessup, InSites
744 - Racial and Ethnic Approaches to Community
Health Across the United States (REACH US)
Programs: Creating and Evaluating Communitybased Coalitions
Panel to be held in Lone Star C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Chair - Ada Wilkinson-Lee, University of Arizona
 Discussant - Mari Wilhelm, University of Arizona
Pima County Cervical Cancer Prevention Partnership
(PCCCPP): Evaluation of a Community-based Coalition
Addressing Cervical Cancer Among Mexican American Women
 Ada Wilkinson-Lee, Martha Moore-Monroy, Francisco
Garcia, and Mari Wilhelm, University of Arizona
Evaluation of a Community-Academic Partnership Using a
Mixed-methods Approach: B Free CEED: National Center of
Excellence in the Elimination of Hepatitis B Disparities
 Nancy VanDevanter, New York University; Shao-Chee Sim,
Charles B Wang Community Health Center; and Simona Kwon,
New York University
745 - Evaluation in Foundations: The State of the Art
Panel to be held in Lone Star D
Sponsored by the Non-profit and Foundations Evaluation TIG
 Chair - Richard McGahey, Ford Foundation
 Discussants - Lester Baxter, Pew Charitable Trusts; and
Mayur Patel, John S and James L Knight Foundation
Evaluation Practice at Major United States Foundations:
Report on a Benchmark Survey and Analysis
 Patricia Patrizi, The Evaluation Roundtable
Performance Measurement at Foundations and Nonprofits:
Tools, Techniques, and Effective Practice
 Elizabeth Boris, Urban Institute
746 - Ten Steps to Making Evaluations Matter:
Designing Evaluations to Exert Influence
Expert Lecture to be held in Lone Star E
Sponsored by the Quantitative Methods: Theory and Design TIG
 Chair - Melvin Mark, Pennsylvania State University
 Presenter - Sanjeev Sridharan, University of Toronto
747 - Partner Roles in a Multi-site Evaluation: The
Viewpoints and Experiences of the Cross-site
Evaluator and the State Program Coordinator
Panel to be held in Lone Star F
Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG
 Chair - Kristin Everett, Western Michigan University
Evaluating a Statewide, Multi-site Program: The External
Evaluator‘s Role
 Kristin Everett, Western Michigan University
Evaluating a Statewide, Multi-site Program: The Program
Coordinator‘s Role
 Donna Hamilton, Michigan Department of Education
748 – Roundtable in Mission A
Sponsored by the Independent Consulting TIG
Translating Findings Into Client Action
 Judith Russell, Independent Consultant
749 - Evaluation of Interventions and Assessments of
Individuals With Disabilities
Multipaper to be held in Mission B
Sponsored by the Disabilities and Other Vulnerable
Populations and the Pre-K - 12 Educational Evaluation TIGs
 Chair - Julia Shaftel, University of Kansas
One State‘s Experience Implementing Links for Academic
Learning
 Julia Shaftel, University of Kansas
Using a Logic Model to Evaluate the Implementation and
Effectiveness of a Complex Intervention
 Celine Mercier, University of Montreal; Diane Morin, University of Quebec at Montreal; Virgine Cobigo, Queen's University at
Kingston; and Astrid Brouselle, University of Sherbrooke
Evaluation 2010: Saturday, November 13, 10:00 AM – 10:45 AM
Page 140
750 - Evaluations of Community Nonprofits and New
Organizations or Developing Programs: Lessons From
the Field
Skill-building Workshop to be held in Bowie A
Sponsored by the Independent Consulting TIG and the Nonprofit and Foundations Evaluation TIG
 Gary Miron, and Kathryn Wilson, and Michael Kiella,
Western Michigan University
751 - Slow Down, You Move too Fast: Calibrating
Evaluator Engagement to the Pace of Campaigners
and Advocates when Developing Theories of Change
Panel to be held in Bowie C
Sponsored by the Advocacy and Policy Change TIG
 Chair - Mary Sue Smiaroski, Oxfam International
Strategic Intuition and Theory of Change: Connecting the Dots
for Stakeholders
 Laura Roper, Brandeis University
Developing, Testing, and Building Data Systems Around Theory
of Change: A Year in the Life of an Embedded Monitoring,
Evaluation and Learning Staffer
 Gabrielle Watson, Oxfam America
752 – Roundtable in Goliad
Sponsored by the Distance Education and Other Educational
Technologies TIG
Increasing Access Through Openness? Evaluating Open
Educational Resources (OER) in Himalayan Community
Technology Centres
 Tiffany Ivins, David D Williams, Randy Davies, and Shrutee
Shrestha, Brigham Young University
753 – Roundtable in San Jacinto
Sponsored by the Evaluation Use TIG
Use, Ethics, and Not Giving Clients What They Ask For
 Rachael Lawrence and Sharon Rallis, University of
Massachusetts, Amherst
Did you know? AEA is piloting a coffee-break
demonstration series consisting of 20-minute
webinars. These are recorded and available to
members, free of charge, on the AEA website.
754 - The Impact of Exogenous Factors in Classroom
Evaluation
Multipaper to be held in Travis A
Sponsored by the Assessment in Higher Education TIG
 Chair - Susan Rogers, State University of New York at Albany
 Discussant - Rhoda Risner, United States Army
10% for Attendance & Participation: Evaluating Assessment
Practices in Undergraduate Courses
 Susan Rogers and Kristina Mycek, State University of New
York at Albany
Tables and Chairs: The Effects of Classroom Design on
Students and Instructors in Higher Educational Settings
 Martin Wikoff, Krueger International; and Susan Rogers,
State University of New York at Albany
755 - Data Dashboard Design for Quality Monitoring
and Decision Making
Demonstration to be held in Travis B
Sponsored by the Integrating Technology Into Evaluation TIG
 Presenters - Veronica Smith, data2insight; and Tarek
Azzam, Claremont Graduate University
756 - Strengthening the Learning Culture Within
Organizations and Projects
Think Tank to be held in Travis C
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG
 Presenters - David Scheie, Touchstone Center for
Collaborative Inquiry; and Nan Kari, Touchstone Center for
Collaborative Inquiry
 Discussants - Jessica Shao, Independent Consultant;
Scott Hebert, Sustained Impact; and Ross Velure Roholt,
University of Minnesota
757 - Building Capacity in Community-Level
Organizations
Multipaper to be held in Travis D
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG
 Chair - Debbie Zorn, University of Cincinnati
 Discussant - Rebecca Woodland, University of
Massachusetts, Amherst
Capacity Building: Grass Roots Agencies – Grass Roots Funding
 John Kelley, Villanova University
Monitoring and Evaluation (M&E) for Me! Building the
Monitoring and Evaluation Capacity of Community-based
HIV/AIDS Programs in Thailand
 Anne Coghlan, Tatcha Apichaisiri, Supol Singhapoon, and
David Dobrowlski, Pact Inc
Evaluation 2010: Saturday, November 13, 10:00 AM – 10:45 AM
Page 141
Saturday, 10:00 am to 10:45 am, continued
758 - Evaluation in Medical Education
Multipaper to be held in Independence
Sponsored by the Assessment in Higher Education TIG
 Chair - Chris Lovato, University of British Columbia
 Discussant - Linda Lynch, United States Army
Using Evaluation to Inform Curriculum Renewal: A Case
Example From Medical Education
 Chris Lovato, Linda Peterson, and Helen Hsu, University of
British Columbia
Tracking Long-Term Outcomes in Medical Undergraduate
Education: Evaluating Readiness for Residency Training
 Helen Hsu, University of British Columbia; Terri BullerTaylor, Independent Consultant; and Holly Buhler and Chris
Lovato, University of British Columbia
759 - Guidelines for IndependentConsultants/
Evaluators Working With Universities: Complying
With Federal Funding Source Requirements,
Budgets, Contracts, and Other Unique Issues
Demonstration to be held in Presidio A
Sponsored by the Independent Consulting and the Government
Evaluation TIGs
 Mary Anne Sydlik, Western Michigan University
760 - Evaluation Capacity Building Through State
Affiliates
Panel to be held in Presidio B
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG
 Chair - Robert Shumer, University of Minnesota
Developing a Statewide Evaluation System
 Robert Shumer, University of Minnesota
Creating An Evaluation System for Civic Engagement
 Julie Plaut, Minnesota Campus Compact
761 - Evaluation Capacity in School Mental Health:
Lessons From School Counseling
MultiPaper to be held in Presidio C
Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG
 Chair - Melissa Maras, University of Missouri
 Discussant - Paul Flaspohler, Miami University
Getting to Outcomes in School Counseling: Examining Statewide Practices to Support Evaluative Practice
 Melissa Maras, Stephanie Coleman, and Norm Gysbers,
University of Missouri; Bragg Stanley, Missouri Department of
Elementary and Secondary Education; and Keith Herman,
University of Missouri
Assessing Evaluation Capacity: The Development and Results
of a Survey on School Counselors‘ Skills in Evaluative Practice
 Stephanie Coleman, Melissa Maras, and Bragg Stanley,
Missouri Department of Elementary and Secondary Education;
and Keith Herman and Norm Gysbers, University of Missouri
762 – Roundtable in Bonham A
Sponsored by the Non-profit and Foundations Evaluation TIG
Using Site Visits to Improve Programs
 Emily Hagstrom and Caroline Taggart, Ciurczak & Co Inc
763 - Control Groups and Cost Analysis: Innovative
Approaches to College Access Program Evaluation
Multipaper to be held in Bonham B
Sponsored by the College Access Programs TIG
 Chair - Kurt Burkum, ACT
The Impact of Gaining Early Awareness and Readiness for
Undergraduate Programs (GEAR UP) on Student Academic
Preparedness
 Kirsten L Rewey and Joseph Curiel, Action Consulting and
Evaluation Team (ACET) Inc; Michael C Rodriguez, University of
Minnesota; and Stella SiWan Zimmerman, Action Consulting
and Evaluation Team (ACET) Inc
Evaluation Quality From an Unexpected Combination: How
Evaluation Management, a Participative Process, and Program
Theory Enhanced the Development of a Cost Analysis
Framework
 Kathryn Hill, Minnesota Office of Higher Education
764 - Promoting Truth and Justice: Evaluation‘s Role
in Teacher Education Programs for Candidates From
Underrepresented Populations
MultiPaper to be held in Bonham C
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Morris Lai, University of Hawaii, Manoa
Kukuluao (Building Enlightenment): Heeding the Guidance of
Teachers in a Native Community
 Alice Kawakami, University of Hawaii, Manoa
Demonstrating the Effectiveness of Alternative Routes for
Teacher Certification in Washington State
 Patty Molloy, Evergreen Training & Evaluation; and Mea
Moore, Professional Educator Standards Board
765 - Evaluating Twenty-first Century Skills
Think Tank to be held in Bonham D
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Presenter - Sophia Mansori, Education Development
Center
 Discussant - Alyssa Na'im, Education Development Center
Evaluation 2010: Saturday, November 13, 10:00 AM – 10:45 AM
Page 142
766 - Systems of Evaluation for Diverse National
Portfolios of Research: Lessons From Russia and
Finland
770 - Evaluating Contributions to Knowledge
Translation for New Technologies or Medical
Treatments
Multipaper to be held in Bonham E
Sponsored by the Research, Technology, and Development
Evaluation TIG
 Chair - Yelena Thomas, Ministry of Research Science and
Technology
Tekes Impact Goals, Logic Models and Evaluation of Socioeconomic Effects
 Jari Hyvarinen, Tekes - Finnish Funding Agency for
Technology and Innovation
Verifiable Evaluation System for Research Programme
 Igor Zatsman, Russian Academy of Sciences
Multipaper to be held in Texas D
Sponsored by the Research, Technology, and Development
Evaluation TIG
 Chair - John Reed, Innovologie LLC
Translating New Knowledge From Technology Based Research
Projects: An Intervention Evaluation Study
 Vathsala Stone, State University of New York at Buffalo
Evolving a High-Quality Evaluation System for the National
Institutes of Health‘s (NIH) HIV/AIDS Clinical Trials Research
Networks
 Scott Rosas, Concept Systems Inc; Jonathan Kagan,
National Institutes of Health; Jeffrey Schouten, Fred
Hutchinson Cancer Research Center; and William M Trochim,
Cornell University
767 - Demonstrating Results for Federally Funded
Programs
Panel to be held in Texas A
Sponsored by the Government Evaluation TIG
Chair - Michelle Kobayashi, National Research Center Inc
Whole Measures for Food Security: Qualitative Tools To
Measure Work
 Jeanette Abi-Nader, Community Food Security Coalition
Evaluation Taxonomy: Incorporating Diverse Grantees and
Stakeholders
 Michelle Kobayashi, National Research Center Inc
768 - Where Do Values Enter Into Evaluations?
Multipaper to be held in Texas B
Sponsored by the Qualitative Methods TIG
 Chair and Discussant - Leslie Goodyear, National Science
Foundation
Slippery Evaluation: Context, Quality, Interpretation
 Serafina Pastore, University of Bari
What Matters and What Does It Look Like?: Values Meet
Practices in the Complex Context of an Educative, ValuesEngaged Evaluation of a Professional Development School
 Melissa Freeman, Jori Hall, Tracie Costantino, Soria E
Colomer, and Isabelle Crowder, University of Georgia
769 - How to Get People to Read Your Research And
Take Action on It
Panel to be held in Texas C
Sponsored by the AEA Conference Committee
 Chair - Susan Parker, Clear Thinking Communications
Find the Gold in Your Evaluation
 Susan Parker, Clear Thinking Communications
Online Strategies for Sharing Your Evaluations More Broadly
 Gabriela Fitz, Issue Lab
771 - Effectively Communicating Evaluation Results:
Creative, Innovative, and Technological Ways to
Share Evaluation Findings
Demonstration to be held in Texas E
Sponsored by the Evaluation Use TIG and the Integrating
Technology Into Evaluation
 Tiffany Comer Cook, University of Wyoming
772 - Quality Evaluation: Drivers and Objectives of
the Renewed Canadian Federal Policy on Evaluation
Expert Lecture to be held in Texas F
Sponsored by the Evaluation Policy TIG and the Government
Evaluation TIG
 Anne Routhier, Treasury Board of Canada
773 - Supporting Evaluation Capacity Building
Within the Cooperative Extension System to Impact
the Lives of Children, Youth, and Families at Risk
MultiPaper to be held in Crockett A
Sponsored by the Extension Education Evaluation TIG
 Chair - Daniel McDonald, University of Arizona
 Discussant - Roger Rennekamp, Oregon State University
Implementing an Evaluation Using Common Measures Across
Multiple States With Individual Programs
 Daniel McDonald and Pamela B Payne, University of
Arizona
Evaluating Impact at the Systems-level: The Importance of
Building Evaluation Capacity to Support the Needs of Children,
Youth, and Families at Risk
 Christine Bracamonte-Wiggs and Lynne Borden, University
of Arizona
Evaluation 2010: Saturday, November 13, 10:00 AM – 10:45 AM
Page 143
Saturday, 10:00 am to 10:45 am, continued
774 - Leading the Horse to Water, Part II: Winning
the Front-end Needs Assessment Tug-of-War in a
Knowledge Management Program Initiative
Think Tank to be held in Crockett B
Sponsored by the Business and Industry TIG
 Thomas Ward, United States Army
775 - Longitudinal Social Network Analysis: An
Understanding of This Dynamic Network Approach
Expert Lecture to be held in Crockett C
Sponsored by the Social Network Analysis TIG
Presenters - Kimberly Fredericks, The Sage Colleges
776 - Evaluation Challenges in Designing and
Implementing a Program Evaluation: The Experience
of the Centers for Disease Control and Prevention‘s
(CDC) Colorectal Cancer Control Program and
Prevention IS Care (PIC)
MultiPaper to be held in Crockett D
Sponsored by the Government Evaluation TIG
 Chair - Amy DeGroff, Centers for Disease Control and
Prevention
Planning an Impact Evaluation: The Experience of the CDC's
Colorectal Cancer Control Program
 Amy DeGroff, CDC; Michelle Revels and Danielle
Beauchesne, ICF Macro International; Djenaba Joseph, CDC;
Anna Krivelyova, ICF Macro International; Janet Royalty,
Florence Tangka, and Faye Wong, Centers for Disease Control
and Prevention; and Susan Zaro, ICF Macro International
Addressing the Evaluation Challenges of a Nationwide
Campaign for Health Care Providers: CDC‘s Prevention IS Care
 H Pamela De La Cerda and Jami Fraze, Centers for Disease
Control and Prevention
777 - Exploring the Role of Software in Qualitative
Analysis
Multipaper to be held in Seguin B
Sponsored by the Qualitative Methods TIG
 Chair and Discussant - Janet Usinger, University of
Nevada, Reno
Promoting Emergent Qualitative Inquiry Within Structured
Evaluation Practices Through NVivo
 Dan Kaczynski and Michelle Salmona, Central Michigan
University
Individual Versus NVivo
 Jenny May and Robert Petrulis, University of South
Carolina
778 - Simulation Model of Evaluation Biases Under
Post Conflict Zones
Demonstration to be held in Republic A
Sponsored by the International & Cross-cultural Evaluation TIG
 Mamadou Sidibe, International Relief & Development
779 - Healthy Aging and Health Screenings: Lessons
Learned Through Participatory Evaluations
Multipaper to be held in Republic B
Sponsored by the Health Evaluation TIG
 Chair - Susan M Wolfe, Susan Wolfe and Associates LLC
 Discussant - Michael Harnar, Claremont Graduate
University
Improving the Practical Implementation of Effectiveness Trials
in a Primary Care Setting
 Katarzyna Alderman, Battelle Memorial Institute;
Margaret J Gunter, LCF Research; Judith Lee Smith, Centers for
Disease Control and Prevention; Gary Chovnick, Linda Winges,
and Susan Pearce, Battelle Memorial Institute; April Salisbury,
LCF Research; Deirdre Shires, Henry Ford Health System;
Danuta Kasprzyk and Daniel Montano, Battelle Memorial
Institute; and Jennifer Elston Lafata, Virginia Commonwealth
University
Participatory Evaluation in a Program to Promote Well-Aging
Among Persons With Intellectual and Developmental Disability
 Karen Widmer, Independent Consultant
780 - Contextual Influences on the Evaluator, the
Evaluation, and the Evaluation Design
Multipaper to be held in Republic C
Sponsored by the Theories of Evaluation TIG
 Chair - James Griffith, Claremont Graduate University
Experimental Evaluation: Dealing With Random Assignment of
Individuals Within Units
 Andrea Beesley and Sheila A Arens, Mid-continent
Research for Education and Learning
Evaluation Influence Within Population Health Partnerships: A
Conceptual Framework
 Sarah Appleton-Dyer, Janet Clinton, and Peter Carswell,
University of Auckland
Evaluation 2010: Saturday, November 13, 10:00 AM – 10:45 AM
Page 144
Notes:
Evaluation 2010: Saturday, November 13, 10:00 AM – 10:45 AM
Page 145
Summary of Sessions for Saturday, November 13, 10:55 AM to 12:25 PM
No Primary Sponsor
Session
Session Title
Room
782 Presidential Strand
Panel
Mixed Methods Contributions to Evaluation Quality
Lone Star A
783 AEA Conference Committee
Skill-building
Writing Effective Items for Survey Research and Evaluation Studies
Lone Star B
784 Collaborative, Participatory & Empowerment
Skill-building
Collaborative Evaluations
Lone Star C
785 Non-profit and Foundations Evaluation TIG
Demonstration
A Foundation-to-Foundation Partnership: What Went Right, What Took Time - A Look at the Robert Wood Johnson…
Lone Star D
786 Quantitative Methods: Theory and Design TIG
Demonstration
Using Rasch Measurement to Strengthen Evaluation Designs and Outcomes
Lone Star E
787 Cluster, Multi-site & Multi-level Evaluation TIG Panel
Extended Learning: A Conversation Among Evaluators of the National Science Foundation (NSF) Extension Services Projects
Lone Star F
788 Disabilities and Other Vulnerable Populations
Roundtable
Preparing Teacher Candidates for Parent Partnerships: An Evaluation of a Preservice Course in Teacher Education
Mission A
789 Evaluation Policy TIG
Multipaper
Cross-National Evaluation Policies: Where We've Been, Where We're Going, and What We Need for Quality Evaluation
Mission B
790 Systems in Evaluation TIG
MultiPaper
The Home Energy Audit: An Exercise in Complex Systems Thinking for Practitioners and Evaluators Alike
Bowie A
791 Indigenous Peoples in Evaluation TIG
Demonstration
The REWA System of Transformative Evaluation: Founded on Pono (Truth), Ahua (Beauty) and Tika (Justice) - Evaluating…
Bowie C
792 Teaching of Evaluation TIG
Roundtable
Rotation I: Who Do They Think We Are? Issues and Dilemmas Raised by Others' Perceptions of Evaluators and Evaluation
Rotation II: Resources to Guide Non-evaluators in the Design of Educational Program Evaluations
Goliad
793 Theories of Evaluation TIG
Roundtable
Rotation I: Evaluation in Late Victorian Literature
Rotation II: Epistemological Distinctions and Values in the Evaluation Process: A Reflective Analysis on the Quality…
San Jacinto
794 Evaluation Use TIG
Think Tank
Making Results Relevant: Designing Evaluations Stakeholders Will Value, Understand, and Use
Travis A
795 Integrating Technology Into Evaluation TIG
Demonstration
An Integrated Web-based Assessment, Planning, and Evaluation System for Strengthening Families Programs…
Travis B
796 Multiethnic Issues in Evaluation TIG
Demonstration
Construct Validity of Race and Its Impact on the Quality of Research and Evaluation
Travis C
797 Health Evaluation TIG
Multipaper
Strategies and Tools to Evaluate the Comprehensive Picture of Health Policy
Travis D
798 Human Services Evaluation TIG
Multipaper
Mixed Methods and Multiple Measures in Quality Human Services Evaluation: Lessons Learned
Independence
799 Quantitative Methods: Theory and Design TIG
Multipaper
Application of Propensity Score Analysis in Assessing Outcomes
Presidio A
800 Org Learning & Evaluation Capacity Bldg TIG
MultiPaper
A Radically Different Approach to Evaluator Competencies
Presidio B
801 Alcohol, Drug Abuse, and Mental Health TIG
Multipaper
Use of Administrative Data for Management and Policy Making
Presidio C
802 Pre-K - 12 Educational Evaluation TIG
Roundtable
Rotation I: Overcoming Data Quality Challenges to Evaluation of School-based Programs
Rotation II: Standardizing Literacy Data Analyses and Reporting Across Multiple Instruments and Grades
Bonham A
803 Non-profit and Foundations Evaluation TIG
Multipaper
Evaluating Family and Community Change
Bonham B
804 Pre-K - 12 Educational Evaluation TIG
Multipaper
Practical Issues in Educational Measurement and Assessment
Bonham C
Evaluation 2010: Saturday, November 13, 10:55 AM – 12:25 PM
Page 146
Summary of Sessions for Saturday, November 13, 10:55 AM to 12:25 PM
No Primary Sponsor
Session
Session Title
Room
805 Costs, Effectiveness, Benefits, and Economics Think Tank
Quality Evaluation: Avoiding Hypocrisy by Formative Evaluation of Evaluation's Outcomes, Processes, and Costs
Bonham D
807 Government Evaluation TIG
MultiPaper
Conceptualizing and Conducting Quality Peer Reviewed Portfolio Evaluations: Approaches & Lessons Learned From the CDC Texas A
808 Evaluation Managers and Supervisors TIG
Demonstration
Successfully Managing Evaluation Projects: Quality Solutions to Common Project Management Challenges
Texas B
809 Mixed Methods Evaluation TIG
Multipaper
Using Mixed Methods to Evaluate Program Implementation and Inter-agency Collaboration
Texas C
810 Research, Technology, and Development
MultiPaper
Evaluation of National Research and Development (R&D) Programs as a Tool for Increasing Efficiency of Public Finance
Texas D
811 Evaluation Use TIG
Multipaper
Evaluators Thinking Evaluatively About Use: Tips for the Trade
Texas E
812 Research on Evaluation
Multipaper
Research on Participatory Evaluation
Texas F
813 Extension Education Evaluation TIG
Skill-building
Evaluating Advocacy Efforts in Cooperative Extension and Other Outreach Organizations
Crockett A
814 Teaching of Evaluation TIG
MultiPaper
Experiencing Quality in Evaluation Training in Brazil and Ethiopia
Crockett B
815 International and Cross-cultural Evaluation TIG Think Tank
Quality and International Evaluation
Crockett C
816 Disaster & Emergency Management Evaluation Multipaper
Development and Selection of Frameworks and Constructs for Disaster Preparedness and Recovery Evaluation
Crockett D
817 Graduate Student and New Evaluator TIG
Panel
Reflections of Emerging Professionals: The Culturally Responsive Path Ahead
Seguin B
819 Health Evaluation TIG
Panel
Operational Research and Monitoring and Evaluation: Can We Forge a Partnership?
Republic B
820 Collaborative, Participatory & Empowerment
Multipaper
Empowerment Evaluations: Insights, Reflections, and Implications
Republic C
Evaluation 2010: Saturday, November 13, 10:55 AM – 12:25 PM
Page 147
Saturday, 10:55 am to 12:25 pm
782 - Mixed Methods Contributions to Evaluation
Quality
Panel to be held in Lone Star A
Sponsored by the Presidential Strand
 Chair - Donna Mertens, Gallaudet
University
 Discussant s - Melvin Mark, Pennsylvania
State University; and Kataraina Pipi, Independent Consultant
What is Quality Empirical Social Science From a Mixed
Methods Perspective?
 Abbas Tashakkori, University of North Texas
Bridging Quality in Mixed Methods Inquiry With Evaluation
Theory and Practice
Donna Mertens, Gallaudet University
How Does the Mix of Methods Enhance Evaluation Quality in
the Field?
 Jori Hall, University of Georgia; Jennifer Greene, University
of Illinois at Urbana-Champaign
783 - Writing Effective Items for Survey Research and
Evaluation Studies
Skill-building Workshop to be held in Lone Star B
Sponsored by the AEA Conference Committee
 Jason Siegel and Eusebio Alvaro, Claremont Graduate
University
784 - Collaborative Evaluations
Skill-building Workshop to be held in Lone Star C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Liliana Rodriguez-Campos, University of South Florida;
and Rigoberto Rincones-Gomez, Maryland Distribution Council
Inc
785 - A Foundation-to-Foundation Partnership: What
Went Right, What Took Time - A Look at the Robert
Wood Johnson Foundation and the Northwest Health
Foundation Partnership- Partners Investing in
Nursing‘s Future
Demonstration to be held in Lone Star D
Sponsored by the Non-profit and Foundations Evaluation TIG
 Ricardo Millett, Ricardo Millett and Associates; and
Chantell Johnson, TCC Group
786 - Using Rasch Measurement to Strengthen
Evaluation Designs and Outcomes
Demonstration to be held in Lone Star E
Sponsored by the Quantitative Methods: Theory and Design TIG
 Christine Fox and Svetlana Beltyukova, University of Toledo
787 - Extended Learning: A Conversation Among
Evaluators of the National Science Foundation (NSF)
Extension Services Projects
Panel to be held in Lone Star F
Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG
 Chair - Beverly Farr, MPR Associates Inc
Can We Really Do It All? Yes... Within Reason
 Elizabeth Bachrach, Goodman Research Group Inc
Use of Technology in Evaluation: How Does It Help and How
Does It Hinder?
 Vicky Ragan, Evaluation and Research Associates
Finding Common Ground: Is It possible?
 Beverly Farr, MPR Associates Inc
Strategies for Guiding and Tracking Sustainability: Will It Last?
 Donna Brock, Evaluation Consulting Services Inc
788 – Roundtable in Mission A
Sponsored by the Disabilities and Other Vulnerable
Populations and the Mixed Methods Evaluation TIGs
Preparing Teacher Candidates for Parent Partnerships: An
Evaluation of a Preservice Course in Teacher Education
 Michael Wischnowski, Marie Cianca, Susan Hildenbrand,
and Daniel Kelly, St John Fisher College
789 - Cross-National Evaluation Policies: Where
We've Been, Where We're Going, and What We Need
for Quality Evaluation
Multipaper to be held in Mission B
Sponsored by the Evaluation Policy TIG
 Chair - Marie Gaarder, International Initiative for Impact
Evaluation (3ie)
 Discussant - Jim Rugh, Independent Consultant
Strengthening Evaluation Policy in Saudi Arabia for Higher
Evaluation Quality
 Mohammed Alyami, Western Michigan University
Institutionalising Evaluation: By Decree or by Persuasion?
 Marie Gaarder, International Initiative for Impact
Evaluation (3ie); and Bertha Briceno, World Bank
Evaluation and the Shifting Meanings of Accountability in
Education in Five Nations
 Christina Segerholm, MidSweden University; and Jenny
Ozga, University of Edinburgh
Evaluation 2010: Saturday, November 13, 10:55 AM – 12:25 PM
Page 148
790 - The Home Energy Audit: An Exercise in Complex
Systems Thinking for Practitioners and Evaluators
Alike
MultiPaper to be held in Bowie A
Sponsored by the Systems in Evaluation and the Environmental
Program Evaluation TIGs
 Chair - Daniel Folkman, University of Wisconsin, Milwakee
A Small Contractor‘s Perspective: From Business Operations,
to Customer Education, to Changing Rules and Regulations in
the Home Improvement and Restoration Industry
 Juanita M Ellias, Rivercity Woodworking LLC
From Assessing Building Performance to Setting Standards
and Expectations for Professional Practice Among Home
Energy Auditors and Consultants
 Keith Williams, Building Services and Consultant LLC
An Emerging Model of Embedded Evaluation Practice in the
Home Energy Conservation Industry
 Daniel Folkman, University of Wisconsin, Milwakee
791 - The REWA System of Transformative
Evaluation: Founded on Pono (Truth), Ahua (Beauty)
and Tika (Justice) - Evaluating Health and Well-being
From Te Ao Maori/Indigenous World-view, Protocol,
and Practice
Demonstration to be held in Bowie C
Sponsored by the Indigenous Peoples in Evaluation TIG
 Tania Wolfgramm and Wikuki Kingi, Pou Kapua Consulting
792 – Roundtables in Goliad
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Teaching of Evaluation TIG
Rotation 1: Resources to Guide Non-evaluators in the Design
of Educational Program Evaluations
 Rick Axelson and Susan Lenoch, University of Iowa
Rotation 2: Who Do They Think We Are? Issues and Dilemmas
Raised by Others' Perceptions of Evaluators and Evaluation
 Loretta Kelley, Kelley, Petterson and Associates; and
Philip Henning, James Madison University
793 – Roundtables in San Jacinto
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Theories of Evaluation TIG and the Teaching
of Evaluation TIG
Rotation 1: Epistemological Distinctions and Values in the
Evaluation Process: A Reflective Analysis on the Quality
Standards of Truth, Beauty, and Justice Using Findings From an
Actual Evaluation Study
 Sarah Wilkey, Zarrina Azizova, Zhanna Shatrova, and Katye
Perry, Oklahoma State University
Rotation 2: Evaluation in Late Victorian Literature
 David D Williams, Brigham Young University
794 - Making Results Relevant: Designing
Evaluations Stakeholders Will Value, Understand,
and Use
Think Tank to be held in Travis A
Sponsored by the Evaluation Use TIG
 Presenter - Anita Drever, University of Wyoming
 Discussants - Paul St Roseman, DataUse Consulting
Group; and Javan Ridge, Colorado Springs School District 11
795 - An Integrated Web-based Assessment,
Planning, and Evaluation System for Strengthening
Families Programs Across the Nation
Demonstration to be held in Travis B
Sponsored by the Integrating Technology Into Evaluation TIG
 Lauren Pugh and Michael Bates, Mosaic Network Inc
796 - Construct Validity of Race and Its Impact on
the Quality of Research and Evaluation
Demonstration to be held in Travis C
Sponsored by the Multiethnic Issues in Evaluation TIG
 Kelly Robertson and Diane Rogers, Western Michigan
University
797 - Strategies and Tools to Evaluate the
Comprehensive Picture of Health Policy
Multipaper to be held in Travis D
Sponsored by the Health Evaluation TIG
 Chair - Jenica Huddleston, University of California, Berkeley
Issues in Evaluating Health Care Information Dissemination
Programs
 Boris Volkov, University of North Dakota
Assessing Health Policy Change Using an Online Survey
Instrument
 Annette Gardner and Claire Brindis, University of
California, San Francisco; Lori Nascimento, California
Endowment; and Sara Geierstanger, University of California,
San Francisco
Evaluating the Impact of the Louisiana Campaign for TobaccoFree Living: The Importance of Comprehensive Evaluation
Strategies
 Nikki Lawhorn, Lisanne Brown, and Jenna Klink, Louisiana
Public Health Institute
Evaluation 2010: Saturday, November 13, 10:55 AM – 12:25 PM
Page 149
Saturday, 10:55 am to 12:25 pm, continued
798 - Mixed Methods and Multiple Measures in
Quality Human Services Evaluation: Lessons Learned
Multipaper to be held in Independence
Sponsored by the Human Services Evaluation TIG
 Chair - Barry Cohen, Rainbow Research Inc
Evaluating a Child Welfare Demonstration Program: Evolution,
Considerations, and Lessons Learned
 Stella SiWan Zimmerman, Action Consulting and
Evaluation Team (ACET) Inc; Heather Scholz, Wayside Housr;
Kirsten L Rewey, Action Consulting and Evaluation Team (ACET)
Inc; and Ellie Skelton, The Wayside House Inc
A Multi-faceted Implementation Assessment: Comparing
Ratings From Observers, Supervisors, Staff, and Clients to
Examine Program Implementation
 Kristin Duppong Hurley and Nikki Wheaton, University of
Nebraska, Lincoln
Evaluating a Child Care Quality Rating and Improvement
System: Lessons Learned
 Michel Lahti, Allyson Dean, and Sarah Rawlings, University
of Southern Maine
Synthesis of a Multi-component Five-Year National Evaluation:
Results and Lessons Learned
 Allan Porowski, Aikaterini Passa, and Kelle Basta, ICF
International; and Susan Siegel, Communities In Schools
799 - Application of Propensity Score Analysis in
Assessing Outcomes
Multipaper to be held in Presidio A
Sponsored by the Quantitative Methods: Theory and Design TIG
 Chair - MH Clark, University of Central Florida
Using Propensity Scores with Small Samples
 William Holmes, University of Massachusetts, Boston; and
Lenore Olsen, Rhode Island College
The Utility of Propensity Score Matching in the Context of
Evaluation
 Corina Owens and Connie Walker-Egea, University of
South Florida
A Comparison of Genetic Matching and Propensity Score
Matching Methods for Covariate Adjustment in a Reading
Intervention Program Evaluation
 Ning Rui and Debra Coffey, Research for Better Schools
800 - A Radically Different Approach to Evaluator
Competencies
MultiPaper to be held in Presidio B
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG
 Chair - Jane Davidson, Real Evaluation Ltd
 Discussants - Michael Scriven, Claremont Graduate
University; and Rodney Hopson, Duquesne University
Privileging Culture and Cultural Competence in an Evaluator
Competency Framework
 Nan Wehipeihana, Research Evaluation Consultancy
Limited
Defining the ‗Good‘ Evaluator – What‘s in, What‘s out? A
Question of Whose Boundaries?
 Kate McKegg, Knowledge Institute Ltd
Using Evaluator Competencies in Practice: Evaluative Quality
Assurance in Tertiary Education in Aotearoa, New Zealand
 Syd King, New Zealand Qualifications Authority
801 - Use of Administrative Data for Management
and Policy Making
Multipaper to be held in Presidio C
Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG
 Chair - Stephen Magura, Western Michigan University
Workforce Challenges in Behavioral Healthcare: A Model
Approach to Gathering Systematic Information About Staffing
Problems Faced by State Agencies, Programs, and Staff
 John Hornik, Jenneth Carpenter, and Jeanine Hanna,
Advocates of Human Potential; and David Wright and Lorrie
Byrum, Oklahoma Department of Mental Health and
Substance Abuse Services
Community Data Collection Systems: Gaps and
Recommendations
 John Carnevale, Carnevale Associates LLC; and Beverlie
Fallik, United States Department of Health and Human
Services
802 – Roundtables in Bonham A
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Pre-K - 12 Educational Evaluation TIG
Rotation 1: Standardizing Literacy Data Analyses and
Reporting Across Multiple Instruments and Grades
 Ashley Kurth and Gretchen Biesecker, City Year Inc
Rotation 2: Overcoming Data Quality Challenges to Evaluation
of School-based Programs
 Lisa Garbrecht, Shanelle Boyle, Tronie Rifkin, and Mona
Desai, EVALCORP
Evaluation 2010: Saturday, November 13, 10:55 AM – 12:25 PM
Page 150
803 - Evaluating Family and Community Change
Multipaper to be held in Bonham B
Sponsored by the Non-profit and Foundations Evaluation TIG
 Chair - Joanne Carman, University of North Carolina at
Charlotte
Capturing Community-level Outcomes Through Responsive
Evaluation: An Example of a New York City Settlement House
 Elizabeth Coker, Lenox Hill Neighborhood House
Uniting for Community Change: Lessons from Charlotte, North
Carolina
 Joanne Carman, University of North Carolina at Charlotte
Getting to the Core: A Multi-site Mixed Methods Evaluation of
Neighbor-to-Neighbor Helping, Also Known as Neighboring
 Brandee Menoher, Points of Light Institute; and Colleen
Kassouf Mackey, Points of Light Institute
An Evaluation of the Whole Child Website: Lessons Learned
From a Low-Budget Community Focus Group
 Breanne Porter and Mercedes Nalls, Florida State University
804 - Practical Issues in Educational Measurement
and Assessment
Multipaper to be held in Bonham C
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Wendy DuBow, National Center for Women and
Information Technology
What Teachers Need in Terms of Results Versus What is
Commonly Reported: Some Standard Deviations?
 Guido Gatti and Katya Petrochenkov, Gatti Evaluation Inc
The Impact of Releasing Rubrics on Performance Assessment
Scores
 Ashlee Lewis, Min Zhu, and Xiaofang Zhang, University of
South Carolina
The Instructional Impact of North Dakota State Accountability
System: A Consequential Validity Study
 Xin Wang, Mid-continent Research for Education and
Learning
Defining Domains of Coaching Knowledge Using a Modified
Delphi Process
 John Sutton, RMC Research Corporation; and Beth
Burroughs and David Yopp, Montana State University
805 - Quality Evaluation: Avoiding Hypocrisy by
Formative Evaluation of Evaluation's Outcomes,
Processes, and Costs
Think Tank to be held in Bonham D
Sponsored by the Costs, Effectiveness, Benefits, and
Economics TIG
 Presenter - Sarah Hornack, American University
 Discussant - Brian Yates and Jose Hermida, American
University
807 - Conceptualizing and Conducting Quality Peer
Reviewed Portfolio Evaluations: Approaches and
Lessons Learned From the Centers for Disease
Control and Prevention (CDC)
MultiPaper to be held in Texas A
Sponsored by the Government Evaluation TIG
 Chair and Discussant - Sue Lin Yee, Centers for Disease
Control and Prevention
Maximizing Quality in a Portfolio Review of the National Center
for Injury Prevention and Control‘s (NCIPC) Core State Injury
Program
 Elyse Levine, Academy for Educational Development; Sue
Lin Yee, Centers for Disease Control and Prevention; Derek
Inokuchi, Academy for Educational Development; and Angela
Marr, Centers for Disease Control and Prevention
Getting the Most From Expert Reviews of Public Health
Programs: Barriers and Facilitators of Quality, Relevance, and
Utility
 Esther Sumartojo and Tom Bartenfeld, Centers for Disease
Control and Prevention
External Program Reviews in the Office of Public Health
Preparedness and Response at CDC
 Barbara Ellis, Centers for Disease Control and Prevention
808 - Successfully Managing Evaluation Projects:
Quality Solutions to Common Project
Management Challenges
Demonstration to be held in Texas B
Sponsored by the Evaluation Managers and Supervisors TIG
 Presenters - Kathy Brennan and Veena Pankaj, Innovation
Network
809 - Using Mixed Methods to Evaluate Program
Implementation and Inter-agency Collaboration
Multipaper to be held in Texas C
Sponsored by the Mixed Methods Evaluation TIG
 Chair - Sandra Bridwell, Cambridge College
 Discussant - Michele Tarsilla, Western Michigan University
Systems Approach and Mixed Methods in Evaluation Within a
Collaborative Context
 Jianglan White, Georgia Department of Community Health;
and Dafna Kanny, Centers for Disease Control and Prevention
Assessing Collaborative Functioning: Identification of Factors
Associated With Longevity and Perceived Effectiveness
 Ann Peisher, Virginia Dick, and Amy Laura Arnold,
University of Georgia; Robetta McKenzie and Katrina Aaron,
Augusta Partnership for Children Inc; and Don Bower,
University of Georgia
Evaluation 2010: Saturday, November 13, 10:55 AM – 12:25 PM
Page 151
Saturday, 10:55 am to 12:25 pm, continued
810 - Evaluation of National Research and
Development (R&D) Programs as a Tool for
Increasing Efficiency of Public Finance
MultiPaper to be held in Texas D
Sponsored by the Research, Technology, and Development
Evaluation TIG
 Chair - Seung Jun Yoo, Korea Institute of Science &
Technology Evaluation and Planning (KISTEP)
Trends in the Performance Evaluation System of the National
R&D Program in Korea
 Ho-Dong Lee, Rae-Young Kim, and Jae-Young Kim,
Ministry of Strategy and Finance
Ex-ante Evaluation of the Validity and Economic Impact of
Nanotechnology Public R&D Program in Korea
 Yun Jong Kim, Korea Institute of Science & Technology
Evaluation and Planning (KISTEP); Dae Hyun Jeong, Korea Zinc
Inc; and Jiho Hwang, Korea Institute of Science & Technology
Evaluation and Planning (KISTEP)
Evaluation of Effectiveness for the Public Environmental R&D
Program in Korea
 Heekweon Lee, Jungseok Hong, and Hyunjung Cho, Korea
Institute of Science & Technology Evaluation and Planning
(KISTEP); and Suho Bae, Sungkyunkwan University
Evaluation of Horizontal Public R&D Programs: A Case Study in
Korea
 Hwan Lee, Seung Jun Yoo, and Boojong Gill, Korea
Institute of Science & Technology Evaluation and Planning
(KISTEP)
811 - Evaluators Thinking Evaluatively About Use:
Tips for the Trade
Multipaper to be held in Texas E
Sponsored by the Evaluation Use TIG
 Chair - Helene Jennings, ICF Macro
Reframing the Goals of an Evaluation During Program
Dissolution: What Can Evaluation Offer?
 Christine Doe, Michelle Searle, and Lyn Shulha, Queen's
University at Kingston
Using Evaluation Data for Secondary Independent Research:
Lessons From Two Studies
 Kari Nelsestuen, Caitlin Scott, and Theresa Deussen,
Education Northwest
Evaluator Perceptions of Process Use
 Lennise Baptiste, Kent State University
Federal Mandates and Guidelines and How This Impacts
Program Evaluation
 Andrea Wood, Rashell Bowerman, Gary Miron, and
Patricia Moore, Western Michigan University
Emerging Concepts and Tools for Developing and Assessing
Evaluation Capacity of Educational Networks and Partnerships:
An Iterative Approach
 Ed McLain, University of Alaska, Anchorage; and Susan
Tucker, Evaluation & Development Associates
812 - Research on Participatory Evaluation
Multipaper to be held in Texas F
Sponsored by the Research on Evaluation TIG
Chair - Michael Szanyi, Claremont Graduate University
An Overview of the Empirical Studies of Stakeholder
Involvement in Program Evaluation
 Landry Fukunaga and Paul Brandon, University of Hawaii
An Investigation of the Relationship Between Participatory
Evaluation and Use of Evaluation in Three Multi-site
Evaluations
 Denise Roseland, University of Minnesota
Boldly Going Inward, Outward, and Forward: Studying (How to
Study) the Intersection of Theory and Practice in Evaluation
 Jeehae Ahn, University of Illinois at Urbana-Champaign
813 - Evaluating Advocacy Efforts in Cooperative
Extension and Other Outreach Organizations
Skill-building Workshop to be held in Crockett A
Sponsored by the Extension Education Evaluation TIG
 Allison Nichols, West Virginia University Extension; Teresa
McCoy, University of Maryland; and Florita Montgomery, West
Virginia University Extension
814 - Experiencing Quality in Evaluation Training in
Brazil and Ethiopia
MultiPaper to be held in Crockett B
Sponsored by the Teaching of Evaluation TIG
 Chair - Marly Cruz, National School of Public Health
(ENSP/Fiocruz)
Resistance and Adoption: Challenges to Change Public Health
Professionals in Evaluators in Situation
 Elizabeth Moreira dos Santos, Oswaldo Cruz Foundation
(Fiocruz); Marly Cruz, Pedro Paulo Chrispim, and Ana Reis,
National School of Public Health (ENSP/Fiocruz); and Ana
Roberta Pascom, National Aids Program, Brazil
Contributing to Increase Evaluative Practices in Public Health
Institution in Brazil
 Eronildo Felisberto, Municipal Institute for Research and
Planning; and Isabella Samico and Luciana Santos Dubeux,
Instituto de Medicina
Building Health Evaluation Capacity in Africa: A University
Based Training Program in Ethiopia
 Wuleta Lemma, Tulane University; Yibeltal Kiflie and
Woldemichael Kiflie, Jimma University; and Elizabeth Moreira
dos Santos, Oswaldo Cruz Foundation (Fiocruz)
Evaluation 2010: Saturday, November 13, 10:55 AM – 12:25 PM
Page 152
815 - Quality and International Evaluation
Think Tank to be held in Crockett C
Sponsored by the International & Cross-cultural Evaluation TIG
 Presenters - Ross Conner, University of California, Irvine;
and Alexey Kuzmin, Process Consulting Company
 Discussansts - Michael Bamberger, Independent
Consultant; Tessie Catsambas, EnCompass LLC; Thomaz
Chianca, COMEA Evaluation Ltd; and J Bradley Cousins,
University of Ottawa
816 - Development and Selection of Frameworks and
Constructs for Disaster Preparedness and Recovery
Evaluation
Multipaper to be held in Crockett D
Sponsored by the Disaster and Emergency Management
Evaluation TIG
 Chair - Scott Aminov, Food For The Hungry
 Discussant - Patricia Bolton, Battelle Memorial Institute
Homeland Security: Evaluating With Management System
Standards
 Sharon Caudle, Texas A&M University
Tribal Disaster Preparedness Assessment: Assessing the
Competency, Capacity, and Capability Needs of American
Indian Nations
 Lisle Hites, University of Alabama at Birmingham; and
Jessica Wakelee, University of Arizona
817 - Reflections of Emerging Professionals: The
Culturally Responsive Path Ahead
Panel to be held in Seguin B
Sponsored by the Graduate Student and New Evaluator TIG
 Chair - Jill Jim, Independent Consultant
 Discussant - Pauline Brooks, Independent Consultant
Seeing the Iceberg Under the Surface: Reflections on
Developing as a Culturally Responsive Evaluator
 Katrina Ellis, University of Michigan
Cultural Competence in Philanthropy: Reflections From an
Emerging Professional
 Summer Jackson, Independent Consultant
Perceptions and Education for Researchers to Work With
American Indian Groups to Improve Quality
 Jill Jim, Independent Consultant
I Have Needs Too: Culturally Responsive Evaluation Meeting
the Needs of Nonprofits and Evaluators
 Domingo Moronta, St Barnabas Hospital
Operational Research and HIV Prevention
 Jeffrey Herbst, Centers for Disease Control and Prevention
Program Evaluation and HIV Prevention
 Dale Stratford, Centers for Disease Control and Prevention
Program Evaluation and Operational Research: Is There a
Difference - Does It Matter?
 Marlene Glassman, Centers for Disease Control and
Prevention
820 - Empowerment Evaluations: Insights,
Reflections, and Implications
Multipaper to be held in Republic C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Chair - Candace Sibley, University of South Florida
Engaging Youth in Program Evaluation: An Exploration of
Current Practices
 Kristi Lekies, The Ohio State University
Forecast: Applications, Innovations, and Contributions to
Formative Evaluation Theory and Practice
 Abraham Wandersman, Jason Katz, and Sarah Griffin,
University of South Carolina; Robert Goodman, Indiana
University; and Dawn Wilson, University of South Carolina
The Need for Social Theories of Power in Empowerment
Evaluation
 Thomas Archibald, Cornell University
Where is the Power in Empowerment Evaluation (EE): Locating
Power and Understanding its Role Within EE Process
 Divya Bheda, University of Oregon
Saturday, 12:35 pm to 1:30 pm
821 - Feminist Issues in Evaluation TIG Business
Meeting
Business Meeting to be held in Goliad
Sponsored by the Feminist Issues in Evaluation TIG
TIG Leaders - Kathryn A Bowen, Centerstone Research
Institute
Michael Bamberger, Independent Consultant
Linda Thurston, National Science Foundation
819 - Operational Research and Monitoring and
Evaluation: Can We Forge a Partnership?
Panel to be held in Republic B
Sponsored by the Health Evaluation TIG
 Chair - Thomas Chapel, Centers for Disease Control and
Prevention
Evaluation 2010: Saturday, November 13, 10:55 AM – 12:25 PM, 12:35 PM – 1:30 PM
Page 153
Summary of Sessions for Saturday, November 13, 1:40 PM to 2:25 PM
No Primary Sponsor
Session
Session Title
Room
822 Presidential Strand
Expert Lecture
A Conversation With Ernest House
Lone Star A
823 Program Theory and Theory-driven Evaluation
Panel
Culturally Responsive Theory-driven Evaluation: Understanding & Accurately Reflecting Cultural Contexts in Program Eval
Lone Star B
824 Environmental Program Evaluation TIG
Multipaper
Estimating Climate Change and Its Use in Evaluation
Lone Star C
825 Non-profit and Foundations Evaluation TIG
Expert Lecture
Evaluations Done Right: Paving the Way for Closing a Program
Lone Star D
826 Quantitative Methods: Theory and Design TIG
Multipaper
A Closer Look at Non-Equivalent Designs in Evaluation
Lone Star E
827 Cluster, Multi-site & Multi-level Evaluation TIG Multipaper
Linking With Outcomes
Lone Star F
828 Crime and Justice TIG
Multipaper
Dealing With Evaluation Challenges and Complexities in Policing and Prison Environments
Mission A
829 AEA Conference Committee
Multipaper
Improving Survey Quality
Mission B
830 Systems in Evaluation TIG
Panel
BUILD-ing an Institute for Child Success: The Statewide Systems Design for the South Carolina Institute for Child Success
Bowie A
831 Advocacy and Policy Change TIG
Multipaper
The Role of Evaluation in Informing Local and State Policy Makers
Bowie C
832 Qualitative Methods TIG
Roundtable
Use of Implementation Rubrics as Indicators of Evaluation Quality
Goliad
833 Assessment in Higher Education TIG
Roundtable
Toward Improving the Evaluation Practice of Financial Education Programs: Key Issues and the Role of Formative Evaluation
San Jacinto
834 Assessment in Higher Education TIG
Demonstration
Thinking About Thinking: Assessing Critical Thinking Instruction in Higher Education
Travis A
835 Integrating Technology Into Evaluation TIG
Skill-building
Data Management: How Not to Lose Face
Travis B
836 Org Learning & Evaluation Capacity Bldg TIG
Panel
Quick and Quality Level Three Evaluations for Corporate Staff Learning
Travis C
837 Internal Evaluation TIG
Multipaper
Internal Evaluators: Contextual Considerations and Roles
Travis D
838 Quantitative Methods: Theory and Design TIG
Demonstration
Replicating Experimental Impact Estimates Using a Regression Discontinuity Design
Independence
839 Independent Consulting TIG
Multipaper
Overcoming the Limitations of the Educational Context to Increase Rigor
Presidio A
840 Org Learning & Evaluation Capacity Bldg TIG
Demonstration
Using Logic Models to Build Evaluation Capacity at the Community Level: Enhancing Program Effectiveness by Building…
Presidio B
841 Alcohol, Drug Abuse, and Mental Health TIG
Multipaper
Evaluating Mental Health Peer Support and Peer Specialist Programs
Presidio C
842 Collaborative, Participatory & Empowerment
Roundtable
Negotiating Multiple Challenges While Maintaining Quality: Lessons From Urban:Rural Alaska
Bonham A
843 College Access Programs TIG
Multipaper
Evaluation of Underrepresented Student College and Career Choice Programs
Bonham B
844 Pre-K - 12 Educational Evaluation TIG
Panel
Fidelity Instruments and School Burden
Bonham C
845 Pre-K - 12 Educational Evaluation TIG
Multipaper
Assessing the Use of Test Score Data to Inform Decisions About Student Achievement
Bonham D
846 Environmental Program Evaluation TIG
Multipaper
Challenges and Recommendations From Evaluating Autobody Shop Environmental Compliance Programs
Bonham E
Evaluation 2010: Saturday, November 13, 1:40 PM – 2:25 PM
Page 154
Summary of Sessions for Saturday, November 13, 1:40 PM to 2:25 PM, Continued
No Primary Sponsor
Session
Session Title
Room
847 Government Evaluation TIG
Think Tank
The Use of Program Progress Reports in Federal Government Program Evaluations
Texas A
848 Assessment in Higher Education TIG
Multipaper
Evaluation in Community Colleges
Texas B
849 Advocacy and Policy Change TIG
Expert Lecture
Establishing a Monitoring, Evaluation and Learning (MEL) System for Policy Reform: Lessons From Oxfam America‘s…
Texas C
850 Research, Technology, and Development
Multipaper
Informing Portfolio Management Using Tracking Systems and Bibliometrics
Texas D
851 Evaluation Use TIG
MultiPaper
Deeper Implementation of the Student Success Learning to Eighteen Strategy Through Developmental Evaluation
Texas E
852 Research on Evaluation TIG
Multipaper
Research on Evaluator Competencies
Texas F
853 Extension Education Evaluation TIG
MultiPaper
Using Observational Assessments to Measure and Improve Youth Program Quality
Crockett A
854 Business and Industry TIG
Expert Lecture
The Thinking Corporation
Crockett B
855 Social Network Analysis TIG
Expert Lecture
Reading Sociograms
Crockett C
856 Government Evaluation TIG
Multipaper
Evaluating Government-Sponsored Education Programs
Crockett D
857 Needs Assessment TIG
Multipaper
Designing Surveys for Use in Needs Assessments
Seguin B
858 International and Cross-cultural Evaluation TIG MultiPaper
Evaluating Peace Building and Conflict Prevention in Fragile States
Republic A
859 Health Evaluation TIG
Multipaper
Successes and Lessons Learned From Evaluations of Long-Term HIV/AIDS Programs
Republic B
860 Theories of Evaluation TIG
MultiPaper
Let Quality Guide Evaluation Quality: Recent Trends Implemented in the Middle East
Republic C
Evaluation 2010: Saturday, November 13, 1:40 PM – 2:25 PM
Page 155
Saturday, 1:40 pm to 2:25 pm
822 - A Conversation With Ernest House
Expert Lecture to be held in Lone Star A
Sponsored by the Presidential Strand
 Chair - Leslie Cooksy, University
of Delaware
 Presenter - Ernest House, University
of Colorado
823 - Culturally Responsive Theory-driven
Evaluation: Understanding and Accurately Reflecting
Cultural Contexts in Program Evaluation
Panel to be held in Lone Star B
Sponsored by the Program Theory and Theory-driven
Evaluation TIG
 Chair - Stewart Donaldson, Claremont Graduate University
 Discussant - Stafford Hood, University of Illinois at
Urbana-Champaign; and Pauline Brooks, Independent
Consultant
Toward a Culturally Responsive Theory-driven Evaluation
Science
 Stewart Donaldson, Claremont Graduate University
Cultural Responsiveness in Theory-driven Evaluation:
Increasing Accuracy in Theories of Change, Questions, and
Methods in Community-based Settings
 Katrina Bledsoe, Walter R McDonald and Associates Inc
824 – Estimating Climate Change and Its Use in
Evaluation
Demonstration to be held in Lone Star C
Sponsored by the Environmental Program Evaluation TIG
 Mende Davis and Owen Davis, University of Arizona
825 - Evaluations Done Right: Paving the Way for
Closing a Program
Expert Lecture to be held in Lone Star D
Sponsored by the Non-profit and Foundations Evaluation TIG
 Lorna Escoffery, Escoffery Consulting Collaborative Inc
826 - A Closer Look at Non-Equivalent Designs in
Evaluation
Multipaper to be held in Lone Star E
Sponsored by the Quantitative Methods: Theory and Design TIG
 Chair - George Julnes, University of Baltimore
A New Strategy for Eliminating Selection Bias in Nonexperimental Evaluations
 Laura Peck, Arizona State University; and Furio Camillo
and Ida D‘Attoma, University of Bologna
The Truncation-by-Death Problem: What To Do in an
Experimental Evaluation When the Outcome is Not Always
Defined
 Sheena McConnell, Mathematica Policy Research;
Elizabeth Stuart, Johns Hopkins University; and Barbara
Devaney, Mathematica Policy Research
827 - Linking With Outcomes
Multipaper to be held in Lone Star F
Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG
 Chair - Yu Ping, Battelle Memorial Institute
Using Large Scale Data Management Systems in the
Evaluation of Multi-site Family Support Programs
 Pam Van Dyk, Evaluation Resources LLC; Bertha Gorham,
Gorham Consulting; Linda Blanton, Cumberland County
Partnership for Children; and Pat Hansen, The North Carolina
Partnership for Children
Assessing the Strength of Community Health Programming: A
New Tool for Evaluators
 Amy A Sorg, Sarah C Shelton, Stephanie Herbers, Douglas
Luke, and Bobbi Carothers, Washington University in St Louis
828 - Dealing With Evaluation Challenges and
Complexities in Policing and Prison Environments
Multipaper to be held in Mission A
Sponsored by the Crime and Justice TIG
 Chair - Roger Przybylski, RKC Group
How to Measure Police Performance: Handling of
Methodological Challenges in a Complex Police Environment
 Morten Eikenes, Office of the Auditor General of Norway
Getting Evaluation Findings Out of Prison: The Challenges of
Doing Evaluation Work in a Total Institution
 Eric Graig, Usable Knowledge LLC
829 - Improving Survey Quality
Multipaper to be held in Mission B
Sponsored by the AEA Conference Committee
 Chair - Katherine Shaw, Westwood College
Strategies for High Response Rates Among Hard-to-Reach
Respondents: A Case Study From the Communities
Empowering Youth National Evaluation
 Amy Minzner, Lindsay Fox and Christopher Mulvey, Abt
Associates Inc
Organizational Survey of Workplace Climate: Differences in
Representation Across Response Modes
 David Mohr, Katerine Osatuke, Scott C Moore, Boris
Yanovsky, and Thomas Brassell, United States Department of
Veterans Affairs; and Mark Nagy, Xavier University
Evaluation 2010: Saturday, November 13, 1:40 PM – 2:25 PM
Page 156
830 - BUILD-ing an Institute for Child Success: The
Statewide Systems Design for the South Carolina
Institute for Child Success
Panel to be held in Bowie A
Sponsored by the Systems in Evaluation TIG and the Human
Services Evaluation TIG
 Chair - Aimee Sickels, University of South Carolina
 Discussant - Julia Coffman, Center for Evaluation
Innovation
BUILD-ing The South Carolina Institute for Child Success
 Susan Shi, South Carolina Institute for Child Success;
Laurie Rovin, United Way Of Greenville County; Desmond Kelly
and Linda Brees, Greenville Hospital System; and Dennis
Poole, University of South Carolina
Looking Back, Thinking Forward: An Historical Analysis of a
Child Wellness Initiative Via the BUILD Model
 Carl Maas and Leigh Hewlett, University of South Carolina
831 - The Role of Evaluation in Informing Local and
State Policy Makers
Multipaper to be held in Bowie C
Sponsored by the Advocacy and Policy Change TIG
 Chair - Jared Raynor, TCC Group
Must Policy-Makers Choose Between Putting Out Fires and
Making Good Policy? Evaluator Observations From "The Belly
of the Beast", also known as The Chicago Political Machine
 Amarachuku Enyia, University of Illinois at UrbanaChampaign
Evidence of Impact: Informing Legislators to Improve Decisionmaking
 Sarah Bradford, Valerie York, Jan Middendorf, and Janice
Cole, Kansas State University
832 – Roundtable in Goliad
Sponsored by the Qualitative Methods TIG
Use of Implementation Rubrics as Indicators of Evaluation
Quality
 Elise Arruda Laorenza, Stephanie Feger, and Joye Whitney,
Brown University
833 – Roundtable in San Jacinto
Sponsored by the Assessment in Higher Education TIG
Toward Improving the Evaluation Practice of Financial
Education Programs: Key Issues and the Role of Formative
Evaluation
 Nicole Jackson, University of California, Berkeley
834 - Thinking About Thinking: Assessing Critical
Thinking Instruction in Higher Education
Demonstration to be held in Travis A
Sponsored by the Assessment in Higher Education TIG
 Linda Lynch, United States Army
835 - Data Management: How Not to Lose Face
Skill-building Workshop to be held in Travis B
Sponsored by the Integrating Technology Into Evaluation TIG
 Julien Kouame, Western Michigan University
836 - Quick and Quality Level Three Evaluations for
Corporate Staff Learning
Panel to be held in Travis C
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG
Chair - Jaime Quizon, World Bank
A Rigorous Evaluation of a Team Leadership Training Program
in a Corporate Environment
 Jaime Quizon, World Bank
A Quick and Quality Level 3 Evaluation of the Language and
Culture Program in a Corporate Environment
 Valya Nikolova, World Bank
837 - Internal Evaluators: Contextual Considerations
and Roles
Multipaper to be held in Travis D
Sponsored by the Internal Evaluation TIG
Chair - Magdalena Rood, Third Coast R&D Inc
Discussant - Joelle Greene, National Community Renaissance
Making Sense of the Contemporary Roles of Internal
Evaluators
 Boris Volkov, University of North Dakota
Program Manager as Internal Evaluator: Challenges and
Lessons Learned
 Anthony Kim, University of California, Berkeley
838 - Replicating Experimental Impact Estimates
Using a Regression Discontinuity Design
Demonstration to be held in Independence
Sponsored by the Quantitative Methods: Theory and Design TIG
 Chair - Karen Larwin, Youngstown State University
 Presenters - Jillian Berk and Philip Gleason, and Alexandra
Resch, Mathematica Policy Research
839 - Overcoming the Limitations of the Educational
Context to Increase Rigor
Multipaper to be held in Presidio A
Sponsored by the Independent Consulting TIG
 Chair - Kathleen Haynie, Haynie Research and Evaluation
Using an Interrupted Time Series Design to Evaluate the
Impact of a Professional Development Program for Teachers
 Frederic Glantz, Kokopelli Associates LLC
Collaborating With Clients to Develop Psychometric Parallel
Teacher and Student Evaluation
 Kathryn Race, Race & Associates Ltd
Evaluation 2010: Saturday, November 13, 1:40 PM – 2:25 PM
Page 157
Saturday, 1:40 pm to 2:25 pm, continued
840 - Using Logic Models to Build Evaluation
Capacity at the Community Level: Enhancing
Program Effectiveness by Building Evaluation Skills
Among Community Coalitions
844 - Fidelity Instruments and School Burden
Demonstration to be held in Presidio B
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG
 Tiffany Comer Cook and Laura Feldman, University of
Wyoming
Panel to be held in Bonham C
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - David Merves, Evergreen Educational
Consulting LLC
Positive Behavior Intervention Support Model Overview and
Instrumentation
 Patricia Mueller, Evergreen Educational Consulting LLC
A Survey of Positive Behavior Intervention Support Schools:
Using Fidelity Measures to Inform Decisions
 Brent Garrett, Pacific Institute for Research and
Evaluation (PIRE)
841 - Evaluating Mental Health Peer Support and
Peer Specialist Programs
845 - Assessing the Use of Test Score Data to Inform
Decisions About Student Achievement
Multipaper to be held in Presidio C
Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG
 Chair - Gitanjali Shrestha, Washington State University
Evaluation of Peer Support Programs: Implications for Utility
and Accuracy
 Glenn Landers and Mei Zhou, Georgia State University
Mixed Methods Evaluation of the Massachusetts Peer
Specialist Training and Certification Program
 Heather Strother, Linda Cabral, Kathy Muhr, Laura Sefton,
and Christine Clements, University of Massachusetts
842 – Roundtable in Bonham A
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
Negotiating Multiple Challenges While Maintaining Quality:
Lessons From Urban:Rural Alaska
 Rosyland Frazier and Alexandra Hill, University of Alaska,
Anchorage
843 - Evaluation of Underrepresented Student
College and Career Choice Programs
Multipaper to be held in Bonham B
Sponsored by the College Access Programs TIG
 Chair - Kurt Burkum, ACT
Evaluation Strategies for Educational Career Pathway
Programs: Targeting Underrepresented High-Performing Youth
 Sandra Eames and Fred Estrello, St Edward's University
Evaluation of Summer Enrichment Programs as a Gateway for
Low-Income Students to Experience and Choose College
 Mehmet Öztürk, Brian Garbarini, and Kerry Lawton,
Arizona State University
Multipaper to be held in Bonham D
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Tara Pearsall, Savannah College of Art and Design
 Discussant - Susan Henderson, WestEd
Data Mining Electronically Linked Grade Three Standardized
Assessment Scores From Kindergarten Assessments to Identify
Performance Patterns
 Deborah Carran, Jacqueline Nunn, and Tamara Otto, Johns
Hopkins university
Using Student Test Scores to Evaluate Performance
 Steven Glazerman, and Liz Potamites, Mathematica Policy
Research
846 - Challenges and Recommendations From
Evaluating Autobody Shop Environmental
Compliance Programs
Multipaper to be held in Bonham E
Sponsored by the Environmental Program Evaluation and the
Business and Industry TIGs
 Chair - Dale Pahl, United States Environmental Protection
Agency
Use of Mixed Methods to Evaluate Three States' Environmental
Results Programs (ERPs)
 John Heffelfinger and Scott Bowles, United States
Environmental Protection Agency
The Statistically Valid Pilot: Taking Advantage of Unique
Opportunities to Design and Implement Rigorous Program
Evaluations
 Tracy Dyke Redmond, Industrial Economics Inc; and Terell
Lasane, United States Environmental Protection Agency
847 - The Use of Program Progress Reports in
Federal Government Program Evaluations
Think Tank to be held in Texas A
Sponsored by the Government Evaluation TIG
 Rose Ann Renteria, Academy for Educational Development
Evaluation 2010: Saturday, November 13, 1:40 PM – 2:25 PM
Page 158
848 - Evaluation in Community Colleges
Multipaper to be held in Texas B
Sponsored by the Assessment in Higher Education TIG
 Chair - William Rickards, Alverno College
 Discussant - George Reinhart, University of Maryland
Perspectives From the Field: Evaluation Approach of and
Lessons Learned From an Evaluation of a Community College
Learning Community
 Charyl Staci Yarbrough and Bill Mabe, Rutgers University
Institutional and Programmatic Self-Evaluation in Higher
Education Development: Telling Their Own Stories in a
Consortium of Two-Year Institutions
 William Rickards, Alverno College
849 - Establishing a Monitoring, Evaluation and
Learning (MEL) System for Policy Reform: Lessons
From Oxfam America‘s Advocacy on More Country
Ownership of United States Foreign Aid
Expert Lecture to be held in Texas C
Sponsored by the Advocacy and Policy Change TIG
 Omar Ortez, Oxfam America
850 - Informing Portfolio Management Using
Tracking Systems and Bibliometrics
Multipaper to be held in Texas D
Sponsored by the Research, Technology, and Development
Evaluation TIG
 Chair - Juan Rogers, School of Public Policy Georgia
Institute of Technology
The Impact of the United States-China collaboration on
China's Research Performance: Evidence From
Nanotechnology Publication
 Li Tang, Georgia Institute of Technology
The Benefits and Challenges of Participatory Tracking Systems
for Monitoring Institutional Change
 Marc Brodersen, Kathryn Nearing, Susan Connors, and
Bonnie Walters, University of Colorado, Denver
851 - Deeper Implementation of the Student
Success Learning to Eighteen Strategy Through
Developmental Evaluation
MultiPaper to be held in Texas E
Sponsored by the Evaluation Use, the Organizational Learning
and Evaluation Capacity Building, and the Pre-K - 12
Educational Evaluation TIGs
 Chair - Michael Quinn Patton, Utilization-focused
Evaluation
The Use of Student Success Indicators in the Student Success
Learning to 18 Strategy: The Ontario Experience
 David Euale, Ontario Ministry of Education
Utilization of Developmental Evaluation to Inform the Student
Success School Support Initiative
 Keiko Kuji-Shikatani, Ontario Ministry of Education
852 - Research on Evaluator Competencies
Multipaper to be held in Texas F
Sponsored by the Research on Evaluation TIG
 Chair and Discussant - John LaVelle, Claremont Graduate
University
The Search for Evaluator Competency Inventories
 Jeanette Gurrola, Claremont Graduate University
Constructing a Measure for Evaluator Competencies:
Exploratory and Confirmatory Factor Analyses
 Jie Zhang, Syracuse University
853 - Using Observational Assessments to Measure
and Improve Youth Program Quality
MultiPaper to be held in Crockett A
Sponsored by the Extension Education Evaluation TIG
 Chair - Kate Walker, University of Minnesota
Matching Method to Purpose: Using Standardized
Observational Assessment to Enhance Point of Service Quality
 Tom Devaney, Weikart Center for Youth Program Quality
Using Youth and Adult Volunteer Assessors to Take Quality
Improvement to Scale
 Kate Walker and Deborah Moore, University of Minnesota
854 - The Thinking Corporation
Expert Lecture to be held in Crockett B
Sponsored by the Business and Industry TIG
 David Frood, Independent Consultant
855 - Reading Sociograms
Expert Lecture to be held in Crockett C
Sponsored by the Social Network Analysis TIG
 Maryann Durland, Durland Consulting
856 - Evaluating Government-Sponsored Education
Programs
Multipaper to be held in Crockett D
Sponsored by the Government Evaluation TIG
 Chair - Nicole Vicinanza, JBS International Inc
Improving Outcomes in Learning at the Defense Language
Institute: How Program Evaluation is
Contributing to the Increased Language Proficiency of Military
Linguists
 Melody Wall, Defense Language Institute
The National Aeronautics and Space Administration's (NASA)
Informal Education Program Evaluation:
The Role of Context in Evaluation
 Alyssa Rulf Fountain and Hilary Rhodes, Abt Associates
Inc; and Abigail Jurist Levy, Education Development Center
Evaluation 2010: Saturday, November 13, 1:40 PM – 2:25 PM
Page 159
Saturday, 1:40 pm to 2:25 pm, continued
857 - Designing Surveys for Use in Needs
Assessments
Multipaper to be held in Seguin B
Sponsored by the Needs Assessment TIG
 Chair - Lora Warner, University of Wisconsin, Green Bay
 Discussant - Ann Del Vecchio, Alpha Assessment
Associates
The Effects of Scale Forms on Perceived Needs: An Example
From a Study of Identifying Essential Competencies for
Program Evaluators
 Yi-Fang Lee, National Chi Nan University; and James
Altschuld, The Ohio State University
Using Online Surveys to Assess Information Needs of
Healthcare Professionals in Low Resource Settings: How is
Data Quality Ensured?
 Saori Ohkubo and Tara Sullivan, Johns Hopkins University
Essential Competency Needs for Program Evaluators in Taiwan
 Yi-Fang Lee, National Chi Nan University; James Altschuld,
The Ohio State University; and Lung-Sheng Steven Lee,
National United University
860 - Let Quality Guide Evaluation Quality: Recent
Trends Implemented in the Middle East
MultiPaper to be held in Republic C
Sponsored by the Theories of Evaluation TIG and the
Assessment in Higher Education TIG
 Chair - Eqbal Darandari, National Commission on
Academic Assessment and Accreditation
 Discussant - Tahira Hoke, Prince Sultan University
An Eclectic Approach to Evaluation for Higher Education
Institutions: Lessons Learned in Saudi Arabia
 Eqbal Darandari, National Commission on Academic
Assessment and Accreditation; and Tahira Hoke, Prince Sultan
University
An Empirical Approach to Evaluation for Higher Education
Institutions: Opportunities in Saudi Arabia
 Tahira Hoke, Prince Sultan University; and Eqbal
Darandari, National Commission on Academic Assessment
and Accreditation
858 - Evaluating Peace Building and Conflict
Prevention in Fragile States
MultiPaper to be held in Republic A
Sponsored by the International & Cross-cultural Evaluation TIG
 Chair - Krishna Kumar, United States Department of State
Building the Architecture for Assessing the Performance of
Peace Building
 Tjip Walker, United States Agency for International
Development
Lessons From Evaluations of Conflict Prevention and
Peacebuilding Programs in Fragile States
 Asbjorn Eidhammer, Noweigian Agency for International
Cooperation
859 - Successess and Lessons Learned From
Evaluations of Long-Term HIV/AIDS Programs
Multipaper to be held in Republic B
Sponsored by the Health Evaluation TIG
 Chair - Miles McNall, Michigan State University
Using Scorecards to Increase Compliance Among Medical
Care Providers Working in AIDS Care
 Jennifer Catrambone, Ruth M Rothstein CORE Center
Evaluating the Value of Capacity Building in Enhancing Aid
Effectiveness; Key Findings and Lessons From the Largest
President‘s Emergency Plan for AIDS Relief (PEPFAR) Grants
Management Program in Africa
 Rita Sonko-Najjemba and Lynn McCoy, Pact Inc
Evaluation 2010: Saturday, November 13, 1:40 PM – 2:25 PM
Page 160
Notes:
Evaluation 2010: Saturday, November 13, 1:40 PM – 2:25 PM
Page 161
Summary of Sessions for Saturday, November 13, 2:50 PM to 4:20 PM
No Primary Sponsor
Session
Session Title
Room
862 Presidential Strand
Panel
Tools for Improving the Quality of Evaluations: Four Examples From the Field
Lone Star A
863 Systems in Evaluation TIG
Think Tank
Integrating Evaluation Into Everyday Organizational Practice: A Complex Systems Perspective
Lone Star B
864 Collaborative, Participatory & Empowerment
Panel
Advances in Stakeholder Consultation for Evaluation Quality
Lone Star C
866 Quantitative Methods: Theory and Design TIG
Demonstration
What Am I Supposed to Do With Three-Way Crosstabs? An Introduction to Log Linear Models
Lone Star E
867 Cluster, Multi-site & Multi-level Evaluation TIG Panel
Meeting Needs of Multiple Stakeholders in a High-Scrutiny Multi-site Evaluation: Evaluation of the Communities Putting…
Lone Star F
868 Lesbian, Gay, Bisexual, Transgender Issues TIG Panel
Building Evaluation Capacity in Nonprofit Organizations Serving Lesbian, Gay, Bisexual and Transgender (LGBT) and HIV+…
Mission A
869 Disabilities and Other Vulnerable Populations
MultiPaper
Evaluating Special Education Personnel Development Initiatives in Three Predominately Rural States: Emphasis on Fidelity… Mission B
870 Independent Consulting TIG
MultiPaper
Ensuring Quality in Our Work: Techniques Used by Independent Consultants
Bowie A
872 Graduate Student and New Evaluator TIG
Roundtable
Rotation I: The Mentor/Mentee Relationship: Perspectives and Suggestions for Maintaining Successful Relationships
Rotation II: Evaluating a Rite of Passage Program as a Vehicle for Systemic Change in At-risk Female Youths Attitudes…
Goliad
873 Extension Education Evaluation TIG
Roundtable
Rotation I: The Unfocused Focus Group: Evaluation Benefit or Bane?
Rotation II: eXtension Evaluation Community of Practice (CoP) Grows Up
San Jacinto
874 Assessment in Higher Education TIG
Multipaper
The Importance of Critical Thinking in Assessment in Higher Education
Travis A
875 Collaborative, Participatory & Empowerment
Think Tank
Positionality Matters: Understanding Culture and Context From the Perspective of Key Stakeholders
Travis B
876 Multiethnic Issues in Evaluation TIG
MultiPaper
Practicing Culturally Responsive Evaluation: Graduate Education Diversity Internship (GEDI) Program Intern Reflections…
Travis C
877 Evaluating the Arts and Culture TIG
Multipaper
Translating Visitors' Experiences Through Evaluation
Travis D
878 Human Services Evaluation TIG
Panel
Community-Derived Research Partnerships: Working Together to Improve Human Services
Independence
879 Distance Ed. & Other Educational Technologies Multipaper
Online Learning in Adult and Postsecondary Education: Theory and Practice
Presidio A
880 Org Learning & Evaluation Capacity Bldg TIG
Multipaper
Increasing Evaluation Capacity Through Different Levels of Training and Support
Presidio B
881 Alcohol, Drug Abuse, and Mental Health TIG
MultiPaper
Evaluating a National Medicaid Children's Mental Health Demonstration Grant Program
Presidio C
882 Pre-K - 12 Educational Evaluation TIG
Roundtable
Adaptations to Evaluation Design: Two Examples of Ensuring Quality in Practice
Bonham A
883 Non-profit and Foundations Evaluation TIG
Demonstration
2010 Report: State of Evaluation Practice and Capacity in the Nonprofit Sector
Bonham B
884 Pre-K - 12 Educational Evaluation TIG
Multipaper
Evaluating the State of Charter Schools and Public Schools of Choice
Bonham C
885 Costs, Effectiveness, Benefits, and Economics Multipaper
Case Studies and Cost Studies
Bonham D
886 Research, Technology, and Development
Improving Proposals and Programs by Improving Peer and Stakeholder Review
Bonham E
Multipaper
Evaluation 2010: Saturday, November 13, 2:50 PM – 4:20 PM
Page 162
Summary of Sessions for Saturday, November 13, 2:50 PM to 4:20 PM
No Primary Sponsor
Session
Session Title
Room
887 Government Evaluation TIG
MultiPaper
Straw, Bricks, Construction: Improving Quality of Education Data, Performance Measures, and Evaluation to Enhance…
Texas A
888 Qualitative Methods TIG
Demonstration
Web Dialogues: A New Tool for Evaluators
Texas B
889 Mixed Methods Evaluation TIG
Multipaper
Challenges and Promises for Using Mixed Methods: Lessons From Implementing Mixed Methods Evaluation
Texas C
890 Research, Technology, and Development
MultiPaper
Evaluation System of Research, Technology, and Development to Induce Innovation: Strategy, Process, and Reflection
Texas D
891 Evaluation Use TIG
Panel
Thinking Outside the Evaluation Report Box: Transforming Evaluation Results Into a Structural Change Grantmaking Toolkit
Texas E
892 Graduate Student and New Evaluator TIG
Skill-building
How to Write an Evaluation Plan
Texas F
893 AEA Conference Committee
Skill-building
Say Goodbye to Power Point and Hello to Gallery Walks!
Crockett A
894 Teaching of Evaluation TIG
Panel
Expanding Our Knowledgebase: Current Research on Teaching Evaluation
Crockett B
895 Social Network Analysis TIG
Think Tank
The Network of Network Funders: Evaluating Networks and Evaluating with a Network Lens
Crockett C
896 Disaster & Emergency Management Evaluation Multipaper
Impact Evaluation of Approaches to Affect Local Resiliency to Disasters, Enhanced Public Health Emergency Peer Networks… Crockett D
897 Feminist Issues in Evaluation TIG
Feminist Evaluation and Gender-Specific Programs
Seguin B
898 International and Cross-cultural Evaluation TIG Multipaper
Case Studies in International Monitoring and Evaluation
Republic A
899 Health Evaluation TIG
MultiPaper
Policy Evaluation and Public Health: Multifaceted Approaches and Examples From the Field
Republic B
900 Collaborative, Participatory & Empowerment
Multipaper
Strengthening Schools and Youth Through the Use of Evaluation: Issues and Perspectives
Republic C
Multipaper
Evaluation 2010: Saturday, November 13, 2:50 PM – 4:20 PM
Page 163
Saturday, 2:50 pm to 4:20 pm
862 - Tools for Improving the Quality of Evaluations:
Four Examples From the Field
Panel to be held in Lone Star A
Sponsored by the Presidential Strand and the
Environmental Program Evaluation TIG
 Chair - Britta Johnson, United States
Environmental Protection Agency
Integrating Evaluation Into Program Design
 Matt Keene, United States Environmental Protection Agency
Using Evaluability Assessment to Understand Data Limitations
and Help Design an Appropriate Evaluation
 Michelle Mandolia, United States Environmental Protection
Agency
Using Expert/Peer Review to Improve the Quality of an
Evaluation Methodology: Tribal General Assistance Program
Case Study
 Yvonne Watson, United States Environmental Protection
Agency; and Tracy Dyke Redmond, Industrial Economics Inc
Using Expert/Peer Review to Improve the Quality of an
Evaluation Methodology: Compliance Assistance Outcomes
Case Study
 Terell Lasane, United States Environmental Protection
Agency
863 - Integrating Evaluation Into Everyday
Organizational Practice: A Complex Systems
Perspective
Think Tank to be held in Lone Star B
Sponsored by the Systems in Evaluation TIG
 Presenter - Srik Gopalakrishnan, New Teacher Center
 Discussant - Royce Holladay, Human Systems Dynamics
Institute
864 - Advances in Stakeholder Consultation for
Evaluation Quality
Panel to be held in Lone Star C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Chair and Discussant- Laura Leviton, Robert Wood Johnson
Foundation
Strategies for Involving Stakeholders in Developing Evaluation
Questions
 Hallie Preskill, FSG Social Impact Advisors
Mapping Stakeholder Views of Evaluation Questions and Plans
 William M Trochim, Cornell University
A Nationwide Delphi Process to Set Priorities for Research and
Evaluation to Prevent Obesity Among Latino Children
 Amelie Ramirez and Kipling Gallion, University of Texas
Health Science Center at San Antonio
866 - What Am I Supposed to Do With Three-Way
Crosstabs? An Introduction to Log Linear Models
Demonstration to be held in Lone Star E
Sponsored by the Quantitative Methods: Theory and Design TIG
 Eric Canen and Nanette Nelson, University of Wyoming
867 - Meeting Needs of Multiple Stakeholders in a
High-Scrutiny Multi-site Evaluation: Evaluation of the
Communities Putting Prevention to Work (CPPW)
Initiative
Panel to be held in Lone Star F
Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG
On Rowing in the Right Direction: Creating an Evaluation Design
for the CPPW Initiative
 Thomas Chapel, Centers for Disease Control and Prevention
Sense and Chaos in Multi-site Evaluations
 Rene Lavinghouze, Centers for Disease Control and
Prevention
Navigating the Complexities of Evaluating Quitlines: Design and
Methodology
 Lei Zhang, Centers for Disease Control and Prevention
The Role of Technical Assistance and Training in Ensuring
Evaluation Quality in a Multi-site, Multi-level Evaluation
 Martha Engstrom, Centers for Disease Control and
Prevention
868 - Building Evaluation Capacity in Nonprofit
Organizations Serving Lesbian, Gay, Bisexual and
Transgender (LGBT) and HIV+ Clients
Panel to be held in Mission A
Sponsored by the Lesbian, Gay, Bisexual, and Transgender
Issues TIG
 Chair and Discussant- Anita Baker, Anita Baker Consulting
Evaluative Thinking and Organizational Change at Latino
Community Services
 Anita Baker, Anita Baker Consulting; and Erica Roggeveen,
Yvette Bello, and Erica Roggeveen, Latino Community Services
Learning From and About Evaluation at the Hartford Gay and
Lesbian Health Collective
 Jamie Bassell and Linda Estabrook, Hartford Gay and
Lesbian Health Collective
Learning From and About Evaluation at AIDS Project Hartford
 Ed Paquette, AIDS Project Hartford
Evaluation 2010: Saturday, November 13, 2:50 PM – 4:20 PM
Page 164
869 - Evaluating Special Education Personnel Development Initiatives in Three Predominately Rural States:
Emphasis on Fidelity of Implementation Measures
MultiPaper to be held in Mission B
Sponsored by the Disabilities and Other Vulnerable Populations
and the Pre-K - 12 Educational Evaluation TIGs
 Chair - David Merves, Evergreen Educational Consulting LLC
 Discussant - Patricia Gonzalez, US Department of Education
Measuring Fidelity of Implementation for Wisconsin‘s State
Personnel Development Grant Activities
 James Frasier, University of Wisconsin, Madison
Capturing Fidelity of Implementation in New Hampshire State
Personnel Development Grant RESPONDS
 Patricia Mueller, Evergreen Educational Consulting LLC
Measuring Fidelity of Implementation for New Mexico State
Personnel Development Grant
 Carlos Romero, Apex Education Inc
870 - Ensuring Quality in Our Work: Techniques Used
by Independent Consultants
MultiPaper to be held in Bowie A
Sponsored by the Independent Consulting TIG
 Chair - Susan M Wolfe, Susan Wolfe and Associates LLC
 Discussant - Michelle Baron, The Evaluation Baron LLC
Avoiding Getting in Over Your Head
 Frederic Glantz, Kokopelli Associates LLC
Using Customized Evaluation Checklists to Ensure Quality
 Michelle Baron, The Evaluation Baron LLC
Keeping your Final Report in Sync With Your Research
 Gail V Barrington, Barrington Research Group Inc
Evaluation Bartering: How to Give and Get Help From Your
Buddies
 Deborah Levy, SuccessLinks LLC
Double Checking and Documenting Your Work
 Susan M Wolfe, Susan Wolfe and Associates LLC
Evaluation Post-mortems: Future Learning From Past
Experiences
 Amy Germuth, EvalWorks LLC
872 – Roundtables in Goliad
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Graduate Student and New Evaluator TIG
Rotation 1: The Mentor/Mentee Relationship: Perspectives and
Suggestions for Maintaining Successful Relationships
 Jennifer Morrow, University of Tennessee, Knoxville; Margot
Ackermann, Homeward; Erin Burr, Oak Ridge Institute for
Science and Education; and Krystall Dunaway, Eastern Virginia
Medical School
Rotation 2: Evaluating a Rite of Passage Program as a Vehicle
for Systemic Change in At-risk Female Youths Attitudes and
Beliefs
 Kathryn Wilson and Mark Kirkpatrick, Western Michigan
University
873 – Roundtables in San Jacinto
The first rotation will use the first 45 minutes and the second
rotation will use the remaining 45 minutes
Sponsored by the Extension Education Evaluation TIG
Rotation 1: The Unfocused Focus Group: Evaluation Benefit or
Bane?
 Nancy Franz, Virginia Tech
Rotation 2: eXtension Evaluation Community of Practice (CoP)
Grows Up
 Michael Lambur, Virginia Tech; and Benjamin Silliman,
North Carolina State University
874 - The Importance of Critical Thinking in
Assessment in Higher Education
Multipaper to be held in Travis A
Sponsored by the Assessment in Higher Education TIG
 Chair - Leigh D'Amico, University of South Carolina
Understanding Student Mastery of Higher Education Curriculum
Standards
 Leigh D'Amico and Grant Morgan, University of South
Carolina; Tammy Pawloski and Janis McWayne, Francis Marion
University
Is Critical Thinking the All-Purpose Outcome in Higher
Education?
 John Stevenson, University of Rhode Island
Science, Technology, Engineering, And Mathematics (STEM)
Evaluations: Best Practices From a Multi-site, Multi-national
Research Program
 Courtney Brown and Christina Russell, Indiana University
Equity, Social Justice, and Quality in School Leadership
Preparation: A Critical Self-Assessment to Build Criteria for
Candidate Selection
 Aarti P Bellara, Zorka Karanxha, and Vonzell Agosto,
University of South Florida
875 - Positionality Matters: Understanding Culture
and Context From the Perspective of Key Stakeholders
Think Tank to be held in Travis B
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Presenter - Alyssa Na'im, Education Development Center
 Discussants- Araceli Martinez Ortiz, Sustainable Future Inc;
Shannan McNair, Oakland University; Carol Nixon, Edvantia Inc;
David Reider, Education Design LLC
Angelique Tucker Blackmon, Innovative Learning Concepts LLC;
Pam Van Dyk, Evaluation Resources LLC; and Karen L Yanowitz,
Arkansas State University
Evaluation 2010: Saturday, November 13, 2:50 PM – 4:20 PM
Page 165
Saturday, 2:50 pm to 4:20 pm, continued
876 - Practicing Culturally Responsive Evaluation:
Graduate Education Diversity Internship (GEDI)
Program Intern Reflections on the Role of
Competence, Context, and Cultural Perceptions
MultiPaper to be held in Travis C
Sponsored by the Multiethnic Issues in Evaluation TIG
 Chair - Michelle Jay, University of South Carolina
 Discussant - Rita O'Sullivan, University of North Carolina at
Chapel-Hill
Designing a Culturally Responsive Evaluation Plan for the Race
Matters Toolkit
 Frances Carter, University of Maryland, Baltimore County
Challenges of Cultural Responsiveness in a Public-Private
Partnership Identifying ‗Hotspots‘ of Poor Diabetes Care Using
Geographic Information Systems (GIS) Tools
 Deborah Ling, University of California, Los Angeles
Challenges in Promoting Culturally Responsive Evaluation
Practices in Unresponsive Work Environments
 Johnavae Campbell, University of North Carolina at ChapelHill
Formative Research on Mentoring African American and
Latino/a Medical Students Toward a Career in HIV/AIDS
Prevention Science
 Neva Pemberton, University of California, Los Angeles
877 - Translating Visitors' Experiences Through
Evaluation
Multipaper to be held in Travis D
Sponsored by the Evaluating the Arts and Culture TIG
 Chair - Tara Pearsall, Savannah College of Art and Design
 Discussant - Kirsten Ellenbogen, Science Museum of
Minnesota
Visitors Within and Across Art Museums: Creating a Baseline for
Comparison While Building Capacity
 Joe E Heimlich, Ohio State University
Establishing a Framework for Evaluating Public Value at the
Smithsonian's National Museum of Natural History
 Bill Watson, Smithsonian's National Museum of Natural
History; Mary Ellen Munley, MEM and Associates; and Shari
Werb, Smithsonian's National Museum of Natural History
878 - Community-Derived Research Partnerships:
Working Together to Improve Human Services
Panel to be held in Independence
Sponsored by the Human Services Evaluation TIG
 Chair - Cynthia Flynn, University of South Carolina
 Discussant - Diana Tester, South Carolina Department of
Social Services
Establishing a Professional Development Consortium of Social
Work Programs in South Carolina: Needs Assessment for
Stakeholder Engagement
 Dana DeHart, University of South Carolina
Connecting for Kids: Navigating Community Partnerships for
Family-finding Services
 Suzanne Sutphin, University of South Carolina
Family Group Conferencing for Children in Foster Care:
Assessing the Effectiveness of a New Model for Engaging
Families
 Cynthia Flynn, University of South Carolina
879 - Online Learning in Adult and Postsecondary
Education: Theory and Practice
Multipaper to be held in Presidio A
Sponsored by the Distance Education & Other Educational
Technologies TIG
 Chair - Talbot Bielefeldt, International Society for
Technology in Education
Pushing Buttons and Breaking Code: Evaluating Instructional
Technology Pilots in Higher Education
 Joel Heikes, Stephanie Corliss, and Erin Reilly, University of
Texas, Austin
Real World, Real Use: The Impact of Integrating StudentCentered Learning in Adult Online Instruction in Mathematics
and Science
 Jane A Rodd and Dianna L Newman, State University of New
York at Albany; and Patricia J Lefor, Empire State College
Evaluation of an Online Training Program for Informal Science
Educators: The FETCH! With Ruff Ruffman Program
 Christine Paulsen and Christopher Bransfield, Concord
Evaluation Group LLC
880 - Increasing Evaluation Capacity Through Different
Levels of Training and Support
Multipaper to be held in Presidio B
Sponsored by the Organizational Learning and Evaluation
Capacity Building TIG
 Chair and Discussant - Stanley Capela, HeartShare Human
Services of New York
Improving the Quality of Program Evaluation Reporting: A
Capacity Building Event in California's Tobacco Control
Programs
 Jeanette Treiber, University of California, Davis
Am I My Brother's Keeper? Coaching Communities an
Evaluation of Process and Outcome
 Gina Weisblat, Cleveland State University
Evaluation Capacity Building in the Corporate Sector: Using
eLearning and Traditional Methods to
Increase Organizational Capacity
 Michele Graham, KPMG LLP; John Mattox, Knowledge
Advisors; and Peter Sanacore, KPMG LLP
Evaluation 2010: Saturday, November 13, 2:50 PM – 4:20 PM
Page 166
881 - Evaluating a National Medicaid Children's
Mental Health Demonstration Grant Program
MultiPaper to be held in Presidio C
Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG
 Chair - Garrett Moran, Westat
Overview of the Home and Community-based Services
Demonstration Waiver Grant Program
 Oswaldo Urdapilleta, IMPAQ International
Virginia's Approach: Transitioning Youth From Institutions to the
Community
 Mendy Meeks and Karen Lawson, Virginia Department of
Medical Assistance Services
Maryland's Implementation Challenges and Evaluation Design
 Jennifer Mettrick and Wai-Ying Chow, University of Maryland
Using Blended Methods and Prospective Meta-analytic
Approach to Strengthen a Multisite Evaluation
 Garrett Moran, Debra Rog, and Joshua Noda, Westat
882 – Roundtable in Bonham A
Sponsored by the Pre-K - 12 Educational Evaluation TIG
Adaptations to Evaluation Design: Two Examples of Ensuring
Quality in Practice
 Stephanie Feger and Elise Laorenza, Brown University
883 - 2010 Report: State of Evaluation Practice and
Capacity in the Nonprofit Sector
Demonstration to be held in Bonham B
Sponsored by the Non-profit and Foundations Evaluation TIG
 Johanna Morariu, Myia Welsh, and Lily Zandniapour,
Innovation Network
884 - Evaluating the State of Charter Schools and
Public Schools of Choice
Multipaper to be held in Bonham C
Sponsored by the Pre-K - 12 Educational Evaluation TIG
 Chair - Juanita Lucas-McLean, Westat
 Discussant - Antionette Stroter, University of Iowa
School Choice and its Impacts on Student Well-being and
Academic Achievement in Post-Katrina New Orleans
 Paul Hutchinson, Tulane University; Lisanne Brown,
Louisiana Public Health Institute; Nathalie Ferrell, Tulane
University; and Marsha Broussard and Sarah Kohler Chrestman,
Louisiana Public Health Institute
National Evaluation of Knowledge Is Power Program (KIPP)
Middle Schools: Impacts on Student Achievement
 Presenters - Brian Gill, Philip Gleason, Ira Nichols-Barrer,
Bing-ru Teh, and Christina Tuttle, Mathematica Policy Research
Lottery-based Estimates of Charter School Impacts and Factors
Related to Impacts
 Christina Clark Tuttle, Philip Gleason, and Melissa Clark,
Mathematica Policy Research
The Art and Science of Picking Comparison Schools
 Agata Jose-Ivanina and Helene Jennings, ICF Macro
885 – Case Studies and Cost Studies
Multipaper to be held in Bonham D
Sponsored by the Costs, Effectiveness, Benefits, and Economics
TIG
 Chair - Mustafa Karakus, Westat
Always Late: Why Some Multilateral Development Bank Projects
Delay so Much While Others do Not?
 Guy Blaise Nkamleu, African Development Bank
Comprehensive Economic Evaluation of a Colorectal Cancer
Screening Demonstration Program: A Multi-site, Multi-level Cost
Analysis
 Maggie Cole Beebe and Sujha Subramanian, RTI
International; Florence Tangka, Centers for Disease Control and
Prevention; and Sonja Hoover, RTI International
Exploring the Economics of Quality Improvement Education in
Healthcare
 Daniel McLinden and Stacey Farber, Cincinnati Children's
Hospital Medical Center
Evaluating Directions Home: A Cost-Benefit Study of Supportive
Housing for People Who Are Homeless in Fort Worth, Texas
 James Petrovich and Emily Spence-Almaguer, University of
Texas, Arlington
886 - Improving Proposals and Programs by Improving
Peer and Stakeholder Review
Multipaper to be held in Bonham E
Sponsored by the Research, Technology, and Development
Evaluation TIG
 Chair - George Teather, George Teather and Associates
Using Fishbone Analysis to Improve the Quality of Science and
Technology Program Proposals
 Shan Shan Li and Ling-Chu Lee, National Applied Research
Laboratories
Improving the Professionalism of Peer Review Panel in Research
and Development (R&D) Evaluation : The Korean Case
 Chan Goo Yi, Pukyong National University; Boojong Gill,
Korea Institute of Science & Technology Evaluation and Planning
(KISTEP)
Interactive Heuristic Reviewing Mechanism: A New Method of
Assessing Exploratory Pioneering Research Projects for National
Nature Science Foundation of China (NSFC)
 Yue Wang, Xiaoxuan Li, and Jianzhong Zhou, Chinese
Academy of Sciences; Yonghe Zheng, National Nature Science
Foundation of China; and Guoxiang Xiong, Chinese Academy of
Sciences
Evaluation 2010: Saturday, November 13, 2:50 PM – 4:20 PM
Page 167
Saturday, 2:50 pm to 4:20 pm, continued
887 - Straw, Bricks, Construction: Improving Quality of
Education Data, Performance Measures, and
Evaluation to Enhance Student Achievement, Reduce
Gaps and Increase College Access and Retention
MultiPaper to be held in Texas A
Sponsored by the Government Evaluation TIG and the Pre-K - 12
Educational Evaluation TIG
 Chair - Stephanie Shipman, United States Government
Accountability Office
EDFacts Data Quality, Usability, and Limitations
 Marian Banfield and Margaret Cahalan, United States
Department of Education
High School Achievement Through Multiple Lenses: Data,
Measures, Methods
 Margaret Cahalan, United States Department of Education
Differentiating the Effects of Federal Programs: The American
Competitiveness (ACG) and National Smart Grant (NSG) - From
Other Federal, State, and Institutional Changes
 Sharon Stout, United States Department of Education
888 - Web Dialogues: A New Tool for Evaluators
Demonstration to be held in Texas B
Sponsored by the Qualitative Methods TIG
 Jerome Hipps and Laurie Maak, WestEd
889 - Challenges and Promises for Using Mixed
Methods: Lessons From Implementing Mixed Methods
Evaluation
Multipaper to be held in Texas C
Sponsored by the Mixed Methods Evaluation TIG
 Chair - James Riedel, Girl Scouts of the United States of
America
 Discussant - Donna Mertens, Gallaudet University
Mixed Method Evaluations Quality and Balance: A Case Study
From New Zealand Public Sector
 Yelena Thomas, Ministry of Research Science and
Technology
Evaluating Migrant Education Programs: Quality and Inquiry
 Karen Vocke, Carl Westine, Brooks Applegate, and Ilse
Schweitzer, Western Michigan University
Evaluating a Narrative Intervention Model (NIM) based HIV/STI
(Sexually Transmitted Infection) Prevention Intervention in Urban
India
 Minakshi Tikoo and Stephen Schensul, University of
Connecticut
Using a Mixed Methodology to Evaluate an EntertainmentEducation Intervention Directed to the Spanish-Speaking Latino
Community of Colorado
 Mariana Enriquez-Olmos and Cristina Bejarano,
Independent Consultant
890 - Evaluation System of Research, Technology, and
Development (RT&D) to Induce Innovation: Strategy,
Process, and Reflection
MultiPaper to be held in Texas D
Sponsored by the Research, Technology, and Development
Evaluation TIG
 Chair - Naoto Kobayashi, Waseda University
On the Feedback of Evaluation Results to the Management of
Advanced Industrial Science and Technology (AIST)
 Yoshiaki Tamanoue, Hidenori Endo, Shigeko Togashi,
Shuichi Oka, Hiroyuki Suda, Kenta Ooi, and Kanji Ueda, National
Institute of Advanced Industrial Science and Technology
Summary and Prospect of Evaluation on Research-supportive
and Administrative Departments in National Institute of AIST for
Promoting Innovation
 Mariko Kamo, Susumu Yasuda, Hiroyuki Suda, Shigeko
Togashi, Kenta Ooi, and Kanji Ueda, National Institute of
Advanced Industrial Science and Technology
Strategic RT&D in Nagasaki to Induce Local and Global
Innovation
 Osamu Nakamura and Nariatsu Inada, Nagasaki Prefectural
Government; and Naoto Kobayashi, Waseda University
891 - Thinking Outside the Evaluation Report Box:
Transforming Evaluation Results Into a Structural
Change Grantmaking Toolkit
Panel to be held in Texas E
Sponsored by the Evaluation Use TIG and the Non-profit and
Foundations Evaluation TIG
 Chair - Steven LaFrance, Learning for Action Group
Introducing the Common Vision Process
 Karen Zelermyer, Ellen Gurzinsky, and Robert Espinoza,
Funders for LGBTQ Issues
Sharing Best Practices for Facilitating a Formative Process
 Jara Dean-Coffey, jdcPartnerships
Exploring an Integrated Evaluation Approach
 Steven LaFrance, Learning for Action Group
Transforming Evaluation Results Into a Structural Change
Grantmaking Toolkit
 JT Taylor, Learning for Action Group
892 - How to Write an Evaluation Plan
Skill-building Workshop to be held in Texas F
Sponsored by the Graduate Student and New Evaluator TIG
 LaTisha Marshall, Centers for Disease Control and
Prevention
Evaluation 2010: Saturday, November 13, 2:50 PM – 4:20 PM
Page 168
893 - Say Goodbye to Power Point and Hello to Gallery
Walks!
Skill-building Workshop to be held in Crockett A
Sponsored by the AEA Conference Committee
 Cassandra ONeill, Wholonomy Consulting; and Allison
Titcomb, ALTA Consulting
894 - Expanding Our Knowledgebase: Current
Research on Teaching Evaluation
Panel to be held in Crockett B
Sponsored by the Teaching of Evaluation TIG
 Chair - Christina Christie, University of California, Los
Angeles
A Descriptive Study of Evaluator Course Taking Patterns and
Practice
 Christina Christie, University of California, Los Angeles;
Leslie Fierro, SciMetrika; and Tarek Azzam, Claremont Graduate
University
Evaluation Coursework in Schools and Programs of Public Health
 Leslie Fierro, SciMetrika; and Christina Christie, University
of California, Los Angeles
Contexts and Teaching Evaluation: An Example From Educational
Administration Programs
 Tara Shepperson, Eastern Kentucky University
Informal Discussion as Socialization and Teaching Tools in
Program Evaluation
 Anne Vo, University of California, Los Angeles
895 - The Network of Network Funders: Evaluating
Networks and Evaluating with a Network Lens
Think Tank to be held in Crockett C
Sponsored by the Social Network Analysis TIG
 Presenter - Astrid Hendricks, California Endowment
 Discussants - Gale Berkowitz, David and Lucile Packard
Foundation; Mayur Patel, John S and James L Knight Foundation;
and Gigi Barsoum, California Endowment
896 - Impact Evaluation of Approaches to Affect Local
Resiliency to Disasters, Enhanced Public Health
Emergency Peer Networks, and First Responder
Psychological Recovery
Multipaper to be held in Crockett D
Sponsored by the Disaster and Emergency Management
Evaluation
 Chair - Karen Pendleton, University of South Carolina
Evaluating Peer Networks Among New Local Health Officials:
Assessing Relationships in Responding to Local Health Crises
Following Leadership and Managerial Training
 Sue Ann Sarpy, Sarpy and Associates LLC; and Alicia
Stachowski andSeth Kaplan, Geroge Mason University
Disaster Resilience Evaluation: An example From Miami-Dade
Faith and Community-based Organizations
 Michael Burke, Joe Eyerman, and Brian Burke, RTI
International
First Responder Immediate Psychological Trauma: How Are We
Helping? A Meta-analysis
 Lynne Wighton, Vanderbilt University
897 - Feminist Evaluation and Gender-Specific
Programs
Multipaper to be held in Seguin B
Sponsored by the Feminist Issues in Evaluation TIG
 Chair - Linda Thurston, National Science Foundation
 Discussant - Jan Middendorf, Kansas State University
Feminist Evaluation: Practical Application in Nonpractical
Situations
 Donna Podems, ICF Macro International
Post Traumatic Stress Disorder (PTSD) and Co-occurring Mental
Health and Substance Abuse Disorders: Does Gender Matter?
 Kathryn A Bowen, Centerstone Research Institute
Meta-evaluations of HIV/AIDS Prevention Intervention
Evaluations in Sub Saharan Africa With Specific Emphasis on
Implications for Women and Girls
 Tererai Trent, Western Michigan University
898 - Case Studies in International Monitoring and
Evaluation
Multipaper to be held in Republic A
Sponsored by the International & Cross-cultural Evaluation TIG
 Chair - Jim Rugh, Independent Consultant
Using Collaborative and Systemic Approaches to Evaluate a
Health Promotion Initiative Involving Canada and Brazil
 Eduardo Marino, Independent Consultant; Thomaz Chianca,
COMEA Evaluation Ltd
Horizontal Evaluation: An Institutional Learning and Knowledge
Building Case From Africa
 Hubert Paulmer, Harry Cummings and Associates Inc; and
Harry Cummings, University of Guelph
Integration of a Safe Water and Hygiene Program With Routine
Childhood Immunization Services: Design Strategies and
Lessons Learned From a Mixed Method Evaluation of a One-Year
Pilot Project at 18 Health Facilities in Nyanza Province, Kenya
 Karen Schlanger, University of Georgia; Tove Ryman and
Margaret Watkins, Centers for Disease Control and Prevention;
Brian Otieno and Cliff Ochieng, Safe Water and AIDS project
Patricia Richards, University of Georgia
The Influence of Cooperative Structure on Commitment and
Member Satisfaction: A Case of the Murang‘a Nutribusiness
Cooperative in Kenya
 Mary Marete, Joan Thomson, and Edgar Yoder, Pennsylvania
State University
Evaluation 2010: Saturday, November 13, 2:50 PM – 4:20 PM
Page 169
Saturday, 2:50 pm to 4:20 pm, continued
899 - Policy Evaluation and Public Health: Multifaceted Approaches and Examples From the Field
MultiPaper to be held in Republic B
Sponsored by the Health Evaluation TIG
 Chair - Karen Debrot, Centers for Disease Control and
Prevention
The Role of Rigorous Policy Evaluation in Violence Prevention
 Jennifer Matjasko, Centers for Disease Control and
Prevention
Evaluating Smoke-free Policies: A Clear View
 Karen Debrot, Centers for Disease Control and Prevention
Indicators for Tobacco Control Policy Evaluation
 Karen Debrot, Centers for Disease Control and Prevention
Saturday, 4:30 pm to 5:30 pm
902 - Reflections on the Conference and Conference
Theme by Recent Past AEA Presidents
Plenary to be held in Texas A
Sponsored by the Presidential Strand
Chair - Leslie Cooksy, University of Delaware
Discussant - Jennifer Greene, University of Illinois at UrbanaChampaign
 Presenters - Melvin Mark, Pennsylvania State University;
Hallie Preskill, FSG Social Impact Advisors; Sharon Rallis,
University of Massachusetts; Debra Rog, Westat; and William M
Trochim, Cornell University
900 - Strengthening Schools and Youth Through the
Use of Evaluation: Issues and Perspectives
Multipaper to be held in Republic C
Sponsored by the Collaborative, Participatory & Empowerment
Evaluation TIG
 Chair - Liliana Rodriguez-Campos, University of South
Florida
Teacher Benefits of Collaborative Action Research: Results of a
Quantitative Inquiry
 John A Ross, University of Toronto; and Catherine D Bruce,
Trent University
Youngsters Marked by Involvement in Crime Acting as the
Evaluation Team
 Daniel Brandão, Fonte Institute
Turning Points: Critical Incidents in the Formation of Academic
Mentoring Relationships: An Evaluation of a University Learning
Community
 Nancy Rogers and Tommy Chou, University of Cincinnati
Process Evaluation of An Immersion-Learning Experience for
Grades K-4 Youth
 Laurie Ruberg, Wheeling Jesuit University; Jackie Shia,
Challenger Learning Center; Cassie Lightfritz, Center for
Educational Technologies; and Annie Morgan, Challenger
Learning Center
Evaluation 2010: Saturday, November 13, 2:50 PM – 4:20 PM, 4:30 PM – 5:30 PM
Page 170
Appendix A: Index of Presenters and Contributors
In brackets after each presenter‘s name may be found the sessions in which she or he is presenting.
AAAAAAAA
Aaron, Katrina [623-678-809] Augusta Partnership for Children Inc; 706-721-4885; [email protected]
Abbott, Maryann [600] Institute for Community Research; [email protected]
Abdullateef, Eric [275-436] Directed Study Services; 202-399-0578; [email protected]
Abed, Joanne [540] Battelle Memorial Institute; 703-761-7617; [email protected]
Abel, Yvonne [227] Abt Associates Inc; 617-349-2451; [email protected]
Abi-Nader, Jeanette [767] Community Food Security Coalition; 434-973-4435; [email protected]
Abreu, Dolores [137] Laboratório de Avaliação de Situações Endêmicas Regionais; +55-21-2598-2444; [email protected]
Achatz, Mary [207] Westat; 301-294-2837; [email protected]
Ackermann, Margot [137-872] Homeward; 804-869-3746; [email protected]
Adams, Adrienne [245] Michigan State University; 517-353-4568; [email protected]
Adams, Jeffery [137] Massey University; +6493666136; [email protected]
Adams, Sandra [263] William Penn Foundation; 215-988-1830; [email protected]
Adedokun, Omolola A [392-600] Purdue University; 765-494-0726; [email protected]
Adjognon, Omonyele [541-619] Institute for Community Health; 617-499-6617; [email protected]
Affeldt, John [257] Public Advocates; 415-431-7430 x113; [email protected]
Agosto, Vonzell [874] University of South Florida; 813-974-3422; [email protected]
Agoulnik, Irina [739] Brigham and Women's Hospital; 617-525-4766; [email protected]
Aguero, Dawn [576] College Center for Library Automation; 850-922-6044; [email protected]
Ah Sam, Anna [654] University of Hawaii, Manoa; 808-956-9217; [email protected]
Ahn, Jeehae [208-502-591-622-812] University of Illinois at Urbana-Champaign; 217-332-2799; [email protected]
Ajose, Lande [217-257] BTW Informing Change; 510-665-6100; [email protected]
Akbay, Lokman [137] University of South Florida; 704-501-6023; [email protected]
Akroyd, Shaun [654] Akroyd Research and Evaluation; +64-27-568-5810; [email protected]
Aladjem, Daniel [137] American Institutes for Research; 202-403-5386; [email protected]
Alaimo, Salvatore [684] Grand Valley State University; 616-331-6582; [email protected]
Alderman, Katarzyna [137-779] Battelle Memorial Institute; 206-528-3011; [email protected]
Alemdar, Meltem [645] Georgia Institute of Technology; 404-518-2478; [email protected]
Alford, Aaron [627-721] Battelle Memorial Institute; 703-248-2144; [email protected]
Alford, Beverly [305] Texas A&M University; 932-758-1881; [email protected]
Ali, Asma [291] University of Illinois at Chicago; 312-399-8881; [email protected]
Alizaga, Natalie [737] Amherst H Wilder Foundation; 415-608-1462; [email protected]
Alkhalaf, Arwa [137] University of British Columbia; 604-767-4074; [email protected]
Alkin, Marv [389] University of California, Los Angeles; 310-825-4800; [email protected]
Allen, Winston [137] Heartlands International; 202-361-7665; [email protected]
Allsopp, Margaret [137] University of South Florida; 813-974-9412; [email protected]
Alsobrook, Metta [256] University of Texas, Dallas; 972-883-5484; [email protected]
Alton, Forrest [619] South Carolina Campaign to Prevent Teen Pregnancy; 803-771-7700; [email protected]
Altschuld, James [117-297-377-857] The Ohio State University; 614-389-4585; [email protected]
Alvarez, Julia [113-524] JVA Consulting LLC; 303-477-4896; [email protected]
Alvaro, Eusebio [783] Claremont Graduate University; 520-360-3599; [email protected]
Alyami, Mohammed [117-137-789] Western Michigan University; 201-660-0966; [email protected]
Amaral, Eliana [256] Universidade Estadual de Campinas; +55-19-37889461; [email protected]
Aminov, Scott [437-816] Food For The Hungry; +62 812 604 2314; [email protected]
Ammann Howard, Kim [257] BTW Informing Change; 510-665-6100; [email protected]
Amo, Courtney [268] National Research Council Canada; 613-990-1053; [email protected]
Amon, Dan [607] United States Environmental Protection Agency; 202-564-7509; [email protected]
Amwake, Lynn [137] University of North Carolina at Greensboro; 850-894-4075; [email protected]
Anastasia, Trena [373-522] University of Wyoming; 307-766-6182; [email protected]
Ander, Roseanna [285] University of Chicago; 312-325-2544; [email protected]
Anders, Jessica [251] NeighborWorks America; 202-220-2316; [email protected]
Anderson, Bernice [371] National Science Foundation; 703-292-5151; [email protected]
Anderson, Beth [730] National Institute of Environmental Health Sciences; [email protected]
Anderson, Jacquie [112] Community Catalyst; 617-275-2803; [email protected]
Anderson, Jock [614] World Bank; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 171
Anderson, Karen [409-671] Clark Atlanta University; 843-465-0704; [email protected]
Anderson, Mary Anne [137] ICF Macro International; 301-572-0824; [email protected]
Anderson, Summerlynn [306] Walter R McDonald and Associates Inc; 916-239-4020 x239; [email protected]
Anderson, Teresa [301] University of Massachusetts; 508-856-6520; [email protected]
Anderson-Hamilton, Andrea [253] Anderson Hamilton Consulting; 917-294-5086; [email protected]
Angresano, Nicole [678] United Way of Greater Milwaukee; 414-263-8115; [email protected]
Apichaisiri, Tatcha [757] Pact Inc; +66 2 2313402; [email protected]
Aponte-Soto, Lisa [671] University of Illinois at Chicago; 708-890-7942; [email protected]
Applegate, Brooks [697-889] Western Michigan University; 269-387-5886; [email protected]
Appleton-Dyer, Sarah [780] University of Auckland; +0064 9 373 7599 x84977; [email protected]
Araya, Daniel [137] University of Illinois at Urbana-Champaign; 217-390-4244; [email protected]
Archibald, Thomas [250-381-820] Cornell University; 607-255-0397; [email protected]
Arens, Sheila A [126-298-368-780] Mid-Continent Research for Education and Learning; 303-632-5625; [email protected]
Armbrecht, Eric [709] Open Health LLC; 314-446-6485; [email protected]
Armstead, Cathleen [261-685] University of Miami; 305-284-5826; [email protected]
Armstrong, Mary [222] University of South Florida; 813-974-4601; [email protected]
Arnold, Amy Laura [519-623-678-809] University Of Georgia; 859-797-4210; [email protected]
Arnold, Mary [692] Oregon State University; 541-737-1315; [email protected]
Arons, Abigial [592] University of California, San Francisco; 415-476-3689; [email protected]
Arroyo, Ruth [319] Consorcio por la Salud, Ambiente y Desarrollo (ECOSAD); [email protected]
Arruda Laorenza, Elise [832] Brown University; 401-688-2053; [email protected]
Atienza, Sara [566] Empirical Education Inc; 650-328-1734 x135; [email protected]
Atkins, Kathleen [268] Education Review Office; 64-4-499-2489; [email protected]
Atkinson, Donna [252] University of Northern British Columbia; 250-960-6719; [email protected]
Austin, Greg [683] WestEd; 562-799-5155; [email protected]
Austria, Diana [320] Stanford University; 281-761-4318; [email protected]
Autio, Elizabeth [725] Education Northwest; 503-275-9593; [email protected]
Autor, Lewis [541] Rock of Escape; 404-281-1858; [email protected]
Avila, Minerva [296] University of California, Los Angeles; 310-206-6944; [email protected]
Avula, Deepa [682] United States Department of Health and Human Services; 240-276-2961; [email protected]
Awgu, Ezechukwu [137] Western Michigan University; 269-387-5895; [email protected]
Axelson, Rick [255-792] University of Iowa; 319-384-4291; [email protected]
Ayyad, Fatma [697] Western Michigan University; 269-267-2347; [email protected]
Azizova, Zarrina [793] Oklahoma State University; 405-744-4715; [email protected]
Azzam, Tarek [353-580-755-894] Claremont Graduate University; 909-374-5355; [email protected]
BBBBBBBB
Babb, Steven [378] Centers for Disease Control and Prevention; 770-488-1172; [email protected]
Baccarini, Rachel [137] Ministry of Health of Brazil; 055-0613-306-7037; [email protected]
Bachmann, Kim [537] Industry Canada; 613-941-1429; [email protected]
Bachrach, Elizabeth [787] Goodman Research Group Inc; 248-432-7067; [email protected]
Badran, Abdel-Kareem [137] National Center for Examinations & Educational Evaluation; 011-02012-803-0999; [email protected]
Badway, Norena Norton [335] San Francisco State University; 209-601-7121; [email protected]
Bae, Suho [810] Sungkyunkwan University; [email protected]
Baek, EunKyeng [383] University of South Florida; 813-618-0213; [email protected]
Baer, Denise L [264-711] Johns Hopkins University; 240-498-5409; [email protected]
Baez, Javier [539] World Bank; 202-473-6568; [email protected]
Bai, Haiyan [300] University of Central Florida; 407-823-1467; [email protected]
Baizerman, Michael [536-588-698] University of Minnesota; 612-624-4912; [email protected]
Baker, Anita [868] Anita Baker Consulting; 609-397-8722; [email protected]
Baker, Kirk [271] National Institutes of Health; 301-451-7431; [email protected]
Baker, Stephen [665] Chapin Hall; 773-256-5113; [email protected]
Bakerson, Michelle [114-683] Indiana University South Bend; 269-362-1620; [email protected]
Balakrishnan, Asha [343] Science and Technology Policy Institute; 202-419-5480; [email protected]
Balasubramanian, Nathan [416-605] Centennial Board of Cooperative Educational Services; 720-936-5999; [email protected]
Balcom, Lee [137] Western Michigan University; 269-655-4671; [email protected]
Baldassari, Carol [385] Lesley University; 617-349-8664; [email protected]
Ballard, Karen [612] University of Arkansas; 501-671-2218; [email protected]
Balmer, Dorene [137] Columbia University; 212-305-3777; [email protected]
Bamberger, Michael [236-696-815-821] Independent Consultant; 503-641-8633; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 172
Bandy, Elizabeth [640] Rockman et al; 415-544-0788; [email protected]
Banfield, Marian [887] United States Department of Education; 202-401-7767; [email protected]
Banks, Gina [390] Washington University in St Louis; 314-935-3648; [email protected]
Banks, Sevaughn [379] California Social Work Education Center; 510-642-9272; [email protected]
Baptiste, Lennise [137-512-811] Kent State University; 330-676-1832; [email protected]
Barba, Kate [687] National Oceanic and Atmospheric Administration; 301-563-1182; [email protected]
Bardack, Sarah [137] American Institutes for Research; 202-403-5827; [email protected]
Barela, Eric [224-314-429-557-616-685] Partners in School Innovation; 415-824-6196 x103; [email protected]
Barley, Zoe [589-645] Mid-continent Research for Education and Learning; 303-632-5611; [email protected]
Barnes, Cassandra [687] National Oceanic and Atmospheric Administration; 301-734-1190; [email protected]
Barnes, Gisoo [137] Centerstone Research Institute; 812-336-1156; [email protected]
Baron, Michelle [121-370-870] The Evaluation Baron LLC; 801-830-1390; [email protected]
Baronberg, Sabrina [227] New York City Department of Health and Mental Hygiene; 212-227-5242; [email protected]
Barrie, Sallay [245] Michigan State University; 517-353-4568; [email protected]
Barrington, Gail V [870] Barrington Research Group Inc; 403-289-2221; [email protected]
Barron-Simpson, Rachel [618] Centers for Disease Control and Prevention; 770-488-4825; [email protected]
Barsoum, Gigi [895] California Endowment; 800-449-4149; [email protected]
Bartenfeld, Tom [807] Centers for Disease Control and Prevention; 404-498-6766; [email protected]
Bartholomay, Tom [295-733] University of Minnesota; 612-626-2162; [email protected]
Bartholomew, Jenni [117] Case Western Reserve University; 216-368-3424; [email protected]
Bass, Kristin [640] Rockman et al; 415-544-0788; [email protected]
Bassell, Jamie [868] Hartford Gay and Lesbian Health Collective; 860-278-4163; [email protected]
Basta, Kelle [798] ICF International; 703-225-2264; [email protected]
Bates, Leigh [120] New York State Office of Children and Family Services; 518-473-8736
Bates, Michael [795] Mosaic Network Inc; 805-886-8694; [email protected]
Batsche, Catherine [718] University of South Florida; 813-974-7196; [email protected]
Baugh, Carlene [541] CHF International; 301-587-4700; [email protected]
Baughman, Sarah [612] Virginia Polytechnic Institute and State University; 540-231-9410; [email protected]
Baumgart, Glen E [594] University of Texas, Austin; 512-232-2930; [email protected]
Baxter, Lester [365-745] Pew Charitable Trusts; 215-575-4750; [email protected]
Bayonas, Holli [137] University of North Carolina at Greensboro; 336-315-7438; [email protected]
Bealaurier, Richard [600] Florida International Unversity; 786-333-0835; [email protected]
Beam, Margaret [526] RMC Research Corporation; 503-223-8248; [email protected]
Beard, Sharon [730] National Institute of Environmental Health Sciences; [email protected]
Beauchesne, Danielle [776] ICF Macro International; [email protected]
Becker, Dana [564] South Carolina Campaign to Prevent Teen Pregnancy; 803-771-7700
Becker, Heather [137] University of Texas, Austin; 512-471-9097; [email protected]
Becker, William [719] University of Arizona; [email protected]
Beckjord, Jennifer [137] Southern Illinois University Carbondale; 618-453-5371; [email protected]
Beesley, Andrea [225-265-298-368-780] Mid-continent Research for Education and Learning; 303-632-5541; [email protected]
Begg, Iain [726] London School of Economics
Begum, Housne [137] University of Dhaka; +0088-02-9014925; [email protected]
Bejarano, Cristina [511-889] Independent Consultant; 720-300-1248; [email protected]
Belding, Theodore [283] TechTeam Government Solutions; 734-302-4667; [email protected]
Belgrave, Faye [734] Virginia Commonwealth University; 804-827-3908; [email protected]
Bell, James [727] James Bell Associates; 703-528-3230; [email protected]
Bellara, Aarti P [668-874] University of South Florida; 813-558-8340; [email protected]
Belle, Carolla [137] University of South Florida; 813-428-2686; [email protected]
Bello, Yvette [868] Latino Community Services; 860-296-6400; [email protected]
Beltyukova, Svetlana [786] University of Toledo; 419-882-4921; [email protected]
Benard, Bonnie [592] WestEd; 510-302-4268; [email protected]
Benita, Williams [557] Feedback Research & Analytics; +27 827729709; [email protected]
Benjamin, Gregory [137-698] Nemours Health and Prevention Services; 302-444-9163; [email protected]
Benjamin, Lehn [325] George Mason University; 703-993-8240; [email protected]
Bennett, Deborah [137] Purdue University; 765-714-4054; [email protected]
Bennett, Heather [114-538-606-685] University of South Carolina; 803-777-3384; [email protected]
Bennett, Megan [121] Training Evaluation and Metrics; 215-286-5895; [email protected]
Benton, Amy [379] California Social Work Education Center; 510-642-9272; [email protected]
Benz, Jennifer [113] NORC at the University of Chicago; 781-639-0811; [email protected]
Berg, Marlene [262] Institute for Community Research; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 173
Berger, Dale [246-706] Claremont Graduate University; 909-625-5783; [email protected]
Bergum, Alison [107] University of Wisconsin; 608-263-2624; [email protected]
Berk, Jillian [838] Mathematica Policy Research; [email protected]
Berkel, Cady [130] Arizona State University; 480-491-1497; [email protected]
Berkowitz, Gale [124-505-895] David and Lucile Packard Foundation; 650-948-7658; [email protected]
Bernstein, David J [388-615] Westat; 301-738-3520; [email protected]
Berry, Michelle [137] University of Nevada, Reno; 775-784-6265; [email protected]
Berry, Tiffany [126-137-226] Claremont Graduate University; 909-607-1540; [email protected]
Berson, Michael [668-740] University of South Florida; 813-974-7917; [email protected]
Bertrand, Frédéric [231] Science-Metrix Corp; 514-495-6505; [email protected]
Bertrand Jones, Tamara [111-291-411-551] Florida State University; 850-644-1331; [email protected]
Bessell, Ann G [261-557-685] University of Miami; 305-284-5826; [email protected]
Best, Allan [387] Michael Smith Foundation for Health Research; 778-279-6896; [email protected]
Betesh, Hannah [686] Berkeley Policy Associates; 510-267-9680 x225; [email protected]
Betts, William [599] University of Colorado, Denver; 303-315-1275; [email protected]
Bhandari, Archna [271] National Institutes of Health; 301-451-7431; [email protected]
Bhang, Ellen [658] University of Massachusetts; 508-856-8585; [email protected]
Bhati, Divya [714] University of Central Florida; 407-882-0281; [email protected]
Bhattacharya, Gargi [358] Southern Illinois University Carbondale; 618-453-3532; [email protected]
Bheda, Divya [318-696-820] University of Oregon; 818-618-1831; [email protected]
Bichelmeyer, Barbara [275] Indiana University; 8i2-856-8468; [email protected]
Bickel, William [303] University of Pittsburgh; 412-624-7091; [email protected]
Bielefeldt, Talbot [340-560-879] International Society for Technology in Education; 541-434-8937; [email protected]
Bierring, Christina [276] United Nations Children's Fund; [email protected]
Biesecker, Gretchen [137-802] City Year Inc; 617-927-2317; [email protected]
Bigirimana, Alphonse [738] Chemonics International; 202-775-6972; [email protected]
Bilgili, Yakup [137-560] Polk County Public Schools; 904-662-9448; [email protected]
Bilinsky, Paula [439] United States Department of State; 301-434-4927; [email protected]
Binder, Diane [386] The Findings Group LLC; 404-783-7820; [email protected]
Bingham, Gary [306] Georgia State University; 404-413-8020; [email protected]
Bir, Anupa [672] RTI International; 781-434-1708; [email protected]
Birnbaum, Matt [687] National Fish and Wildlife Foundation; 202-595-2461; [email protected]
Bisgard, Jennifer [268] Khulisa Management Services (Pty) Ltd; [email protected]
Bishop, Pamela [248-673] University of Tennessee, Knoxville; 865-974-9348; [email protected]
Black, Jason [137-248] University of Tennessee, Knoxville; 401-487-9256; [email protected]
Blair, Meredith [514] Humanity United; 650-587-2015; [email protected]
Blanton, Linda [827] Cumberland County Partnership for Children; 910-867-9700 x2230; [email protected]
Blasinsky, Margaret [137] The Madrillon Group Inc; 703-821-1244; [email protected]
Blazovich, Linda [137] St Catherine University; 651-690-6594; [email protected]
Bledsoe, Katrina [229-242-543-742-823] Walter R McDonald and Associates Inc; 301-881-2590 x255; [email protected]
Bleeker, Martha [126-226] Mathematica Policy Research; 609-275-2269; [email protected]
Block, Carolyn [673] Illinois Criminal Justice Information Authority; [email protected]
Blough, Joan M [630] Great Start Early Childhood Investment Corporation; 517-371-9000; [email protected]
Blumenthal, Daniel [541] Morehouse School of Medicine; 404-752-1625; [email protected]
Blumhardt, Felix [291] The Evaluation Group; 803-454-2012; [email protected]
Blust, Kendal [693] Brigham Young University; 520-243-3038; [email protected]
Boardman, Craig [569] Ohio State University; [email protected]
Boeke, Melissa [137] Minnesota Institute of Public Health; 763-427-5310 x133; [email protected]
Bohman, Thomas [137] University of Texas, Austin; 512-232-0605; [email protected]
Bohni Nielsen, Steffen [121] Rambøll Management Consulting; +45-2948-8103; [email protected]
Bolland, Kathleen [409-734] University of Alabama; 205-348-3926; [email protected]
Boller, Kimberly [307] Mathematica Policy Research; 609-275-2341; [email protected]
Bolton, Patricia [437-816] Battelle Memorial Institute; 206-528-3310; [email protected]
Bolton-Gary, Cynthia [137] University of South Carolina, Beaufort; 843-208-8230; [email protected]
Bonbright, David [703] Keystone Accountability; +44-773-403-7455; [email protected]
Bond, Sally [510] The Program Evaluation Group LLC; 919-545-9200; [email protected]
Bonnet, Deborah [235-736] Fulcrum Corporation; 703-876-9750 x209; [email protected]
Bonney, Richard [267-347] Cornell Univeristy; 607-254-2442; [email protected]
Booker, Cristina [227] Abt Associates Inc; 617-349-2681; [email protected]
Boothroyd, Roger [262-718] University of South Florida; 813-974-1915; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 174
Borden, Lynne [534-773] University of Arizona; 520-621-1063; [email protected]
Borenstein, Juliana [137] National School of Public Health (ENSP/Fiocruz); +55-21-2598-2444; [email protected]
Borgman-Arboleda, Catherine [253] City University of New York (CUNY); 646-249-3027; [email protected]
Boris, Elizabeth [745] Urban Institute; 202-261-5770; [email protected]
Borland, Jennifer [640] Rockman et al; 812-333-8883; [email protected]
Borman, Kathryn [137] University of South Florida; 813-974-9058
Boruch, Robert F [614] University of Pennsylvania; [email protected]
Bosma, John [301] WestEd; 562-799-5122; [email protected]
Boucher, Suzanne [541] Wayside Youth and Family Support Network; 617-926-3600 x309; [email protected]
Bouroncle, Alberto [669] LTG Associates Inc; 301-270-0882; [email protected]
Bowen, Kathryn A [597-696-821-897] Centerstone Research Institute; 615-460-4166; [email protected]
Bower, Don [519-623-678-809] University of Georgia; 706-542-7566; [email protected]
Bowerman, Rashell [811] Western Michigan University; 269-275-2981
Bowles, Scott [846] United States Environmental Protection Agency; 202-566-2208; [email protected]
Boyce, Ayesha [137-208-502-591] University of Illinois at Urbana-Champaign; 602-614-6039; [email protected]
Boyd, Heather [612] Virginia Polytechnic Institute and State University; 540-231-9423; [email protected]
Boyle, Shanelle [222-802] EVALCORP; 949-466-9108; [email protected]
Bracamonte-Wiggs, Christine [534-773] University of Arizona; 520-621-9756; [email protected]
Bracken, Roxie [605] Keenesburg School District; 303-536-2006; [email protected]
Bradford, Sarah [116-831] Kansas State University; 785-532-5930; [email protected]
Bradley-Bull, Kristin [240] New Perspectives Consulting Group; 919-286-5995; [email protected]
Bradshaw, Wendy [722] University of South Florida; 813-974-4509; [email protected]
Brandão, Daniel [261-900] Fonte Institute; +551130321108; [email protected]
Brandon, Paul [611-812] University of Hawaii; 808-956-4928; [email protected]
Bransfield, Christopher [137-879] Concord Evaluation Group LLC; 978-369-3519; [email protected]
Brassell, Thomas [658-695-829] United States Department of Veterans Affairs; 513-247-2251; [email protected]
Braun, Drew [380-626] Bethel School District; 541-689-3280; [email protected]
Braun, Fern M [527] RTI International; 919-541-7112; [email protected]
Braun, Margaret [348] Oregon Department of Corrections; 503-945-9001; [email protected]
Braverman, Marc [128] Oregon State University; 541-737-1021; [email protected]
Bravo, Carlos [547] Evaluation, Management & Training Associates Inc; 916-983-6693; [email protected]
Braza, Mark [647] United States Government Accountability Office; 202-512-7187; [email protected]
Braziel Rollins, Kayla [226-305] Texas A&M University; 979-845-8363; [email protected]
Breck, Andrew [118] ICF Macro; 646-695-8140; [email protected]
Brees, Linda [830] Greenville Hospital System; 864-467-3333; [email protected]
Breihan, Ann [613] College of Notre Dame of Maryland; 410-532-5554; [email protected]
Bremner, Larry K [238-252] Proactive Information Services Inc; 204-292-7880; [email protected]
Brennan, Kathy [808] Innovation Network; 202-728 0727 x101; [email protected]
Brenner, Ashley [730] Science and Technology Policy Institute; 202-419-3722; [email protected]
Brett, Belle [137] Brett Consulting Group; 617-628-2068; [email protected]
Brewington, Dave [137] YMCA of the USA; 312-419-8288; [email protected]
Briceno, Bertha [789] World Bank; 202-473-1000; [email protected]
Bridwell, Sandra [809] Cambridge College; [email protected]
Briggs, Ronetta [137] O Si Yo Communications; 972-741-5756; [email protected]
Briggs, Susan [212] Independent Consultant; 503-288-0824; [email protected]
Brindis, Claire [592-797] University of California, San Francisco; 415-476-5255; [email protected]
Bristol, Hollace [223] Coconino County Education Services Agency; 928-679-8060; [email protected]
Britt, Heather [283] Independent Consultant; +20-10-387-5228; [email protected]
Britton, Edward [226] WestEd; 650-381-6416; [email protected]
Brock, Andrea [304] Center for Effective Philanthropy; 617-492-0800 x231; [email protected]
Brock, Donna [787] Evaluation Consulting Services Inc; 540-343-9977; [email protected]
Brodersen, Marc [595-850] University of Colorado, Denver; 303-315-3617; [email protected]
Brooks, Pauline [310-817-823] Independent Consultant; 323-821-5891; [email protected]
Brough, Steffan [268] Education Review Office; [email protected]
Broughton, Edward [558] University Research Company LLC; 917-204-0663; [email protected]
Brouselle, Astrid [749] University of Sherbrooke; 450-466-5000 x3682; [email protected]
Broussard, Jennifer [376] Texas Education Agency; 512-463-1241; [email protected]
Broussard, Marsha [222-320-884] Louisiana Public Health Institute; 504-301-9800; [email protected]
Brown, Adama [137] University of Texas, Austin; 232-4762; [email protected]
Brown, Charles [137] Centerstone Research Institute; 615-463-6641; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 175
Brown, Corliss [596] University of North Carolina at Chapel-Hill; 919-843-7878; [email protected]
Brown, Courtney [566-874] Indiana University; 812-330-1706; [email protected]
Brown, Gary [635] Washington State University; 509-335-1352; [email protected]
Brown, Jacqueline [541] Empowerment Resource Center for Women Inc; 770-234-9902; [email protected]
Brown, Jim [355] University of Minnesota; 612-624-7754; [email protected]
Brown, Kristin [137] Centers for Disease Control and Prevention; 770-488-6414; [email protected]
Brown, Lisanne [222-320-382-592-708-797-884] Louisiana Public Health Institute; 504-301-9813; [email protected]
Brown, Prudence [104] Independent Consultant; 212-662-2056; [email protected]
Brown, Tom [320] NC Health and Wellness Trust Fund; 919-855-6887; [email protected]
Brown Urban, Jennifer [283] Montclair State University; [email protected]
Brownson, Carol [723] Washington University in St Louis; 314-286-1915; [email protected]
Bruce, Catherine D [900] Trent University; 705-748-1011 x7500; [email protected]
Bruckner, Monica [214] Carleton College; 507-222-7096; [email protected]
Bruhn, Thea C [528-561] United States Department of State; 202-647-9897; [email protected]
Brun, Carl [508] Wright State University; 937-775-2868; [email protected]
Brunner, Wendy [279] Minnesota Department of Health; 651-201-5895; [email protected]
Bryant, Jeff [684] Community Foundation for Monterey County; 831-375-9712; [email protected]
Bryant, Max [137] Washington University in St Louis; 314-935-3734; [email protected]
Buchan, Alison [387] University of British Columbia; 604-822-0763; [email protected]
Budiharsana, Meiwita [641] Population Council; +844-3-7345821; [email protected]
Bufford, Jennifer L [133] Marshfield Clinic; 715-221-8939; [email protected]
Buhler, Holly [758] University of British Columbia; 604-875-4111 x66021; [email protected]
Buller-Taylor, Terri [758] Independent Consultant; 604-241-9503; [email protected]
Burch, Vanessa [256] University of Cape Town; +021-6714255; [email protected]
Burden, Frances [137] Quill Research Associates; 202-412-0301; [email protected]
Burdick, Williams [256] Foundation for Advancement of International Medical Education and Research; 215-823-2232; [email protected]
Burgess, Wilella [392] Purdue University; 765-494-0668; [email protected]
Burke, Brian [896] RTI International; 919-541-6851; [email protected]
Burke, Michael [293-896] RTI International; 202-974-7805; [email protected]
Burkhardt, Jason [137-358] Western Michigan University; 386-473-2207; [email protected]
Burkum, Kurt [342-424-763-843] ACT; 319-341-2301; [email protected]
Burley, Kim [137] Centers for Disease Control and Prevention; 770-488-6321; [email protected]
Burr, Erin [315-532-872] Oak Ridge Institute for Science and Education; 757-567-9058; [email protected]
Burroughs, Beth [804] Montana State University; 877-572-5032; [email protected]
Bush Stevens, Amy [364] Owl Creek Consulting; 740-427-2802; [email protected]
Buteau, Ellie [304] Center for Effective Philanthropy; 617-492-0800 x213; [email protected]
Butler, Mary Odell [662] University of Maryland; 703-860-6564; [email protected]
Byrum, Lorrie [801] Oklahoma Department of Mental Health and Substance Abuse Services; 405-522-6169; [email protected]
CCCCCCCC
Cabell, Stephanie [528-561] United States Department of State; 202-647-2557; [email protected]
Cabin, William [137] Richard Stockton College; 201-445-9180; [email protected]
Cabral, Linda [658-841] University of Massachusetts; 508-856-8423; [email protected]
Cahalan, Margaret [887] United States Department of Education; 202-401-1679; [email protected]
Cai, Xinsheng [137] American Institutes for Research; 202-403-6929; [email protected]
Calhoun, Avery [711] University of Calgary; 780-492-2520; [email protected]
Callahan, Jane [630] Community Anti-Drug Coalitions of America; 703-706-0560 x229; [email protected]
Callander, Najah [585] United Way of Greater Houston; 713-685-2456; [email protected]
Callow-Heusser, Catherine [369] EndVision Research and Evaluation LLC; 435-881-8811; [email protected]
Camacho, Alex [698] Nemours Health and Prevention Services; 302-444-9187; [email protected]
Camillo, Furio [826] University of Bologna; +39(051)2098251; [email protected]
Campbell, David [231-344] Science-Metrix Corp; 800-299-8061; [email protected]
Campbell, Johnavae [137-596-876] University of North Carolina at Chapel-Hill; 919-843-7878; [email protected]
Campbell, Suellen [137] St Catherine University; 651-690-6586; [email protected]
Campbell, William [713] Institute for Community Living Inc; 718-369-7226 x227; [email protected]
Campos, Henry [256] Universidade Federal do Ceará; +55-85-33667452; [email protected]
Candido, Tamara [537] Indian and Northern Affairs Canada; 613-947-9236; [email protected]
Canen, Eric [715-866] University of Wyoming; 307-760-0307; [email protected]
Cantillon, Dan [686] ICF International; 703-934-3000; [email protected]
Cao Yu, Hanh [264] Social Policy Research Associates; 510-763-1499 x631; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 176
Capela, Stanley [308-388-880] HeartShare Human Services of New York; 718-422-4248; [email protected]
Caracelli, Valerie J [228-322-371] United States Government Accountability Office; 202-512-9792; [email protected]
Cardoso, Gisela [137] National School of Public Health (ENSP/Fiocruz); +55-21-3298-8582; [email protected]
Carey, Martha Ann [367-667] Maverick Solutions; 626-710-2063; [email protected]
Carillo, Nancy [234] Albuquerque Public Schools; 505-872-6804; [email protected]
Carleton-Hug, Annelise [267-281-427] Trillium Associates; 724-963-5406; [email protected]
Carley, Stephen [311] Georgia Institute of Technology; [email protected]
Carman, Joanne [365-803] University of North Carolina at Charlotte; 704-687-4533; [email protected]
Carnevale, John [801] Carnevale Associates LLC; 301-977-3600; [email protected]
Carney, Jennifer [277] Abt Associates Inc; 301-634-1747; [email protected]
Carothers, Bobbi [675-827] Washington University in St Louis; 314-935-3745; [email protected]
Carouthers, Dewey [137] 180 Degree Change; [email protected]
Carpenter, Jenneth [801] Advocates for Human Potential; 260-449-9423; [email protected]
Carpenter, Laurie [137] University of Michigan; 734-615-7825; [email protected]
Carr, Matthew [526] Westat; 301-610-5513; [email protected]
Carran, Deborah [845] Johns Hopkins University; 410-516-9753; [email protected]
Carrillo, Nancy [109-267] Albuquerque Public Schools; 505-934-0680; [email protected]
Carswell, Peter [780] University of Auckland; +0064 9 373 7599; [email protected]
Carter, Frances [551-876] University of Maryland, Baltimore County; 901-483-2186; [email protected]
Caruthers, Flora [362] Florida Legislature; 850-487-9226; [email protected]
Carvalho, Soniya [316] World Bank; 202-473-5705; [email protected]
Cash, Timothy [273] University of Illinois at Urbana-Champaign; 217-333-5350; [email protected]
Casillas, Wanda [283-381] Cornell University; 210-347-4914; [email protected]
Cassaro, Denice [318-559-696] Cornell University; 607-256-0373; [email protected]
Castañeda-Emenaker, Imelda [117-261-392] University of Cincinnati; 513-556-3816; [email protected]
Castellow, Jennifer [280] University of South Carolina; 919-274-5265; [email protected]
Castro, Karim [319] Consorcio por la Salud, Ambiente y Desarrollo (ECOSAD); + 51 1 332 5713
Cater, Melissa [692] Louisiana State University; 225-578-2903; [email protected]
Catrambone, Jennifer [859] Ruth M Rothstein CORE Center; 312-572-4512; [email protected]
Catsambas, Tessie [439-738-815] EnCompass LLC; 301-299-3266; [email protected]
Caudle, Sharon [816] Texas A&M University; 979-845-1673; [email protected]
Cauley, Katherine [508] Wright State University; 937-258-5546; [email protected]
Caveny-Cox, Chris [137] North Carolina State University; 704-922-2126; [email protected]
Cawley, Marge [562] National Development and Research Institutes (NDRI); 919-863-4600 x223; [email protected]
Caywood, JoAnna [320] Lucile Packard Foundation for Children's Health; 650-724-1618; [email protected]
Cecil, Heather [126] Center for Schools and Communities; 717-763-1611 x198; [email protected]
Cellar, Douglas [325] DePaul University; 773-325-7887; [email protected]
Cerna, Rebeca [683] WestEd; [email protected]
Cervantes, Bianca [387] University of British Columbia; 604-822-2083; [email protected]
Chacko, Thomas [256] PSG Institute of Medical Sciences and Research; +91-422-2570170; [email protected]
Chakraborty, Bubli [137] Provincial Health Services Authority of Bristish Columbia; 604-219-2734; [email protected]
Chamberlin, Cliff [682] MANILA Consulting Group Inc; 571-633-9797; [email protected]
Champion, Heather [595] Center for Creative Leadership; 336-286-4230; [email protected]
Chan, Tsze [645] American Institutes for Research; [email protected]
Chang, Chin-Wen [137] National Applied Research Laboratories; 886-2-2882-4564; [email protected]
Chansky, Melanie [321] National Recreation and Parks Association; 571-439-4812; [email protected]
Chapel, Thomas [107-619-819-867] Centers for Disease Control and Prevention; 770-488-6467; [email protected]
Chapin, Deborah A [598] Excelsior College; 518-463-8115; [email protected]
Chapman, Melissa [133-265-525-734] University of Iowa; 319-360-0907; [email protected]
Chappelle, Eileen [137] Centers for Disease Control and Prevention; 770-488-8144; [email protected]
Charon, Rita [137] Columbia University; 212-305-4942; [email protected]
Chatterji, Madhabi [400] Columbia University; [email protected]
Chatters, Seriashia [383-541] University of South Florida; 813-732-5865; [email protected]
Chavez, Margeaux [137] University of South Florida; 813-974-9412
Chavis, David M [264] Community Science; 301-519-0722; [email protected]
Chazdon, Scott [733] University of Minnesota; 612-624-0982; [email protected]
Checkoway, Berry [401] University of Michigan; 734-763-5960; [email protected]
Chelimsky, Eleanor [100-102-506] Independent Consultant; [email protected]
Chelyshkova, Marina [375] State University of Management; 499-784-6301; [email protected]
Chen, Ge [594] University of Texas, Austin; 512-471-1205; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 177
Chen, Huey [243] Centers for Disease Control and Prevention; 770-488-3732; [email protected]
Chen, Hui-Jung [137] National Taiwan Normal University; 886-2-7734-6817; [email protected]
Chen, Lynn [137] University of Texas, Austin; 512-232-4761; [email protected]
Chen, Mei-kuang [206-586-666-719] University of Arizona; 520-621-5463; [email protected]
Cheney, David [567] SRI International; 703-247-8707; [email protected]
Chi, Bernadette [125] University of California, Berkeley; 510-643-1294; [email protected]
Chianca, Thomaz [587-738-815-898] COMEA Evaluation Ltd; +55 21 9880-3683; [email protected]
Chiasson, Emily [699] Institute for Community Health; 617-499-6613; [email protected]
Chien, Victoria [280-704] University of South Carolina; 517-927-9494; [email protected]
Childs, Karen [606] Florida Positive Behavior Support; 813-974-7358; [email protected]
Chinman, Matthew [699] RAND Corporation; 818-481-3909; [email protected]
Chitiyo, George [137] Tennessee Technological University; 931-372-3676; [email protected]
Chiu, Korinne [137-656] University of North Carolina at Greensboro; 305-905-0712; [email protected]
Chiu, Mei-Hung [137] National Taiwan Normal University; 886-2-7734-6817; [email protected]
Cho, Hyunjung [810] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); +82-2-589-2942; [email protected]
Chou, Tommy [900] University of Cincinnati; 817-994-0426; [email protected]
Chouinard, Jill Anne [252-291] University of Ottawa; 613-722-6384; [email protected]
Chovnick, Gary [137-779] Battelle Memorial Institute; 206-528-3013; [email protected]
Chow, Wai-Ying [881] University of Maryland; [email protected]
Chrispim, Pedro Paulo [137-814] National School of Public Health (ENSP/Fiocruz); +55-21-25982861; [email protected]
Christensen, Kristin [137] University of Texas, Austin; 512-232-0606; [email protected]
Christian, Carole [271] National Institutes of Health; 301-451-7431; [email protected]
Christian, Cinda [509] Austin Independent School District; 512-414-3461; [email protected]
Christie, Christina [220-353-393-498-894] University of California, Los Angeles; 310-825-0432; [email protected]
Chung, Yi-Hsing [375] National Chi Nan University; 886-49-2911-242; [email protected]
Cianca, Marie [788] St John Fisher College; 585-899-3878; [email protected]
Cicchinelli, Louis [589-645] Mid-continent Research for Education and Learning; 303-632-5518; [email protected]
Cici, Kristen [137-571] University of Minnesota; 651-353-2085; [email protected]
Ciminillo, Cara [134-223-305-515] University of Pittsburgh; 412-624-7240; [email protected]
Cinnamond, Karen [331] Human Development Institute; 859-977-4050 x222; [email protected]
Cisneros-Cohernour, Edith J [137-294] University of Yucatan; +52999-9224557; [email protected]
Cisterna - Alburquerque, Dante [532] Michigan State University; 517-432-8388; [email protected]
Clark, Heather [137] Texas A&M University; 979-845-6957; [email protected]
Clark, Helene [703] ActKnowledge; 212-817-1906; [email protected]
Clark, Melissa [884] Mathematica Policy Research; 609-799-3535; [email protected]
Clark, MH [120-799] University of Central Florida; 618-453-3551; [email protected]
Clark, Sherrill [379] California Social Work Education Center; 510-642-9272; [email protected]
Clasen, Carla [508] Wright State University; 937-258-5543; [email protected]
Clawson, Heather [137-259] ICF International; 703-225-2247; [email protected]
Clay, Phyllis [234-346] Albuquerque Public Schools; 816-935-1532; [email protected]
Clements, Christine [658-841] University of Massachusetts; 508-856-6521; [email protected]
Clements, Paul [132] Western Michigan University; 269-387-5699; [email protected]
Clementz, A Rae [656] University of Illinois at Urbana-Champaign; 217-615-4201; [email protected]
Cline, Rebecca [364] The Ohio Domestic Violence Network; 1-800-934-9840; [email protected]
Clinton, Janet [393-780] University of Auckland; 649 3737599; [email protected]
Clinton-Sherrod, A Monique [137] RTI International; 828-293-3989; [email protected]
Coats, Sue [245] Turning Point Inc; 586-463-4430
Cobigo, Virgine [749] Queen's University at Kingston; 613-533-6000 x77676; [email protected]
Coburn, Jamie [137] Tennessee Technological University; 931-526-1870; [email protected]
Coffey, Debra [526-799] Research for Better Schools; 215-568-6150; [email protected]
Coffey, John [137] Claremont Graduate University; [email protected]
Coffman, Julia [124-212-505-830] Center for Evaluation Innovation; 703-837-8358; [email protected]
Coghlan, Anne [757] Pact Inc; +66 81 900 0220; [email protected]
Cohen, Barry [419-536-798] Rainbow Research Inc; 612-824-0724 x202; [email protected]
Cohen, Benjamin [126] Center for Schools and Communities; 717-763-1161 x159; [email protected]
Cohen, Elaine [137] National Parkinson Foundation; 212-873-0739; [email protected]
Cohen, Marcia [228] Development Services Group Inc; 301-951-0056; [email protected]
Cohn, Sarah [548] Science Museum of Minnesota; 651-265-5972; [email protected]
Coker, Elizabeth [803] Lenox Hill Neighborhood House; 212-744-5022; [email protected]
Cole, Janice [831] Kansas State University; 795-532-5930; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 178
Cole, Russell [307] Mathematica Policy Research; 609-716-4549; [email protected]
Cole Beebe, Maggie [885] RTI International; 781-434-1728; [email protected]
Coleman, Marcus [678] University of Georgia; [email protected]
Coleman, Stephanie [622-761] University of Missouri; 573-300-7615; [email protected]
Collier-Goubil, Deshonna [673] National Institute of Justice; 707-980-3161; [email protected]
Collins, Charles [137-630-710] Michigan State University; 530-321-0155; [email protected]
Collins, Isabelle [527] Technopolis; [email protected]
Collins, Krista [126-226] Claremont Graduate University; 858-922-6596; [email protected]
Colombo, Marie [264] Skillman Foundation; 313-393-1151; [email protected]
Colomer, Soria E [671-768] University of Georgia; 601-278-5820; [email protected]
Colvin, Delta Q [137] Wichita State University; 316-978-3317; [email protected]
Coman, Emil [137-262-600] Institute for Community Research; 860-278-2044 x257; [email protected]
Comer Cook, Tiffany [771-840] University of Wyoming; 307-760-1911; [email protected]
Compton, Donald [588-698] Centers for Disease Control and Prevention; 678-457-3155; [email protected]
Conley, Dave [137] Museum of Science and Industry; [email protected]
Conner, Ross [102-815] University of California, Irvine; 949-824-0563; [email protected]
Connor, Christine [397] American Red Cross; 202-303-4567; [email protected]
Connors, Susan [385-595-850] University of Colorado, Denver; 303-460-0275; [email protected]
Cook, Elisabeth [602] Westat; 240-453-2917; [email protected]
Cooksy, Leslie [100-282-322-500-580-622-822-902] University of Delaware; 302-831-6872; [email protected]
Cooper, Andrew [212] Diana, Princess of Wales Memorial Fund; +44 0 20 7902 5521; [email protected]
Cooper, Peter [224] Room to Read; 415-561-3331 x120; [email protected]
Copeland-Carson, Jacqueline [662] Copeland Carson & Associates; 408-674-2563; [email protected]
Coplen, Michael [235-736] United States Department of Transportation; 202-493-6346; [email protected]
Coppola, Nanci [317] Program Reach Inc; 718-409-0800; [email protected]
Corliss, Stephanie [879] University of Texas, Austin; 512-232-1506; [email protected]
Corn, Jenifer [137] North Carolina State University; 919-513-8527; [email protected]
Cornetto, Karen [386] Austin Independent School District; 512-414-3661; [email protected]
Cornish, Disa [373] University of Northern Iowa; 319-273-7476; [email protected]
Corron, Amy [585] United Way of Greater Houston; 713-685-2302; [email protected]
Coryn, Chris [393] Western Michigan University; 269-387-5906; [email protected]
Cosentino de Cohen, Clemencia [277-371] Urban Institute; 202-261-5409; [email protected]
Costantino, Tracie [768] University of Georgia; 706-542-1640; [email protected]
Costello, Humphrey [546-715] University of Wyoming; 307-399-8484; [email protected]
Cotner, Bridget [137] University of South Florida; 813-974-7384; [email protected]
Coulbertson, LaShonda [740] Center for Equal Health; 813-468-7165; [email protected]
Coulbertson, LaShonda T [740] Center for Equal Health; 813-468-7165; [email protected]
Coulter, Andrea [137] Southern Illinois University Carbondale; 618-453-5371; [email protected]
Coulton, Claudia [306] Case Western Reserve University; 216-368-2708; [email protected]
Cousins, J Bradley [137-236-291-498-815] University of Ottawa; 613-562-5800 x4036; [email protected]
Coverdale, Bradley [137] University of Maryland; 330-464-2397; [email protected]
Cowell, Alex [578] Georgia Department of Community Health; 404-463-2725; [email protected]
Cox, Matt [693] Brigham Young University; 801-636-6698; [email protected]
Cozzens, Susan [391] Georgia Institute of Technology; 404-385-0397; [email protected],edu
Craig, Diane [394] University of Florida; 352-332-1587; [email protected]
Crain, Cathleen [669] LTG Associates Inc; 301-270-0882; [email protected]
Cram, Fiona [591] Katoa Ltd; +64-9-5502231; [email protected]
Crave, Mary [238-439-534-697] University of Wisconsin; 608-262-6677; [email protected]
Crawford, Jewel [137] Wholistic Stress Control Institute Inc; 404-755-0068 x3017; [email protected]
Crohn, Kara [427-607] Research Into Action; 951-742-5619; [email protected]
Crosse, Scott [721] Westat; 301-294-3979; [email protected]
Crowder, Isabelle [768] University of Georgia; 706-546-9168; [email protected]
Crusto, Cindy A [211-242] Yale University; 203-789-7645; [email protected]
Cruz, Kari [720] Centers for Disease Control and Prevention; 770-488-0789; [email protected]
Cruz, Marly [137-511-814] National School of Public Health (ENSP/Fiocruz); +55 21 25982861; [email protected]
Cullen, Anne [265-282-514-740] Western Michigan University; 269-387-5918; [email protected]
Cullen, Marica [203] Illinois State Board of Education; 217-557-7323; [email protected]
Culver, Steve [594] Virginia Tech; 540-231-4581; [email protected]
Cummings, Harry [898] University of Guelph; 519-823-1647; [email protected]
Cummings, Megan [682] MANILA Consulting Group Inc; 571-633-9797; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 179
Cundiff, Nicole [130-137] University of Alaska, Fairbanks; 217-390-7741; [email protected]
Curiel, Joseph [763] Action Consulting and Evaluation Team (ACET) Inc; 952-922-1811; [email protected]
Currie, Michelle [336] Cornell University; 212-340-2949; [email protected]
Curry Villeneuve, Jennifer [257] BTW Informing Change; 510-665-6100; [email protected]
Curtis, LaShawn [717] RTI International; 770-407-4913; [email protected]
Curtis, Patrick [707] Walter R McDonald and Associates Inc; 301-881-2590 x245; [email protected]
DDDDDDDD
D‘Attoma, Ida [826] University of Bologna; +39(051)264182; [email protected]
Daffin, Larry [671] New York University; 832-453-8814; [email protected]
Dahlke, Katie [306] Learning Point Associates; 630-649-6628; [email protected]
Dai, Tao [254] Chinese Academy of Sciences; [email protected]
Daltuva, Judith [355] University of Michigan; 734-936-0756; [email protected]
D'Amante, Dannalea [137] City Year Inc; 617-927-2436; [email protected]
D'Amico, Leigh [137-874] University of South Carolina; 704-919-1967; [email protected]
Damle, Ranjana [109-234-244] Albuquerque Public Schools; 505-872-6801; [email protected]
Daniel-Echols, Marijata [254-513] HighScope Educational Research Foundation; 734-485-2000 x275; [email protected]
Daniels, Jason [356] University of Alberta; 780-492-6332; [email protected]
Dannreuther, Maggie [244] Stennis Space Center; 228-688-2003; [email protected]
Danter, Elizabeth [267] Institute for Learning Innovation; 410-956-5144; [email protected]
Darandari, Eqbal [860] National Commission on Academic Assessment and Accreditation; 955-5-059-6785; [email protected]
Daro, Deborah [307] Chapin Hall; 773-256-5127; [email protected]
Dasgupta, Sathi [553] SONA Consulting Inc; 301-775-3380; [email protected]
Davidson, Jane [229-800] Real Evaluation Ltd; +64-9-575-1982; [email protected]
Davidson, Katrina [519] Augusta Partnership for Children Inc; 706-721-4885; [email protected]
Davidson, Pamela [590] University of California, Los Angeles; 310-825-7188; [email protected]
Davidson, Tala [436] Western Michigan University; 269-903-9680; [email protected]
Davies, Randy [435-752] Brigham Young University; 801-422-5229; [email protected]
Davis, Helena L [730] National Institute of Environmental Health Sciences; 919-316-4813; [email protected]
Davis, James Earl [200-322] Temple University; [email protected]
Davis, Mende [719-824] University of Arizona; 520-626-7820; [email protected]
Davis, Owen [824] University of Arizona; 520-621-7953; [email protected]
Davis, Sarita [629-696] Georgia State University; 404-413-5134; [email protected]
Davis-White, Nicole [137] Family Resource Center of South Florida; 954-232-3766; [email protected]
Dawes, Katherine [542-687] United States Environmental Protection Agency; 202-566-2189; [email protected]
Dawkins, Nicola [118] ICF Macro; 404-592-2136; [email protected]
Daws, John T [339-420-559-628] University of Arizona; 520-318-7259 x119; [email protected]
de Alteriis, Martin [237] United States Government Accountability Office; 703-525-9153; [email protected]
de Guzman, Anna [137-208] University of Denver; 303-871-4198; [email protected]
De La Cerda, H Pamela [776] Centers for Disease Control and Prevention; 404-639-8920; [email protected]
De La Rosa, Josue [582] Research Works Inc; 914-333-7946; [email protected]
de Mello, Maeve B [636] Pact Inc; 202-466-5666; [email protected]
De Ruijter De Wildt, Marieke [543] LEI Wageningen UR; +31-70-3358368; [email protected]
Dean, Allyson [798] University of Southern Maine; 207-780-5833; [email protected]
Dean-Coffey, Jara [284-891] jdcPartnerships; 415-482-7839 x2; [email protected]
Debrot, Karen [899] Centers for Disease Control and Prevention; 770-488-1037; [email protected]
Decker, Lauren [137] Edvance Research; 210-558-4148; [email protected]
Decker, Sarah [137-729] ICF International; 703-225-2244; [email protected]
Decotelli, Paula Vita [137-511-814] National School of Public Health (ENSP/Fiocruz); +55 21 88430548; [email protected]
DeGroff, Amy [776] Centers for Disease Control and Prevention; 770-488-2415; [email protected]
DeHart, Dana [878] University of South Carolina; 803-777-7867; [email protected]
DeJoy, Sharon [306] State University of New York College at Potsdam; 315-267-3136; [email protected]
Deke, John [265] Mathematica Policy Research; 609-275-2230; [email protected]
Del Grosso, Patricia [307] Mathematica Policy Research; 609-275-2252; [email protected]
Del Vecchio, Ann [417-857] Alpha Assessment Associates; 505-341-2263; [email protected]
Delaney, Linda [704] LFD Consulting LLC; 870-225-1103; [email protected]
Delgatty, Christi [697] Texas State University; 719-761-5145; [email protected]
Deluhosh, Karen [137] Center for Health Training; 206-447-9538; [email protected]
Derzon, Jim [320-721] Battelle Memorial Institute; 703-248-1640; [email protected]
Desai, Mona [126-802] EVALCORP; 510-332-8242; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 180
Desiderio, Gina [312] Healthy Teen Network; 410-685-0410; [email protected]
Destefano, Lizanne [225] University of Illinois at Urbana-Champaign; 217-333-9625; [email protected]
Deussen, Theresa [811] Education Northwest; 503-275-9500; [email protected]
Devaney, Barbara [611-826] Mathematica Policy Research; 609-275-2389; [email protected]
Devaney, Tom [853] Weikart Center for Youth Program Quality; 734-961-6900; [email protected]
Devlin-Foltz, David [552] Aspen Institute; 202-736-5812; [email protected]
Dewey, Jennifer [244] James Bell Associates; 703-528-3230; [email protected]
DeWitt, Caroline [695] Human Resources and Skills Development; 613-523-9533; [email protected]
Diaz, Elizabeth [517] Gay, Lesbian & Straight Education Network; 646-388-8051; [email protected]
Diaz, Marycruz [214] WestEd; 510-302-4220; [email protected]
Diaz, Rebeca [383] WestEd; 510-302-4275; [email protected]
Diaz Puente, Jose Maria [435-704] Polytechnic University of Madrid; +34-91-336-3986; [email protected]
Dick, Virginia [137-230-244-310-519-623-678-809] University of Georgia; 706-542-6272; [email protected]
Dickenson, Tammiee [225-606-685] University of South Carolina; 803-777-1246; [email protected]
Dickinson, Pauline [137] Massey University; +6493666136; [email protected]
Dickinson, Wendy [137] Ringling College of Art and Design; 941-323-1177; [email protected]
Diehl, David [129-734] University of Florida; 352-273-3526; [email protected]
Dietsch, Barbara [683] WestEd; 562-799-5126; [email protected]
Dillman, Lisa [389] University of California, Los Angeles; 310-206-6944; [email protected]
Dilworth, Caroline [730] National Institute of Environmental Health Sciences; [email protected]
Diserens, Deborah [256] Foundation for Advancement of International Medical Education & Research; 215-823-2292; [email protected]
Disler, Sheri [709] Centers for Disease Control and Prevention; 770-488-3713; [email protected]
Dixon, L Beth [118] New York University; 212-998-5584; [email protected]
Dixon, Maressa [137] University of South Florida; 813-974-9412; [email protected]
Dixon-Reeves, Regina [677] Lloyd A Fry Foundation; 312-580-0310; [email protected]
Doberneck, Diane [543] Michigan State University; 517-353-8977; [email protected]
Dobrowlski, David [757] Pact Inc; +66 2 2313402; [email protected]
Dobrowski, David J [545] First 5 Monterey; 831-886-7177; [email protected]
Dobson, Noelle [212] Community Health Partnership; 503-227-5502; [email protected]
Doe, Christine [532-811] Queen's University at Kingston; 613-484-0811; [email protected]
Dokter, Erin [137] University of Arizona; 520-621-2440; [email protected]
Dolfin, Sarah [226] Mathematica Policy Research; 609-275-2365; [email protected]
Dollard, Norin [222] University of South Florida; 813-974-3761; [email protected]
Domoff, Sarah [119] Bowling Green State University; 203-788-2510; [email protected]
Donaldson, Joseph [274-394-434-652] University of Tennessee; 865-974-7245; [email protected]
Donaldson, Stewart [507-704-742-823] Claremont Graduate University; 909-607-9001; [email protected]
Donoff, Mike [261] University of Alberta; 780-492-1144; [email protected]
Donovan, Kristen [126-222] EVALCORP; 949-271-6437; [email protected]
Doolittle, Martha [509] Austin Independent School District; 512-414-3611; [email protected]
Dorabawila, Vajeera [120-419] New York State Office of Children and Family Services; 518-402-7386; [email protected]
Dorime-Williams, Marjorie [248] University of Illinois at Urbana-Champaign; 631-704-7491; [email protected]
Dorman, Rebecca [224] Room to Read; 415-561-3331 x122; [email protected]
Doucette, Ann [119-262] George Washington University; 202-994-8112; [email protected]
Downey, Gilbert [203] Illinois State Board of Education; 217-780-0336; [email protected]
Downs, Holly [208-589] University of Illinois at Urbana-Champaign; 217-372-5011; [email protected]
Doyle, Elizabeth [112] Take Action Minnesota; 651-379-0745; [email protected]
Drach, Linda [559-639] Oregon Public Health Division; 971-673-0591; [email protected]
Drake, Mary [278] Jhpiego; 202-203-0923; [email protected]
Drayton, Vonna [137-698] Nemours Health and Prevention Services; 302-444-9236; [email protected]
Drever, Anita [120-794] University of Wyoming; 307-399-4238; [email protected]
Drew, Christie [730] National Institute of Environmental Health Sciences; 919-544-9103; [email protected]
Dube, Shanta [378] Centers for Disease Control and Prevention; 770-488-6287; [email protected]
DuBow, Wendy [247-512-804] National Center for Women and Information Technology; 303-492-5462; [email protected]
Duffy, Jennifer [521-619] University of South Carolina; 803-600-8550; [email protected]
Duggan, Colleen [536] International Development Research Centre; 613-236-6163 x 2123; [email protected]
Duignan, Paul [137] Parker Duignan Consulting; +64 4 9739729; [email protected]
Dunavin, River [109-234] Albuquerque Public Schools; 505-872-6802; [email protected]
Dunaway, Krystall [137-872] Eastern Virginia Medical School; 757-668-6451; [email protected]
Dunet, Diane [137] Centers for Disease Control and Prevention; [email protected]
Dunn, Cindi [137-220] Kansas State University; 785-532-5930; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 181
Dunn, Lillian L [118] New York City Department of Health and Mental Hygiene; 212-442-1849; [email protected]
Duppong Hurley, Kristin [798] University of Nebraska, Lincoln; 402-472-5501; [email protected]
Durland, John [137] Durland Consulting; 859-200-7946; [email protected]
Durland, Maryann [137-410-595-855] Durland Consulting; 630-650-9944; [email protected]
Dussault, Mary [296] Harvard-Smithsonian Center for Astrophysics; 617-496-7962; [email protected]
Dyke Redmond, Tracy [601-846-862] Industrial Economics Inc; 617-354-0074 x193; [email protected]
Dyrenforth, Sue R [237-695] United States Department of Veterans Affairs; 513-247-4680; [email protected]
Dziadkowiec, Oliwier [137] Wichita State University; 316-978-3988; [email protected]
EEEEEEEE
Eames, Sandra [843] St Edward's University; 512-636-0530; [email protected]
Earle, Jane [381] Cornell University; 607-255-0397; [email protected]
Eblen, Matthew [271] National Institutes of Health; 301-443-5234; [email protected]
Eckman, Karlyn [127] University of Minnesota; 651-308-7285; [email protected]
Economos, Christina [400] Tufts University; [email protected]
Eddy, Rebecca [298-606] Cobblestone Applied Research & Evaluation Inc; 714-981-0422; [email protected]
Edelmann, Sid [352-570] World Bank; 202-458-4738; [email protected]
Eduardo, Marino [738] Independent Consultant; +55 11 8371-9989; [email protected]
Edwards, Alexa [137] University of North Carolina at Greensboro; 336-315-7436; [email protected]
Edwards, Jessica [522] Pacific Institute for Research and Evaluation (PIRE); 909-265-2636; [email protected]
Edwin, James [132] African Development Bank; +0021671102586; [email protected]
Eidhammer, Asbjorn [858] Noweigian Agency for International Cooperation; +47 22 24 0367; [email protected]
Eikenes, Morten [828] Office of the Auditor General of Norway; 472-224-1138; [email protected]
Eke, Adanze [360] MANILA Consulting Group Inc; 404-639-0931; [email protected]
Elgie, Susan [532] Independant Consultant; 416-531-9548; [email protected]
Elkins, Catherine [132] RTI International; 919-541-8898; [email protected]
Ellenbogen, Kirsten [877] Science Museum of Minnesota; 651-894-3373; [email protected]
Ellias, Juanita M [790] Rivercity Woodworking LLC; 414-272-0437; [email protected]
Ellis, Barbara [807] Centers for Disease Control and Prevention; 404-639-0637; [email protected]
Ellis, Bruce [320-627] Battelle Memorial Institute; 703-875-2965; [email protected]
Ellis, Katrina [817] University of Michigan; 734-845-6009; [email protected]
Elston Lafata, Jennifer [137-779] Virginia Commonwealth University; 804-628-3293; [email protected]
Endo, Hidenori [890] National Institute of Advanced Industrial Science and Technology; +81-29-862-6069; [email protected]
Enev, Tiho [698] Nemours Health and Prevention Services; 302-444-9246; [email protected]
Engle, Molly [274-667] Oregon State University; 541-737-4126; [email protected]
Engstrom, Martha [378-867] Centers for Disease Control and Prevention; 770-488-5749; [email protected]
Engstrom, Whitney [331] The Lewin Group; 703-269-5665; [email protected]
Enright Patterson, Tracy [595] Center for Creative Leadership; 336-286-4418; [email protected]
Enriquez-Olmos, Mariana [511-889] Independent Consultant; 303-755-4491; [email protected]
Enyia, Amarachuku [831] University of Illinois at Urbana-Champaign; 217-721-0164; [email protected]
Erchov, Simone [680] George Mason University; 703-993-8292; [email protected]
Erwin, Katherine [541] Morehouse School of Medicine; 404-756-5278; [email protected]
Escandon, Ines [301] Paraprofessional Healthcare Institute (PHI); 718-402-7766; [email protected]
Escoffery, Lorna [674-825] Escoffery Consulting Collaborative Inc; 305-987-8975; [email protected]
Espinoza, Robert [891] Funders for LGBTQ Issues; [email protected]
Essien, Joyce [541] Emory University; 404-727-7835; [email protected]
Estabrook, Linda [868] Hartford Gay and Lesbian Health Collective; 860-278-4163; [email protected]
Estrello, Fred [843] St Edward's University; 512-636-0530; [email protected]
Euale, David [851] Ontario Ministry of Education; 416-326-9369; [email protected]
Eugene, Ngole Masango [137] Non-governmental Organization (NGO); +237-74-08-50-29; [email protected]
Evan, Aimee [137] Quill Research Associates; 703-307-7559; [email protected]
Evans, Donoria [137] Morehouse School of Medicine; 404-752-1187; [email protected]
Evans, W Douglas [390] George Washington University; 202-994-3632; [email protected]
Everett, Kristin [747] Western Michigan University; 269-387-3791; [email protected]
Evergreen, Stephanie [232-670] Western Michigan University; 269-387-5920; [email protected]
Eyerman, Joe [896] RTI International; 919-541-7139; [email protected]
Ezumah, Bellarmine [541] Howard University; 347-351-1422; [email protected]
Ezzell, Mark [320] North Carolina Health and Wellness Trust Fund; 919-606-7584; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 182
FFFFFFFF
Fabian, Anupa [595] ICF Macro; 646-695-8178; [email protected]
Faddis, Bonnie [526] RMC Research Corporation; 503-223-8248; [email protected]
Falconer, Mary Kay [390] Ounce of Prevention Fund of Florida; 850-921-4494 x134; [email protected]
Fallik, Beverlie [556-801] United States Department of Health and Human Services; 240-276-2438; [email protected]
Farber, Stacey [137-216-676-885] Cincinnati Children's Hospital Medical Center; 513-803-0318; [email protected]
Farley, Joanne [211-331] Human Development Institute; 859-257-4921 x80248; [email protected]
Farr, Beverly [787] MPR Associates Inc; 510-849-4942; [email protected]
Farr, Erin [219] Wright State University; 937-545-2084; [email protected]
Farris, Kimberly [209] United States Army; 404-423-6799; [email protected]
Farris, Rosanne [378-698] Centers for Disease Control and Prevention; 770-488-5007; [email protected]
Favor, Kevin E [111-137-511] Lincoln University; 484-365-7587; [email protected]
Fee, Robert [702] Savannah College of Art and Design; 912-525-6679; [email protected]
Feger, Stephanie [832-882] Brown University; 401-274-9548; [email protected]
Feldman, Jill [606] Research for Better Schools; 215-568-6150 x267; [email protected]
Feldman, Laura [376-840] University of Wyoming; 307-399-1914; [email protected]
Felisberto, Eronildo [814] Municipal Institute for Research and Planning; [email protected]
Feller, Irwin [527] Pennsylvania State University; [email protected]
Feng, Annie [137] National Institutes of Health; 301-402-2927; [email protected]
Fernandez, Felix [259] ICF International; 703-225-2159; [email protected]
Fernando, Sheara [280] University of South Carolina; 803-629-5578; [email protected]
Ferrell, Nathalie [222-320-884] Tulane University; 504-988-6078; [email protected]
Ferron, John [740] University of South Florida; 813-974-5361; [email protected]
Fetterman, David [204-324-404-662-704-742] Fetterman & Associates; 650-269-5689; [email protected]
Field, Julie [306] First 5 Sacramento; 916-876-6526; [email protected]
Fierro, Leslie [279-589-691-709-894] SciMetrika; 909-987-4354; [email protected]
Fierro, Rita [310-370] Independant Consultant; 215-893-0579; [email protected]
Figueiredo, Cláudia [137-258] Institute for Learning Innovation; 410-956-5144; [email protected]
Figueredo, Aurelio Jose [719] University of Arizona; 520-621-7444; [email protected]
Filene, Jill [310] James Bell Associates; 954-659-8677; [email protected]
Fine, David [137] Center for Health Training; 206-447-9538; [email protected]
Fine, Wendy [285] Youth Guidance; 312-253-4900 x3920; [email protected]
Finegood, Diane [641] The CAPTURE Project; 778-782-6706; [email protected]
Finkbiner, Richard [682] MANILA Consulting Group Inc; 571-633-9797; [email protected]
Finkelstein, Daniel [126-245] Mathematica Policy Research; 617-301-8996; [email protected]
Finkelstein, Martin [137-317] Seton Hall University; 973-275-2056; [email protected]
Finney, Pamela B [137] University of North Carolina at Greensboro; 336-315-7456; [email protected]
Firth, Kim [299] Human Services Research institute; 503-924-3783 x-26; [email protected]
Fisch, Peter [726] European Commission; +32-2-296-2137; [email protected]
Fischer, Rob [117-306] Case Western Reserve University; 216-368-2711; [email protected]
Fisher, Holly [360] Centers for Disease Control and Prevention; 404-639-1940; [email protected]
Fitz, Gabriela [769] Issue Lab; 773-649-1790; [email protected]
Fitzpatrick, Jody [102] University of Colorado, Denver; 303-315-2085; [email protected]
Flaspohler, Paul [761] Miami University; 513-529-2469; [email protected]
Fleischer, Dreolin [393] Claremont Graduate University; 617-680-2775; [email protected]
Fleming, Lynette [267] Research, Evaluation & Development Services; 520-749-4909; [email protected]
Fletcher, Erica [619] Massachusetts Alliance on Teen Pregnancy; 617-482-9122; [email protected]
Flick, Arend [255] Norco College; 951-372-7028; [email protected]
Florin, Paul [699] University of Rhode Island; 401-874-1000; [email protected]
Fluellen, Anthony [137] Lincoln University; 610-717-8443; [email protected]
Flynn, Cynthia [878] University of South Carolina; 803-777-1378; [email protected]
Flynn, Shannon [564] South Carolina Campaign to Prevent Teen Pregnancy; 803-771-7700; [email protected]
Folkman, Daniel [790] University of Wisconsin, Milwakee; 414-227-3285; [email protected]
Fonseca, Claudia [137] Independent Consultant; 55-21-87602910; [email protected]
Forneris, Susan [137] St Catherine University; 651-690-6674; [email protected]
Foster, Gwen [379] California Social Work Education Center; 510-642-9272; [email protected]
Foster-Fishman, Pennie [630-710] Michigan State University; 517-353-5015; [email protected]
Fountain, Douglas [302] Outpourings; [email protected]
Fowler, Ted [117] University of Cincinnati; 513-403-7443; [email protected]
Fox, Christine [786] University of Toledo; 419-534-2578; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 183
Fox, Lindsay [829] Abt Associates Inc; 617-520-2516; [email protected]
Francis, David [526] University of Houston; 713-743-8533; [email protected]
Francis, Judith [296-380] Pima Prevention Partnership; 520-791-2771 x1425; [email protected]
Franck, Karen [394] University of Tennessee, Knoxville; 865-974-7457; [email protected]
Frank, Christine [337] Christine Frank & Associates; 705-835-3921; [email protected]
Frank, Jennifer [288] University System of Maryland; 301-445-2795; [email protected]
Franke, Todd [220-259-379-419] University of California, Los Angeles; 310-312-9202; [email protected]
Franz, Nancy [274-612-873] Virginia Tech; 540-231-1634; [email protected]
Fraser, John [267] Institute for Learning Innovation; 410-956-5144; [email protected]
Frasier, James [869] University of Wisconsin, Madison; 608-265-4579; [email protected]
Fraze, Jami [776] Centers for Disease Control and Prevention; [email protected]
Frazier, Rosyland [842] University of Alaska, Anchorage; 907-786-5432; [email protected]
Frazier-Anderson, Pamela [111-137-291-411-591] Lincoln University; 203-845-9111; [email protected]
Fredericks, Kimberly [595-775] The Sage Colleges; 518-292-1782; [email protected]
Freeman, Ade [570] World Bank; 202-473-9520; [email protected]
Freeman, Melissa [768] University of Georgia; 706-542-3613; [email protected]
French, Brian [137] Washington State University; 509-335-8584; [email protected]
Friedman, Elisa [541-619-699] Institute for Community Health; 617-499-6678; [email protected]
Friedman, Stacey [256-410] Foundation for Advancement of International Medical Education & Research; 215-823-2191;
[email protected]
Frierson, Henry [111] University of Florida; 352-846-0113; [email protected]
Frood, David [854] Independent Consultant; +61412 296 463; [email protected]
Fuentes, Stephanie [573] Inventivo Design LLC; 720-413-0600; [email protected]
Fuhrman, Nick [612] University of Georgia; 706-542-8828; [email protected]
Fukunaga, Landry [812] University of Hawaii; 808-956-9202; [email protected]
Fulmer, Erika [378] Centers for Disease Control and Prevention; 770-488-5334; [email protected]
Furlong, Michael [646] University of California, Santa Barbara; 805-453-4955; [email protected]
GGGGGGGG
Gaarder, Marie [614-789] International Initiative for Impact Evaluation (3ie); +91-11-26139494; [email protected]
Gabriel, Roy [682] RMC Research Corporation; 503-223-8248; [email protected]
Gaddy, Peggy [709] Missouri Asthma Prevention and Control Program; 573-522-2876; [email protected]
Gadsden, Paola [614] Instituto Nacional de Salud Publica; [email protected]
Gaiser, Melanie [676] Brandeis University; 603-682-2040; [email protected]
Galen, Matthew [261-393] Claremont Graduate University; 646-354-8722; [email protected]
Gallion, Kipling [864] University of Texas Health Science Center at San Antonio; 210-562-6500; [email protected]
Gannon, Nora [358-390] University of Illinois at Urbana-Champaign; [email protected]
Gao, Zhongcui [137] Nemours Health and Prevention Services; 302-444-9100; [email protected]
Garbarini, Brian [843] Arizona State University; 602-496-1151; [email protected]
Garbe, Paul [243-709] Centers for Disease Control and Prevention; 770-488-3727; [email protected]
Garbrecht, Lisa [126-802] EVALCORP; 949-468-9849; [email protected]
Garcia, Anna [695] Independent Consultant; 559-448-7792; [email protected]
Garcia, Francisco [744] University of Arizona; 520-626-8539; [email protected]
García-Iriarte, Edurne [521] Trinity College Dublin; 353-1-896-2200; [email protected]
Gardiner, Karen [331] The Lewin Group; 703-269-5528; [email protected]
Gardner, Annette [413-592-797] University of California, San Francisco; 415-514-1543; [email protected]
Gareau, Sarah [386-606] South Carolina Educational Policy Center; 803-777-0424; [email protected]
Gargani, John [623-742] Gargani + Company; 510-291-4226; [email protected]
Garrard, Wendy [119-380] University of Michigan; 734-709-9512; [email protected]
Garrett, Brent [844] Pacific Institute for Research and Evaluation (PIRE); 502-238-7329; [email protected]
Gasper, Charles [325-365-684-723-742] Missouri Foundation for Health; 314-345-5581; [email protected]
Gatti, Guido [804] Gatti Evaluation Inc; 412-371-9832; [email protected]
Gaver, Amy [397] American Red Cross; 202-303-4548; [email protected]
Geier, Susan [137] Purdue University; 765-532-9325; [email protected]
Geierstanger, Sara [592-797] University of California, San Francisco; [email protected]
Gemmer, Stephanie [219] Wright State University; 513-502-6215; [email protected]
Geoghegan, Cristin [137] University of Illinois at Urbana-Champaign; 908-358-5658; [email protected]
Georgis, Rebecca [261] University of Alberta; 780-492-1144; [email protected]
Geraghty, Estella [116] University of California, Davis; 916-734-5265; [email protected]
Gerardi, Nicole [123-296] University of California, Los Angeles; 310-767-6637; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 184
Gerde, Hope [630] Michigan State University; 517-355-0365; [email protected]
Germuth, Amy [308-870] EvalWorks LLC; 919-401-5403; [email protected]
Gervin, Derrick [209] The Evaluation Group; 678-681-6206; [email protected]
Getahun, Monica [737] OMG Center for Collaborative Learning; 267-408-9816; [email protected]
Gheen, Margaret [225] Montgomery County Public Schools; 202-276-0268; [email protected]
Ghosh, Rajashi [613] Drexel University; 215-571-3664; [email protected]
Gigliotti, Ruth Anne [369] Synthesis Professional Services Inc.; 301-698-2754; [email protected]
Gilbert, Brandi [137-437-622] University of Colorado, Boulder; 410-615-7327; [email protected]
Gilbert, Cindy [243] United States Government Accountability Office; 202-512-3000; [email protected]
Giles, Rebecca [279] Utah Department of Health Asthma Program; 801-538-6259; [email protected]
Gill, Boojong [810-886] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); +82-2-589-2214; [email protected]
Gill, Brian [884] Mathematica Policy Research; 617-301-8962; [email protected]
Gill, Sarah [279-709] Cazador; 770-488-0782; [email protected]
Gilling, Maxine [369] Western Michigan University; 269-387-6861; [email protected]
Gilman, Elizabeth [379] California Social Work Education Center; 510-642-9272; [email protected]
Gilmore, Joanna [114-538-685] University of South Carolina; 803-777-9918; [email protected]
Giuli, Charles [108] Pacific Resources for Education and Learning (PREL); 808-441-1349; [email protected]
Glantz, Frederic [370-839-870] Kokopelli Associates LLC; 505-983-0785; [email protected]
Glass, Don [598] VSA; 202-628-2800; [email protected]
Glassman, Marlene [819] Centers for Disease Control and Prevention; 404-639-1998; [email protected]
Glazerman, Steven [226-265-845] Mathematica Policy Research; 202-484-9220; [email protected]
Gleason, Philip [838-884] Mathematica Policy Research; [email protected]
Glebova, Natalia [697] University of Massachusetts, Amherst; 413-230-3492; [email protected]
Glover-Kudon, Rebecca [398] University of Georgia; 706-542-4900; [email protected]
Gmeiner, Kathleen [112] Universal Health Care Action Network of Ohio; 614-456-0060; [email protected]
Gnadinger, Tracy [216] Cincinnati Children's Hospital Medical Center; 513-803-0798; [email protected]
Gnedko, Natalya [576] Chicago Public Schools; 847-507-3588; [email protected]
Goldberg, Debora [400] Virginia Commonwealth University; 703-356-8008; [email protected]
Goldenkranz, Sarah [137] Center for Health Training; 206-447-9538; [email protected]
Goldstein, Adam [320] University of North Carolina; 919-966-4090; [email protected]
Gonzalez, Malu [665] University of Texas, El Paso; 915-747-8083; [email protected]
Gonzalez, Maria Luisa [266] University of Texas, El Paso; 915-747-8045; [email protected]
Gonzalez, Patricia [869] United States Department of Education; 202-245-7355; [email protected]
Gonzalez Cambero, Alfredo [392] Food and Agriculture Organization of the United Nations; 434-384-7251; [email protected]
Gonzalez-Ramos, Gladys [137] New York University; 212-260-8435; [email protected]
Goodman, Charity [662] United States Department of Health and Human Services; 240-276-1959; [email protected]
Goodman, Kenneth [118] ICF Macro; 404-592-2203; [email protected]
Goodman, Robert [820] Indiana University; 812-855-1561; [email protected]
Goodyear, Leslie [125-314-429-632-768] National Science Foundation; 703-292-5115; [email protected]
Goolsby, Rhonda [226] Texas A&M University; 979-845-8363; [email protected]
Gopal, Gita [316] World Bank; 202-473-6835; [email protected]
Gopalakrishnan, Srik [863] New Teacher Center; 630-738-3030; [email protected]
Gorham, Bertha [827] Gorham Consulting; 919-870-5808; [email protected]
Gossman, Ginger [566] Austin Independent School District; 512-736-2957; [email protected]
Gothberg, June [310-329-495] Western Michigan University; 269-387-2821; [email protected]
Gowen, Sheryl [346] Georgie State University; 404-413-8030; [email protected]
Gragg, Martha [723] Missouri Foundation for Health; 314-345-5530; [email protected]
Graham, Kathryn [304] Alberta Innovates-Health Solutions; 780-423-5727; [email protected]
Graham, Michele [880] KPMG LLP; 303-621-6835; [email protected]
Graham, Phillip [137] RTI International; 919-485-7752; [email protected]
Graig, Eric [650-828] Usable Knowledge LLC; 212-931-8540; [email protected]
Grane, Douglas [622-732] University of Iowa; 319-325-8420; [email protected]
Grant, Billie-Jo [137] University of Virginia; 805-550-9132; [email protected]
Grasso, Patrick [287-352-542-615] World Bank; 202-258-2913; [email protected]
Graves, Kelly [137-656] University of North Carolina at Greensboro; 336-217-9713; [email protected]
Gravina, Virginia [278] University of the Republic; 598-2-3581603; [email protected]
Gray, Cheryl [316-539-570] World Bank; 202-473-9188; [email protected]
Greaney, Debra [203] Area V Learning Technology Center; 618-692-6200 x5011; [email protected]
Greece, Jacey [227] Abt Associates Inc; 617-520-2809; [email protected]
Green, Chad [386-496] Loudoun County Public Schools; 571-252-1486; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 185
Green, Diane C [312] Centers for Disease Control and Prevention; 770-488-6562; [email protected]
Green, Sheridan [137] University of Denver; 303-871-3895; [email protected]
Greenberg Motamedi, Jason [725] Education Northwest; 5032759500; [email protected]
Greene, Consuela [619] Massachusetts Alliance on Teen Pregnancy; 617-482-9122; [email protected]
Greene, Jennifer [287-390-400-502-542-591-782-902] University of Illinois at Urbana-Champaign; 217-333-8736; [email protected]
Greene, Joelle [837] National Community Renaissance; 909-483-2444 x115; [email protected]
Greene, Kari [349-420-559-639] Oregon Public Health Division; 971-673-0599; [email protected]
Greene, Rose [116] Center for Human Services Research; 518-442-5774; [email protected]
Greene, Ruth [137] Johnson C Smith University; 704-333-5068; [email protected]
Greene-Dorsett, Tracey [251] National Rural Funders Collaborative; 803-447-2000; [email protected]
Greenfield, Lawrence [302] Lawrence Greenfield Consulting; 240-687-2052; [email protected]
Gregory, Katie [245] Michigan State University; 517-353-4568; [email protected]
Greytak, Emily [517] Gay, Lesbian & Straight Education Network; 646-388- 8054; [email protected]
Grider, Mary [226] Mathematica Policy Research; 202-484-4820; [email protected]
Griffin, Paul [137] Pennsylvania State University; 814-865-7601; [email protected]
Griffin, Sarah [820] University of South Carolina; 864-642-5620; [email protected]
Griffith, James [229-361-579-780] Claremont Graduate University; 909-851-8491; [email protected]
Grimes, Tanisha [360] Centers for Disease Control and Prevention; 404-639-8291; [email protected]
Grimm, Curt [303] University of New Hampshire; 603-862-3788; [email protected]
Grob, George [287-529-542-611-651-727] Center for Public Program Evaluation; 540-454-2888; [email protected]
Grodzicki, Deborah [261-732] University of California, Los Angeles; 585-943-0433; [email protected]
Gruendel, George [723] Missouri Foundation for Health; 573-729-7194; [email protected]
Grunden, Leslie [137] Edvance Research; 210-561-8955; [email protected]
Guan, Zhongcheng [513] Chinese Academy of Sciences; +861062550660; [email protected]
Guijt, Irene [202-520] Learning by Design; 31-488-491880; iguijt@learningbydesign
Gujrati, Malika [301] Paraprofessional Healthcare Institute (PHI); 718-402-7766; [email protected]
Gullickson, Amy [272-670] Western Michigan University; 269-387-5895; [email protected]
Gullickson, Arlen [137-670] Western Michigan University; 269-387-5895; [email protected]
Gullie, Kathy [226-386] State University of New York at Albany; 518-442-5027; [email protected]
Gunter, Margaret J [137-779] LCF Research; 505-938-9901; [email protected]
Gurrola, Jeanette [852] Claremont Graduate University; 626-975-1335; [email protected]
Gurzinsky, Ellen [891] Funders for LGBTQ Issues; 347-583-1811; [email protected]
Gutmann, Mary [558] EnCompass LLC; 970-513-9685; [email protected]
Gwaltney, Margaret [682] Abt Associates Inc; 301-634-1898; [email protected]
Gysbers, Norm [761] University of Missouri; 573-882-6386; [email protected]
HHHHHHHH
Haak, Laurel [231] Discovery Logic; 240-912-1927; [email protected]
Hacker, Karen [699] Institute for Community Health; 617-499-6613; [email protected]
Haden, Carol [290-385] Magnolia Consulting LLC; 928-600-6641; [email protected]
Hage, Jerald [609] University of Maryland; 301-405-6437; [email protected]
Hagen, Carol [721] Westat; 301-294-3877; [email protected]
Hagestuen, Ruth [137] National Parkinson Foundation; 305-606-9011; [email protected]
Hagstrom, Emily [762] Ciurczak & Co Inc; 716-362-0627; [email protected]
Hakobyan, Anna [224] Children's Investment Fund Foundation; [email protected]
Hall, Bruce [137] University of South Florida; 813-974-3220; [email protected]
Hall, Jori [230-390-768-782] University of Georgia; 706-542-1801; [email protected]
Hall, Kara [137] National Institutes of Health; 301-594-9056; [email protected]
Hall, Melanie [137] St Joseph's Children's Advocacy Center; 813-493-4546; [email protected]
Hall, Tracey [249] Center for Applied Special Technology; 781-245-2212 x227; [email protected]
Haller, Megan [595] University of Illinois at Chicago; 312-413-2189; [email protected]
Hamakawa, Tomohiro [224] Children's Investment Fund Foundation; +919717774383; [email protected]
Hamann, Sue [117-739] National Institutes of Health; 301-594-4849; [email protected]
Hamilton, Donna [747] Michigan Department of Education; 517-241-4546; [email protected]
Hamilton, Dustin [219] Wright State University; 937-830-7891; [email protected]
Hamilton, Jennifer [526-615] Westat; 301-738-3628; [email protected]
Hamlett, Kristin [137] Nurse Oncology Education Program; 512-467-2803; [email protected]
Han Kim, Do [120] New York State Office of Children and Family Services; 518-402-7386
Hancock, Dawson [218] University of North Carolina at Charlotte; 704-687-8863; [email protected]
Hanna, Jeanine [801] Advocates of Human Potential; 518-475-9146; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 186
Hanni, Krista [684] Monterey County Health Department; 831-755-4586; [email protected]
Hansen, Mark [233-389] University of California, Los Angeles; 857-212-1691; [email protected]
Hansen, Morten Balle [243] University of Southern Denmark; +45 6550 2218; [email protected]
Hansen, Pat [827] The North Carolina Partnership for Children; 919-821-7999; [email protected]
Harding, Wayne [522] Social Science Research and Evaluation; 781-273-4204; [email protected]
Hargett, Stella L [411] Morgan State University; 443-885-3411; [email protected]
Hargraves, Monica [250-381-534] Cornell University; 607-255-0341; [email protected]
Hargreaves, Margaret [210-307-363] Mathematica Policy Research; 617-301-8994; [email protected]
Harmon, Michele [721] Westat; 301-294-3814; [email protected]
Harnar, Michael [658-779] Claremont Graduate University; 909-524-7800; [email protected]
Harper, Gary [325] DePaul University; 773-325-2056; [email protected]
Harrington, Maura [734] Center for Nonprofit Management; 213-346-3258; [email protected]
Harris, Jenine [675] Saint Louis University; 314-977-8210; [email protected]
Harris, Karol K [737] University of Texas, Austin; 512-494-0758; [email protected]
Harrison, Shayne [248] University of Tennessee, Knoxville; 865-591-6999; [email protected]
Harris-Tally, Kirsten [619] Center for Health Training Resource Group; 206-223-1186; [email protected]
Hart, Matthew [260] University of South Florida; 813-766-3107; [email protected]
Hart, Raymond [220-246-306] Georgia State University; 404-413-8264; [email protected]
Hartje, Joyce [137] University of Nevada, Reno; 775-684-7237; [email protected]
Hartry, Ardice [125] University of California, Berkeley; 510-942-6245; [email protected]
Hatashima, Hiroyuki [659] International Finance Corporation; 202-473-5387; [email protected]
Hatry, Harry [727] Urban Institute; 202-261-5521; [email protected]
Hawkins, Stephanie [306] State University of New York College at Potsdam; 315-267-3136; [email protected]
Hayden, Elizabeth [599] Northeastern University; 860-230-7428; [email protected]
Haynes, Ray [275-613] Indiana University; 812-856-8151; [email protected]
Haynie, Kathleen [525-839] Haynie Research and Evaluation; 609-466-2990; [email protected]
He, Huihua [137] Shanghai Normal University; 86-21-66309252; [email protected]
Heath, Barbara [597] East Main Educational Consulting; 910-784-9523; [email protected]
Heath, Debra [234] Albuquerque Public Schools; 505-872-6803; [email protected]
Heaton, Tim [693] Brigham Young University; 801-422-3280; [email protected]
Hebbard, Claire [250-381] Cornell University; 607-255-3791; [email protected]
Heberger, Anne [691] National Academy of Sciences; 949-943-2823; [email protected]
Hebert, Scott [665-756] Sustained Impact; 410-223-2932; [email protected]
Hecklinger, John [520] GlobalGiving Foundation; 202-232-5784; [email protected]
Hector, LaJuana [334] Texas A&M University; 254-549-5747; [email protected]
Heffelfinger, John [846] United States Environmental Protection Agency; 202-566-2192; [email protected]
Hegamin-Younger, Cecilia [137-357] TUI University; 473-415-4815; [email protected]
Hegedus, Andrea [212] Northrop Grumman Corporation; 734-717-1858; [email protected]
Heikes, Joel [115-879] University of Texas, Austin; 512-475-8679; [email protected]
Heimlich, Joe E [137-258-339-420-628-877] Ohio State University; 614-228-2674 x2425; [email protected]
Heinecke, Walter [137] University of Virginia; 434-982-2864; [email protected]
Held, Sam [237-272-388] Oak Ridge Institute for Science and Education; 865-576-8223; [email protected]
Henderson, Kathryn [615] Westat; 301-610-4849; [email protected]
Henderson, Stuart [116-230] University of California, Davis; 916-703-9220; [email protected]
Henderson, Susan [547-845] WestEd; 781-481-1118; [email protected]
Hendricks, Astrid [264-332-592-895] California Endowment; 213-928-8671; [email protected]
Hendricks, Michael [341-507-585] Independent Consultant; 240-994-6087; [email protected]
Hennessy, Kevin [228] United States Department of Health and Human Services; 240-276-2234; [email protected]
Henning, Philip [792] James Madison University; 540-292-9374; [email protected]
Henry, James [519-685] Western Michigan University; 269-387-3175; [email protected]
Henry, Stephan [308] REASolutions LLC; 785-273-5619; [email protected]
Henry Akintobi, Tabia [137-541] Morehouse School of Medicine; 404-755-1144; [email protected]
Heo, Se Jin [355] University of Minnesota; 612-239-5452; [email protected]
Herbers, Stephanie [137-616-638-827] Washington University in St Louis; 314-935-3721; [email protected]
Herbst, Jeffrey [819] Centers for Disease Control and Prevention; 404-639-5386; [email protected]
Herman, Jeanette [115] University of Texas, Austin; 512-471-3948; [email protected]
Herman, Keith [761] University of Missouri; 573-884-2419; [email protected]
Herman, Patricia [586] University of Arizona; 520-318-7259 x147; [email protected]
Hermida, Jose [805] American University; 202-885-6404; [email protected]
Hernandez, Arthur [213-734] Texas A&M University; 361-825-2661; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 187
Herrera, Denise [737] Decision Information Resources Inc; 512-791-9115; [email protected]
Hersch, Rebekah [721] ISA Associates; 703-739-0880 x11; [email protected]
Heschel, Jessica [219] Wright State University; 567-201-6768; [email protected]
Hewitt, Anne [684-734] Seton Hall University; 908-782-0827; [email protected]
Hewitt, Cheryl [227] Abt Associates Inc; 617-520-2724; [email protected]
Hewitt, Sue [376] Health District of Northern Larimer County; 970-224-5209; [email protected]
Hewlett, Leigh [830] University of South Carolina; 803-777-7000; [email protected]
Hibbard, Susan [137] Florida Gulf Coast University; 941-465-9403; [email protected]
Hicks, Dan [222] Ventura County Behavioral Health Department; 805-981-9577; [email protected]
Hicks, Mary [677] Boundless Readers; 773-989-8582; [email protected]
Hickson, Rachel [507] Montgomery County Public Schools; 301-279-3287; [email protected]
Hildenbrand, Susan [788] St John Fisher College; 585-385-7297; [email protected]
Hill, Alexandra [842] University of Alaska, Anchorage; 907-786-5436; [email protected]
Hill, Dale [397] American Red Cross; 301-263-9316; [email protected]
Hill, Kathryn [137-763] Minnesota Office of Higher Education; 763-464-8814; [email protected]
Hill, Laura [137] Washington State University; 509-335-8478; [email protected]
Hill, Patty [657] EnCompass LLC; 301-518-5120; [email protected]
Hilscher, Rainer [283] Altarum Institute; 734-302-4798; [email protected]
Hinchcliff, Ginger [687] National Oceanic and Atmospheric Administration; 843-740-1184; [email protected]
Hipps, Jerome [888] WestEd; 510-302-4227; [email protected]
Hitchcock, John [547-616] Ohio University; 740-597-1323; [email protected]
Hites, Lisle [816] University of Alabama at Birmingham; 205-975-8980; [email protected]
Ho, Timothy [137-389] University of California, Los Angeles; 626-252-6160; [email protected]
Hobson, Jennifer [137] Washington University in St Louis; [email protected]
Hobson, Kristin [393] Western Michigan University; [email protected]
Hodge, Sheryl [137-220] Kansas State University; 785-532-7171; [email protected]
Hoechstetter, Susan [332] Alliance for Justice; 202-822-6070; [email protected]
Hoffman, Cheri [504] Centerstone Research Institute; 615-463-6256; [email protected]
Hogle, Janice A [133] University of Wisconsin, Madison; 608-262-4313; [email protected]
Hoke, Tahira [860] Prince Sultan University; 966-5-962-1764; [email protected]
Holden, Debra [717] Research Triangle Institute International; 919-541-6491; [email protected]
Holladay, Royce [550-863] Human Systems Dynamics Institute; 612-201-3781; [email protected]
Holmes, William [799] University of Massachusetts, Boston; 781-784-9487; [email protected]
Homan, Sherri [709] Missouri Asthma Prevention and Control Program; 573-522-2810; [email protected]
Honeycutt, Todd [210] Mathematica Policy Research; 609-945-3397; [email protected]
Hong, Jungseok [810] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); +52-2-589-2296; [email protected]
Hong, Seung Won [248] University of Illinois at Urbana-Champaign; 217-819-8816; [email protected]
Hood, Stafford [111-591-823] University of Illinois at Urbana-Champaign; 217-333-6510; [email protected]
Hoover, Sonja [885] RTI International; 781-434-1722; [email protected]
Hopson, Rodney [111-200-229-322-362-591-662-800] Duquesne University; 412-396-4034; [email protected]
Hornack, Sarah [805] American University; 202-885-6404; [email protected]
Horne, Christopher [245] University of Tennessee, Chattanooga; 423-425-1709; [email protected]
Horne, Richard [131] United States Department of Labor; 202-693-4923; [email protected]
Hornik, John [137-801] Advocates for Human Potential; 413-687-5246; [email protected]
Horwood, Thomas [376-729] ICF International; 703-225-2276; [email protected]
Hostrup, Judy [305] Texas A&M University; 979-845-8363; [email protected]
Houle, Sylvain [579] University of Quebec at Montreal; 514-987-3000; [email protected]
Houmes, Virginia [390-616] Washington University in St Louis; 314-935-3741; [email protected]
House, Ann [137-632] SRI International; 650-859-2426; [email protected]
House, Duane [137-619] Centers for Disease Control and Prevention; 770-488-6302; [email protected]
House, Ernest [229-822] University of Colorado; 720-938-1826; [email protected]
Housne, Begum [137] University of Dhaka; 008802-9014925; [email protected]
Howell, Britteny [137-676] Cincinnati Children's Hospital Medical Center; 513-803-0189; [email protected]
Howell, Tamika [713] Institute for Community Living Inc; 212-385-3030 x3234; [email protected]
Howieson, Susannah T [730] Science and Technology Policy Institute; [email protected]
Hoyte, Tamika [360] MANILA Consulting Group Inc; 404-639-6929; [email protected]
Hsu, Helen [758] University of British Columbia; 604-875-4111 x68786; [email protected]
Hu, Haiyang [513] Chinese Academy of Sciences; 861068597457; [email protected]
Hubelbank, Jeanne [115-255] Independent Consultant; 978-443-3877; [email protected]
Huddleston, Jenica [137-400-698-797] University of California, Berkeley; 925-202-3133; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 188
Huerta, Timothy [387] Texas Tech University; 213-793-1900; [email protected]
Huff-Rousselle, Maggie [221] Social Sectors Development Strategies; 617-421-9644; [email protected]
Hughes, Bob [249] Seattle University; 206-296-6168; [email protected]
Hughes, Denise [698] Nemours Health and Prevention Services; 302-444-9100; [email protected]
Hughes, Mary Beth [343] Science and Technology Policy Institute; 202-419-5487; [email protected]
Hummelbrunner, Richard [269-663] OEAR Regional Development Consultants; +43 316 31 18 4815; [email protected]
Humphries, Paul [261] University of Alberta; 780-492-1144; [email protected]
Hung, Hsin-Ling [117-297-377-417] University of North Dakota; 513-556-7004; [email protected]
Hunter, Sue [512] New York University; 212-263-4179; [email protected]
Hunter, Yvonne [383] University of South Florida; 813-325-3871; [email protected]
Hurteau, Marthe [579] University of Quebec at Montreal; 514-987-3000 X4702; [email protected]
Hutchinson, Elizabeth [514] Land O'Lakes International Development; 651-494-5189; [email protected]
Hutchinson, Kylie [137] Community Solutions Planning & Evaluation; 604-629-6872; [email protected]
Hutchinson, Paul [222-320-884] Tulane University; 504-988-6078; [email protected]
Hutton, Michael [301] The Blue Foundation for a Healthy Florida; 904-607-2659; [email protected]
Hwalek, Melanie [611] SPEC Associates; 313-964-0500; [email protected]
Hwang, Jiho [137-810] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); +82-2-589-2290; [email protected]
Hyra, Allison [331] The Lewin Group; 703-269-5628; [email protected]
Hyun Jeong, Dae [810] Korea Zinc Inc; [email protected]
Hyvarinen, Jari [766] Tekes - Finnish Funding Agency for Technology and Innovation; 358-1060-55803; [email protected]
IIIIIIII
Ibanez-Carrasco, Francisco [137] Provincial Health Services Authority of Bristish Columbia; [email protected]
Iglesias, Kevin [317] Seton Hall University; 973-761-9306; [email protected]
Imm, Pamela [280-312-604-699] University of South Carolina; 803-808-2316; [email protected]
Inada, Nariatsu [890] Nagasaki Prefectural Government; +81 95 895 2521; [email protected]
Inazu, Judith [298] University of Hawaii at Manoa; 808-956-4584; [email protected]
Infante, Alycia [113] NORC at the University of Chicago; 301-634-9371; [email protected]
Inokuchi, Derek [807] Academy for Educational Development; 202-884-8652; [email protected]
Intili, JoAnn [695] JBS International Inc; 510-482-9979; [email protected]
Irani, Tracy [534] University of Florida; 352-392-0502; [email protected]
Irie, Ellen [257] BTW Informing Change; 510-665-6100; [email protected]
Iriti, Jennifer [303-392-610-677] University of Pittsburgh; 412-624-7092; [email protected]
Isenberg, Eric [226] Mathematica Policy Research; 202-554-7540; [email protected]
Ishikawa, Tomonori [386-606] University of South Carolina; 803-561-0769; [email protected]
Israel, Glenn D [534] University of Florida; 352-392-0502; [email protected]
Iverson, Ellen [214-272-674] Carleton College; 507-222-5749; [email protected]
Ivins, Tiffany [752] Brigham Young University; 801-824-0153; [email protected]
JJJJJJJJ
Jackson, Ceasar [111] National Science Foundation; 703-292-4669; [email protected]
Jackson, Melody [137] Wholistic Stress Control Institute Inc; 404-755-0068; [email protected]
Jackson, Nicole [712-833] University of California, Berkeley; 415-586-2236; [email protected]
Jackson, Summer [817] Independent Consultant; 773-633-6154; [email protected]
Jackson-Newsom, Julia [595] University of North Carolina at Greensboro; 336-334-9866; [email protected]
Jacob, Claude- Alix [541] Cambridge Public Health Department; 617-665-3810; [email protected]
Jacobs, DeBran [137] Morehouse School of Medicine; 404-752-1916; [email protected]
Jacobson, Miriam [691] Claremont Graduate University; 339-203-0418; [email protected]
Jacquet, Susan [379] California Social Work Education Center; 510-642-9272; [email protected]
James, Nakia [109] Western Michigan University; 269-544-0249; [email protected]
James, Tom [522] University of Oklahoma; 405-360-7509; [email protected]
James-Burdumy, Susanne [126-265] Mathematica Policy Research; 609-275-2248; [email protected]
Jang, Kristy [137] University of British Columbia; 778-888-3177; [email protected]
Jarosewich, Tania [203-625] Censeo Group; 440-788-2321; [email protected]
Jatau, Afabwaje [737] National Cancer Institute; 614-406-5908; [email protected]
Javad, Mohammad [657] University of Massachusetts, Amherst; 413-695-6692; [email protected]
Jay, Michelle [111-671-737-876] University of South Carolina; 803-777-6519; [email protected]
Jayaratne, Koralalage [137] North Carolina State University; 919-515-6079; [email protected]
Jenniges, Reese [546-715] University of Wyoming; 307-299-3635; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 189
Jennings, Helene [294-686-811-884] ICF Macro; 301-572-0248; [email protected]
Jeremiah, Rohan [137-357] St George's University; 473-439-2000; [email protected]
Jernigan, Jan [227-378] Centers for Disease Control and Prevention; 770-488-5224; [email protected]
Jessup, Pat [110-743] InSites; 734-761-5412; [email protected]
Jewiss, Jennifer [127-314-429-576] University of Vermont; 802-656-2711; [email protected]
Jhawar, Mona [592] California Endowment; 800-449-4149 x8674; [email protected]
JIinnah-Ghelani, Haminda [137] University of Georgia; 706-254-0477; [email protected]
Jim, Jill [817] Independent Consultant; 801-618-6712; [email protected]
Jimenez, Maria [137-208-502] University of Illinois at Urbana-Champaign; 217-778-2537; [email protected]
Jimenez, Tiffeny [137] Michigan State University; 517-775-3019; [email protected]
Jinkerson, Darryl [275-629] Abilene Christian University; 325-674-2493; [email protected]
Jinnah-Ghelani, Hamida [137] University of Georgia; 7062540477; [email protected]
Jochelson, David [533] Academy for Educational Development; 202-884-8250; [email protected]
Johnson, Amy [226] Mathematica Policy Research; 609-976-2714; [email protected]
Johnson, Barrett [379] California Social Work Education Center; 510-642-9272; [email protected]
Johnson, Beth [519] EMJ Associates; 630-879-7466; [email protected]
Johnson, Britta [862] United States Environmental Protection Agency; 202-566-1465; [email protected]
Johnson, Chantell [785] TCC Group; 312-266-1711; [email protected]
Johnson, Elmima [111-371] National Science Foundation; 703-292-5137; [email protected]
Johnson, Erin [619] South Carolina Campaign to Prevent Teen Pregnancy; 803-771-7700; [email protected]
Johnson, Jeana [619] Center for Health Training Resource Group; 206-223-1186; [email protected]
Johnson, Jeremiah [502] University of Illinois at Urbana-Champaign; 217-714-6774; [email protected]
Johnson, Jerry [616] Ohio University; 740-818-6115; [email protected]
Johnson, Jessica [671] Virginia Commonwealth University; 804-433-7390; [email protected]
Johnson, LaJuana [619] Center for Health Training Resource Group; 206-223-1186; [email protected]
Johnson, Leona [331-411] Hampton University; 703-727-5370; [email protected]
Johnson, Margaret [283-381-589] Cornell Univeristy; 607-227-8315; [email protected]
Johnson, Robert [286] University of South Carolina; 803-777-6585; [email protected]
Johnson, Sarah [137] United States Office of Personnel Management; 202-904-3364; [email protected]
Johnson, Tarita [137] Wholistic Stress Control Institute Inc; 404-755-0068; [email protected]
Johnston, Andrea LK [103-252] Johnston Research Inc; 905-889-4430; [email protected]
Johnston, Dennis [137] AVID Center; 858-380-4787; [email protected]
Jones, Jenny [209-211-242] Virginia Commonwealth University; 804-828-0732; [email protected]
Jordan, Alexandra [137] University of Colorado, Boulder; 323-252-1998; [email protected]
Jordan, Gretchen [271-391-527-655-689-730] Sandia National Laboratories; 505-844-9075; [email protected]
Jorgensen, Daniel [137] Texas A&M University; 361-825-3269; [email protected]
Jose-Ivanina, Agata [884] ICF Macro; 301-572-0927; [email protected]
Joseph, Djenaba [776] Centers for Disease Control and Prevention; [email protected]
Jourdan, Linda [137] University of Wisconsin, Green Bay; 920-915-8579; [email protected]
Jovaag, Amanda [107] University of Wisconsin; 608-265-4172; [email protected]
Joy, Roy [137] Southern Illinois University Carbondale; 618-453-5371; [email protected]
Juan, Shu-Ping [137] National Taipei University of Technology; +886-3-2118999; [email protected]
Julnes, George [102-246-506-826] University of Baltimore; 410-837-6256; [email protected]
Jun Yoo, Seung [810] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); +82-2-589-2861; [email protected]
Jurist Levy, Abigail [856] Education Development Center; 617-618-2437; [email protected]
Jwahar, Mona K [264] California Endowment; 800-449-4149; [email protected]
KKKKKKKK
Kabel, Christopher [212] Northwest Health Foundation; 971-230-1291; [email protected]
Kaczynski, Dan [777] Central Michigan University; 989-317-0621; [email protected]
Kaesbauer, Susanne [248-398-593] University of Tennessee, Knoxville; 757-515-7017; [email protected]
Kagan, Jonathan [770] National Institutes of Health; 301-453-3733; [email protected]
Kahlert, Rahel [369-738] University of Texas, Austin; 512-709-1017; [email protected]
Kakooza, James [243] African Women in Agricultural Research and Development; +25420722 44400; [email protected]
Kalayil, Elizabeth [360] MANILA Consulting Group Inc; 404-639-8049; [email protected]
Kallemeyn, Leanne [213] Loyola University, Chicago; 847-549-1024; [email protected]
Kaminsky, Alexis [244] Kaminsky Consulting; 505-270-8019; [email protected]
Kamo, Mariko [890] National Institute of Advanced Industrial Science and Technology; +81 29 862 6096; [email protected]
Kane, Cathleen [133] Cornell University; 646-962-8320; [email protected]
Kanny, Dafna [809] Centers for Disease Control and Prevention; 770-488-5411; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 190
Kaplan, Marina [137] Nemours Health and Prevention Services; 302-444-9052; [email protected]
Kaplan, Seth [896] Geroge Mason University; 703-993-8475; [email protected]
Karakus, Mustafa [676-885] Westat; 301-294-2874; [email protected]
Karanxha, Zorka [874] University of South Florida; 813-974-6040; [email protected]
Kari, Nan [756] Touchstone Center for Collaborative Inquiry; 612-331-9342; [email protected]
Karim, Nidal [245] Michigan State University; 517-614-0349; [email protected]
Karlawish, Jason [691] University of Pennsylvania; 215-898-8997; [email protected]
Karlsson Vestman, Ove [268] Malardalen University; +4616153456; [email protected]
Kasprzak, Ashley [681] JVA Consulting LLC; 720-407-8378; [email protected]
Kasprzyk, Danuta [137-779] Battelle Memorial Institute; 206-528-3106; [email protected]
Kass, Lauren [310] James Bell Associates; 703-247-2635; [email protected]
Kassouf Mackey, Colleen [803] Points of Light Institute; 440-476-8013; [email protected]
Katz, Jason [280-699-820] University of South Carolina; 610-952-8943; [email protected]
Kawakami, Alice [764] University of Hawaii, Manoa; 808-956-4245; [email protected]
Kaye, Lara [116] Center for Human Services Research; 518-591-8615; [email protected]
Kaylor Richardson, Kristin [369-433-589] Western Michigan University; 248-770-3430; [email protected]
Kazi, Mansoor [122-209] State University of New York at Buffalo; 716-645-1257; [email protected]
Keene, Matt [687-862] United States Environmental Protection Agency; 202-566-2240; [email protected]
Keener, Dana [118] ICF Macro; 404-592-2206; [email protected]
Kegler, Michelle C [541] Emory University; 404-712-9957; [email protected]
Kellar-Guenther, Yvonne [599] University of Colorado, Denver; 303-829-0819; [email protected]
Kelley, John [757] Villanova University; 610-519-4835; [email protected]
Kelley, Loretta [792] Kelley, Petterson and Associates; 415-518-7960; [email protected]
Kelley, Robin [137] National Minority AIDS Council; 202-483-6622 x360; [email protected]
Kelly, Cheryl [390] Saint Louis University; 314-977-8117; [email protected]
Kelly, Daniel [788] St John Fisher College; 585-899-3896; [email protected]
Kelly, Desmond [830] Greenville Hospital System; 864-467-3333; [email protected]
Kelly, Thomas [124-207-665-895] Annie E Casey Foundation; 410-223-2932; [email protected]
Kendall, Lauren [137-596] University of North Carolina at Chapel-Hill; 919-843-7878; [email protected]
Kershner, Sarah [564] South Carolina Campaign to Prevent Teen Pregnancy; 803-771-7700; [email protected]
Kessler, Cheryl [137-258] Independent Consultant; 530-902-3785; [email protected]
Ketema, Teserach [131] United States Department of Labor; 202-693-7908; [email protected]
Kettel Khan, Laura [378] Centers for Disease Control and Prevention; 770-488-6018; [email protected]
Khan, Fahad [137] Catholic Relief Services; +92-333-913-4910; [email protected]
Khattri, Nidhi [617] World Bank; 202-473-5255; [email protected]
Kibler, Barbara [541] Margaret Fuller Neighborhood House; 617-547-4680; [email protected]
Kiella, Michael [750] Western Michigan University; 269-673-6963; [email protected]
Kiflie, Woldemichael [814] Jimma University; [email protected]
Kiflie, Yibeltal [814] Jimma University; [email protected]
Kim, Anthony [643-837] University of California, Berkeley; 847-942-3704; [email protected]
Kim, Eunyoung [317] Seton Hall University; 973-275-2156; [email protected]
Kim, Jae-Young [810] Ministry of Strategy and Finance; +82 2 2150 5375; [email protected]
Kim, Jung [112-245] Mathematica Policy Research; 609-936-3253; [email protected]
Kim, Kellie [137] Quill Research Associates; kkim@qrc-llc-net
Kim, Meelee [541] Brandeis University; 781-736-3978; [email protected]
Kim, Mimi [669] Korean Community Center of East Bay; 510-593-5522; [email protected]
Kim, Rae-Young [810] Ministry of Strategy and Finance; +82 2 2150 5375; [email protected]
Kim, Yun Jong [810] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); +82-2-589-2802; [email protected]
Kimball, Kristi [217-257] William and Flora Hewlett Foundation; 650-234-4500; [email protected]
Kimmich, Madeleine [259-299] Human Services Research Institute; 503-924-3783 x12; [email protected]
King, Jean A [137-247-337-377-693] University of Minnesota; 612-626-1614; [email protected]
King, Katherine [355] University of Michigan; 734-764-3946; [email protected]
King, Nicki [128-587] University of California, Davis; 530-752-3863; [email protected]
King, Syd [307-800] New Zealand Qualifications Authority; +64-21-979-765; [email protected]
Kingi, Wikuki [791] Pou Kapua Consulting; 6421-208-2140; [email protected]
Kingsley, Gordon [391] Georgia Institute of Technology; 404-894-0454; [email protected]
Kirk, Chris [137] Wichita State University; 316-978-3170; [email protected]
Kirk, Colin [132] African Development Bank; +0021671102041; [email protected]
Kirk, Roger [246] Baylor University; 254-710-2253; [email protected]
Kirkendall, Randahl [214-272] Carleton College; 507-222-4368; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 191
Kirkhart, Karen E [242-591] Syracuse University; 315-443-5574; [email protected]
Kirkley, Jane [385] Northern Arizona University; 928-523-7136; [email protected]
Kirkpatrick, Mark [872] Western Michigan University; 269-657-6763; [email protected]
Kisira, Simon [574] Evaluation Resource Group; +256 772 353 771; [email protected]
Kissam, Edward [695] JBS International Inc; 650-533-0319; [email protected]
Klayman, Doug [131] Social Dynamics LLC; 301-990-1105x110; [email protected]
Klein, Sheri [517] AdCouncil; 212-984-1995; [email protected]
Klink, Jenna [592-797] Louisiana Public Health Institute; 504-301-9829; [email protected]
Kloosterman, Valerntina I [557] University of Miami; 305-284-3260; [email protected]
Knapp-Philo, Joanne [225] National Head Start Family Literacy Center; 805-388-5634; [email protected]
Knauth, Shaunti [137] National Louis University; 847-947-5187; [email protected]
Knox, Andrea [654] Counterbalance Research and Evaluation; +64 21 1107996; [email protected]
Knudsen, Jeffrey [682] RMC Research Corporation; 503-223-8248; [email protected]
Knuth, Randy [698] Knuth Research Inc; 509-951-8278; [email protected]
Koball, Heather [210-307] Mathematica Policy Research; 609-716-4542; [email protected]
Kobayashi, Michelle [767] National Research Center Inc; 303-444-7863 x106; [email protected]
Kobayashi, Naoto [890] Waseda University; +81-3-5286-1973; [email protected]
Kohler, Paula [310] Western Michigan University; 269-387-8283; [email protected]
Kohler Chrestman, Sarah [222-320-382-884] Louisiana Public Health Institute; 504-301-9800; [email protected]
Kohn, Sheila [315] University of Rochester; 585-455-5228; [email protected]
Koppel, Ross [695] University of Pennsylvania; 215-576-8221; [email protected]
Korsmo, Fay [371] National Science Foundation; 703-292-8002; [email protected]
Kortecamp, Karen [740] George Washington University; 202-994-1713; [email protected]
Kosciw, Joseph [517] Gay, Lesbian & Straight Education Network; 646-388-8050; [email protected]
Kotrcova, Jana [137] University of Saskatchewan; 306-880-7669; [email protected]
Kouame, Julien [137-835] Western Michigan University; 404-441-0500; [email protected]
Krafve, Michael [647] United States Government Accountability Office; 206-654-2822; [email protected]
Kramer, Kathryn [320] University of North Carolina; 919-843-9751; [email protected]
Kratt, Diane [137] Florida Gulf Coast University; 239-590-7780; [email protected]
Kreger, Mary [592] University of California, San Francisco; 415-502-4544; [email protected]
Kreiner, Peter [541-699] Brandeis University; 781-736-3945; [email protected]
Krenn, Huilan [707] W K Kellogg Foundation; 269-969-2240; [email protected]
Krivelyova, Anna [776] ICF Macro International; [email protected]
Kroma, Margaret [243] African Women in Agricultural Research and Development; +25420722 44400; [email protected]
Kubas-Meyer, Tanja [207] Independent Consultant; 401-263-1126; [email protected]
Kubilius, Kaitlin [672] Miami University; 513-217-4308; [email protected]
Kubo Della-Piana, Connie [371] National Science Foundation; 703-292-5309; [email protected]
Kuji-Shikatani, Keiko [337-851] Ontario Ministry of Education; 416-327-9842; [email protected]
Kulick, Rachel [253] City University of New York (CUNY); 617-501-3467; [email protected]
Kullberg, Christian [268] Orebro University; +46735043081; [email protected]
Kumar, Anjali [316] World Bank; 202-458-0004; [email protected]
Kumar, Krishna [858] United States Department of State; 202-647-2822; [email protected]
Kundrat, Cara [331] The Lewin Group; 703-269-5640; [email protected]
Kung, Susanna [533] Academy for Educational Development; 212-367-4606; [email protected]
Kurth, Ashley [802] City Year Inc; 857-753-9172; [email protected]
Kushmerick, Ann [649] Thomson Reuters; 215-823-5351; [email protected]
Kushner, Saville [624] University of the West of England; +44 1173284250; [email protected]
Kuzmin, Alexey [276-815] Process Consulting Company; +7 903 729 8189; [email protected]
Kwon, Deborah [137-672] The Ohio State University; 614-975-8325; [email protected]
Kwon, Simona [744] New York University; 212-263-3026; [email protected]
LLLLLLLL
La France, Stephen [266] LFA Group; 415-392-2850; [email protected]
Laanan, Frankie [525] Iowa State University; 515-294-7292; [email protected]
Labin, Susan [230-312-521] Independent Consultant; 301-564-0764; [email protected]
Lacey, Candace [256-512] Nova Southeastern University; 954-262-8575; [email protected]
LaChausse, Robert [400-678] California State University, San Bernardino; 909-537-7229; [email protected]
Ladd, Susan [378] Centers for Disease Control and Prevention; 770-488-5448; [email protected]
Ladhmi Narayana, Undurthy [137] Regional Institute of Education; +91 755 2522044; [email protected]
LaFrance, Joan [372-574-591] Mekinak Consulting; 206-706-6829; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 192
LaFrance, Steven [665-891] Learning for Action Group; 415-392-2858; [email protected]
Lahey, Robert [617] REL Solutions Inc; 613-728-4272; [email protected]
Lahti, Michel [798] University of Southern Maine; 207-232-2181; [email protected]
Lai, Chung [694-735] International Relief & Development; 730-248-0161; [email protected]
Lai, Emily [133] University of Iowa; 319-335-5904; [email protected]
Lai, Morris [707-764] University of Hawaii, Manoa; 808-956-7900; [email protected]
Lake, Jeremy [722] University of South Florida; 813-494-7619; [email protected]
Lakshmi Narayana, Undurthy [137] Regional Institute of Education; +91 755 2522044; [email protected]
Lal, Bhavya [343] Science and Technology Policy Institute; 202-419-3724; [email protected]
Lalich, Nina [306] Case Western Reserve University; 216-368-3029; [email protected]
Lam, Tony [137] University of Toronto; 416-978-0140; [email protected]
Lamb, Lindsay [386] Austin Independent School District; 512-414-9567; [email protected]
Lamb, Yvette [533] Academy for Educational Development; 202-464-3825; [email protected]
Lambur, Michael [873] Virginia Tech; 540-231-8177; [email protected]
Lamm, Alexa J [534] University of Florida; 352-392-0502 x238; [email protected]
Lancey, Patrice [714] University of Central Florida; 407-882-0279; [email protected]
Landau, Melinda [320] San Jose Unified School District; 408-535-6377; [email protected]
Landers, Glenn [841] Georgia State University; 404-413-0294; [email protected]
Landy, Ann [522-602] Westat; 301-251-2277; [email protected]
Lanehart, Rheta [137] University of South Florida; 813-974-2138; [email protected]
Langer, Michael [556] State of Washington; 360-725-3740; [email protected]
Langs, Jodie [703] West Coast Children's Clinic; 510-452-7400; [email protected]
Laorenza, Elise [882] Brown University; 401-274-9548; [email protected]
Lapitan, Aileen [595] University of North Carolina at Charlotte; 806-559-9900; [email protected]
Lapp, Sue [320] School Health Clinics of Santa Clara County; 408-284-2282; [email protected]
Larimer, Dustin [518] Savannah College of Art and Design; 210-464-1971; [email protected]
Larwin, Karen [246-326-838] Youngstown State University; 330-509-5266; [email protected]
Lasane, Terell [601-846-862] United States Environmental Protection Agency; 202-566-0705; [email protected]
Laster, Nastassia [137] Morehouse School of Medicine; 404-752-8671; [email protected]
Lauer, Patricia [121] Rocky Mountain Center for Health Promotion and Education; 303-867-9105; [email protected]
Laurie, Carpenter [592] University of Michigan; 734-615-7825; [email protected]
LaVelle, John [233-704-852] Claremont Graduate University; 952-807-3777; [email protected]
LaVelle, Katherine [226] Five Acres; 909-753-7775; [email protected]
Laven, Daniel [127] National Park Service; 802-457-3368; [email protected]
Lavinghouze, Rene [367-627-867] Centers for Disease Control and Prevention; 770-488-5905; [email protected]
Lawhorn, Nikki [592-797] Louisiana Public Health Institute; 251-928-8534; [email protected]
Lawrence, Rachael [753] University of Massachusetts, Amherst; 315-866-2378; [email protected]
Lawrenz, Frances [137] University of Minnesota; 612-625-2046; [email protected]
Lawson, Karen [881] Virginia Department of Medical Assistance Services; [email protected]
Lawton, Kerry [843] Arizona State University; 602-496-1334; [email protected]
Lazar, Marsha [541] Cambridge Public Health Department; 617-665-3655; [email protected]
Le Menestrel, Suzanne [128-692] United States Department of Agriculture; 202-720-2297; [email protected]
Leacock, Nicole [390-616] Washington University in St Louis; 314-935-3649; [email protected]
Leaf, Samantha [721] ISA Associates; 703-739-0880 x16; [email protected]
Leahy, Peter [707] University of Akron; 330-972-6871; [email protected]
Leake, Robin [137] University of Denver; 303-871-6813; [email protected]
Leal, Aline [137] National School of Public Health (ENSP/Fiocruz); 5521-32091416; [email protected]
Leaver, Stephen [519] Imagination Theater; [email protected]
Lederhendler, Israel [271-567] National Institutes of Health; 301-451-7431; [email protected]
Lee, Andrea [137-321] YMCA of the USA; 312-419-8892; [email protected]
Lee, Chris [379] California Social Work Education Center; 510-642-9272; [email protected]
Lee, Heekweon [810] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); +82 2 589 2918; [email protected]
Lee, Ho-Dong [810] Ministry of Finance and Strategy; +82 2 2150 5370; [email protected]
Lee, Hwan [810] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); +82 2 589 2930; [email protected]
Lee, Janet [123-296] University of California, Los Angeles; 310-625-4883; [email protected]
Lee, Joseph [320] University of North Carolina at Chapel-Hill; 919-966-8948; [email protected]
Lee, Lark [137-607] PA Consulting Group; 830-964-3409; [email protected]
Lee, Linda E [238-582] Proactive Information Services Inc; 204-955-4489; [email protected]
Lee, Ling-Chu [886] National Applied Research Laboratories; +886 2 2737 7072; [email protected]
Lee, Lung-Sheng Steven [857] National United University; +886 37 381000; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 193
Lee, Sabra [385-674] Lesley University; 617-349-8450; [email protected]
Lee, Steven [685] University of Kansas; 785-864-9701; [email protected]
Lee, Yi-Fang [297-375-857] National Chi Nan University; +886 49 2910960 x2611; [email protected]
Lee, Yoon Been [137] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); 82-2-589-2290; [email protected]
Lee, Yuan-Hsuan [226-305] Texas A&M University; 979-862-7166; [email protected]
Lee Smith, Judith [137-779] Centers for Disease Control and Prevention; 770-488-4864; [email protected]
Lefor, Patricia J [879] Empire State College; 518-587-2100; [email protected]
Lehman, Suzanne [137] St Catherine University; 651-690-6811; [email protected]
Leight, Christine [259] ICF International; 703-225-2208; [email protected]
Lejeune, Andrew [356] University of Alberta; 780-991-3876; [email protected]
Lekies, Kristi [820] The Ohio State University; 614-688-3537; [email protected]
Lemieux, Véronique [579] University of Quebec at Montreal; [email protected]
Lemire, Sebastian [121] Rambøll Management Consulting; +45 2948 8188; [email protected]
Lemke, Melissa [678] University of Wisconsin; 414-219-5113; [email protected]
Lemma, Wuleta [814] Tulane University; [email protected]
Lenoch, Susan [792] University of Iowa; 319-335-8907; [email protected]
Lesesne, Catherine [137-312-619] Centers for Disease Control and Prevention; 770-488-6564; [email protected]
Lessard, Laura [118] Emory University; 404-727-8093; [email protected]
Letichevsky, Ana Carolina [137-512] Cesgranrio Foundation; +55 21 25547642; [email protected]
Levine, Carlisle [552] CARE; 202-595-2824; [email protected]
Levine, Cathy [112] The Universal Health Care Action Network of Ohio; 614-456-0060; [email protected]
Levine, Elyse [807] Academy for Educational Development; 202-884-8913; [email protected]
Leviton, Laura [100-118-309-400-669-864] Robert Wood Johnson Foundation; 609-627-5952; [email protected]
Levy, Abigail [277] Education Development Center; 617-618-2437; [email protected]
Levy, Deborah [870] SuccessLinks LLC; 202-256-4489; [email protected]
Lewis, Ashlee [218-804] University of South Carolina; 843-283-7605; [email protected]
Lewis, Deborah K [137] Ohio State University; 614-292-5089; [email protected]
Lewis, Holly [301] Arizona State University; 602-496-1085; [email protected]
Lewis, Johnnye [730] University of New Mexico; 505-991-3489; [email protected]
Lewis, Kelly [312] Georgia State University; 404-413-6210; [email protected]
Lewis, Nicole [657] University of Kentucky; 859-257-2628; [email protected]
Lewis, Tavia [137] City Year Inc; 617-927-2376; [email protected]
Lewis-Moss, Rhonda [137] Wichita State University; 316-978-3695; [email protected]
Lezin, Nicole [118] Cole Communications Inc; 831-479-1786; [email protected]
Li, Huaye [137] University of South Florida; 813-317-5496; [email protected]
Li, Shan Shan [886] National Applied Research Laboratories; 886-2-2737-7007; [email protected]
Li, Xiaoxuan [886] Chinese Academy of Sciences; 13911053629; [email protected]
Lieber, Michael D [662] University of Illinois at Chicago; 773-463-2527; [email protected]
Lifshitz, Chen [137] Branco Weiss Institute; 972-50-3109162; [email protected]
Light, Elana [595] ICF Macro; 646-695-8150; [email protected]
Lightfritz, Cassie [900] Center for Educational Technologies; 304-243-4417; [email protected]
Lin, Cindy [254] HighScope Educational Research Foundation; 734-485-2000 x241; [email protected]
Lindgren-Streicher, Anna [548] Museum of Science, Boston; 617-589-4231; [email protected]
Lindquist, Christine [672] RTI International; 919-485-5706; [email protected]
Ling, Deborah [876] University of California, Los Angeles; 310-880-1777; [email protected]
Linick, Matthew [137-248] University of Illinois at Urbana-Champaign; 815-791-1982; [email protected]
Lininger, Monica [265] Western Michigan University; 269-387-2703; [email protected]
Lippin, Tobi [240] New Perspectives Consulting Group; 919-286-5995; [email protected]
Lipson, Mindy [338] Mathematica Policy Research; 617-674-8360; [email protected]
Litvack, Jennie [539] World Bank; 202-458-7245; [email protected]
Liu, Che-Hao [137] National Normal University; 886-2-7734-1120; [email protected]
Llorente, Carlin [137] SRI International; 650-859-2381; [email protected]
Loadman, William [137-526-600-672] The Ohio State University; 614-292-8055; [email protected]
Lobosco, Anna [313-598] New York Sates Developmental Disabilities Planning Council; 518-486-7505; [email protected]
Lockman, Jennifer [597] Centerstone Research Institute; 615-460-4142; [email protected]
Lodge, John [219] Wright State University; 734-904-1349; [email protected]
Lohmeier, Jill [685] University of Massachusetts, Lowell; 978-934-4617; [email protected]
Londhe, Rucha [296] Goodman Research Group Inc; 617-491-7033; [email protected]
Longworth-Reed, Laricia [137-208] University of Denver; 303-871-4099; [email protected]
Looby, Karen [509] Austin Independent School District; 512-414-0027; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 194
Loomis, Ross J [527] RTI International; 919-541-6930; [email protected]
Lopez, Alexis [278] University of Los Andes, Colombia; +57 1 248 5725; [email protected]
Lopez, Kimberly Kay [603] Independent Consultant; 713-320-7917; [email protected]
Lorek, Edward [137] Eastern Virginia Medical School; 757-668-6434; [email protected]
Lorton Jr, Paul [256-296-598] University of San Francisco; 415-422-6185; [email protected]
Lovato, Chris [758] University of British Columbia; 604-875-4111 x66002; [email protected]
Lubke, Margaret [116-416] Utah State University; 435-797-4546; [email protected]
Lucas-McLean, Juanita [884] Westat; 301-294-2866; [email protected]
Lucio, Robert [718] University of South Florida; 813-974-3099; [email protected]
Ludwig, Rachel [122] Chautauqua Tapestry; 716-753-4513; [email protected]
Lugo-Gil, Julieta [226-265] Mathematica Policy Research; 609-945-3356; [email protected]
Lujan, Anita [319] Consorcio por la Salud, Ambiente y Desarrollo (ECOSAD); [email protected]
Luke, Douglas [137-675-827] Washington University in St Louis; 314-935-3704; [email protected]
Lundh, Patrik [137] SRI International; 650-859-3603; [email protected]
Luskin, Rebecca JC [389] University of California, Los Angeles; 310-872-4638; [email protected]
Luster, Jane Nell [713] Louisiana State University; 225-267-4024; [email protected]
Lutz, Bob [698] Gonzaga University; [email protected]
Lutz, Gene [373] University of Nothern Iowa; 319-273-2105; [email protected]
Lynch, Linda [758-834] United States Army; 816-520-3873; [email protected]
MMMMMMMM
Maak, Laurie [888] WestEd; 510-520-4658; [email protected]
Maas, Carl [830] University of South Carolina; 803-777-7000; [email protected]
Mabe, Bill [848] Rutgers University; 732-932-4100 x6213; [email protected]
Mabry, Linda [393] Washington State University, Vancouver; 360-546-9428; [email protected]
Machado, Verônica [137] Independent Consultant; +55 2130799740; [email protected]
Macken, Candace [729] Texas Education Agency; 512-463-7814; [email protected]
Madison, Anna [535] University of Massachusetts, Boston; [email protected]
Mage, Caroline [320] University of North Carolina; 919-966-3014; [email protected]
Magharious, Gina [385] David Heil & Associates Inc; 503-245-2102; [email protected]
Magnotta, Micheline [532] 3D Group; 510-463-0333 x204; [email protected]
Magura, Stephen [120-137-283-342-801] Western Michigan University; 269-387-5895; [email protected]
Mahajan, Namrata [298-606] Cobblestone Applied Research & Evaluation Inc; 562-412-0658; [email protected]
Mahon, Shelly [330] University of Wisconsin, Madison; 608-770-1342; [email protected]
Mahowski, Janet [218] University of South Florida; 727-244-3806; [email protected]
Malhotra, Sheetal [678] Medical Institute for Sexual Health; 512-328-6268 x206; [email protected]
Malloy, Courtney [510] Vital Research LLC; 323-951-1670; [email protected]
Malter, Frederic [206-586] University of Arizona; 520-318-7259 x114; [email protected]
Manai, Mohamed [132] African Development Bank; +0021671102416; [email protected]
Mandolia, Michelle [862] United States Environmental Protection Agency; 202-566-2198; [email protected]
Mann, Nathan [717] RTI International; [email protected]
Manning, Colleen [296-588] Goodman Research Group Inc; 617-491-7033; [email protected]
Mannix, Danyelle [320-627] United States Department of Health and Human Services; 240-276-1879; [email protected]
Mansori, Sophia [632-765] Education Development Center; 617-618-2113; [email protected]
Maples, Connie [122] ICF Macro; 404-321-3211 x2115; [email protected]
Maras, Melissa [761] University of Missouri; 573-884-9733; [email protected]
March, Melisa [716] Innovation Network; 202-728-0727 x102; [email protected]
Marchand, Marie-Pier [579] University of Quebec at Montreal; [email protected]
Marczak, Mary [733] University of Minnesota; 612-626-3968; [email protected]
Marete, Mary [898] Pennsylvania State University; 301-917-7761; [email protected]
Margolin, Jonathan [327] Learning Point Associates; 312-288-7632; [email protected]
Maria, Whitsett [509] Moak, Casey & Associates; 512-485-7878; [email protected]
Marino, Eduardo [898] Independent Consultant; +551183719989; [email protected]
Mark, Melvin [273-433-498-746-782-902] Pennsylvania State University; 814-865-9515; [email protected]
Marks, Victoria R [137] American Institutes for Research; 202-403-5170; [email protected]
Marr, Angela [807] Centers for Disease Control and Prevention; 770-488-1428; [email protected]
Marshall, LaTisha [892] Centers for Disease Control and Prevention; [email protected]
Martin, Brad [222] Centerstone Research Institute; 615-460-4136; [email protected]
Martin, Cassandra [720] Centers for Disease Control and Prevention; 770-488-5786; [email protected]
Martin, Ian [732] University of San Diego; 619-260-7612; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 195
Martin, James [504] Mule Town Family Network; 931-446-9601; [email protected]
Martinasek, Mary [137] University of South Florida; 813-493-4546; [email protected]
Martineau, Jennifer [436] Center for Creative Leadership; 336-286-4419; [email protected]
Martinez, Alina [277-739] Abt Associates Inc; 617-349-2312; [email protected]
Martinez, Raul [545] Harder+Company; 415-522-5400; [email protected]
Martinez Ortiz, Araceli [875] Sustainable Future Inc; 512-569-3622; [email protected]
Martínez-Saldaña, Jesus [695] Independent Consultant; 559-307-7941; [email protected]
Martz, Dawn [705] Foellinger Foundation Inc; 260-422-2900; [email protected]
Masimore, Beth [231] Discovery Logic; 240-912-1975; [email protected]
Massey, Oliver [523] University of South Florida; 813-974-6403; [email protected]
Mathias, Chris [379] California Social Work Education Center; 510-642-7490; [email protected]
Mathison, Sandra [137-309-572-582] University of British Columbia; 604-879-7386; [email protected]
Matjasko, Jennifer [899] Centers for Disease Control and Prevention; 770-488-4267; [email protected]
Matteson, Michael [603] University of Wollongong; [email protected]
Mattox, John [880] Knowledge Advisors; 615-591-1032; [email protected]
Matulis, Janet [216-417-676] Cincinnati Children's Hospital Medical Center; 513-803-1891; [email protected]
Matzen, Nita [137] Appalachian State University; 828-262-6064; [email protected]
Max, Jeffrey [265] Mathematica Policy Research; 202-484-4236; [email protected]
Maxwell, Ann [376-529] United States Department of Health and Human Services; 312-353-9871; [email protected]
May, Jenny [777] University of South Carolina; 803-777-8202; [email protected]
May, John [386] University of South Carolina; 803-777-0316; [email protected]
Mayfield, Marcia [301] Paraprofessional Healthcare Institute (PHI); 718-928-2074; [email protected]
Maynard, Kathie [117] University of Cincinnati; 513-556-2023; [email protected]
Mazurkiewicz, Grzegorz [137] Jagiellonian University; +48501268058; [email protected]
McAndrew, Abra [703] University of Arizona; 520-626-4688; [email protected]
McBride, Dominica [511] Center for African American Health; 480-430-9709; [email protected]
McClure, Megan [612] Texas A&M University; 785-564-0949; [email protected]
McConnell, Sheena [826] Mathematica Policy Research; 202-484-4518; [email protected]
McCoy, Lynn [636-859] Pact Inc; 360-217-5012; [email protected]
McCoy, Teresa [813] University of Maryland; 301-405-4153; [email protected]
McCracken, Kasey [385] Oregon Health & Science University; 503-245-2102; [email protected]
McCrae, Marjorie [607] Research Into Action; 503-287-9136; [email protected]
McCrae, Tarsha [137] National Institutes of Health; 301-443-8972; [email protected]
McCullough, Anna [320] University of North Carolina; 919-843-2746; [email protected]
McDermott, Peter [224] Children's Investment Fund Foundation; [email protected]
McDonald, Daniel [737-773] University of Arizona; 520-626-5161; [email protected]
McEathron, Mary [127-283-363-427] University of Minnesota; 612-750-5276; [email protected]
McGahey, Richard [745] Ford Foundation; 212-573-5398; [email protected]
McGuire, Joan [289] University of Connecticut; 860-486-6201; [email protected]
McGuire, Martha [337] Cathexis Consulting; 416-469-9954 x224; [email protected]
McKay, Kathleen [260-420-628] Connecticut Children's Medical Center; 860-545-9423; [email protected]
McKay, Tasseli [672] RTI International; 919-485-5747; [email protected]
McKegg, Kate [307-800] The Knowledge Institute; +64-21-475-919; [email protected]
McKenna, Margaret [708] ConTEXT; 206-935-6340; [email protected]
McKenzie, Robetta [519-623-678-809] Augusta Partnership for Children Inc; 706-721-4885; [email protected]
McKinney, Christopher [302] Mental Health Center of Denver; 303-504-6638; [email protected]
McKlin, Tom [226-496-525] The Findings Group LLC; 404-788-4506; [email protected]
McKnight, Katherine [206-580-586] Pearson Corporation; 703-389-5401; [email protected]
McKnight, Patrick [246-586-666] George Mason University; 703-993-8292; [email protected]
McLain, Ed [731-811] University of Alaska, Anchorage; 907-952-8940; [email protected]
McLean, Cathie [302] Mental Health Center of Denver; 303-504-6578; [email protected]
McLinden, Daniel [676-885] Cincinnati Children's Hospital Medical Center; 513-636-8933; [email protected]
McMillin, Stephen Edward [711] University of Chicago; 773-329-0289; [email protected]
McNair, Shannan [875] Oakland University; 248-320-5637; [email protected]
McNall, Miles [260-543-679-710-859] Michigan State University; 517-432-0475; [email protected]
McNeil, Keith [266] University of Texas, El Paso; 575-636-4721; [email protected]
McQuiston, Thomas [240-730] Tony Mazzocchi Center for Health, Safety and Environment; 919-929-5878; [email protected]
McRae, Marjorie [127] Research Into Action; 503-287-9136; [email protected]
McWayne, Janis [874] Francis Marion University; 843-661-1467; [email protected]
Means, Barbara [116] SRI International; 650-859-5001; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 196
Meeks, Mendy [881] Virginia Department of Medical Assistance Services; 804-225-4285; [email protected]
Meli, Jane [137] University of North Carolina at Greensboro; 336-315-7406; [email protected]
Melkers, Julia [391-531] Georgia Institute of Technology; 404-385-0456; [email protected]
Mello, Dan [547] WestEd; 781-481-1158; [email protected]
Menke, James Michael [206-326] University of Arizona; 520-621-5463; [email protected]
Menkes, Susan [137-226] Claremont Graduate University; [email protected]
Menoher, Brandee [803] Points of Light Institute; 404-641-7220; [email protected]
Menon, Goutham [209-263] University of Texas, San Antonio; 210-458-2625; [email protected]
Menon, Nidu [320] North Carolina Health and Wellness Trust Fund; 919-855-6880; [email protected]
Mentzer, Gale [237] University of Toledo; 419-530-4910; [email protected]
Mercier, Celine [749] University of Montreal; 514-364-2282 x2360; [email protected]
Meredith, Julie [303] University of Pittsburgh; 412-624-7596; [email protected]
Merola, Stacey [137-606-729] ICF International; 703-225-2315; [email protected]
Mertens, Donna [318-497-782-889] Gallaudet University; 202-651-5545; [email protected]
Merves, David [249-844-869] Evergreen Educational Consulting LLC; 802-434-5607; [email protected]
Mettrick, Jennifer [881] University of Maryland; 410--706-4712; [email protected]
Metzger, Isha W [280] University of South Carolina; 404-784-7659; [email protected]
Meyer, Cheryl [219-435-508] Wright State University; 937-775-2886; [email protected]
Meyers, Duncan [137-280] University of South Carolina; 803-414-1090; [email protected]
Michaels, R Gregory [738] Chemonics International; 202-270-6761; [email protected]
Michalchik, Vera [137] SRI International; 650-859-4176; [email protected]
Michel, Rochelle [345] Educational Testing Service; 609-734-5726; [email protected]
Middaugh, Ellen [125] University of California, Berkeley; 510-643-1984; [email protected]
Middendorf, Jan [116-220-831-897] Kansas State University; 785-532-4716; [email protected]
Mielke, Monica [692] Policy Studies Associates; 202-939-5320; [email protected]
Mijanovich, Tod [273] New York University; [email protected]
Mikkelsen, Megan [618] Washington State Department of Health; 360-236-3853; [email protected]
Miller, Andy [607] United States Environmental Protection Agency; 919-541-2920; [email protected]
Miller, Christine [702] Savannah College of Art and Design; 912-525-6433; [email protected]
Miller, M David [262] University of Florida; 352-273-4306; [email protected]
Miller, Patricia [137] Nemours Health and Prevention Services; 302-444-9067; [email protected]
Miller, Robin Lin [260-389] Michigan State University; 517-432-3267; [email protected]
Millett, Ricardo [737-785] Ricardo Millett and Associates; 773-752-9600; [email protected]
Mills, Jack [342] Independent Consultant; 909-224-0412; [email protected]
Milton, Jessica [596] University of North Carolina at Chapel Hill; [email protected]
Mindrila, Diana [386] South Carolina Educational Policy Center; 803-777-7416
Minja-Trupin, Christine [133] Meharry Medical College; 615-327-6528; [email protected]
Minzner, Amy [829] Abt Associates Inc; [email protected]
Mir, Nushina [625] Lumina Foundation for Education; 317-951-5340; [email protected]
Mirambeau, Alberta [618] Centers for Disease Control and Prevention; 770-488-8185; [email protected]
Miron, Gary [589-750-811] Western Michgian University; 269-387-3883; [email protected]
Misra, Shalini [691] University of California, Irvine; 949-331-5300; [email protected]
Mitchell, Nora [127] National Park Service; 802-457-3368; [email protected]
Mitchell-Herzfeld, Susan [120] New York State Office of Children and Family Services; 518-474-9486
Moberg, D Paul [133] University of Wisconsin, Madison; 608-263-1304; [email protected]
Mock, Nancy [738] Tulane University; 504-899-8898; [email protected]
Modarresi, Shahpar [225] Montgomery County Public Schools; 301-279-3579; [email protected]
Moe, Judith [537] Indian and Northern Affairs Canada; 613-947-5023; [email protected]
Moeykens, Barbara [320] NC Health and Wellness Trust Fund; 919-855-6881; [email protected]
Mohan, Rakesh [308-341-388-615] Idaho State Legislature; 208-332-1470; [email protected]
Mohr, David [658-829] United States Department of Veterans Affairs; 857-364-5679; [email protected]
Mohr, Ruth [625] SPEC Associates; 734-662-5253; [email protected]
Mohre, Gaylen [592] University of California, San Francisco; 415-476-3689; [email protected]
Molinaro, Lisa [552] Aspen Institute; 202-736-5813; [email protected]
Molitor, Fred [306] Walter R McDonald and Associates Inc; 916-239-4020 x246; [email protected]
Mollette, Melinda [137] North Carolina State University; 919-986-9149; [email protected]
Molloy, Patty [764] Evergreen Training & Evaluation; 206-780-3343; [email protected]
Molyneaux, Jack [399] Millennium Challenge Corporation; 202-521-3600; [email protected]
Monchuk, Victoria [539] World Bank; 202-458-0916; [email protected]
Monem, Abeer [585] Fort Bend County Women's Center Inc; 281-342-0251; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 197
Monrad, Diane [386-606] University of South Carolina; 803-777-8244; [email protected]
Montano, Daniel [137-779] Battelle Memorial Institute; 206-528-3105; [email protected]
Montgomery, Florita [813] West Virginia University Extension; 304-293-8701; [email protected]
Montrosse, Bianca [137-361-385-579] Western Carolina University; 843-267-0098; [email protected]
Moo Sang, Brian [537] Treasury Board of Canada; 613-957-9653; [email protected]
Moore, Andrea [360] MANILA Consulting Group Inc; 404-639-6262; [email protected]
Moore, Angela [673-717] National Institute of Justice; 202-307-0145; [email protected]
Moore, Deborah [853] University of Minnesota; 612-625-7813; [email protected]
Moore, Marah [110-707] i2i Institute Inc; 575-758-7513; [email protected]
Moore, Mea [764] Professional Educator Standards Board; 360-725-6276; [email protected]
Moore, Patricia [811] Western Michigan University; 269-388-9494 x201; [email protected]
Moore, Raeal [137-600-672] The Ohio State University; 614-247-6256; [email protected]
Moore, Scott C [237-829] United States Department of Veterans Affairs; 513-247-4284; [email protected]
Moore-Monroy, Martha [744] University of Arizona; 520-626-1709; [email protected]
Moorthy, Savitha [278-686] SRI International; 650-859-5143; [email protected]
Morahan, Page [256] Foundation for Advancement of International Medical Education and Research; 215-823-2240; [email protected]
Morales, Julie [137-720] University of Denver; 303-871-4873; [email protected]
Moran, Garrett [881] Westat; 301-294-3821; [email protected]
Morariu, Johanna [205-883] Innovation Network; 202-728-0727 x103; [email protected]
Moreau, Katherine [137-252] University of Ottawa; 613-260-2206; [email protected]
Moreira dos Santos, Elizabeth [137-814] Oswaldo Cruz Foundation (Fiocruz); +55 21 25982861; [email protected]
Morell, Jonathan [235-283-503] Vector Research Center; 734-646-8622; [email protected]
Morgan, Annie [900] Challenger Learning Center; 304-243-1479; [email protected]
Morgan, Chris [612] University of Georgia; 706-542-7102; [email protected]
Morgan, Claire [614] WestEd; [email protected]
Morgan, Dewayne [288] University System of Maryland; 301-445-2731; [email protected]
Morgan, Grant [114-286-874] University of South Carolina; 803-576-6331; [email protected]
Moriarty, Mary [289] Picker Engineering Program, Smith College; 413-585-6972; [email protected]
Morin, Diane [749] University of Quebec at Montreal; 514-987-3000 x4924; [email protected]
Moronta, Domingo [817] St Barnabas Hospital; 646-338-7600; [email protected]
Morra Imas, Linda [617] World Bank; 202-247-7988; [email protected]
Morris, Meghan [137] State University of New York at Albany; 518-442-5027; [email protected]
Morris, Michael [582] University of New Haven; 203-932-7289; [email protected]
Morrow, Jennifer [137-315-532-593-872] University of Tennessee, Knoxville; 865-974-6117; [email protected]
Morrow, Nathan [738] World Vision International; 504-899-8898; [email protected]
Morrow, Stephanie [235] Volpe National Transportation Systems Center; 617-494-2172; [email protected]
Mortensen, Jennifer [137-630-710] Michigan State University; 224-715-3193; [email protected]
Mortimer, Sharon [387] Michael Smith Foundation for Health Research; 604-714-2777; [email protected]
Morzuch, Michaella [245] Mathematica Policy Research; 617-674-8352; [email protected]
Moster, Kristina [137] Cincinnati Children's Hospital Medical Center; 513-803-0582; [email protected]
Mostovoy, Cathie [126] Woodcraft Rangers; 213-249-9293; [email protected]
Motamedi, Kurt [590] Pepperdine University; 310-568-5577; [email protected]
Mowat, Marisa [137] St Joseph's Children's Advocacy Center; 813-493-4546; [email protected]
Mueller, Nancy [390-616-638] Washington University in St Louis; 314-935-3710; [email protected]
Mueller, Patricia [495-844-869] Evergreen Educational Consulting LLC; 802-434-5607; [email protected]
Muhr, Kathy [658-841] University of Massachusetts; 508-856-3533; [email protected]
Mukhopadhyay, Kankana [315] University of Rochester; 585-362-5666; [email protected]
Muller-Clemm, Werner [304] Canadian Health Services Research Foundation; 613-728-2238 x214; [email protected]
Mulvey, Christopher [829] Abt Associates Inc; 617-520-2822; [email protected]
Mumford, Steve [292] Organizational Research Services; 206-728-0474 x224; [email protected]
Mundy, Brian [713] Institute for Community Living Inc; 212-385-3030 x3236; [email protected]
Munley, Mary Ellen [877] MEM and Associates; 708-660-9290; [email protected]
Munson, April [634] Kennesaw State University; 770-423-6138; [email protected]
Murphrey, Theresa [137] Texas A&M University; 979-458-2749; [email protected]
Murphy, Kelly [126] Claremont Graduate University; 909-607-1540; [email protected]
Murphy, Kevin [137] State University of New York at Albany; 518-442-5027; [email protected]
Muse, Andrea [682] MANILA Consulting Group Inc; 571-633-9797; [email protected]
Muthoni, Rachel [272] International Center for Tropical Agriculture; +256 754 44 77 86; [email protected]
Mycek, Kristina [137-296-754] State University of New York at Albany; 585-313-8855; [email protected]
Myhlhousen-Leak, Georgetta [137] University of Iowa; 641-672-2058; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 198
Myrick, Shannon [348] Oregon Youth Authority; 503-373-7387; [email protected]
Mzumara, Howard [515] Indiana University-Purdue University Indianapolis; 317-278-2214; [email protected]
NNNNNNNN
Nagy, Mark [829] Xavier University; [email protected]
Nahan, Neva [435] Wayne State University; 313-577-9918; [email protected]
Naidoo, Indran [202] Office of the South African Public Service Commission; 27-12-352-1039; [email protected]
Na'im, Alyssa [117-765-875] Education Development Center; 617- 618-2456; [email protected]
Najab, Julius [680] George Mason University; 703-993-8292; [email protected]
Nakamura, Osamu [890] Nagasaki Prefectural Government; +81 95 895 2520; [email protected]
Nalls, Mercedes [803] Florida State University; 850-241-3183; [email protected]
Nangle, Desiree [137] Claremont Graduate University; [email protected]
Naoom, Sandra [280] National Implementation Research Network; 919-636-2035; [email protected]
Nascimento, Lori [264-592-797] California Endowment; 213-928-8637; [email protected]
Natenshon, Debra [205] The Center for What Works; 773-398-8858; [email protected]
Ndichu, Eric [616] Washington University in St Louis; 314-935-4368; [email protected]
NDinga, Pascal [579] University of Quebec at Montreal; 514-987-3000; [email protected]
Nearing, Kathryn [595-850] University of Colorado, Denver; 303-315-4945; kathryn.nearing @ucdenver.edu
Nelsestuen, Kari [610-725-811] Education Northwest; 503-275-9588; [email protected]
Nelson, Amber [609] University of Maryland; 301-405-6417; [email protected]
Nelson, Catherine A [677] Independent Consultant; 818-851-9771; [email protected]
Nelson, Nanette [866] University of Wyoming; 307-399-0496; [email protected]
Nelson, Randi [524-681] JVA Consulting LLC; 720-407-8406; [email protected]
Neubauer, Leah [325] DePaul University; 773-325-4768; [email protected]
Neupert, Shevaun [137] North Carolina State University; 919-513-8514; [email protected]
Nevins, Kate [801] Human Services Research Institute; 617-876-0426 x2328; [email protected]
Nevo, David [734] Tel Aviv University; [email protected]
Newcomer, Kathryn [615-687-727] George Washington University; 202-994-3959; [email protected]
Newman, Denis [566] Empirical Education Inc; 650-328-1734 x112; [email protected]
Newman, Dianna L [137-313-598-879] State University of New York at Albany; 518-329-5027; [email protected]
Newman, Frederick [106-300-600] Florida International University; 816-585-3882; [email protected]
Newton, Xiaoxia [643] University of California, Berkeley; 510-643-8385; [email protected]
Newton-Curtis, Linda [259-299] Human Services Research Institute; 503-924-3783 x15; [email protected]
Ngapo, Chantalle [654] Te Wananga o Aotearoa; +64 7 872 0330; [email protected]
Ngugi, Mary [636] Pact Inc; 202-466-5666; [email protected]
Nichols, Allison [813] West Virginia University Extension; 304-293-8643; [email protected]
Nichols-Barrer, Ira [884] Mathematica Policy Research; 617-674-8364; [email protected]
Nickel, Philip [137] AVID Center; 858-380-4739; [email protected]
Nielsen, Julie [211-574] NorthPoint Health and Wellness Center Inc; 612-543-2578; [email protected]
Nikolova, Valya [836] World Bank; 202-473-4483; [email protected]
Nilsen, Corinne [137] Wichita State University; 316-978-7814; [email protected]
Nimon, Kim [435] University of North Texas; 214-675-4872; [email protected]
Nistler, Mary [327] Learning Point Associates; 312-288-7629; [email protected]
NIxon, Carol [525-875] Edvantia Inc; 615-248-0248; [email protected]
Nixon, J Alice [609] University of Maryland; 301-405-9369; [email protected]
Nkamleu, Guy Blaise [885] African Development Bank; 216-7110-2241; [email protected]
Nnawulezi, Nkiru [245] Michigan State University; 517-353-4568; [email protected]
Noble, Corinne [116] Center for Human Services Research; 518-591-8785; [email protected]
Nochajski, Thomas H [209] State University of New York at Buffalo; 716-645-1245; [email protected]
Noda, Joshua [881] Westat; [email protected]
Noga, Janice [363-597-724] Pathfinder Evaluation and Consulting; 513-533-1643; [email protected]
Norman, Cameron [387] University of Toronto; 416-978-1242; [email protected]
Norris, Kathleen [374-734] Plymouth State University; 603-535-3023; [email protected]
Novais, Gabe [137] SRI International; 650-859-2835; [email protected]
Nuckles, Kimberly [127] Minnesota Pollution Control Agency; 651-757-2618; [email protected]
Nunn, Jacqueline [845] Johns Hopkins university; [email protected]
Nwangwu, Ndidi [137] Centers for Disease Control and Prevention; 770-488-4286; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 199
OOOOOOOO
Ochieng, Cliff [898] Safe Water and AIDS project; [email protected]
O'Connell, Ann [600] The Ohio State University; [email protected]
O'Conner, Rosemarie [729] ICF Macro; 703-934-3000; ro'[email protected]
O'Connor, Alan [527] RTI International; [email protected]
Odhiambo, Karen [732] University of Nairobi; +254 722334649; [email protected]
O'Donnell, Cara [730] Science and Technology Policy Institute; [email protected]
O'Fallon, Liam [730] National Institute of Environmental Health Sciences; [email protected]
Officer, Kelly [348] Oregon Criminal Justice Commission; 503-378-6224; [email protected]
Ofir, Zenda [132-202-243] Evalnet South Africa; +27 82 881 0251; [email protected]
Ogunbanjo, Gboyega [256] University of Limpopo; +012 5214528; [email protected]
Ohkubo, Saori [857] Johns Hopkins University; 410-659-6398; [email protected]
Oka, Shuichi [890] National Institute of Advanced Industrial Science and Technology; +81 29 862 6069; [email protected]
Okonkwo, Charles [137-672] The Ohio State University; [email protected]
Olatunji, Anane [226-265-496] Fairfax County Public Schools; 571-423-1445; [email protected]
Olderbak, Sally [719] University of Arizona; [email protected]
Oliphant, Emmerentie [333] Stephen F Austin State University; 936-622-3814; [email protected]
Oliveira, Luisa [137] Fluminense Federal University; luisa,[email protected]
Oliveira, Thais [137] Oswaldo Cruz Foundation; 055-21-98111627; [email protected]
Oliver, Monica [618] Centers for Disease Control and Prevention; 404-931-9759; [email protected]
Olmos-Gallo, Pablo [302] Mental Health Center of Denver; 303-504-6661; [email protected]
Olney, Cynthia [512] National Network of Libraries of Medicine; 678-682-3864; [email protected]
Olsen, Lenore [799] Rhode Island College; 781-784-9487; [email protected]
Olsho, Lauren [227] Abt Associates Inc; 617-349-2326; [email protected]
Olson, Chris [352-570] European Bank for Reconstruction and Development; +011 44 207 338 6000; [email protected]
Ondrusek, Robert [437] International Federation of Red Cross and Red Crescent Societies; +66-84-752-6159; [email protected]
O'Neil, Sasigant [338] Mathematica Policy Research; 617-301-8975; so'[email protected]
ONeill, Cassandra [893] Wholonomy Consulting; 520-888-2545; [email protected]
Ooi, Kenta [890] National Institute of Advanced Industrial Science and Technology; +81-29-862-6069; [email protected]
Oppenheimer, Caitlin [113] NORC at the University of Chicago; 301-634-9322; [email protected]
Ordowich, Chris [567] SRI International; 703-247-8485; [email protected]
Orians, Carlyn [279-540-720] Battelle Memorial Institute; 206-528-3320; [email protected]
Oros, Cheryl [431-569-689] Oros Consulting LLC; 703-524-6420; [email protected]
Ortega, Sandra [364] Ohio DELTA and Rape Prevention Education; 614-898-0070; [email protected]
Ortez, Omar [849] Oxfam America; 857-928-3241; [email protected]
Ortiz, Lorena [530] Berkeley Policy Associates; 510-465-7884 x213; [email protected]
Orwin, Robert [137-522] Westat; 301-251-2277; [email protected]
Osatuke, Katerine [237-658-695-829] United States Department of Veterans Affairs; 513-247-2255; [email protected]
Oscarsson, Lars [268] Orebro University; +46705457410; [email protected]
Ostenso, Laura [716] Innovation Network; 202-728-0727 x114; [email protected]
O'Sullivan, Rita [137-204-324-424-671-876] University of North Carolina at Chapel-Hill; 919-843-7878; [email protected]
Otero, Martina [261] Fonte Institute; 551130321108; [email protected]
Otieno, Brian [898] Safe Water and AIDS project; [email protected]
Otto, Tamara [845] Johns Hopkins university; [email protected]
Outley, Corliss [137] Texas A&M University; 979-458-0937; [email protected]
Overbay, Amy [137] North Carolina State University; 919-637-0787; [email protected]
Oviedo, Magaly [319] Consorcio por la Salud, Ambiente y Desarrollo (ECOSAD); + 51 1 332 5713
Owens, Corina [740-799] University of South Florida; 813-943-1217; [email protected]
Owens, Robert [525] Washington State University; 509-335-8394; [email protected]
Owens, Timothy J [600] Purdue University; [email protected]
Oyer, Elizabeth [203] EvalSolutions Inc; 317-582-1925; [email protected]
Oyloe, Peter [137] Academy for Educational Development; +977 1 444 4753; [email protected]
Ozawa, Jennifer [567] SRI International; 703-247-8431; [email protected]
Ozga, Jenny [789] University of Edinburgh; [email protected]
Öztürk, Mehmet [843] Arizona State University; 602-496-1151; [email protected]
PPPPPPPP
Pace, April [619] Center for Health Training Resource Group; 206-223-1186; [email protected]
Pacifico, Massimiliano [268] Evaluation Unit of Region Lazio; +39 06 51683452; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 200
Packer-Muti, Barbara [256-512] Nova Southeastern University; 954-262-5398; [email protected]
Pahl, Dale [607-633-846] United States Environmental Protection Agency; 919-541-1851; [email protected]
Pan, Hui-Ling [137] National Taiwan Normal University; +886282111897; [email protected]
Pan, Wei [300] University of Cincinnati; 513-556-2610; [email protected]
Panagides-Busch, Melissa [533] Academy for Educational Development; 202-884-8142; [email protected]
Pankaj, Veena [552-808] Innovation Network; 202-728-0727 x107; [email protected]
Pannone, Aaron [137] University of Virginia; 434-924-9032; [email protected]
Pant, Prakash Dev [137] N-MARC Project; +977 9841525718; [email protected]
Paquette, Ed [868] AIDS Project Hartford; 860-951-4833; [email protected]
Park, Jiyoung [137] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); +82 2 589 2290; [email protected]
Parker, Loran Carleton [392] Purdue University; 765-494-6646; [email protected]
Parker, Susan [557-769] Clear Thinking Communications; 802-748-3070; [email protected]
Parman, Mark [137] Cherokee Nation; 918-207-4973; [email protected]
Parrish, Donna [409] Clark Atlanta University; 770-883-9974; [email protected]
Parsons, Beverly A [110-261-507-743] InSites; 360-638-1442; [email protected]
Passa, Aikaterini [137-259-729-798] ICF International; 703-225-2161; [email protected]
Pastore, Serafina [375-768] University of Bari; +0039 349 8778918; [email protected]
Patel, Mayur [124-745-895] John S and James L Knight Foundation; 305-908-2600; [email protected]
Patel-Larson, Alpa [360] Centers for Disease Control and Prevention; 404-639-3253; [email protected]
Patrick, Jonathan [268] Department for International Development; [email protected]
Patrizi, Patricia [690-745] Patrizi & Associates; 215-732-2200 x235; [email protected]
Patroclo, Maria Aparecida [137] National School of Public Health (ENSP/Fiocruz); [email protected]
Patron-Cortes, Roger [294] Universidad Autonoma de Campeche; +52-999-9195824; [email protected]
Patton, Michael Quinn [100-235-276-307-323-690-736-851] Utilization-Focused Evaluation; 651-690-3254; [email protected]
Patton-Terry, Nicole [306] Georgia State University; 404-413-8326; [email protected]
Paulmer, Hubert [898] Harry Cummings and Associates Inc; 613-884-2828; [email protected]
Paulsell, Diane [307] Mathematica Policy Research; 609-275-2297; [email protected]
Paulsen, Christine [137-879] Concord Evaluation Group LLC; 978-369-3519; [email protected]
Pawloski, Tammy [874] Francis Marion University; 843-661-1475; [email protected]
Payne, Gayle [227] Centers for Disease Control and Prevention; 770-488-8050; [email protected]
Payne, Pamela B [773] University of Arizona; 520-621-4284; [email protected]
Pearce, Susan [137-779] Battelle Memorial Institute; 206-528-3154; [email protected]
Pearsall, Tara [137-518-845-877] Savannah College of Art and Design; 803-546-6119; [email protected]
Peaster, Trisha [137] Wichita State University; 316-978-6772; [email protected]
Peck, Laura [273-826] Arizona State University; 602-496-0460; [email protected]
Peisher, Ann [519-623-678-809] University of Georgia; 706-549-7032; [email protected]
Pelkowski, Tracy [223] University of Pittsburgh; 412-624-7240; [email protected]
Pelt, Juanita [137] The Evaluation Group; 803-719-5108; [email protected]
Pemberton, Neva [876] University of California, Los Angeles; 510-316-9723; [email protected]
Pendleton, Karen [437-896] University of South Carolina; 803-978-7574; [email protected]
Penna-Firme, Thereza [137-512] Cesgranrio Foundation; +55 21 2279 5849; [email protected]
Penuel, William R [116-560] SRI International; 415-269-0902; [email protected]
Perez, Jesus [137] Lou Panci, Citrus Health Network; 757-329-4690; [email protected]
Perkins, John [619] Center for Health Training Resource Group; 206-223-1186; [email protected]
Perrin, Karen [137] University of South Florida; 813-974-6704; [email protected]
Perry, Aubrey W [593] Portland State University; 405-596-0005; [email protected]
Perry, Joy [605] Fort Morgan School District; 970-867-5633 x48113; [email protected]
Perry, Katye [435-554-734-793] Oklahoma State University; 405-744-9447; [email protected]
Persaud, Nadini [350-430-676] University of the West Indies; +246-438-0595; [email protected]
Pesl Murphrey, Theresa [435] Texas A&M University; 970-458-2749; [email protected]
Peters, Jane [127] Research Into Action; 503-287-9136; [email protected]
Petersén, Anna [268] Orebro University; +4619303000; [email protected]
Peterson, Lance [306] Case Western Reserve University; 216-368-2734; [email protected]
Peterson, Linda [758] University of British Columbia; 604-875-4111 x66200; [email protected]
Petit-Bois, Merlande [740] University of South Florida; 813-477-2305; [email protected]
Petrochenkov, Katya [804] Gatti Evaluation Inc; 412-477-8025; [email protected]
Petrosino, Anthony [614] WestEd; 781-481-1100; [email protected]
Petrovich, James [885] University of Texas, Arlington; 682-478-7660; [email protected]
Petrucci, Carrie [137-367] Evaluation, Management & Training Associates Inc; 818-667-9167; [email protected]
Petrulis, Robert [137-777] University of South Carolina; 803-777-1246; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 201
Pettibone, Kristi [602] National Institute of Environmental Health Sciences; 919-541-7752; [email protected]
Petty, Richard [329] Independent Living Research Utilization; 713-520-0232; [email protected]
Pfaff, John [137] Fordham Law School; 212-636-7661; [email protected]
Pham, Thanh [383] University of South Florida; 813-406-7925; [email protected]
Phelps, Jerry [137] National Institute of Environmental Health Sciences; 919-541-4259; [email protected]
Philipose, Sandy [566] Empirical Education Inc; 650-328-1734 x156; [email protected]
Phillips, Kaye [304] Canadian Health Services Research Foundation; 613-327-7483; [email protected]
Phillips, Susan [617] Carleton University; 613-520-2600 x2633; [email protected]
Phillips, Tina [267-347] Cornell Univeristy; 607-254-2482; [email protected]
Philp, Joel [137] The Evaluation Group; 803-719-5102; [email protected]
Picher, Helen Davis [263-365] William Penn Foundation; 215-988-1830; [email protected]
Pierce, Steven [366-710] Michigan State University; 517-353-9288; [email protected]
Pierre, Paule-Anny [537] Department of Canadian Heritage; 819-953-7841; [email protected]
Ping, Yu [827] Battelle Memorial Institute; 703-875-2981; [email protected]
Pinsker, Eve [662] University of Illinois at Chicago; 773-802-4802; [email protected]
Piontek, Mary [374] EmcArts Inc; 734-649-6866; [email protected]
Pipi, Kataraina [307-591-782] Independent Consultant; +64 9 827 8967; [email protected]
Pirozzi, Stephen [570] World Bank; 202-458-8772; [email protected]
Plaskett, Nancy [677] Chicago Children's Museum; 312-527-1000; [email protected]
Plaut, Julie [760] Minnesota Campus Compact; 651-707-7820; [email protected]
Pless Jr, Albert [541] Cambridge Public Health Department; 617-665-3830; [email protected]
Podems, Donna [318-897] ICF Macro International; +27 21 418 3369; [email protected]
Polin, Meridith [665] Public/Private Ventures; 212-822-2411; [email protected]
Polinsky, Margaret [519-629] Parents Anonymous Inc; 909-621-6184 x213; [email protected]
Pollack, Harold [285] University of Chicago; 773-702-4414; [email protected]
Pollard, Michael [231] Discovery Logic; 240-912-1901; [email protected]
Polt, Wolfgang [726] Joanneum Research; +43 1 5817520; [email protected]
Polus, Elena [244] Iowa State University; [email protected]
Polush, Elena [623] Iowa State University; 515-460-1443; [email protected]
Ponomariov, Branco [569] University of Texas, San Antonio; 210-478-6767; [email protected]
Poole, Dennis [830] University of South Carolina; 803-777-7000; [email protected]
Pope, Paul [137-394] Texas A&M University; 979-845-7202; [email protected]
Popkin, Stephen [736] Volpe National Transportation Systems Center; [email protected]
Porowski, Allan [137-259-686-729-798] ICF International; 703-225-2229; [email protected]
Porter, Alan [311-531] Georgia Institute of Technology; 404-384-6295; [email protected]
Porter, Breanne [803] Florida State University; 850-345-0357; [email protected]
Porter, Michael [576] College Center for Library Automation; 850-922-6044; [email protected]
Potamites, Liz [845] Mathematica Policy Research; 202-484-9220; [email protected]
Poth, Cheryl [261-356] University of Alberta; 780-492-1144; [email protected]
Potter, Lance [124-292] Bill & Melinda Gates Foundation; 202-662-8177; [email protected]
Potter, Robert [740] University of South Florida; 813-974-6957; [email protected]
Powell, Brian [392-511] University of Cincinnati; 513-787-8172; [email protected]
Powers, Jane [401-584-699] Cornell University; 607-255-3993; [email protected]
Prather, Heather [137] United States Office of Personnel Management; 202-553-1312; [email protected]
Pratt, Brandy [137] Western Michigan University; 269-344-0089; [email protected]
Preskill, Hallie [124-276-521-720-864-902] Strategic Learning & Evaluation Center; 206-624-6745 x307; [email protected]
Pribesh, Shana [734] Old Dominion University; 757-683-6684; [email protected]
Price, Karen [386-538-685] South Carolina Educational Policy Center; 803-777-7416; [email protected]
Price, Rebecca [223] University of Pittsburgh; 412-624-7240; [email protected]
Pride, Bryce [740] University of South Florida; 321-287-5767; [email protected]
Prince, Bonnie [616] Ohio University; [email protected]
Prince, Mary [564-619] South Carolina Campaign to Prevent Teen Pregnancy; 803-771-7700; [email protected]
Probus, Matt [231] Discovery Logic; 240-912-1966; [email protected]
Protik, Ali [265] Mathematica Policy Research; 202-484-4232; [email protected]
Prottas, Jeffrey [676] Brandeis University; 781-736-3955; [email protected]
Przybylski, Roger [357-672-828] RKC Group; 303-949-8551; [email protected]
Pugh, Lauren [795] Mosaic Network Inc; 805-692-0992 x223; [email protected]
QQQQQQQQ
Qian, Qiang [642] University of Maryland; 410-646-2068; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 202
Quartaroli, MaryLynn [223] Professional Evaluation & Assessment Consultants; 928-779-2687; [email protected]
Quinn, Brian [112] Robert Wood Johnson Foundation; 609-627-5813; [email protected]
Quinn, Martha [137-592] University of Michigan; 734-936-0480; [email protected]
Quirk, Matthew [646] University of California, Santa Barbara; 805-893-9000; [email protected]
Quizon, Jaime [836] World Bank; 202-458-1916; [email protected]
RRRRRRRR
Race, Kathryn [137-839] Race & Associates Ltd; 773-878-8535; [email protected]
Rafols, Ismael [531] University of Sussex; +447853865382; [email protected]
Ragan, Vicky [787] Evaluation and Research Associates; 425-977-4760 x101; [email protected]
Rahimian, Afsaneh [137-619] Center for Health Training; 206-447-9538; [email protected]
Rahr, Matthew [296] University of Arizona; 520-621-2489; [email protected]
Rai, Kalyani [372] University of Wisconsin, Milwakee; 414-227-3271; [email protected]
Raia, Anthony [590] University of California, Los Angeles; 310-546-3082; [email protected]
Rainwater, Julie [116-230] University of California, Davis; 916-703-9189; [email protected]
Rajigah, Lisa [433-589] International Initiative for Impact Evaluation (3ie); 801-540-1329; [email protected]
Rajvaidya, Prashant [646] Mosaic Network Inc; 805-692-0992 x225; [email protected]
Rallis, Sharon [657-753-902] University of Massachusetts, Amherst; 413-545-1056; [email protected]
Ramaswami, Soundaram [317] Kean University; 908-737-5979; [email protected]
Ramirez, Amelie [864] University of Texas Health Science Center at San Antonio; 210-562-6500; [email protected]
Rana, Meenal [543] Michigan State University; 517-353-8977; [email protected]
Ranney, Joyce [235-736] Volpe National Transportation Systems Center; 617-494-2095; [email protected]
Ranney, Leah [320] University of North Carolina; 919-843-8354; [email protected]
Rao, Vasanthi [286] University of South Carolina; 803-777-1246; [email protected]
Rao Hermon, Sandhya [137] Pricewaterhouse Coopers LLP; 510-665-5787; [email protected]
Rawlings, Sarah [798] University of Southern Maine; 207-626-5200; [email protected]
Raynor, Jared [264-332-831] TCC Group; 215-568-0399 x206; [email protected]
Reaves, Taniya [596] University of North Carolina at Chapel-Hill; 919-843-7878; [email protected]
Reed, Ehren [413-505-552-711] Innovation Network; 202-728-0727; [email protected]
Reed, John [607-655-770] Innovologie LLC; 301-340-8701; [email protected]
Reed, Winnie [673] National Institute of Justice; 202-307-2952; [email protected]
Reese, April [107] North Carolina Department of Health; 919-707-5344; [email protected]
Reeve, Neville [726] European Commission; +32 2 298 9329; [email protected]
Reeves, Jennifer [256-512] Nova Southeastern University; 850-646-0214; [email protected]
Reich, Stephanie [119] University of California, Irvine; 949-824-5970; [email protected]
Reid, Leslie [137] University of Calgary; 403-220-7405; [email protected]
Reid, Shani [686] ICF Macro; 301-572-0534; [email protected]
Reider, David [875] Education Design LLC; 617-501-7152; [email protected]
Reilly, Daniel [137] University of Tennessee, Knoxville; 865-974-1850; [email protected]
Reilly, Erin [879] University of Texas, Austin; 512-232-4374; [email protected]
Reinhart, George [375-415-848] University of Maryland; 301-226-8996; [email protected]
Reis, Ana [137-814] National School of Public Health (ENSP/Fiocruz); [email protected]
Reiserer, Randall [222] Centerstone Research Institute; 615-463-6257; [email protected]
Reist, Aimee [576] College Center for Library Automation; 850-922-6044; [email protected]
Rempert, Tania [137-259-419] University of Illinois at Urbana-Champaign; 708-404-0559; [email protected]
Ren, Weijia [137-600-672] The Ohio State University; 617-319-4470; [email protected]
Rennekamp, Roger [128-773] Oregon State University; 541-737-1737; [email protected]
Renteria, Rose Ann M [847] Academy for Educational Development; 202-884-8608; [email protected]
Resch, Alexandra [838] Mathematica Policy Research; [email protected]
Resnick, Gary [306] Harder+Company; 415-522-5400; [email protected]
Rethwisch, David [525] University of Iowa; 319-335-1413; [email protected]
Revels, Michelle [776] ICF Macro International; [email protected]
Rewey, Kirsten L [763-798] Action Consulting and Evaluation Team (ACET) Inc; 952-922-1811; [email protected]
Reyes, Adrian [602] Behavioral Assessment Inc; 310-652-6449; [email protected]
Rhodes, Hilary [277-856] Abt Associates Inc; 617-520-3516; [email protected]
Rice, Jessica [678] University of Wisconsin; 414-219-5067; [email protected]
Rich, Lauren [266] Chapin Hall; 773-256-5100; [email protected]
Rich, Rachel [335] University of the Pacific; 916-622-1140; [email protected]
Richards, Boyd [137] Columbia University; 212-305-0229; [email protected]
Richards, Patricia [898] University of Georgia; 706-542-3235; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 203
Richardson, Margaret [519-685] Western Michigan University; 269-387-7065; [email protected]
Richardson, Robyn [518] Savannah College of Art and Design; 850-294-4452; [email protected]
Richards-Schuster, Katie [401-584] University of Michigan; 734-615-2118; [email protected]
Richmond-Scott, Alicia [317] United States Department of Health and Human Services; 240-453-2828; [email protected]
Rickards, William [848] Alverno College; 414-382-6256; [email protected]
Ridge, Bill [607] United States Environmental Protection Agency; 202-564-2165; [email protected]
Ridge, Javan [126-606-794] Colorado Springs School District 11; 719-520-2084; [email protected]
Riedel, James [413-889] Girl Scouts of the United States of America; 212-852-6552; [email protected]
Rifkin, Tronie [802] EVALCORP; 310-420-3895; [email protected]
Rigamer, Elmore [708] Catholic Charities of New Orleans; 504-432-1019; [email protected]
Rincones-Gomez, Rigoberto [784] Maryland Distribution Council Inc; 813-382-6144; [email protected]
Ringholz, David [702] Savannah College of Art and Design; 912-525-6676; [email protected]
Ríos, Ruth [137] University of Puerto Rico; 787-758-2525 x4415; [email protected]
Ripley, Jeff [137] Texas A&M University; 979-845-7280; [email protected]
Risner, Rhoda [415-754] United States Army; 913-684-2029; [email protected]
Ritchie, Liesel [137] University of Colorado at Boulder; 662-617-2464; [email protected]
Rivera, Melissa [137-222-522] National Center for Prevention and Research Solutions; 386-760-2254; [email protected]
Rivero, Rosario [643] University of California, Berkeley; [email protected]
Rivers, Desiree [740] Center for Equal Health; 813-974-2140; [email protected]
Rivers, Erika [127] Minnesota Department of Natural Resources; 218-999-7914; [email protected]
Roberta Pascom, Ana [814] National Aids Program, Brazil; [email protected]
Roberts, Carl [623] Iowa State University; 515-294-8929; [email protected]
Roberts-Gray, Cindy [225] Third Coast R&D Inc; 409-762-2499; [email protected]
Robertson, Kelly [282-342-514-796] Western Michigan University; 269-387-5919; [email protected]
Robin, Wagner [271] National Institutes of Health; 301-443-5234; [email protected]
Robinson, Amber [118] ICF Macro; 404-592-2292; [email protected]
Robst, John [222] University of South Florida; 813-974-1505; [email protected]
Rochester, Phyllis [717] Centers for Disease Control and Prevention; 770-488-3096; [email protected]
Rodd, Jane A [137-879] State University of New York at Albany; 518-442-5027; [email protected]
Rodgers, Philip [137] American Foundation for Suicide Prevention; 267-886-5906; [email protected]
Rodi, Michael S [595] ICF Macro; 917-407-9894; [email protected]
Rodriguez, Eunice [320] Stanford University; 650-251-9410; [email protected]
Rodriguez, Michael C [763] University of Minnesota; 612-624-4324; [email protected]
Rodriguez, R Joseph [594] University of Texas, Austin; 512-232-5847; [email protected]
Rodriguez-Campos, Liliana [132-324-404-668-740-784-900] University of South Florida; 813-974-1163; [email protected]
Rodríguez-Campos, Liliana [204] University of South Florida; 813-974-1163; [email protected]
Roeber, Carter [669] LTG Associates Inc; 301-270-0882; [email protected]
Roestenburg, Willem [333] University of Johannesburg; +27 11 7875156; [email protected]
Rog, Debra [102-500-506-615-881-902] Westat; 301-279-4594; [email protected]
Rogers, Diane [137-796] Western Michigan University; 269-377-8434; [email protected]
Rogers, Juan [431-531-689-850] School of Public Policy Georgia Institute of Technology; 404-894-6697; [email protected]
Rogers, Nancy [392-511-900] University of Cincinnati; 513-556-1476; [email protected]
Rogers, Patricia [202-270-309-663] Royal Melbourne Institute of Technology; +61409386499; [email protected]
Rogers, Susan [137-754] State University of New York at Albany; 518-442-3687; [email protected]
Rogers, Todd [378] Public Health Institute; 650-949-4055; [email protected]
Roget, Nancy [137] University of Nevada, Reno; 775-784-6265; [email protected]
Roggeveen, Erica [868] Latino Community Services; 860-296-6400; [email protected]
Rohrbaugh, Kate [395] Independent Project Analysis; 703-726-5465; [email protected]
Rollison, Chris [619] South Carolina Campaign to Prevent Teen Pregnancy; 803-771-7700; [email protected]
Rollison, Julia [320] MANILA Consulting Group Inc; 571-633-9797; [email protected]
Romero, Carlos [869] Apex Education Inc; 505-828-0082; [email protected]
Roney, Candace [320] Lucile Packard Children's Hospital; 650-725-9468; [email protected]
Rood, Magdalena [225-837] Third Coast R&D Inc; 512-326-3044; [email protected]
Roper, Laura [751] Brandeis University; 617-877-4336; [email protected]
Rorrer, Audrey [255-415] University of North Carolina at Charlotte; 704-227-3059; [email protected]
Rosas, Scott [0-770] Concept Systems Inc; 607-272-1206; [email protected]
Rose, Shyanika [540] Battelle Memorial Institute; 919-544-3717 x118; [email protected]
Rosebear, Sharon [137] Red Lake Band of Chippewa Indians; 218-679-1961; [email protected]
Rosecrans, Lindsey [226] State University of New York at Albany; 518-442-5027; [email protected]
Roseland, Denise [576-812] University of Minnesota; 612-298-2076; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 204
Rosenblum, Andrew [137] National Development and Research Institutes (NDRI); 212-845-4528; [email protected]
Rosenthal, Emily [686] Berkeley Policy Associates; 510-465-7884; [email protected]
Ross, John A [900] University of Toronto; 705-742-9773 x2206; [email protected]
Ross, Shelley [261] University of Alberta; 780-492-1144; [email protected]
Rothman, Emily [604] Boston University; 617-414-1385; [email protected]
Rothwell, Julie [678] United Way of Greater Milwaukee; 414-263-8127; [email protected]
Rountree, Michele [137] University of Texas, Austin; 512-471-7160; [email protected]
Routhier, Anne [537-772] Treasury Board of Canada; 613-952-7447; [email protected]
Rovin, Laurie [830] United Way Of Greenville County; 864-467-3333; [email protected]
Roy, Ajanta [222] Centerstone Research Institute; 615-460-4143; [email protected]
Roy, Ria [275] Indiana University; [email protected]
Royalty, Janet [776] Centers for Disease Control and Prevention; [email protected]
Ruben, Elizabeth [137] National Institute of Environmental Health Sciences; 919-541-9470; [email protected]
Ruberg, Laurie [900] Wheeling Jesuit University; 304-243-2480; [email protected]
Rubin, Maureen [209-263] University of Texas, San Antonio; 210-458-2922; [email protected]
Rubright, Jonathan [691] University of Delaware; 484-529-4466; [email protected]
Ruegg, Rosalie [527-567] TIA Consulting Inc; 252-354-9321; [email protected]
Ruffini, Stephen J [121] Wested; 202-429-9727; [email protected]
Rugh, Jim [236-282-514-553-587-789-898] Independent Consultant; 865-908-3133; [email protected]
Ruhf, Robert J [328] Western Michigan University; 269-387-3791; [email protected]
Rui, Ning [300-606-799] Research for Better Schools; 215-568-6150 x277; [email protected]
Ruitman, Hendrick [298-606] Cobblestone Applied Research & Evaluation Inc; 909-689-9818; [email protected]
Rulf Fountain, Alyssa [277-856] Abt Associates Inc; 617-520-2657; [email protected]
Runkles, Tina [306] State University of New York College at Potsdam; 315-267-3136; [email protected]
Russell, Christina [874] Indiana University; 812-855-4438; [email protected]
Russell, Judith [553-748] Independent Consultant; 212-866-2563; [email protected]
Russon, Craig [282] International Labor Organization Evaluation Unit; [email protected]
Ryan, Katherine [230] University of Illinois at Urbana-Champaign; 217-333-0719; [email protected]
Ryker, Sarah [730] Science and Technology Policy Institute; [email protected]
Ryman, Tove [898] Centers for Disease Control and Prevention; 404-639-6283; [email protected]
SSSSSSSS
Sabo Flores, Kim [401-544-584] Evaluation Access and ActKnowledge; 917-817-1841; [email protected]
Sachs, Jonathan [304] Canadian Health Services Research Foundation; 613-728-2238 x223; [email protected]
Saflund, Peter [670] The Saflund Institute; 253-630-5326; [email protected]
Saka, Susan [627] University of Hawaii, Manoa; 808-956-7900; [email protected]
Salcedo Baca, Salomon [392] Food and Agriculture Organization of the United Nations; 434-384-7251; [email protected]
Salisbury, April [137-779] LCF Research; 505-938-9925; [email protected]
Salmona, Michelle [777] Central Michigan University; 989-317-0621; [email protected]
Salzman, James [203] Ohio University; 740-593-4419; [email protected]
Samico, Isabella [814] Instituto de Medicina; [email protected]
Samuel, Cherian [659] International Finance Corporation; 202-473-0802; [email protected]
Sanabria, Ida [137] University of Puerto Rico; 787-646-8719; [email protected]
Sanacore, Peter [880] KPMG LLP; 201-307-7495; [email protected]
Sankar, Pamela [691] University of Pennsylvania; 215-898-7136; [email protected]
Santa Maria, Diane [678] University of Texas; 281-298-6899; [email protected]
Santoni, Tim [642] University of Maryland; 410-666-7960; [email protected]
Santos, Romeo [132] University of the Philippines; +63 2 915 507 4038; [email protected]
Santos, Sonia [137] National School of Public Health (ENSP/Fiocruz); [email protected]
Santos Dubeux, Luciana [814] Instituto de Medicina; [email protected]
Sanz, Belen [318] United Nations Development Fund for Women; [email protected]
Sapiano, Tobey [360] Centers for Disease Control and Prevention; 970-568-8037; [email protected]
Sargent, Katherine [592] University of California, San Francisco; 415-476-3689; [email protected]
Sarpy, Sue Ann [896] Sarpy and Associates LLC; 434-293-4768; [email protected]
Sartwell, Crispin [200-322] Dickinson College; [email protected]
Sasaki, Ryoh [132] International Development Center of Japan; 81-47-380-0820; [email protected]
Sass, James S [305] Research Support Services; 562-777-6455; [email protected]
Savage Brown, Amanda [279-709] Cazador; 678-333-5856; [email protected]
Savidge, Mildred [288] Research Works Inc; 518-869-9272; [email protected]
Scaccia, Jonathan [280] University of South Carolina; 484-868-2971; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 205
Schaffner, Monika [137] Planning and Learning Technologies Inc; 571-314-3862; [email protected]
Schaller, Amy [534] University of Arizona; 520-621-7133; [email protected]
Scharbatke-Church, Cheyanne [396-735] Besa Consulting; 403-918-5240; [email protected]
Schauer, Laura [137-607] PA Consulting Group; 830-317-3600; [email protected]
Schaum-Nguyen, Melissa [380] Los Alamos National Laboratory; 505-667-3214; [email protected]
Scheie, David [104-756] Touchstone Center for Collaborative Inquiry; 612-825-9100; [email protected]
Scheirer, Mary Ann [239] Scheirer Consulting; 609-951-8686; [email protected]
Schell, Sarah [638] Washington University in St Louis; 314-935-3750; [email protected]
Schenk Jr, Tom [525] Iowa Department of Education; 515-281-3753; [email protected]
Schensul, Jay [137] Institute for Community Research; 860-278-2044 x226; [email protected]
Schensul, Stephen [889] University of Connecticut; 860-679-1570; [email protected]
Scherer, Christina [137] Southern Polytechnic State University; 678-915-7243; [email protected]
Scherer, Hilary [113] NORC at the University of Chicago; 301-634-9374; [email protected]
Schiffer-Graham, Beate [537] Industry Canada; 613-954-5084; [email protected]
Schindler, Jay [212] Northrop Grumman Corporation; 678-530-3626; [email protected]
Schlagen, Ronda [553] Independent Consultant; 802-645-9798; [email protected]
Schlanger, Karen [898] University of Georgia; 917-613-1596; [email protected]
Schleifer, Michael [579] University of Quebec at Montreal; [email protected]
Schmidt, Stefanie [526] United States Department of Education; 202-219-2129; [email protected]
Schmitt, Lisa [386-509] Austin Independent School District; 512-414-9845; [email protected]
Schnell, Joshua [231] Discovery Logic; 240-912-1974; [email protected]
Schnell, Joshua D [137] Discovery Logic; 240-912-1974; [email protected]
Scholz, Heather [798] Wayside House; 952-922-1811; [email protected]
Schooley, Michael [588] Centers for Disease Control and Prevention; 770-488-5780; [email protected]
Schouten, Jeffrey [770] Fred Hutchinson Cancer Research Center; 206-667-5980; [email protected]
Schrader, Linda [435-693] Florida State University; 850-644-8780; [email protected]
Schreiner, Sebastian [207] City of San Antonio; 210-880-4286; [email protected]
Schroeder, Aaron [116] Kansas State University; 785-532-5122; [email protected]
Schroeder, Kathryn [137-208] University of Denver; 303-871-6390; [email protected]
Schroeter, Daniela [117-282-514] Western Michigan University; 269-387-5895; [email protected]
Schug, Vicki [137] St Catherine University; 651-690-6940; [email protected]
Schwandt, Thomas [202-273-309-572] University of Illinois at Urbana-Champaign; 217-333-5350; [email protected]
Schweitzer, Ilse [889] Western Michigan University; 269-387-2573; [email protected]
Sciulli, Joe [385] National Science Teachers Association; 703-312-9218; [email protected]
Scott, Brianna [640] Rockman et al; 415-544-0788; [email protected]
Scott, Caitlin [725-811] Education Northwest; 503-275-9500; [email protected]
Scott, Chyllis [226] Texas A&M University; 979-845-8363; [email protected]
Scott, Jack [137] The Madrillon Group Inc; 301-588-7344; [email protected]
Scriven, Michael [132-742-800] Claremont Graduate University; 415-663-1511; [email protected]
Searle, Michelle [218-532-811] Queen's University at Kingston; 519-645-2455; [email protected]
Sechrest, Lee [106-206-586-666] University of Arizona; 621-5463; [email protected]
Seff, Laura [600] Florida International Unversity; 305-273-0389; [email protected]
Sefton, Laura [841] University of Massachusetts; 508-856-4213; [email protected]
Segal, Jodi B [133] Johns Hopkins University; 410-955-9866; [email protected]
Segerholm, Christina [789] MidSweden University; +46 611 86243; [email protected]
Segone, Marco [276-282] United Nations Children's Fund; 212-824-6567; [email protected]
Sembiante, Sabrina F [261-557-685] University of Miami; 305-284-3260; [email protected]
Seufert, Robert [672] Miami University; 513-217-4306; [email protected]
Sewall, Catherine [137] Centerstone Research Institute; 615-460-4160; [email protected]
Sexton, Julie [137] University of Northern Colorado; 303-277-9790; [email protected]
Seybolt, Diana [302-562] University of Maryland, Baltimore; 410-646-1756; [email protected]
Shackelford, Philip [137] Texas A&M University; 979-203-5633; [email protected]
Shady, Therese [120] New York State Office of Children and Family Services; 518-486-5581
Shafloot, Fayez [137-589] Western Michigan University; 269-779-8518; [email protected]
Shafritz, Lonna [137] Academy for Educational Development; 202-884-8784; [email protected]
Shafritz, Lonna B [137] Academy for Educational Development; 202-884-8784; [email protected]
Shaftel, Julia [749] University of Kansas; 785-864-0733; [email protected]
Shannon, Lisa [290] Magnolia Consulting LLC; 919-367-9433; [email protected]
Shao, Jessica [756] Independent Consultant; 415-889-7084; 415) 889-7084
Shapatava, Ekaterine [360] Northrop Grumman Corporation; 404-639-2411; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 206
Shapiro, Marc [399] Millennium Challenge Corporation; 202-521-7229; [email protected]
Shatirishvili, Mamuka [399] Millennium Challenge Account-Georgia; +011 995 32 507 770; [email protected]
Shatrova, Zhanna [793] Oklahoma State University; 405-744-4715; [email protected]
Shaw, Katherine [255-829] Westwood College; 720-524-5140; [email protected]
Shear, Linda [278] SRI International; 650-859-4476; [email protected]
Sheedy, Cori [682] Abt Associates Inc; 617-349-2560; [email protected]
Shellard, David [137] SRA International Inc; 703-568-2490; [email protected]
Shelton, Sarah C [827] Washington University in St Louis; 314-935-3723; [email protected]
Shepard, Bonnie [221] Social Sectors Development Strategies; 617-421-9644; [email protected]
Shepherd, Robert [617] Carleton University; 613-520-2547; [email protected]
Shepperson, Tara [346-435-693-894] Eastern Kentucky University; 808-203-4648; [email protected]
Sherry, Susan [112] Community Catalyst; 617-275-2816; [email protected]
Sherwood, Kay [690] Independent Consultant; 973-509-2994; [email protected]
Shi, Bing [513] Chinese Academy of Sciences; +86-10-6859-7459; [email protected]
Shi, Susan [830] South Carolina Institute for Child Success; 864-467-3333; [email protected]
Shia, Jackie [900] Challenger Learning Center; 304-243-4431; [email protected]
Shing, Janet [684] Community Foundation for Monterey County; 831-375-9712; [email protected]
Shipman, Stephanie [228-506-542-651-887] United States Government Accountability Office; 202-512-4041; [email protected]
Shipp, Stephanie [730] Science and Technology Policy Institute; [email protected]
Shires, Deirdre [137-779] Henry Ford Health System; 313-874-5454; [email protected]
Shirley, Eleanor [577] Peace Corps; 202-692-1863; [email protected]
Shrestha, Gitanjali [137-647-841] Washington State University; 214-406-7871; [email protected]
Shrestha, Shrutee [752] Brigham Young University; 510-230-9091; [email protected]
Shrestha-Kuwahara, Robin [279-631] Centers for Disease Control and Prevention; 770-488-0791; [email protected]
Shulha, Lyn [204-324-362-532-811] Queen's University at Kingston; 613-533-6000 x75016; [email protected]
Shumer, Robert [544-760] University of Minnesota; 651-336-7777; [email protected]
Sibley, Candace [260-820] University of South Florida; 214-755-5830; [email protected]
Sickels, Aimee [280-830] University of South Carolina; 910-200-8576; [email protected]
Sidibe, Mamadou [694-778] International Relief & Development; 703-248-0161; [email protected]
Siebold, Wendi [367] Evaluation, Management & Training Associates Inc; 206-962-0260; [email protected]
Siegel, Jason [783] Claremont Graduate University; 520-975-6264; [email protected]
Siegel, Susan [137-798] Communities In Schools; 703-518-2548; [email protected]
Silliman, Benjamin [137-354-612-873] North Carolina State University; 919-515-8485; [email protected]
Silva, Sandra [321] Altarum Institute; 202-776-5163; [email protected]
Silveira, Carol [301] Massachusetts Board of Registration in Nursing; 617-973-0917; [email protected]
Silver, Diana [273] New York University; [email protected]
Sim, Shao-Chee [744] Charles B Wang Community Health Center; 212-379-6999; [email protected]
Simon, Alan [220] Metis Associates; 212-425-8833 x134; [email protected]
Singer, Erin [299] Human Services Research Institute; 503-924-3783 x18; [email protected]
Singh, Arati [533] Academy for Educational Development; 512-301-8952; [email protected]
Singh, Tejinder [256] Christian Medical College; +91-161-2608617; [email protected]
Singhapoon, Supol [757] Pact Inc; +66 2 2313402; [email protected]
Singleton, Corinne [278-560] SRI International; 512-608-4349; [email protected]
Sitzler, Aimee [301] Arizona State University; 602-496-1085; [email protected]
SiWan Zimmerman, Stella [763] Action Consulting and Evaluation Team (ACET) Inc; 952-922-1811; [email protected]
Skaff, Laura F [131] Altarum Institute; 202-828-5100; [email protected]
Skelton, Ellie [798] The Wayside House Inc; 952-405-7636; [email protected]
Skolits, Gary [121-315-532-593] University of Tennessee, Knoxville; 865-974-2777; [email protected]
Slay, Julie [126-222] EVALCORP; 949-468-9953; [email protected]
Sloane, Fraser [654] Sloane Walker Ltd; +64 27 242 9722; [email protected]
Slovacek, Simeon [551] California State University, Los Angeles; 323-343-5622; [email protected]
Slutsky, Jean [228] United States Department of Health and Human Services; 301-427-1601; [email protected]
Smart, Dawn [251] Clegg & Associates; 206-448-0878; [email protected]
Smeardon, Becky [137] Quill Research Associates; 703-307-7559; [email protected]
Smiaroski, Mary Sue [751] Oxfam International; 617-728-2463; [email protected]
Smiley-McDonald, Hope [672] RTI International; 919-485-5743; [email protected]
Smith, Christa [385] Kansas State University; 785-532-5127; [email protected]
Smith, Debra [218] Lesley University; 617-349-8230; [email protected]
Smith, Donald [249] Texas Early Childhood Education Coalition; 512-476-7939; [email protected]
Smith, Elliott [310] Cornell University; 607-255-8104; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 207
Smith, Martin [692] University of California, Davis; 530-752-6894; [email protected]
Smith, Michael [708] Louisiana Public Health Institute; 504-301-9800; [email protected]
Smith, Nick [611] Syracuse University; 315-443-3703; [email protected]
Smith, Tommy [530] Berkeley Policy Associates; tommy@@bpacal.com
Smith, Veronica [224-593-755] data2insight; 206-290-0374; [email protected]
Snilstveit, Birte [614] International Initiative for Impact Evaluation (3ie); [email protected]
Sniukaite, Inga [318] United Nations Development Fund for Women; [email protected]
Snow, Juna [125-736] University of California, Berkeley; 707-812-1244; [email protected]
Snyder, Angela [137] Georgia State University; 404-413-0285; [email protected]
Sobolew-Shubin, Sandy [683] WestEd; [email protected]
Soloe, Cindy [717] RTI International; 919-316-3363; [email protected]
Sonko-Najjemba, Rita [859] Pact Inc; 202-466-5666; [email protected]
Sorg, Amy A [827] Washington University in St Louis; 314-935-3732; [email protected]
Sosa-Molina, Miguel [137] University of Yucatan; +52 999 9224557; [email protected]
Souflee, Andrea [398] United Way of Dallas; 214-978-0047; [email protected]
Souza, Rafaela [137] National School of Public Health (ENSP/Fiocruz); +21 25399461; [email protected]
Spearman, Christina [133] University of Wisconsin, Madison; 608-262-7586; [email protected]
Spence-Almaguer, Emily [885] University of Texas, Arlington; 817-781-8478; [email protected]
Sprague, Kimberly [526] Brown University; [email protected]
Springer, Fred [367-547] Evaluation, Management & Training Associates Inc; 916-983-6680; [email protected]
Sprott, Katherine [385] Kansas State University; 785-532-6408; [email protected]
Spybrook, Jessaca [265-685] Western Michigan University; 269-387-3889; [email protected]
Sridharan, Sanjeev [503-746] University of Toronto; 416-540-1570; [email protected]
St Roseman, Paul [664-794] DataUse Consulting Group; 510-415-2010; [email protected]
Stabile, Bonnie [435] George Mason University; 703-789-5423; [email protected]
Stachowiak, Sarah [124-292] Organizational Research Services; 206-728-0474 x229; [email protected]
Stachowski, Alicia [896] George Mason University; 703-993-1384; [email protected]
Stake, Robert [624] University of Illinois at Urbana-Champaign; [email protected]
Stanley, Bragg [761] Missouri Department of Elementary and Secondary Education; 573-751-7966; [email protected]
Starobin, Soko [525] Iowa State University; 515-294-9121; [email protected]
Starr, Christine [380] Los Alamos National Laboratory; 505-606-1976; [email protected]
Staub-DeLong, Leah [227] Abt Associates Inc; 617-520-3517; [email protected]
Steedly, Katie [418-518] Steedly Consulting; 202-360-6026; [email protected]
Steel, Scott [676] Cincinnati Children's Hospital Medical Center; 513-803-0207; [email protected]
Steffanowski, Andrés [106] University of Mannheim; +0049 621 181 3128; [email protected]
Steger, Scott [137-522] National Center for Prevention and Research Solutions; 386-760-2254; [email protected]
Steinberg, Marla [641] The CAPTURE Project; 778-782-6706; [email protected]
Steiner, Ivan [261] University of Alberta; 780-492-1144; [email protected]
Steiner, Melissa [678] Medical Institute for Sexual Health; 512-328-6268x202; [email protected]
Steinke, Megan [236] Save the Children; 203-221-4239; [email protected]
Stein-Seroussi, Alan [522] Pacific Institute for Research and Evaluation (PIRE); 919-265-2636; [email protected]
Stephens, Robert L [595] ICF Macro; 678-389-8923; [email protected]
Stephenson, Blair [380] Los Alamos National Laboratory; 505-665-1423; [email protected]
Stevahn, Laurie [137-377] Seattle University; 2062962559; [email protected]
Stevens, Beth [210-245] Mathematica Policy Research; 609-716-4542; [email protected]
Stevens, Edith [137] ICF Macro; 301-572-0558; [email protected]
Stevens, Joseph [380-626] University of Oregon; 541-346-2445; [email protected]
Stevens, Xuan [137] Florida International University; 305-653-9615; [email protected]
Stevenson, John [535-734-874] University of Rhode island; 401-874-4240; [email protected]
Stice, Kim [225] National Head Start Family Literacy Center; 805-388-5635; [email protected]
Stigger, Cagney [137] Morehouse School of Medicine; 404-752-1098; [email protected]
Stillisano, Jacqueline [226-305] Texas A&M University; 979-845-8098; [email protected]
Stipelman, Brooke [137] National Institutes of Health; 301-402-9639; [email protected]
Stockmyer, Chrisandra [717] Centers for Disease Control and Prevention; 770-488-5027; [email protected]
Stokes, Helga [737] Duquesne University; 412-396-4057; [email protected]
Stokols, Dan [137] University of California, Irvine; 949-824-5294; [email protected]
Stokols, Daniel [691] University of California, Irvine; 949-824-5294; [email protected]
Stone, Mike [705] Impact Strategies Inc; 260-413-9200; [email protected]
Stone, Vathsala [770] State University of New York at Buffalo; 716-204-8606 x210; [email protected]
Stoneman, Zolinda [137] University of Georgia; 706-254-0477; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 208
Stoner, Dena [137] Texas Department of State Health Services; 512-206-4851; [email protected]
Stone-Wiggins, Brenda [717] Research Triangle Institute International; 919-316-3328; [email protected]
Stoter, Antoinette [435] University of Iowa; 319-335-5905; [email protected]
Stout, Sharon [887] United States Department of Education; 202-260-2493; [email protected]
Stratford, Dale [819] Centers for Disease Control and Prevention; 404-639-6276; [email protected]
Streke, Andrei [645] Mathematica Policy Research; 202-484-4513; [email protected]
Stringer-Hessel, Amy [390] Missouri Foundation for Health; 314-345-5540; [email protected]
Strong, Debra [112-307] Mathematica Policy Research; 609-750-2001; [email protected]
Stroter, Antionette [496-732-884] University of Iowa; 336-580-4335; [email protected]
Strother, Heather [841] University of Massachusetts; 508-856-4042; [email protected]
Stuart, Elizabeth [826] Johns Hopkins University; 410-502-6222; [email protected]
Stuebe, Claire [597] East Main Educational Consulting; 910-784-9523; [email protected]
Styers, Mary [290] Magnolia Consulting LLC; 540-718-2142; [email protected]
Suarez-Balcazar, Yolanda [521] University of Illinois at Chicago; 312-413-1007; [email protected]
Subah, Marion [278] Jhpiego; [email protected]
Subramanian, Sujha [885] RTI International; 781-434-1749; [email protected]
Suda, Hiroyuki [890] National Institute of Advanced Industrial Science and Technology; +81 29 862 6069; [email protected]
Sugarman, Julie [566] Center for Applied Linguistics; 202-362-0700 x570; julie@cal-org
Sulewski, Jennifer [329-368-495] University of Massachusetts, Boston; 617-287-4356; [email protected]
Sulik, Gayle [301] Texas Woman's University; 940-231-3184; [email protected]
Sullivan, Cris [245] Michigan State University; 517-353-8867; [email protected]
Sullivan, Tara [857] Johns Hopkins University; 518-398-0514; [email protected]
Sumartojo, Esther [807] Centers for Disease Control and Prevention; 404-498-3072; [email protected]
Sun, Hongling [390] University of Illinois at Urbana-Champaign; 217-714-7076; [email protected]
Supe, Avinash [256] GS Medical College; +91 22 5227031; [email protected]
Sureshbabu, Suman [270] Rockefeller Foundation; 646-670-1779; [email protected]
Surgenor, Cathryn [696] New York Theological Seminary; 845-878-6621; [email protected]
Susan, York [707] University of Hawaii, Manoa; 808-956-7900; [email protected]
Sutphin, Suzanne [878] University of South Carolina; 803-777-8494; [email protected]
Sutter, Mary [607] Opinion Dynamics Corporation; 510-444-5050 x104; [email protected]
Sutton, John [804] RMC Research Corporation; 800-922-3636; [email protected]
Svitakova, Jirina [137] Czech University of Life Sciences; +00420 777 935 336; [email protected]
Sweida-DeMania, Gloria [272] Claremont Graduate University; 714-270-1176; [email protected]
Sydlik, Mary Anne [328-759] Western Michigan University; 269-387-3791; [email protected]
Symonette, Hazel [244] University of Wisconsin; [email protected]
Szanyi, Michael [233-812] Claremont Graduate University; 702-285-9909; [email protected]
TTTTTTTT
Tabone, Carmine [137] Education Arts Team; 201-232-6643; [email protected]
Tackett, Wendy [637] iEval; 269-420-3417; [email protected]
Taggart, Caroline [762] Ciurczak & Co Inc; 716-362-0627; [email protected]
Tagle, Laura [268] Italy's Ministry for Economic Development; +39 335 635 2208; [email protected]
Talieri, John [636] Pact Inc; 202-466-5666; [email protected]
Tamanoue, Yoshiaki [890] National Institute of Advanced Industrial Science and Technology; +81 29 862 6096; [email protected]
Tananis, Cynthia [134-223-305-641] University of Pittsburgh; 412-648-7171; [email protected]
Tang, Li [850] Georgia Institute of Technology; 678-896-3133; [email protected]
Tangka, Florence [776-885] Centers for Disease Control and Prevention; [email protected]
Tanyu, Manolya [327-685] Learning Point Associates; 312-288-7611; [email protected]
Tarakeshwar, Nalini [224] Children's Investment Fund Foundation; +44 7825798894; [email protected]
Tarsilla, Michele [344-393-514-809] Western Michigan University; 202-361-9183; [email protected]
Tashakkori, Abbas [782] University of North Texas; 940-565-4964; [email protected]
Tashima, Niel [669] LTG Associates Inc; 301-270-0882; [email protected]
Taylor, Brandie K [137] National Institutes of Health; 301-451-3068; [email protected]
Taylor, JT [891] Learning for Action Group; 415-392-2850 x306; [email protected]
Taylor, Mary [518] Savannah College of Art and Design; [email protected]
Taylor, Mascie [137] University of Cambridge, United Kingdom; +44 1223 335456; [email protected]
Taylor-Dormond, Marvin [352] World Bank; 202-473-0770
Taylor-Ritzler, Tina [521] Dominican University; 773-882-1731; [email protected]
Teather, George [431-689-886] George Teather and Associates; 613-824-2423; [email protected]
Tebes, Jacob [739] Yale University; 203-789-7645; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 209
Teh, Bing-ru [884] Mathematica Policy Research; 617-301-8960; [email protected]
Tendulkar, Shalini [541] Institute for Community Health; 617-499-6683; [email protected]
Tenev, Stoyan [352] World Bank; 202-473-1392; [email protected]
Terry, John D [280] University of South Carolina; 803-445-4421; [email protected]
Tester, Diana [878] South Carolina Department of Social Services; 803-898-7512; [email protected]
Thais, Oliveira [137] Oswaldo Cruz Foundation; 055-21-98111627; [email protected]
Thiessen-Love, Lois [599] Uhlich Children's Advantage Network; 773-429-9330; [email protected]
Thomas, A Udaya [278] Jhpiego; 410-537-1860; [email protected]
Thomas, Cicely [245] Mathematica Policy Research; 617-674-8358; [email protected]
Thomas, Patrick [567] 1790 Analytics LLC; 856-216-1790; [email protected]
Thomas, Veronica [535] Howard University; 202-806-9093; [email protected]
Thomas, Yelena [569-766-889] Ministry of Research Science and Technology; +6449172842; [email protected]
Thompson, Bob [607] United States Environmental Protection Agency; 919-541-1904; [email protected]
Thompson, Winifred W [541] Emory University; 404-778-1349; [email protected]
Thomson, Joan [898] Pennsylvania State University; [email protected]
Thurston, Linda [220-289-495-821-897] National Science Foundation; 703-292-4612; [email protected]
Tibbetts, Katherine A [111-211-242-372-654] Kamehameha Schools; 808-285-4822; [email protected]
Tikoo, Minakshi [889] University of Connecticut; 860-679-5559; [email protected]
Tilney, Kate [104] Hope Community Inc; 651-271-8696; [email protected]
Tilson, Wilma [113] United States Department of Health and Human Services; 202-205-8841; [email protected]
Timko, Gary [137] Community Research Partners; 614-449-8479; [email protected]
Tinworth, Katheen [258] Denver Museum of Nature & Science; 303-370-6136; [email protected]
Tinworth, Kathleen [137-258] Denver Museum of Nature & Science; 303-370-6136; [email protected]
Tisdal, Carey [137-258] Tisdal Consulting; 314-496-9097; [email protected]
Titcomb, Allison [893] ALTA Consulting; 520-904-1058; [email protected]
Togashi, Shigeko [890] National Institute of Advanced Industrial Science and Technology; +81 29 862 6069; [email protected]
Tolley, Leigh M [611] Syracuse University; 315-443-3703; [email protected]
Toms, Kathleen [582] Research Works Inc; 845-337-3806; [email protected]
Ton, Giel [543] LEI Wageningen UR; +31-317-450347; [email protected]
Torkel, Steven [137] Pricewaterhouse Coopers LLP; 973-236-4253; [email protected]
Tornberg, Robert [593-693] University of Minnesota; 781-858-5503; [email protected]
Torres, Luis R [331] University of Houston; 713-743-8512; [email protected]
Torres, Raquel [137] National School of Public Health (ENSP/Fiocruz); [email protected]
Torres, Rosalie [385] Torres Consulting Group; 510-681-6567; [email protected]
Toure, Itihari [211] The Jegna Collective; [email protected]
Towns, Natalie [137] Georgia State University; 404-413-0287; [email protected]
Townsend, John [641] Population Council; 202-237-9400; [email protected]
Townsend, Julie [717] Centers for Disease Control and Prevention; 770-488-3012; [email protected]
Townsend, Lisa [534] University of New Hampshire; 603-862-1031; [email protected]
Townsend, Shannon [268] National Research Council Canada; 613-993-1027; [email protected]
Townson, Lisa [434] University of New Hampshire; 603-862-1031; [email protected]
Trahan, Keith [223-305-515] University of Pittsburgh; 412-624-7240; [email protected]
Tran, Rosanna [684] California HealthCare Foundation; 510-587-3130; [email protected]
Treiber, Jeanette [880] University of California, Davis; 530-752-9966; [email protected]
Trenholm, Christopher [611] Mathematica Policy Research; 609-936-2796; [email protected]
Trent, Tererai [137-897] Western Michigan University; 760-356-2599; [email protected]
Trevisan, Mike [525] Washington State University; 509-335-4251; [email protected]
Tripathi, Sue [104-207] Making Connections, Denver; 303-561-2227; [email protected]
Triscari, Robert [137] Florida Gulf Coast University; 239-590-7202; [email protected]
Trochim, William M [133-250-283-381-589-770-864-902] Cornell University; 607-255-0887; [email protected]
Trotter, Jennie [137] Wholistic Stress Control Institute Inc; 404-755-0068 x3007; [email protected]
Truebridge, Sara [592] WestEd; 510-302-4268; [email protected]
Trumpet, Jane-Van [137] University of South Florida; 813-562-6555; [email protected]
Tseng, Han-yun [622] Washington State University; [email protected]
Tseng, Shu-Hui [137] National Taipei University of Technology; +886-2-27712171 x4033; [email protected]
Tucker, Susan [288-498-532-731-811] Evaluation & Development Associates; 415-385-8396; [email protected]
Tucker Blackmon, Angelique [875] Innovative Learning Concepts LLC; 770-374-8373; [email protected]
Tucker Brown, Aisha [409-618] Northrop Grumman Corporation; 678-777-8484; [email protected]
Tung, Quoc Mai [641] Population Council; +844 3 7345821; [email protected]
Tunik, Jonathan [220] Metis Associates; 212-425-8833 x107; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 210
Tunstall, Rebecca [399] Millennium Challenge Corporation; 202-521-3600; [email protected]
Turay, Foday [132] African Development Bank; +0021671103257; [email protected]
Turner, Nannette [243] Mercer University; 478-301-5649; [email protected]
Tuttle, Christina [884] Mathematica Policy Research; 202-554-7570; [email protected]
Tuttle, Christina Clark [884] Mathematica Policy Research; 202-554-7570; [email protected]
Tutty, Michael [658] University of Massachusetts; 508-856-4350; [email protected]
Tytel, Mallary [550-653] Healthy Workplaces; 860-874-7137; [email protected]
Tzeng, Janice [717] RTI International; [email protected]
UUUUUUUU
Ueda, Kanji [890] National Institute of Advanced Industrial Science and Technology; +81 29 862 6069; [email protected]
Uekawa, Kazuaki [137] ICF International; 703-225-2266; [email protected]
Uhl, Gary [360] Centers for Disease Control and Prevention; 404-639-0950; [email protected]
Unger, Zita [275-563-659] Evaluation Solutions Pty Ltd; +613 9863 7555; [email protected]
Urban, Jennifer [381] Montclair State University; 973-655-6884; [email protected]
Urdapilleta, Oswaldo [881] IMPAQ International; 443-539-1394; [email protected]
Usinger, Janet [314-429-777] University of Nevada, Reno; 775-682-9083; [email protected]
Ussery-Hall, Ann [321] National Association of Chronic Disease Directors; 404-378-8590; [email protected]
Uyeki, Terry [242-284] Humboldt State University; 707-826-3404; [email protected]
VVVVVVVV
Valle, José [319] Consorcio por la Salud, Ambiente y Desarrollo, ECOSAD; + 51 1 4371300; [email protected]
van der Woerd, Kim [252-320] Reciprocal Consulting; 604-731-3536; [email protected]
Van Dyk, Pam [827-875] Evaluation Resources LLC; 919-839-1778; [email protected]
Van Dyke, Ray [594] Virginia Tech; 540-231-6003; [email protected]
Van Egeren, Laurie [543] Michigan State University; 517-355-0140; [email protected]
Van Haneghan, James P [306-525] University of South Alabama; 251-380-2760; [email protected]
van Leeuwen, Thed [531] University of Leiden; +31 71 527 3909; [email protected]
van Raan, Anthony [531] University of Leiden; +31 71 527 3909; [email protected]
VanDevanter, Nancy [744] New York University; 212-998-5328; [email protected]
VanEgeren, Laurie [637] Michigan State University; 517-355-0140; [email protected]
Vardiman, Phil [275] Abilene Christian University; 325-674-2153; [email protected]
Varillas, Walter [319] Consorcio por la Salud, Ambiente y Desarrollo, ECOSAD; [email protected]
Varnhagen, Stanley [356] University of Alberta; 780-492-3641; [email protected]
Vaughn, Deloris [716] Innovation Network; 202-728-0727 x118; [email protected]
Vedung, Evert [243] Uppsala University; +46 26 420 6511; [email protected]
Vela, Clemencia [647] Independent Consultant; [email protected]
Velasquez, Andrea [108] Brigham Young University; 801-310-6050; [email protected]
Velazquez, Melissa [238] Christian Foundation for Children and Aging; 913-384-6500 x7329; [email protected]
VeLure Roholt, Ross [536-756] University of Minnesota; 612-624-8785; [email protected]
Ventura, Miriam [511] National School of Public Health (ENSP/Fiocruz); [email protected]
Vicinanza, Nicole [856] JBS International Inc; 650-373-4952; [email protected]
Villasenor, Elodia [592] University of California, San Francisco; 415-476-6594; [email protected]
Visscher, Ron [430-556] Aquinas College; 616-510-8206; [email protected]
Vo, Anne [233-389-894] University of California, Los Angeles; 510-282-5706; [email protected]
Vocke, Karen [889] Western Michigan University; 269-330-2902; [email protected]
Voelkle, Manuel [106] Max-Planck-Institute for Human Development Berlin; +49-30-82406-467; [email protected]
Vogel, Amanda [137] National Institutes of Health; 301-435-5874; [email protected]
Volkov, Boris [247-797-837] University of North Dakota; 701-777-6781; [email protected]
Von Sychowski, Shirley [618] Heart and Stroke Foundation of Ontario; 416-489-7111 x339; [email protected]
WWWWWWWW
Waddington, Hugh [614] International Initiative for Impact Evaluation (3ie); +44-7779-261108; [email protected]
Waggett, Jessica [619-699] Institute for Community Health; 617-499-6613; [email protected]
Waggle, Joseph [609] University of Maryland; 301-405-6430; [email protected]
Wagner, Caroline [271] Science-Metrix Corp; 703-785-2226; [email protected]
Waid, Jillian [137] Washington University in St Louis; +88 01746274265; [email protected]
Wakelee, Jessica [816] University of Arizona; 520-626-4706; [email protected]
Walahoski, Jill [692] University of Nebraska, Lincoln; 402-472-1710; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 211
Wald, Lana [137-616-675] Washington University in St Louis; 314-935-3735; [email protected]
Walker, Debbie [227] Abt Associates Inc; 617-349-2390; [email protected]
Walker, Elaine [137-317] Seton Hall University; 609-208-9004; [email protected]
Walker, Joe [137] Native American Training Institute; 701-255-6374; [email protected]
Walker, Kate [733-853] University of Minnesota; 612-624-2116; [email protected]
Walker, Michael [345] Educational Testing Service; 609-734-1897; [email protected]
Walker, Tjip [858] United States Agency for International Development; 202-712-4842; stwalker @usaid.gov
Walker, Uda [243] Gargani + Company; 510-291-4226; [email protected]
Walker-Egea, Connie [668-799] University of South Florida; 787-604-9769; [email protected]
Wall, Hilary [378] Centers for Disease Control and Prevention; 770-488-8172; [email protected]
Wall, Melody [856] Defense Language Institute; 831-393-1508; [email protected]
Wallace, Michael [224] Room to Read; 415-561-3331 x111; [email protected]
Wallace, Tanner LeBaron [389] University of Pittsburgh; 412-624-6356; [email protected]
Wallisch, Lynn [137] University of Texas, Austin; 512-232-0611; [email protected]
Walrath-Greene, Christine [595] ICF Macro; 646-695-8154; [email protected]
Walser, Tamara M [346-535] University of North Carolina at Wilmington; 910-962-4175; [email protected]
Walsh, Michele [586] University of Arizona; 520-318-7259 x130; [email protected]
Walters, Bonnie [595-850] University of Colorado, Denver; 303-315-4967; [email protected]
Wandersman, Abraham [204-280-312-324-521-604-699-704-820] University of South Carolina; 803-777-7671; [email protected]
Wang, Xin [804] Mid-continent Research for Education and Learning; 303-632-5644; [email protected]
Wang, Yuanyuan [223-515] University of Pittsburgh; 412-624-7240; [email protected]
Wang, Yue [886] Chinese Academy of Sciences; +13031058208; [email protected]
Wang, Yushi [518] Savannah College of Art and Design; 405-269-6116; [email protected]
Wang'ati, Maureen [712] Measure Africa; +254 722 714991; [email protected]
Ward, Thomas [355-436-774] United States Army; 913-684-4408; [email protected]
Warner, Lora [105-137-518-857] University of Wisconsin, Green Bay; 920-465-2404; [email protected]
Warner, Lynn [116] State University of New York at Albany; 518-591-8734; [email protected]
Wasilik, Oksana [120] University of Wyoming; 307-760-3110; [email protected]
Wat, Toni [137] Texas State University; 512-245-3287; [email protected]
Watanabe, Yukiko [255] University of Hawaii, Manoa; 808-358-4325; [email protected]
Waterford, April [137] Lincoln University; 330-541-6502; [email protected]
Watkins, Margaret [898] Centers for Disease Control and Prevention; 404-639-8306; [email protected]
Watling Neal, Jennifer [630] Michigan State University; 517-353-5015; [email protected]
Watson, Angela [554] Oklahoma State University; 918-855-9823; [email protected]
Watson, Bill [877] Smithsonian's National Museum of Natural History; 202-633-1127; [email protected]
Watson, Erin [630-710] Michigan State University; 517-353-5015; [email protected]
Watson, Gabrielle [751] Oxfam America; 617-875-6391; [email protected]
Watson, Kenneth [132] Rideau Consultants Ltd; 202-232-0454; [email protected]
Watson, Yvonne [601-862] United States Environmental Protection Agency; 202-566-2239; [email protected]
Watt, Toni [137] Texas State University; 512-245-3287; [email protected]
Wauchope, Barbara [303] University of New Hampshire; 603-862-1235; [email protected]
Waxman, Hersh [226-305] Texas A&M University; 979-862-1724; [email protected]
Weeks, Peg [600] Institute for Community Research; 860-278-2044 x229; [email protected]
Weeks, Peggie [670] Western Michigan University; 607-292-7003; [email protected]
Wehipeihana, Nan [307-591-800] Research Evaluation Consultancy Limited; +64 21-686-766; [email protected]
Weisblat, Gina [880] Cleveland State University; 216-780-2358; [email protected]
Weitzman, Beth [273] New York University; 212-998-7446; [email protected]
Welch, Eric [595] University of Illinois at Chicago; 312-413-2416; [email protected]
Welsh, Myia [883] Innovation Network; 202-728-0727 x112; [email protected]
Wendel, Monica [137] Texas A&M University; 979-458-0937; [email protected]
Werb, Shari [877] Smithsonian's National Museum of Natural History; 202-633-1096; [email protected]
Were, Valerie [127] University of Minnesota; 612-801-5875; [email protected]
West Meiers, Maurya [735] World Bank; 202-473-8543; [email protected]
Westine, Carl [137-670-889] Western Michigan University; 503-949-8316; [email protected]
Weston, Christine [133] Johns Hopkins University; 443-287-8039; [email protected]
Wharton, Tracy C [409] University of Michigan; 205-409-4424; [email protected]
Wheat, Norma [392] Campbellsville University; 270-789-5169; [email protected]
Wheaton, Nikki [798] University of Nebraska, Lincoln; [email protected]
Whipple, Elizabeth [288] Research Works Inc; 518-869-9272; [email protected]
White, David [401] Oregon State University; 541-548-6088; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 212
White, Howard [614] International Initiative for Impact Evaluation (3ie); [email protected]
White, Jeffry [297-377] University of Louisiana, Lafayette; 337-482-1010; [email protected]
White, Jianglan [578-809] Georgia Department of Community Health; 404-657-6602; [email protected]
White, Kathleen [237] United States Government Accountability Office; 202-8512; [email protected]
Whitmore, Bessa [242-711] Carleton University; 613-234-1547; [email protected]
Whitney, Joye [832] Brown University; 401-274-9548; [email protected]
Whitsett, Maria [278-388-695] Moak, Casey and Associates; 512-485-7878; [email protected]
Whittinghill, Jonathan [551] California State University, Los Angeles; 323-343-5622; [email protected]
Wholey, Joseph [312-388-727] University of Southern California; 703-524-3722; [email protected]
Widmer, Karen [779] Independent Consultant; 707-815-2286; [email protected]
Wighton, Lynne [896] Vanderbilt University; 615-364-2406; [email protected]
Wijesinha Rose, Shyanika [279] Battelle Memorial Institute; 919-544-3717; [email protected]
Wikoff, Martin [754] Krueger International; [email protected]
Wilce, Maureen [631-720] Centers for Disease Control and Prevention; 770-488-3721; [email protected]
Wiley, Caroline [680] University of Arizona; 520-621-7828; [email protected]
Wilhelm, Mari [744] University of Arizona; 520-621-3902; [email protected]
Wilkerson, Stephanie [290] Magnolia Consulting LLC; 434-984-5540; [email protected]
Wilkey, Sarah [793] Oklahoma State University; 405-744-6539; [email protected]
Wilkinson-Lee, Ada [744] University of Arizona; 520-626-4433; [email protected]
Will, Kelli [137] Eastern Virginia Medical School; 757-668-6449; [email protected]
Willard, Alice [359] International Relief & Development; 703-533-3126; [email protected]
Willems, Gwen [394] University of Minnesota; 651-646-8854; [email protected]
Williams, Ashanta [237] United States Government Accountability Office; 202-512-5110; [email protected]
Williams, Benita [557] Feedback Research & Analytics; +278 27729709; [email protected]
Williams, Bob [583-663] Independent Consultant; +64 4 586 2790; [email protected]
Williams, David D [108-752-793] Brigham Young University; 801-422-2765; [email protected]
Williams, Duane E [137] Discovery Logic; 240-912-1932; [email protected]
Williams, Jennifer [392-511] University of Cincinnati; 513-312-2341; [email protected]
Williams, Julia [515] University of Minnesota, Duluth; 218-940-7317; [email protected]
Williams, Katherine [641] Population Council; 202-237-9409; [email protected]
Williams, Keith [790] Building Services and Consultant LLC; 414-431-2147; [email protected]
Williams, Melissa [137] University of North Carolina at Greensboro; 336-315-7415; [email protected]
Williams, Sean [137] Clemson University; 864-656-2179; [email protected]
Williams, Valerie [502] The Globe Program; [email protected]
Williams Kaye, Jacqueline [266-413-665] Atlantic Philanthropies; 212-916-7300; [email protected]
Williams-Forson, Psyche [200-322] University of Maryland; [email protected]
Willis, Anne [219] Wright State University; 937-775-2886; [email protected]
Wilson, Bincy [209] State University of New York at Buffalo; 716-418-5797; [email protected]
Wilson, Dawn [137-820] University of South Carolina; 803-777-8032; [email protected]
Wilson, Heather [597] Centerstone Research Institute; 615-460-4493; [email protected]
Wilson, Kathryn [750-872] Western Michigan University; 517-543-6801; [email protected]
Wilson, Mary Martha [312] Healthy Teen Network; 772-219-7566; [email protected]
Wilson, Maureen [711] University of Calgary; 403-486-4585; [email protected]
Wilson, Tasha-Neisha [137] University of South Florida; 813-974-3014; [email protected]
Wilson-Grau, Ricardo [319] Ricardo Wilson-Grau Consulting; +55 21 2284 6889; [email protected]
Wind, Tricia [319-690] International Development Research Centre; 613-696-2480; [email protected]
Wingate, Lori [117-137-282-670] Western Michigan University; 269-387-5895; [email protected]
Winges, Linda [137-279-540-779] Battelle Memorial Institute; 206-528-3151; [email protected]
Winston, Donna [214] WestEd; 510-302-4273; [email protected]
Wischnowski, Michael [788] St John Fisher College; 585-385-5265; [email protected]
Wise, Jean-Marc [115] Florida State University; 850-644-3541; [email protected]
Wittmann, Werner [106] University of Mannheim; +0049 621 181 3128; [email protected]
Wituk, Scott [137] Wichita State University; 316-978-3327; [email protected]
Wolfe, Susan M [305-779-870] Susan Wolfe and Associates LLC; 682-472-1161; [email protected]
Wolfgramm, Tania [791] Pou Kapua Consulting; +6421-201-7229; [email protected]
Wolowiec-Fisher, Kim [137] University of Illinois at Urbana-Champaign; 847-733-8178; [email protected]
Wong, Cindy [618] Bradeis University; 831-708-2741; [email protected]
Wong, Faye [776] Centers for Disease Control and Prevention; [email protected]
Woo, Annie [137] Education Northwest; 503-617-1848; [email protected]
Wood, Andrea [811] Western Michigan University; 616-304-7820; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 213
Wood, Diana [137] Tennessee Technological University; [email protected]
Wood, Richard [380] Pima Prevention Partnership; 520-260-5598; [email protected]
Woodard, Audra [137] Wholistic Stress Control Institute Inc; 404-755-0069; [email protected]
Woodard, Thelma [248-398-593] University of Tennessee, Knoxville; 865-247-5827; [email protected]
Woodland, Rebecca [301-565-757] University of Massachusetts, Amherst; 413-545-1751; [email protected]
Woody, Jennifer [107] North Carolina Department of Health; 919-707-5428; [email protected]
Worley, Trish [373] University of Wyoming; 307-760-6009; [email protected]
Wright, Annie [280-699] University of South Carolina; 803-397-7290; [email protected]
Wright, David [629-801] Abilene Christian University; 325-674-2790; [email protected]
Wright, Kevin [137] National Institutes of Health; 301-402-3574; [email protected]
Wu, Gang [137] Shanghai Normal University; +86 2164321005; [email protected]
XXXXXXXX
Xiao, Xiaoxi [254] Chinese Academy of Sciences; [email protected]
Xiong, Guoxiang [886] Chinese Academy of Sciences; +68 97333; [email protected]
Xiong, Sharon [320-627] Battelle Memorial Institute; 703-875-2987; [email protected]
Xue, Yuanjing [137] University of Minnesota; 612-209-7852; [email protected]
Yaacov, Michal [137] Branco Weiss Institute; +972 52 6540321; [email protected]
YYYYYYYY
Yale, Melissa [137] Purdue University; 574-514-8808; [email protected]
Yam, Kai Chi [137] Washington State University; 509-335-2923; [email protected]
Yamashita, Mika [390-497-533-616] Academy for Educational Development; 202-464-3825; [email protected]
Yamnitzky, Gail [223] University of Pittsburgh; 412-624-7240; [email protected]
Yang, Evelyn [630] Community Anti-Drug Coalitions of America; 703-706-0560 x243; [email protected]
Yanovsky, Boris [237-695-829] United States Department of Veterans Affairs; 513-247-4292; [email protected]
Yanowitz, Karen L [875] Arkansas State University; 870-972-3064; [email protected]
Yap, Ching Ching [418-518-598-702] Savannah College of Art and Design; 912-525-5848; [email protected]
Yarbrough, Charyl Staci [848] Rutgers University; 732-932-4100 x6211; [email protected]
Yarbrough, Donald [133-282-362] University of Iowa; 319-335-5567; [email protected]
Yasuda, Susumu [890] National Institute of Advanced Industrial Science and Technology; +81 29 862 6069; [email protected]
Yates, Brian [556-805] American University; 301-755-1892; [email protected]
Yee, Sue Lin [807] Centers for Disease Control and Prevention; 770-488-3941; [email protected]
Yegian, Jill [304] California HealthCare Foundation; 613-327-7483; [email protected]
Yetter, Scott [541] CHF International; [email protected]
Yi, Chan Goo [886] Pukyong National University; +82 10 2577 3434; [email protected]
Yi Zang, 'Leaf' [525] Iowa State University; 515-294-3817; [email protected]
Yoder, Brian [277] National Aeronautics and Space Administration; 202-358-7338; [email protected]
Yoder, Edgar [898] Pennsylvania State University; [email protected]
Yoo, Seung Jun [810] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); +82-2-589-2861; [email protected]
Yopp, David [804] Montana State University; 877-572-5032; [email protected]
York, Susan [707] University of Hawaii; 808-956-7900; [email protected]
York, Valerie [116-831] Kansas State University; 785-532-5930; [email protected]
Yost, Jan [604] Health Foundation of Central Massachusetts; 508-438-0009; [email protected]
Young, Jennifer [225] South Carolina Department of Education; 803-608-1834; [email protected]
Youtie, Jan [531] Georgie Institute of Technology; 404-894-6111; [email protected]
Yu, Chien [613] National Taiwan Normal University; +886 2 8211 1897; [email protected]
Yu, Hanh Cao [505] Social Policy Research Associates; [email protected]
Yu, Ping [320-627] Battelle Memorial Institute; 703-875-2981; [email protected]
Yu, Shiuh-Sheng [375] National Chi Nan University; +886 49 2911 242; [email protected]
Yuan, Wenhui [305] Fort Worth Independent School District; 269-267-3039; [email protected]
Yuen, JoAnn [213] University of Hawaii, Manoa; 808-956-5462; [email protected]
Yung, Betty [508] Wright State University; 937-775-4327; [email protected]
Zahniser, S Christine [312] Global Evaluation and Applied Research Solutions Inc; 770-488-6304; [email protected]
ZZZZZZZZ
Zakocs, Ronda [212] Independent Consultant; 503-719-4140; [email protected]
Zandniapour, Lily [883] Innovation Network; 202-728-0727 x117; [email protected]
Zannini Bull, Karen [137] Syracuse University; 315-708-7504; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 214
Zaro, Susan [776] ICF Macro International; [email protected]
Zatsman, Igor [766] Russian Academy of Sciences; +7 499 129 1951; [email protected]
Zavala, Maria Elena [342] California State University, Northridge; 818-677-3342; [email protected]
Zaveri, Heather [307] Mathematica Policy Research; 202-264-3441; [email protected]
Zayas, Luis H [331] Washington University in St Louis; 314-935-9448; [email protected]
Zeitler, Leslie [379] California Social Work Education Center; 510-642-9272; [email protected]
Zeldin, Shep [401] University of Wisconsin, Madison; 608-263-2383; [email protected]
Zeleke, Michael [397] American Red Cross; 202-303-5037; [email protected]
Zelermyer, Karen [891] Funders for LGBTQ Issues; 212-475-2930 x13; [email protected]
Zerounian, Patricia [684] Monterey County Health Department; 831-755-4583; [email protected]
Zhang, Jie [852] Syracuse University; 315-382-7695; [email protected]
Zhang, Lei [867] Centers for Disease Control and Prevention; 770-488-1144; [email protected]
Zhang, Xiaofang [804] University of South Carolina; 803-553-7715; [email protected]
Zhao, Jia [698] Nemours Health and Prevention Services; 302-444-9100; [email protected]
Zhao, Jing [137-672] The Ohio State University; 614-707-3410; [email protected]
Zheng, Haijun [513] Chinese Academy of Sciences; +86 1062550587; [email protected]
Zheng, Xiaohui [566] Empirical Educaiton Inc; 650-328-1734 x155; [email protected]
Zheng, Yonghe [886] National Nature Science Foundation of China; +139 10381789; [email protected]
Zhou, Changhai [254] Chinese Academy of Sciences; [email protected]
Zhou, Jianzhong [886] Chinese Academy of Sciences; +158 10786699; [email protected]
Zhou, Mei [841] Georgia State University; 404-413-0314; [email protected]
Zhu, Jing [220] Metis Associates; 212-425-8833 x181; [email protected]
Zhu, Min [286-518-804] University of South Carolina; 803-777-3459; [email protected]
Ziebarth, Steven [315] Western Michigan University; 269-387-4534; [email protected]
Zimmer, Jeanne [693] University of Minnesota; 651-292-1424; [email protected]
Zimmerman, Stella SiWan [798] Action Consulting and Evaluation Team (ACET) Inc; 952-922-1811; [email protected]
Ziner, Andrew Scott [695] Atlantic Social Research Corporation; 610-573-6400; [email protected]
Zito, Mark [565] East Hartford Public School District; 860-622-5010; [email protected]
Zorn, Debbie [757] University of Cincinnati; 513-556-3818; [email protected]
Zuckerman, Brian [137-271-431-689] Science and Technology Policy Institute; 202-419-5485; [email protected]
Zuercher, Nancy [113-524] JVA Consulting LLC; 303-477-4896; [email protected]
Zukoski, Ann [225] Rainbow Research Inc; 612-824-0724 x207; [email protected]
Zurn-Birkhimer, Suzanne M [137] Purdue University; 765-494-9335; [email protected]
Zuschlag, Michael [235] Volpe National Transportation Systems Center; 617-494-3250; [email protected]
Zvoch, Keith [380-626] University of Oregon; 541-346-1401; [email protected]
Zvonikov, Victor [375] State University of Management; [email protected]
Evaluation 2010: Appendix A – Index of Presenters and Contributors
Page 215
Appendix B: Directory of Sessions by Sponsor
Index of Sessions for the Presidential Strand
#
Time
Session Type
Session Title
Room Name
100
Wed, 3:15 PM to 4:15 PM
Plenary
Tensions Among Evaluative Perspectives in the Age of Obama: Influences on Evaluation Quality, Thinking and Values
Texas A
102
Wed, 4:30 PM to 6:00 PM
Panel
Improving the Quality of Evaluation Practice by Attending to Context
Lone Star A
200
Thu, 8:00 AM to 8:45 AM
Plenary
Interdisciplinary Perspectives on Evaluation Quality
Texas A
202
Thu, 9:15 AM to 10:45 AM
Panel
Rigor at Stake: Quality Evaluation of Change and Impact in a Complex World
Lone Star A
242
Thu, 10:55 AM to 12:25 PM
Think Tank
Cultural Competency in Evaluation: Discussion of the American Evaluation Association's Public Statement on the Importance…
Lone Star A
282
Thu, 1:40 PM to 3:10 PM
Panel
The Role of Metaevaluation in Promoting Evaluation Quality: National and International Cases
Lone Star A
322
Thu, 3:35 PM to 4:20 PM
Panel
Truth, Beauty, and Justice: A Conversation With Plenary Speakers
Lone Star A
362
Thu, 4:30 PM to 6:00 PM
Skill-building
Using the Program Evaluation Standards, Third Edition, to Define and Enhance Evaluation Quality
Lone Star A
500
Fri, 8:00 AM to 8:45 AM
Plenary
Evaluation Quality: The Good, the Bad, the Beautiful, and the Ugly
Texas A
502
Fri, 9:15 AM to 10:45 AM
Panel
Equity and Quality in Evaluation: Ideas and Illustrations From the Field
Lone Star A
542
Fri, 10:55 AM to 11:40 AM
Expert Lecture
President Obama's Evaluation Policies
Lone Star A
582
Fri, 1:40 PM to 3:10 PM
Think Tank
In the Multi-level Systemic Evaluation Universe, Whose Responsibility is Quality? A Discussion Among Respected Colleagues
Lone Star A
622
Fri, 3:35 PM to 4:20 PM
Think Tank
Exploring the Intersection of Beauty and Quality With the Student Travel Award Winners
Lone Star A
662
Fri, 4:30 PM to 6:00 PM
Panel
Evaluation Anthropology Praxis Today: Building the Future
Lone Star A
702
Sat, 8:00 AM to 9:30 AM
Panel
Design Thinking: The Art of Evaluation
Lone Star A
742
Sat, 10:00 AM to 10:45 AM
Panel
Improving Evaluation Quality by Improving Program Quality: A Theory-based/Theory-driven Perspective
Lone Star A
782
Sat, 10:55 AM to 12:25 PM
Panel
Mixed Methods Contributions to Evaluation Quality
Lone Star A
822
Sat, 1:45 PM to 2:30 PM
Expert Lecture
A Conversation With Ernest House
Lone Star A
862
Sat, 2:50 PM to 4:20 PM
Panel
Tools for Improving the Quality of Evaluations: Four Examples From the Field
Lone Star A
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 216
Index of Sessions for the Advocacy and Policy Change TIG
#
Time
Session Type
Session Title
Room Name
112
212
253
Wed, 4:30 PM to 6:00 PM
Thu, 9:15 AM to 10:45 AM
Thu, 10:55 AM to 12:25 PM
MultiPaper
Multipaper
Roundtable
Bowie C
Bowie C
Goliad
292
332
413
513
Thu, 1:40 PM to 3:10 PM
Thu, 3:35 PM to 4:20 PM
Thu, 6:10 PM to 7:00 PM
Fri, 9:15 AM to 10:45 AM
Think Tank
Panel
Business Meeting
Roundtable
552
592
711
751
831
849
Fri, 10:55 AM to 11:40 AM
Fri, 1:40 PM to 3:10 PM
Sat, 8:00 AM to 9:30 AM
Sat, 10:00 AM to 10:45 AM
Sat, 1:45 PM to 2:30 PM
Sat, 1:45 PM to 2:30 PM
Panel
Multipaper
Multipaper
Panel
Multipaper
Expert Lecture
Understanding, Building, and Evaluating Advocacy Capacity
Maintaining Quality in Challenging Contexts
Rotation I: Theory of Change Evaluation in the Real World: Lessons Learned from Applying (and Modifying) the TOC Approach…
Rotation II: Evaluating Foundation Advocacy Strategies: When Theory and Practice Collide
Who Are Champions, What Are Their Impact and How Do You Know? Considerations for Advocates, Funders, and Evaluators
Advocacy Capacity Nuance: Helpful, or Too Much? Considering the Cases of Assessing Coalitions Versus Networks and Grassroots…
Advocacy and Policy Change TIG Business Meeting
Rotation I: Big Money, More Scrutiny: How to Forge Evaluator-Early Childhood Education Program Partnerships…
Rotation II: A Study on the Indicator of High Quality Papers: The Case of Casualty Actuarial Society (CAS)
How Does Evidence Influence Policy Change? Examining Two Complementary Approaches With Two Complementary Evaluations
Health Matters: Evaluating Advocacy and Policy Change
Where Theory Meets Practice in Assessing Advocacy and Policy Change
Slow Down, You Move too Fast: Calibrating Evaluator Engagement to the Pace of Campaigners and Advocates when Developing…
The Role of Evaluation in Informing Local and State Policy Makers
Establishing a MEL System for Policy Reform: Lessons From Oxfam America‘s Advocacy on More Country Ownership of US Foreign Aid
Bowie C
Bowie C
Goliad
Goliad
Bowie C
Bowie C
Bowie C
Bowie C
Bowie C
Texas C
Index of Sessions for the Alcohol, Drug Abuse, and Mental Health TIG
#
Time
Session Type
Session Title
Room Name
122
222
262
302
312
373
Wed, 4:30 PM to 6:00 PM
Thu, 9:15 AM to 10:45 AM
Thu, 10:55 AM to 12:25 PM
Thu, 1:40 PM to 3:10 PM
Thu, 1:40 PM to 3:10 PM
Thu, 4:30 PM to 6:00 PM
Skill-building
Multipaper
Multipaper
Multipaper
Panel
Roundtable
Presidio C
Presidio C
Presidio C
Presidio C
Texas E
Goliad
522
562
602
642
682
721
761
801
841
881
Fri, 9:15 AM to 10:45 AM
Fri, 10:55 AM to 11:40 AM
Fri, 1:40 PM to 3:10 PM
Fri, 3:35 PM to 4:20 PM
Fri, 4:30 PM to 6:00 PM
Sat, 8:00 AM to 9:30 AM
Sat, 10:00 AM to 10:45 AM
Sat, 10:55 AM to 12:25 PM
Sat, 1:45 PM to 2:30 PM
Sat, 2:50 PM to 4:20 PM
Multipaper
Business Meeting
Panel
Demonstration
Panel
Panel
MultiPaper
Multipaper
Multipaper
MultiPaper
Integrating Realist Evaluation Strategies in a SAMHSA System of Care Local Evaluation
Evaluation of Youth Mental Health and Substance Abuse Interventions
Analytic and Measurement Approaches in Substance Abuse and Mental Health Evaluation
Outcome Assessment in Substance Abuse and Mental Health
The Cycle of Evidence-based Policy and Practice: Synthesis, Translation, and Evaluation Capacity Building
Rotation I: Designing for Change: The Experience of the Quitline Iowa Evaluation
Rotation II: Adapting the Strategic Prevention Framework Model for Use in Suicide Prevention and Other Abbreviated Funding Cycles…
Evaluating National Substance Abuse Prevention Programs
Alcohol, Drug Abuse and Mental Health TIG Business Meeting
Assessing Implementation Fidelity of Substance Abuse Prevention Environmental Change Strategies: Lessons Learned From…
Building a Flexible, Web-based Analysis Tool to Examine Person Level Changes Over Time in a Mental Health Outcomes…
National Evaluation of the Addiction Technology Transfer Center Network (ATTC): Findings and Observations From a Contextually Rich…
Taking Stock of the Quality of Evaluation Research on School-Based Prevention Programs
Evaluation Capacity in School Mental Health: Lessons From School Counseling
Use of Administrative Data for Management and Policy Making
Evaluating Mental Health Peer Support and Peer Specialist Programs
Evaluating a National Medicaid Children's Mental Health Demonstration Grant Program
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Presidio C
Presidio C
Presidio C
Presidio C
Presidio C
Presidio C
Presidio C
Presidio C
Presidio C
Presidio C
Page 217
Index of Sessions for the Assessment in Higher Education TIG
#
Time
Session Type
Session Title
115
255
335
375
415
515
594
Wed, 4:30 PM to 6:00 PM
Thu, 10:55 AM to 12:25 PM
Thu, 3:35 PM to 4:20 PM
Thu, 4:30 PM to 6:00 PM
Thu, 6:10 PM to 7:00 PM
Fri, 9:15 AM to 10:45 AM
Fri, 1:40 PM to 3:10 PM
Multipaper
Multipaper
Panel
Multipaper
Business Meeting
Multipaper
Roundtable
635
674
Fri, 3:35 PM to 4:20 PM
Fri, 4:30 PM to 6:00 PM
Expert Lecture
Roundtable
714
754
758
833
834
848
860
874
Sat, 8:00 AM to 9:30 AM
Sat, 10:00 AM to 10:45 AM
Sat, 10:00 AM to 10:45 AM
Sat, 1:45 PM to 2:30 PM
Sat, 1:45 PM to 2:30 PM
Sat, 1:45 PM to 2:30 PM
Sat, 1:45 PM to 2:30 PM
Sat, 2:50 PM to 4:20 PM
Skill-building
Multipaper
Multipaper
Roundtable
Demonstration
Multipaper
MultiPaper
Multipaper
Assessing Student Learning Outcomes I: Incorporating Feeback
Travis A
Assessing Student Learning Outcomes II: Three Sides of the Coin
Travis A
Using Business Frameworks to Evaluate Program Impact on Student Learning
Travis A
Evaluation Without Borders: Lessons From Other Countries
Travis A
Assessment in Higher Education TIG Business Meeting
Travis A
Beyond the Classroom: Assessment in Non-Traditional Settings
Travis A
Rotation I: Conceptualizing the Quality of Assessment
San Jacinto
Rotation II: Perspectives on Collaboration in Practice: Expanding the Role and Culture of Assessment in Academic Affairs and Student…
Compared to What? Reconsidering Assessment in Higher Education
Travis A
Rotation I: Accreditation as a Pathway to Build Community and Generate Renewal
San Jacinto
Rotation II: Using Evaluation to Help Transform Departments in the Challenging Economic Environment of Higher Education
Leading Change Through Assessment
Travis A
The Impact of Exogenous Factors in Classroom Evaluation
Travis A
Evaluation in Medical Education
Independence
Toward Improving the Evaluation Practice of Financial Education Programs: Key Issues and the Role of Formative Evaluation
San Jacinto
Thinking About Thinking: Assessing Critical Thinking Instruction in Higher Education
Travis A
Evaluation in Community Colleges
Texas B
Let Quality Guide Evaluation Quality: Recent Trends Implemented in the Middle East
Republic C
The Importance of Critical Thinking in Assessment in Higher Education
Travis A
Room Name
Index of Sessions for the Business and Industry TIG
#
Time
Session Type
Session Title
Room Name
235
275
355
395
436
563
573
607
613
653
659
774
846
854
Thu, 9:15 AM to 10:45 AM
Thu, 10:55 AM to 12:25 PM
Thu, 3:35 PM to 4:20 PM
Thu, 4:30 PM to 6:00 PM
Thu, 6:10 PM to 7:00 PM
Fri, 10:55 AM to 11:40 AM
Fri, 10:55 AM to 11:40 AM
Fri, 1:40 PM to 3:10 PM
Fri, 1:40 PM to 3:10 PM
Fri, 3:35 PM to 4:20 PM
Fri, 3:35 PM to 4:20 PM
Sat, 10:00 AM to 10:45 AM
Sat, 1:45 PM to 2:30 PM
Sat, 1:45 PM to 2:30 PM
Panel
Multipaper
Multipaper
Demonstration
Business Meeting
Roundtable
Demonstration
Multipaper
Multipaper
Expert Lecture
Multipaper
Think Tank
Multipaper
Expert Lecture
Evaluation Utilization and the Story of the Federal Railroad Administration‘s 10 Year Research and Development Effort to Change…
Evaluating Leadership Development in Organizations
Behavioral and Systematic Causal Influences in Health and Safety
Process Lessons for Applied Research and Evaluation from Capital Projects
Business and Industry TIG Business Meeting
Assessing Board Performance: Challenges and Constraints
How to Use Evaluation to Achieve Human Resources (HR) System Alignment
Key Issues in Evaluating Industrial and Commercial Energy Efficiency Programs and Technologies
Evaluating Effectiveness in Recruitment, Mentoring, and Human Resources' Functions
Small Business Sustainability: A Systems Approach to Triple Bottom Line Success
Risk and Tension in Private Sector Development Project Evaluation
Leading the Horse to Water, Part II: Winning the Front-end Needs Assessment Tug-of-War in a Knowledge Management Program…
Challenges and Recommendations From Evaluating Autobody Shop Environmental Compliance Programs
The Thinking Corporation
Crockett B
Crockett B
Crockett B
Crockett B
Crockett C
Bonham A
Crockett B
Bonham E
Crockett B
Crockett B
Republic C
Crockett B
Bonham E
Crockett B
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 218
Index of Sessions for the Cluster, Multi-site and Multi-level Evaluation TIG
#
Time
Session Type
Session Title
Room Name
107
Wed, 4:30 PM to 6:00 PM
MultiPaper
Balancing Autonomy and Uniformity in a Multi-site Evaluation: Evaluation of Program Integration Efforts at the CDC
Lone Star F
207
Thu, 9:15 AM to 10:45 AM
Panel
Serving Two Masters: Local Evaluators Trying to Maintain Evaluation Quality and Use While Participating in a National Multi-site…
Lone Star F
288
Thu, 1:40 PM to 3:10 PM
Roundtable
Rotation I: Evaluating Twenty First Century Community Learning Centers: Reconciling Evaluation Needs and Constraints at Multiple…
Rotation II: Simplifying the Complex: Creating Transparent Evaluation in Multi-institutional Education Partnerships
Mission A
327
Thu, 3:35 PM to 4:20 PM
Panel
Evaluating a Multi-site Twenty First Century Learning Program: Strategies and Results
Lone Star F
367
Thu, 4:30 PM to 6:00 PM
Business Meeting
TIG Business Meeting and Demonstration: A Mixed Methods Approach to Measurement for Multi-site Evaluation
Lone Star F
547
Fri, 10:55 AM to 11:40 AM
Multipaper
Multi-method Approaches
Lone Star F
582
Fri, 1:40 PM to 3:10 PM
Think Tank
In the Multi-level Systemic Evaluation Universe, Whose Responsibility is Quality? A Discussion Among Respected Colleagues
Lone Star A
627
Fri, 3:35 PM to 4:20 PM
Multipaper
Exemplars of School Evaluations
Lone Star F
667
Fri, 4:30 PM to 6:00 PM
Skill-building
Evaluation 201: Evaluation Skills Needed After Coursework
Lone Star F
707
Sat, 8:00 AM to 9:30 AM
Panel
The Process of Evaluating Supporting Partnerships to Assure Ready Kids (SPARK) and Ready Kids Follow-Up (RKF): Embracing…
Lone Star F
747
Sat, 10:00 AM to 10:45 AM
Panel
Partner Roles in a Multi-site Evaluation: The Viewpoints and Experiences of the Cross-site Evaluator and the State Program Coordinator Lone Star F
787
Sat, 10:55 AM to 12:25 PM
Panel
Extended Learning: A Conversation Among Evaluators of the National Science Foundation (NSF) Extension Services Projects
827
Sat, 1:45 PM to 2:30 PM
Multipaper
Linking With Outcomes
Lone Star F
867
Sat, 2:50 PM to 4:20 PM
Panel
Meeting Needs of Multiple Stakeholders in a High-Scrutiny Multi-site Evaluation: Evaluation of the CPPW Initiative
Lone Star F
Lone Star F
Index of Sessions for the Collaborative, Participatory & Empowerment Evaluation TIG
#
Time
Session Type
Session Title
Room Name
104
Wed, 4:30 PM to 6:00 PM
Panel
Building a Learning Culture Within Community Initiatives and Organizations
Lone Star C
134
Wed, 4:30 PM to 6:00 PM
Skill-building
Round Robin Focus Groups: Participatory Inquiry - From Data Gathering to Reporting in an Hour
Republic C
204
Thu, 9:15 AM to 10:45 AM
MultiPaper
The Essential Features of Collaborative, Participatory, and Empowerment Evaluation
Lone Star C
227
Thu, 9:15 AM to 10:45 AM
Panel
Enhancing the Quality of Evaluation Through Collaboration Among Funders, Programs, and Evaluators: The Example of the NYC Health… Bonham E
240
Thu, 9:15 AM to 10:45 AM
Demonstration
Using a Practical Lens to Develop National-Level Participatory Projects
Republic C
244
Thu, 10:55 AM to 12:25 PM
Think Tank
What We Don‘t Say Can Hurt Us: Working with Undiscussables
Lone Star C
280
Thu, 10:55 AM to 12:25 PM
MultiPaper
A Checklist for Planning, Implementing and Evaluating Implementation Quality
Republic C
284
Thu, 1:40 PM to 3:10 PM
Think Tank
I See What You Mean: Applications of Visual Methods in Evaluation
Lone Star C
321
Thu, 1:40 PM to 3:10 PM
Panel
Five Partners, One Evaluation: A Cohesive Evaluation of the ACHIEVE Healthy Communities Initiative
Republic C
324
Thu, 3:35 PM to 4:20 PM
Think Tank
Exploring the Multiple Roles of Collaborative, Participatory, and Empowerment Evaluators
Lone Star C
364
Thu, 4:30 PM to 6:00 PM
Skill-building
The Biggest Winners: Empowerment Evaluation Exercises to Strengthen Primary Prevention Capacity
Lone Star C
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 219
Index of Sessions for the Collaborative, Participatory & Empowerment Evaluation TIG continued
#
Time
Session Type
Session Title
Room Name
383
Thu, 4:30 PM to 6:00 PM
Roundtable
Rotation I: Evaluation Goes to College: The Collaborative Evaluation of a Graduate Program
Rotation II: Working Together to Design Effective Evaluation Tools
Bonham A
401
Thu, 4:30 PM to 6:00 PM
Panel
Building Capacity for Youth Participatory Evaluation
Republic C
404
Thu, 6:10 PM to 7:00 PM
Business Meeting
Collaborative, Participatory, and Empowerment TIG Business Meeting
Lone Star C
504
Fri, 9:15 AM to 10:45 AM
Demonstration
Youth Led Evaluation in Action: Stomping Out the Stigma of Mental Illness
Lone Star C
541
Fri, 9:15 AM to 10:45 AM
Multipaper
Engaging Participants in the Evaluation Process: A Participatory Approach
Republic C
544
Fri, 10:55 AM to 11:40 AM
Think Tank
Youth Participatory Evaluation: Entering the Age of the Internet
Lone Star C
584
Fri, 1:40 PM to 3:10 PM
Think Tank
Youth Participatory Evaluation: Where Are We and Where Do We Go From Here?
Lone Star C
603
Fri, 1:40 PM to 3:10 PM
Roundtable
Rotation I: Slipping and Sliding Like a Weasel on the Run: Empowerment Evaluation and the Hawthorne Effect
Rotation II: Innovations in Youth Empowerment Evaluation
Bonham A
619
Fri, 1:40 PM to 3:10 PM
MultiPaper
Preliminary Results of Prevention Capacity Building in Science-based Teen Pregnancy, HIV, and STI Prevention
Republic C
624
Fri, 3:35 PM to 4:20 PM
Expert Lecture
Rights-based Evaluation and Active Citizenship in Development Contexts
Lone Star C
664
Fri, 4:30 PM to 6:00 PM
Demonstration
The Evaluative Journey: Implementing Evaluation Activities That Faciliate Ongoing Decision Making
Lone Star C
668
Fri, 4:30 PM to 6:00 PM
Roundtable
Rotation I: Examining Collaboration in an Evaluation of a Large Scale Civic Education Program
Rotation II: Using Mixed Methods to Evaluate a School Based Civic Engagement Initiative
Mission A
673
Fri, 4:30 PM to 6:00 PM
Roundtable
Rotation I: My First Year as an Internal Evaluator: What I Didn't Know That I Didn't Know
Rotation II: Evaluator/ Practitioner Collaborations
Goliad
695
Fri, 4:30 PM to 6:00 PM
Multipaper
Collaboration in Government-Sponsored Evaluations
Crockett D
699
Fri, 4:30 PM to 6:00 PM
Panel
Technical Assistance in Action: How Does the Practice Look?
Republic C
704
Sat, 8:00 AM to 9:30 AM
MultiPaper
Training in Evaluation: Formal and Informal Capacity Building
Lone Star C
722
Sat, 8:00 AM to 9:30 AM
Roundtable
Bonham A
740
744
784
820
842
864
875
900
Sat, 8:00 AM to 9:30 AM
Sat, 10:00 AM to 10:45 AM
Sat, 10:55 AM to 12:25 PM
Sat, 10:55 AM to 12:25 PM
Sat, 1:45 PM to 2:30 PM
Sat, 2:50 PM to 4:20 PM
Sat, 2:50 PM to 4:20 PM
Sat, 2:50 PM to 4:20 PM
Multipaper
Panel
Skill-building
Multipaper
Roundtable
Panel
Think Tank
Multipaper
Rotation I: Wearing Different Hats: The Multiple Roles of an Evaluator
Rotation II: Valuing Stakeholders: Collaborative Evaluation of Professional Development Needs
Collaborative Evaluations: Successes, Challenges, and Lessons Learned
REACH US Programs: Creating and Evaluating Community-based Coalitions
Collaborative Evaluations
Empowerment Evaluations: Insights, Reflections, and Implications
Negotiating Multiple Challenges While Maintaining Quality: Lessons From Urban: Rural Alaska
Advances in Stakeholder Consultation for Evaluation Quality
Positionality Matters: Understanding Culture and Context From the Perspective of Key Stakeholders
Strengthening Schools and Youth Through the Use of Evaluation: Issues and Perspectives
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Republic C
Lone Star C
Lone Star C
Republic C
Bonham A
Lone Star C
Travis B
Republic C
Page 220
Index of Sessions for the College Access Programs TIG
#
Time
Session Type
Session Title
Room Name
342
Thu, 3:35 PM to 4:20 PM
Multipaper
Science, Technology, Engineering, and Mathematics (STEM) Recruitment Programs: Evaluation of Effectiveness
Presidio C
424
Thu, 6:10 PM to 7:00 PM
Business Meeting
College Access Programs TIG Business Meeting
Bonham B
533
Fri, 9:15 AM to 10:45 AM
Panel
The GEAR UP Experience: Exploring the Promise of Multi-site Evaluation
Texas F
763
Sat, 10:00 AM to 10:45 AM
Multipaper
Control Groups and Cost Analysis: Innovative Approaches to College Access Program Evaluation
Bonham B
843
Sat, 1:45 PM to 2:30 PM
Multipaper
Evaluation of Underrepresented Student College and Career Choice Programs
Bonham B
Index of Sessions for the Costs, Effectiveness, Benefits, and Economics TIG
#
Time
Session Type
Session Title
Room Name
350
Thu, 3:35 PM to 4:20 PM
Skill-building
New Cost Tools for The Evaluator‘s Toolkit
Texas C
430
Thu, 6:10 PM to 7:00 PM
Business Meeting
Costs, Effectiveness, Benefits, and Economics TIG Business Meeting
Texas C
556
Fri, 10:55 AM to 11:40 AM
Panel
Using CPPOA Data to Improve Substance Abuse Prevention Programs and Portfolios
Travis B
676
Fri, 4:30 PM to 6:00 PM
Multipaper
Methodological Considerations: Choosing an Appropriate Cost Analysis Methodology for the Evaluation
Travis B
805
Sat, 10:55 AM to 12:25 PM
Think Tank
Quality Evaluation: Avoiding Hypocrisy by Formative Evaluation of Evaluation's Outcomes, Processes, and Costs
Bonham D
885
Sat, 2:50 PM to 4:20 PM
Multipaper
Cost Studies in Health Care
Bonham D
Index of Sessions for the Crime and Justice TIG
#
Time
Session Type
Session Title
Room Name
348
Thu, 3:35 PM to 4:20 PM
MultiPaper
Strategies for Evaluation Quality in Government
Texas A
357
Thu, 3:35 PM to 4:20 PM
Business Meeting
Crime and Justice TIG Business Meeting and Paper Presentations
Crockett D
672
Fri, 4:30 PM to 6:00 PM
Multipaper
Evaluations of Court and Corrections Programs
Bowie C
828
Sat, 1:45 PM to 2:30 PM
Multipaper
Dealing With Evaluation Challenges and Complexities in Policing and Prison Environments
Mission A
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 221
Index of Sessions for the Disabilities and Other Vulnerable Populations TIG
#
Time
Session Type
Session Title
Room Name
249
Thu, 10:55 AM to 12:25 PM
Panel
Issues and Models: Evaluating Universal Design for Learning
Mission B
289
Thu, 1:40 PM to 3:10 PM
Panel
Constructing Relevant Guidelines for Disability Program Evaluations
Mission B
329
Thu, 3:35 PM to 4:20 PM
Skill-building
Quality Evaluation Includes Everyone! Using Universal Design to Make Your Evaluation More Accessible
Mission B
368
Thu, 4:30 PM to 6:00 PM
Roundtable
Rotation I: Special Populations: Strategies for Collecting Data, Giving Voice
Rotation II: Toward Universal Design for Evaluation: Continuing the Conversation
Mission A
495
Fri, 7:00 AM to 7:50 AM
Business Meeting
TIG Business Meeting and Presentation: Disability-related Funding Opportunities at the NSF - What Evaluators Have to Offer
Mission B
669
Fri, 4:30 PM to 6:00 PM
MultiPaper
Evaluating Community Capacity Building as a Prevention Strategy
Mission B
749
Sat, 10:00 AM to 10:45 AM
Multipaper
Evaluation of Interventions and Assessments of Individuals With Disabilities
Mission B
788
Sat, 10:55 AM to 12:25 PM
Roundtable
Preparing Teacher Candidates for Parent Partnerships: An Evaluation of a Preservice Course in Teacher Education
Mission A
869
Sat, 2:50 PM to 4:20 PM
MultiPaper
Evaluating Special Education Personnel Development Initiatives in Three Predominately Rural States: Emphasis on Fidelity…
Mission B
Index of Sessions for the Disaster and Emergency Management Evaluation TIG
#
Time
Session Type
Session Title
Room Name
334
Thu, 3:35 PM to 4:20 PM
Roundtable
Being on Target: Evaluation Techniques for Disaster Relief Agencies
San Jacinto
397
Thu, 4:30 PM to 6:00 PM
Panel
Haiti: Challenges in Emergency Response and Recovery Bring Challenges (and Innovation) in Evaluation
Crockett D
437
Thu, 6:10 PM to 7:00 PM
Business Meeting
TIG Business Meeting and Discussion – Lessons From the Tsunami Recover in the Indian Ocean and Earthquake Recover in Haiti
Crockett D
816
Sat, 10:55 AM to 12:25 PM
Multipaper
Development and Selection of Frameworks and Constructs for Disaster Preparedness and Recovery Evaluation
Crockett D
896
Sat, 2:50 PM to 4:20 PM
Multipaper
Impact Evaluation of Approaches to Affect Local Resiliency to Disasters, Enhanced Public Health Emergency Peer Networks and First… Crockett D
Index of Sessions for the Distance Education and Other Educational Technologies TIG
#
Time
Session Type
Session Title
Room Name
108
Wed, 4:30 PM to 6:00 PM
Roundtable
Rotation I: Using Technological Pedagogical Content Knowledge and an Evaluation Framework to Evaluate Online Courses and Tools
Rotation II: REMOTE Messages: The Job Value of a Distance Learning Graduate Program for the Pacific Region
Mission A
340
Thu, 3:35 PM to 4:20 PM
Business Meeting
Distance Education and Other Educational Technologies TIG Business Meeting
Presidio A
560
Fri, 10:55 AM to 11:40 AM
Multipaper
Technology and Student Outcomes: Mathematics, Language Arts, and Big-District Diversity
Presidio A
640
Fri, 3:35 PM to 4:20 PM
Think Tank
Digital Media and Learning for Youth: What Do They Know, When Do They Know It, How Do We Evaluate It?
Presidio A
752
Sat, 10:00 AM to 10:45 AM
Roundtable
Increasing Access Through Openness? Evaluating Open Educational Resources (OER) in Himalayan Community Technology Centres
Goliad
879
Sat, 2:50 PM to 4:20 PM
Multipaper
Online Learning in Adult and Postsecondary Education: Theory and Practice
Presidio A
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 222
Index of Sessions for the Environmental Program Evaluation TIG
#
Time
Session Type
Session Title
Room Name
127
Wed, 4:30 PM to 6:00 PM
Multipaper
Environmental and Energy Evaluations: Strategies for Pursuing Innovative Approaches That Demonstrate Impact, Promote…
Bonham E
267
Thu, 10:55 AM to 12:25 PM
Multipaper
Environmental Education Evaluation: Examining Citizen Collected Data, Mixed Method Designs, and Professional Development
Bonham E
281
Thu, 1:40 PM to 3:10 PM
Demonstration
San Antonio River Improvements Project: Field Trip to Ecosystem Restoration Sites
Off Site Fieldtrip
347
Thu, 3:35 PM to 4:20 PM
Demonstration
Toolkit for Evaluating Impacts of Public Participation in Scientific Research
Bonham E
427
Thu, 6:10 PM to 7:00 PM
Business Meeting
Environmental Program Evaluation TIG Business Meeting
Bonham E
607
Fri, 1:40 PM to 3:10 PM
Multipaper
Key Issues in Evaluating Industrial and Commercial Energy Efficiency Programs and Technologies
Bonham E
647
Fri, 3:35 PM to 4:20 PM
Multipaper
Improving the Quality of Habitat and Biodiversity Conservation Program Evaluations Using Methodological and Budgetary Techniques Bonham E
687
Fri, 4:30 PM to 6:00 PM
Panel
The Environmental Evaluators Network: Quality in an Era of Results-based Performance
Bonham E
790
Sat, 10:55 AM to 12:25 PM
MultiPaper
The Home Energy Audit: An Exercise in Complex Systems Thinking for Practitioners and Evaluators Alike
Bowie A
824
Sat, 1:45 PM to 2:30 PM
Demonstration
Estimating Climate Change and Its Use in Evaluation
Lone Star C
846
Sat, 1:45 PM to 2:30 PM
Multipaper
Challenges and Recommendations From Evaluating Autobody Shop Environmental Compliance Programs
Bonham E
862
Sat, 2:50 PM to 4:20 PM
Panel
Tools for Improving the Quality of Evaluations: Four Examples From the Field
Lone Star A
Index of Sessions for the Evaluating the Arts and Culture TIG
#
Time
Session Type
Session Title
Room Name
218
Thu, 9:15 AM to 10:45 AM
Multipaper
Improving Evaluation Quality Through and In the Arts
Travis D
258
Thu, 10:55 AM to 12:25 PM
Panel
Evaluation in Action: A Sampler of Tracking and Timing Methodologies in Museums, Culturals, and Informal Education Settings
Travis D
374
Thu, 4:30 PM to 6:00 PM
Roundtable
Rotation I: The Beauty of Internal Evaluation in the Arts: Using Metaphors and Symbols to Develop the Evaluation Capacity…
Rotation II: Evaluating Innovation and Capacity Building in Arts Organizations: Challenges and Lessons Learned in Capturing…
San Jacinto
418
Thu, 6:10 PM to 7:00 PM
Business Meeting
Evaluating the Arts and Culture TIG Business Meeting
Travis D
518
Fri, 9:15 AM to 10:45 AM
Multipaper
Ecologies of Collaboration in the Arts
Travis D
598
Fri, 1:40 PM to 3:10 PM
Multipaper
Implication of Evaluation Approaches on Arts Organization Policies
Travis D
634
Fri, 3:35 PM to 4:20 PM
Roundtable
The Evolution of Integrating Arts-based Inquiry in Evaluation
San Jacinto
702
Sat, 8:00 AM to 9:30 AM
Panel
Design Thinking: The Art of Evaluation
Lone Star A
877
Sat, 2:50 PM to 4:20 PM
Multipaper
Translating Visitors' Experiences Through Evaluation
Travis D
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 223
Index of Sessions for the Evaluation Managers and Supervisors TIG
#
Time
Session Type
Session Title
Room Name
216
Thu, 9:15 AM to 10:45 AM
Demonstration
Project Management Software: An Important Multi-Purpose Tool in an Evaluation Unit‘s Toolbox
Travis B
376
Thu, 4:30 PM to 6:00 PM
Business Meeting
TIG Business Meeting and Panel: Reflections on Evaluation Management Expertise and Competencies From Two Perspectives
Travis B
529
Fri, 9:15 AM to 10:45 AM
Skill-building
Taking Control of Your Evaluation Career
Texas B
548
Fri, 10:55 AM to 11:40 AM
Roundtable
Controlling Quality Within Museums: Coordinating Internal Evaluation Departments
Mission A
588
Fri, 1:40 PM to 3:10 PM
Roundtable
Rotation I: Directors of Research Ensuring Quality in Practice
Rotation II: Managing Evaluation: Continuing the Conversation
Mission A
808
Sat, 10:55 AM to 12:25 PM
Demonstration
Successfully Managing Evaluation Projects: Quality Solutions to Common Project Management Challenges
Texas B
Index of Sessions for the Evaluation Policy TIG
#
Time
Session Type
Session Title
Room Name
253
Thu, 10:55 AM to 12:25 PM
Roundtable
Rotation I: Theory of Change Evaluation in the Real World: Lessons Learned from Applying (and Modifying) the TOC Approach…
Rotation II: Evaluating Foundation Advocacy Strategies: When Theory and Practice Collide
Goliad
313
Thu, 1:40 PM to 3:10 PM
Think Tank
Change is a Process, Not An Outcome: Implication for Evolving Federal Evaluation Policy
Texas F
369
Thu, 4:30 PM to 6:00 PM
Multipaper
Historical Shifts in Evaluation Policy abnd Evaluation Practice: What We've Learned About Quality Evaluation
Mission B
433
Thu, 6:10 PM to 7:00 PM
Business Meeting
TIG Business Meeting and Presentation: Evaluation Policy - Where Might We Want To Go, and How Might We Get There
Texas F
509
Fri, 9:15 AM to 10:45 AM
Panel
How Evaluation Policies Affect Evaluation Quality in a Texas Public School District
Mission B
542
Fri, 10:55 AM to 11:40 AM
Expert Lecture
President Obama's Evaluation Policies
Lone Star A
589
Fri, 1:40 PM to 3:10 PM
Multipaper
Evaluation Management Policies: Examining Requirements of Quality Evaluation
Mission B
651
Fri, 3:35 PM to 4:20 PM
Expert Lecture
Introduction to Evaluation and Public Policy
Texas F
709
Sat, 8:00 AM to 9:30 AM
Panel
From Deliverables to Strategies: Experience of Implementing a National Evaluation Policy via Statewide Asthma Programs
Mission B
772
Sat, 10:00 AM to 10:45 AM
Expert Lecture
Quality Evaluation: Drivers and Objectives of the Renewed Canadian Federal Policy on Evaluation
Texas F
789
Sat, 10:55 AM to 12:25 PM
Multipaper
Cross-National Evaluation Policies: Where We've Been, Where We're Going, and What We Need for Quality Evaluation
Mission B
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 224
Index of Sessions for the Evaluation Use TIG
#
Time
Session Type
Session Title
Room Name
232
Thu, 9:15 AM to 10:45 AM
Demonstration
Why Evaluators Need Graphic Design Skills
Texas E
272
Thu, 10:55 AM to 12:25 PM
Panel
Mainstreaming Evaluation in Diverse Organizational Contexts
Texas E
312
Thu, 1:40 PM to 3:10 PM
Panel
The Cycle of Evidence-based Policy and Practice: Synthesis, Translation, and Evaluation Capacity Building
Texas E
328
Thu, 3:35 PM to 4:20 PM
Roundtable
What Role Should the Evaluator Take When a Project Is Off-Track?
Mission A
352
Thu, 3:35 PM to 4:20 PM
Panel
Evaluating Program Interventions in a Rapidly Changing World: Exploring the Potential of Mid-term Reviews, Real Time…
Texas E
392
Thu, 4:30 PM to 6:00 PM
Multipaper
Case Studies in Evaluation Use
Texas E
498
Fri, 7:00 AM to 7:50 AM
Business Meeting
Evaluation Use TIG Business Meeting and Presentation: Recapturing the "Golden Age" of Research on Evaluation Use
Seguin B
532
Fri, 9:15 AM to 10:45 AM
Multipaper
Clients Speak Out About Evaluation
Texas E
570
Fri, 10:55 AM to 11:40 AM
Panel
Joint Evaluation of Private Sector Development Projects: Benefits and Challenges
Texas E
610
Fri, 1:40 PM to 3:10 PM
Think Tank
Taking a Good, Long Look In the Mirror: How Can We Hold Ourselves Accountable for Quality Recommendations?
Texas E
650
Fri, 3:35 PM to 4:20 PM
Demonstration
Moving Beyond the Weighty Tome: New Approaches to Reporting Evaluation Findings
Texas E
677
Fri, 4:30 PM to 6:00 PM
Panel
From Compliance to Reliance: Critical Moments in Integrating Evaluation Into an Organization‘s Work
Travis C
690
Fri, 4:30 PM to 6:00 PM
Panel
Strategy as Evaluand: Quality and Utilization Issues in Evaluating Strategy
Texas E
731
Sat, 8:00 AM to 9:30 AM
Demonstration
Strategies for Developing Evaluation Capacity in Educational Partnerships
Texas E
753
Sat, 10:00 AM to 10:45 AM
Roundtable
Use, Ethics, and Not Giving Clients What They Ask For
San Jacinto
771
Sat, 10:00 AM to 10:45 AM
Demonstration
Effectively Communicating Evaluation Results: Creative, Innovative, and Technological Ways to Share Evaluation Findings
Texas E
794
Sat, 10:55 AM to 12:25 PM
Think Tank
Making Results Relevant: Designing Evaluations Stakeholders Will Value, Understand, and Use
Travis A
811
Sat, 10:55 AM to 12:25 PM
Multipaper
Evaluators Thinking Evaluatively About Use: Tips for the Trade
Texas E
851
Sat, 1:45 PM to 2:30 PM
MultiPaper
Deeper Implementation of the Student Success Learning to Eighteen Strategy Through Developmental Evaluation
Texas E
891
Sat, 2:50 PM to 4:20 PM
Panel
Thinking Outside the Evaluation Report Box: Transforming Evaluation Results Into a Structural Change Grantmaking Toolkit
Texas E
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 225
Index of Sessions for the Extension Education Evaluation TIG
#
Time
Session Type
Session Title
Room Name
128
Wed, 4:30 PM to 6:00 PM
Panel
Standards of Evidence for Evaluating Extension Programs: A Changing Picture?
Crockett A
274
Thu, 10:55 AM to 12:25 PM
Panel
The Role of Evaluation During Tough Fiscal Times: Sage Advice From Evaluation Leaders
Crockett A
354
Thu, 3:35 PM to 4:20 PM
Think Tank
Thinking Again About Concept Mapping
Crockett A
394
Thu, 4:30 PM to 6:00 PM
Multipaper
Evaluation Methodology
Crockett A
434
Thu, 6:10 PM to 7:00 PM
Business Meeting
Extension Education Evaluation TIG Business Meeting
Crockett A
534
Fri, 9:15 AM to 10:45 AM
Multipaper
Evaluation and Program Quality
Crockett A
612
Fri, 1:40 PM to 3:10 PM
Multipaper
Extension Educators and Evaluation
Crockett A
652
Fri, 3:35 PM to 4:20 PM
Demonstration
Program Evaluation Network: Capacity and Creativity for Multi-Site Program Evaluation
Crockett A
692
Fri, 4:30 PM to 6:00 PM
MultiPaper
Building Capacity for the 4-H Science, Engineering, and Technology Initiative to Get to Outcomes
Crockett A
733
Sat, 8:00 AM to 9:30 AM
Demonstration
Mapping Extension‘s Networks: Using Social Network Analysis to Explore Extension Outreach
Crockett A
773
Sat, 10:00 AM to 10:45 AM
MultiPaper
Supporting Evaluation Capacity Building Within the Cooperative Extension System to Impact the Lives of Children, Youth and Families… Crockett A
813
Sat, 10:55 AM to 12:25 PM
Skill-building
Evaluating Advocacy Efforts in Cooperative Extension and Other Outreach Organizations
Crockett A
853
Sat, 1:45 PM to 2:30 PM
MultiPaper
Using Observational Assessments to Measure and Improve Youth Program Quality
Crockett A
873
Sat, 2:50 PM to 4:20 PM
Roundtable
Rotation I: The Unfocused Focus Group: Evaluation Benefit or Bane?
Rotation II: eXtension Evaluation Community of Practice (CoP) Grows Up
San Jacinto
Index of Sessions for the Feminist Issues in Evaluation TIG
#
Time
Session Type
Session Title
Room Name
318
Thu, 1:40 PM to 3:10 PM
Panel
Gender and Human Rights Evaluation
Seguin B
553
Fri, 10:55 AM to 11:40 AM
Roundtable
Incorporating Gender into Mainstream Projects
Goliad
696
Fri, 4:30 PM to 6:00 PM
Multipaper
Theorectical Issues in Feminist Evaluation
Seguin B
821
Sat, 12:35 PM to 1:30 PM
Business Meeting
Feminist Issues in Evaluation TIG Business Meeting
Goliad
897
Sat, 2:50 PM to 4:20 PM
Multipaper
Feminist Evaluation and Gender-Specific Programs
Seguin B
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 226
Index of Sessions for the Government Evaluation TIG
#
Time
Session Type
Session Title
Room Name
113
Wed, 4:30 PM to 6:00 PM
Roundtable
Rotation I: A Conceptual Framework to Assess the Sustainability of Community Coalitions Post-Federal Funding
Rotation II: Using Community Partnerships to Reach Hard-to-Reach Populations in Health- Related Evaluations
Goliad
131
Wed, 4:30 PM to 6:00 PM
MultiPaper
Informing Government Policy Through Evaluation: A Cross-site Evaluation of the Self-Employment Initiative (Start-Up USA)
Crockett D
228
Thu, 9:15 AM to 10:45 AM
Panel
Methodological Choices in Assessing the Quality and Strength of Evidence on Effectiveness
Texas A
237
Thu, 9:15 AM to 10:45 AM
Multipaper
Evaluation and Quality: Examples From Government
Crockett D
268
Thu, 10:55 AM to 12:25 PM
Multipaper
International Approaches to Government Evaluation
Texas A
277
Thu, 10:55 AM to 12:25 PM
MultiPaper
NASA Office of Education‘s Portfolio Evaluation Approach: Focus on Questions That Provide High Value Answers
Crockett D
308
Thu, 1:40 PM to 3:10 PM
Panel
Tips From the Trenches: The Role of the Evaluator in Designing a Quality Evaluation
Texas A
317
Thu, 1:40 PM to 3:10 PM
MultiPaper
Towards an Understanding of the Role of the Local Evaluator in Federally Funded Demonstration Projects: The Perspectives of Federal… Crockett D
348
Thu, 3:35 PM to 4:20 PM
MultiPaper
Strategies for Evaluation Quality in Government
Texas A
388
Thu, 4:30 PM to 6:00 PM
Business Meeting
TIG Business Meeting and Panel: Happy Anniversary to Us! Celebrating Twenty Years of Government Evaluation
Texas A
528
Fri, 9:15 AM to 10:45 AM
Skill-building
The Weakest Link: Does Good Evaluation Lead to Good Decisions? How to Assess Your Organization
Texas A
537
Fri, 9:15 AM to 10:45 AM
Panel
Assessing the Health of and Improving the Evaluation Function Across the Government of Canada Through MAF
Crockett D
542
Fri, 10:55 AM to 11:40 AM
Expert Lecture
President Obama's Evaluation Policies
Lone Star A
615
Fri, 1:40 PM to 3:10 PM
Panel
Perspectives on Conducting Quality Evaluations at Various Levels of Government
Crockett D
633
Fri, 3:35 PM to 4:20 PM
Roundtable
Celebrating Government Evaluation: Forging Links Among Research, Policy Decisions, and Evaluation to Protect Our Nation's Air…
Goliad
651
Fri, 3:35 PM to 4:20 PM
Expert Lecture
Introduction to Evaluation and Public Policy
Texas F
655
Fri, 3:35 PM to 4:20 PM
Expert Lecture
A Theory Driven Multi-year Strategic Evaluation Plan for a Multi-program Government Agency
Crockett D
695
Fri, 4:30 PM to 6:00 PM
Multipaper
Collaboration in Government-Sponsored Evaluations
Crockett D
727
Sat, 8:00 AM to 9:30 AM
Panel
Use of Evaluation: Overcoming the Challenges
Texas A
736
Sat, 8:00 AM to 9:30 AM
Panel
Infusing Evaluation Theory Into Practice in Government Safety Programs: Process Examples From the US DOT
Crockett D
759
Sat, 10:00 AM to 10:45 AM
Demonstration
Guidelines for Independent Consultants/Evaluators Working With Universities: Complying With Federal Funding Source…
Presidio A
767
Sat, 10:00 AM to 10:45 AM
Panel
Demonstrating Results for Federally Funded Programs
Texas A
772
Sat, 10:00 AM to 10:45 AM
Expert Lecture
Quality Evaluation: Drivers and Objectives of the Renewed Canadian Federal Policy on Evaluation
Texas F
776
Sat, 10:00 AM to 10:45 AM
MultiPaper
Evaluation Challenges in Designing and Implementing a Program Evaluation: The Experience of the CDC‘s Colorectal Cancer Control… Crockett D
807
Sat, 10:55 AM to 12:25 PM
MultiPaper
Conceptualizing and Conducting Quality Peer Reviewed Portfolio Evaluations: Approaches and Lessons Learned From the CDC
Texas A
847
Sat, 1:45 PM to 2:30 PM
Think Tank
The Use of Program Progress Reports in Federal Government Program Evaluations
Texas A
856
Sat, 1:45 PM to 2:30 PM
Multipaper
Evaluating Government-Sponsored Education Programs
Crockett D
887
Sat, 2:50 PM to 4:20 PM
MultiPaper
Straw, Bricks, Construction: Improving Quality of Education Data, Performance Measures, and Evaluation to Enhance Student…
Texas A
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 227
Index of Sessions for the Graduate Student and New Evaluator TIG
#
Time
Session Type
Session Title
Room Name
130
Wed, 4:30 PM to 6:00 PM
Skill-building
Networking and Getting Involved With the American Evaluation Association
Crockett C
208
Thu, 9:15 AM to 10:45 AM
Roundtable
Rotation I: Truth, Beauty, And Justice For All: A Conversation With Graduate Students Examining Issues of Power, Control…
Rotation II: The Role of Evaluation and Research Support in Ensuring Evaluation Quality
Mission A
248
Thu, 10:55 AM to 12:25 PM
Roundtable
Rotation I: Grad Students on Grad Students: Evaluating Peers in a Professional Context
Rotation II: A Student-Generated Collaborative Approach to Developing New Evaluator Competencies
Mission A
329
Thu, 3:35 PM to 4:20 PM
Skill-building
Quality Evaluation Includes Everyone! Using Universal Design to Make Your Evaluation More Accessible
Mission B
358
Thu, 3:35 PM to 4:20 PM
Business Meeting
Graduate Student and New Evaluators TIG Business Meeting
Seguin B
398
Thu, 4:30 PM to 6:00 PM
Multipaper
Student Centered Issues in Evaluation
Seguin B
571
Fri, 10:55 AM to 11:40 AM
Demonstration
Using R for Statistical Analysis
Texas F
656
Fri, 3:35 PM to 4:20 PM
Multipaper
Advancing the Field of Evaluation
Seguin B
673
Fri, 4:30 PM to 6:00 PM
Roundtable
Rotation I: My First Year as an Internal Evaluator: What I Didn't Know That I Didn't Know
Rotation II: Evaluator/ Practitioner Collaborations
Goliad
737
Sat, 8:00 AM to 9:30 AM
Panel
Emerging Evaluators and the Future of Culturally Responsive Evaluation
Seguin B
817
Sat, 10:55 AM to 12:25 PM
Panel
Reflections of Emerging Professionals: The Culturally Responsive Path Ahead
Seguin B
872
Sat, 2:50 PM to 4:20 PM
Roundtable
Rotation I: The Mentor/Mentee Relationship: Perspectives and Suggestions for Maintaining Successful Relationships
Rotation II: Evaluating A Rite of Passage Program as a Vehicle for Systemic Change in At-Risk Female Youths Attitudes and Beliefs
Goliad
892
Sat, 2:50 PM to 4:20 PM
Skill-building
How to Write an Evaluation Plan
Texas F
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 228
Index of Sessions for the Health Evaluation TIG
#
Time
Session Type
Session Title
Room Name
113
Wed, 4:30 PM to 6:00 PM
Roundtable
Goliad
118
Wed, 4:30 PM to 6:00 PM
MultiPaper
Rotation I: A Conceptual Framework to Assess the Sustainability of Community Coalitions Post-Federal Funding
Rotation II: Using Community Partnerships to Reach Hard-to-Reach Populations in Health- Related Evaluations
Emerging Strategies and Tools for Evaluating Environmental and Policy Change Approaches to Chronic Disease Prevention
133
Wed, 4:30 PM to 6:00 PM
Panel
Evaluation of the Clinical and Translational Science Awards (CTSA) Programs: A Focus on Quality
Republic B
239
Thu, 9:15 AM to 10:45 AM
Think Tank
Evaluating Health Program Sustainability: Improving the Quality of Methods and Measures
Republic B
279
Thu, 10:55 AM to 12:25 PM
Panel
Keep an Eye on the Basics: The Importance of Evaluating Public Health Program Infrastructure
Republic B
293
Thu, 1:40 PM to 3:10 PM
Roundtable
Measuring Communication Campaign Intermediate Outcomes: Tools and Techniques
Goliad
301
Thu, 1:40 PM to 3:10 PM
Multipaper
Improving Medical and Prevention Services Through Continuous Evaluation and Organizational Learning
Presidio B
312
Thu, 1:40 PM to 3:10 PM
Panel
The Cycle of Evidence-based Policy and Practice: Synthesis, Translation, and Evaluation Capacity Building
Texas E
320
Thu, 1:40 PM to 3:10 PM
Multipaper
Improving School-Based Health Through Campus Centers, Nursing, and Effective Interventions
Republic B
338
Thu, 3:35 PM to 4:20 PM
Demonstration
Environmental Scans Using State Legislative Databases for Health Policy Research
Travis D
360
Thu, 3:35 PM to 4:20 PM
Panel
Improving the Design, Methods, and Data Quality of a Public Health Outcome Monitoring Project
Republic B
378
Thu, 4:30 PM to 6:00 PM
MultiPaper
Health Indicator Systems for Evaluation of Local, State, and National Chronic Disease Prevention and Control Initiatives
Travis D
400
Thu, 4:30 PM to 6:00 PM
Business Meeting
TIG Business Meeting and Presentation: Bridging the Evidence Gap in Obesity Prevention - A Framework to Inform Decision Making
Republic B
523
Fri, 9:15 AM to 10:45 AM
Roundtable
Towards Translational Process Evaluation: Implementation, Fidelity, Integration, and Sustainability – A Roundtable Discussion
Bonham A
540
Fri, 9:15 AM to 10:45 AM
Skill-building
Tools for Aligning National-Level and Local-Level Evaluations: Helping Grantees Evaluate Their Public Health Interventions
Republic B
558
Fri, 10:55 AM to 11:40 AM
Expert Lecture
Is Quality Improvement In Healthcare Cost-Effective?
Travis D
578
Fri, 10:55 AM to 11:40 AM
Demonstration
Online Visual System for Strategic Planning and Performance Monitoring: iProgress √ Check
Republic B
592
Fri, 1:40 PM to 3:10 PM
Multipaper
Health Matters: Evaluating Advocacy and Policy Change
Bowie C
609
Fri, 1:40 PM to 3:10 PM
MultiPaper
Report on a Test of a General Method for Quick Evaluation of Medical Research by Morbidity
Texas D
618
Fri, 1:40 PM to 3:10 PM
Multipaper
Examining Heart Disease and Stroke: Sharing Lessons to Improve Evaluation Quality
Republic B
638
Fri, 3:35 PM to 4:20 PM
Demonstration
Is Your Program Sustainable? A Practical Tool for Evaluating Sustainability
Travis D
658
Fri, 3:35 PM to 4:20 PM
Multipaper
Health Care Delivery, Effectiveness, and Reform: Where to Go From Here?
Republic B
678
Fri, 4:30 PM to 6:00 PM
Multipaper
Working Together and Getting the Message Heard in Teen Pregnancy Prevention Programs
Travis D
698
Fri, 4:30 PM to 6:00 PM
Multipaper
Improving Evaluations of Nutrition, Physical Activity, and Obesity Programs Through Schools, Providers, and Statewide Efforts
Republic B
717
Sat, 8:00 AM to 9:30 AM
Panel
Moving Towards Improving the Quality of Our Evaluations: Approaches and Lessons Learned From Comprehensive Cancer Control…
Travis D
720
Sat, 8:00 AM to 9:30 AM
Panel
Measuring Evaluation Capacity to Enhance Quality of ECB Activities in Federal Public Health and Systemic Change Programs
Presidio B
739
Sat, 8:00 AM to 9:30 AM
MultiPaper
National Evaluation of Team Science in the Interdisciplinary Research Consortium Program
Republic B
779
Sat, 10:00 AM to 10:45 AM
Multipaper
Healthy Aging and Health Screenings: Lessons Learned Through Participatory Evaluations
Republic B
797
Sat, 10:55 AM to 12:25 PM
Multipaper
Strategies and Tools to Evaluate the Comprehensive Picture of Health Policy
Travis D
819
Sat, 10:55 AM to 12:25 PM
Panel
Operational Research and Monitoring and Evaluation: Can We Forge a Partnership?
Republic B
859
Sat, 1:45 PM to 2:30 PM
Multipaper
Successess and Lessons Learned From Evaluations of Long-Term HIV/AIDS Programs
Republic B
899
Sat, 2:50 PM to 4:20 PM
MultiPaper
Policy Evaluation and Public Health: Multifaceted Approaches and Examples From the Field
Republic B
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Travis D
Page 229
Index of Sessions for the Human Services Evaluation TIG
#
Time
Session Type
Session Title
Room Name
119
Wed, 4:30 PM to 6:00 PM
MultiPaper
Are Universal School-based Prevention Programs Effective? It Depends on the Students and Outcomes Targeted
Independence
219
Thu, 9:15 AM to 10:45 AM
MultiPaper
Mixed-Method Evaluation in Human Services Settings
Independence
259
Thu, 10:55 AM to 12:25 PM
Multipaper
Implementing Quality Randomized Control Trials in Human Service Evaluations: Applications Addressing Challenges and Barriers
Independence
299
Thu, 1:40 PM to 3:10 PM
Panel
Use of Fidelity Scores in Measuring Outcomes for Children Involved in the Child Welfare System
Independence
379
Thu, 4:30 PM to 6:00 PM
Panel
Quality by Design: Statewide Human Services Workforce Evaluation Using an Integrated Framework
Independence
419
Thu, 6:10 PM to 7:00 PM
Business Meeting
Human Services Evaluation TIG Business Meeting
Independence
508
Fri, 9:15 AM to 10:45 AM
Roundtable
Making Decisions About Program Continuation: A Step-by-Step Process
Mission A
519
Fri, 9:15 AM to 10:45 AM
Multipaper
Challenges and Solutions in Implementing and Conducting Quality Evaluations on Children, Youth, and Families
Independence
550
Fri, 10:55 AM to 11:40 AM
Panel
The Adaptive Action Cycle: Bridging the Gap Between Lessons Learned and Lessons Applied
Bowie A
599
Fri, 1:40 PM to 3:10 PM
Multipaper
Interesting Evaluations in Social Services and Welfare
Independence
679
708
Fri, 4:30 PM to 6:00 PM
Sat, 8:00 AM to 9:30 AM
Think Tank
Roundtable
718
Sat, 8:00 AM to 9:30 AM
Panel
Beyond Fidelity: Evaluating the Implementation of Evidence-based Practices
Independence
Rotation I: Measuring Success: Applying Short-Term Indicators to Measure Long-Term Success in Human Capital Investment Programs Mission A
Rotation II: How to Maintain Evaluation Quality in a Changing Environment: The Importance of Mixed Methods
Using Geographic Information Systems (GIS) to Enhance the Quality and Validity of Evaluations in Human Services
Independence
798
Sat, 10:55 AM to 12:25 PM
Multipaper
Mixed Methods and Multiple Measures in Quality Human Services Evaluation: Lessons Learned
Independence
830
Sat, 1:45 PM to 2:30 PM
Panel
BUILD-ing an Institute for Child Success: The Statewide Systems Design for the South Carolina Institute for Child Success
Bowie A
878
Sat, 2:50 PM to 4:20 PM
Panel
Community-Derived Research Partnerships: Working Together to Improve Human Services
Independence
Index of Sessions for the Independent Consulting TIG
#
Time
Session Type
Session Title
Room Name
223
Thu, 9:15 AM to 10:45 AM
Roundtable
Bonham A
290
Thu, 1:40 PM to 3:10 PM
Panel
Rotation I: Learning About Educational Reform From a Seven-Year Math-Science Partnership
Rotation II: When Quality and Policy Collide in Evaluating Math-Science Partnership Programs: Strategies for Resolution
The Fight for Evaluation Quality: Perspectives From the Trenches
330
Thu, 3:35 PM to 4:20 PM
Demonstration
Marketing the Online You: Developing and Maintaining a Professional Online Presence
Bowie A
370
Thu, 4:30 PM to 6:00 PM
Business Meeting
Independent Consulting TIG Business Meeting
Bowie A
510
Fri, 9:15 AM to 10:45 AM
Think Tank
Enhancing the Quality of Evaluation Design, Data Collection, and Reports Through Peer Review
Bowie A
590
Fri, 1:40 PM to 3:10 PM
Panel
Integrating Management Consulting Competencies into the Evaluation Process
Bowie A
670
Fri, 4:30 PM to 6:00 PM
MultiPaper
Evaluation Opportunities Within a National Science Foundation (NSF) Program
Bowie A
748
Sat, 10:00 AM to 10:45 AM
Roundtable
Translating Findings Into Client Action
Mission A
750
Sat, 10:00 AM to 10:45 AM
Skill-building
Evaluations of Community Nonprofits and New Organizations or Developing Programs: Lessons From the Field
Bowie A
759
Sat, 10:00 AM to 10:45 AM
Demonstration
Guidelines for Independent Consultants/Evaluators Working With Universities: Complying With Federal Funding Source…
Presidio A
839
Sat, 1:45 PM to 2:30 PM
Multipaper
Overcoming the Limitations of the Educational Context to Increase Rigor
Presidio A
870
Sat, 2:50 PM to 4:20 PM
MultiPaper
Ensuring Quality in Our Work: Techniques Used by Independent Consultants
Bowie A
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Bowie A
Page 230
Index of Sessions for the Indigenous Peoples in Evaluation TIG
#
Time
Session Type
Session Title
Room Name
103
Wed, 4:30 PM to 6:00 PM
Skill-building
Waawiyeyaa (Circular) Evaluation Tool
Lone Star B
252
Thu, 10:55 AM to 12:25 PM
Multipaper
Culturally Responsive Evaluation: Three Cases From Aboriginal Peoples and First Nations in Canada
Bowie C
307
Thu, 1:40 PM to 3:10 PM
Panel
Grappling With Uncertainty in Innovative and Complex Settings: Weaving Quality in Developmental Evaluation
Bonham E
372
Thu, 4:30 PM to 6:00 PM
Business Meeting
Indigenous Peoples in Evaluation TIG Business Meeting
Bowie C
574
Fri, 10:55 AM to 11:40 AM
Multipaper
Translating Evaluation to Enhance Its Meaning and Use: Examples From Two Indigenous Communities - Urban USA and Rural Uganda Crockett C
654
Fri, 3:35 PM to 4:20 PM
Multipaper
Understanding Indigenous Higher Education Expenses: Innovative Evaluations From New Zealand and Hawaii
Crockett C
731
Sat, 8:00 AM to 9:30 AM
Demonstration
Strategies for Developing Evaluation Capacity in Educational Partnerships
Texas E
791
Sat, 10:55 AM to 12:25 PM
Demonstration
The REWA System of Transformative Evaluation: Founded on Pono (Truth), Ahua (Beauty) and Tika (Justice)- Evaluating Health…
Bowie C
Index of Sessions for the Integrating Technology Into Evaluation TIG
#
Time
Session Type
Session Title
Room Name
116
214
Wed, 4:30 PM to 6:00 PM
Thu, 9:15 AM to 10:45 AM
Multipaper
Roundtable
Travis B
San Jacinto
256
Thu, 10:55 AM to 12:25 PM
Multipaper
Viabilities of Technologies in Evaluation Research
Rotation I: Using Technology for Efficiency in Evaluation
Rotation II: Integrating Website Use Analytics into a Mixed Method Evaluation of a Professional Development Website
Visualizing Data for Strategic Planning
296
Thu, 1:40 PM to 3:10 PM
Multipaper
Contribution of Technology to Evaluation Practice
Travis B
336
Thu, 3:35 PM to 4:20 PM
Demonstration
From Game Shows, to Universities, to Cooperative Extension: The Benefits, Challenges, and Logistics of Using an Audience Response… Travis B
416
Thu, 6:10 PM to 7:00 PM
Business Meeting
Integrating Technology Into Evaluation TIG Business Meeting
Travis B
596
Fri, 1:40 PM to 3:10 PM
Demonstration
Multimedia Advances in Evaluation: The Use of Skype, Elluminate, and Virtual World Technologies in Conducting Focus Group…
Travis B
636
Fri, 3:35 PM to 4:20 PM
Panel
Using New Technologies to Support Evaluation Quality and Organizational Learning
Travis B
650
Fri, 3:35 PM to 4:20 PM
Demonstration
Moving Beyond the Weighty Tome: New Approaches to Reporting Evaluation Findings
Texas E
715
Sat, 8:00 AM to 9:30 AM
Demonstration
Fewer Errors and Faster Results: How to Automate Production of Tables and Reports with Software You Already Own
Travis B
755
Sat, 10:00 AM to 10:45 AM
Demonstration
Data Dashboard Design for Quality Monitoring and Decision Making
Travis B
771
Sat, 10:00 AM to 10:45 AM
Demonstration
Effectively Communicating Evaluation Results: Creative, Innovative, and Technological Ways to Share Evaluation Findings
Texas E
795
Sat, 10:55 AM to 12:25 PM
Demonstration
An Integrated Web-based Assessment, Planning, and Evaluation System for Strengthening Families Programs Across the Nation
Travis B
835
Sat, 1:45 PM to 2:30 PM
Skill-building
Data Management: How Not to Lose Face
Travis B
Travis B
Index of Sessions for the Internal Evaluation TIG
#
Time
Session Type
Session Title
247
Thu, 10:55 AM to 12:25 PM
Business Meeting
Internal Evaluation TIG Business Meeting and Presentation: A Decade of Internal Evaluation in One School District - How Times Change Lone Star F
512
713
Fri, 9:15 AM to 10:45 AM
Sat, 8:00 AM to 9:30 AM
Multipaper
Roundtable
837
Sat, 1:45 PM to 2:30 PM
Multipaper
Improving Quality of Programs and Evaluation: Examples From the Field
Rotation I: Internal Evaluation: How to Keep the Fox Out of the Hen House
Rotation II: The Internal Evaluator's Dual Role as Project Manager and Evaluator: Lessons in Maintaining Evaluation Quality
Internal Evaluators: Contextual Considerations and Roles
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Room Name
Bowie C
San Jacinto
Travis D
Page 231
Index of Sessions for the International and Cross-cultural Evaluation TIG
#
Time
Session Type
Session Title
Room Name
132
Wed, 4:30 PM to 6:00 PM
Multipaper
Evaluation and the Complexities of International Financial Assistance Programs
Republic A
236
Thu, 9:15 AM to 10:45 AM
Think Tank
Assessing Impacts in Real World Evaluations: Alternatives to the Conventional Statistical Counterfactual
Crockett C
238
Thu, 9:15 AM to 10:45 AM
Multipaper
Navigating the Intricacies of Culture and Context in International Program Evaluation
Republic A
276
Thu, 10:55 AM to 12:25 PM
Panel
National Evaluation Capacity Development
Crockett C
278
Thu, 10:55 AM to 12:25 PM
Multipaper
Evaluating Education, Health Education and Agriculture Education Around the Globe
Republic A
294
Thu, 1:40 PM to 3:10 PM
Roundtable
Rotation I: Assessing Principals' Needs for Professional Development
Rotation II: Reflection on an Instrument for Capturing School Conditions in Developing Countries
San Jacinto
316
Thu, 1:40 PM to 3:10 PM
Panel
Evaluating Support to Poverty and Gender in Cross Country Aid Programs
Crockett C
319
Thu, 1:40 PM to 3:10 PM
Panel
Reflections From Applying a Complexity Lens to Monitoring and Evaluation
Republic A
359
Thu, 3:35 PM to 4:20 PM
Expert Lecture
Julia Child and Richard Feynman: An Oblique Approach to Evaluation Quality
Republic A
396
Thu, 4:30 PM to 6:00 PM
Demonstration
Improving the Quality of Peacebuilding Evaluation
Crockett C
399
Thu, 4:30 PM to 6:00 PM
Panel
Impact Evaluation at the Millennium Challenge Corporation (MCC): Theory, Application, and Complications
Republic A
439
Thu, 6:10 PM to 7:00 PM
Business Meeting
International and Cross-cultural TIG Business Meeting
Republic A
514
Fri, 9:15 AM to 10:45 AM
Roundtable
Rotation I: Exploring Evaluation Quality in International Development Evaluation: An Examination of How International Development… San Jacinto
Rotation II: Practices for Working With and Building Capacity of Local Evaluation Consultants in International Development
536
Fri, 9:15 AM to 10:45 AM
Panel
Evaluation Within Contested Spaces
Crockett C
539
Fri, 9:15 AM to 10:45 AM
Panel
Complementary Approaches to Evaluating Social Safety Nets at the World Bank
Republic A
577
Fri, 10:55 AM to 11:40 AM
Demonstration
Peace Corps‘ Volunteer Reporting Tool: Increasing the Capacity for Evidence-based Decision-Making at Multiple Levels of the Peace… Republic A
614
Fri, 1:40 PM to 3:10 PM
MultiPaper
Impact of Social and Economic Development Interventions: Presentation of Synthetic Reviews of Education, Early Childhood…
617
Fri, 1:40 PM to 3:10 PM
Panel
Building Capacity to Monitor and Evaluate Development Policies, Programs, and Projects: Everyone Wants to do It, but How Should It… Republic A
657
Fri, 3:35 PM to 4:20 PM
Multipaper
Evaluation Capacity Building in International Contexts
Republic A
694
Fri, 4:30 PM to 6:00 PM
Skill-building
Data Collection Instruments for Quality Evaluation
Crockett C
697
Fri, 4:30 PM to 6:00 PM
Multipaper
Export and Translation: Evaluating the Sharing of People, Programs, and Instruments Across Borders
Republic A
712
Sat, 8:00 AM to 9:30 AM
Roundtable
Rotation I: Improving Methods of Inquiry in Evaluation Practice: Issues and Recommendations to Incorporate Diverse Views…
Goliad
Rotation II: Investing in Long Term Capacity Building Initiatives for African-based Graduates and Professionals Involved or Interested…
735
Sat, 8:00 AM to 9:30 AM
Panel
The Role of Monitoring in Evaluation Quality
Crockett C
738
778
Sat, 8:00 AM to 9:30 AM
Sat, 10:00 AM to 10:45 AM
Multipaper
Demonstration
Impact Evaluation and Beyond: Methodological and Cultural Considerations in Measuring What Works
Simulation Model of Evaluation Biases Under Post Conflict Zones
Republic A
Republic A
815
Sat, 10:55 AM to 12:25 PM
Think Tank
Quality and International Evaluation
Crockett C
858
Sat, 1:45 PM to 2:30 PM
MultiPaper
Evaluating Peace Building and Conflict Prevention in Fragile States
Republic A
898
Sat, 2:50 PM to 4:20 PM
Multipaper
Case Studies in International M&E
Republic A
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Crockett C
Page 232
Index of Sessions for the Lesbian, Gay, Bisexual, Transgender Issues TIG
#
Time
Session Type
Session Title
Room Name
260
Thu, 10:55 AM to 12:25 PM
Multipaper
Including Everyone: Lesbian, Gay, Bisexual, Transgender, People of Color, and Double Winners
Presidio A
339
Thu, 3:35 PM to 4:20 PM
MultiPaper
Including Sexual Orientation Information in an Evaluation: When, Why, and How?
Independence
420
Thu, 6:10 PM to 7:00 PM
Business Meeting
Lesbian, Gay, Bisexual and Transgender Issues TIG Business Meeting
Presidio A
517
Fri, 9:15 AM to 10:45 AM
MultiPaper
Evaluation of Efforts to Create Safer Environments for Lesbian, Gay, Bisexual, and Transgender (LGBT) Youth
Travis C
559
Fri, 10:55 AM to 11:40 AM
Multipaper
None of the Above: Expanding Binary Categorizations
Independence
628
Fri, 3:35 PM to 4:20 PM
Roundtable
Improving the Quality of Evaluations That Include Lesbian, Gay, Bisexual and Transgender People (LGBT): Tools for the Evaluator?
Mission A
639
Fri, 3:35 PM to 4:20 PM
Panel
Nerd Activism: Using Data as the Vehicle for Community Mobilization
Independence
868
Sat, 2:50 PM to 4:20 PM
Panel
Building Evaluation Capacity in Nonprofit Organizations Serving Lesbian, Gay, Bisexual and Transgender (LGBT) and HIV+ Clients
Mission A
Index of Sessions for the Mixed Methods Evaluation TIG
#
Time
Session Type
Session Title
Room Name
109
Wed, 4:30 PM to 6:00 PM
Roundtable
Rotation I: Increasing Nonprofit Sustainability Activities With Effective Request for Proposals (RFP's): A Mixed Methods Evaluation…
Rotation II: Improving the Process of Reviewing Research Proposals: Reflections of a Research Review Committee
Mission B
230
Thu, 9:15 AM to 10:45 AM
Multipaper
Dealing With Technical Challenges in Mixed Methods Evaluation
Texas C
270
Thu, 10:55 AM to 12:25 PM
Demonstration
Better Evaluation - A Toolbox of Evaluation Methods and Applications That Supports Quality and Methodological Diversity
Texas C
310
Thu, 1:40 PM to 3:10 PM
Multipaper
Using Mixed Methods to Expand Frameworks for Program Evaluation
Texas C
390
Thu, 4:30 PM to 6:00 PM
Multipaper
Examining the Mixing in Mixed Methods Evaluation
Texas C
497
Fri, 7:00 AM to 7:50 AM
Business Meeting
Mixed Methods TIG Business Meeting
Crockett A
530
Fri, 9:15 AM to 10:45 AM
MultiPaper
Ensuring High-Quality Data Processes in Evaluation: Examples From Qualitative, Quantitative and Mixed Methods Work
Texas C
668
Fri, 4:30 PM to 6:00 PM
Roundtable
Rotation I: Examining Collaboration in an Evaluation of a Large Scale Civic Education Program
Rotation II: Using Mixed Methods to Evaluate a School Based Civic Engagement Initiative
Mission A
708
Sat, 8:00 AM to 9:30 AM
Roundtable
Rotation I: Measuring Success: Applying Short-Term Indicators to Measure Long-Term Success in Human Capital Investment Programs Mission A
Rotation II: How to Maintain Evaluation Quality in a Changing Environment: The Importance of Mixed Methods
729
Sat, 8:00 AM to 9:30 AM
MultiPaper
A Mixed Methods Assessment of the Impact of Three Dropout Prevention Strategies on Student Academic Achievement in Grades 6th… Texas C
788
Sat, 10:55 AM to 12:25 PM
Roundtable
Preparing Teacher Candidates for Parent Partnerships: An Evaluation of a Preservice Course in Teacher Education
Mission A
809
Sat, 10:55 AM to 12:25 PM
Multipaper
Using Mixed Methods to Evaluate Program Implementation and Inter-agency Collaboration
Texas C
889
Sat, 2:50 PM to 4:20 PM
Multipaper
Challenges and Promises for Using Mixed Methods: Lessons From Implementing Mixed Methods Evaluation
Texas C
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 233
Index of Sessions for the Multiethnic Issues in Evaluation TIG
#
Time
Session Type
Session Title
Room Name
111
Wed, 4:30 PM to 6:00 PM
Roundtable
Maximizing Our Collective Talent: Conversations With Senior Evaluators
Bowie B
211
Thu, 9:15 AM to 10:45 AM
Think Tank
Third Annual Asa G. Hilliard III Think Tank on Culture and Evaluation
Bowie B
213
Thu, 9:15 AM to 10:45 AM
Roundtable
Rotation I: Engaging Social Justice in a Graduate Course on Program Evaluation
Rotation II: Issues of Quality: Guiding Principles for Culturally Competent Teaching and Practice
Goliad
251
Thu, 10:55 AM to 12:25 PM
Panel
Race, Class, and Power: Bringing The Issues Into Discussion and Evaluation
Bowie B
291
Thu, 1:40 PM to 3:10 PM
Multipaper
Advancing Multiethnic Program Evaluation Through Theory and Practice: An Examination of Culture, Cultural Context, and Culturally… Bowie B
331
Thu, 3:35 PM to 4:20 PM
Multipaper
Overcoming Specific Challenges to Service Delivery Within Hispanic-American Communities
Bowie B
371
Thu, 4:30 PM to 6:00 PM
Panel
Evaluation Quality From a Federal Perspective
Bowie B
411
Thu, 6:10 PM to 7:00 PM
Business Meeting
Multiethnic Issues in Evaluation TIG Business Meeting
Bowie B
511
Fri, 9:15 AM to 10:45 AM
Multipaper
Utilizing Evaluation Methods to Provide Quality Health Care Services to Underserved Populations
Bowie B
551
Fri, 10:55 AM to 11:40 AM
Multipaper
Using Evaluation to Enhance Program Participation With Underrepresented Groups in STEM Fields
Bowie B
591
Fri, 1:40 PM to 3:10 PM
Panel
The Evolution and Revolution of Culturally Responsive Evaluation
Bowie B
631
Fri, 3:35 PM to 4:20 PM
Demonstration
How Well Are We Addressing Asthma Disparities? Demonstration of a New Evaluation Toolkit
Bowie B
671
Fri, 4:30 PM to 6:00 PM
MultiPaper
Practicing Culturally Responsive Evaluation: GEDI Program Intern Reflections on the Role of Competence, Context, and Cultural…
Bowie B
716
Sat, 8:00 AM to 9:30 AM
Think Tank
Evaluating Social Change Programs: How Does a Culturally Responsive Approach Apply
Travis C
796
Sat, 10:55 AM to 12:25 PM
Demonstration
Construct Validity of Race and Its Impact on the Quality of Research and Evaluation
Travis C
876
Sat, 2:50 PM to 4:20 PM
MultiPaper
Practicing Culturally Responsive Evaluation: GEDI Program Intern Reflections on the Role of Competence, Context, and Cultural…
Travis C
Index of Sessions for the Needs Assessment TIG
#
Time
Session Type
Session Title
Room Name
117
Wed, 4:30 PM to 6:00 PM
Multipaper
Planning Programs: Allocating Scarce Resources Based on Needs Assessment
Travis C
297
Thu, 1:40 PM to 3:10 PM
Skill-building
Introduction to Designing Needs Assessment Surveys
Travis C
377
Thu, 4:30 PM to 6:00 PM
Panel
Face to Face With the Authors of the Needs Assessment Kit: Challenging Questions (With a Twist) and Hopefully Meaningful Answers
Travis C
417
Thu, 6:10 PM to 7:00 PM
Business Meeting
Needs Assessment TIG Business Meeting
Travis C
857
Sat, 1:45 PM to 2:30 PM
Multipaper
Designing Surveys for Use in Needs Assessments
Seguin B
Index of Sessions for the Non-profit and Foundations Evaluation TIG
#
Time
Session Type
Session Title
Room Name
105
Wed, 4:30 PM to 6:00 PM
Think Tank
Successful Outcome Measurement in Nonprofits: Overcoming Challenges
Lone Star D
124
Wed, 4:30 PM to 6:00 PM
Panel
The Intersection of Strategy and Evaluation: What Are We Learning?
Bonham B
205
Thu, 9:15 AM to 10:45 AM
Think Tank
Nonprofit Rating Systems and Implications for Evaluation
Lone Star D
224
Thu, 9:15 AM to 10:45 AM
Multipaper
How Did You Do It? Implementing Performance Measurement and Monitoring Systems
Bonham B
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 234
Index of Sessions for the Non-profit and Foundations Evaluation TIG, continued
#
Time
Session Type
Session Title
Room Name
239
Thu, 9:15 AM to 10:45 AM
Think Tank
Evaluating Health Program Sustainability: Improving the Quality of Methods and Measures
Republic B
245
Thu, 10:55 AM to 12:25 PM
Multipaper
Evaluating Social Service Programs for Government and Foundations
Lone Star D
257
Thu, 10:55 AM to 12:25 PM
Panel
Measuring the Immeasurable: Lessons for Building Grantee Capacity to Evaluate Hard-to-assess Efforts
Travis C
263
Thu, 10:55 AM to 12:25 PM
Roundtable
Rotation I: Evaluation as a Management and Learning Tool for the Successful Development and Scaling of Innovative Program Models Bonham A
Rotation II: Evaluating Enterprising Nonprofits: The Social Return on Investment
264
Thu, 10:55 AM to 12:25 PM
Panel
Using Evaluation to Improve the Quality of the Initial Implementation of a Statewide Community and State Level Policy and Systems… Bonham B
285
Thu, 1:40 PM to 3:10 PM
Panel
Contextual Issues in a Randomized Control Group Evaluation of a School-based Intervention: Fielding an Evidence-based…
Lone Star D
303
Thu, 1:40 PM to 3:10 PM
Roundtable
Rotation I: Small Foundations With Big Learning Agenda: A Case of Using Analysis of Past Grant Making to Support Future…
Rotation II: Challenges in Developing Multi-level Logic Models
Bonham A
304
Thu, 1:40 PM to 3:10 PM
Multipaper
Insights Into Foundation Evaluation
Bonham B
325
Thu, 3:35 PM to 4:20 PM
Multipaper
Evaluation and Nonprofits: Learning From Experience
Lone Star D
344
Thu, 3:35 PM to 4:20 PM
Multipaper
Evaluation: Understanding the Context and Managing Tensions
Bonham B
365
Thu, 4:30 PM to 6:00 PM
Business Meeting
Non-profits & Foundations Evaluation TIG Business Meeting
Lone Star D
505
Fri, 9:15 AM to 10:45 AM
Panel
Strategic Learning: An Embedded Approach for Evaluating Complex Change
Lone Star D
524
Fri, 9:15 AM to 10:45 AM
Think Tank
Aligning Priorities of Diverse Stakeholders Using Collaborative Evaluation Planning
Bonham B
545
Fri, 10:55 AM to 11:40 AM
Panel
Funder‘s Use of Network Analysis to Build Intentional Collaboration
Lone Star D
564
Fri, 10:55 AM to 11:40 AM
Panel
Low-cost, High-Quality Assessments for Nonprofit Adolescent Pregnancy Prevention Program Planning
Bonham B
585
Fri, 1:40 PM to 3:10 PM
Panel
Helping Nonprofit Agencies Move From Measuring Outcomes to Managing Them: A Budding Success Story From the United Way…
Lone Star D
604
Fri, 1:40 PM to 3:10 PM
Panel
Improving Evaluation in the Real World of Nonprofits and Foundations
Bonham B
625
Fri, 3:35 PM to 4:20 PM
Panel
Communities of Practice (CoP) as a Foundation Strategy
Lone Star D
665
Fri, 4:30 PM to 6:00 PM
Panel
Multiple Sites, Multiple Layers, Multiple Players: Lessons From the Field on Keeping Quality High and Frustration Low
Lone Star D
684
Fri, 4:30 PM to 6:00 PM
Multipaper
Making Sense of the Relationships Between Nonprofits, Funders, and Evaluation
Bonham B
690
Fri, 4:30 PM to 6:00 PM
Panel
Strategy as Evaluand: Quality and Utilization Issues in Evaluating Strategy
Texas E
705
Sat, 8:00 AM to 9:30 AM
Demonstration
Foundation Effectiveness: Aligning Impact Strategy and Evaluation
Lone Star D
723
745
Sat, 8:00 AM to 9:30 AM
Sat, 10:00 AM to 10:45 AM
Panel
Panel
Beauty is in the Eye of the Beholder: Rationalizing Evaluation Needs Amongst Foundation Boards, Staff, and the Nonprofits They Fund Bonham B
Evaluation in Foundations: The State of the Art
Lone Star D
762
Sat, 10:00 AM to 10:45 AM
Roundtable
Using Site Visits to Improve Programs
Bonham A
785
Sat, 10:55 AM to 12:25 PM
Demonstration
A Foundation-to-Foundation Partnership: What Went Right, What Took Time- A Look at the Robert Wood Johnson Foundation…
Lone Star D
803
Sat, 10:55 AM to 12:25 PM
Multipaper
Evaluating Family and Community Change
Bonham B
825
Sat, 1:45 PM to 2:30 PM
Expert Lecture
Evaluations Done Right: Paving the Way for Closing a Program
Lone Star D
883
Sat, 2:50 PM to 4:20 PM
Demonstration
2010 Report: State of Evaluation Practice and Capacity in the Nonprofit Sector
Bonham B
891
Sat, 2:50 PM to 4:20 PM
Thinking Outside the Evaluation Report Box: Transforming Evaluation Results Into a Structural Change Grantmaking Toolkit
Texas E
Panel
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 235
Index of Sessions for the Organizational Learning and Evaluation Capacity Building TIG
#
Time
Session Type
Session Title
Room Name
121
Wed, 4:30 PM to 6:00 PM
Business Meeting
TIG Business Meeting and Presentations: Advancing Quality in Evaluation Capacity Building
Presidio B
217
Thu, 9:15 AM to 10:45 AM
Demonstration
Assessing Evaluation Capacity: Using the Evaluation Capacity Diagnostic Tool
Travis C
221
Thu, 9:15 AM to 10:45 AM
Skill-building
The Power of Metaphor: Using Images for Organizational Analysis
Presidio B
261
Thu, 10:55 AM to 12:25 PM
Multipaper
Building, Enhancing, and Sustaining Evaluation Quality for Organizational Learning
Presidio B
272
Thu, 10:55 AM to 12:25 PM
Panel
Mainstreaming Evaluation in Diverse Organizational Contexts
Texas E
301
Thu, 1:40 PM to 3:10 PM
Multipaper
Improving Medical and Prevention Services Through Continuous Evaluation and Organizational Learning
Presidio B
312
Thu, 1:40 PM to 3:10 PM
Panel
The Cycle of Evidence-based Policy and Practice: Synthesis, Translation, and Evaluation Capacity Building
Texas E
337
Thu, 3:35 PM to 4:20 PM
Demonstration
CES's Professional Designation Program - How Our Members Are Applying to be Designated as a Credentialed Evaluator
Travis C
381
Thu, 4:30 PM to 6:00 PM
Panel
A Systems Approach to Building and Assessing Evaluation Plan Quality
Presidio B
521
Fri, 9:15 AM to 10:45 AM
Panel
Evaluation Capacity Building (ECB) Models, Measures, And Outcomes: Taking Stock to Forge Ahead
Presidio B
557
Fri, 10:55 AM to 11:40 AM
Multipaper
Communication: At What Level Does It Help or Hinder Evaluation Capacity?
Travis C
561
Fri, 10:55 AM to 11:40 AM
Demonstration
Herding Cats: Improving the Quality and Quantity of Decentralized Evaluation in a Global Organization Through Capacity Building
Presidio B
570
Fri, 10:55 AM to 11:40 AM
Panel
Joint Evaluation of Private Sector Development Projects: Benefits and Challenges
Texas E
601
Fri, 1:40 PM to 3:10 PM
Demonstration
Improving the Quality of Analysis, Interpretation, and Reporting of Program Outcomes Through a Measurement, Evaluation…
Presidio B
610
Fri, 1:40 PM to 3:10 PM
Think Tank
Taking a Good, Long Look In the Mirror: How Can We Hold Ourselves Accountable for Quality Recommendations?
Texas E
637
Fri, 3:35 PM to 4:20 PM
Demonstration
Creating Statewide Guidelines for Twenty First Century Community Learning Centers' Local Evaluation
Travis C
641
Fri, 3:35 PM to 4:20 PM
Multipaper
Engaging Practitioners in the Medical Field to Build Evaluation Capacity
Presidio B
677
Fri, 4:30 PM to 6:00 PM
Panel
From Compliance to Reliance: Critical Moments in Integrating Evaluation Into an Organization‘s Work
Travis C
681
Fri, 4:30 PM to 6:00 PM
Demonstration
Using the Comprehensive Organizational Assessment Tool to Diagnose and Evaluate Organizational Capacity
Presidio B
690
Fri, 4:30 PM to 6:00 PM
Panel
Strategy as Evaluand: Quality and Utilization Issues in Evaluating Strategy
Texas E
720
Sat, 8:00 AM to 9:30 AM
Panel
Measuring Evaluation Capacity to Enhance Quality of ECB Activities in Federal Public Health and Systemic Change Programs
Presidio B
731
Sat, 8:00 AM to 9:30 AM
Demonstration
Strategies for Developing Evaluation Capacity in Educational Partnerships
Texas E
756
Sat, 10:00 AM to 10:45 AM
Think Tank
Strengthening the Learning Culture Within Organizations and Projects
Travis C
757
Sat, 10:00 AM to 10:45 AM
Multipaper
Building Capacity in Community-Level Organizations
Travis D
760
Sat, 10:00 AM to 10:45 AM
Panel
Evaluation Capacity Building Through State Affiliates
Presidio B
800
Sat, 10:55 AM to 12:25 PM
MultiPaper
A Radically Different Approach to Evaluator Competencies
Presidio B
836
Sat, 1:45 PM to 2:30 PM
Panel
Quick and Quality Level Three Evaluations for Corporate Staff Learning
Travis C
840
Sat, 1:45 PM to 2:30 PM
Demonstration
Using Logic Models to Build Evaluation Capacity at the Community Level: Enhancing Program Effectiveness by Building Evaluation…
Presidio B
851
Sat, 1:45 PM to 2:30 PM
MultiPaper
Deeper Implementation of the Student Success Learning to Eighteen Strategy Through Developmental Evaluation
Texas E
880
Sat, 2:50 PM to 4:20 PM
Multipaper
Increasing Evaluation Capacity Through Different Levels of Training and Support
Presidio B
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 236
Index of Sessions for the Pre-K - 12 Educational Evaluation TIG
#
Time
Session Type
Session Title
Room Name
109
Wed, 4:30 PM to 6:00 PM
Roundtable
Rotation I: Increasing Nonprofit Sustainability Activities With Effective Request for Proposals (RFP's): A Mixed Methods Evaluation…
Rotation II: Improving the Process of Reviewing Research Proposals: Reflections of a Research Review Committee
Mission B
123
Wed, 4:30 PM to 6:00 PM
Roundtable
Rotation I: Evaluating the Effects of Year-Long Professional Development on Teachers: Final Refinement of UCLA‘s Center X…
Rotation II: Evaluation Quality in Measuring Teacher Quality: The Impact of the Targeted Assistance Coaching Model on LEA…
Bonham A
125
Wed, 4:30 PM to 6:00 PM
Panel
Managing Quality Through the Stages of Science, Technology, Engineering and Mathematics (STEM) Educational Evaluation
Bonham C
126
Wed, 4:30 PM to 6:00 PM
Multipaper
Evaluating Supplementary Programs in Educational Settings
Bonham D
223
Thu, 9:15 AM to 10:45 AM
Roundtable
Rotation I: Learning About Educational Reform From a Seven-Year Math-Science Partnership
Rotation II: When Quality and Policy Collide in Evaluating Math-Science Partnership Programs: Strategies for Resolution
Bonham A
225
Thu, 9:15 AM to 10:45 AM
Multipaper
Evaluating K-8 Literacy Programs: Methods and Models
Bonham C
226
Thu, 9:15 AM to 10:45 AM
Multipaper
Methods Leading to Higher Quality Evaluations in Education Evaluation
Bonham D
254
Thu, 10:55 AM to 12:25 PM
Roundtable
Rotation I: Choices of Research and Development (R&D) Evaluation Approaches in (CAS) Institutes: We Reap What We Sow?
Rotation II: Producing Evidence of Effectiveness Data in the Real World of Early Childhood Education
San Jacinto
265
Thu, 10:55 AM to 12:25 PM
Multipaper
Group and Cluster Randomized-Control Experimental Interventions in Educational Evaluation Studies
Bonham C
266
Thu, 10:55 AM to 12:25 PM
Panel
Integrating High Quality Evaluation Into a National Integrated Services in Schools Initiative
Bonham D
305
Thu, 1:40 PM to 3:10 PM
Multipaper
Current Topics in Educational Evaluation: An Eclectic Set of Noteworthy Projects
Bonham C
306
Thu, 1:40 PM to 3:10 PM
Multipaper
Methods and Models for Evaluating Pre-Kindergarten and School Readiness Programs
Bonham D
345
Thu, 3:35 PM to 4:20 PM
MultiPaper
Concordances: Development and Appropriate Uses
Bonham C
346
Thu, 3:35 PM to 4:20 PM
Multipaper
Building Evaluation Capacity Among School Leaders
Bonham D
385
Thu, 4:30 PM to 6:00 PM
Multipaper
Education Evaluation: Connecting Professional Development to Changes in Classroom Practice
Bonham C
386
Thu, 4:30 PM to 6:00 PM
Multipaper
Addressing Schools as Organizations in Educational Evaluation
Bonham D
496
Fri, 7:00 AM to 7:50 AM
Business Meeting
PreK-12 Educational Evaluation TIG Business Meeting
Bonham C
525
Fri, 9:15 AM to 10:45 AM
Multipaper
Evaluating Science, Technology, Engineering, and Mathematics (STEM) Initiatives in K-12 Education
Bonham C
526
Fri, 9:15 AM to 10:45 AM
Panel
Evaluating Literacy Curricula for Adolescents: Results From Three Years of Striving Readers
Bonham D
565
Fri, 10:55 AM to 11:40 AM
Expert Lecture
Is Working Together Worth It? The Process and Findings of a Longitudinal Evaluation of a Districtwide Professional Learning …
Bonham C
566
Fri, 10:55 AM to 11:40 AM
Multipaper
Evaluating Education Programs for English Language Learners
Bonham D
605
Fri, 1:40 PM to 3:10 PM
Think Tank
Teacher Effectiveness and Teacher Quality: What's the Difference?
Bonham C
606
Fri, 1:40 PM to 3:10 PM
Multipaper
Fidelity of Program Implementation in Educational Evaluations
Bonham D
643
Fri, 3:35 PM to 4:20 PM
Roundtable
The Cost of Delayed Start: Effect of Early Algebra on End of High School, Transition to College, and End-of-College STEM Participation Bonham A
645
Fri, 3:35 PM to 4:20 PM
Multipaper
Meta-reviews in Rural Education and Reading Interventions
Bonham C
646
683
Fri, 3:35 PM to 4:20 PM
Fri, 4:30 PM to 6:00 PM
MultiPaper
Roundtable
Applying Evaluation to Improve Learning Outcomes: Scaling Up From Small Schools to a Million Students
Rotation I: Evaluating K-12 Professional Development: Implementation of the SIOP Model
Rotation II: School Climate: A Comprehensive Data Collection and School Improvement System
Bonham D
Bonham A
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 237
Index of Sessions for the Pre-K - 12 Educational Evaluation TIG, continued
685
Fri, 4:30 PM to 6:00 PM
Multipaper
Current Issues in Evaluating High School Programs
Bonham C
686
Fri, 4:30 PM to 6:00 PM
MultiPaper
Improving Evaluation Quality: A Focus on Better Measures of Implementation
Bonham D
724
Sat, 8:00 AM to 9:30 AM
Skill-building
Systems and Logic Models as Complementary Tools for Educational Evaluation
Bonham C
725
Sat, 8:00 AM to 9:30 AM
Panel
Classroom Observations: Lessons Learned About Five Protocols From Five Multi-site Education Evaluations
Bonham D
731
Sat, 8:00 AM to 9:30 AM
Demonstration
Strategies for Developing Evaluation Capacity in Educational Partnerships
Texas E
749
Sat, 10:00 AM to 10:45 AM
Multipaper
Evaluation of Interventions and Assessments of Individuals With Disabilities
Mission B
764
Sat, 10:00 AM to 10:45 AM
MultiPaper
Promoting Truth and Justice: Evaluation‘s Role in Teacher Education Programs for Candidates From Underrepresented Populations
Bonham C
765
Sat, 10:00 AM to 10:45 AM
Think Tank
Evaluating Twenty-first Century Skills
Bonham D
802
Sat, 10:55 AM to 12:25 PM
Roundtable
Bonham A
804
Sat, 10:55 AM to 12:25 PM
Multipaper
Rotation I: Overcoming Data Quality Challenges to Evaluation of School-based Programs
Rotation II: Standardizing Literacy Data Analyses and Reporting Across Multiple Instruments and Grades
Practical Issues in Educational Measurement and Assessment
844
Sat, 1:45 PM to 2:30 PM
Panel
Fidelity Instruments and School Burden
Bonham C
845
Sat, 1:45 PM to 2:30 PM
Multipaper
Assessing the Use of Test Score Data to Inform Decisions About Student Achievement
Bonham D
851
Sat, 1:45 PM to 2:30 PM
MultiPaper
Deeper Implementation of the Student Success Learning to Eighteen Strategy Through Developmental Evaluation
Texas E
869
Sat, 2:50 PM to 4:20 PM
MultiPaper
Evaluating Special Education Personnel Development Initiatives in Three Predominately Rural States: Emphasis on Fidelity…
Mission B
882
Sat, 2:50 PM to 4:20 PM
Roundtable
Adaptations to Evaluation Design: Two Examples of Ensuring Quality in Practice
Bonham A
884
Sat, 2:50 PM to 4:20 PM
Multipaper
Evaluating the State of Charter Schools and Public Schools of Choice
Bonham C
887
Sat, 2:50 PM to 4:20 PM
MultiPaper
Straw, Bricks, Construction: Improving Quality of Education Data, Performance Measures, and Evaluation to Enhance Student…
Texas A
Bonham C
Index of Sessions for the Program Theory and Theory-driven Evaluation TIG
#
Time
Session Type
Session Title
Room Name
203
Thu, 9:15 AM to 10:45 AM
Panel
Implementation From the Ground Up: Defining, Promoting, and Sustaining Fidelity at All Levels of a State Program
Lone Star B
243
Thu, 10:55 AM to 12:25 PM
Multipaper
Improving the Practice of Theory-driven Evaluation: Understanding the Role of Stakeholders and Context in Evaluation Settings
Lone Star B
543
Fri, 10:55 AM to 11:40 AM
Multipaper
Examples From the Field: Using Mixed Methodological Frameworks in Theory-Driven Evaluations
Lone Star B
623
Fri, 3:35 PM to 4:20 PM
Multipaper
Using Quantitative Analyses in the Development and Testing of Theories of Change
Lone Star B
663
Fri, 4:30 PM to 6:00 PM
Panel
Systems Perspectives on Using Logic Models to Improve Evaluation Quality
Lone Star B
703
Sat, 8:00 AM to 9:30 AM
Panel
Theory of Change Online: Implications for Participatory Planning and Evaluation Using Technology
Lone Star B
742
Sat, 10:00 AM to 10:45 AM
Business Meeting
TIG Business Meeting and Panel: Improving Evaluation Quality by Improving Program Quality: A Theory-based…
Lone Star A
823
Sat, 1:45 PM to 2:30 PM
Panel
Culturally Responsive Theory-driven Evaluation: Understanding and Accurately Reflecting Cultural Contexts in Program Evaluation
Lone Star B
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 238
Index of Sessions for the Qualitative Methods TIG
#
Time
Session Type
Session Title
Room Name
269
Thu, 10:55 AM to 12:25 PM
Skill-building
Circular Dialogue and Other Dialectical Methods of Inquiry
Texas B
314
Thu, 1:40 PM to 3:10 PM
Panel
Quality in Evaluation: How Do We Know It When We See It in Qualitative Evaluations?
Crockett A
349
Thu, 3:35 PM to 4:20 PM
Demonstration
Techniques and Tools for Reporting and Communicating Evaluation Findings Using NVivo
Texas B
429
Thu, 6:10 PM to 7:00 PM
Business Meeting
Qualitative Methods TIG Business Meeting
Texas B
520
Fri, 9:15 AM to 10:45 AM
Demonstration
Does Sensemaker Make Sense? Evaluating Development Initiatives Through Narrative Capture and Tagging in Kenya and Latin America Presidio A
538
Fri, 9:15 AM to 10:45 AM
Demonstration
Assessing the Quality of Research Instruments Using Cognitive Lab Methodology: A Practical Discussion and Lessons Learned
Seguin B
576
Fri, 10:55 AM to 11:40 AM
Multipaper
Using Qualitative Methods in Evaluations With Limited Resources
Seguin B
616
Fri, 1:40 PM to 3:10 PM
Multipaper
Reaching for the Pot of Gold: Tested Techniques for Enhancing Evaluation Quality With Trustworthiness and Authenticity
Seguin B
768
Sat, 10:00 AM to 10:45 AM
Multipaper
Where Do Values Enter Into Evaluations?
Texas B
777
Sat, 10:00 AM to 10:45 AM
Multipaper
Exploring the Role of Software in Qualitative Analysis
Seguin B
832
Sat, 1:45 PM to 2:30 PM
Roundtable
Use of Implementation Rubrics as Indicators of Evaluation Quality
Goliad
888
Sat, 2:50 PM to 4:20 PM
Demonstration
Web Dialogues: A New Tool for Evaluators
Texas B
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 239
Index of Sessions for the Quantitative Methods: Theory and Design TIG
#
Time
Session Type
Session Title
Room Name
106
Wed, 4:30 PM to 6:00 PM
Panel
Place Randomized Trials and Alternatives in a Field Setting: Examples From Psychotherapy Research
Lone Star E
114
Wed, 4:30 PM to 6:00 PM
Roundtable
Rotation I: Non-response Bias a Limitation: Practical Perspectives of Evaluation Quality Using Survey and Questionnaire Data
Rotation II: Coding Open-Ended Survey Items: A Discussion of Codebook Development and Coding Procedures
San Jacinto
120
Wed, 4:30 PM to 6:00 PM
Panel
Innovative Applications of Propensity Scores and Propensity Score Methodology Adjustments to Address Data Constraints
Presidio A
206
Thu, 9:15 AM to 10:45 AM
Panel
Comparative Effectiveness Research in Program Evaluation
Lone Star E
220
Thu, 9:15 AM to 10:45 AM
Multipaper
Back to the Basics and Beyond
Presidio A
246
Thu, 10:55 AM to 12:25 PM
Business Meeting
Quantitative Methods Theory and Design TIG Business Meeting and Presentation: What is New in Multiple Comparison Procedures
Lone Star E
259
Thu, 10:55 AM to 12:25 PM
Multipaper
Implementing Quality Randomized Control Trials in Human Service Evaluations: Applications Addressing Challenges and Barriers
Independence
286
Thu, 1:40 PM to 3:10 PM
Demonstration
Estimating Rater Consistency: Which Method Is Appropriate?
Lone Star E
300
Thu, 1:40 PM to 3:10 PM
MultiPaper
Propensity Score Matching: Further Methodological Development
Presidio A
326
Thu, 3:35 PM to 4:20 PM
MultiPaper
Bayesian Mixture Modeling Versus Traditional Meta-analysis: Examining the Treatment Advantage Research Using Three…
Lone Star E
366
Thu, 4:30 PM to 6:00 PM
Demonstration
Fundamentals of Power Analysis and Sample Size Determination
Lone Star E
380
Thu, 4:30 PM to 6:00 PM
Multipaper
Assessing Change Over Time
Presidio A
506
Fri, 9:15 AM to 10:45 AM
Panel
Promoting Quality Impact Studies: Constructive, Context-Appropriate Policies for Strengthening Research Designs for Impact…
Lone Star E
546
Fri, 10:55 AM to 11:40 AM
Demonstration
Using Latent Class Analysis to Target and Tailor Programs to Specific Populations
Lone Star E
586
Fri, 1:40 PM to 3:10 PM
Panel
Enhancing the Quality of Evaluations by Rational Planning
Lone Star E
600
Fri, 1:40 PM to 3:10 PM
Multipaper
Structural Equation Modeling Solutions for Evaluators
Presidio A
626
Fri, 3:35 PM to 4:20 PM
Demonstration
Using Regression Discontinuity Designs for Program Evaluation
Lone Star E
666
Fri, 4:30 PM to 6:00 PM
Panel
The Case for Brief(er) Measures
Lone Star E
680
Fri, 4:30 PM to 6:00 PM
Demonstration
Basic Change: Examining a Simple Design From Multiple Approaches
Presidio A
706
Sat, 8:00 AM to 9:30 AM
Demonstration
Applications of Multiple Regression for Evaluators
Lone Star E
719
Sat, 8:00 AM to 9:30 AM
MultiPaper
A Practical Comparison of Longitudinal Data Analysis Methods
Presidio A
746
Sat, 10:00 AM to 10:45 AM
Expert Lecture
Ten Steps to Making Evaluations Matter: Designing Evaluations to Exert Influence
Lone Star E
786
Sat, 10:55 AM to 12:25 PM
Demonstration
Using Rasch Measurement to Strengthen Evaluation Designs and Outcomes
Lone Star E
799
Sat, 10:55 AM to 12:25 PM
Multipaper
Application of Propensity Score Analysis in Assessing Outcomes
Presidio A
826
Sat, 1:45 PM to 2:30 PM
Multipaper
A Closer Look at Non-Equivalent Designs in Evaluation
Lone Star E
838
Sat, 1:45 PM to 2:30 PM
Multipaper
Applications and Issues With Regression Discontinuity Design
Independence
866
Sat, 2:50 PM to 4:20 PM
Demonstration
What Am I Supposed to Do With Three-Way Crosstabs? An Introduction to Log Linear Models
Lone Star E
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 240
Index of Sessions for the Research on Evaluation TIG
#
Time
Session Type
Session Title
Room Name
233
Thu, 9:15 AM to 10:45 AM
Panel
New Directions for Research on Evaluation
Texas F
272
Thu, 10:55 AM to 12:25 PM
Panel
Mainstreaming Evaluation in Diverse Organizational Contexts
Texas E
353
Thu, 3:35 PM to 4:20 PM
Business Meeting
Research on Evaluation TIG Business Meeting
Texas F
393
Thu, 4:30 PM to 6:00 PM
Multipaper
Research on Evaluation Standards and Methods
Texas F
502
Fri, 9:15 AM to 10:45 AM
Panel
Equity and Quality in Evaluation: Ideas and Illustrations From the Field
Lone Star A
554
Fri, 10:55 AM to 11:40 AM
Roundtable
Utilizing Metaevaluation to Validate Evaluation Quality: Study of a Grant-Funded Graduate Program for Minority Group Students…
San Jacinto
579
Fri, 10:55 AM to 11:40 AM
Multipaper
The Basis for Good Judgment in Evaluation
Republic C
611
Fri, 1:40 PM to 3:10 PM
Panel
Snapshots of Exemplary Evaluations
Texas F
691
Fri, 4:30 PM to 6:00 PM
Multipaper
Research on Data Collection Approaches
Texas F
732
Sat, 8:00 AM to 9:30 AM
Multipaper
Studies of Evaluation Practice Across Multiple Contexts
Texas F
812
Sat, 10:55 AM to 12:25 PM
Multipaper
Research on Participatory Evaluation
Texas F
852
Sat, 1:45 PM to 2:30 PM
Multipaper
Research on Evaluator Competencies
Texas F
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 241
Index of Sessions for the Research, Technology, and Development Evaluation TIG
#
Time
Session Type
Session Title
Room Name
231
Thu, 9:15 AM to 10:45 AM
Panel
Analysis and Evaluation of Research Portfolios Using Quantitative Science Metrics: Practice
Texas D
254
Thu, 10:55 AM to 12:25 PM
Roundtable
Rotation I: Choices of Research and Development (R&D) Evaluation Approaches in (CAS) Institutes: We Reap What We Sow?
Rotation II: Producing Evidence of Effectiveness Data in the Real World of Early Childhood Education
San Jacinto
271
Thu, 10:55 AM to 12:25 PM
Panel
Analysis and Evaluation of Research Portfolios Using Quantitative Science Metrics: Theory
Texas D
311
Thu, 1:40 PM to 3:10 PM
Demonstration
Third Generation Research Knowledge Tracking: Citation Analyses
Texas D
343
Thu, 3:35 PM to 4:20 PM
Roundtable
Methodological Issues in Evaluating Potentially Transformative Research
Bonham A
387
Thu, 4:30 PM to 6:00 PM
Panel
Evaluating the Science of Discovery in Complex Health Systems: Challenges and Opportunities
Bonham E
391
Thu, 4:30 PM to 6:00 PM
Panel
Linking Professional Associations to Advance the Study of Science and Innovation Policy
Texas D
431
Thu, 6:10 PM to 7:00 PM
Business Meeting
Research, Technology and Development Evaluation TIG Business Meeting
Texas D
513
Fri, 9:15 AM to 10:45 AM
Roundtable
Rotation I: Big Money, More Scrutiny: How to Forge Evaluator-Early Childhood Education Program Partnerships in Order to Produce…
Rotation II: A Study on the Indicator of High Quality Papers: The Case of Casualty Actuarial Society (CAS)
Goliad
527
Fri, 9:15 AM to 10:45 AM
Panel
Challenges and Best Practices in Benefit Cost Studies of Research and Technology Programs
Bonham E
531
Fri, 9:15 AM to 10:45 AM
MultiPaper
Recent Developments in Research and Development Evaluation: The Academic Side
Texas D
567
Fri, 10:55 AM to 11:40 AM
Multipaper
From Research to Commercialization: Impact Evaluation of Portfolios of Research
Bonham E
569
Fri, 10:55 AM to 11:40 AM
Multipaper
Evaluating Government Research and Technology Policies: Traditional and Emerging Methods
Texas D
609
Fri, 1:40 PM to 3:10 PM
MultiPaper
Report on a Test of a General Method for Quick Evaluation of Medical Research by Morbidity
Texas D
649
Fri, 3:35 PM to 4:20 PM
Demonstration
Assessing Faculty Productivity and Institutional Research Performance: Using Publication and Citation Key Performance Indicators
Texas D
689
Fri, 4:30 PM to 6:00 PM
Think Tank
Your Input, Please: RTD TIG Draft User‘s Guide to Conducting Research and Development Evaluation
Texas D
726
Sat, 8:00 AM to 9:30 AM
Panel
Interim Evaluation: The Quality of Research and the Quality of Evaluation - Case Study of the FP7 Interim Evaluation
Bonham E
730
Sat, 8:00 AM to 9:30 AM
Panel
Metrics for NIEHS: Measuring Outcomes to Advance Partnerships for Environmental Public Health
Texas D
766
Sat, 10:00 AM to 10:45 AM
Multipaper
Systems of Evaluation for Diverse National Portfolios of Research: Lessons From Russia and Finland
Bonham E
770
Sat, 10:00 AM to 10:45 AM
Multipaper
Evaluating Contributions to Knowledge Translation for New Technologies or Medical Treatments
Texas D
810
Sat, 10:55 AM to 12:25 PM
MultiPaper
Evaluation of National Research and Development (R&D) Programs as a Tool for Increasing Efficiency of Public Finance
Texas D
850
Sat, 1:45 PM to 2:30 PM
Multipaper
Informing Portfolio Management Using Tracking Systems and Bibliometrics
Texas D
886
Sat, 2:50 PM to 4:20 PM
Multipaper
Improving Proposals and Programs by Improving Peer and Stakeholder Review
Bonham E
890
Sat, 2:50 PM to 4:20 PM
MultiPaper
Evaluation System of Research, Technology, and Development (RT&D) to Induce Innovation: Strategy, Process, and Reflection
Texas D
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 242
Index of Sessions for the Social Network Analysis TIG
#
Time
Session Type
Session Title
Room Name
295
Thu, 1:40 PM to 3:10 PM
Demonstration
Why Settle for Silos? Four Applications of Social Network Analysis for Building More Effective Organizational Networks…
Travis A
410
Thu, 6:10 PM to 7:00 PM
Business Meeting
Social Network Analysis TIG Business Meeting
Bowie A
595
Fri, 1:40 PM to 3:10 PM
Multipaper
Social Network Analysis Across Disciplines and Purposes
Travis A
675
Fri, 4:30 PM to 6:00 PM
Demonstration
How to Cast Your Net: Network Analysis Techniques in Public Health Evaluation
Travis A
775
Sat, 10:00 AM to 10:45 AM
Expert Lecture
Longitudinal Social Network Analysis: An Understanding of This Dynamic Network Approach
Crockett C
855
Sat, 1:45 PM to 2:30 PM
Expert Lecture
Reading Sociograms
Crockett C
895
Sat, 2:50 PM to 4:20 PM
Think Tank
The Network of Network Funders: Evaluating Networks and Evaluating with a Network Lens
Crockett C
Index of Sessions for the Social Work TIG
#
Time
Session Type
Session Title
Room Name
209
Thu, 9:15 AM to 10:45 AM
Multipaper
Evaluating the Intervention: A Look at Clinical Treatments and Client Implications
Mission B
333
Thu, 3:35 PM to 4:20 PM
Roundtable
Enhancing Evaluation Quality in a Developing Context: A South African Case Study
Goliad
409
Thu, 6:10 PM to 7:00 PM
Business Meeting
Social Work TIG Business Meeting and Presentation: Evaluation in Social Work Education Practice
Mission B
629
Fri, 3:35 PM to 4:20 PM
Multipaper
Program Fidelity and Development in Social Work
Mission B
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 243
Index of Sessions for the Systems in Evaluation TIG
#
Time
Session Type
Session Title
Room Name
110
Wed, 4:30 PM to 6:00 PM
Skill-building
A Tool for Designing Evaluations of Paradigm Shifts in Complex System Interventions
Bowie A
210
Thu, 9:15 AM to 10:45 AM
MultiPaper
Using a Multi-stage, Mixed Methods Approach to Improve the Design of System Change Evaluations
Bowie A
250
Thu, 10:55 AM to 12:25 PM
Think Tank
Systems Theories in Evaluation Planning: Differentiating Planning Process from Evaluation Plan
Bowie A
283
Thu, 1:40 PM to 3:10 PM
Multipaper
From Agent-Based Modeling to Cynefin: The ABC's of Systems Frameworks for Evaluation
Lone Star B
307
Thu, 1:40 PM to 3:10 PM
Panel
Grappling With Uncertainty in Innovative and Complex Settings: Weaving Quality in Developmental Evaluation
Bonham E
323
Thu, 3:35 PM to 4:20 PM
Expert Lecture
Developmental Evaluation for Complex Systems: Quality as Speed and Adaptability
Lone Star B
363
Thu, 4:30 PM to 6:00 PM
Business Meeting
Systems in Evaluation TIG Business Meeting and Presentation: Meet and Greet With Systems in Evaluation Authors
Lone Star B
381
Thu, 4:30 PM to 6:00 PM
Panel
A Systems Approach to Building and Assessing Evaluation Plan Quality
Presidio B
503
Fri, 9:15 AM to 10:45 AM
Think Tank
Model Forms, Program Theory, And Unexpected Behavior: What Are the Implications For Program Implementation and Evaluation?
Lone Star B
520
Fri, 9:15 AM to 10:45 AM
Demonstration
Does Sensemaker Make Sense? Evaluating Development Initiatives Through Narrative Capture and Tagging in Kenya and Latin America Presidio A
550
Fri, 10:55 AM to 11:40 AM
Panel
The Adaptive Action Cycle: Bridging the Gap Between Lessons Learned and Lessons Applied
Bowie A
583
Fri, 1:40 PM to 3:10 PM
Skill-building
Fitting the Key to the Lock: Matching Systems Methods To Evaluation Questions
Lone Star B
597
Fri, 1:40 PM to 3:10 PM
Multipaper
Real World Applications of System Concepts in Evaluation
Travis C
630
Fri, 3:35 PM to 4:20 PM
MultiPaper
The Role of Collaboratives in Promoting Community and Systems Changes
Bowie A
663
Fri, 4:30 PM to 6:00 PM
Panel
Systems Perspectives on Using Logic Models to Improve Evaluation Quality
Lone Star B
710
Sat, 8:00 AM to 9:30 AM
MultiPaper
Framework for Orchestrating Systems Transformation: Theory and Practice for Promoting Dynamic Systems Change
Bowie A
743
Sat, 10:00 AM to 10:45 AM
Demonstration
Expanding Evaluation‘s Utility and Quality Through System-Oriented Data Synthesis
Lone Star B
790
Sat, 10:55 AM to 12:25 PM
MultiPaper
The Home Energy Audit: An Exercise in Complex Systems Thinking for Practitioners and Evaluators Alike
Bowie A
830
Sat, 1:45 PM to 2:30 PM
Panel
BUILD-ing an Institute for Child Success: The Statewide Systems Design for the South Carolina Institute for Child Success
Bowie A
863
Sat, 2:50 PM to 4:20 PM
Think Tank
Integrating Evaluation Into Everyday Organizational Practice: A Complex Systems Perspective
Lone Star B
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Page 244
Index of Sessions for the Teaching of Evaluation TIG
#
Time
Session Type
Session Title
Room Name
129
Wed, 4:30 PM to 6:00 PM
Demonstration
Using an Interest-Driven Project to Teach Program Planning and Evaluation
Crockett B
213
Thu, 9:15 AM to 10:45 AM
Roundtable
Rotation I: Engaging Social Justice in a Graduate Course on Program Evaluation
Rotation II: Issues of Quality: Guiding Principles for Culturally Competent Teaching and Practice
Goliad
315
Thu, 1:40 PM to 3:10 PM
Multipaper
Strategies for Preparing Quality Evaluation Practitioners
Crockett B
435
Thu, 6:10 PM to 7:00 PM
Business Meeting
TIG Business Meeting and Presentations: Critical Concepts for Introductory Evaluation Courses: Multiple Perspectives- Part 1
Crockett B
535
Fri, 9:15 AM to 10:45 AM
Multipaper
Teaching About Specific Aspects of Evaluation
Crockett B
593
Fri, 1:40 PM to 3:10 PM
Roundtable
Rotation I: The Essentials of a Quality Evaluation Capstone Project, Practicum or Internship: Students‘ Perspectives
Rotation II: An Evaluation Seminar: How our Students Gain Practical Experience in Evaluation and Research Methodology
Goliad
693
Fri, 4:30 PM to 6:00 PM
Multipaper
Teaching Through an Interdisciplinary Focus
Crockett B
734
Sat, 8:00 AM to 9:30 AM
Demonstration
Critical Concepts for Introductory Evaluation Courses: Multiple Perspectives- Part 2
Crockett B
792
Sat, 10:55 AM to 12:25 PM
Roundtable
Rotation I: Who Do They Think We Are? Issues and Dilemmas Raised by Others' Perceptions of Evaluators and Evaluation
Rotation II: Resources to Guide Non-evaluators in the Design of Educational Program Evaluations
Goliad
793
Sat, 10:55 AM to 12:25 PM
Roundtable
Rotation I: Evaluation in Late Victorian Literature
San Jacinto
Rotation II: Epistemological distinctions and values in the evaluation process: A reflective analysis on the quality standards of truth…
814
Sat, 10:55 AM to 12:25 PM
MultiPaper
Experiencing Quality in Evaluation Training in Brazil and Ethiopia
Crockett B
894
Sat, 2:50 PM to 4:20 PM
Panel
Expanding Our Knowledgebase: Current Research on Teaching Evaluation
Crockett B
Index of Sessions for the Theories of Evaluation TIG
#
Time
Session Type
Session Title
Room Name
229
Thu, 9:15 AM to 10:45 AM
Panel
Evaluating With Validity: Truth, Justice, and the Beautiful Way
Texas B
361
Thu, 3:35 PM to 4:20 PM
Business Meeting
Theories of Evaluation TIG Business Meeting
Republic C
389
Thu, 4:30 PM to 6:00 PM
MultiPaper
Using Logic Models to Facilitate Comparisons of Evaluation Theory
Texas B
523
Fri, 9:15 AM to 10:45 AM
Roundtable
Towards Translational Process Evaluation: Implementation, Fidelity, Integration, and Sustainability – A Roundtable Discussion
Bonham A
579
Fri, 10:55 AM to 11:40 AM
Multipaper
The Basis for Good Judgment in Evaluation
Republic C
780
Sat, 10:00 AM to 10:45 AM
Multipaper
Contextual Influences on the Evaluator, the Evaluation, and the Evaluation Design
Republic C
793
Sat, 10:55 AM to 12:25 PM
Roundtable
Rotation I: Evaluation in Late Victorian Literature
San Jacinto
Rotation II: Epistemological distinctions and values in the evaluation process: A reflective analysis on the quality standards of truth…
860
Sat, 1:45 PM to 2:30 PM
MultiPaper
Let Quality Guide Evaluation Quality: Recent Trends Implemented in the Middle East
Evaluation 2010: Appendix B – Directory of Sessions by Sponsor
Republic C
Page 245
Appendix C: Directory of Exhibitors
The exhibits may be found outside of the Texas Ballroom on Level Two and the Lone Star Ballroom on Level Four. The exhibits are
open from 8:00 am to 5:00 pm on Thursday and Friday, November 11 and 12, and from at least 8:00 am to 12:00 pm on Saturday,
November 13. Some exhibits will also be open on Wednesday, at their discretion.
Academic Management Systems: CoursEval™, Academic Management Systems web-based software, allows institutional users to
evaluate courses and faculty online, typically replacing the paper process. Our software provides a means to create, deploy, and
analyze results over time and across courses, departments and schools. CoursEval™ can also be used to conduct formative midcourse evaluations or to create evaluations for clinical evaluations for block schedule courses. CoursEval™ will also support selfassessment activities and has a new feature that allows faculty to 'reflect' on their results as part of the reporting process. Please
visit our website at http://www.academicmanagement.com or call 716-867-8434.
Alberta Innovates Health Solutions: Created in 2010 as part of a newly aligned research and innovation system in the province of
Alberta, Canada building on its 30-year history as Alberta Heritage Foundation for Medical Research. Mandate is to support health
research and innovation in key areas to improve the health and socioeconomic wellbeing of Albertans. One of its programs, the
Alberta Research Ethics Community Consensus Initiative (ARECCI), has successfully pioneered tools, methodologies, and networks
in the area of ethics in applied projects (evaluation).The ARECCI project ethics courses and online decision guides will be featured at
this conference. See http://www.ahfmr.ab.ca/arecci.
Annie E Casey Foundation: Annie e Casey Foundation is a private charitable organization dedicated to helping build better futures
for disadvantaged children in the United States. It was established in 1948 by Jim Casey, one of the founders of
UPS, and his siblings, who named the Foundation in honor of their mother. The primary mission of the Foundation
is to foster public policies, human-service reforms, and community supports that more effectively meet the needs
of today's vulnerable children and families. For more information, please see http://www.aecf.org/ and also our
KnowledgeCenter http://www.aecf.org/KnowledgeCenter.aspx and KIDS COUNT Data Center http://datacenter.kidscount.org.
Annie E Casey Foundation is sponsoring, but does not have an exhibit table.
Battelle: As the world‘s largest independent research and development organization, Battelle provides innovative solutions to the
world‘s most pressing needs through its four global businesses: Laboratory Management, National Security, Energy Technology, and
Health and Life Sciences. Battelle advances scientific discovery and application by conducting $5.2 billion in global R&D annually
through contract research, laboratory management and technology commercialization. Headquartered in Columbus, Ohio, Battelle
oversees 20,400 employees in more than 130 locations worldwide, including seven national laboratories which Battelle manages or
co-manages for the U.S. Department of Energy and the U.S. Department of Homeland Security. Battelle is also one of the nation‘s
leading charitable trusts focusing on societal and economic impact and actively supporting and promoting science and math
education. http://www.battelle.org
Claremont Graduate University: Located in Southern California, Claremont Graduate University (CGU) is one of the leading providers
of education and training in Evaluation and Applied Research Methods. CGU offers one of the largest graduate programs in
evaluation, with evaluation concentrations at the MA and PhD level. CGU also offers distance-based Certificate Programs that stress
rigorous training and a high level of competence and an array of online and on-site workshops. CGU‘s research institutes perform
evaluations for private and public clientele, utilizing world-renowned faculty and an extensive network of evaluation alumni.
http://www.cgu.edu/pages/665.asp
Compass Evaluation and Research: Compass Evaluation and Research is an evaluation and research consulting company dedicated
to working jointly with clients to meet the challenges of developing and sustaining successful programs. Compass provides strategic
planning, logic modeling, evaluation planning and design, complete implementation of evaluation activities, research support, and
guidance in utilizing evaluation findings. Compass also provides technical assistance and training in all aspects of strategic
planning, logic modeling, and evaluation activities. Compass grounds all of its work in a collaborative approach, which engages key
program stakeholders throughout the evaluative process and promotes expanding the evaluation expertise of program staff.
Compass balance its collaborative approach with independence and thoughtful adherence with accepted professional standards.
Our commitment to our clients is to add value beyond expectations. Please contact us at http://www.compasseval.com.
Evaluation 2010: Appendix C – Exhibitors
Page 246
CUSO-VSO: CUSO-VSO is an international development organization that works through volunteers. As the North American member
of the VSO Federation, CUSO-VSO works in over 40 countries and seven focus areas, including: Education, HIV and AIDS, Disability,
Health and Social Well-being, Secure Livelihoods, Participation and Governance and Environment and Natural Resource
Management. CUSO-VSO recruits skilled professionals from a variety of professional backgrounds to work in partnership with local or
national organizations around the world. Volunteers are matched to placements that meet the direct requests of our overseas
partners. They work to share skills and experiences with local colleagues, so their impact continues long after they return home.
http://www.cuso-vso.org.
DecisionEd Group: DecisionEd helps school administrators measure the performance of their district. Specializing in K12 data
warehouse solutions, our solution provides authorized staff with a web-based environment to view data from all sources of the
district, including assessment, finance, graduation trends, HR, discipline, program costs, IEP, etc., and cross analyze this data to
make more informed decisions. This solution is designed as a turnkey, ready-to-go solution containing 245 pre-built reports and
dashboards. For more information, visit http://www.DecisionEd.com.
Empirical Education Inc: Empirical Education helps educators make cost effective decisions about instructional and professional
development programs. Our research services assist districts, developers, and publishers in determining the effectiveness of
programs, products, or services—before or after they are in place. Our commitment is to provide rigorous, independent, and objective
evidence while remaining sensitive to the unique context of the local research site. We advocate for using evidence in policy
decisions, and we provide information and recommendations to trade organizations, policy institutes, foundations, and government
entities that make or influence policy and practice in education. http://www.empiricaleducation.com.
The Evaluation Center at Western Michigan University: The Evaluation Center has over a 40-year history of providing national and
international leadership for advancing the theory, practice, and utilization of evaluation. Unlike most evaluation units in academic
settings, the Center is not affiliated with a single academic department or college. This reflects the transdisciplinary nature of
evaluation and enables Center personnel to work effectively in an array of subject areas. See http://www.wmich.edu/evalctr/. The
Center houses WMU's Interdisciplinary Ph.D. in Evaluation, which features practice-linked learning; more than 30 faculty members
from 13 academic departments and The Evaluation Center; and a fully tailored, challenging curriculum. See
http://www.wmich.edu/evalctr/idpe.
Gravic Inc: Gravic makes software for assisting researchers and evaluators to collect and analyze data from paper
and web forms (surveys, evaluations, assessments). Use any word processor to create and print your own plainpaper evaluations and then scan them with Remark Office OMR using an image scanner. Or, create, host and
administer online surveys using Remark Web Survey. Host your own online forms; there are no form or respondent
limitations. Use both products to combine data from paper and web evaluations. Easily generate analysis reports and graphs with
Remark Quick Stats, a built-in analysis component. Or, export data to 35+ different formats (SPSS, Excel, ASCII, etc.). For more
information visit our website http://www.gravic.com/remark.
Guilford Publications: At Guilford Publications, we know that it can be a challenge to keep up with all the new developments in
evaluation or to utilize a technique that you‘ve read about but haven‘t used. We‘re here to help. Come see our latest books, including
those by AEA members: Developmental Evaluation by Michael Quinn Patton; Evaluation Essentials: From A to Z by Marv Alkin;
Qualitative Research: Studying How Things Work by Bob Stake; Evaluation in the Face of Uncertainty by Jonathan Morell; Oral History
for the Qualitative Researcher by Valerie Janesick; and, Hot off the Press—Robert Yin‘s Qualitative Research from Start to Finish.
http://www.guilford.com.
ICF International: ICF International (NASDAQ:ICFI) partners with government and commercial clients to deliver professional services
and technology solutions in the energy and climate change; environment and infrastructure; health, human services, and social
programs; and homeland security and defense markets. The firm combines passion for its work with industry expertise and innovative
analytics to produce compelling results throughout the entire program life cycle, from research and analysis through implementation
and improvement. Since 1969, ICF has been serving government at all levels, major corporations, and multilateral nstitutions. More
than 3,500 employees serve these clients worldwide. ICF‘s Web site is http://www.icfi.com.
Evaluation 2010: Appendix C – Exhibitors
Page 247
Appendix C: Directory of Exhibitors
Information Age Publishing: Information Age Publishing was founded in 1999 by George F. Johnson, IAP is a social science publisher
of academic and scholarly book series and journals. IAP's goal is to develop a comprehensive list of book series, monographs and
journals that break down and define specific niches that lack high-level research material in the fields of Education and
Management. Our products will be offered in both print and electronic formats where possible. We at IAP sincerely hope to have you
become a part of a new era in publishing as we grow. Visit us at http://www.infoagepub.com.
Innovation Network Inc: The Innovation Network is a nonprofit evaluation, research, and consulting firm. We provide knowledge and
expertise to help nonprofits and funders learn from their work to improve their results. Our AEA booth each year gives visitors the
chance to talk with staff and learn about our services. We also offer materials featuring our most recent evaluation consulting
projects and research results. For 2010, we will be spotlighting results from a ―State of Evaluation‖ survey of the U.S. nonprofit
sector. Visit us at http://www.innonet.org.
The International Program for Development Evaluation Training (IPDET): The International Program for Development Evaluation
Training (IPDET) is an executive training program that aims to provide managers and practitioners the generic tools required to
evaluate development policies, programs, and projects at the local, national, regional, and global levels. The program features a
two-week Core Course, followed by two weeks of more than 25 in-depth workshops, all taught by a dynamic group of leading-edge
international faculty drawn from Southern and Northern organizations. An intensive and unique training initiative of the Independent
Evaluation Group of the World Bank and Carleton University, it is best known for its flagship training program offered each summer in
Ottawa, Canada. Visit http://www.ipdet.org for more information.
Jossey Bass, An Imprint of Wiley: Jossey Bass is a leading publisher for students and professionals in research methods and
evaluation, including Evaluation Theory, Models, and Applications by (Stufflebeam and Shinkfield), Methods in Educational
Research: From Theory to Practice, 2nd Edition (Lodico, Spaulding and Voegtle) and the forthcoming Purposeful Program Theory:
Effective Use of Theories of Change and Logic Models (Funnell and Rogers). Wiley/Jossey-Bass also publishes the quarterly report
series New Directions for Evaluation in partnership with the American Evaluation Association. http://www.josseybass.com;
http://www.wiley.com.
LYCEUM Books: Since its founding in 1988, LYCEUM Books has earned a reputation for excellence in the field of social service
education. We are an independent publishing house with the editorial freedom to select books for the quality of their ideas, research,
writing, and their usefulness to students and practitioners. http://www.lyceumbooks.com.
Mathematica Policy Research: Mathematica Policy Research provides a range of research and evaluation services, including
program evaluation, policy research, survey design and data collection, research methods and standards, and program
management/data system support. Our program evaluations utilize impact and process analyses, quantitative and qualitative data
collection, and administrative or other secondary data, depending on the needs of our clients. We have offices in Princeton, NJ; Ann
Arbor, MI; Cambridge, MA; Chicago, IL; Oakland, CA; and Washington, DC and a staff of over 700. Our clients include federal and
state governments, foundations, private-sector, nonprofit, and international organizations. Visit us at http://www.mathematicampr.com.
Mosaic Network Inc: Mosaic Network provides data solutions and evaluation services to multi-site, multi-year human service
initiatives. Our vision is to seamlessly integrate our expertise in the areas of research, evaluation, training, and information
technology to promote the development of effective social services, with an aim to create healthier and stronger communities. To
that end, we collaborate with funders, evaluators and researchers to translate their visions into effective data driven
implementations, where results and the process of ascertaining results caters to the unique needs and perspectives of project
stakeholders. For more information, please visit http://www.mosaic-network.com or call (805) 692-0992.
National Science Foundation: The National Science Foundation is an independent United States federal agency, supports science
and engineering (S&E) research, education and evaluation through an annual budget of about $6.9 billion. NSF
funds grants and contracts to individuals, academic institutions, and for-profit and non-profit entities selected
from over 42,000 proposals received annually. About 50,000 S&E experts volunteer to serve as NSF reviewers
each year as part of the grant merit review process that selects promising proposals. Discover more about NSF
online at http://www.nsf.gov/, or by phone at 703-292-5111 (TDD 800-281-8749).
Evaluation 2010: Appendix C – Exhibitors
Page 248
Provalis Research: Provalis Research is the world's leading developer of mixed methods research software with ground-breaking
qualitative and quantitative analysis programs, such as QDA Miner, an innovative mixed-models qualitative data analysis software;
Simstat, an easy yet powerful statistical software; and WordStat, a powerful add-on module for computer-assisted content analysis
and text mining. One of the most distinctive features of these tools is their interoperability, allowing researchers to integrate
numerical and textual data into a single project file and to seamlessly move back and forth between quantitative and qualitative data
analysis, as well as to easily explore relationships between numerical and textual data. http://www.provalisresearch.com.
QSR International: Evaluation programs are often multifaceted. You might be collecting and analyzing data from Word documents,
PDFs and audio recordings, through to videos, digital photos and even database tables. QSR International‘s NVivo software helps
users make sense of this material quickly and easily. Over 400,000 users in 150 countries use NVivo. From program to personnel
evaluation, it removes many of the manual tasks associated with analysis, like classifying and sorting information, so there‘s more
time to explore trends and arrive at answers to questions. Be amongst the first to see our new NVivo 9 software at Evaluation 2010.
http://www.qsrinternational.com.
SAGE: SAGE is an independent international publisher in the social sciences, technology and medicine-provides
journals, books, and electronic media of the highest caliber. Researchers, students, and professionals have relied
on our innovative resources for over 45 years. Please stop by our booth or visit us at http://www.sagepub.com.
Stanford University Press: Stanford University Press is committed to educating and assisting today‘s evaluators and tomorrow‘s
leaders in the field. SUP publishes books that stand at the intersection of scholarship and practice. Our books not only introduce
readers to today‘s methodological toolkit, but also help them to put evaluation in context — by seeing their practice through the lens
of organizational studies, education, and public policy. Please stop by our booth or visit us at http://www.sup.org.
SurveyGizmo: SurveyGizmo is a software as a service (SaaS) company that provides software to create online surveys, quizzes, polls,
and evaluations. SurveyGizmo is the only company in the market to serve the entire spectrum of survey users; sophisticated enough
for advanced market research users while being accessible enough for corporations or small businesses. SurveyGizmo offers the
most affordable solution in the industry for the level of sophistication, integration, flexibility, and high level of customer service
provided. Contact SurveyGizmo at [email protected] or visit the website at http://www.surveygizmo.com.
Westat: Westat is an employee-owned research corporation serving Federal, state, local, and international government agencies,
businesses, nonprofit organizations, and foundations. In addition to our capabilities as a leading survey research and data collection
and analysis organization, Westat has extensive skill and experience in evaluation, strategic planning,
performance measurement, and quantitative/qualitative research methods across a broad range of subject
areas. Westat offers a full-range of evaluation services to meet our clients‘ needs, including evaluation planning
and design, implementation, data analysis, and reporting for process, implementation, and impact evaluation of
programs and services at various stages of development. See our website at http://www.westat.com.
WestEd: WestEd is a national nonpartisan, nonprofit research, development, and service agency, works with education and other
communities to promote excellence, achieve equity, and improve learning for children, youth, and adults. Evaluation professionals at
WestEd perform dozens of analyses each year, including evaluation studies, program design and policy formation, and professional
development and training. These evaluations lead to better understanding of whether a program is effective, whether a policy is
having the desired impact, whether a chosen approach is the most cost-effective way of accomplishing agreed-upon goals, and how
an effort can be improved. To learn more, visit http://www.wested.org.
Evaluation 2010: Appendix C – Exhibitors
Page 249
Evaluation 2011: Values and Valuing in Evaluation
In the fall of 2011, members and friends of AEA will convene in Anaheim, California – land of sun and sea,
movie stars, perennial childhood (in nearby Disneyland), as well as an evocative mix of beliefs, traditions, and
cultures.
Like culture, evaluation is inherently imbued with values. Our work as evaluators intrinsically involves the
process of valuing, as our charge is to make judgments about the “goodness” or the quality, merit or worth of a
program. Judgments rest on criteria, which in turn reflect priorities and beliefs about what is most important. At
Evaluation 2011, I would like us to take up the challenges of values and valuing in evaluation, particularly the
plurality of values represented by different evaluation purposes and audiences, key evaluation questions, and
quality criteria. I anticipate that greater attention to and openness in the value dimensions of our work can
improve our practice, offer voice to diverse stakeholder interests, and enhance our capacity to make a
difference in society.
The richness and vitality of this conference theme will hopefully generate a wide and deep mixture of ideas,
experiences, and insights. The major values underlying the conference theme itself, and thus expected
discourse at the conference, include the legitimacy of different standpoints, respectful acceptance of others’
points of view, and norms of listening well to each other. As catalysts for forthcoming conference proposals, I
offer the following starting points.
First, in terms of the major anchors of values within the design of evaluation studies (purposes and audiences,
key evaluation questions, and quality criteria):
 Which stakeholder interests should be given priority in an evaluation study, and how is this
determination made?
 What strategies exist for evaluators to expand upon the given values in an evaluation context? (Given
values are expressed in given purposes/audiences and the criteria for judging program quality, and may
be conveyed in the request for proposals, in relevant policies, or in institutional norms.)
 How can evaluators be forthright and transparent about the values being promoted in their work?
Second, as connected to the technical side of evaluators’ work:
 How do values show up in evaluation methodologies and analyses?
 How is the process of valuing enacted in evaluation’s design, implementation, and utilization?
And third, as connected to the role of evaluation in society:
 What responsibilities do evaluators have for advancing a valuing of evaluation itself in society?
 What political role(s) should evaluation play in society? When and where should evaluation primarily
serve the interests of the elite – existing policy and decision makers – and thus the status quo? What
responsibilities does the evaluation profession have for giving voice to the interests of other legitimate
stakeholders – to onsite program administrators, program staff, and especially intended program
beneficiaries?
I am grateful and humbled by this opportunity to serve as AEA’s president for 2011. And I look forward to
celebrating AEA’s 25th at our next gathering in Anaheim CA.
Jennifer Greene
Jennifer Greene
AEA 2011 President