to the entire program as a pdf

Transcription

Evaluation 2007 President’s Welcome
On behalf of the American Evaluation Association's Board of Directors, the AEA staff, and many wonderful
volunteers, I am happy to welcome you to the 2007 AEA Annual Conference. The conference offers us
excellent opportunities for sharing our work, learning from each other, developing and strengthening
professional relationships, renewing old and starting new friendships, and exploring the sights, sounds,
and excellent cuisine of Baltimore.
This year, the Presidential Strand theme is "Evaluation and Learning." This theme will be the focus of the
Presidential Address, three Plenary sessions, and 19 other Strand sessions (one for each timeslot of the
conference). In addition, various panels and presentations outside the Presidential Strand will address the
intersection of evaluation and learning. And, of course, it would be great if the theme stimulates
provocative conversations at the receptions and various gathering places.
My hope is that this topic will also generate valuable insights into the ways in which evaluation facilitates
individual, group, organization, and community learning, as well as the ways in which evaluation capacity
is developed. Sessions in the Presidential Strand reflect a wide range of ways to consider the relationship
between evaluation and learning. Some of these include learning in complex systems, learning from
Appreciative Inquiry, teaching and learning about evaluation, learning and social justice, understanding
indigenous knowledge, learning through practice, and evaluation and organizational learning.
At the opening Plenary, Jean King will use experiential learning processes as a means for exploring
evaluative learning at both the society and individual practitioner levels. In my Presidential Address, I will
ask us to imagine a world where evaluation is a social epidemic…where individuals, groups, organizations,
and communities are constantly learning about and from evaluations. On Friday morning, Tom Schwandt
will challenge us to think about what is involved in learning about evaluation as a special kind of critical
appraisal, inspection, questioning, scrutiny, and judgment of value. On Saturday morning, Sulley Gariba
and Hazel Symonette will provide critical insights into evaluation and learning within a global and cultural
context.
I would like to extend a big thank you to Darlene Russ-Eft, Presidential Strand Chair, for her
encouragement and guidance throughout the year, and to Jennifer Martineau and Saumitra SenGupta,
who did such a wonderful job of selecting many of the Presidential Strand sessions and the Student Travel
Award winners. I also want to thank Tessie Catsambas and Marguerite Foxon for their expertise, wonderful
ideas, and support in developing the conference theme. Additional thanks go to Gordon Bonham, Local
Arrangements Chair, and his team of dedicated colleagues in Baltimore who have so willingly shared their
knowledge of, and excitement for, this wonderful city. A conference like this takes the work of many
people, who give generously of their time and energy. A warm thank you goes to Nicole Vicinanza,
Conference Chair, for her patience, leadership, and continued commitment to providing a memorable
conference experience. Finally, I would like to thank Susan Kistler, our amazingly talented Executive
Director, who never appears to sleep, as she works to ensure that this organization is all it can be…and
more.
I hope you have a great time at this year’s conference – learn new things, make new friends, see things in
new ways, and appreciate the possibilities of evaluation.
Hallie Preskill
AEA 2007 President
American Evaluation Association Annual Conference
BOARD OF DIRECTORS
TABLE OF CONTENTS
PAGE
OFFICERS
• President
Hallie Preskill
• Past-President/Secretary
Melvin Mark
• President-elect
William Trochim
• Treasurer
Kathleen Bolland
President’s Welcome
Inside Front Cover
Board Member directory
1
Table of Contents
1
Conference Hotel Maps
2-3
Registration Information
4
Career Boards Information
4
Future Conferences
4
FAQs About the Conference and AEA
5-6
Topical Interest Group (TIG) directory
7-8
Sponsors
9
Thank You! Acknowledgements
9-11
Professional Development Sessions
12-28
Wednesday, November 7 Sessions
29-40
Thursday, November 8 Sessions
41-80
Friday, November 9 Sessions
81-118
Saturday, November 10 Sessions
119-154
BOARD MEMBERS
Gail Barrington
Valerie Caracelli
Leslie Goodyear
Jennifer Greene
Howard Mzumara
Zenda Ofir
Thomas Schwandt
Ellen Taylor-Powell
Huilan Yang
Appendix A: Index of Presenters & Contributors 155-192
ANNUAL MEETING
• Chair
Nicole Vicinanza
JOURNAL EDITORS
American Journal of Evaluation
Robin L Miller
New Directions for Evaluation
Sandra Mathison
Appendix B: Directory of Sessions by Sponsor
193-214
Appendix C: Exhibitors
215-218
Advertisements
219-231
Map of Downtown Baltimore
232
AEA Mission, Goal, and Values
233
Looking Toward 2008
Inside Back Cover
If you are in need of assistance as you prepare for the
conference, please call the AEA office at (888) 232-2275 or
(508) 748-3326, or email us at [email protected].
Evaluation 2007 Conference Maps: Radisson
RADISSON BUILDING
Mezzanine Level
Lafayette
Suite
Business
Center
Map
How to get there:
Take Sheraton walkway over to the
Radisson and you will be on the Mezzanine Level. Or, go up one level from
the Radisson lobby.
Baltimore
Theatre
Eval 2007 Registration
Elevators
Found on this level:
Hanover
Suite B
Baltimore Theatre
Hanover Suite B
Lafayette Suite
Business Center
Registration
Lower Lobby Level
Lobby Level
International
Room
Map
How to get there:
The International Room is on the same level
as Starbucks, the Chesapeake Boardroom is
down the stairs.
Starbucks
Versailles
Room
Across from
The Radisson’s
hotel
Registration
Desk.
Chesapeake
Boardroom
International
Chesapeake Boardroom
Ballroom Level
Salon D
Salon A
Map
How to get there:
Take elevators or stairs from the Radisson Lobby or Mezzanine Level to the
Ballroom Level.
Calvert ballroom
Salon C
Salon B
Salon E
Elevators
Calvert Ballroom
Calvert Ballroom Salons A-E
19th Floor Conference Rooms
Map
How to get there:
Take elevators from the Radisson Lobby
or Mezzanine Level to the 19th floor.
Founders Suite
Mt. Vernon Suite
Caswell Suite
Federal Hill Suite
Fairmont Suite
Royal Board Room
Royal Conference Foyer
Founders
Suite
Royal Board Room
Federal
Hill
Suite
Mt Vernon
Suite
Caswell
Suite
Elevators
Royal Conference
Foyer
Fairmount
Suite
Walkway to
Sheraton
Evaluation 2007 Conference Maps: Sheraton
SHERATON BUILDING
Mencken
Lobby Level
E.A. Poe
Int’l C
Int’l E
Int’l D
Carroll
Int’l B
Int’l
Foyer
Elevators
Int’l A
Walkway to
Radisson
How to get there:
Enter through lobby level (1st
floor). Proceed to back of the
building.
Liberty
A
Shula’s
SteakHouse
Elevators
Map
Liberty
B
Lobby
International A– E
Mencken
Edgar Allen Poe
Carroll
Liberty A –B
Exhibits
Career Center
Walkway to Radisson
Lower Level South Tower
Pratt-A
Pratt-B
Map
How to get there:
Douglass
Peale
Elevators
Take elevators or stairs down one
floor from lobby/exhibitor promenade
level to lower level south tower.
Pratt– A
Pratt– B
Peale
Douglas
Hopkins
Hopkins
Cabana Level
McKeldin
Schaefer
Elevators
Map
Preston
Cabana Level Connector
Jefferson
Adams
Washington
Elevators
Pool
D’Alessandro
Calhoun
How to get there:
Take elevators or stairs up one floor
from lobby/exhibitor promenade level
to cabana level.
McKeldin
Schaefer
Preston
Calhoun
D’Alessandro
Jefferson
Adams
Washington
Registration Desk, Career Center
Registration: Conference sessions will be held in two adjacent hotels – the Sheraton Baltimore City Center and the Radisson Plaza
Lord Baltimore. These hotels are connected by an above-ground walkway over the street. The Registration Desk for Evaluation 2007
is located on the Mezzanine Level of the Radisson Plaza Lord Baltimore. From the lobby of the Radisson at 20 West Baltimore
Street, go up one floor to the Mezzanine level, or second floor. You won’t be able to miss us.
The Registration Desk should be your first stop during the conference. It is where you receive your name badge, printed conference
program, and convention bag. It is where you may return with questions or concerns at any time during the event, and where any
last-minute changes to the program are posted. There are also conference binders available at the desk with abstracts for each
session for your perusal.
Day
Monday, November 5
Tuesday, November 6
Wednesday, November 7
Thursday, November 8
Friday, November 9
Saturday, November 10
Sunday, November 11
Registration Desk Hours
8:00 am – 5:30 pm
8:00 am – 7:00 pm
7:00 am – 7:00 pm
7:00 am – 6:30 pm
7:00 am – 6:30 pm
7:00 am – 5:00 pm
8:00 am – 12:00 pm (Noon)
Career Boards: Our career services will be provided this year in a different format from that used in the past. Look for Job Boards and
Resume Boards at one end of the Exhibitor Promenade in the Sheraton. Those who have submitted resumes or position descriptions
in advance will have them posted here. You may also bring your position descriptions on site and add them to one of the pockets
there yourself. The Career Boards will be available Thursday through Saturday. Be sure to peruse the position and resume listings!
Future Conferences
Plan ahead and save the dates! The sites have already been selected for the following conferences. We look forward to seeing you
there.
Evaluation 2008
Dates: Wednesday, November 5, through Saturday, November 8, 2008
Location: Hyatt Regency – Denver, Colorado
Evaluation 2009
Location: Rosen Shingle Creek Resort – Orlando, Florida
Evaluation 2010
Location: Grand Hyatt – San Antonio, Texas
Evaluation 2011
Dates: Wednesday, October 31 to Saturday, November 5, 2011
Location: Hilton Anaheim – Anaheim, California
Evaluation 2012
Dates: Wednesday, October 24 to Saturday, October 27, 2012
Location: Hilton Minneapolis and Minneapolis Convention Center – Minneapolis, Minnesota
Evaluation 2007
Page 4
Frequently Asked Questions About the AEA Annual Conference
What should I do when I arrive at the conference? Begin by checking in, and picking up your nametag and materials, at the AEA
conference registration desk on the Mezzanine Level in the Radisson Plaza Lord Baltimore, 20 West Fayette Street, Baltimore, MD.
May I register or make purchases on site? You may register for the conference, or add to your existing conference registration, on
site at the conference registration desk. You may enroll in any open professional development sessions, but many have filled before
the conference. Lunch tickets for the Friday awards luncheon are usually available through noon on Thursday or until sold out.
Tickets will also be available for Thursday Evening’s Sock Hop. A limited number of t-shirts are available for on site purchase as well.
What is included in my registration? Standard conference registration includes admission to all of the sessions held after 3:10 pm
on Wednesday through 6:00 pm on Saturday with the exception of Thursday’s Sock Hop, and Friday’s awards luncheon, which are
separate ticketed events. Registration includes the receptions Wednesday and Friday evenings. Meals are not included, but
beverages are available in the foyers each morning after the plenary and each afternoon before the penultimate session.
Do I need to sign up for sessions in advance? The professional development workshops that precede and follow the conference
require a separate registration and are filled on a first-come, first-served basis. All other sessions held during the conference are
open to all attendees. You may attend any session by arriving at the appropriate room before the session begins. We make every
effort to ensure that the room size is adequate for the attendance; however, occasionally, a session’s seating will fill. If there is a
session that you especially wish to see, it is a good idea to arrive at the beginning of the break rather than at the end.
What is the Presidential Strand? The Presidential Strand is a set of sessions highlighting the year’s conference theme of Evaluation
and Learning. There is one Strand session during each set of concurrent sessions, plus five plenary, or general sessions – one
opening the conference, one each on Thursday, Friday, and Saturday mornings at 8:00 a.m., and one closing the conference on
Saturday afternoon.
What is a TIG and what do they do? AEA has 41 Topical Interest Groups, or TIGs. One of the major activities of each TIG is to review
conference proposals and sponsor conference sessions. Under each session in the program you will see the sponsoring group, and
the program is indexed by TIG in Appendix B. Checking the TIG sponsor will give you an idea as to the topical bent of the overall
session. Each TIG also holds a business meeting during the conference, and attending one is a great way to connect with others who
share your interests and to learn of the TIG’s plans for the coming year. Many TIG members may be identified by ribbons attached to
their nametags stating TIG affiliations. Pick up free ribbons showing your topical interests when you check in at the registration desk
and look for others throughout the conference who share your interests.
How can I meet people? It can be difficult to connect with others your first time at a conference. One great way to meet colleagues is
to attend the Wednesday Reception and Poster Exhibition and take the opportunity to connect with over 100 poster presenters
sharing their work as well as AEA leaders and authors. Purchase a ticket to Friday’s awards luncheon and sit with colleagues to
enjoy a good meal and great company while honoring the best in the field. Friday is topped off by a reception and silent auction
hosted by the International and Cross-Cultural Evaluation TIG. Meet attendees from around the world and bid on a range of items
from texts to talismans. Finally, attending a TIG business meeting will help you to connect with people who share your disciplinary
interests.
What should I do if I have questions during the conference? Please feel free to come to the registration desk at any time. We’re
happy to answer your questions, give a little advice, or point you in the right direction. When out and about, look for attendees with
“Ambassador” ribbons. These past and present Association leaders will be happy to help.
Be sure to attend the first-time attendee’s orientation session held in the Calvert Ballroom, Section C, in the Radisson
from 6:10 to 6:40 pm on Wednesday evening to learn more about the Association and the Conference.
Evaluation 2007
Page 5
Frequently Asked Questions About AEA
How long has AEA been around? The American Evaluation Association (AEA) came into being in 1986 out of the merger of two
existing evaluation groups: The Evaluation Network and the Evaluation Research Society.
What is the mission of AEA? AEA’s mission is to:
Improve evaluation practice and methods
Increase evaluation use
Promote evaluation as a profession, and
Support the contribution of evaluation to the generation of theory and knowledge about effective human action.
Why should I become a member? Membership in AEA signifies to yourself and to others that you consider yourself an evaluation
professional. The Association’s two journals, subscriptions to both of which come with full membership, provide you with up-to-date
information on current theory and practice. The American Journal of Evaluation includes articles on topics of current interest,
information about upcoming conferences, book reviews, and more. Published quarterly, New Directions for Evaluation focuses on
various aspects of a single salient topic with each issue. AEA members also receive electronic access to two additional journals Evaluation and the Health Professions and Evaluation Review, a listing on AEA’s “Find an Evaluator” pages, access to the online
member directory, and informational materials. Finally, AEA members enjoy considerable discounts on conference and professional
development workshop registrations.
Where can I turn with professional questions? EVALTALK is the official listserv of AEA. Subscribers to EVALTALK engage in lively,
sometimes heated, usually thought provoking, discussions of topics related to evaluation. EVALTALK can be received in real time via
ongoing emails throughout the day, or as a digest so that you receive one email each day that includes the indexed, full discussion
from the past 24 hours. The AEA office can direct you to information on how to sign on to EVALTALK or check the AEA website at
www.eval.org. Another option for your professional questions is to connect with a Topical Interest Group either through attending
TIG-sponsored sessions at the annual conference or communicating with the TIG leaders.
What is a TIG? AEA’s 41 Topical Interest Groups (TIGs) span the methodological, disciplinary, and ideological gamut. These
subgroups of the Association allow members to connect with others who share their interests as well as provide a forum for sharing
knowledge and skills during the annual conference. Some TIGs are very active and produce a newsletter, manage their own website,
and solicit and develop special conference sessions. Other TIGs focus primarily on providing reviewers for topical presentations for
the annual conference. AEA members may be members in up to five TIGs and may change their TIG choices at any time by
contacting the AEA office or making the changes on your membership renewal form.
What is a Local Affiliate? AEA’s Local Affiliates (LAs) are independent associations that provide a regional home to evaluators. You
do not need to be a member of AEA to join an Affiliate and you do not need to participate in an Affiliate to be a member of AEA.
Affiliates provide their own programming and outreach activities, yet share with AEA a focus on serving evaluators and the
evaluation community.
How can I get involved? AEA is a professionally run, volunteer lead association. The most obvious way to get involved is to
participate: submit a proposal to present at the conference, vote in AEA elections, nominate a colleague for an award. Share your
knowledge by submitting an article to The American Journal of Evaluation – manuscript guidelines can be found online or through
the AEA office. Become a leader by attending a TIG business meeting at the annual conference and offering your services. TIGs are
seeking people to do everything from design websites to write newsletters to review conference proposals. Go to a local affiliate
meeting and make your voice heard about your professional development needs. If you want to influence the actions of the
Association, consider running for office on the AEA Board or connecting with an AEA Board member, committee chair, or TIG leader
at the Wednesday evening Info Fair. Only members may serve on the AEA Board or as Topical Interest Group leaders.
Where should I turn with questions? A good place to start is with Heidi Nye, AEA’s Member Services Director in our AEA office. Heidi
can answer most administrative or member services questions and will point you in the right direction for other resources.
Evaluation 2007
Page 6
Topical Interest Group Directory
AEA’s 41 Topical Interest Groups are the primary reviewers and sponsors of conference sessions. We encourage you to attend a TIG business
meeting to connect with others who share your interests and get involved in the life of the Association. Conference attendees are welcome at any
business meeting – you need not be a pre-existing member of the TIG.
Topical Interest Group Name
Chair(s)
Program Chair(s)
Business Meeting Time
Location
Advocacy and
Policy Change TIG
Julia Coffman
Astrid Hendricks
Ehren Reed
Justin Louie
Thu 6:10 PM to 7:00 PM
Edgar Allen Poe
Room
Alcohol, Drug Abuse, and
Mental Health TIG
Robert Hanson
Garrett E Moran
Robert Hanson
Garrett E Moran
Royal Conference
Foyer
Assessment in Higher Education TIG
William Rickards
William Rickards
Wed 4:30 PM to 6:00 PM
Adams Room
Business and Industry TIG
Amy Gullickson
Sheri Hudacek-Lantz
Eric Graig
Otto Gustafson
Fri 11:15 AM to 12:00 PM
Pratt Room,
Section B
Cluster, Multi-site and Multi-level
Evaluation TIG
Rene Lavinghouze
Cynthia Phillips
Martha Ann Carey
Fri 7:00 AM to 7:50 AM
Mencken Room
Collaborative, Participatory &
Empowerment Evaluation TIG
David Fetterman
Liliana Rodriguez-Campos
Liliana Rodriguez-Campos
Wed 4:30 PM to 6:00 PM
Hanover Suite B
College Access
Programs TIG
Rita O'Sullivan
Kurt Burkum
Calhoun Room
Costs, Effectiveness, Benefits, and
Economics TIG
Brian T Yates
Sam Bickel
Mencken Room
Crime and Justice TIG
Roger K Przybylski
Roger K Przybylski
Washington Room
Disaster and Emergency Management
Evaluation TIG
Liesel Ritchie
Scott Chaplowe
Mary V Davis
Thu 9:35 AM to 11:05 AM
Calvert Ballroom
Salon B
Distance Education. & Other
Educational Technologies TIG
Mark Hawkes
Mark Hawkes
Fairmount Suite
Environmental Program Evaluation TIG
Katherine Dawes
Annelise Carleton-Hug
Lisa Flowers
Edgar Allen Poe
Room
Evaluating the Arts and
Culture TIG
Treseen McCormick
Sharon Herpin
Kathlyn Steedly
Versailles Room
Evaluation Managers and
Supervisors TIG
Robert Vito
Sue Hewitt
Ann Maxwell
Schaefer Room
Evaluation Use TIG
Karen E Kirkhart
Susan A Tucker
Emma Norland
International
Ballroom D
Extension Education Evaluation
Mary Arnold
Heather Boyd
Calvert Ballroom
Salon E
Feminist Issues in Evaluation TIG
Sharon Brisolara
Denice Cassaro
Federal Hill
Suite
Government Evaluation TIG
Kent Hutchinson
Kent Hutchinson
Mencken Room
Graduate Student and
New Evaluators TIG
Chris Coryn
Stephen Hulme
Daniela Schroeter
Annette Griffith
Fri 1:55 PM to 3:25 PM
International
Ballroom E
Health Evaluation TIG
Christel A Woodward
Ann Zukoski
Robert G LaChausse
Eunice Rodriguez
Pratt Room
Section A
Human Services Evaluation TIG
Michel Lahti
Ann Tvrdik
Jim Sass
Tracy Greever-Rice
Pratt Room
Section B
Evaluation 2007
Page 7
Topical Interest Group Name
Chair(s)
Program Chair(s)
Business Meeting Time
Location
Independent Consulting TIG
Kathleen Dowell
Frederic B Glantz
Dawn Hanson Smart
Pratt Room
Section B
Indigenous Peoples TIG
Katherine Tibbetts
Morris Lai
Joan LaFrance
McKeldon Room
Integrating Technology into Evaluation
TIG
Marcie Bober
Margaret Lubke
Marcie Bober
Hopkins Room
International and Cross Cultural
Evaluation TIG
Thomaz Chianca
Gwen Willems
Nino Saakashvili
Nino Saakashvili
McKeldon Room
Lesbian, Gay, Bisexual, and
Transgender Issues TIG
Denice Cassaro
Les Burleson
Steve Fifield
Kari Greene
Royal Board Room
Multiethnic Issues in Evaluation TIG
Elmima Johnson
Emiel Owens
Pratt Room,
Section A
Needs Assessment TIG
Catherine Sleezer
Jeffry White
Catherine Sleezer
Jeffry White
Pratt Room
Section B
Non-profit and Foundations Evaluation
TIG
Diane Manuel
Lorna Esscoffery
John B Nash
Teri Behrens
Peale Room
Organizational Learning and
Evaluation Capacity Building TIG
Susan Boser
Jean King
Rebecca Gajda
Emily Hoole
Liberty Ballroom
Section A
Pre-K - 12 Educational
Evaluation TIG
Alison Williams
James Van Haneghan
Linda Channell
Anane Olatunji
Tom McKlin
International
Ballroom B
Program Theory and Theory-driven
Evaluation TIG
Katrina Bledsoe
Lea Witta
Katrina Bledsoe
Liberty Ballroom
Section B
Qualitative Methods TIG
Jennifer Jewiss
Leslie Goodyear
Eric Barela
Janet Usinger
Hopkins Room
Quantitative Methods: Theory and
Design TIG
Patrick McKnight
George Julnes
Fred Newman
Karen Given Larwin
Dale E Berger
Thu 11:15 AM to 12:45 PM
Baltimore Theater
Research on Evaluation
Tarek Azzam
Christina Christie
Tarek Azzam
Christina Christie
Fri 11:15 AM to 12:00 PM
International
Ballroom A
Research, Technology, and
Development Evaluation TIG
Gretchen Jordan
George Teather
Brian Zuckerman
International
Ballroom E
Social Work TIG
Mansoor AF Kazi
Sue Tungate
Robert L Fischer
Kimberly D Farris
Carroll Room
Special Needs Populations TIG
Carol L Henderson-Dahms
Janice A Grskovic
McKeldon Room
Systems in Evaluation TIG
Derek Cabrera
Jan Noga
Bob Williams
International
Ballroom C
Teaching of Evaluation TIG
Linda B Schrader
Vanessa Dennen
Neva Nahan
Adams Room
Theories of Evaluation TIG
Bernadette Campbell
Bernadette Campbell
Liberty Ballroom
Section B
Evaluation 2007
Page 8
Thank you to our Conference Sponsors
AEA would like to thank the following parties for contributing funds and services as sponsors of this year’s annual conference. The contributions
of people and groups such as these allow the Association to keep registration feels as low as possible. If you know of anyone who would like to
sponsor next year’s conference in Denver, Colorado, please contact the AEA office.
Annie E Casey Foundation: Financial Support for Student Registrations and Initiatives
Gravic Inc – Remark Products Group: Evaluation Form Scanning, Online Survey Deployment, Data Entry
Macro International: Financial Support for Friday Evening’s Reception
National Science Foundation: Financial Support for Tote Bags
Sage Publications: Publications, Financial Support for Wednesday Evening’s Reception
Thank you to our Volunteers
AEA would like to thank the many people who lend their time and talents to making Evaluation 2006 an event to remember.
Conference Chair
Nicole Vicinanza
Local Arrangements Chair
Gordon Bonham
Presidential Strand Chair
Darlene Russ-Eft
Professional Development Program Reviewers
Katherine McKnight (Chair)
Howard Mzumara
Vinetta Jones
Stephanie Shipman
Victor Kuo
Jennifer Williams
Susan Kistler
Heidi Nye
Aleise Mathison
Damon Thompson
Silent Auction Coordinator
Antoinette Brown
AEA On Site Staff
Cady Berkel
Susan Mort
Of course, the most thanks must go to the 1,000+ people who have contributed their time, knowledge, and expertise as
presenters for this year’s conference. Their names and contributions appear in the body of this program.
Evaluation 2007
Page 9
Thank you to our Evaluation 2007 Proposal Reviewers!
The following 388 individuals contributed their knowledge and expertise as reviewers for the Evaluation 2007 program.
Kecia Addison-Scott
Dennis Affholter
Terri Akey
Olayinka Akinola
Kate Alderete
Amy Anderson
Martha Ann Carey
Thomas Archer
Sheila Arens
Mary Armstrong
Mary Arnold
Jo-Ellen Asbury
Paule Asch
Karyl Askew
Jennifer Bagnell Stuart
Michelle Bakerson
Lennise Baptiste
Eric Barela
Michelle Baron
Yvonne Belanger
Dale Berger
David Bernstein
Tamara Bertrand
Monifa Beverly
Gargi Bhattacharya
Bill Bickel
Samuel Bickel
Mark Biddle
Katrina Bledsoe
Marcie Bober
Sally Bond
Roger Boothroyd
Susan Boser
Eric Bothwell
Heather Boyd
Kathryn Braun
Sharon Brisolara
Antoinette Brown
Courtney L Brown
Densie Bulling
Kurt Burkum
Erin Burr
Ellie Buteau
William Cabin
Derek Cabrera
Bernadette Campbell
Steve Canavero
Hanh Cao Yu
Stanley Capela
Annelise Carleton-Hug
Joann Carman
Deborah Carran
Denise Cassaro
Evaluation 2007
Imelda CastañedaEmenaker
Melissa Cater
Michelle Chandrasekhar
Linda Channell
Scott Chaplowe
Edith J CisnerosCohernour
MH Clark
A Rae Clementz
Greg Clendenning
Becky Cocos
Julia Coffman
Carolyn Cohen
Jeffrey Coleman
Isabel Collins
Susan Connors
Cheryl Cook
Chris Coryn
Mary Crave
Thomas Crochunis
Catherine Crystal Foster
Nancy Csuti
Brian Dates
Mende Daves
Randall Spencer Davies
Mary Davis
Kara Davis
Katherine Dawes
Karen Debrot
Enrique Delamonica
Connie Della-Piana
Vanessa Dennen
Kate DeRoche
Jim Derzon
Wendy Dickenson
Shawn Dickerson
David Dobrowski
Tara Donahue
Karen Douglas
River Dunavin
MaryAnn Durland
John Ehlert
Wendy Erisman
Kimberly Farris
Karen Febey
Steve Fifield
Teresa Figueroa
Rob Fischer
Sylvia Fisher
Jody Fitzpatrick
Lisa Flowers
Janice Fournillier
Melissa Freeman
Rebecca Gajda
Paul Gale
John Gargani
Charles Gasper
Monica Geist
Diane J Gibbs
Karen Givens
Frederic Glantz
Marlene Glassman
Leslie Goodyear
Srik Gopalakrishnan
Eric Graig
Zandra Gratz
Tangie Gray Fleming
Sallie E Greenberg
George Greene
Kari Greene
Tracy Greever-Rice
Sue Griffey
Annette Griffith
Jane Grover
Janice A Grskovic
Cristian Gugui
Amy Gullickson
Otto Gustufson
Kendall Guthrie
Kelly Hallberg
Kelly Hannum
Robert Hanson
Todd Harcek
Elizabeth Harris
Mark Hawkes
Barbara Heath
Linda Heath
Sam Held
Jan Henderson
Susan Henderson
Carol L HendersonDahms
Astrid Hendricks
Stephanie Herbers
Sharon Herpin
Bart Hewitt
Diane Hirshberg
Tricia Hodge
Cheri Hodson
Susan Hoechstetter
Martha Holleman
Helen HolmquistJohnson
Nancy Hood
Emily Hoole
Arlene Hopkins
Jordan Horowitz
Rabia Hos
David Hough
John Hoye
Helen Hsu
Jeanne k Hubelbank
Jenica Hudleston
Kristin Huff
Douglas Huffman
Stephen Hulme
Kent Hutchinson
Jo Ann Intili
Annabel Jackson
Nakia James
Valerie Janesick
Natasha Jankowski
Michelle Jay
Jay Jayaratne
Jennifer Jewiss
Burke Johnson
Jeannette Johnson
Kathleen Johnson
Andrea LK Johnston
Nalin Johri
Melanie S Jones
Gretchen Jordan
Kris Juffer
George Julnes
Summers Kalishman
Kas Karuskevic
Alice Kawakami
Yvonne Kellar-Guenther
Kathleen Kelsey
Brianna Kennedy
Teserach Ketema
Shaila Khan
Madeleine Kimmich
Jean King
Edward Kissam
Ted Kniker
Chris Koliba
Matthias Koopmans
Danijela KoromDjakovic
Joseph Kosciw
Deborah H Kwon
Laura L’Heureux
Candace Lacey
Robert LaChausse
Jessica Ladage
Susan Ladd
Joan LaFrance
Page 10
Morris Lai
Donna Lander
Cecile Lardon
Mandi Larsen
John Lavelle
Rene Lavinghouze
Kien S Lee
Anna Lobosco
Armando Loera Varela
Jill Lohmeier
Paul Longo
Paul Lorton Jr
Justin Louie
Craig Love
James Luther
Anna Madison
Shelly Mahon
Colleen Manning
Krystin Martens
Lorraine Martinez
Karen Matheson
Sandra Mathison
Ann Maxwell
Ron Maynard
Treseen McCormick
Dan McDonald
Katie McDonald
Jack McKillip
Christopher McKinney
Tom Mcklin
Patrick McKnight
Edward McLain
Erin Mehalic Burr
J Michael Menke
William Michaud
Matthew Militello
David Miller
Shahpar Modarresi
Ruth Mohr
Bianca Montrosse
Garrett Moran
Jonathan Morell
Linda Morrell
Jennifer Morrow
Michael Mueller
Deena Murphy
Evaluation 2007
Keith S Murray
Barry Nagle
Neva Nahan
Julius Najab
John Nash
Randi K Nelson
Fred Newman
Allison Nichols
Janice Noga
Emma Norland
Lisa O’Leary
Mary Ohmer
Anane Olatunji
Lisa O'Leary
Tina Olsson
Sandra Ortega
Rhonda Ortiz
Jeannette Oshitoye
John O'Sullivan
Rita O'Sullivan
Emiel W Owens Jr
Asil Ozdogru
Mehmet Dali Öztürk
Dale Pahl
Tracy Patterson
Katye Perry
Donna Peterson
Carrie Petrucci
Timothy Pettit
Patricia Pokay
Ridish Pokharel
Scott Pollack
Charles Potter
Mary Poulin
Hallie Preskill
Shana L Pribesh
Roger Przybylski
Marylynn Quartaroli
Barbara Radecki
Mushtaq Rahim
Ehren Reed
Shani A Reid
Tony Rey
Robert Richard
William Rickards
James Riedel
Rigoberto Rincones
John Risley
Rhoda Risner
Liesel Ritchie
Cindy Roberts-Gray
Melinda Roden
Eunice Rodriguez
Liliana RodriguezCampos
Juan Rogers
Patricia Rogers
Shyanika Rose
Sharon Ross
Laurie Ruberg
Darlene Russ-Eft
Katherine Ryan
Nino Saakashvili
Sue Ann Sarpy
James Sass
Neil Schiavo
Daniela C Schroeter
Larry Seawright
Christina Segerholm
Joyce Serido
John Sherman
Jha Shreyasi
Cindy Shuman
Souraya Sidani
Benjamas Siripatra
Cathy Sleezer
Dawn Smart
Iris Smith Smith
Neale Smith
Juna Snow
Hung Sonya
Kathlyn Steedly
Blair Stevenson
Herbert Struss
Yolanda SuarezBalcazar
Bhuvana Sukumar
Ché Tabisola
George Teather
Heike Thiel de
Bocanegra
Veronica Thomas
Bill Thorndike
Bill Thornton
Cidhinnia M Torres
Campos
James Trudeau
Susan Tucker
Diana Urbanas
Janet Usinger
Kim van der Woerd
Laurie Van Egeren
James Van Haneghan
Stanley Varnhagen
Vamsi Vasireddy
Elena Vinogradova
Christopher Vowels
Connie Walker
Leigh Wang
Thomas E Ward
Denice Ward Hood
Deborah Wasserman
Brad Watts
Hersh Waxman
Stacy Wenzel
Richard West
Katharine Wheatley
Jeffrey White
Machteld Willemse
Aisha Williams
Alison Williams
Bob Williams
Jackie Williams Kaye
Werner Wittmann
Michael Wolf-Branigin
Christel Woodward
Barbara Wygant
Clarisa Yata
Brian Yates
Elmer Yglesias
Kai Young
Mina Zadeh
Karen Zannini
Lei Zhang
Klaus Zinoecker
Brian Zuckerman
Ann Zukoski
Keith Zvoch
Page 11
Professional Development Workshops
Monday and Tuesday,
November 5 and 6, 9 am to 4 pm
Professional development workshops precede and follow the actual
conference. These two-day sessions require a separate registration
fee of $300 for members, $400 for nonmembers, and $160 for
students. They are filled on a first-come, first-served basis and we
expect that most of the two-day workshops will be full prior to the
event. For those workshops that have not filled, on-site registration
is available in Portland. Rooms are assigned at the conference and
appear on your conference nametag.
1. Qualitative Methods
Qualitative data can humanize evaluations by portraying people
and stories behind the numbers. Qualitative inquiry involves using
in-depth interviews, focus groups, observational methods, and
case studies to provide rich descriptions of processes, people, and
programs. When combined with participatory and collaborative
approaches, qualitative methods are especially appropriate for
capacity-building-oriented evaluations.
Through lecture, discussion, and small-group practice, this
workshop will help you to choose among qualitative methods and
implement those methods in ways that are credible, useful, and
rigorous. It will culminate with a discussion of new directions in
qualitative evaluation.
You will learn:
•
Types of evaluation questions for which qualitative
inquiry is appropriate,
•
Purposeful sampling strategies,
•
Interviewing, case study, and observation methods,
•
Analytical approaches that support useful evaluation.
Michael Quinn Patton is an independent consultant and professor
at the Union Institute. An internationally known expert on
utilization-focused evaluation and qualitative methods, he
published the third edition of Qualitative Research and Evaluation
Methods (SAGE) in 2001.
Level: Beginner, no prerequisites
Scheduled: Monday and Tuesday, November 5 and 6, 9 am – 4 pm
2. Quantitative Methods
Quantitative data offers opportunities for numerical descriptions of
populations and samples. The challenge is in knowing which
analyses are best for a given situation. Designed for the
practitioner needing a refresher course and/or guidance in
applying quantitative methods to evaluation contexts, the
workshop covers the basics of parametric and nonparametric
statistics, as well as how to report your findings.
Hands-on exercises and computer demonstrations interspersed
with mini-lectures will introduce methods and concepts. The
instructor will review examples of research and evaluation
questions and the statistical methods appropriate to developing a
quantitative data-based response.
You will learn:
•
The conceptual basis for a variety of statistical
procedures,
•
How more sophisticated procedures are based on the
statistical basics,
•
Which analyses are most applicable for a given data set
or evaluation question,
•
How to interpret and report findings from these analyses.
Katherine McKnight applies quantitative analysis as Director of
Program Evaluation for Pearson Achievement Solutions.
Additionally, she teaches Research Methods, Statistics, and
Measurement in Public and International Affairs at George Mason
University in Fairfax, VA.
3. Evaluation 101: Intro to Evaluation Practice
Begin at the beginning and learn the basics of evaluation from an
expert trainer. The session will focus on the logic of evaluation to
answer the key question: "What resources are transformed into
what program evaluation strategies to produce what outputs for
which evaluation audiences, to serve what purposes." Enhance
your skills in planning, conducting, monitoring, and modifying the
evaluation so that it generates the information needed to improve
program results and communicate program performance to key
stakeholder groups.
A case-driven instructional process, using discussion, exercises,
and lecture will introduce the steps in conducting useful
evaluations: Getting started, Describing the program, Identifying
evaluation questions, Collecting data, Analyzing and reporting, and
Using results.
You will learn:
•
The basic steps to an evaluation and important drivers of
program assessment,
•
Evaluation terminology,
•
Contextual influences on evaluation and ways to respond,
•
Logic modeling as a tool to describe a program and
develop evaluation questions and foci,
•
Methods for analyzing, and using evaluation information.
John McLaughlin has been part of the evaluation community for
over 30 years working in the public, private, and non-profit sectors.
He has presented this workshop in multiple venues and will tailor
this two-day format for Evaluation 2007.
Evaluation 2007: Professional Development Workshops
Page 12
4. Logic Models for Program Evaluation and
Planning
Many programs fail to start with a clear description of the program
and its intended outcomes, undermining both program planning
and evaluation efforts. The logic model, as a map of what a
program is and intends to do, is a useful tool for clarifying
objectives, improving the relationship between activities and those
objectives, and developing and integrating evaluation plans and
strategic plans.
First, we will recapture the utility of program logic modeling as a
simple discipline, using cases in public health and human services
to explore the steps for constructing, refining and validating
models. Then, we'll examine how to improve logic models using
some fundamental principles of "program theory", and, finally,
demonstrate how to use logic models effectively to help frame
questions in evaluation, performance measurement, and strategic
planning. Both days use modules with presentations, small group
case studies, and debriefs to reinforce group work.
You will learn:
•
To construct logic models,
•
To use program theory principles to improve a logic
model,
•
To develop an evaluation focus based on a logic model,
•
To use logic models to answer strategic planning
questions and select and develop performance
measures.
Thomas Chapel is the central resource person for planning and
program evaluation at the Centers for Disease Control and
Prevention and a sought after trainer. Tom has taught this
workshop for the past four years to much acclaim.
•
Responses to challenges in participatory evaluation
practices,
•
Four frameworks for reflective evaluation practice.
Jean King has over 30 years of experience as an award-winning
teacher at the University of Minnesota. As an evaluation
practitioner, she has received AEA’s Myrdal award for outstanding
evaluation practice. Laurie Stevahn is a professor at Seattle
University with extensive facilitation experience as well as applied
experience in participatory evaluation.
Prerequisites: Basic evaluation skills
Level: Intermediate
6. Evaluating Inter- and Intra- Organizational
Collaboration
“Collaboration” is a ubiquitous, yet misunderstood, underempiricized and un-operationalized construct. Program and
organizational stakeholders looking to do and be collaborative
struggle to identify, practice and evaluate it with efficacy.
This workshop aims to increase participants’ capacity to
quantitatively and qualitatively examine the development of interand intra-organizational partnerships. Assessment strategies and
specific tools for data collection, analysis and reporting will be
presented. You will practice using assessment techniques that are
currently being employed in the evaluation of PreK-16 educational
reform initiatives and other grant-sponsored endeavors including
the Safe School/Healthy Student initiative. The processes and
tools are applicable across all areas of practice from health and
human services to business to governmental networks and
agencies.
You will learn:
•
The principles of collaboration so as to understand and
be able to evaluate the construct,
•
Specific strategies, tools and protocols used in
qualitative and quantitative assessment,
5. Participatory Evaluation
•
Participatory evaluation practice requires evaluators to be skilled
facilitators of interpersonal interactions. This workshop will provide
you with theoretical grounding (social interdependence theory,
conflict theory, and evaluation use theory) and practical
frameworks for analyzing and extending your own practice.
How to assess formatively the development of interpersonal, intra-organizational collaboration in grantfunded programs,
•
How stakeholders use the evaluation process and
findings to improve organizational collaboration.
Through presentations, discussion, reflection, and case study, you
will experience strategies to enhance participatory evaluation and
foster interaction. You are encouraged to bring examples of
challenges faced in your practice for discussion to this workshop
consistently lauded for its ready applicability to real world
evaluation contexts.
You will learn:
•
Strategies to foster effective interaction, including belief
sheets; values voting; three-step interview; cooperative
rank order; graffiti; jigsaw; and data dialogue,
Rebecca Gajda has facilitated workshops and courses for adult
learners for more than 10 years and is the Director of Educational
of Research and Evaluation for a large-scale school improvement
initiative. Her most recent publication on the topic of organizational
collaboration can be found in the March 2007 issue of AJE.
Prerequisites: Basic understanding of organizational change
theory/systems theory and familiarity with mixed methodological
designs.
Level: Intermediate
Page 13
You will learn:
7. Survey Design and Administration
A standout from the 2006 and program, this workshop has been
updated and expanded to a two-day offering for 2007. Designed
for beginners with little or no background in survey development,
you will be introduced to the fundamentals of survey design and
administration, and leave with tools for developing and improving
your own surveys as part of your evaluation practice.
This interactive workshop will use a combination of direct
instruction with hands-on opportunities for participants to apply
what is learned to their own evaluation projects. We will explore
different types of surveys, how to identify the domains included in
surveys, how to choose the right one, how to administer the survey
and how to increase response rates and quality of data. You will
receive handouts with sample surveys, item writing tips, checklists,
and resource lists for further information.
You will learn:
•
The various types and formats of surveys,
•
Procedures for high quality survey design,
•
How to write high quality questions,
•
Strategies for increasing reliability and validity.
Courtney Malloy and Harold Urman are consultants at Vital
Research, a research and evaluation firm that specializes in survey
design. They both have extensive experience facilitating workshops
and training sessions on research and evaluation for diverse
audiences.
Full Day Workshops,
Tuesday, November 6, 9 AM to 4 PM
9. Introduction to Longitudinal Analysis
Many evaluation studies make use of longitudinal data. However,
while much can be learned from repeated measures, the analysis of
change is also associated with a number of special problems, e.g.
the unreliability of change scores. This workshop reviews how
traditional methods in the analysis of change, such as the paired ttest, and repeated measures ANOVA or MANOVA, address these
problem. From there, we will move to the core of the workshop, an
introduction to latent growth curve modeling (LGM) and how to
specify, estimate, and interpret growth curve models.
The workshop will be delivered as a mixture of PowerPoint
presentation, group discussion, and exercises with a special focus
on model specification. Processes for setting up and estimating
models will be demonstrated using different software packages,
and a number of practical examples will help to illustrate the
material. You will receive all slides as handouts as well as
recommendations for further reading and study.
•
How to detect reliable sources of variance in individual
differences of intraindividual change,
•
Special problems associated with the analysis of
longitudinal data,
•
The advantages and limitations of conventional
techniques for the analysis of change,
•
How to specify, estimate and interpret latent growth curve
models (LGM),
•
Recent developments in latent growth curve modeling.
Manuel C Voelkle is a research associate at the University of
Mannheim where he teaches courses on multivariate data analysis
and research design and methods. Werner W. Wittmann is
professor of psychology at the University of Mannheim, where he
heads a research and teaching unit specializing in research
methods, assessment and evaluation research.
Level: Intermediate - Prerequisites: Basic understanding of
structural equation models and regression analytic techniques.
Experience with analyzing longitudinal data is advantageous.
Scheduled: Tuesday, November 6, 9 am – 4 pm
10. RealWorld Evaluation: Conducting
Evaluations with Budget, Time, Data and
Political Constraints
What do you do when asked to perform an evaluation on a program
that is well underway? When time and resources are few, yet
expectations high? When questions about baseline data and
control groups are met with blank stares? When time and resources
are few, yet clients expect “rigorous impact evaluation”? When
there are political pressures to address?
The RealWorld Evaluation approach will be introduced and its
practical utility assessed through presentations and discussion,
and through examples drawn from the experiences of presenters
and participants. This well-developed seven-step approach seeks
to ensure the best quality evaluation under real-life constraints.
You will learn:
•
The seven steps of the RealWorld Evaluation approach,
•
Context-responsive evaluation design alternatives,
•
Ways to reconstruct baseline data,
•
How to identify, and overcome threats to the validity or
adequacy of evaluation methods.
Jim Rugh and Michael Bamberger recently co-authored, with Linda
Mabry, the book Real World Evaluation, Working Under Time, Data
and Political Constraints (SAGE 2006). The two presenters bring
over eighty years of professional evaluation experience, mostly in
developing countries around the world.
Level: Intermediate - Prerequisites: Basics of evaluation
Page 14
11. Developing Reliable and Valid
Questionnaires
12. Growing Your Evaluation Business from
Surviving to Thriving
Increasingly, individuals and organizations are being asked to
collect, manage, and use information for decision-making,
particularly to improve the quality of services and products. Rather
than basing decisions on hunches and intuition, decision-making is
viewed as being a “data-driven” process, one which is systematic
and produces trustworthy information.
Interested in growing your evaluation business? This workshop
brings together business, service, and marketing concepts from
recent publications such as Jim Collin's Good to Great, Robert
Schwartz and John Mayne's Quality Matters, and the recent New
Directions for Evaluation issue on Independent Evaluation
Consulting, and applies them to small evaluation consulting firms.
Employing lecture, hands on exercises, and discussion, this
workshop will focus on developing reliable and valid
questionnaires. A variety of both supply and selection item formats
will be presented, including short answer, fill in the blank, paired
comparison ranking, rating scales, checklists, etc. Types of
reliability to be discussed include measures of stability over time
and instrument consistency. Validity discussion will focus on face,
content, criterion related, and construct validity. Overall, we will
emphasize the practical “how to” aspects of developing good
questionnaires and observational instruments.
The workshop begins with a self-assessment where attendees rate
their evaluation businesses in terms of being a sustainable asset.
You will then look into the future and dream about what you would
like your business to become in terms of sales, profitability and
sustainability. The remainder of the workshop focuses on ways to
get from where the business is today to where you would like your
business to be in the future. The workshop will be highly interactive
and use numerous real-life situations for analysis and
recommendations for ways to proactively and deliberately grow.
You will learn:
•
Ways that instruments are used for decision-making,
research and evaluation,
•
How research methodology may influence the choice of
instrument,
•
Approaches to constructing instruments and the pros and
cons of each approach,
•
Ways to demonstrate the validity and reliability of the
results produced by an instrument.
David Colton and Robert W. Covert teach instrument construction
at the Curry School of Education, University of Virginia. The
presenters are coauthors of the text Designing and Constructing
Instruments for Social Research and Evaluation to be published
this summer by Jossey-Bass.
You will learn:
•
To move your evaluation businesses forward in terms of
sales, profitability and sustainability,
•
To build a sustainable plan for marketing your evaluation
services,
•
Methods for assuring the highest quality of evaluation
services to clients,
•
Ways to structure your company and services so that your
business becomes a saleable asset.
Melanie Hwalek is the founder and owner of SPEC Associates, a
program evaluation and research company that has thrived over the
past 27 years. She is co-author of the 2006 New Directions for
Evaluation article "Building Your Evaluation Business into a
Valuable Asset.” Victoria Essenmacher is a partner and business
manager of SPEC Associates and has provided extensive consulting
to non-profit organizations on issues of high-quality performance
measurement systems.
Prerequisites: Experience conducting evaluations as a small
business owner or self-employed contractor.
Level: Intermediate
Page 15
13. Best Practices in Quantitative Methods:
Attending to the Little Things Makes a Big
Difference
Learn the latest advances in data management, statistical testing,
and outcome measurement! Best practices are common in every
field. Program evaluators and, in particular, quantitatively-oriented
evaluators, ought to have the same benefit of keeping abreast of
these "best" practices as their professional counterparts in other
fields.
Through short lectures, didactic inquiry, and demonstrations, the
session will explore data-handling including coding and
transforming variables and computing new variables, working with
missing data, statistical testing including statistical power and
effect size estimation, and quantitatively capturing outcomes in
program and policy implementation.
You will learn:
•
Best practices for handling and managing data including
coding and transformation of variables,
•
Best practices for statistical testing including estimating
statistical power and effect size,
•
Best practices for capturing outcomes including
designing useful measures for relevant outcomes.
Patrick McKnight is a professor of psychology at George Mason
University where he teaches statistics and methods courses, and is
the co-chair of AEA's Quantitative Methods Topical Interest Group
(TIG). An experienced facilitator, his engaging style renders the
complex accessible and well worth the time and investment.
Level: Intermediate - Prerequisites: Working knowledge of a
statistical package and a sound understanding of univariate,
bivariate (correlations and t-tests), and multivariate (GLM, ANOVA,
multiple regression) statistical procedures.
14. Using Systems Tools in Evaluation
Situations
The field of systems inquiry is as diverse and complicated as the
field of evaluation. When the two are placed side-by-side, the
complexities seem to multiply. The purpose of this session is to
bring the use of systems concepts down to earth for real-world
evaluation scholars and practitioners.
Over the course of the day, we will address a variety of difficult
questions: When and why should an evaluator think about systemic
aspects of a situation? What does it mean to treat a situation in a
systemic way? How can I take the step from thinking about
situations systemically and to evaluating them systemically? In
short lecturettes, reflection, experience, and group discussion, you
will explore these questions and come to a personal realization
about what a systems-approach would mean to your own
evaluation practice.
You will learn:
•
Basic systems principles that underpin system tools,
•
Which systems tools are appropriate for particular
evaluation tasks,
•
Three useful evaluation tools from three distinct systems
traditions.
Bob Williams is an independent consultant who has been at the
forefront of incorporating systems based ideas into evaluation
practice. His own experience of using systems theory in practice
dates back over 30 years. Glenda Eoyang is founding Executive
Director of the Human Systems Dynamics Institute. Among other
publications, she is the author or co-author of Coping with Chaos:
Seven Simple Tools, and Facilitating Organization Change: Lessons
from Complexity Science.
Level: Intermediate - Prerequisites: Knowledge of multiple
evaluation methods and experience conducting evaluations.
15. Lenses, Filters, Frames: Cultivating Self as
Responsive Instrument
Evaluative judgments are inextricably bound up with culture and
context and call for diversity-grounded, multilateral self-awareness.
Excellence and ethical practice in evaluation are intertwined with
orientations toward, responsiveness to, and capacities for
engaging diversity. Breathing life into this expectation calls for
critical ongoing personal homework for evaluators regarding their
lenses, filters and frames vis-a-vis judgment-making.
Together, we will cultivate a deliberative forum for exploring these
issues using micro-level assessment processes that will help
attendees to explore mindfully the uses of self as knower, inquirer
and engager of others within as well as across salient diversity
divides. We often look but still do not see, listen but do not hear,
touch but do not feel. Evaluators have a professional and ethical
responsibility to address the ways our lenses, filters and frames
may obscure or distort more than they illuminate.
You will learn:
•
To cultivate the self responsive instrument and
understand yourself in dynamically diverse contexts,
•
To expand and enrich your diversity-relevant knowledge
and skills repertoire,
•
To engage in ongoing assessment of your own lenses,
filters, and frames,
•
To engage in empathic perspective taking,
•
To develop intercultural/multicultural competencies as
process and stance and not simply as a status or fixed
state of being.
Hazel Symonette brings over 30 years of work in diversity-related
arenas and currently serves as a senior policy/planning analyst at
the University of Wisconsin-Madison. She designed, and has
offered annually, the Institute on Program Assessment for over 10
years. Her passion lies in expanding the cadre of practitioners who
embrace end-to-end evaluative thinking/praxis within their
program design and development efforts.
Page 16
16. Evaluation Strategies for Communicating
and Reporting
Communicating evaluation processes and results is one of the
most critical aspects of evaluation practice. Yet, evaluators
continually experience frustration with hours spent on writing
reports that are seldom read or shared. While final reports will
continue to be an expectation of many evaluation contracts, there
are other ways in which evaluators can communicate and report on
the progress and findings from an evaluation.
Using hands-on demonstrations and real-world examples, we will
explore how a variety of strategies for communicating and reporting
can increase learning from the evaluation’s findings, stakeholders’
understanding of evaluation processes, the evaluation’s credibility,
and action on the evaluation’s recommendations.
You will learn:
•
Reasons for communicating and reporting throughout an
evaluation’s life cycle,
•
How stakeholders’ information needs influence your
choice of communicating approaches,
•
More than 15 strategies for communicating and reporting
evaluation processes and findings.
Rosalie T Torres is president of Torres Consulting Group, a research,
evaluation and management consulting firm specializing in the
feedback-based development of programs and organizations since
1992. She has authored/co-authored numerous books and
articles including, Evaluation Strategies for Communicating and
Reporting (Torres, Preskill, & Piontek, 2005), and Evaluative
Inquiry for Learning in Organizations (Preskill & Torres, 1999).
17. Introduction to Needs Assessment and
Designing Needs Assessment Surveys
Assessing needs is a task often assigned to evaluators with the
assumption that they have been trained in or have experience with
the activity. However, surveys of evaluation training indicated that
only one formal course on the topic was being taught in university
based evaluation programs.
This workshop uses multiple hands-on activities interspersed with
mini-presentations and discussions to provide an overview of
needs assessment and a strong emphasis on designing needs
assessment surveys. The focus will be on basic terms and concepts,
models of needs assessment, steps necessary to conduct a needs
assessment, and an overview of methods with particular focus on
the design and nature of needs assessment surveys.
You will learn:
•
Definitions of need and need assessment,,
•
Models of needs assessment with emphasis on a
comprehensive 3-phase model,
•
How to plan a needs assessment through the use of a
Needs Assessment Committee,
•
How to design and analyze a needs assessment survey,
•
Qualitative techniques to improve needs assessment.
James Altschuld is a well known author and trainer in the area of
needs assessment and was a pioneer in offering academic training
in needs assessment to evaluators. His recent publications include
co-authorship of the text From Needs Assessment to Action:
Transforming Needs in Solution Strategies (SAGE 2000).
18. Qualitative Software: Considerations of
Context and Analysis
This workshop is based on the premise that the use of qualitative
software does not threaten the methodological integrity of
qualitative researchers’ work, but rather such software serves as a
tool to encourage researchers to maintain their role as primary
agents of their analysis. Coding and qualitative software are
presented as heuristic devices that assist the search for meaning in
qualitative data.
The agenda is designed to use practical experience with real data
to direct conversation around important principles that shape
qualitative analysis. “Context” is explored from several angles as a
way to emphasize the importance of movement from the particular
to the holistic. Pre-code work can outline the context of data
collection episodes. Code evolution should occur with conscious
attention to the context of an entire research project. Memo writing
is presented as a resource for considering context of real-life
meaning to what we see in data.
You will learn:
•
How and when to integrate qualitative software into the
analysis process,
•
The value of context in analytic decision-making,
•
Processes that support the evolution of coding qualitative
data,
•
Strategies for moving through coding to latter phases of
ascertaining meaning from qualitative data.
Ray Maietta is President and founder of ResearchTalk Inc, a
qualitative inquiry consulting firm. He is an active qualitative
researcher, research consultant, and teacher of qualitative
analysis. Over 10 years of consultation with qualitative researchers
provide the backdrop of this workshop, which uses materials from a
manuscript in preparation by the facilitator, Sort and Sift, Think and
Shift, to be completed in 2008.
Prerequisites: Basic understanding of qualitative data analysis.
Level: Intermediate
Page 17
You will learn:
One Day Workshops,
Wednesday, November 7, 8 AM to 3 PM
19. Using Effect Size and Association Measures
Answer the call to report effect size and association measures as
part of your evaluation results. Improve your capacity to understand
and apply a range of measures including: standardized measures
of effect sizes from Cohen, Glass, and Hedges; Eta-squared;
Omega-squared; the Intraclass correlation coefficient; and
Cramer’s V.
Through mini-lecture, hands-on exercises, and demonstration, you
will improve your understanding of the theoretical foundation and
computational procedures for each measure as well as ways to
identify and correct for bias.
•
Frameworks and guidelines for conducting advocacy
evaluations,
•
Ways to create nimble and flexible evaluations that allow
for real-time improvement,
•
Practical tools that can assist with evaluation efforts,
Techniques to identify outcomes that can be used as milestones for
success.
Justin Louie, a consultant with Blueprint Research & Design, Inc.,
works with nonprofits and foundations to help them evaluate their
advocacy efforts, and has conducted leading research on this topic
for The California Endowment. Ehren Reed, a Senior Associate with
Innovation Network, Inc., leads a number of evaluations of policy
change initiatives and conducts field-building research for national
foundations.
Level: Intermediate - Prerequisites: Basic Evaluation Skills
Scheduled: Wednesday, November 7, 8 am – 3 pm
You will learn:
•
How to select, compute, and interpret the appropriate
measure of effect size or association,
•
Considerations in the use of confidence intervals,
•
SAS and SPSS macros to compute common effect size
and association measures,
•
Basic relationships among the measures.
Jack Barnette hails from The University of Alabama at Birmingham.
He has been conducting research and writing on this topic for the
past ten years. Jack has won awards for outstanding teaching and
is a regular facilitator both at AEA's annual conference and the
CDC/AEA Summer Evaluation Institute.
21. Utilization-focused Evaluation
Evaluations should be useful, practical, accurate and ethical.
Utilization-focused Evaluation is a process that meets these
expectations and promotes use of evaluation from beginning to
end. With a focus on carefully targeting and implementing
evaluations for increased utility, this approach encourages
situational responsiveness, adaptability and creativity.
With an overall goal of teaching you the process of Utilizationfocused Evaluation, the session will combine lectures with concrete
examples and interactive case analyses, including cases provided
by the participants.
You will learn:
Level: Advanced - Prerequisites: Univariate statistics through
ANOVA and understanding of and use of confidence levels.
•
Basic premises and principles of Utilization-focused
Evaluation (U-FE),
•
Practical steps and strategies for implementing U-FE,
20. Evaluating Advocacy and Policy Change
Efforts
•
Strengths and weaknesses of U-FE, and situations for
which it is appropriate.
Evaluations of advocacy, community organizing, and other policy
change efforts present unique challenges for evaluators,
particularly those looking to use evaluation for ongoing learning.
On the ground, change can take years to happen, and when it does,
it may occur in fits and starts. Outside forces can affect efforts in
unforeseen ways, causing advocates' strategies to shift, goals to
be abandoned, and new goals to be taken up. And current policy
losses can belie gains that spell future success. Evaluators need
strategies for addressing these challenges in evaluation design and
implementation.
Michael Quinn Patton is an independent consultant and professor
at the Union Institute. An internationally known expert on
Utilization-focused Evaluation, this workshop is based on the newly
completed fourth edition of his best-selling evaluation text,
Utilization Focused Evaluation: The New Century Text (SAGE).
Through lecture, discussion, demonstration, and hands-on
activities, this workshop will walk participants through a variety of
strategies for evaluating advocacy and policy change efforts. We
will draw from specific case studies that address real-world
challenges and discuss ways to overcome them.
Page 18
22. Evaluating Program Implementation:
Concepts, Methods, and Applications
Monitoring the manner and degree to which a program, service, or
treatment is implemented is key to valid process and outcome
evaluation. Yet, while many program stakeholders and evaluators
have a general awareness of the diagnostic value associated with
measuring and documenting the delivery and receipt of a planned
intervention, the collection and examination of implementation
data is often an overlooked or contentious aspect of the evaluation
process.
Through lecture, discussion, demonstration, and hands-on
activities, this workshop will explore the benefits offered and the
challenges posed by the collection and usage of implementation
data. Qualitative and quantitative measurement and analytic
strategies will be presented, and the merits of strict adherence to
and strategic adaptation of program protocol will be considered.
You will learn:
•
How the collection and usage of implementation data
can strength an evaluation,
•
How program theory can be used to identify key
intervention components,
•
Selected approaches to measuring implementation,
•
The types of analyses that implementation data facilitate,
•
How to interpret and report findings from these analyses.
Keith Zvoch is an assistant professor at the University of Oregon
with over ten years experience designing and conducting
evaluations of educational and social service interventions.
Lawrence Letourneau is a federal programs administrator at the
University of Nevada, Las Vegas (UNLV) involved in all aspects of
service delivery, management, and evaluation of UNLV’s suite of 16
college access programs.
Level: Intermediate - Prerequisites: A basic understanding of
research design and statistics.
23. Logic Modeling for Program Success
This workshop provides a practical framework for developing logic
models that has been used throughout the United States, Canada,
and Africa. You will practice the skills necessary to develop a logic
map for a problem of interest, prioritize the underlying conditions
appearing in the logic map for strategy development, and identify
potential measures to assess the underlying conditions. Overall,
use of the logic modeling process will help to ensure programs
have the best chance of producing intended outcomes.
Through mini-lectures, discussion, and small group exercises, we
will explore the logic modeling process including how to avoid
activity traps, identify antecedent conditions, and setting up a
program for success.
You will learn:
•
A three step logic modeling process,
•
How to use the logic modeling process to complete the
logic model table often required by funding agencies,
•
Ways to ensure a program has the best chance of
producing its intended effect.
Ralph Renger will lead a team of experienced facilitators who have
offered training in logic modeling to learners at all levels. The
facilitation team developed the three step approach to logic
models and have worked with local, state, national, and
international agencies to develop new programs and restructure
existing programs using the three step logic modeling process.
Level: Intermediate - Prerequisites: Basic understanding of logic
models and familiarity with completing logic models for projects.
24. Concept Mapping for Evaluation: A Mixed
Methods, Participatory Approach
'Concept mapping" is a tool for assisting and enhancing many
types of thinking. By using this methodology, it can help a group
describe and organize its assessment on a topic. Ideas are
represented visually in a series of easy-to-read graphics that
capture specific ideas generated by a group; relationships between
ideas; how ideas cluster together; and how those ideas are valued.
This workshop explore this methodology using lecture, group
discussion and project examples. There will be a particular focus on
the planning stages of a project, as the decisions at this stage are
applicable to any participatory project. A secondary focus will be on
the unique analyses that create a shared conceptual framework for
complex, systems-based issues and represent that in easy-to-read
visuals.
You will learn:
•
Key principles, decisions and steps in the engagement of
stakeholders in systems-based evaluation,
•
How to describe and to recognize appropriate
applications of the concept mapping methodology,
•
The steps in the concept mapping methodology and how
those can be adapted to various situations,
•
How the concept mapping analysis converts qualitative
input into quantitative data that is useful in evaluation
projects,
•
To apply the methodology to their own projects.
Mary Kane and Kathleen Quinlan are, respectively, President and
Senior Consultant at Concept Systems, Inc, a consulting company
that uses the concept mapping methodology as a primary tool in its
planning and evaluation consulting projects. William Trochim is a
Professor and Director of Evaluation for Extension and Outreach at
Cornell University and the author of many peer reviewed
publications on the methodology and countless conference
presentations.
Page 19
25. Performance Measurement in the Public
and Nonprofit Sectors
Managing for Results! Performance-Based Budgeting! Balanced
Score Cards! Dash Boards! Program managers and executives in
the public and non profit sectors are being pushed to embrace
these approaches to assessing how well their programs and
agencies are doing. The unifying thread linking all of these efforts is
performance measurement. So what is needed to measure
performance in an effective and useful manner?
This workshop will provide you with instruction, materials
and exercises to increase your understanding of what constitutes
performance measurement and how to measure program
performance in the public and nonprofit sectors.
You will learn:
•
How to identify pressures and opportunities for
measuring performance,
•
The political challenges to measuring performance and
how to respond to them,
•
Ways to assess the reliability and validity of performance
measures,
•
How to identify performance measures for social services,
You will learn:
•
The pros and cons of using an evaluation study as
dissertation research,
•
How to construct a compelling argument in a dissertation
proposal,
•
The basic process and review criteria for constructing an
effective problem statement and methods section,
•
How to provide the assurances necessary to guarantee
approval of the proposal.
Nick L Smith is the co-author of How to Prepare a Dissertation
Proposal from Syracuse University Press and a past-president of
AEA. He has taught research and evaluation courses for over 20
years at Syracuse University and is an experienced workshop
presenter through NOVA University's doctoral program in
evaluation.
27. Theory-Driven Evaluation for Assess-ing and
Improving Program Planning, Implementation,
and Effectiveness
• Approaches to getting performance measures used.
Kathryn Newcomer is the Director of the Phd in Public Policy and
Administration program at the George Washington University where
she teaches public and nonprofit program evaluation, research
design, and applied statistics. She conducts research and training
for federal and local government agencies on performance
measurement and program evaluation, and has published five
books and numerous articles about performance measurement in
the government and nonprofit sectors.
Learn the theory-driven approach for assessing and improving
program planning, implementation and effectiveness. You will
explore the conceptual framework of program theory and its
structure, which facilitates precise communication between
evaluators and stakeholders regarding evaluation needs and
approaches to addressing those needs. From there, the workshop
moves to how program theory and theory-driven evaluation are
useful in the assessment and improvement of a program at each
stage throughout its life-cycle.
Mini-lectures, group exercises and case studies will illustrate the
use of program theory and theory-driven evaluation for program
planning, initial implementation, mature implementation and
outcomes. In the outcome stages, you will explore the differences
among outcome monitoring, efficacy evaluation and effectiveness
evaluation.
26. How to Prepare an Evaluation Dissertation
Proposal
Developing an acceptable dissertation proposal often seems more
difficult than conducting the actual research. Further, proposing an
evaluation as a dissertation study can raise faculty concerns of
acceptability and feasibility. This workshop will lead you through a
step-by-step process for preparing a strong, effective dissertation
proposal with special emphasis on the evaluation dissertation.
The workshop will cover such topics as the nature, structure, and
multiple functions of the dissertation proposal; how to construct a
compelling argument; how to develop an effective problem
statement and methods section; and how to provide the necessary
assurances to get the proposal approved. Practical procedures and
review criteria will be provided for each step. The workshop will
emphasize application of the knowledge and skills taught to the
participants’ personal dissertation situation through the use of an
annotated case example, multiple self-assessment worksheets,
and several opportunities for questions of personal application.
You will learn:
•
How to apply the conceptual framework of program
theory and theory-driven evaluations,
•
How to conduct theory-driven process and outcome
evaluations,
•
How to conduct integrative process/outcome
evaluations,
•
How to apply program theory to improve program
planning processes.
Huey Chen, professor at the University of Alabama at Birmingham,
is the author of Theory-Driven Evaluations (SAGE), the classic text
for understanding program theory and theory-driven evaluation and
most recently of Practical Program Evaluation (2005). He is an
internationally know workshop facilitator on the subject.
Level: Intermediate - Prerequisites: Evaluation basics
Page 20
28. Introduction to IRT/Rasch Measurement in
Evaluation
•
How to conduct mediation and moderation analyses,
•
How to interpret SPSS regression output,
Program evaluation has great need for the development of valid
measures, e.g. of the quantity and quality of services and of the
outcomes of those services. Many evaluators are frustrated when
existing instruments are not well tailored to the task and do not
produce the needed sensitive, accurate, valid findings.
•
How to present findings in useful ways.
Through an extensive presentation, followed by discussion and
hands-on work with data sets and computer-generated output, this
workshop will explore Rasch Measurement as a means to
effectively measure program services. It provides an overview of
“modern” measurement as practiced using item response theory
with a focus on Rasch measurement. Rasch analysis provides the
social sciences with the kind of measurement that characterizes
measurement in the natural sciences.
You will learn:
•
Differences between Classical Test Theory and Rasch
Measurement,
•
Why, when, and how to apply Rasch measurement,
•
Why and how Rasch seeks to create linear, interval
measures,
•
Interpretation of Rasch/Winsteps output
Kendon Conrad and Barth Riley are from the University of Illinois at
Chicago. They bring extensive experience in both teaching about,
and applying, Rasch measurement to evaluation. Their workshops
have won high praise from participants for their down-to-earth,
clear, applied presentation with discussion.
Level: Intermediate - Prerequisites: Evaluation Basics
29. Applications of Multiple Regression in
Evaluation: Mediation, Moderation, and More
Multiple regression is a powerful tool that has wide applications in
evaluation and applied research. Regression analyses are used to
describe relationships, test theories, make predictions with data
from experimental or observational studies, and model linear or
nonlinear relationships. Issues we’ll explore include selecting
specific regression models that are appropriate to your data and
research questions, preparing data for analysis, running the
analyses, interpreting the results, and presenting findings to a
nontechnical audience.
The facilitator will demonstrate applications from start to finish
with SPSS and Excel, and then you will tackle multiple real-world
case examples in small groups. Detailed handouts include
explanations and examples that can be used at home to guide
similar applications.
Dale Berger is Professor of Psychology at Claremont Graduate
University where he teaches a range of statistics and methods
courses for graduate students in psychology and evaluation. He
was President of the Western Psychological Association and
recipient of the WPA Outstanding Teaching Award.
Level: Intermediate - Prerequisites: Basic statistics
30. Public Health Evaluation: Getting to the
Right Questions
In 1999, the Centers for Disease Control and Prevention published
the Evaluation Framework to provide public health professionals
with a common evaluation frame of reference. Public health
practitioners have successfully used the framework in a variety of
settings and contexts. Beyond the framework, however, there are
nuances and complexities to planning and implementing
evaluations in public health settings.
Employing discussions, real examples, and activities, this
workshop will focus on topics for evaluators to consider and
strategies for approaching public health evaluations to get to the
right questions to be addressed in a variety of evaluation contexts.
This session will go beyond the CDC Evaluation Framework to
examine confounders and complexities of public health evaluation.
You will learn
•
Unique aspects of evaluability assessment in public
health settings,
•
Elements to consider to get to the right questions for the
evaluation, including politics, accountability, ongoing
evaluations, and rotating personnel,
•
Strategies to work with stakeholders to identify what
types of evidence will have credibility,
•
Strategies to develop indicators for chosen evaluation
questions.
Mary V Davis is Director of Evaluation Services at the North Carolina
Institute for Public Health and Adjunct Faculty in the University of
North Carolina School of Public Health where she teaches several
advanced evaluation courses. Diane Dunet is a Senior Program
Evaluator in the Division of Nutrition and Physical Activity where she
conducts and supervises public health evaluations.
You will learn:
•
Concepts important for understanding regression,
•
Procedures for conducting computer analysis, including
SPSS code,
Page 21
31. Managing Experimental Designs in
Evaluation
•
Quick and easy methods for presenting data,
•
Innovative methods for graphing data,
Evaluators and administrators are increasingly expected to conduct
studies using what are called scientifically-based methods. This
workshop will provide you with the knowledge and ability to design
and implement both random assignment experiments and
alternative rigorous designs that can satisfy demands for
scientifically-based methods.
•
Ways to decide if quantitative information should be
presented graphically/visually versus in words/text.
With an emphasis on hands-on exercises and individual
consultation within the group setting, this workshop will provide
you with concrete skills in improving your current or anticipated
work with experimental design studies.
Stephanie Reich is an assistant professor in the department of
education at the University of California, Irvine where her research
focuses on cognitive development and how people process
information. David Streiner is a Professor of Psychiatry at the
University of Toronto and has authored four widely used books in
statistics, epidemiology and scale development.
You will learn:
•
How to conduct evaluability assessments of experimental
and quasi-experimental designs,
•
How to write or evaluate proposals to satisfy demands for
scientifically-based research methods,
•
How to modify experimental designs to respond to
specific contexts,
•
How to conduct quantitative analyses to strengthen the
validity of conclusions and reveal hidden program
impacts.
George Julnes, Associate Professor of Psychology at Utah State
University, has been contributing to evaluation theory for over 15
years and has been working with federal agencies, including the
Social Security Administration, on the design and implementation
of randomized field trials. Fred Newman is a Professor at Florida
International University with over thirty years of experience in
performing front line program evaluation studies.
Level: Intermediate - Prerequisites: Understanding of threats to
validity and the research designs used to minimize them, practical
experience with eval helpful.
33. The "State of the Art" in Evaluation
Together we will explore four 'hot topics' in the field today: (1) The
Geography of the Discipline -- What are its components, what
differentiates it from other disciplines, from a collection of bits and
pieces, leaving 'the brand,' etc.; (2) Current Models and Theories -their variety, strengths and weaknesses, best uses, possible future
directions, etc.; (3) Methodologies and Uses -- what have we
borrowed and extended or improved, which if any are new and
distinctive of evaluation, what is still needed; and (4) The Rest of
the Story -- the political, psychological, economic, educational
dimensions, and what else; and, finally, what should we treat as the
priorities for future development?
This will be a participatory workshop aimed at developing
everyone's individual perspective on the present situation in the
discipline of evaluation. The facilitator will 'open the bidding' on
each topic with a summary and then chair a discussion including
all, to take the topic further. We'll engage in discussion about the
current state of the art in evaluation, the directions the discipline is
taking, and what we can do to set and realize priorities for future
development.
You will learn:
•
What evaluators bring to the table that our research
counterparts do not,
•
How one's identity as an evaluator provides a unique
stance and framing for client and stakeholder
relationships,
•
The state of the art in evaluation - what innovations lie
out there on the cutting edge,
•
Where is the discipline headed and how might we
contribute to a valued and valuable future for evaluation.
32. Visual Presentations of Quantitative Data
Presenting data through graphics, rather that numbers, can be a
powerful tool for understanding data and disseminating
findings. Unfortunately, this method is commonly used to confuse
audiences, complicate research and obscure findings.
This workshop will enable participants to capitalize on the benefits
of visual representation by providing them with tools for displaying
data graphically for presentations, evaluation reports, publications
and continued dialogue with program funders, personnel and
recipients. This workshop will teach you about cognitive processing
and heighten your awareness of the common errors made when
visually displaying multivariate relationships, making you a more
critical consumer of quantitative information.
You will learn:
•
How people process visual information,
•
Ways to capitalize in cognitive processing and minimize
cognitive load,
Michael Scriven is among the most well-known professionals in the
field today with 25 years of work on the philosophy of science. He
has over 90 publications in the field of evaluation. Michael is
excited to offer this brand new workshop at Evaluation 2007.
Page 22
34. Multilevel Models in Program Evaluation
Multilevel models (also called hierarchical linear models) open the
door to understanding the inter-relationships among nested
structures (students in classrooms in schools in districts for
instance), or the ways evaluands change across time (perhaps
longitudinal examinations of health interventions). This workshop
will demystify multilevel models and present them at an accessible
level, stressing their practical applications in evaluation.
Through lectures supplemented with practical examples and
discussion of crucial concepts, the workshop will address four key
questions: When are multilevel models necessary? How can they be
implemented using standard software? How does one interpret
multilevel results? What are recent developments in this arena?
You will learn:
•
The basics of multilevel modeling,
•
When to use multilevel models in your evaluation
practice,
•
How to implement models using widely available
software,
•
Practical applications of multilevel models in education,
health, and international development,
•
The importance of considering multilevel structures in
understanding program theory.
Sanjeev Sridharan is head of evaluation programs and a senior
research fellow at the University of Edinburgh as well as a trainer for
SPSS and an Associate Editor for the American Journal of
Evaluation. He has taught and presented on statistical topics to a
wide variety of audiences including university students, program
practitioners, policy makers, and faculty.
Level: Intermediate - Prerequisites: Basic statistics
35. Evaluation Practice: A Collaborative
Approach
Collaborative evaluation is an approach that actively engages
program stakeholders in the evaluation process. When
stakeholders collaborate with evaluators, stakeholder and
evaluator understanding increases and the utility of the evaluation
is often enhanced. Strategies to promote this type of evaluation
include evaluation conferences, member checking, joint instrument
development, analysis and reporting.
Employing discussion, hands-on activities, and role-playing, this
workshop focuses on these strategies and techniques for
conducting successful collaborative evaluations, including ways to
avoid common collaborative evaluation pitfalls.
•
Collaborative evaluation design and data-collection
strategies.
Rita O'Sullivan of the University of North Carolina and John
O'Sullivan of North Carolina A&T State University have offered this
well-received session for the past six years at AEA. The presenters
have used collaborative evaluation techniques in a variety of
program settings, including education, extension, family support,
health, and non-profit organizations.
Half Day Workshops,
Wednesday, November 7, 8 AM to 11 AM
36. Conducting Online Surveys
The uses for surveys in evaluation are endless, and online surveys
are a relatively new way to conduct survey research. Online surveys
provide promising opportunities for addressing many of the
prohibitive issues of conducting paper surveys or phone surveys,
including reaching target audiences within resource constraints,
yet they are not without their limitations and challenges. This
presentation will better equip evaluators to create design, and
distribute effective online surveys.
Through mini-lectures, discussion, and demonstration, we will
explore how to select an appropriate online survey host, format
survey questions for online administration, create an online survey,
and download data for analysis and reporting. Please note that this
short course focuses on providing examples and an overview rather
than teaching how to use a specific application. As such, there is
no computer use by individual participants.
You will learn:
•
Differences between online and paper surveys, and the
pros and cons of using an online survey,
•
General design principles and ways to make online
surveys visually appealing,
•
Ways to increase response rate, including approaches for
follow-up emails and options for incentives,
•
Options and advantages of commercial software program
and web-based survey hosts.
•
A collaborative approach to evaluation,
Lois Ritter and Valerie Sue are faculty members at California State
University and co-authors of Conducting Online Surveys (SAGE,
2007), a comprehensive guide to the creation, implementation,
and analysis of email and web-based surveys. They are developing
a New Directions for Evaluation volume focusing on online surveys
due out this fall.
•
Levels of collaborative evaluation and when and how to
employ them,
Scheduled: Wednesday, November 7, 8 am – 11 am
•
Techniques used in collaborative evaluation,
You will learn:
Page 23
37. Advanced Performance Measurement
Performance measurement has been a popular analytic and
management tool for the past several years. As a result, many
evaluators have considerable experience in this technique, and
they recognize both the enormous potential and the many
challenges involved. This advanced workshop is for experienced
practitioners who want to wrestle with those difficult issues and
develop options for tackling each one.
In order to respect and utilize the rich experience of the
participants, the workshop will operate more as a seminar than a
training session. In advance of the workshop, you will be asked to
email the facilitator 3-4 difficult issues you wish to have addressed,
and these issues will collectively generate the agenda. The
facilitator will certainly lead the seminar and contribute
suggestions from his experience, but participants are also expected
to share their own ideas and expertise.
You will learn:
38. Identifying, Measuring and Interpreting
Racism in Evaluation Efforts
Historically, racism has been a contributing factor to the racial
disparities that persist across contemporary society. This workshop
will help you to identify, frame, and measure racism's presence.
The workshop includes strategies for removing racism from various
evaluation processes, as well as ways for identifying types of racism
that may be influencing the contexts in which racial disparities- and
other societal programs operate.
Through mini-lectures, discussion, small group exercises, and
handouts, learners will practice at identifying racial biases that
may be embedded in certain research literature, influence of
racism in the contexts of racial disparities programs and
eliminating inadvertent racism that may become embedded in
cross-cultural research.
You will learn:
•
A variety of cross-disciplinary and international
definitions of racism,
•
Strategies for removing/averting racism's presence in
evaluation processes,
•
Common places where racism may hide and influence
the context of programs and problems,
Ways to encourage the all-important use of the
performance measurement data,
•
How to collect five broad types of data concerning racism
as a variable,
A range of content generated from our collaborativelydeveloped agenda.
•
Strategies for collecting data on eight of the several
dozen types of racism described in contemporary crossdisciplinary English-language research literature.
•
The important distinction between performance
measurement and performance management,
•
Specific tips to help at various steps of the performance
measurement process,
•
Ideas for analyzing performance measurement data,
•
•
Michael (Mike) Hendricks has helped a variety of public and nonprofit organizations design and implement performance
measurement systems in his 23 years as a consultant. He has
written articles on performance measurement, co-authored a
manual on analyzing outcome data, and is an experienced trainer
and facilitator.
Level: Advanced - Prerequisites: Solid understanding of the
principles and procedures of performance measurement, several
years of real-world experience implementing a performance
measurement system.
Pauline Brooks is an evaluator and researcher by formal training
and practice. She has had years of university-level teaching and
evaluation experience in both public and private education,
particularly in the fields of education, psychology, social work and
public health. For over 20 years, she has worked in culturally
diverse settings focusing on issues pertaining to underserved
populations, class, race, gender, and culture.
Level: Intermediate - Prerequisites: Previous thinking, work, or
study in the area of discrimination's influence on programs and
processes and an openness to further dialogue and exploration of
racism.
Page 24
39. Evaluating Large Scale Initiatives Using
Systems Thinking
Are you lost in the systems jargon, multiple systems concepts, and
their application to evaluation situations? Are you uncertain how to
evaluate large scale initiatives? Join us to explore ways to select
and apply evaluation methods based on the dynamics of the
complex systems intertwined within large scale initiatives. Learn to
apply system dynamics modeling and tools related to complex
adaptive systems concepts.
Through lecture, small group exercises involving case studies, and
a Q & A session, this workshop will provide a framework for
understanding the nature of the systems involved in large scale
multi-site/multi-project initiatives and the kinds of evaluative
questions that arise out of an understanding of system dynamics.
You will learn:
•
How to capture, save, and analyze stories in evaluation
contexts,
•
How stories for evaluation purposes are often different
from other types of stories.
Richard Krueger is a senior fellow at the University of Minnesota
and has been actively listening for evaluation stories for over a
decade. He has offered well-received professional development
workshops at AEA and for non-profit and government audiences for
over 15 years. Richard is a past president of AEA.
•
How to consider three different system dynamics—
organized, self-organizing, and unorganized—within large
scale initiatives,
Half Day Workshops,
Wednesday, November 7, 12 PM to 3 PM
•
How to align different evaluation designs with different
types of system dynamics,
•
How to design and apply nonlinear systems dynamics
modeling to organized system dynamics,
41. Level Best: How to Help Small and
Grassroots Organizations Tackle Evaluation
•
How to design and apply evaluation methods to selforganizing system dynamics,
•
How this systems orientation relates to commonly used
evaluation methods (e.g., outcomes, process,
participatory, and empowerment evaluation methods).
Beverly Parsons is the executive director of InSites in Colorado and
has over 20 years experience in evaluating education and social
service initiatives. She focuses on the evaluation and planning of
systemic change. Teresa Behrens is the director of evaluation at the
WK Kellogg Foundation. She recently co-edited a special issue of
the American Journal of Community Psychology on systems change.
Level: Intermediate - Prerequisites: Knowledge of or experience in
conducting or planning cluster and/or multi-site evaluations.
Knowledge of multiple theories of evaluation.
Small and grassroots organizations usually have much different
needs and funding sources than larger organizations. This
workshop is based on the presenters' new book, Level Best: How
Small and Grassroots Organizations Can Tackle Evaluation and Talk
Results. This workshop introduces the concept of "rolling
evaluation," and emphasizes that evaluation at its best is about
learning rather than judging, about improving rather than proving,
and that overall, evaluation does not need to be costly, overwrought
or burdensome.
Through lecture, discussion and handouts, we will address the
myths and misperceptions surrounding evaluation of nonprofit
programs, and through the sharing of specific tools and strategies,
will teach you how to support nonprofits in their evaluation efforts.
You will learn:
•
An evaluation process that is scaled to nonprofit realities
and capacity,
•
How to guide a grassroots agency through evaluation,
40. Using Stories in Evaluation
•
How to respond to funder concerns,
Stories are an effective means of communicating the ways in which
individuals are influenced by educational, health, and human
service agencies and programs. Unfortunately, the story has been
undervalued and largely ignored as a research and reporting
procedure. Stories are sometimes regarded with suspicion because
of the haphazard manner in which they are captured or the cavalier
promise of what the story depicts.
•
How to integrate evaluation into the ongoing work of even
the smallest agency.
Through short lecture, discussion, demonstration, and hands-on
activities, this workshop explores effective strategies for
discovering, collecting, analyzing and reporting stories that
illustrate program processes, benefits, strengths or weaknesses.
Marianne Philbin is a consultant with extensive experience working
with foundations and nonprofit organizations on issues related to
evaluation and planning, capacity building and organizational
development. Marcia Festen is the Executive Director of ArtsWork
Fund and co-author with Ms. Philbin of Level Best: How Grassroots
Organizations Can Tackle Evaluation and Talk Results (Wiley,
October 2006).
Scheduled: Wednesday, November 7, 12 pm – 3:00 pm
You will learn:
• How stories can reflect disciplined inquiry,
Page 25
42. Empowerment Evaluation
Empowerment Evaluation builds program capacity and fosters
program improvement. It teaches people to help themselves by
learning how to evaluate their own programs. The basic steps of
empowerment evaluation include: 1) establishing a mission or
unifying purpose for a group or program; 2) taking stock - creating a
baseline to measure future growth and improvement; and 3)
planning for the future - establishing goals and strategies to
achieve goals, as well as credible evidence to monitor change. The
role of the evaluator is that of coach or facilitator in an
empowerment evaluation, since the group is in charge of the
evaluation itself.
Employing lecture, activities, demonstration and case examples
ranging from townships in South Africa to a $15 million HewlettPackard Digital Village project, the workshop will introduce you to
the steps of empowerment evaluation and tools to facilitate the
approach.
You will learn:
•
How to plan and conduct an empowerment evaluation,
•
Ways to employ new technologies as part of
empowerment evaluation including use of digital
photography, quicktime video, online surveys, and webbased telephone/videoconferencing,
•
The dynamics of process use, theories of action, and
theories of use.
David Fetterman hails from Stanford University and is the editor of
(and a contributor to) the recently published Empowerment
Evaluation Principles in Practice (Guilford). He Chairs the
Collaborative, Participatory and Empowerment Evaluation AEA
Topical Interest Group and is a highly experienced and sought after
facilitator.
43. Strategies to Respond to the Top 10
Problems, Challenges and Headaches with
Focus Group Interviewing
Focus groups don't always work as expected. Find out what leading
focus group practitioners say are their top 10 problems, challenges
and headaches AND how they solve those concerns. Also, find out
the concerns among AEA members. AEA workshop participants will
be invited to submit their top concerns as well. So, make your list,
attend the workshop and discover helpful solution strategies.
•
Solution strategies to the top 10 problems, challenges,
and headaches.
Richard Krueger is a senior fellow at the University of Minnesota. In
30+ years of practice he has conducted thousands of focus group
interviews and he still gets excited about listening to people. He is
the author of 6 books on focus group interviewing and is a past
president of AEA.
Level: Intermediate - Prerequisites: Experience in conducting focus
groups
44. Handling Data: From Logic Model to Final
Report
Collect, analyze and present data from complex evaluation studies
in ways that are feasible for the evaluator and meaningful to the
client. Explore lessons learned through over twenty years in
evaluation consulting to ask the right questions, collect the right
data and analyze and present findings in simple yet comprehensive
ways.
Actual data samples will be presented along with examples of
analysis techniques. You will have an opportunity to work in small
groups with sample data and will explore various analysis
techniques. Throughout the workshop, the presenter will respond to
individual questions and facilitate group discussion on data
handling topics. At the end of the workshop, you will take away
fresh ideas to tackle you data handling challenges.
You will learn:
•
To develop and link a program theory, a holistic logic
model, a data collection matrix, and evaluation tools,
•
To ask the right questions and get the answers you need,
•
To develop a data summary that triangulates the
information collected from different sources,
•
To extract and map themes, prepare an evidence table,
and report findings in a comprehensive but user-friendly
way.
Gail Barrington started Barrington Research Group more than 20
years ago and has been conducting complex evaluations ever
since. A top rated facilitator, she has taught workshops throughout
the US and Canada for many years.
Level: Intermediate - Prerequisites: Experience collecting data in
evaluation projects - No in-depth statistical knowledge required
Through presentations, question-and-answer, and exploration of
responses to attendee challenges, this workshop will help you
move your focus group facilitation skills to the next level.
You will learn:
•
Challenges with focus groups as seen by professional
focus group moderators,
•
Challenges with focus groups as seen by AEA members,
Page 26
45. Practical Applications of Propensity Scores
Quasi-experiments are excellent alternatives to true experiments
when random assignment is not feasible. Unfortunately, causal
conclusions cannot easily be made from results that are potentially
biased. Some advances in statistics that attempt to reduce
selection bias in quasi-experiments use propensity scores, the
predicted probability that units will be in a particular treatment
group.
Using real data sets as examples, demonstrations of computation
of propensity scores in SAS and SPSS, and hands-on analysis of
output, you will become adept at when and how to use propensity
scores to adjust for selection bias.
You will learn:
•
A basic methodology for computing propensity scores,
•
The conditions under which propensity scores should,
and should not, be used,
•
How propensity scores can be used to make statistical
adjustments using matching, stratifying, weighting and
covariate adjustment,
•
Known limitations and problems when using propensity
score adjustments,
• How to improve propensity score computations.
M H Clark received her PhD in Experimental Psychology from the
University of Memphis with a specialization in research design and
statistics. She currently is an assistant professor at Southern
Illinois University where she teachers courses focusing on
advanced research methodology, statistics, and program
evaluation.
GTO has been customized for several areas of public health
including: substance abuse prevention, underage drinking
prevention, positive youth development, teen pregnancy
prevention, and emergency preparedness.
You will learn:
•
A comprehensive approach to results-based
accountability,
•
Ten questions to ask to improve program planning,
accountability, and results,
•
How to select evidence-based models and best practices,
• Strategies for continuous program improvement.
Abraham Wandersman is a Professor of Psychology at the
University of South Carolina-Columbia. He is a co-author of
Prevention Plus III and a co-editor of Empowerment Evaluation:
Principles in Practice. Catherine Lesesne is a Behavioral Scientist
in the Division of Reproductive Health at the Centers for Disease
Control and Prevention. She is the lead author of the newly
developed GTO manual, Promoting Science-based Approaches to
Teen Pregnancy Prevention Using Getting to Outcomes.
Scheduled: Sunday, November 11, 9 am – 12 pm
47. Conflict Resolution Skills
Level: Intermediate - Prerequisites: Statistics through regression
Unacknowledged and unresolved conflict can challenge even the
most skilled evaluators. Conflict between evaluators and clients
and among stakeholders create barriers to successful completion
of the evaluation project. This workshop will delve into ways to
improve listening, problem solving, communication and facilitation
skills and introduce a streamlined process of conflict resolution
that may be used with clients and stakeholders.
Through a hands-on, experiential approach using real-life examples
from program evaluation, you will become skilled at the practical
applications of conflict resolution theory as they apply to conflict
situations in program evaluation.
Half Day Workshops,
Sunday, November 11, 9 AM to 12 PM
46. Getting to Outcomes in Public Health
Getting To Outcomes: Methods and Tools for Planning, Evaluation,
and Accountability (GTO) was developed as an approach to help
practitioners plan, implement, and evaluate their programs to
achieve results. GTO is based on answering 10 accountability
questions. By answering the questions well, program developers
increase their probability of achieving outcomes and demonstrate
their accountability to stakeholders. Addressing the 10 questions
involves a comprehensive approach to results-based accountability
that includes evaluation and much more.
Through lecture, demonstration, and hands-on activities, this
workshop will explore the basics of the GTO approach and provide
resources for further investigation and action. Research funded by
a grant from CDC has shown that use of the GTO model can improve
individual capacity and program performance to facilitate the
planning, implementation, and evaluation of prevention programs.
You will learn:
•
The nature of conflict in program evaluation and possible
positive outcomes,
•
How to incorporate the five styles of conflict-resolution as
part of reflective practice,
•
Approaches to resolving conflict among stakeholders
with diverse backgrounds and experiences,
•
Techniques for responding to anger and high emotion in
conflict situations,
•
To problem solve effectively, including win-win
guidelines, clarifying, summarizing, and reframing.
Jeanne Zimmer has served as Executive Director of the Dispute
Resolution Center since 2001 and is completing a doctorate in
evaluation studies with a minor in conflict management at the
University of Minnesota. For over a decade, she has been a very
well-received professional trainer in conflict resolution and
communications skills.
Page 27
48. Advanced Focus Group Moderator Training
The literature is rich in textbooks and case studies on many aspects
of focus groups including design, implementation and analyses.
Missing however are guidelines and discussions on how to
moderate a focus group.
In this experiential learning environment, you will find out how to
maximize time, build rapport, create energy and apply
communication tools in a focus group to maintain the flow of
discussion among the participants and elicit more than one-person
answers. Using practical exercises and examples, including role
play and constructive peer-critique as a focus group leader or
respondent, you will explore effective focus group moderation
including ways to increase and limit responses among individuals
and the group as a whole.
You will learn:
•
Fifteen practical strategies to create and maintain focus
group discussion,
•
Approaches to moderating a focus group while being
sensitive to cross-cultural issues,
•
How to stimulate discussion in community forums,
committee meetings, and social settings.
Nancy-Ellen Kiernan has facilitated over 150 workshops on
evaluation methodology and moderated focus groups in 50+
studies with groups ranging from Amish dairy farmers in barns to
at-risk teens in youth centers, to university faculty in classrooms.
Level: Intermediate - Prerequisites: Having moderated 2 focus
groups and written focus group questions and probes
49. Advanced Applications of Program Theory
While simple logic models are an adequate way to gain clarity and
initial understanding about a program, sound program theory can
enhance understanding of the underlying logic of the program by
providing a disciplined way to state and test assumptions about
how program activities are expected to lead to program outcomes.
Lecture, exercises, discussion, and peer-critique will help you to
develop and use program theory as a basis for decisions about
measurement and evaluation methods, to disentangle the success
or failure of a program from the validity of its conceptual model,
and to facilitate the participation and engagement of diverse
stakeholder groups.
developed one of the largest university-based evaluation training
programs, and has conducted theory-driven evaluations for more
than 100 organizations during the past decade.
Level: Intermediate - Prerequisites: Experience or Training in Logic
Models
50. Building Evaluation Capacity Within
Community Organizations
Are you working with community groups (coalitions, nonprofits,
social service agencies, local health departments, volunteers,
school boards) that are trying to evaluate the outcomes of their
work to meet a funding requirement, an organizational expectation,
or to enhance their own program performance?
Join us in this highly interactive workshop were you will practice and
reflect on a variety of activities and adult learning techniques
associated with three components of evaluation planning: focus,
data collection, and communicating. Try these activities out, assess
their appropriateness for your own situation, and expand your
toolbox. We will draw from a compendium of practical tools and
strategies that we have developed over the past years and have
found useful in our own work. We encourage you to bring your own
‘best practices' to share as we work towards building the
evaluation capacity of communities.
You will learn:
•
Activities to use in building essential evaluation
competence within community-based organizations,
•
Techniques that facilitate learning including use of
peripherals, energizers, role play, reflection, games,
•
What to consider in choosing among options to better
suit needs, requests and realities.
Ellen Taylor-Powell is widely recognized for her work in evaluation
capacity building. Her nearly 20 years in Extension have
continuously focused on evaluation training and capacity building
with focus on individual, team, organizational learning. She will
lead a team of four facilitators with extensive experience both in
teaching adults and in working with community groups and
agencies.
Level: Intermediate - Prerequisites: Involvement in evaluation
capacity building at the community level
You will learn:
•
To employ program theory to understand the logic of a
program,
•
How program theory can improve evaluation accuracy
and use,
•
To use program theory as part of participatory evaluation
practice.
Stewart Donaldson is Dean of the School of Behavioral and
Organizational Sciences at Claremont Graduate University. He has
published widely on the topic of applying program theory,
Page 28
Wednesday, November 7, 2007: Overview of Schedule
7:00 am to 6:30 pm
Registration Desk Open
8:00 am to 5:00 pm
Exhibits Open at Exhibitor Discretion
8:00 am to 11:00 am
Professional Development Workshops (Require separate registration)
12:00 pm to 3:00 pm
Professional Development Workshops (Require separate registration)
3:10 pm to 4:10 pm
Opening Plenary
4:30 pm to 6:00 pm
Concurrent Conference Sessions
6:10 pm to 6:40 pm
Orientation for First Time Attendees and New Members
6:30 pm to 8:00 pm
AEA Poster Exhibition and Reception
My Schedule and Notes:
Evaluation 2007: Wednesday, November 7, Overview
Page 29
Summary of Sessions for Wednesday, November 7, 4:30 PM to 6:00 PM
No Primary Sponsor
Session
Session Title
Room Name
102 Independent Consulting TIG
103 Government Evaluation TIG
Think Tank
Panel
Intermediate Consulting Skills: A Self-Help Fair
Eval and Learning in a Changing Landscape: How Changes to First 5 LA's Eval Framework are Integrated…
Liberty Ballroom Section B
Mencken Room
104 Cluster, Multi-site / Multi-level TIG
Multipaper
Community Focus
Edgar Allen Poe Room
105 Health Evaluation TIG
106 International and Cross-cultural
Think Tank
Think Tank
Awareness and Education: Did You Change Your Behavior This Week?
International Development Evaluation: Opportunities and Challenges for the Use of the DAC Criteria
Carroll Room
Pratt Room, Section A
107 Alcohol, Drug Abuse, and Mental Health TIG
108 AEA Conference Committee
Panel
Roundtable
Building Capacity to Strengthen the Evaluation of Safe Start Promising Approaches: An Evidence-based Approach
Rotation I: Why do Evaluators use the Technology They do and Why are They not a Stronger Factor for Innovating…
Rotation II: The Power of Technology: Using Wikis, Blogs, and Online Tools for Evaluation
Pratt Room, Section B
Douglass Boardroom
109 Org Learning /Nonprofit & Foundations TIGs
Think Tank
Using Evaluative Processes in Foundations: Challenges and Solutions
Hopkins Room
111 Assessment in Higher Education TIG
Multipaper
Evaluation of Multi-Country Teacher Training Programs and Curriculum Policies
Business Meeting Assessment in Higher Education TIG Business Mtg and Presentation: Evaluating Alaska Native Serving
Native Hawaiian-Serving Institutions and Hispanic Serving Institutions of Higher Education
Peale Room
Adams Room
Roundtable
Rotation I: Assessing Student Learning Outcomes: An Examination of a Process That Focuses Upon Improvement…
Rotation II: Evolution of a First Year Seminar: Evaluation for Organizational Learning
Jefferson Room
113
114
115
116
117
Quantitative Methods: Theory and Design
Indigenous Peoples in Evaluation TIG
Org Learning and Eval Capacity Building TIG
Multipaper
MultiPaper
Multipaper
Panel
Panel
New Evaluation Initiatives on Diabetes Prevention and Childhood Obesity: From the National to the School Level
When Leadership Moves From I to We: Evaluating Collective Leadership Development Efforts
Learning From Alternative Models of Evaluation
Providing Meaningful Evaluations for Prevention Projects in Indigenous Communities
Eval of Organizations as Enterprises: Approaches, Appropriate Outcome Expectations, and Potential Indicators
Washington Room
D'Alesandro Room
Calhoun Room
McKeldon Room
Preston Room
118
119
120
121
122
123
124
AEA Conference Committee
Presidential Strand
Extension Education Evaluation TIG
Pre-K - 12 Educational Evaluation TIG
Research, Technology, & Development Eval TIG
Multipaper
Panel
Demonstration
Multipaper
Panel
Panel
Multipaper
Putting Context in Context With Examples in Strategic Planning and Measuring Fidelity
Evaluating the Teaching of Program Evaluation: Student and Teacher Assessments
Facilitating Fast-paced Learning: Developmental Evaluation for Complex Emergent Innovations
Building Evaluation Capacity Within Organizations
When Does Evaluation Not Feel Like Evaluation? Embedding Evaluation Activities Into Programs
Evaluating the Reading First Program: Best Practices and Lessons Learned
Closing the Loop: Mapping Value to Inform Research Management
Schaefer Room
Calvert Ballroom Salon B
Calvert Ballroom Salon C
Calvert Ballroom Salon E
Fairmount Suite
Federal Hill Suite
Royal Board Room
125 Multiethnic Issues in Evaluation TIG
126 Collaborative, Participatory & Emp Eval TIG
Panel
Practicing Culturally-Based Evaluation: Learnings From the Field
Business Meeting Collaborative, Participatory and Empowerment Evaluation TIG Business Meeting
Hanover Suite B
127 Quantitative Methods: Theory and Design TIG
129 Distance Ed. & Other Educational Tech TIG
Multipaper
Panel
Multipaper
Assessing Randomized Control Trials and Alternatives
Crime, Violence and IRT/Rasch Measurement
Evaluation Methodology in Educational Technology Contexts
Baltimore Theater
International Room
Chesapeake Room
Think Tank
International Perspectives on Evaluation Part 1: Evaluating the Impact of Development Projects
International Perspectives on Evaluation Part 2: Institutionalizing Evaluation in Government
Versailles Room
Evaluation 2007: Wednesday, November 7, 4:30 pm to 6:00 pm, Timeslot Overview
Page 30
Wednesday, 3:10 pm to 4:10 pm
100 - Bringing Evaluative Learning to Life
Plenary to be held in Sheraton International Ballroom
Sponsor: Presidential Strand
• Chair - Hallie Preskill,
Claremont Graduate University
• Presenter - Jean King, University
of Minnesota
102 - Intermediate Consulting Skills: A Self-Help Fair
Think Tank to be held in the Liberty Ballroom, Section B on the
Main Lobby Level in the Sheraton
Sponsor: Independent Consulting TIG
• Discussants - Mariam Azin, Planning, Research and
Evaluation Services Associates Inc; Victoria Essenmacher,
Social Program Evaluators and Consultants Inc; Maura
Harrington, Lodestar Management/Research Inc; James
Luther, Luther Consulting LLC; Emmalou Norland, Institute
for Learning Innovation; Geri Peak, Two Gems Consulting
Services; Kathryn Race, Race and Associates Ltd; Dawn
Hanson Smart, Clegg & Associates
• Presenter - Robert Hoke, Independent Consultant
103 - Evaluation and Learning in a Changing
Landscape: How Changes to First 5 LA's Evaluation
Framework Are Integrated by Evaluation Contractors
Panel to be held in the Mencken Room on the Main Lobby
Level in the Sheraton
Sponsor: Government Evaluation TIG
• Chair - Marc Davidson, First 5 Los Angeles
The Evolution of First 5 LA's Evaluation Framework
• Marc Davidson, First 5 Los Angeles
First 5 LA (Los Angeles) and First 5 Kern County Evaluation
Frameworks: Impact on Evaluation
• Grant Power, Semics LLC
Evaluation of a County-Wide Hotline for Families With Young
Children and Their Service Providers
• Elizabeth Harris, EMT Associates Inc
Look for the conference logo
throughout the program to
identify the sessions
selected for the
Presidential Strand
104 - Community Focus
Multipaper to be held in the Edgar Allen Poe Room on the Main
Lobby Level in the Sheraton
Sponsor: Cluster, Multi-site and Multi-level Evaluation TIG
• Chair - Martha Ann Carey, Azusa Pacific University
Multi-site Action Research
• Thomas Fuller-Rowell, Cornell University
Multi-level Evaluation Alignment: A Systematic Approach to
the Evaluation of the Child Care Quality Improvement System
• Xuejin Lu, Karen Brandi, and Lance Till, Children's
Services Council of Palm Beach County
Finding the Threads Across Different Organizations: Different
Community Service Activities: Identifying Common Measures
• Kenneth Terao and Anna Marie Schmidt, JBS
International Inc
Tip: Most sessions are sponsored by one or
more of AEA’s 40 Topical Interest Groups (TIGs).
Use the TIG index in the back of the program to
guide your selection of sessions that match your
professional interests.
105 - Awareness and Education: Did You Change
Your Behavior This Week?
Think Tank to be held in the Carroll Room on the Main Lobby
Sponsor: Health Evaluation TIG
• Discussants - Jaime Dominguez, Catholic Relief Services;
Christy Lynch, Partners in Evaluation and Planning
• Presenter - Anna Kathryn Webb, Catholic Relief Services
106 - International Development Evaluation:
Opportunities and Challenges for the Use of the
Development Assistance Committee (DAC) Criteria
Think Tank to be held in the Pratt Room, Section A on the Lower
Level in the Sheraton South Tower
Sponsor: International and Cross-cultural Evaluation TIG
• Discussants - Thomaz C hianca, Ronald Scott Visscher,
Krystin Martens, Michael Scriven, and Paul Clements,
Western Michigan University
• Presenters - Paul Lamphear, Western Michigan University;
Tererai Trent, Heifer International; Sheri Hudachek, Todd
Harcek, and Ryoh Sasaki, Western Michigan University
Evaluation 2007: Wednesday, November 7, 3:10 pm to 4:10 pm and 4:30 to 6:00 pm
Page 31
Wednesday, 4:30 pm to 6:00 pm, Continued
107 - Building Capacity to Strengthen the Evaluation
of Safe Start Promising Approaches: An Evidencebased Approach
Panel to be held in the Pratt Room, Section B on the Lower
Sponsor: Alcohol, Drug Abuse, and Mental Health TIG
• Chair - Yvette Lamb, Association for the Study and
Development of Community
• Discussant - Kristen Kracke, US Department of Justice
Launching a National Evaluation of the Safe Start Promising
Approaches Initiative: Getting to Green Light
• Lisa Jaycox, RAND Corporation; Kristen Kracke, United
States Department of Justice; Yvette Lamb, Association for
the Study and Development of Community; Dana Schultz,
Laura Hickman, Lauren Honess-Morreale, Dionne Barnes,
RAND Corporation; Joie Acosta, Association for the Study
and Development of Community
Training in Data Collection for a National Evaluation
• Lauren Honess-Morreale, Lisa Jaycox, Suzanne Perry,
Dana Schultz, Laura Hickman, and Dionne Barnes, RAND
Corporation
Improving Quality Assurance When Implementing and
Evaluating an Evidence-Based Intervention in a Community
Setting
• Joie Acosta and Yvette Lamb, Association for the Study
and Development of Community; Dana Schultz, RAND
Corporation
Planning and Communication Strategies to Engage Children,
Families, and Practitioners
• Elena Cohen, Safe Start Center; Yvette Lamb and Joie
Acosta, Association for the Study and Development of
Community
108 – Roundtables
The first rotation will use the first 45-minutes and the second
rotation will use the remaining 45 minutes.
Roundtable to be held in the Douglass Boardroom on the
Lower Level in the Sheraton South Tower
Rotation I: Why do Evaluators use the Technology They do and
Why Are They not a Stronger Factor for Innovating new
Technology for Use in Evaluation
• Brian Chantry and David Williams, Brigham Young
University
Rotation II: The Power of Technology: Using Wikis, Blogs, and
Online Tools for Evaluation
• Cary Johnson, Stephen Hulme, and David Williams,
Brigham Young University
109 - Using Evaluative Processes in Foundations:
Challenges and Solutions
Think Tank to be held in the Hopkins Room on the Lower Level
in the Sheraton South Tower
Sponsors: Organizational Learning and Evaluation Capacity
Building TIG, and Non-profit and Foundations Evaluation TIG
• Discussants - Bill Bickel, University of Pittsburgh;
Catherine Nelson, Independent Consultant; Jennifer Iriti,
University of Pittsburgh
• Presenter - Astrid Hendricks, The California Endowment
110 - Evaluation of Multi-Country Teacher Training
Programs and Curriculum Policies
Multipaper to be held in the Peale Room on the Lower Level in
the Sheraton South Tower
• Chair - Peter Fisch, European Commission
Methodological Lessons and Planning Insights From a
Formative Evaluation of a Pilot of Afghanistan's Teacher
Education Program (TEP) Initiative
• Mohammad Javad Ahmadi, Creative Associates
International Inc
Designing Effective Multi-country Evaluations: Lessons
Learned From a Large Scale Teacher Training Program
• Roshni Menon and Daniel Light, Education Development
Center Inc
Tracking the Consistency: Evaluating the Curriculum Reform
Policy in China
• Wenhui Yuan, Western Michigan University
111 - Assessment in Higher Education TIG Business
Meeting and Presentation: Evaluating Alaska NativeServing/Native Hawaiian-Serving Institutions and
Hispanic Serving Institutions of Higher Education
Business Meeting to be held in the Adams Room on the
Cabana Level in the Sheraton North Tower
Sponsor: Assessment in Higher Education TIG
• Discussant - Deborah H Kwon, The Ohio State University
• Presenters - Henry Doan, Saleia Afele-Faamuli, and Irma
Lawrence, United States Department of Agriculture
• TIG Leader - William Rickards, Alverno College
Did you know? AEA received over 1000
proposals to present at Evaluation 2007.
Evaluation 2007: Wednesday, November 7, 4:30 pm to 6:00 pm
Page 32
112 - Roundtables
Roundtable to be held in the Jefferson Room on the Cabana
Level in the Sheraton North Tower
Rotation I: Evolution of a First Year Seminar: Evaluation for
Organizational Learning
• Karen M Reid, Peggy Perkins, and Amy Morris, University
of Nevada, Las Vegas
Rotation II: Assessing Student Learning Outcomes: An
Examination of a Process That Focuses Upon the Improvement
of Teaching and Learning
• Tanis Stewart, University of Nevada, Las Vegas
113 - New Evaluation Initiatives on Diabetes
Prevention and Childhood Obesity: From the National
to the School Level
Multipaper to be held in the Washington Room on the Cabana
• Chair - Eunice Rodriguez, Stanford University
The National Diabetes Education Program Evaluation
Framework: A Case Study in Evaluation of a National Public
Health Program
• Joanne Gallivan, National Institutes of Health; Clarice
Brown, Social & Scientific Systems Inc; Rachel Greenberg,
Marketing and Communications Consulting
Use of Coordinated School Health Programs as a Strategy for
Diabetes Prevention
• Debra Pinkney, Lynne Borden, Stephen Russell, and
Ralph Renger, University of Arizona
Program Fidelity: The Forgotten Variable in Program
Evaluation
• Janet Clinton and Sarah Appleton, University of Auckland
Evaluating an After-school Health Education Curriculum Using
a Randomized Groups Experimental Design
• Catherine A Oleksiw, Academy for Educational
Development; Paul L Johnson, National Institutes of Health
Real-time Evaluation of Burnley Food and Fitness Program
Aimed at Tackling Childhood Obesity
• Mansoor Kazi, University at Buffalo; Jenny Slaughter, East
Lancashire Primary Care Trust; Nicole Tomasello, University
at Buffalo
114 - When Leadership Moves From I to We: Evaluating Collective Leadership Development Efforts
MultiPaper to be held in the D'Alesandro Room on the Cabana
Sponsor: Non-profit and Foundations Evaluation TIG
• Chair and Discussant - Claire Reinelt, Leadership
Learning Community
114 – Continued
Leadership in the City: How Individuals and Teams Impact a
Community
• Jessica Baltes, Center for Creative Leadership
Improving the Health of the System: A Case Study of Collective
Leadership Within Catholic Healthcare Partners
• Tracy Enright Patterson, Center for Creative Leadership;
Jennifer Martineau, Center for Creative Leadership
Using Social Network Analysis to Evaluate Collective
Leadership and Collaboration
• Emily Hoole, Center for Creative Leadership; Kimberly
Fredericks, Indiana State University
115 - Learning From Alternative Models of Evaluation
Multipaper to be held in the Calhoun Room on the Cabana
Sponsor: Quantitative Methods: Theory and Design TIG
• Chair - Sanjeev Sridharan, University of Edinburgh
Applying Item Response Theory in the Evaluation of a Clinical
Program
• Mukaria Itang'ata, Western Michigan University
A Mixed Method Approach to Evaluating Civic Learning
Outcomes
• Lisa O'Leary, Tufts University
Maximizing Evaluation Impact by Maximizing Methods: Social
Network Analysis Combined With Traditional Methods for
Measuring Collaboration
• Carl Hanssen, Hanssen Consulting LLC; Maryann Durland,
Durland Consulting
A Realist Synthesis Approach to Evaluating Complex Health
Interventions
• Sanjeev Sridharan, University of Edinburgh
116 - Providing Meaningful Evaluations for
Prevention Projects in Indigenous Communities
Panel to be held in the McKeldon Room on the Cabana Level in
Sponsor: Indigenous Peoples in Evaluation TIG
• Chair - Richard Nichols, Colyer Nichols Inc Consulting
• Discussant - Richard Nichols, Colyer Nichols Inc
Consulting
Evaluation of Amokura: An Indigenous Family Violence
Prevention Strategy
• Fiona Cram, Katoa Ltd
An Evaluation's Identity Crisis: Implementing a Federally
Funded Prevention Project Evaluation Within a Sovereign Tribal
Government Context
• Nicole Bowman, Bowman Performance Consulting LLC
Indigenous Evaluation of the Implementation of the Center for
Substance Abuse Prevention's Strategic Prevention
Framework in a Community on the Yakama Nation
• Jane Grover, RMC Research Corporation
Page 33
117 - Evaluation of Organizations as Enterprises:
Approaches, Appropriate Outcome Expectations, and
Potential Indicators
Panel to be held in the Preston Room on the Cabana Level in
Sponsor: Organizational Learning and Evaluation Capacity
Building TIG
• Chair - Thomas Chapel, Centers for Disease Control and
Prevention
These Are the Voyages of Evaluating an Enterprise
• Michael Schooley, Rosanne Farris, and Jan
Jernigan,Centers for Disease Control and Prevention; Barri
Burrus, James Hersey, Erika Fulmer, Jeanette Renaud, and
Alton Dunlap, and RTI International
Evaluating Strategy Execution: Lessons Learned in
Implementing Human Capital Management Plans
• Joan Cioffi, Centers for Disease Control and Prevention
Planning for Partnerships and Strategic Alliances at the United
States Centers for Disease Control and Prevention
• Adam Skelton, Centers for Disease Control and
Prevention
118 - Putting Context in Context With Examples in
Strategic Planning and Measuring Fidelity
Multipaper to be held in the Schaefer Room on the Cabana
Sponsor: AEA Conference Committee
• Chair - Cheri Levenson, Cherna Consulting
Putting Context in Context
• A Rae Clementz, University of Illinois at UrbanaChampaign
Measuring Fidelity of Implementation of a Coach-based
Professional Development Model
• Tara Pearsall, Ching Ching Yap, and Ashlee Lewis,
University of South Carolina
119 - Evaluating the Teaching of Program Evaluation:
Student and Teacher Assessments
Panel to be held in the Calvert Ballroom Salon B on the
Ballroom Level in the Radisson
Sponsor: Teaching of Evaluation TIG
• Chair - Katherine McDonald, Portland State University
Ideas for Evaluating the Teaching and Learning of Program
Evaluation
• Katherine McDonald, Portland State University
Student Assessment of Gains in Knowledge of Program
Evaluation
• Lauren Denneson, Portland State University
Teacher Assessment of Gains in Knowledge of Program
Evaluation
• Tina Taylor-Ritzler, University of Illinois, Chicago
119 – Continued
Relationships Between Student and Teacher Assessment of
Gains in Knowledge of Program Evaluation
• Margaret Braun, Portland State University
Generating a Vision for the Evaluation of Teaching Program
Evaluation
• Shannon Myrick, Portland State University
120 - Facilitating Fast-paced Learning: Developmental Evaluation for Complex Emergent Innovations
Demonstration to be held in the
Calvert Ballroom Salon C on the
• Michael Quinn Patton,
Utilization-Focused Evaluation
121 - Building Evaluation Capacity Within
Organizations
Multipaper to be held in the Calvert Ballroom Salon E on the
Sponsor: Extension Education Evaluation TIG
• Chair - Mary Arnold, Oregon State University
Reporting Extension Program Impacts: Slaying the Dragon of
Resistance
• Nancy Franz, Virginia Cooperative Extension
Do Workshops Work for Building Evaluation Capacity Among
Cooperative Extension Service Faculty?
• Kathleen Kelsey, Oklahoma State University
A Framework for Evaluating 4-H National Initiatives
• Benjamin Silliman, North Carolina State University
122 - When Does Evaluation Not Feel Like Evaluation? Embedding Evaluation Activities Into Programs
Panel to be held in the Fairmount Suite on the 19th Floor in the
Radisson
Sponsor: Pre-K - 12 Educational Evaluation TIG
• Chair - Leslie Goodyear, Education Development Center
• Discussant - Sylvia James, National Science Foundation
Using Embedded Evaluation to Assist Teachers in Using
Inquiry-based Modules That Integrate Math, Science and
Information Technology
• Roxann Humbert, Fairmont State University
Embedding Evaluation Activities to Promote Learning
• Ann Howe, SUCCEED Apprentiship Program
Using Engineering Notebooks as Embedded Evaluation
• Neal Grandgenett, University of Nebraska, Omaha
Games as Embedded Assessments
• Karen Peterman, Goodman Research Group Inc; Deborah
Muscella, Girls Get Connected Collaborative
Page 34
123 - Evaluating the Reading First Program: Best
Practices and Lessons Learned
Panel to be held in the Federal Hill Suite on the 19th Floor in
the Radisson
• Chair - Michael Long, Macro International Inc
• Discussant - Michael Long, Macro International Inc
Evaluation of Policy and Practice in Delaware's Reading First
Initiative
• Linda Grusenmeyer, University of Delaware
Evaluation of the Maryland Reading First Program: Successes
and Challenges
• Michael Long, Macro International Inc
Evaluation of the Indiana Reading First Program
• Amy Kemp, Indiana University
It Can't Be Either/Or: Using Internal Evaluation Methods and
Procedures to Complement and Strengthen External
Evaluation
• James Salzman, Cleveland State University
124 - Closing the Loop: Mapping Value to Inform
Research Management
Multipaper to be held in the Royal Board Room on the 19th
Floor in the Radisson
Sponsor: Research, Technology, & Development Evaluation TIG
• Chair - Neville Reeve, European Commission
A Framework for Evaluating Large Scale AIDS Clinical Research
Networks
• Jonathan Kagan, National Institutes of Health; Mary Kane
and Kathleen M Quinlan, Concept Systems Inc; William
Trochim, Cornell University; Daniel Montoya, Hill and
Knowlton; Melissa Burns, Concept Systems Inc; Brendan
Cole, National Institutes of Health
Analysis of Follow-up Evaluation Results of Research and
Development (R&D) Projects Applying Logic Model to
Elucidate the Process of Innovation
• Kazuki Ogasahara, Ministry of Economy, Trade and
Industry; Osamu Nakamura, National Institute of Advanced
Industrial Science and Technology; Kazuyuki Inahashi,
Chikahiro Miyokawa, and Yoshitaka Kimura, Ministry of
Economy, Trade and Industry
Contribution of Evaluation to Management of Research and
Development (R&D) in the Process of Technology Transfer: A
Knowledge Value Mapping Approach
• Juan Rogers, Georgia Institute of Technology
125 - Practicing Culturally-Based Evaluation:
Learnings From the Field
Panel to be held in the Royal Conference Foyer on the 19th
Sponsor: Multiethnic Issues in Evaluation TIG
• Chair - Cheryl Blanchette, Harder & Company Community
Research
Check It Out: The Development and Use of a Culturally Based
Consulting Checklist
• Kym Dorman, Harder & Company Community Research
On a Scale of 1 to 5, How Well do you Understand the
Question?
• Maricela Piña, Harder & Company Community Research
No Entiendo: Improving the Quality of Translation in Evaluation
Practice
• Nayeli Cerpas, Harder & Company Community Research
126 - Collaborative, Participatory and Empowerment
Evaluation TIG Business Meeting
Business Meeting to be held in the Hanover Suite B on the
Mezzanine Level in the Radisson
Sponsor: Collaborative, Participatory & Empowerment
Evaluation TIG
• TIG Leaders - David Fetterman, Stanford University;
Liliana Rodriguez-Campos, University of South Florida
127 - Assessing Randomized Control Trials and
Alternatives
Multipaper to be held in the Baltimore Theater on the
• Chair - James Derzon, Pacific Institute for Research and
Evaluation
Using the Pre-test/Post-test Only Design for Evaluation of
Training
• Jack McKillip, Southern Illinois University, Carbondale;
Joan Rycraft, University of Texas, Arlington; Steven Wernet,
Saint Louis University; Michael Patchner and Edmund Mech,
Indiana University Purdue University Indianapolis
Comparison of Variations in Retrospective Pre-test (RPT) and
Pre-test/Post-test Surveys Measuring the Outcomes of an Antiviolence Education Program
• James Riedel, Girl Scout Research Institute
Using Randomized Control Trials to Learn What Works in
Prevention
• James Derzon, Pacific Institute for Research and
Evaluation
They May Glitter, but Are They Gold? Randomized Control Trials
in Evaluation
• Sheila Arens and Andrea Beesley, Mid-continent
Research for Education and Learning
Page 35
128 - Crime, Violence and IRT/Rasch Measurement
Panel to be held in the International Room across from
Starbucks/Lobby Level in the Radisson
• Chair - Susan Hutchinson, University of Northern Colorado
• Discussant - Michael Dennis, Chestnut Health Systems
Interpreting Maps and Statistics of the Crime and Violence
Scale
• Karen Conrad and Barth Riley, University of Illinois,
Chicago; Chicago; Ya-Fen Chan, Chestnut Health Systems;
Kendon Conrad, University of Illinois, Chicago; Michael
Dennis, Chestnut Health Systems
Crime and Violence: Differential Item Functioning by Age and
Gender
• Ya-Fen Chan, Chestnut Health Systems; Karen Conrad,
Kendon Conrad, and Barth Riley, University of Illinois,
Chicago; Michael Dennis, Chestnut Health Systems
Detecting Misfitting Persons with the Rasch Model
• Barth Riley, University of Illinois, Chicago; Ya-Fen Chan,
Chestnut Health Systems; Karen Conrad and Kendon
Conrad, University of Illinois, Chicago; Michael Dennis,
Chestnut Health Systems
129 - Evaluation Methodology in Educational
Technology Contexts
Multipaper to be held in the Chesapeake Room in the Lower
Lobby Level in the Radisson
Sponsor: Distance Ed. & Other Educational Technologies TIG
• Chair - Michael Coe, Northwest Regional Educational
Laboratory
Investigating the Validity and Reliability of the School
Technology Needs Assessment (STNA)
• Jeni Corn, University of North Carolina, Greensboro
Building the Theoretical Contribution of the Worldly Science:
The Case for Longitudinal Engagement in the Evaluation of
Programs
• Charles Potter, University of the Witwatersrand; Gordon
Naidoo, Open Learning Systems Education Trust
Improved Evaluation Designs for Educational Technology
Projects
• Michael Coe, Northwest Regional Educational Laboratory
130 - International Perspectives on Evaluation
Part 1: Evaluating the Impact of Development
Projects
Part 2: Institutionalizing Evaluation in Government
Think Tank to be held in the Versailles Room on the Lobby Level
in the Radisson
• Ross Conner, University of California, Irvine
131 – First Time Attendee and New Member
Orientation
Business Meeting to be held in the Calvert Ballroom Salon B
on the Ballroom Level in the Radisson
Join the AEA Membership Committee for this short orientation
to the conference and the association in order to make the
most out of the event. We will then proceed from here over to
the evening’s reception and poster exhibition.
133 – Reception, Poster Exhibition, and Meet the
Authors
Special event to be held in the International Ballroom on the
Admission to the Reception and Poster
exhibition is included in conference
registration. All attendees are encouraged to
attend, to view the work represented in over
100 poster presentations, to meet the authors
at our author tables, and to build your
professional network in this social setting. This is the most
widely attended event of the conference and we hope to see
you there.
Please join us in saying ‘thank you’ to the co-sponsor of this
evening’s reception, SAGE Publications.
Poster 1: Implementation of Evidence-based Interventions in
Community Mental Health Settings: Organizational Factors
and Provider Perspectives Impacting Implementation
Processes and Child and Family Outcomes
• Elizabeth Douglas, Christine Walrath, and Bhuvana
Sukumar, Macro International Inc
Poster 2: Stress Influences to Age Crossover in Heavy Alcohol
Consumption
• Diana Urbanas, National Institutes of Health
Poster 3: Institutionalizing Utilization-focused approaches to
Evaluation in Non-Governmental Organizations (NGOs):
Creating a Culture of Evaluation
• Carrie Willimann, Winnehl Tubman, HyeJin Kim, Arushi
Terway, Ana Florez, and Audrey-Marie Moore, Academy for
Educational Development
Poster 4: Internal Auditing As Evaluation: Quality Assurance
and Performance Improvement Through An Internal Social
Work Auditing Program
• William Cabin, Youth Consultation Service
Poster 5: Steps to Developing Evaluation Capacity: Enhancing
the Learning Potential of Nonprofit
• Karen Russon, Evaluation Capacity Development Group
Evaluation 2007: Wednesday, November 7, 4:30 – 6:00 pm, 6:10 – 6:40 pm, and Posters Page 36
Poster 6: Development of a Systematic Evaluation Model for
Regional Economic Development Projects in the United States
• Brad Watts, Western Michigan University
Poster 7: The Effects of a Series of Early Literacy Workshops for
Parents on Parents, Teachers and Students: An Evaluation of
the Pre-Kindergarten Parent Project
• Katy Allen, University of Rochester
Poster 8: Newly Revised Authentic Project and Rubric for Use in
a Graduate Level Program Evaluation Course
• Zandra Gratz, Kean University
Poster 9: Impact of a Financial Program on Knowledge and
Practices of Adult Participants
• Cathy Bowen, Marilyn Furry, and Rama Radhakrishna,
Pennsylvania State University
Poster 10: Learning Through Focus Groups: Evaluation of the
Treatment Planning Process by Clinicians Within a Community
Health Center
• Erica Gosselin, Steve Baumer, Kristi Helvig, and Antonio
Olmos, Mental Health Center of Denver
Poster 11: Evaluation of Business Needs in a Diverse
Community
• Dennis Watson and Akilah Watking-Buttler, Loyola
University, Chicago
Poster 12: Impact of AgrAbility Program: Helping Farmers to
Stay in Farming
• Connie Baggett, Rama Radhakrishna, and Linda Fetzer,
Poster 13: What is Success? Considerations From an
Evaluation of a First Nations Treatment Centre
• Kim Van der Woerd, Simon Fraser University
Poster 14: The Evaluation of a Listening-While-Reading
Program: Challenges in and Recommendations From
Conducting an In-school Evaluation Experiment
• Aubrie Swan, Rutgers University
Poster 15: The Use of a Standardized Exercise to Evaluate
Emergency Preparedness Training Effectiveness for Health
Care Workers
• Eileen Blake and Michael Mozzer, Yale New Haven Health
Poster 16: Case Studies in Transformative Learning:
Interviews, Assessments, and Evidence Used to Evaluate
“Ready Schools”
• Paula Plonski and Bruce Yelton, Praxis Research Inc
Poster 17: PET: A Practical Evaluation Tool for (Art) Projects
• Machteld Willemse, Artnotion
Poster 18: Increasing the Response Rate for Satisfaction
Surveys
• Michaela Kennedy, Family Services of Western
Pennsylvania
Poster 19: Assertive Community Treatment in Atlanta:
Exploring Particular Outcomes of a Grady Healthcare System's
Approach
• Angela Mooss, John Barile, Joanna Weinberg, Doyanne
Darnell, Brandeis Green, and John Barile, Georgia State
University
Poster 20: Evaluating the Capacity and Quality of an Early Care
and Education System
• Rob Fischer, Kristen Mikelbank, and Claudia Coulton,
Case Western Reserve University
Poster 21: Evaluation of Web-based Applications: The
eXtension Experience
• Michael Lambur, Virginia Tech
Poster 22: Measuring Program Fidelity Through Factor
Analysis: A Developmental Process
• Tara Weatherholt, Education Development Center Inc
Poster 23: How Are They Faring? Using the South Carolina
Data Warehouse to Track Outcomes for Young Adults After They
Leave the Foster Care System
• Cynthia Flynn, University of South Carolina
Poster 24: Comparison of On-line and On-site Training for
Public Health Emergency Preparedness
• Thomas Reischl and Amy Sarigiannis, University of
Michigan
Poster 25: Insights on Learning From Using Qualitative
Methods to Evaluate Safety Training in Mining: Gaining Deeper
Understanding
• Lori Matthews and Theodore Teske, Spokane Research
Laboratory
Poster 26: Benefits and Challenges Using Participatory Evaluation for a National Multi-site Participatory-Action Research,
Business Education, and Policy Development Initiative
• Becky A Melzer, Independent Consultant; Gwen Martin,
Center for Women's Business Research
Poster 27: Developmental Evaluation as a Learning Tool for
Novice Evaluators
• Chris De Luca, Laura McEwen, and Hana Saab, Queen's
University
Poster 28: Immersion in School-based Evaluation
Communities
• Douglas Huffman, Kelli Thomas, Karen Lombardi, and
Carrie Hohl, University of Kansas
Poster 29: Using Exact and Propensity Score Matching in the
Integration and Matching of Evaluation Data
• Mukaria Itang'ata, Western Michigan University
Poster 30: HIV Prevention Among High School Students:
Evaluation of a Peer Educator Project
• Manuel Voelkle and David Dwertmann, University of
Mannheim
Poster 31: The Development and Validation of the Evaluation
Involvement Scale
• Stacie Toal, University of Minnesota
Page 37
Poster 32: Three Decades of Program Evaluation in Brazil:
Lessons Learned and the Case of Roberto Marinho
• Thereza Penna Firme, Cesgranrio Foundation; Vilma
Guimarães, Roberto Marinho Foundation; Angela
Dannemann, D&S Engenheiras Associadas Ltda; Ana
Carolina Letichevsky, Cesgranrio Foundation
Poster 33: Let Me Tell You What I Need! Using Multiple
Perspectives to Explore the Needs of Adolescents After a
Concussion
• Isabelle Gagnon, Swaine Bonnie, François Champagne,
Helene Lefebvre, and Debbie Feldman, University of
Montreal; Jeff Atkinson, Montreal Children's Hospital
Poster 34: Glowing in the Dark in the Cave of Information:
Organizational Learning and Transtheoretical Models
• Marisa Allen, Case Western Reserve University
Poster 35: Evaluating an Organizational Capacity Building
Program Designed to Increase Diversity Among Health Services
Researchers
• Andrea S Burling and Roger E Levine, American Institutes
for Research; Darlene Russ-Eft, Oregon State University;
Jennnifer Stephens, American Institutes for Research
Poster 36: An Evaluation of Techniques for Recruiting Parents
into HIV Prevention Research in Rural Communities: Teen
Recruitment of Adults Versus Traditional Methods: What Works
Best?
• Josephine Allen, Cornell University; Eunice Rodriguez,
Stanford University; Jennifer Tiffany, Deladem Kusi-Appouh,
and Wendy Vonhof, Cornell University
Poster 37: How Good is Our Advice? An Evaluation of an
Undergraduate Advising Program
• Jessica Ladage, Catherine Butler, Kelly Carpenter, Karen
Otero-Fisher, Erin Burr, and Jennifer Morrow, Old Dominion
University
Poster 38: Evaluating Mental Health Programs for Children
Based on the System of Care Model: A Critical Review
• Mijung Yoon, University of Illinois at Urbana-Champaign
Poster 39: Mentoring Adult Ex-offenders in Ready4Work:
Mentors' Perspectives
• Danijela Korom-Djakovic and Igor Holas, Public/Private
Ventures; Shawn Bauldry, University of North Carolina
Poster 40: Kinder, Gentler Pre-tests for Math-Science
Partnership Teachers
• Linda Heath, Aisha Leverett, and David Slavsky, Loyola
University, Chicago
Poster 41: Mentoring Adult Ex-offenders in Ready4Work:
Assessing the Effects of Mentoring
• Shawn Bauldry, University of North Carolina; Igor Holas
and Danijela Korom-Djakovic, Public/Private Ventures
Poster 42: How Learning From Today’s “Generations” Will Help
Make Evaluation More Relevant and Useful for Future
Generations
• Vanessa Moss-Summers, Xerox Corporation
Poster 43: Evaluating Outreach Strategies to Promote HIV
Testing Among Young African-American Men who
Have Sex With Men: The Case for Youth Empowerment
• George Greene, Clifford Armstead, Gregory Norels, and
Sean Morgan, Working For Togetherness
Poster 44: Challenges in Program Evaluation: Lessons Learned
From Evaluating Child Maltreatment Prevention Interventions
• Lei Zhang, Angela Snyder, and Karen Minyard, Georgia
State University
Poster 45: A Short Primer on Structural Equation Modeling:
The Essential Concepts
• Kristi Lekies, The Ohio State University
Poster 46: Progress on Establishing Project-evaluation System
in a Government-led Fund for Environmental Protection in
Japan
• Kenichi Ishida, Ocean Research Institute
Poster 47: Evaluating an Intensive Outpatient Treatment
Program for Parolees With Mental Health and Substance
Abuse Disorders
• Pamela Walsh, Eastern Michigan University; David
Atkinson, Community Care Services
Poster 48: Having Graduate Students as Evaluators: A
Description of a Community Based Evaluation
• Shawn Dickerson, Abby Braitman, and Krystall Dunaway,
Old Dominion University; Jennifer Morrow, and Erin Burr,
University of Tennessee
Poster 49: In-situ® Simulation: An Evaluative Mechanism for
Health Care Systems
• Amy Gullickson, Western Michigan University
Poster 50: Consumer Assessment of Mental Health Service
Providers' Cultural Competence
• Amanda Gmyrek, University of Maryland; Natasha Durant,
University of Maryland Medical System; Diana Seybolt,
University of Maryland; Iris Reeves, Maryland Mental Hygiene
Administration
Poster 51: Evaluating the Virginia Community College System
Professional Development Program: Lessons in Conducting a
Formal Assessment of a Large-scale, Centralized Professional
Development Initiative
• Kelle Basta, Thomas J Horwood, and Mary Ann Hanson,
Caliber an ICF International Company
Poster 52: Learning About Use and Evaluation
• Jeanne Hubelbank, Independent Consultant; Lauren
Chapman and Maureen Kavanaugh, Boston College
Poster 53: Using Evaluation of Community Service School Program to Enhance Participants' Learning From Their Experience
• Natalia Kosheleva, Ideas for Radiostations and
Communities
Poster 54: Evaluation of an Intensive Rehabilitation Services
Project for Adolescents With Behavior Problems
• Gilles Mireault, Centre Jeunesse de Québec-Institut
Universitaire
Poster 55: Navigating to Discovery: Personal Development of a
Culturally Competent Evaluator While Coordinating a
Community-wide Health & Wellness Fair
• Vernita Morgan, University of Iowa
Page 38
Poster 56: Where Do We Go From Here? Lessons on
Organizational Change and Development From an
Assessment of a School Resource Officer Program
• Kathleen Crowley, Anna Laszlo, and Deanna Breslin, Circle
Solutions
Poster 57: Evaluation and Learning: Project ECHO, a Training
and Capacity Building Model for Hepatitis C
• Summers Kalishman, Denise Dion, Jan Mines, Karla
Thornton, and Sanjeev Arora, University of New Mexico
Poster 58: National Cancer Institute's Small Grants Program
for Behavioral Research in Cancer Control Boosting Careers for
New Investigators: Lessons on Assessing Program Success in
Meeting National Institutes of Health (NIH) Research Priorities
• Veronica Chollette, National Institutes of Health; Kathleen
Crowley, Circle Solutions
Poster 59: Collaborative Evaluation of Project Quest: A
Comprehensive Program Preparing Middle and High
School Students for Academic Success
• Monifa Beverly and Rita O'Sullivan, University of North
Carolina, Chapel Hill
Poster 60: Surviving Establishment of an Evaluation Center:
Lessons Learned
• Melinda Hess and Jeffrey Kromrey, University of South
Florida
Poster 61: An Innovative Methodology for Measuring the
Results of Peacebuilding Media Interventions
• Alice Rowley and Ratiba Taouti-Cherif, Search for
Common Ground
Poster 62: Evaluation: A Tool for Teaching and Learning High
School Mathematics
• Anane Olatunji, George Washington University; Paige
Allison, Alachua County Public Schools
Poster 63: A Comparison of Traditional and Rasch Cut Points
for Assessing Clinically Important Change in Health-Related
Quality of Life Among Patients with Asthma
• Stacie Metz, West Chester University; Kathleen Wyrwich,
Saint Louis University; Ajit Babu, Amrita Institute of Medical
Sciences; Kurt Kroenke and William Tierney, Regenstrief
Institute; Frederic Wolinsky, University of Iowa
Poster 64: Validity of Patient-reported Health-related Quality
of Life Global Ratings of Change Using Structural Equation
Modeling
• Stacie Metz, West Chester University; Kathleen Wyrwich,
Saint Louis University; Ajit Babu, Amrita Institute of Medical
Sciences; Kurt Kroenke and William Tierney, Regenstrief
Institute; Frederic Wolinsky, University of Iowa
Poster 65: The Mississippi Delta Children's Partnership: A
Child-focused Community Change Initiative
• Bettye Fletcher, LaTonya Lott, and Aisha Fletcher,
Professional Associates Inc
Poster 66: Identifying Challenges to Evaluating Abstinence
Education Programs
• Sharon McGroder, Jane Koppelman, Mark Thomas, and
Shanise Hill, The Lewin Group
Poster 67: Using Formative Evaluation to Culturally Adapt a
Parenting Program for Black Fathers of Children With Special
Needs
• James C Bridgers Jr and Suzanne M Randolph, University
of Maryland, College Park; Cecil H Doggette, Health Services
for Children with Special Needs Inc; Sally Koblinsky,
University of Maryland
Poster 68: Why They Do It - Or Not: Evaluation of the
Implementation of a Web-based Educational Innovation for
Teachers
• Michael P Mueller, The Hospital for Sick Children
Poster 69: Evaluator Learning Curve: Is it a Gamble for
Stakeholders?
• Caroline Lippy, Leanne Valentine, Jim Emshoff, Beth
Anthony, Dary Enkhtor, Ayana Perkins, and Lindsey
Zimmerman, Georgia State University
Poster 70: "Apples to Apples": The Experience of Developing
an Evaluation Tool for the Workforce Development
Performance Benchmarking Project
• Stacy Woodruff-Bolte, Public/Private Ventures; Martha
Miles, Training Inc; Carol Clymer, Public/Private Ventures
Poster 71: Amplifying Community Voices: Enhancing the Needs
Assessment Process
• Catherine Carey, Practical Research; Ede Taylor, BelairEdison Healthy Community Coalition
Poster 72: Tools for a Successful Randomized Control Trial
(RCT) in an International Arena
• Kathlyn Rohrbaugh, Macro International Inc
Poster 73: Ensuring Program Assessment Rating Tool (PART)
Effectiveness: The Performance Measure Analytic Tool (PMAT)
• Ian Boyd, DFI Government Services; Christopher Cihlar,
DFI Government Services
Poster 74: Inclusion of Children With Disabilities in School Age
Care Settings: Provider's Perspective
• Hamida Jinnah, Zolinda Stoneman, Christine Todd, Anika
Francis, University of Georgia
Poster 75: The Use of Evaluation to Impact Comprehensive
School Reform Over Time: Michigan Coalition of Essential
Schools 2002-2007
• Tara Donahue, Learning Point Associates
Poster 76: Classroom-level Influences on Literacy Growth
Among Early Reading First Students
• Sheridan Green, JVA Consulting LLC; Susan Hutchinson,
University of Northern Colorado; Ana Leon, JVA Consulting
LLC; Jane Walsh, Denver Public Schools Early Reading First
Poster 77: Evaluation of Research Program Structures Using
Logic Models and Value Stream Management: A Pilot Study
• Delia J Valles-Rosales, Elizabeth Schott, and Barbara
Lugo, New Mexico State University
Page 39
Poster 78: Promoting Science, Technology, Engineering,
Mathematics, and Geography (STEM-G) Through
Professional Development: Learning From Evaluation
• Karen Chen, Laurie Ruberg, and Judy Martin, Wheeling
Jesuit University
Poster 79: Increasing Commitment to Organizational Change
Through Evaluation and Learning
• Rex Foster, University of Minnesota
Poster 80: Involving Stakeholders to Improve Acceptance
• Nancy Carrillo, Albuquerque Public Schools
Poster 81: How Learning About Evaluation Can Better Support
Teaching and Learning in a Postsecondary Environment
• Stanley Varnhagen, Brad Arkison, and Jason Daniels,
University of Alberta
Poster 82: Out of the Cocoon and Into the Real World:
Challenges Faced and Lessons Learned by Students in
Their First Endeavor as Professional Evaluators
• Rabia Hos and Kankana Mukhopadhyay, University of
Rochester
Poster 83: Satisfaction Surveys and Their Relevance in Service
Delivery
• Maureen Rubin, Program Development and Evaluation
Associates
Poster 84: How Graduate Students Gain Evaluation Skills:
What Worked for Us
• Erin Burr and Jennifer Morrow, University of Tennessee;
Margot Ackermann, Old Dominion University
Poster 85: HIV/AIDS/STD-related Worry and Sexual Activity
Within Adolescent Social Networks
• Deladem Kusi-Appouh and Josephine Allen, Cornell
University; Eunice Rodriguez, Stanford University; Jennifer
Tiffany and Lindy Williams, Cornell University
Poster 86: Using Latent Growth Modeling to Test Effectiveness
of Georgia Family Connection Collaboratives
• Adam Darnell, James Emshoff, and Steve Erickson,
EMSTAR Research Inc
Poster 87: Evaluating a Grass-Roots Non-traditional
Educational Program: Challenges for Non-academic Midcareer New Evaluators
• Sean Little, Independent Consultant
Poster 88: Collaboration and Evaluation Capacity Building:
Lessons From a Learning Environment
• Randi K Nelson, David Fischer, Herbert Struss, University
of Minnesota
Poster 89: Lesson Study: Capturing Collegial Professional
Development for Educators
• Robert Nelson, ASPEN Associates Inc
Poster 90: Evaluating an Online New Teacher Mentorship
Program: Science, Technology, Engineering, and
Mathematics Mentoring Program (STEMMP)
• Herbert Struss, Joel Donna, Gillian Roehrig, University of
Minnesota
Poster 91: Evaluator Certification: More than 30 Years Without
Resolution
• Arisara Roengsumran, University of Minnesota
Poster 92: A Data Quality Rating System to Improve
Organizational Use of Evaluation
• Paul Pope, Texas Cooperative Extension
Poster 93: Conducting and Evaluating Effective Translations to
Promote Linguistic Competence in a Federally Funded National
Evaluation
• Sylvia Fisher, United States Department of Health and
Human Services; Michelle Schurig, Macro International Inc
Poster 94: Global Diffusion of Evaluation Theories and
Practices. Driving Forces and Implications
• Rahel Kahlert, University of Texas, Austin
Poster 95: Robotics: Opportunities for Building Outstanding
Talent in the Sciences (R.O.B.O.T.S.): The Collaborative
Evaluation of a Middle School Science, Technology,
Engineering, and Mathematics (STEM) Program
• Tangie Fleming and Rita O'Sullivan, University of North
Poster 96: Using Qualitative Information to Develop Materials
to Address Clinical and Psychosocial Needs of Lesbian, Gay,
Bisexual, Transgendered, Questioning, Intersexed, and TwoSpirit (LGBTQI2S) Youth in Systems of Care
• Sylvia Fisher, US Department of Health and Human
Services; Jeffrey Poirier, American Institutes for Research
Poster 97: The Questions Parking Lot Project: Data Source for
Training Curriculum and Service Enhancements
• Norma Martinez-Rubin, Evaluation Focused Consulting
Poster 98: Use of Stakeholder Focus Groups in the Development of Evaluation Protocols for Sexuality Education Programs
• Sharon Wilburn and Kenneth Wilburn, University of North
Florida; Dax Weaver, Health-Tech Consultants Inc
Poster 99: Influences on the Career Paths of Underrepresented
Minority Students in a Biology Enrichment Program
• Jennifer Sweeney, Merna Villarejo, and Amy Barlow,
University of California, Davis
Poster 100: Educating Evaluations: Designing and
Implementing Impact Evaluations for Non-formal and
Vocational Education Development Projects
• Marc Shapiro, Independent Consultant
Poster 101: Naming and Framing: Are Logic Models Used to its
Full Potential by Program Stakeholders and Evaluators Alike?
• Chidinma Ibe, Johns Hopkins University; Helen Hsu,
University of British Columbia
Poster 102: Successful Organization Learning and Evaluation
Capacity Building Among Nonprofits
• Michele Graham, Rebecca Baggett, and Sheridan Green,
JVA Consulting LLC
Poster 103: Assessing the Quality of Program for Improving
Reading in the Southeast of Mexico
• Victor Aguilar-Fernandez and Edith J Cisneros-Cohernour,
Universidad Autonoma de Yucatan
Poster 104: A Network Map of Stakeholder Partnerships
• Anthony Lee, University of South Carolina, Columbia
Page 40
Thursday, November 8, 2007: Overview of Schedule
7:00 am to 6:30 pm
8:00 am to 9:15 am
Plenary Session
9:35 am to 11:05 am
11:15 am to 12:45 pm
12:55 pm to 1:45 pm
AEA Business Meeting
1:55 pm to 3:25 pm
3:35 pm to 5:05 pm
5:15 pm to 6:00 pm
6:10 pm to 7:00 pm
7:30 pm to 10:00 pm
Sock Hop (Ticketed Event)
Evaluation 2007: Thursday, November 8, Overview
Page 41
Summary of Sessions for Thursday, November 8, 9:35 AM to 11:05 AM
No Primary Sponsor
Session
Session Title
Room Name
301 Presidential Strand /Quantitative TIG
Panel
Learning to Promote Quality Over Ideology for Methodology
International Ballroom A
Panel
Understanding Culturally and Contextually Responsive Eval Through the Experiences of a Multi-year Project
International Ballroom B
303 Qualitative Methods TIG
Panel
Accountability, Democracy and Representation in the Global Evaluation Context
International Ballroom C
304 Evaluation Use TIG
Multipaper
Organizational Learning and Evaluation Use at the State Level
International Ballroom D
305 Graduate Student and New Evaluator TIG
Multipaper
Critical Reflections: Theory and Practice
International Ballroom E
306 Org Learning and Eval Capacity Building TIG
Multipaper
What Theory and Research Tell Us About Evaluation Capacity Building
Liberty Ballroom Section A
Think Tank
Learning From the American Evaluation Association Topical Interest Groups Proposal Review Standards
Panel
Putting the Pieces Together: Making Inferences in a Complex Multimodal Evaluation
Mencken Room
309 Cluster, Multi-site and Multi-level Eval TIG
Panel
Three Perspectives on Using Evaluation for Alternative Teacher Preparation…
310 Advocacy and Policy Change TIG
Panel
Policy Evaluation: Learning About What, When and For Whom?
Carroll Room
Multipaper
Logic Models Are Alive and Well: New Applications in the Health Field
Skill-building
Using Case Studies to Teach the AEA Guiding Principles: An Introduction to the Guiding Principles Training Package Pratt Room, Section B
Roundtable
Rotation I: Developing Frameworks for Evaluating Knowledge Management Initiatives
Rotation II: The Role of Evaluation in Business Intelligence
Douglass Boardroom
314 Integrating Technology Into Evaluation
Demonstration
There's More Than One Way to Skin a Cat: Cost Effective Online Surveying and Evaluation
Hopkins Room
Multipaper
Evaluation of Various Educational Programs in Different Countries of the Globe
Peale Room
Roundtable
Rotation I: Experiences With an Online Student Rating System
Rotation II: This is Not a Test: Building Instruments to Measure Course Outcomes Beyond Knowledge
Jefferson Room
Panel
The Safe Start Demonstration Project: Design, Approaches and Outcomes of Evaluating a Systems Change…
Washington Room
319 Non-profit and Foundations Evaluation
Panel
Evaluating Volunteering in Low-income Communities: A Participatory Approach
D'Alesandro Room
Demonstration
Introduction to You Get What You Measure ™
Calhoun Room
Think Tank
What Have We Learned From/What Do We Still Need to Learn About Developing Evaluation Organizations?
Preston Room
323 Theories of Evaluation TIG
Multipaper
The Centrality of Learning to Evaluation Practice and Theory
Schaefer Room
324 Disaster & Emergency Mgmt Evaluation TIG
Business Meeting TIG Business Meeting and Panel: Evaluation of the National Case Management Consortium Katrina Aid Today…
Panel
An Overview of Proven Customer Service Practices for Independent Evaluation Consultants
326 Extension Education Evaluation TIG
Panel
Building Evaluation Capacity in Extension Systems
327 Pre-K - 12 Educational Evaluation TIG
Panel
Integrating Research-based Information into the Educational Practices of School Workers…
Fairmount Suite
Panel
Supporting Partnerships to Assure Ready Kids (SPARK): Cultural Connections to Ready Schools…
Federal Hill Suite
329 Research, Technology, & Development Eval TIG Multipaper
Hard Cases: Measuring and Facilitating Interdisciplinarity and Inter-Organizational Interactions
Royal Board Room
MultiPaper
Evaluation in the Era of Evidence-based Prevention
Multipaper
Strengthening Communities Through the Use of Evaluation: Issues and Perspectives
Hanover Suite B
332 Quantitative Methods: Theory and Design
Demonstration
A Gentle Introduction to Resampling Techniques
Baltimore Theater
333 Human Services Evaluation TIG
Demonstration
Creating a Culture of Process Improvement in the Human Services: An Application of Lean Philosophy
International Room
Panel
Performance Measurement: Getting to Yes With Grantees and Partners
Versailles Room
Evaluation 2007: Thursday, November 8, 9:35 am to 11:05 am, Timeslot Overview
Page 42
Thursday, 8:00 am to 9:15 am
300 - Presidential Address - Evaluation’s Second
Act: A Spotlight on Learning
Plenary to be held in the Sheraton
International Ballroom
• Chair - Melvin Mark,
• Presenter - Hallie Preskill, Claremont Graduate University
Beverage Break in Exhibitors Promenade
Join us for coffee or tea
Thursday, 9:35 am to 11:05 am
301 - Learning to Promote Quality Over Ideology for
Methodology
Panel to be held in the Sheraton
International Ballroom Section A
Sponsors: Presidential Strand and
the Quantitative Methods TIG
• Chair - George Julnes, Utah State University
• Discussant - Lois-ellin Datta, Datta Analysis
Missing in Action in the Qualitative Versus Quantitative Wars
• Henry M Levin and Douglas Ready, Columbia University
Establishing Criteria for Rigor in Non-Randomized and
Qualitative Outcome Designs
• Debra Rog, Westat
The Renaissance of Quasi-Experimentation
• William Shadish, University of California, Merced
Working Towards a Balance of Values in Promoting Methods in
Evaluation
• George Julnes, Utah State University
302 - Understanding Culturally and Contextually
Responsive Evaluation Through the Experiences of a
Multi-year Implementation Project
Panel to be held in the Sheraton International Ballroom
Section B
• Chair - Stafford Hood, Arizona State University
• Discussant - Jennifer Greene, University of Illinois at
Urbana-Champaign
Conceptual Designs and Practical Issues: Lessons From the
Implementation of Culturally and Contextually Responsive
Evaluation
• Melvin Hall, Northern Arizona University; Jennifer Greene,
University of Illinois at Urbana-Champaign
301 – Continued
Relevance of Culture in Evaluation Institute Lessons Learned:
Implementing School-based, Culturally and Contextually
Responsive Evaluation Projects
• Michael Wallace, Howard University; Stafford Hood,
Arizona State University
Evaluation Influence and Cultural Context
• Karen Kirkhart, Syracuse University; Melvin Hall, Northern
Arizona University
303 - Accountability, Democracy and Representation
in the Global Evaluation Context
Panel to be held in the Sheraton International Ballroom
Section C
Sponsor: Qualitative Methods TIG
• Chair - Leslie Goodyear, Education Development Center
• Discussant - Robert Stake, University of Illinois at UrbanaChampaign
Accountability Structures and Evaluator Roles
• Lehn Benjamin, George Mason University
Global Accountabilities, the New Public Management and the
Millennium Development Goals
• Saville Kushner, University of the West of England
The Role of Representation in Democratic Accountability and
Evaluation
• Leslie Goodyear, Education Development Center Inc
304 - Organizational Learning and Evaluation Use at
the State Level
Multipaper to be held in the Sheraton International Ballroom
Section D
Sponsor: Evaluation Use TIG
• Chair - Susan Tucker, Evaluation and Development
Association
Evaluations of High School Exit Examinations: What Have We
Learned?
• Nicki King, University of California, Davis
Using Evaluation as a Management Tool: The Experience of the
Tennessee State Improvement Grant Evaluation
• Chithra Perumal, University of Kentucky; Brent Garrett,
Independent Consultant
Learning From Local Evaluations: How Math-Partnership
Project Evaluations Informed State Policy
• Helene Jennings, Macro International Inc; Nancy Carey,
Maryland State Department of Education
Did you know? One-third of AEA’s members
do at least some evaluation work with a focus
outside of the United States.
Source: 2007 AEA Member Survey – More results to come this winter!
Evaluation 2007: Thursday, November 8, 8:00 am to 9:15 am and 9:35 am to 11:05 am
Page 43
Thursday, 9:35 am to 11:05 am, Continued
305 - Critical Reflections: Theory and Practice
Multipaper to be held in the Sheraton International Ballroom
Section E
Sponsor: Graduate Student and New Evaluator TIG
• Chair - Bianca Montrosse, University of North Carolina,
Chapel Hill
Reflections of Emerging Evaluators: Constructing Evaluation
Meaning in Situated Learning Contexts
• Sallie E Greenberg, A Rae Clementz, Ana Houseal, and
LaShorage Shaffer, University of Illinois at UrbanaChampaign
An Investigative Study on Evaluation Theory and Practice Using
Conceptualization Method
• Jie Zhang, Syracuse University
The Making of Evaluation: An Inquiry Into the Theory-practice
Interaction in Evaluation
• Jeehae Ahn, University of Illinois at Urbana-Champaign
306 - What Theory and Research Tell Us About
Evaluation Capacity Building
Multipaper to be held in the Liberty Ballroom, Section A on the
Building TIG
• Chair - Christina Christie, Claremont Graduate University
• Discussant - J Bradley Cousins, University of Ottawa
Navigating Through the Evaluation Capacity Building
Literature: A Compass for Future Practice
• Shanelle Boyle and Hallie Preskill, Claremont Graduate
University
Program Evaluations: A Tool to Prevent Organizational Learning
Disabilities
• Bill Thornton and Steve Canavero, University of Nevada,
Reno; Ricky Medina, Carson City School District
What Organizational Characteristics Facilitate Using
Evaluation for Organizational Learning in North Carolina's
Nonprofit Sector?
• Deena Murphy, National Development and Research
Institutes Inc
307 - Learning From the American Evaluation
Association TIG Proposal Review Standards
• Discussants - Chris Coryn, Western Michigan University;
Robert Hanson, Health Canada; Ann Maxwell, United States
Department of Health and Human Services; Martha Ann
Carey, Azusa Pacific University; Janice Noga, Pathfinder
Evaluation and Consulting; Rita O'Sullivan, University of
North Carolina, Chapel Hill; John Nash, Open Eye Group;
Elmima Johnson, National Science Foundation;
307 – Continued
•
Discussants continued - Emiel W Owens Jr, Texas
Southern University; Liesel Ritchie, Western Michigan
University; Eunice Rodriguez, Stanford University; James
Sass, LA's BEST After School Enrichment Program; Nino
Saakashvili, Horizonti Foundation; Ann Zukoski, Oregon
State University; Heather Boyd, Virginia Tech; Susan Kistler,
American Evaluation Association; Nicole Vicinanza,
American Evaluation Association; Howard Mzumara, Indiana
University Purdue University Indianapolis; Otto Gustafson,
Western Michigan University; Marcie Bober, San Diego State
University; Tom McKlin, Georgia Institute of Technology;
Emmalou Norland, Institute for Learning Innovation; Neva
Nahan, Wayne State University; Denice Cassaro, Cornell
University; Eric Barela, Los Angeles Unified School District
• Presenter - Daniela C Schroeter, Western Michigan
University
308 - Putting the Pieces Together: Making Inferences
in a Complex Multimodal Evaluation
• Chair - Sara Speckhard, United States Citizenship and
Immigration Services
• Discussant - Rebecca Gambler, United States
Government Accountability Office
Using Focus Groups to Shape Quantitative Data Collection
• Denise Glover, Westat
Integrating Qualitative and Quantitative Data Collected During
Site Visits
• Molly Hershey-Arista, Westat
Putting the Pieces Together in the Evaluation Report
• Carolyn Shettle, Westat
309 - Three Perspectives on Using Evaluation for
Alternative Teacher Preparation: Insights From the
Evaluator, the Policymaker, and the Program
Implementer
Panel to be held in the Edgar Allen Poe Room on the Main
• Chair - Edith Stevens, Macro International Inc
Using Evaluation for Alternative Teacher Preparation: The
Evaluator's Perspective
• Edith Stevens, Macro International Inc
Policymaker's Perspective
• Michelle Dunkle, Maryland State Department of
Education
Program Implementer’s Perspective
• Roger Schulman, The Maryland Practitioner Teacher
Program
Evaluation 2007: Thursday, November 8, 9:35 am to 11:05 am
Page 44
310 - Policy Evaluation: Learning About What, When
and For Whom?
Panel to be held in the Carroll Room on the Main Lobby Level in
the Sheraton
Sponsor: Advocacy and Policy Change TIG
• Chair - John Sherman, Headwaters Group
Let's Get Real About Real-Time Reporting
• Julia Coffman, Harvard Family Research Project
Learning During Intense Advocacy Cycles
• Ehren Reed, Innovation Network Inc
Accountable Learning in Policy Evaluation: Politics and
Practice
• John Sherman, Headwaters Group
311 - Logic Models Are Alive and Well: New
Applications in the Health Field
Multipaper to be held in the Pratt Room, Section A on the
• Chair - Kathryn E Lasch, Mapi Values
Using Logic Models as Learning Tool: Practical Lessons From
Evaluating Health Programs
• Robert LaChausse, California State University, San
Bernardino
From Research to Practice: Measuring the Impact of Health
Information Programs
• Tara Sullivan and Saori Ohkubo, Johns Hopkins University
Evaluating at the Cross-project or Initiative Level: The Case of
Communities First in California
• Ross Conner, University of California, Irvine; Kathy
Hebbeler, SRI International; Diane Manuel, The California
Endowment
312 - Using Case Studies to Teach the American
Evaluation Association Guiding Principles: An
Introduction to the Guiding Principles Training
Package
Skill-building Workshop to be held in the Pratt Room, Section
B on the Lower Level in the Sheraton South Tower
• Jules M Marquart, Centerstone Community Mental Health
Centers Inc; Dennis Affholter, Affholter and Associates; Scott
Rosas, Nemours Health and Prevention Services
313 – Roundtables
313 – Continued
Rotation I: Developing Frameworks for Evaluating Knowledge
Management Initiatives
• Thomas E Ward, United States Army Command and
General Staff College
Rotation II: The Role of Evaluation in Business Intelligence
• Wes Martz, Western Michigan University
314 - There's More Than One Way to Skin a Cat: Cost
Effective Online Surveying and Evaluation
Demonstration to be held in the Hopkins Room on the Lower
Sponsor: Integrating Technology Into Evaluation
• Cheryl Cook, United States Department of State
315 - Evaluation of Various Educational Programs in
Different Countries of the Globe
• Chair - Norma Fleischman, United States Department of
State
Evaluation of High School Graduates in Brazil: A Decade of
Learning
• Ana Carolina Letichevsky, Cesgranrio Foundation
Educational Evaluation Across Nations: Methodological and
Conceptual Issues Confronting a Cross-country Delphi Study
• Hsin-Ling Hung, National Taiwan Normal University; YiFang Lee, National Chi Nan University; James W Altschuld,
The Ohio State University
Challenges and Good Practices in Evaluating Anti-child Labor
and Basic Education Programs Worldwide
• Katharine Wheatley and Lisa Slifer-Mbacke, Macro
International Inc
Undergraduate Education in Vietnam: Insights Gained From an
Evaluation of Vietnam's Postsecondary Education From a
Cross-national Perspective
• Peter J Gray, United States Naval Academy; Lynne
McNamara and Phuong Nguyen, Vietnam Education
Foundation
317 - Roundtables
Rotation I: This is Not a Test: Building Instruments to Measure
Course Outcomes Beyond Knowledge
• Kelly Fischbein, American Red Cross; Thearis Osuji,
Macro International Inc
Rotation II: Experiences With an Online Student Rating System
• John Ory and Christopher Migotsky, University of Illinois at
Urbana-Champaign
Page 45
318 - The Safe Start Demonstration Project: Design,
Approaches and Outcomes of Evaluating a Systems
Change Continuum of Care for Children Exposed to
Violence
Panel to be held in the Washington Room on the Cabana Level
in the Sheraton North Tower
• Chair - David Chavis, Association for the Study and
• Discussant - Kristen Kracke, United States Department of
Justice
Overview of the Design of the National Evaluation of the Safe
Start Demonstration Project
• David Chavis, Association for the Study and Development
of Community
Applying a Theory of Change Approach to the Evaluation of the
Safe Start Demonstration Project
• Mary Hyde and David Chavis, Association for the Study
Using Process Evaluation Findings and Grantee Level Activities
to Generate an Understanding of Systems Change Strategies in
a Continuum of Care for Children Exposed to Violence
• Mary Hyde and David Chavis, Association for the Study
Maximizing Data Collection for Children Exposed to Violence
• S Sonia Arteaga and Joie Acosta, Association for the
Study and Development of Community
319 - Evaluating Volunteering in Low-income
Communities: A Participatory Approach
Panel to be held in the D'Alesandro Room on the Cabana Level
• Chair - Deborah Levy, Points of Light Foundation
Overview of the Neighboring Concept and the Family
Strengthening and Neighborhood Transformation Grant
• Polina Mackievsky, Points of Light Foundation
Evaluating Multi-site Grant Funded Projects, A Participatory
Approach
• Deborah Levy, Points of Light Foundation
A Grantee Perspective
• Deborah Levy, Points of Light Foundation
322 - What Have We Learned From/What Do We Still
Need to Learn About Developing Evaluation
Organizations?
Think Tank to be held in the Preston Room on the Cabana Level
Building TIG
• Discussants - Lisa Raphael and Meghan Burke, University
of Illinois, Chicago
• Carol Fendt, University of Illinois, Chicago; Cindy
Shuman, Kansas State University; Bret Feranchak, Chicago
Public Schools; Stacy Wenzel, University of Illinois, Chicago
323 - The Centrality of Learning to Evaluation
Practice and Theory
Sponsor: Theories of Evaluation TIG
• Chair - Sheila Arens, Mid-continent Research for
Education and Learning
Evaluation as/of Learning
• Janice Fournillier, Georgia State University; Cecile
Cachaper, Independent Consultant
Evaluator as Learner: Rethinking Roles and Relationships
• Tysza Gandha, University of Illinois at Urbana-Champaign
How Can Our Society Learn Through Contextualized
Evaluation? A Renewed Appreciation of Generalization in
Evaluation
• Wonsuk Lee, University of Illinois, Urbana
Standards-based, Competency-based and Appreciative
Inquiry: Using Program Theory for Assessing Program Quality
and Promoting Organizational Learning
• Edith J Cisneros-Cohernour, Universidad Autonoma de
Yucatan; Thomas E Grayson, University of Illinois at UrbanaChampaign
Did you know? Nine percent of AEA’s
members have fewer than two years of experience
in the evaluation field, while eighteen percent
have more than 20 years of experience.
320 - Introduction to You Get What You Measure ™
Demonstration to be held in the Calhoun Room on the Cabana
• Shanna Ratner, Yellow Wood Associates Inc; Kim Norris,
Page 46
324 - Disaster and Emergency Management Evaluation TIG Business Meeting and Panel: Evaluation of
the National Case Management Consortium Katrina
Aid Today: What Have we Learned?
Business Meeting to be held in the Calvert Ballroom Salon B
on the Ballroom Level in the Radisson
Sponsor: Disaster and Emergency Management Evaluation TIG
• TIG Leaders - Liesel Ritchie, Western Michigan University;
Scott Chaplowe, American Red Cross; Mary Davis, University
of North Carolina, Chapel Hill
• Chair - Cindy Roberts-Gray, Third Coast Research and
Development Inc
• Discussant - Celine Carbullido, United Methodist
Committee on Relief-Katrina Aid Today
United Methodist Committee on Relief: Katrina Aid Today - The
Coordinator's Role in the Evaluation
• Amanda Janis, United Methodist Committee on ReliefKatrina Aid Today
Federal Emergency Management Agency: The Sponsor's Role
in the Evaluation
• Liz Monahan-Gibson, Federal Emergency Management
Agency
Coordinated Assistance Network (CAN): The Role of Technology
in Information Sharing
• Noah Simon, Coordinated Assistance Network
The Salvation Army - Southern Territory: A Partner's Role in the
Evaluation
• Terry Hammond, Salvation Army
External Formative Mid-term Evaluation: The Role of the
External Evaluator at Mid-term
• Mary Sondgeroth, Third Coast Research and
Development Inc
325 - An Overview of Proven Customer Service
Practices for Independent Evaluation
Panel to be held in the Calvert Ballroom Salon C on the
• Chair - Carol Haden, Magnolia Consulting LLC
Serving Clients Through Collaborative Planning and Shared
Understanding
• Stephanie Wilkerson, Magnolia Consulting LLC
Serving Clients through Effective and Responsive
Communication
• Tracy Herman, Magnolia Consulting LLC
Serving Clients Through Useful and Timely Reporting
• Lisa Shannon, Magnolia Consulting LLC
326 - Building Evaluation Capacity in Extension
Systems
Panel to be held in the Calvert Ballroom Salon E on the
• Chair - William Trochim, Cornell University
• Discussants - Michael Duttweiler and Donald Tobias,
Cornell University
Protocols, Plans and Networks: The Nuts-and-Bolts of Systems
Evaluation
• William Trochim, Cornell University
Motivation and Management in Evaluation
• Cath Kane, Cornell University
Incorporating Experimental Design into Extension Evaluation:
The Switching Replications Waiting List Design
• Sarah Hertzog, Cornell University
327 - Integrating Research-based Information into
the Educational Practices of School Workers: What
We've Learned so far From a Strategy Involving 200
High Schools
Radisson
• Chair - Michel Janosz, University of Montreal
The New Approaches New Solutions (NANS) Strategy: Overview
of the Evaluation and the Use of Resutls for Decision Making
• Michel Janosz, Jonathan Levesque, and Jean L Belanger,
University of Montreal
Formative Evaluation of CIDA, a Ministry Task Team in Charge
of Facilitating the Use of research-based information in NANS
Schools
• Frederic Nault-Brière, Christian Dagenais, Didier Dupont,
Julie Dutil, Alexandre Chabot, and Michel Janosz, University
of Montreal
Factors Influencing the Role of School Boards in Supporting
the Use of Research Based Information
• Christian Dagenais, Didier Dupont, Frederic Nault-Brière,
Julie Dutil, Alexandre Chabot, and Michel Janosz, University
of Montreal
The Development and Validation of a Behavior and Attitude
Questionnaire to Measure Utilization of Research-based
Information by School Practitioners
• Philip Abrami, Concordia University; Christian Dagenais
and Michel Janosz, University of Montreal; Robert Bernard
and Larysa Lysenco, Concordia University; Marie Pigeon and
Jonathan Levesque
Beyond Numbers: Qualitative Evaluation of the Factors
Influencing the Transfer of Research-based Knowledge Based
on Perceptions of Professionals Working in NANS Schools
• Alexandre Chabot, Christian Dagenais, and
Michel Janosz, University of Montreal; Philip Abrami and
Robert Bernard, Concordia University
Page 47
328 - Supporting Partnerships to Assure Ready Kids
(SPARK): Cultural Connections to Ready Schools,
Native Hawaiians, Spanish Speaking Immigrants,
and Refugee Children and Families
the Radisson
• Chair - Anthony Berkley, W K Kellogg Foundation
Pathways to Ready Schools: Cultural Connections between
Schools That Serve Vulnerable Children and Their Communities
• Patrick Curtis and Kate Simons, Walter R McDonald &
Associates Inc
Three Methods for Assessing Pre-K Programs and Elementary
Schools in Hawai'i
Morris Lai and Susan York, University of Hawaii
Supporting Partnerships to Assure Ready Kids (SPARK) Florida:
Impact on Spanish Speaking Immigrant Children and Families
• Charles Bleiker, Florida International University
The Impact of Supporting Partnerships to Assure Ready Kids
(SPARK) Georgia on Refugee Children
• Kevin Baldwin, Wellsys Corporation
329 - Hard Cases: Measuring and Facilitating
Interdisciplinarity and Inter-Organizational
Interactions
• Chair - Erik Arnold, Technopolis
University-Industry Collaboration: An issue for Ireland as an
Economy With a High Dependence on
• James Ryan, CIRCA Group Europe Ltd
Measuring the Interdisciplinarity of a Body of Research
• David Roessner, SRI International; Alan Porter, Georgia
Institute of Technology; Anne Heberger, Alex Cohen, and
Marty Perreault, National Academies
Wikis in Evaluation: Evaluating Wikis for Theory Development in
a Multi-disciplinary Center
• P Craig Boardman, Nathaniel Deshmukh Towery, and
Brian Zuckerman, Science and Technology Policy Institute
330 - Evaluation in the Era of Evidence-based
Prevention
MultiPaper to be held in the Royal Conference Foyer on the
19th Floor in the Radisson
• Chair - Nikki Bellamy, United States Department of
Health and Human Services
The Institute of Medicine Framework as a Meta-construct for
Organizing and Using Evaluation Studies
• J Fred Springer, EMT Associates Inc
330 – Continued
A Measure of Severity of Consequences for Evaluating
Prevention Policy
• Steve Shamblen, Pacific Institute for Research and
Evaluation
Evaluation Techniques for Effectively Implementing and
Adapting Evidence-based Programs and Practice
• Elizabeth Harris, EMT Associates Inc
331 - Strengthening Communities Through the Use of
Evaluation: Issues and Perspectives
Multipaper to be held in the Hanover Suite B on the Mezzanine
Level in the Radisson
Evaluation TIG
• Chair - Kristin Huff, Independent Consultant
Using Community Indicators for Assessing Progress and
Learning From Community Development
• Jemimah Njuki and Susan Kaaria, International Centre for
Tropical Agriculture; Tennyson Magombo, Consultative
Group on International Agricultural Research
Understanding the Power of Homelessness Prevention: A Look
at the Experiences of Those at Risk
• Mandira Kala and Jennifer Raymond, University of
Massachusetts, Boston
Assessing the Role of Community-driven Evaluation
Approaches in Strengthening Community Learning, Social
Capital, and Internal Accountability: A Synthesis of Lessons
From Kenya and Colombia
• Susan Kaaria and Jemimah Njuki, Consultative Group on
International Agricultural Research; Noel Sangole,
International Center for Tropical Agriculture; Kenga Kadenge
Lewa, Kenya Agricultural Research Institute; Luis Alfredo
Hernandez and Elias Claros, Consultative Group on
International Agricultural Research
332 - A Gentle Introduction to Resampling
Techniques
Demonstration to be held in the Baltimore Theater on the
• Dale Berger, Claremont Graduate University
333 - Creating a Culture of Process Improvement in
the Human Services: An Application of Lean
Philosophy
Demonstration to be held in the International Room across
from Starbucks/Lobby Level in the Radisson
Sponsor: Human Services Evaluation TIG
• Joyce A Miller, Tania Bogatova, and Bruce Carnohan,
KeyStone Research Corporation
Page 48
335 - Performance Measurement: Getting to Yes
With Grantees and Partners
Panel to be held in the Versailles Room on the Lobby Level in
the Radisson
Prevention
How do you Keep it Going? Steps That one Centers for Disease
Control and Prevention Program Takes to Keep Performance
Measures Relevant
• Betty Apt and Dayne Collins, Centers for Disease Control
and Prevention
Getting From War Stories to Science: Developing Performance
Measures in Public Health Emergency Preparedness
• Sue Lin Yee, Centers for Disease Control and Prevention
Performance Measurement in Centers for Disease Control and
Prevention's Division of Diabetes Translation: Some Early
Lessons Learned
• Kristina Ernst, David Guthrie, Richard Hoffman, Wayne
Millington, and Clay Cooksey, Centers for Disease Control
and Prevention
Notes:
Page 49
Summary of Sessions for Thursday, November 8, 11:15 AM to 12:45 PM
No Primary Sponsor
Session
336
337
338
339
340
341
342
343
344
345
346
347
348
Panel
MultiPaper
Multipaper
Multipaper
Multipaper
Think Tank
Panel
Panel
Multipaper
Multipaper
Panel
Panel
Roundtable
Presidential Strand
Evaluation Use TIG
Graduate Student and New Evaluator TIG
Government Evaluation TIG
Cluster, Multi-site and Multi-level Eval TIG
Advocacy and Policy Change TIG
Alcohol, Drug Abuse, and Mental Health TIG
Session Title
Learning Practical Knowledge Through the Study of Cases
Practicing What we Preach: Exploring the Transformative Potential of Evaluation Processes
Incorporating Technological Innovations in Data Collection
Models of Evaluation Use and Influence in Social and Educational Services
Evaluation Training: Developing Professionals
Evaluation Capacity Building Unplugged
Professional Status for Evaluators: Canadian and American Views
Exploring the Implications of the Administration of Aging's Performance Outcomes Measures Project for Evaluators
Evaluation in Education
Foundation Policy Change Efforts: Internal and External Evaluation Strategies
Conducting Large Scale Evaluations of Federal Cancer Control Programs
Evaluating the Effectiveness of Community Prevention Coalitions: An Interim Report…
Rotation I: A Time Sequencing Evaluation Technique for Exercise Evaluation
Rotation II: Linking Monitoring, Eval and Internal Audit in Int’l Emergency Response to Increase Effectiveness
349 Integrating Technology Into Evaluation TIG
Panel
Exchange Outcome Assessment Linkage System (E-GOALS): A US Dept of State Web-Based Approach to Assessing…
350 International and Cross-cultural Evaluation TIG Panel
Building a Framework for Public Diplomacy Evaluations: Lessons Learned and Best Practices…
MultiPaper
Macro-level and Micro-level Methodologies for Evaluating Education System Functioning in Afghanistan
Roundtable
Rotation I: Authentic Demand and Sustainable Community Change: Testing a Theory and Making the Case
Rotation II: Maximizing Learning From Eval Findings for Diverse Stakeholders in a Comm Capacity-building Initiative
Panel
Evaluating a State Comprehensive Cancer Control Program: Planning, Implementation and Initial Results
MultiPaper
The Contribution of Evaluation to Building the Capacity of Indigenous, Not for Profit Organizations in New Zealand…
Panel
Evaluation Reports: Reframing the Concept for the Real World
356 Indigenous Peoples in Evaluation TIG
Think Tank
Reflections and Recommendations Concerning Culturally Competent Evaluation
Panel
Reflective Inquiry Into Learning Through Evaluation Practice
Multipaper
Sharing, Defining Ethics and Rejections on Training
359 Disaster & Emergency Mgmt Evaluation TIG
Panel
State and Local Public Health Emergency Preparedness: Evaluation as the CDC Expands Focus Expands Focus…
Demonstration
Evaluation Contracts: Considerations, Clauses, and Concerns
Think Tank
Locating Evidence of Research-based Extension Education Programs
Multipaper
Evaluating Teacher Professional Development
Multipaper
Evaluating Schools and Processes Within Schools
Research Evaluation of the Upcoming Europeans Union’s Framework Program
Panel
Evaluating the Cultural Competence of Substance Abuse and Mental Health Services…
Multipaper
Empowerment Evaluations: Insights, Reflections, and Implications
Business Meeting Business Meeting and Presentation - Theory Soup for the Quantitative Soul
Panel
Quality Counts: Becoming Bilingual in Quality Improvement and Evaluation in Human Services and Health Care…
369 Needs Assessment TIG
Panel
Mainstreaming and Supporting Needs Assessment in a Large Organization
370 Evaluating the Arts and Culture TIG
MultiPaper
Multi-year Evaluation of the Arts Education Reform Efforts in South Carolina
Room Name
Mencken Room
Carroll Room
Douglass Boardroom
Hopkins Room
Peale Room
Adams Room
Jefferson Room
Washington Room
D'Alesandro Room
Calhoun Room
McKeldon Room
Preston Room
Schaefer Room
Fairmount Suite
Federal Hill Suite
Royal Board Room
Hanover Suite B
Baltimore Theater
International Room
Chesapeake Room
Versailles Room
Thursday, 11:15 am to 12:45 pm
336 - Learning Practical Knowledge Through the
Study of Cases
Panel to be held in the International
Ballroom Section A on the Main
• Chair - Jody Fitzpatrick, University of Colorado, Denver
• Discussants - Tysza Gandha and Holli Burgon, University
of Illinois at Urbana-Champaign; Jody Fitzpatrick, University
of Colorado, Denver
The Role of Practical Knowledge in Learning
• Thomas Schwandt, University of Illinois at UrbanaChampaign
Gaining Practical Knowledge from Dialogues on Ethical Cases
• Michael Morris, University of New Haven
337 - Practicing What we Preach: Exploring the
Transformative Potential of Evaluation
MultiPaper to be held in the International Ballroom Section B
on the Main Lobby Level in the Sheraton
• Chairs - Tanya Brown and Rodney Hopson, Duquesne
University
• Discussants- Karen Kirkhart, Syracuse University;
Stafford Hood, Arizona State University
Planting Collaborative Growth: Coalition Building as a Key
Element to the Evaluation Process
• Nia Davis, University of New Orleans
An Analysis of Organizational Capacity and Research Inquires:
Incorporating Cultural Competence in Evaluation Research
Agendas
• Milton Ortega, Portland State University
Illuminating Community Meanings: Utilization of a Narrative
Framework to Document Community Change
• Josephine Sirineo, University of Michigan
Evaluation of Non-Traditional Approaches for Preventing High
School Dropout
• Roderick Harris, University of Pittsburgh
338 - Incorporating Technological Innovations in
Data Collection
Multipaper to be held in the International Ballroom Section C
• Chair and Discussant - Sandra Mathison, University of
British Columbia
Using On-line Diaries as an Evaluative Tool to Improve Program
Development and Implementation
• Nicole Gerardi, University of California, Los Angeles
338 – Continued
Photolanguage Use With Novice Teachers Participating in a
School University Partnership to Provide Optimal Resources for
Teachers (SUPPORT) Network
• Ann Bessell, Adriana Medina, Paola Pilonieta, and
Valentina Kloosterman, University of Miami
Fitting PhotoVoice Into an Evaluator's Repertoire of Qualitative
Tools: Possibilities and Caveats
• Amy La Goy, Evaluation and Research Consulting; Edward
Mamary, San Jose State University
339 - Models of Evaluation Use and Influence in
Social and Educational Services
Multipaper to be held in the International Ballroom Section D
• Chair - Dennis Affholter, Affholter and Associates
Supporting the Conditions for Organizational Development: A
Case Study Examining the Role of the Evaluator
• Cheryl-Anne Poth, Queen's University
Evaluation Influence and Evaluation Utilization: Comparison of
Theories and Application to a Case
Implications of a Case Study for Mark and Henry's Schematic
Model of Evaluation Influence
• Shu-Huei Cheng, National Hsinchu University of
Education; Jean King, University of Minnesota
340 - Evaluation Training: Developing Professionals
Multipaper to be held in the International Ballroom Section E
• Chair - Chris Coryn, Western Michigan University
Teaching Evaluation Skills in Trinidad and Tobago: Obstacles
and Solutions
• Lindsay Nichols, Lisa Sandberg, Aisha Leverett, and Linda
Heath, Loyola University, Chicago
Growing New Buds on the Evaluation Tree: Undergraduate
Students' Interest in Program Evaluation
• John LaVelle, Claremont Graduate University
Program Evaluation to Guide Training for State-wide Federally
Funded College Access Initiative: The Experience of First-time
Evaluators
• Karyl Askew, Bridget Weller, and Tangie Gray Fleming,
University of North Carolina, Chapel Hill
Integrating Client Education With the Evaluation Process
• Christopher L Vowels and Jason Brunner, Kansas State
University
Evaluation 2007: Thursday, November 8, 11:15 am to 12:45 pm
Page 51
Thursday, 11:15 am to 12:45 pm, Continued
341 - Evaluation Capacity Building Unplugged
Think Tank to be held in the Liberty Ballroom, Section A on the
Building TIG
• Hallie Preskill and Shanelle Boyle, Claremont Graduate
University
342 - Professional Status for Evaluators: Canadian
and American Views
Panel to be held in the Liberty Ballroom, Section B on the Main
• Chair - Gerald Halpern, Fair Findings Inc
Warming up to the Prospect of Professional Designations:
Reflections on the Canadian Process
• J Bradley Cousins, University of Ottawa; Jim Cullen,
Thomas More Institute
Arriving at an Action Plan
• Gerald Halpern, Fair Findings Inc
Critical Examination of the Canadian Plan
• James W Altschuld, The Ohio State University
343 - Exploring the Implications of the
Administration of Aging's Performance
Outcomes Measures Project for Evaluators
• Chair - Patricia Yee, Vital Research, LLC
• Discussant - Melanie Hwalek, Social Program Evaluators
and Consultants Inc
Administration on Aging's (AoA) Performance Outcomes
Measures Project (POMP) as a Resource: History and Use as a
Resource for Evaluators
• Saadia Greenberg, United States Department of Health
and Human Services; Cynthia Agens Bauer, Administration
on Aging
Assessing the Utility and Validity of the Senior Center
Performance Measure in Senior Affordable Housing
Developments
• Joelle Greene, National Community Renaissance
Adapting the Caregiver Support and Assessment Survey
Instrument to Assess Kin-caregiver Needs
• Allison Nichols, West Virginia University
344 - Evaluation in Education
• Chair - Rene Lavinghouze, Centers for Disease Control
and Prevention
A Case Study of Involvement and Influence: Multi-year Crosssite Core Evaluation of the National Science Foundation's
Collaboratives for Excellence in Teacher Preparation Program
• Kelli Johnson, Frances Lawrenz, and Lija Greenseid,
University of Minnesota
Multiplicity in Action: Creating and Implementing a Multiprogram, Multi-site Evaluation Plan for a Predominantly
Minority/Urban School District
• Mehmet Dali Öztürk, Arizona State University
Lessons Learned From Rating the Progress and Extent of
Reform
• Patricia K Freitag and Darnella Davis, COSMOS
Corporation
Value-added Assessment: Teacher Training Designed to
Improve Student Achievement
• Laurie Ruberg, Judy Martin, and Karen Chen, Wheeling
Jesuit University
Using Threshold Analysis to Develop a Typology of Programs:
Lessons Learned from the National Evaluation of Communities
In Schools (CIS)
• Allan Porowski, Stella Munya, and Felix Fernandez,
Caliber an ICF International Company; Susan Siegel,
Communities in Schools
345 - Foundation Policy Change Efforts: Internal and
External Evaluation Strategies
Multipaper to be held in the Carroll Room on the Main Lobby
• Chair - Claire Brindis, University of California, San
Francisco
Developing a Framework for Evaluating Policy and Advocacy
Activity at the Foundation Level
• Charles Gasper and Leslie Reed, Missouri Foundation for
Health
The Role of Policy Advocacy in Assuring Comprehensive Family
Life Education in California
• Claire Brindis, Sara Geierstanger, and Adrienne Faxio,
University of California, San Francisco
Did you know? AEA has over 5500 members
as of October 2007.
Page 52
346 - Conducting Large Scale Evaluations of Federal
Cancer Control Programs
Panel to be held in the Pratt Room, Section A on the Lower
• Chair - Lenora Johnson, National Institutes of Health
Evaluation of the National Network of Tobacco Cessation
Quitlines (NNTCQ) Initiative
• Candace Deaton Maynard, National Institutes of Health
Evaluation of the National Cancer Institute's National Body &
Soul Dissemination
• Felicia Solomon, National Institutes of Health
The Impact of a Smoking Cessation Media Campaign in the
Military
• Herbert Baum, National Institutes of Health
347 - Evaluating the Effectiveness of Community
Prevention Coalitions: An Interim Report on the
Evaluation of the Drug-free Communities Support
Program
• Chair - David Chavis, Association for the Study and
• Discussant - Kenneth Shapiro, Office of National Drug
Control Policy
How Do You Evaluate Community Prevention Coalitions?:
Design of the Evaluation of Drug-free Communities Support
Program
• Jeanine Christian, Battelle Centers for Public Health
Research and Evaluation
Framework for a Typology of Community Substance Abuse
Prevention Coalitions
• Joie Acosta, Association for the Study and Development
of Community
A Nationwide Comparison of Communities With and Without
Drug-Free Community Coalitions
• Ben Pierce, Battelle Centers for Public Health Research
and Evaluation
Examining Effectiveness: What Are the Characteristics of
Successful Coalitions in the Drug-Free Communities Support
Program?
• David Chavis, Association for the Study and Development
of Community
Navigating the Challenges of Evaluating Community Prevention
Coalitions
• Jennifer Mason, Battelle Centers for Public Health
348 - Roundtables
Rotation I: A Time Sequencing Evaluation Technique for
Exercise Evaluation
• Lisle Hites, Tulane University
Rotation II: Linking Monitoring, Evaluation and Internal Audit in
International Emergency Response to Increase Effectiveness
• Jason Ackerman, Carlisle Levine, and Alex Causton,
Catholic Relief Services
349 - Exchange Outcome Assessment Linkage
System (E-GOALS): A United Sates Department of
State Web-Based Approach to Assessing the
Performance of International Educational Programs
Panel to be held in the Hopkins Room on the Lower Level in the
Sheraton South Tower
• Chair - Cheryl Cook, United States Department of State
Part 1: A Brief Overview of the Exchange Outcome Assessment
Linkage System (E-GOALS) System and its Development
• Cheryl Cook, United States Department of State
Part 2: An Outline of the Nine Bureau Level Performance
Outcomes - Part 3: The Construction of the Nine Indicators That
Are Based on the Nine Bureau Outcomes-Question Bank
• Steven Gaither, United States Department of State
Part 4: Examples of Our Pre, Post and Follow-up Templates Part 5: Highlight Critical Features, e.g., Multi-language
Database
• Michelle Hale, United States Department of State
Look for the conference logo
throughout the program to
identify the sessions
selected for the
Presidential Strand
Page 53
350 - Building a Framework for Public Diplomacy
Evaluations: Lessons Learned and Best Practices in
Public Diplomacy Evaluation
Panel to be held in the Peale Room on the Lower Level in the
• Chair - Melinda Crowley, United States Department of
State
• Discussant - Norma Fleischman, United States
Department of State
Building the Architecture for Evaluating the American Corners
Program Globally
• Melinda Crowley, United States Department of State
Building a Foundation for Assessing Media Outreach at United
States Embassies
• James Alexander, United States Department of State
Developing a Global Tool for Tracking Public Diplomacy
Outreach at United States Embassies
• Catalina Lemaitre, United States Department of State
351 - Macro-level and Micro-level Methodologies for
Evaluating Education System Functioning in
Afghanistan
MultiPaper to be held in the Adams Room on the Cabana Level
• Chair - Edward Kissam, JBS International Inc
• Discussants- Roger Rasnake and Jo Ann Intili, JBS
International Inc
Challenges in Interpreting National Survey Data on Education:
Moving From Summary Tabulation to Practical Action
• Craig Naumann, Shannon Williams, and Edward Kissam,
JBS International Inc
From Ritual Flowchart to Complexities of Real-world Action:
Understanding the Local Community Context of School
Functioning as an Element of Formative Evaluation
• Mohammad Javad Ahmadi, Creative Associates
International Inc; Bianca Murray, JBS International Inc
Capacity-Building Challenges, Requirements, and Strategies
for Strengthening National Education Systems' Evaluation
Research Capacity
• Trish Hernandez, Shannon Williams, and Craig Naumann,
JBS International Inc
352 – Roundtables
352 – Continued
Rotation I: Authentic Demand and Sustainable Community
Change: Testing a Theory and Making the Case
• Audrey Jordan, Annie E Casey Foundation; Mary Achatz,
Westat; Thomas Kelly, Annie E Casey Foundation
Rotation II: Maximizing Learning From Evaluation Findings for
Diverse Stakeholders in a Community Capacity-building
Initiative
• Liz Maker, Mia Luluquisen and Tammy Lee, Alameda
County Public Health Department; Kim Gilhuly, University of
California
353 - Evaluating a State Comprehensive Cancer
Control Program: Planning, Implementation and
Initial Results
Chair - Lisa Stephens, National Cancer Institute
Introduction to Comprehensive Cancer Control in Minnesota:
Planning, Implementation and Evaluation
• Lisa Stephens, National Cancer Institute
Developing Tools and Methods to Operationalize the
Evaluation Plan
• Priscilla Flynn, Mayo Clinic
Reporting to Stakeholders and Lessons Learned
• Julia Johnsen, University of Minnesota
354 - The Contribution of Evaluation to Building the
Capacity of Indigenous, Not for Profit Organizations
in New Zealand: Implementation of the Child, Youth
and Family Provider Development Fund
MultiPaper to be held in the D'Alesandro Room on the Cabana
• Discussant - Kate McKegg, The Knowledge Institute Ltd
Taking the Time and Building the Relationship: The Approach
Taken to the Design and Implementation of the Iwi and Maori
Provider Workforce and Development Fund Evaluation
• Nan Wehipeihana, Research Evaluation Consultancy Ltd
Utilizing Evaluation in the Ongoing Implementation of the Iwi
Maori Provider Development Fund
• Sonya Cameron, Department of Child, Youth and Family
Services
The Contribution of Evaluation to Building the Capacity of Iwi
and Maori Social Service, Not-For-Profit Provider Organizations
• Miri Rawiri, Department of Child, Youth and Family
Services
Building an Evidence Base to Support the Sustainability of Iwi
and Maori Social Service Provider Organizations and the
Development of Cultural Practice Models
Page 54
355 - Evaluation Reports: Reframing the Concept for
the Real World
Panel to be held in the Calhoun Room on the Cabana Level in
• Chair - Zoe Clayson, Abundantia Consulting
• Discussant - Gale Berkowitz, Packard Foundation
Reflection and Learning From Evaluation Reports: Perspectives
Across Foundations
• Patricia Patrizi, Patrizi Associates
A Diagrammatic Approach to Fostering Common Talk on
Impact
• John Nash, Open Eye Group
Innovation Using the Web and Visuals to Strengthen Common
Talk
• Zoe Clayson, Abundantia Consulting
356 - Reflections and Recommendations Concerning
Culturally Competent Evaluation
Think Tank to be held in the McKeldon Room on the Cabana
• Arthur Hernandez, University of Texas, San Antonio; Julie
Desjarlais, Turtle Mountain Community College; Heyda
Martinez, SUAGM; Ana Marie Pazos-Rego, University of
Miami; Iris Prettypaint, University of Montana; Delia J VallesRosales, New Mexico State University; Elizabeth Yellowbird,
University of North Dakota; JoAnn W L Yuen, University of
Hawaii, Manoa
357 - Reflective Inquiry Into Learning Through
Evaluation Practice
Building TIG
• Chair - Daniel Folkman, University of Wisconsin,
Milwaukee
Learning While Creating Pathways to College
• Daniel Folkman, University of Wisconsin, Milwaukee
Learning Within a Parent Education Agency
• Devarati Syam, University of Wisconsin, Milwaukee
Learning within Hmong Family Strengthening Programs
• Kalyani Rai, University of Wisconsin, Milwaukee
358 - Sharing, Defining Ethics and Rejections on
Training
• Chair - Cheri Levenson, Cherna Consulting
358 – Continued
To Share or Not to Share: A Discussion of the Possibility of a
Data Sharing System for American Evaluation Association
Members
• Dreolin Fleischer, Claremont Graduate University
Reflecting on Learning, Evaluation and Self-evaluation: The
Training Dimension of Evaluation
• Serafina Pastore, University of Bari
359 - State and Local Public Health Emergency
Preparedness: Evaluation at the Centers for Disease
Control and Prevention Expands Focus on Capacities
to Include Outcomes
• Chair - Craig Thomas, Centers for Disease Control and
Prevention
• Discussant - Edward Liebow, Battelle Centers for Public
Health Research and Evaluation
Historical Overview of the Evolution of the Evaluation Focus for
the Public Health Emergency Preparedness Program
• Patricia Bolton, Battelle Centers for Public Health
Fund Federally, Respond Locally: Evaluating Public Health
Emergency Preparedness in Diverse Contexts
• Davis Patterson, Battelle Centers for Public Health
Crawl, Walk, Run: An Incremental Approach for Demonstrating
Accountability in Centers for Disease Control and Prevention's
Public Health Emergency Preparedness Cooperative
Agreement
• Sue Lin Yee, Centers for Disease Control and Prevention
360 - Evaluation Contracts: Considerations, Clauses,
and Concerns
Demonstration to be held in the Calvert Ballroom Salon C on
the Ballroom Level in the Radisson
• Kristin Huff, Independent Consultant
361 - Locating Evidence of Research-based
Extension Education Programs
Think Tank to be held in the Calvert Ballroom Salon E on the
• Discussants- Bart Hewitt, United States Department of
Agriculture; Dawn Gundermann, University of Wisconsin
• Presenter - Heather Boyd, Virginia Tech
Page 55
362 - Evaluating Teacher Professional Development
Multipaper to be held in the Fairmount Suite on the 19th Floor
in the Radisson
• Chair - Rabia Hos, University of Rochester
Review of Evidence on the Effects of Teacher Professional
Development on Student Achievement: Findings and
Suggestions for Future Evaluation Designs
• Kwang Suk Yoon, Teresa Duncan, and Silvia Lee,
American Institutes for Research; Kathy Shapley, Edvance
Research Inc
Evaluating the Link Between Teacher Professional
Development and Student Achievement: A Longitudinal,
Mixed-method Approach
• Barbara Heath, East Main Educational Consulting LLC
Bonnie Walters, University of Colorado, Denver; Aruna
Lakshmanan, University of North Carolina, Wilmington; Aaron
Perlmutter, East Main Educational Consulting LLC
The Missing Link: Teacher development, Evaluation and Brain
Research
• Barbara Thomson, The Ohio State University; Tamara J
Barbosa, PhD's Consulting
Balancing Change and Complexity: Evaluation of a Statewide
Professional Development Program for Literacy Instruction
• Janice Noga, Pathfinder Evaluation and Consulting
363 - Evaluating Schools and Processes Within
Schools
Multipaper to be held in the Federal Hill Suite on the 19th
• Chair - Paul Lorton Jr, University of San Francisco
Evaluating a Problem-solving Model: Including Training and
Organizational Factors That Influence the Fidelity of
Implementation
• Elizabeth Cooper-Martin and Heather Wilson,
Montomgery County Public Schools
What Helps, What Hinders: The Interplay of Conditions
Associated with High-performing and Under-performing
Diverse, Title I Schools
• River Dunavin, Albuquerque Public Schools
Evaluating Organizational Learning in Education: Modifying
and Validating an Instrument With Empirical Evidence From
Health Settings
• Catherine Callow-Heusser, Wendy Sanborn, and Heather
Chapman, EndVision Research and Evaluation
Learning From School Districts: Practicing Effective Decisionmaking Through the Use of Multiple Achievement Criteria
• Paul Gale, San Bernardino County Superintendent of
Schools
364 - Research Evaluation of the Upcoming
Europeans Union’s Framework Program
• Chair - Peter Fisch, European Commission
Networks of Innovation in Information Technology: Technology
Development and Deployment in Europe
• Nicholas Vonortas, George Washington University; Franco
Malerba, Nicoletta Corrocher, and Lorenzo Cassi, Luigi
Bocconi University
A New System for Research Evaluation Under the European
Union's Seventh Framework Program
• Neville Reeve, European Commission
The European Union's Seventh Framework Programme and the
Role of Evaluation
• Peter Fisch, European Commission
365 - Evaluating the Cultural Competence of
Substance abuse and Mental Health Services: Policy,
Technology, and Practice
• Chair - James Herrell, United States Department of Health
and Human Services
Perspectives on the Evaluation of Cultural Competence in
Substance Abuse and Mental Health Services
• James Herrell, United States Department of Health and
Human Services
An Operational Framework for Bridging Cultural Competency
Evaluation Policy and Practice
• Ramón (Ray) Valle, San Diego State University
Developing and Evaluating Culturally Adaptive Cognitive
Behavioral Therapy
• Gregory Archer, Archer, Searfoss and Associates Inc
Page 56
366 - Empowerment Evaluations: Insights,
Reflections, and Implications
Evaluation TIG
• Chair - Brian Marriott, Calgary Health Region
Evaluation as a Learning Process for Teachers and School
Organizations: Moving From a Judgmental to an Empowerment
Model
• YunHuo Cui and XueMei Xia, East China Normal University
Reflections on Empowerment Evaluations in South Africa
2004-2007
• Ray Basson, University of the Witwatersrand
Lesson Study: Professional Development for Empowering
Teachers and Improving Classroom Practices
• Robin Smith, Florida State University
Creating a Sense of Community Through Empowerment
Evaluation of an Academic Program
• Asil Ozdogru, University at Albany
367 - Quantitative Methods: Theory and Design TIG
Business Meeting and Presentation - Theory Soup for
the Quantitative Soul
Business Meeting to be held in the Baltimore Theater on the
• Discussant - William Trochim, Cornell University
• Melvin Mark, Pennsylvania State University
• TIG Leaders - Patrick McKnight, George Mason University;
George Julnes, Utah State University; Fred Newman, Florida
International University; Karen Given Larwin, Gannon
University; Dale Berger, Claremont Graduate University
368 - Quality Counts: Becoming Bilingual in Quality
Improvement and Evaluation in
Human Services and Health Care Settings
• Chair - James Sass, LA's BEST After School Enrichment
Program
Integrating Quality Improvement and Internal Program
Evaluation to Enhance Program Learning and to Facilitate
Conditions for Program Success
• Lois Thiessen Love, Uhlich Children's Advantage Network
368 – Continued
Introducing Evaluation Tools to a National Child Abuse
Prevention Organization – Program Quality, Participant
Outcomes, Model Fidelity
• Margaret Polinsky, Parents Anonymous Inc
Learning from Patients: Identifying and Transforming the
Culture(s) of a Community Hospital in New Orleans
• Paul Longo, Touro Infirmary
369 - Mainstreaming and Supporting Needs
Assessment in a Large Organization
Panel to be held in the Chesapeake Room in the Lower Lobby
Sponsor: Needs Assessment TIG
• Chair - Maurya West Meiers, World Bank
Creating a Multi-dimensional Learning Series to Build
Awareness, Skills, and Enthusiasm About Needs Assessment
• Maurya West Meiers, World Bank
Needs Assessment for Program Strategy and for Learning:
Methodology and Practical Tools
• Ryan Watkins, George Washington University
Dissemination and Consultations to Foment Implementation of
Needs Assessment in an Organization
• Joy Behrens, World Bank
370 - Multi-year Evaluation of the Arts Education
Reform Efforts in South Carolina
MultiPaper to be held in the Versailles Room on the Lobby
Sponsor: Evaluating the Arts and Culture TIG
• Chair - Ching Ching Yap, University of South Carolina
• Discussant - Ken May, South Carolina Arts Commission
Summary of Five-Year Evaluation in Arts Education Reform
Effort
• Ching Ching Yap, University of South Carolina
Implications of Arts Programming Characteristics on Student
Achievement
• Leigh D'Amico and Pu Peng, University of South Carolina
Developing Arts Integration Evaluation Tools
• Christine Fisher, Winthrop University
Thursday, 12:55 pm to 1:45 pm
371 – American Evaluation Association Annual
Business Meeting
Meeting to be held in the International Ballroom Section A on
the Main Lobby Level in the Sheraton
Evaluation 2007: Thursday, November 8, 11:15 am to 12:45 pm and 12:55 to 1:45 pm
Page 57
Summary of Sessions for Thursday, November 8, 1:55 PM to 3:25 PM
No Primary Sponsor
Session
Session Title
Room Name
372 Presidential Strand
Skill-building
Learning Systems and Systems of Learning in Practice
MultiPaper
Distributed Leadership & Social Network Analysis in K-12 Education
374 Systems in Evaluation TIG
Panel
Evaluation From a Self-organizing Versus Predictive Systems Perspective: Examples From the Field
Panel
Building Evaluation Capacity in Youth Serving Organizations for Bullying Prevention
Looking Inside the Research Center Black Box: Using Eval Research to Promote Organizational Effectiveness…
376 Research, Technology, & Development Eval TIG MultiPaper
Business Meeting TIG Business Meeting and Presentation: Learning and Meaning in Organizations: How Evaluation Stops the DRIP
Panel
Cost and Sustainability Checklists: Theory and Practice
Panel
Evaluating Department of Justice Faith and Community-Based Initiatives That Serve Victims of Crime
Mencken Room
380 Environmental Program Evaluation TIG
Multipaper
Connecting People and Nature: Models of Environmental Education
Panel
Evaluating Policy and Advocacy Organizations Through Short Term Measures of Organizational Capacity
Carroll Room
Multipaper
Making Health Evaluation More Culturally Competent Using Mixed Methods and Case Studies
Multipaper
Evaluation to Promote Collective and Individual Learning: Applications in the Human Services
Roundtable
Feminist Evaluation and Accreditation Efforts: What Standards?
Douglass Boardroom
Multipaper
Technological Tools That Build Eval Capacity: The Power of Blogs, Clickers and Web-based Customized Reports
Hopkins Room
386 International and Cross-cultural Eval TIG
Debate
Learning From Each “Other”: Should The Cultural Characteristics of the Evaluator Match the Cultural…
Peale Room
387 Teaching of Evaluation TIG
Multipaper
Learning Through Practice: Developing Evaluation Knowledge Across Settings
Adams Room
Roundtable
Rotation I: Cozy Up and Read With Us at the Book Café: An Eval of a Middle School Mentor/Mentee Literacy Program Jefferson Room
Rotation II: Fostering Learning for All Stakeholders: Lessons From an Evaluation of the Historical Literacy Project
Panel
Outbreaks: How Do You Evaluate Responses to the Unexpected?
Washington Room
Multipaper
Learning From Each Other: Cross-cutting Issues and Opportunities
D'Alesandro Room
Multipaper
Innovative Approaches to Impact Assessments
Calhoun Room
Multipaper
Indigenizing Approaches to Evaluation in American Indian, First Nations, and Native Hawaiian Communities
McKeldon Room
Skill-building
Collaborative Evaluations: A Step-by-Step Model for the Evaluator
Preston Room
394 Evaluation Managers and Supervisors TIG
Business Meeting TIG Business Meeting and Presentation: Managing Evaluation: Towards a Text for Practitioners
Schaefer Room
395 Business and Industry TIG
Multipaper
Evaluation, Learning, and Training in Business Industry Settings
Panel
Putting Your Program Logic Model to Use
Panel
Eval Specialists: How Those who Evaluate Cooperative Extension Svcs and Other Ed Organizations Define…
Panel
MultiPaper
Weaving Collaborative Learning Principles into a Multi-dimensional Evaluation of an Early Learning Partnership
Using Mixed Methods to Evaluate the North Carolina DSSF on Academically Disadvantaged Students
Fairmount Suite
Federal Hill Suite
400 Lesbian, Gay, Bisexual, Transgender Issues
Business Meeting TIG Business Meeting and Think Tank: LGBT and Intersex Issues and Queer Theory in Evaluation…
Royal Board Room
MultiPaper
Small Wins Are Winsome: Aggregating Learning From Small Evaluations Into Systems Change
Demonstration
Lessons Learned Through Building Capacity in Collaborative Evaluation in the Field of Education
Hanover Suite B
MultiPaper
Measurement to Improve Precision and Validity of Evaluation Outcomes
Baltimore Theater
MultiPaper
Patient Preferences for Treatment: Correlates and Impact
International Room
Multipaper
Evaluating Student Learning Outcomes
Chesapeake Room
Multipaper
Exploring Innovation and Process in Arts Evaluation
Versailles Room
372 - Learning Systems and Systems of Learning in
Practice
Skill-building Workshop to be held in
the International Ballroom Section A
on the Main Lobby Level in the
Sheraton
• Bob Williams, Independent Consultant; Kate McKegg,
The Knowledge Institute Ltd
373 - Distributed Leadership & Social Network
Analysis in K-12 Education
• Chair - Becky Cocos, Georgia Institute of Technology
Social Network Analysis in K-12 Education Literature Review
• Andrew Kerr and Becky Cocos, Georgia Institute of
Technology
Distributed Leadership and Social Network Analysis at the
School District Level
• Becky Cocos, Andrew Kerr, and Tom McKlin, Georgia
Institute of Technology
Evaluating University-High Schools Partnerships Using Social
Networks and Graph Analysis
• Marion Usselman, Donna Llewellyn, and Gordon Kingsley,
Georgia Institute of Technology
374 - Evaluation From a Self-organizing Versus
Predictive Systems Perspective: Examples From the
Field
Panel to be held in the International Ballroom Section C on the
Sponsor: Systems in Evaluation TIG
• Chair - Beverly Parsons, InSites
Contrasting Evaluation Designs for Predictive and Selforganizing Dimensions of Complex Human Systems
• Beverly Parsons, InSites
Dynamic Evaluation
• Glenda Eoyang, Human Systems Dynamics Institute
Co-evolving Evaluation
• Patricia Jessup, InSites
375 - Building Evaluation Capacity in Youth Serving
Organizations for Bullying
Panel to be held in the International Ballroom Section D on the
• Chair and Discussant - Nancy Csuti, The Colorado Trust
Incorporating Evaluation into Bullying Prevention Programming
• Ed Lucero, The Colorado Trust
375 – Continued
Providing Customized Technical Assistance within a
Foundation: Directed Evaluation Framework
• Robin Leake, JVA Consulting LLC
Using Evaluation to Guide Program Related Technical
Assistance: The Real World Intervenes
• Jill Adams, Colorado Foundation for Families and
Children
376 - Looking Inside the Research Center Black Box:
Using Evaluation Research to Promote Organizational Effectiveness of Scientific Research Centers
MultiPaper to be held in the International Ballroom Section E
• Chair - Denis Gray, North Carolina State University
• Discussant - Gretchen Jordan, Sandia National
Laboratories
Evaluating Leadership Development in a Research and
Development (R&D) Context: Assessing Alpha, Beta, and
Gamma Change
• Bart Craig, North Carolina State University
A Multi-variate Study of Graduate Student Satisfaction and
Other Outcomes Within Cooperative Research Centers
• Jennifer Schneider, North Carolina State University
Enhancing Collaboration Between Historically Black Colleges
and Universities (HBCU) and Research Extensive Universities
• Andrea Lloyd, North Carolina State University
Predictors of Cooperative Research Center Post-Graduation
Survival and Success
• Lindsey McGowen, North Carolina State University
377 - Organizational Learning and Evaluation
Capacity Building TIG Business Meeting and
Presentation: Learning and Meaning in
Organizations: How Evaluation Stops the DRIP
Business Meeting to be held in the Liberty Ballroom, Section A
Building TIG
• Rebecca Gajda and Sharon Rallis, University of
Massachusetts, Amherst
• TIG Leaders - Susan Boser, Indiana University
Pennsylvania; Jean King, University of Minnesota; Rebecca
Gajda, University of Massachusetts, Amherst; Emily Hoole,
Center for Creative Leadership
Did you know? Fifty-eight percent of AEA’s
members train others in evaluation.
Evaluation 2007: Thursday, November 8, 1:55 pm to 3:25 pm
Page 59
Thursday, 1:55 pm to 3:25 pm, Continued
378 - Cost and Sustainability Checklists: Theory and
Practice
• Chair - Daniel Stufflebeam, Western Michigan University
• Discussants- Michael Scriven, Western Michigan
University; Brian Yates, American University; Mary Ann
Scheirer, Scheirer Consulting
A Cost Analysis Checklist Methodology for Use in Program
Evaluations
• Nadini Persaud, Western Michigan University
The Logic and Methodology of Sustainability Evaluation: A
Checklist Approach
• Daniela C Schroeter, Western Michigan University
The Validity and Utility of the Cost and Sustainability
Checklists: A Field-Trial in an International Aid Evaluation
• Otto Gustafson, Western Michigan University
379 - Evaluating Department of Justice Faith and
Community-Based Initiatives That Serve Victims of
Crime
• Chair - Carrie Mulford, United States Department of
Justice
Evaluating Department of Justice Faith-based Programs: An
Overview
• Carrie Mulford, United States Department of Justice
Evaluation of the Rural Domestic Violence and Child
Victimization Enforcement Grant Program Special Initiative:
Faith and Community-based Pilot Program
• Andrew Klein, Advocates for Human Potential
Helping Outreach Programs to Expand II (HOPE II): Faith-based
and Community Organization Evaluation
• Carrie Markovitz, Abt Associates Inc
380 - Connecting People and Nature: Models of
Environmental Education
Sponsor: Environmental Program Evaluation TIG
• Chair - William Michaud, SRA International Inc
Assessing the Effectiveness of a Place-based Conservation
Education Program by Applying Utilization-focused Evaluation
• Lisa Flowers, University of Montana
The Challenges of Evaluating Campus-Community
Partnerships for an Environmental Service-learning Program
• Christa Smith, Kansas State University; Christopher
Lavergne, WaterLINK
Second Year Evaluation of an Outdoor Recreation Program for
At-risk 5th Graders in an Urban School District: Adding Teacher
and Parent Assessment Measures
• Gregory Schraw, Lori Olafson, Michelle Weibel, and
Daphne Sewing, University of Nevada, Las Vegas
Lessons Learned From a Mixed-methods Evaluation of an
Online Environmental Education Program
• Annelise Carleton-Hug and J William Hug, Trillium
Associates
381 - Evaluating Policy and Advocacy Organizations
Through Short Term Measures of Organizational
Capacity
the Sheraton
• Chair - Astrid Hendricks, The California Endowment
• Discussants - Don Crary, Annie E Casey Foundation;
Astrid Hendricks, The California Endowment
The Context for Evaluating Policy and Advocacy Organizations:
Challenges and Limitations
• Shao-Chee Sim, TCC Group
Proposing A Core Organizational Capacity Framework to
Evaluate Short-term Outcomes of Policy and Advocacy
Organizations
• Pete York, TCC Group
Advocacy Core Capacity Assessment Tool: One Mechanism to
Measure Organizational Capacity of Policy and Advocacy
Organizations
• Jared Raynor, TCC Group
Page 60
382 - Making Health Evaluation More Culturally
Competent Using Mixed Methods and Case Studies
• Chair - Kathryn L Braun, University of Hawaii
Use of the Case Study to Understand Program Processes
• Louise Miller and Constance W Brooks, University of
Missouri, Columbia
Learning From a Community-based Evaluation: The
HealthConnect in our Community Evaluation Experience
• Louise Palmer and Embry Howell, The Urban Institute;
Gloria Deckard, Florida International University; Carladenise
Edwards, The Bae Company; Anna Sommers, The Urban
Institute; Lee Saunders, University of Miami
The Minnesota Healthcare Disparities Task Force: A Case Study
of the Use of Complexity Science Based Developmental
Planning and Evaluation Methods
• Meg Hargreaves, Abt Associates Inc
Lessons Learned on Use and Integration of System-Level Data
From the Evaluation of a Public Health Demonstration Project
Bernette Sherman, Amanda Phillips Martinez, Angela Snyder,
Dawud Ujaama, and Mei Zhou, Georgia State University
Using Evaluation Techniques to Conduct a Community-specific
Needs Assessment
• Kristi Lewis, James Madison University
383 - Evaluation to Promote Collective and
Individual Learning: Applications in the Human
Services
Multipaper to be held in the Pratt Room, Section B on the
• Chair - Lois Thiessen Love, Uhlich Children's Advantage
Network
• Discussant - Ellen L Konrad, Independent Consultant
Child Welfare Caseworker Pre-Service Training: Evaluating
Transfer of Skills to the Job
• Chris Hadjiharalambous and Chris Pelton, University of
Tennessee, Knoxville
Challenges in Evaluating Adult Education Programs: How
Theory Can Help Fill in the Gaps and Connect the Dots
• Noelle Rivera, University of California, Los Angeles
Mainstreaming Training Evaluation at the New York City
Administration for Children's Services: An Interpersonal
Process
• Henry Ilian, New York City Administration for Children's
Services
A Process Evaluation of a Community Organizing Agency
• Ayana Perkins, Georgia State University; Mary Wilson,
East Point Community Action Team
384 – Roundtable Feminist Evaluation and
Accreditation Efforts: What Standards?
• Denise Seigart, Mansfield University
385 - Technological Tools That Build Evaluation
Capacity: The Power of Blogs, Clickers and Webbased Customized Reports
Multipaper to be held in the Hopkins Room on the Lower Level
• Chair - Paul Longo, Touro Infirmary
Evaluating Online Community: Finding Connections in an
Informal Blog-based Network
• Vanessa Dennen, Florida State University
Assessing Intuitive Responding as a Function of a
Technological Classroom Initiative: Attributes and Values of
Computer-assisted Data Collection
• Sheryl Hodge, Iris M Totten, and Christopher L Vowels,
Kansas State University
386 - Learning From Each “Other”: Should The
Cultural Characteristics of the Evaluator Match the
Cultural Characteristics of the Population of
Interest?
Debate to be held in the Peale Room on the Lower Level in the
• Chair - Susan Connors, University of Colorado, Denver
• Debaters: Gregory Diggs, University of Colorado, Denver;
Wendy Dubow, National Research Center Inc
Page 61
387 - Learning Through Practice: Developing
Evaluation Knowledge Across Settings
Multipaper to be held in the Adams Room on the Cabana Level
Chair - Neva Nahan, Wayne State University
How do People Learn to Evaluate? Lessons Drawn From Work
Analysis
• Claire Tourmen, Ecole Nationale d'Enseignement
Supérieur Agronomique de Dijon
Experiential Lessons From a Five Year Program Evaluation
Partnership
• M Brooke Robertshaw, Joanne Bentley, Heather Leary,
and Joel Gardner, Utah State University
Developing Understanding: A Novice Evaluator and an Internal,
Participatory and Collaborative
• Michelle Searle, Queen's University
What do Stakeholders Learn About Program Evaluation When
Their Programs Are Being Evaluated?
• Jill Lohmeier, University of Massachusetts, Lowell; Steven
Lee, University of Kansas
388 - Roundtables
Rotation I: Fostering Learning for All Stakeholders: Lessons
From an Evaluation of the Historical Literacy
• Heidi Sweetman and Ximena Uribe, University of
Delaware
Rotation II: Cozy Up and Read With Us at the Book Café: An
Evaluation of a Middle School Mentor/Mentee Literacy
Program
• Connie Walker-Egea and Nakia James, Western Michigan
University
389 - Outbreaks: How Do You Evaluate Responses to
the Unexpected?
Prevention
Using Evaluation Data for Estimating Workforce Capacity
Requirements for Emergency Response
• Joan Cioffi and Christine Rosheim, Centers for Disease
Control and Prevention
389 – Continued
Evaluating the Division of Tuberculosis Elimination Outbreak
Response, is Value Added?
• Maureen Wilce, Centers for Disease Control and
Prevention; Brandii Mayes, Saint Louis City Department of
Health Communicable Disease; Maryam Haddad, John
Oeltmann, and Kashef Ijaz, Centers for Disease Control and
Prevention
Assessment of a Customizable Tuberculosis Outbreak
Response Plan
• Laura Freimanis Hance, Westat; Karen R Steingart,
Francis J Curry National Tuberculosis Center; Christine Hahn,
Idaho Department of Health and Welfare; Lisa Pascopella,
Francis J Curry National Tuberculosis Center; Charles Nolan,
Public Health - Seattle and King County
Challenges of Evaluating Rapid Responses to Syphilis
Outbreaks
• Betty Apt, Centers for Disease Control and Prevention
390 - Learning From Each Other: Cross-cutting
Issues and Opportunities
Multipaper to be held in the D'Alesandro Room on the Cabana
• Chair - Elvis Fraser, Evaluation and Knowledge Services
Group
Aligning and Employing Public Use Data for School-level
Analyses: A Quasi-experimental Study of Communities In
Schools (CIS)
• Sarah Decker, Kelle Basta, and Jill Berger, Caliber an ICF
International Company; Susan Siegel, Communities In
Schools
Think Globally, Act Accountably: An Exploration of Crosscutting Issues in Domestic and International Nonprofit
Evaluation
• Monica Oliver and Shena Ashley, Georgia State University
Effective Communication Strategies for Large Cross-site
Evaluations: Lessons Learned From the National Evaluation of
Communities in Schools
• Kellie Kim and Melissa Busch, Caliber an ICF
International Company; Susan Siegel, Communities in
Schools
Page 62
391 - Innovative Approaches to Impact Assessments
• Chair - Keith Zvoch, University of Nevada, Las Vegas
Treatment Fidelity in Multi-site Evaluation: A Multi-level
Longitudinal Examination of Provider Adherence Status and
Change
• Keith Zvoch and Lawrence Letourneau, University of
Nevada, Las Vegas
Multiple Random Sampling When Treatment Units Are
Matched to Numerous Controls Using Propensity Scores
• Shu Liang and Paul Bellatty, Oregon Department of
Corrections
A Quantitative Evaluation Utilizing the 'Ground Effect' Unit:
Application to the Evaluation of Foreign Student Policy and
Regional Cooperation Program
• Yuriko Sato, Tokyo Institute of Technology
Alternatives Choices When a Comparison/Control Group is
Desired but not Planned
• Deborah Carran, Johns Hopkins University; Stacey
Dammann, York College of Pennsylvania
392 - Indigenizing Approaches to Evaluation in
American Indian, First Nations, and
Native Hawaiian Communities
Multipaper to be held in the McKeldon Room on the Cabana
• Chair - Joan LaFrance, Mekinak Consulting
Continuous Evaluation of the Use of Problem-based Learning
to Engage Native American Students in Environmental Issues
• MaryLynn Quartaroli, Northern Arizona University
The Necessity of Indigenizing Accountability and Assessment
• Katherine Tibbetts, Kamehameha Schools; Maenette
Benham, Michigan State University
393 - Collaborative Evaluations: A Step-by-Step
Model for the Evaluator
Skill-building Workshop to be held in the Preston Room on the
Cabana Level in the Sheraton South Tower
Evaluation TIG
• Liliana Rodriguez-Campos, University of South Florida
394 - Evaluation Managers and Supervisors TIG
Business Meeting and Presentation: Managing
Evaluation: Towards a Text for Practitioners
Business Meeting to be held in the Schaefer Room on the
Sponsor: Evaluation Managers and Supervisors TIG
• Donald Compton, Centers for Disease Control and
Prevention; Michael Baizerman, University of Minnesota
• TIG Leaders - Robert Vito, Office of Inspector General; Sue
Hewitt, Health District of Northern Larimer County; Ann
Maxwell, United States Department of Health and Human
Services
395 - Evaluation, Learning, and Training in Business
Industry Settings
Multipaper to be held in the Calvert Ballroom Salon B on the
Sponsor: Business and Industry TIG
• Chair - Eric Graig, Usable Knowledge LLC
Developing Evaluation Tool for E-Learning
• Ga-jin In, Ewha Womans University
Making e-Learning More Effective Through Evaluation
• Carl Hanssen, Hanssen Consulting LLC; John Mattox,
Nicole Green, and Heather Maitre, KPMG
Learning for Results: How Evaluation Can Help Corporations in
Their Quest for Learning and Business Results
• Vanessa Moss-Summers, Xerox Corporation
396 - Putting Your Program Logic Model to Use
• Chair - Susan Ladd, Centers for Disease Control and
Prevention
Using Logic Models for Program Evaluation
• Jan Jernigan, Susan Ladd, and Michael Schooley, Centers
for Disease Control and Prevention
Logic Models as a Platform for Program Evaluation: The
Washington State Experience
• Marilyn Sitaker, Washington State Department of Health;
Jan Jernigan and Susan Ladd, Centers for Disease Control
and Prevention
Logic Models as an Evaluation Planning Tool: The
Massachusetts Face Arm Speech Time (F.A.S.T.) Stroke
Awareness Campaign
• Hilary Wall, Massachusetts Department of Public Health
The Logic Model as a Mechanism for Evaluating New Jersey's
Statewide Tobacco Control Program
• Mary Hrywna, Hila Feldman Berger, and Cristine Delnevo,
University of Medicine and Dentistry of New Jersey; Uta
Vorbach, New Jersey Department of Health and Senior
Services
Page 63
397 - Evaluation Specialists: How Those who
Evaluate Cooperative Extension Services and Other
Educational Organizations Define and Design Their
Job
• Chair - Daniel McDonald, University of Arizona
A 4-H Evaluation Specialist: Building Evaluation Capacity From
Within a Program Unit
• Mary Arnold, Oregon State University
Evaluation/Program Development/Institutional Research:
Evaluators Wear Many Hats
• Heather Boyd, Virginia Tech
An In-house Product Researcher: Determining the Efficacy of
Educational Products and Services by Introducing Randomized
Controlled Trials
• James Demery, McGraw-Hill
A State Evaluation Leader: Providing Evaluation Leadership to
Cooperative Extension Statewide
• Koralalage Jayaratne, North Carolina State University
Guiding Team Evaluation: Building Capacity for Evaluation
Within Program Area Teams
• Allison Nichols, West Virginia University
398 - Weaving Collaborative Learning Principles into
a Multi-dimensional Evaluation of an Early Learning
Partnership
Radisson
• Chair - Allison Titcomb, LeCroy & Milligan Associates Inc
• Discussant - LaVonne Douville, United Way of Tucson
Improving Early Learning Quality: A Long Range Vision
• LaVonne Douville, United Way of Tucson
Collaborative Learning and Evaluation Design
• Allison Titcomb, LeCroy & Milligan Associates Inc
Using Quality Ratings and Feedback to Assist Center Learning
• Allyson Baehr, LeCroy & Milligan Associates Inc
Learning From Quality Rating Results and Other Partner
Evaluations
• Jen Kozik, LeCroy & Milligan Associates Inc
A Practitioner's View
• Ellen Droegemeier, Tucson Unified School District
399 - Using Mixed Methods to Evaluate the North
Carolina Disadvantage Student Supplement Fund
(DSSF) on Academically Disadvantaged Students
MultiPaper to be held in the Federal Hill Suite on the 19th
• Chair - Gary T Henry, University of North Carolina, Chapel
Hill
Implementation of the North Carolina Disadvantaged Student
Supplement Fund
• Charles Thompson, East Carolina University
Impacts of the North Carolina Disadvantaged Student
Supplement Fund on High School Student Achievement
• C Kevin Fortner, Georgia State University
Process Quality - Student's Exposure to Higher Teacher Quality
• Dana Rickman, Georgia State University
Disadvantaged Student Trend Data
• Kelley Dean, Georgia State University
400 - LGBT TIG Business Meeting and Think Tank:
Lesbian, Gay, Bisexual, Transgender and Intersex
Issues and Queer Theory in Evaluation: Planning a
Proposal to New Directions for Evaluation
Business Meeting to be held in the Royal Board Room on the
Sponsor: Lesbian, Gay, Bisexual, Transgender Issues TIG
• Denice Cassaro, Cornell University; Steve Fifield,
University of Delaware
• TIG Leaders - Denice Cassaro, Cornell University; Les
Burleson, Syracuse University; Steve Fifield, University of
Delaware; Kari Greene, Oregon Public Health Division
401 - Small Wins Are Winsome: Aggregating
Learning From Small Evaluations Into Systems
Change
• Chair - Paul Florin, University of Rhode Island
• Discussant - John Stevenson, University of Rhode Island
Insights Into Implementation of Evidence-based Programs:
Lessons Learned Through Focus Groups
• Thomas Sawyer, University of Rhode Island
Lessons Learned from the Evaluation of Environmental
Strategies in Community Interventions
• Jessica Nargiso, University of Rhode Island
Lessons Learned from the Evaluation of Prevention Training
• Crystelle Egan, University of Rhode Island
Page 64
402 - Lessons Learned Through Building Capacity in
Collaborative Evaluation in the Field of Education
Demonstration to be held in the Hanover Suite B on the
Evaluation TIG
• Ann Brackett, Nancy Hurley, and Sarah Guckenburg,
Learning Innovations at WestEd
403 - Measurement to Improve Precision and Validity
of Evaluation Outcomes
MultiPaper to be held in the Baltimore Theater on the
• Chair - Ya-Fen Chan, Chestnut Health Systems
• Discussant - Barth Riley, University of Illinois, Chicago
Measurement Equivalence: Validity Implications for Program
Evaluation
• Susan Hutchinson, University of Northern Colorado
Assessing Outcomes Across Time: Testing Measurement
Assumptions
• Ann Doucette, George Washington University
I Think the People Changed, or was it the Test?
• Kendon Conrad and Barth Riley, University of Illinois,
Chicago; Ya-Fen Chan and Michael Dennis, Chestnut Health
Systems
404 - Patient Preferences for Treatment: Correlates
and Impact
MultiPaper to be held in the International Room across from
• Chair - Souraya Sidani, Ryerson University
Preferences for Treatment: Methodological Effects
• Souraya Sidani, Ryerson University
Correlates of Preferences
• Joyal Miranda, University of Toronto
Clinical and Methodological Consequences of Preferences
• David Streiner, University of Toronto
Faculty Involvement in Curriculum Planning
• Katrina Miller-Stevens and Jody Fitzpatrick, University of
Colorado, Denver
Learning-centered Evaluation of Teaching
• Trav Johnson, Brigham Young University
406 - Exploring Innovation and Process in Arts
Evaluation
Multipaper to be held in the Versailles Room on the Lobby
• Chair - Kathlyn Steedly, The Academy for Educational
Development
Evaluating AND Encouraging Innovation, Creativity, and
Adaptability: Lessons From a Theatre Company
• Tamara Walser, University of North Carolina, Wilmington;
Keith Bridges, Charter Theatre; Kate Mattingly, Windwalker
Corporation
Evaluating Arts Exhibitions: A Constructivist Insight
• Annabel Jackson, Annabel Jackson Associates
What Makes Opera Thrive: Learning From Evaluation in the
Performing Arts
• Paul Lorton Jr, University of San Francisco
Tip: Every Topical Interest Group (TIG) holds a
business meeting at some point during the
conference. Attend a TIG’s business meeting in
order to learn of the TIG’s plans for the coming
year and to get involved in the life of the
association. Everyone is welcome at TIG business
meetings – whether a new member or seasoned
veteran.
405 - Evaluating Student Learning Outcomes
• Chair - Darryl Jinkerson, Abilene Christian University
• Discussant - Stanley Varnhagen, University of Alberta
Accreditation-Mandated Focus on Learning Outcomes: A Case
Study
• Larry Seawright and Joseph Peabody, Brigham Young
University
Using a Rubric to Evaluate Student Learning and to Increase
Page 65
No Primary Sponsor
Session
Panel
Exploring Evaluation and Learning: Winners of the Student Competition
Multipaper
Accountability, Federal Programs, and No Child Left Behind
Business Meeting TIG Business Meeting and Think Tank: Early Steps to Next Steps: Where Are We Now? Where Should We Go Next?
Session Title
Room Name
MultiPaper
411 Research, Technology, & Development Eval TIG Panel
Conceptual and Empirical Advances in Evaluation Capacity Building
Tools for Useful Performance Assessment of Science and Technology Programs: An Example
412 Costs, Effectiveness, Benefits, and Econ TIG
Skill-building
Starting a "Cost Study": Measuring and Improving Costs, Cost-effectiveness, and Cost-benefit in Human Services
Panel
Reflecting on Practice: Strategies and Lessons Learned
Multipaper
International Issues in Evaluation
Business Meeting TIG Business Meeting and Preview of the Fieldtrip to the Herring Run Watershed Association Project
Mencken Room
416 Social Work TIG
Demonstration
Applying Binary Logistic, Ordered and Unordered Multinomial Logistic Regression Models to Illuminate Learning…
Carroll Room
Multipaper
Multipaper
Roundtable
Evaluation: A Tool for Planning, Implementation, and Organizational Development
Current Approaches to Evaluating Programs for Children, Youth and Parents
Rotation I: Conducting Independent Evaluations: Taking a Proactive Step From Student to Professsional
Rotation II: Ethical Dilemmas: A Case Study of One Graduate Student
Douglass Boardroom
420
421
422
423
424
International and Cross-cultural
Multipaper
Panel
Multipaper
Roundtable
Panel
Capturing Theoretical Underpinnings of Programs Through Qualitative Inquiry
Lessons From the Field: Zambian Case Study
Classroom Experiences and the Teaching of Evaluation
Applying Guskey's Model to a Reading Professional Development Program for K-3 Teachers
Focusing on Exposure as a Central Construct in Health Campaigns Research: Experiences From Entertainment…
Hopkins Room
Peale Room
Adams Room
Jefferson Room
Washington Room
425
426
427
428
Indigenous Peoples in Evaluation TIG
Multipaper
Demonstration
Business Meeting
MultiPaper
Learning From Organizational Level Evaluations
Utilizing Hierarchical Linear Modeling in Evaluation: Concepts and Applications
Indigenous Peoples in Evaluation TIG Business Meeting
Simultaneous Learning: Four Perspectives From a University-based Evaluation Center
D'Alesandro Room
Calhoun Room
McKeldon Room
Preston Room
429 Crime and Justice TIG
Panel
Think Tank
Evaluation Research Involving Criminal Justice Interventions
Continuous Improvement: Examining the Impact of Year-after-Year Evaluations and Improve Learning Products…
Schaefer Room
Think Tank
Challenges and Issues: What Do We Know About the Role of Evaluation in Organizational Learning?…
432
433
434
435
Business Meeting
Panel
Multipaper
Think Tank
Extension Education Evaluation TIG Business Meeting
Professional Communities of Inquiry
Educational Evaluation Internationally
Identifying Challenges to Using Evaluation to Inform Program Management and Public Policy
Fairmount Suite
Federal Hill Suite
Royal Board Room
Multipaper
Skill-building
Substance Abuse Program Evaluation: Productivity Benefits, Peer Mentorship, Drug Courts and Jail Interventions
Moving Measures: Employing Visual Theater and Movement to Convey and Augment Participatory Learning…
Hanover Suite B
Multipaper
Panel
Advancing Valid Measurement in Evaluation
Learning From Experience With Random Assignment Experiments: Lessons From Social Security Benefit-Offset…
Baltimore Theater
International Room
Demonstration
Learning to Assess Learning: Using the Instructional Assessment Resources (IAR) Web Site to Improve Teaching…
Chesapeake Room
441 Feminist Issues in Evaluation TIG
Think Tank
From Identity-based Perspectives to Social Justice in Evaluation
Versailles Room
Extension Education Evaluation TIG
407 - Exploring Evaluation and Learning: Winners of
the Student Competition
Ballroom Section A on the Main
• Chair - Jennifer Martineau, Center for Creative Leadership
• Discussant - Hallie Preskill, Claremont Graduate
University
• Michelle Searle, Queen's University
• Tysza Gandha, University of Illinois at Urbana-Champaign
• Marisa Allen, Case Western Reserve University
• Alice Navarro, Texas State University-San Marcos
• Rachel Lopez, Claremont Graduate University
408 - Accountability, Federal Programs, and No
Child Left Behind
Multipaper to be held in the International Ballroom Section B
• Chair - James Van Haneghan, University of South
Alabama
Programmed for Trouble: Evaluation of Federally Funded
Education Programs
• Keith Murray, M A Henry Consulting LLC
Martha Henry, M A Henry Consulting LLC
Evaluating No Child Left Behind Test-based Educational
Accountability
• Katherine Ryan, University of Illinois at UrbanaChampaign
Assessing the Feasibility of Incorporating Geocoding and
Census Data Into the National Assessment of Educational
Progress (NAEP) Framework
• Stacey Merola and Steve Davis, American Institutes for
Research
Conducting a Robust Performance Needs Assessment: An No
Child Left Behind (NCLB) Case Study
• Willis Thomas, Western Michigan University
409 - Systems in Evaluation TIG Business Meeting
and Think Tank: Early Steps to Next Steps: Where Are
We Now? Where Should We Go Next?
Business Meeting to be held in the International Ballroom
Section C on the Main Lobby Level in the Sheraton
• Chair - Derek A Cabrera, Cornell University
• Discussant - Tessie Catsambas, EnCompass LLC
• TIG Leaders - Derek A Cabrera, Cornell University; Janice
Noga, Pathfinder Evaluation and Consulting; Bob Williams,
410 - Conceptual and Empirical Advances in
MultiPaper to be held in the International Ballroom Section D
• Chair - J Bradley Cousins, University of Ottawa
• Discussant - Peter Dahler-Larsen, University of Southern
Denmark
Integrating Consequences of Evaluation into Evaluation
Capacity Building Inquiry
• J Bradley Cousins, Swee C Goh, and Catherine Elliott,
University of Ottawa
Precarious Balance
• Miri Levin-Rozalis, Ben-Gurion University of Negev
Evaluation Capacity Across Organizational Contexts: What Are
the Patterns?
• Swee C Goh, University of Ottawa; Robert Lahey, REL
Solutions Inc; Catherine Elliott and Jill Chouinard, University
of Ottawa; Keiko Kuji-Shikatani, Independent Consultant
A Case Study of a Successful School Evaluation Capacity
Building Process
• Barbara Rosenstein and Pnina Elal-Englert, Ben-Gurion
University of Negev
411 - Tools for Useful Performance Assessment of
Science and Technology Programs: An Example
Panel to be held in the International Ballroom Section E on the
• Chair - Jerald Hage, University of Maryland
• Discussant - Alfred Powell, National Oceanic and
Atmospheric Administration
A Strategic Balanced Scorecard for Publicly Funded Science
and Technology Programs
• Gretchen Jordan, Sandia National Laboratories
Perceptions of the Research Environment: Kinds of Networks,
Research, and Projects
• Jerald Hage, University of Maryland
Measuring the Immeasurable: Innovation and the Economics
Benefits of Satellite Data
• Jonathon Mote, University of Maryland
412 - Starting a "Cost Study": Measuring and
Improving Costs, Cost-effectiveness, and
Cost-benefit in Human Services
Skill-building Workshop to be held in the Liberty Ballroom,
Section A on the Main Lobby Level in the Sheraton
Sponsor: Costs, Effectiveness, Benefits, and Economics TIG
• Brian Yates, American University
Page 67
413 - Reflecting on Practice: Strategies and Lessons
Learned
• Chair - Jeremy Lonsdale, United Kingdom National Audit
Office
• Discussant - Nancy Kingsbury, United States Government
Accountability Office
The Practice of Metaevaluation: Does Evaluation Practice
Measure-up?
• Leslie Cooksy, University of California, Davis
Valerie J Caracelli, United States Government Accountability
Office
Simply the Best? Understanding the Market for Good Practice
Advice From Government Research and Evaluation
• Elena Bechberger, London School of Economics and
Political Science
Assessing the Utilization and Influence of Evaluations
• Michael Bamberger, Independent Consultant
What Questions Should we ask About Lessons Learned?
• Martin de Alteriis, United States Government
414 - International Issues in Evaluation
Multipaper to be held in the Mencken Room on the Main Lobby
• Chair - Kris Juffer, Action Research & Associates Inc
Monitoring and Evaluation for Accountability: The Case of
Nigeria's Virtual Poverty Fund
• Lawal Aboki, Office of the Senior Special Assistant to the
President on Millenium Development Goals
Normative Supports, Psychological Resistances, and
Procedural Support: Lessons Learned of Performance
Management of the Korean Government
• Wha-Joon Rho, Seoul National University; Kilkon Ko,
National University of Singapore; YeonBaek Jeong, Seoul
National University
415 - Environmental Program Evaluation TIG
Business Meeting and Preview of the Fieldtrip to the
Herring Run Watershed Association Project
Business Meeting to be held in the Edgar Allen Poe Room on
• Chair - Katherine Dawes, United States Environmental
Protection Agency
• Discussant - Matthew Birnbaum, National Fish and
Wildlife Foundation
• TIG Leaders - Katherine Dawes, United States
Environmental Protection Agency; Annelise Carleton-Hug,
Trillium Associates; Lisa Flowers, University of Montana
416 - Applying Binary Logistic, Ordered and
Unordered Multinomial Logistic Regression Models
to Illuminate Learning From Evaluation in Practice
Demonstration to be held in the Carroll Room on the Main
Sponsor: Social Work TIG
• Mansoor Kazi and Tom Nochajski, University at Buffaloo;
Carrie Petrucci, California State University, Los Angeles
417 - Evaluation: A Tool for Planning,
Implementation, and Organizational Development
• Chair - Nino Saakashvili, Horizonti Foundation
How can International Non-governmental Organizations
(INGOs) use Metaevaluations for Accountability and Learning?
• Jim Rugh, CARE International
An Endeavor to Improve Organizational Learning and Quality
Within an International Development Organization
• Mary Picard, CARE International
Catalyzing Design, Monitoring and Evaluation (DM&E) for
Strategic Program Direction in the Transition From Relief to
Development: Practical Lessons for Non-governmental
Organizations
• Nicole Demestihas, Mercy Corps; Scott Chaplowe,
American Red Cross
Evaluating Cooperatives Using Organizational Capacity
Building Index
• Frank Valdivia, Chung Lai, Peter Ngoma, and Michael
Odumbe, Land O'Lakes International Development Division
•
Page 68
418 - Current Approaches to Evaluating Programs for
Children, Youth and Parents
• Chair - Mandi Larsen, Safe Horizon
• Discussant - Vajeera Dorabawila, New York State Office of
Children and Family Services
Assessing the Effectiveness of the Baby&Me Tobacco Free
Program
• Anne Gadomski and Nancy Tallman, Bassett Research
Institute; Laurie Adams, Chautauqua County Health
Department
Development of an Observational Measure to Assess Staff
Implementation of a Residential Program for Youth With
Emotional and Behavioral Problems
• Kristin Duppong Hurley, University of Nebraska, Lincoln;
Tanya Shaw, Girls and Boys Town; Annette Griffith, University
of Nebraska, Lincoln; Ron Thompson, Girls and Boys Town
Impacts, Implementation, and Processes: Lessons Learned
From the Evaluation of the Girls Inc Preventing Adolescent
Pregnancy Program
• Anu Rangarajan and Susan Zief, Mathematica Policy
Research Inc; Heather Johnston Nicholson, Girls
Incorporated; Kristin Adams, Girls Incorporated
Using Outcomes Measurement and Case Studies to Evaluate
an After School Children's Health Initiative: Procedures and
Lessons From the Los Angeles' Better Educated Students for
Tomorrow (LA's BEST) Internal Evaluation of BEST Fit
• James Sass, Sandra Kennedy, and Edith Ballesteros, LA's
BEST After School Enrichment Program
•
419 - Roundtables
Conducting Independent Evaluations: Taking a Proactive Step
From Student to Professional
• Thomas Sawyer, Crystelle Egan, and Jessica Nargiso,
University of Rhode Island
Ethical Dilemmas: A Case Study of One Graduate Student
• Stephen Hulme, Cary Johnson, and David Williams,
Brigham Young University
420 - Capturing Theoretical Underpinnings of
Programs Through Qualitative Inquiry
• Chair - Janet Usinger, University of Nevada, Reno
• Discussant - Janet Usinger, University of Nevada, Reno
Using a Qualitative Approach to Map Beliefs in Education
Policy
• Steve Canavero, Janet Usinger, and Bill Thornton,
University of Nevada, Reno
Learning from History: A Method of Theory Reconstruction for
Approximating Program Theory of Non-living Authors
• Annalisa Raymer and Paula Horrigan, Cornell University
Using Interview Excerpts to Illustrate and Personalize a
Program's Implementation Theory
• Jennifer Jewiss, University of Vermont
421 - Lessons From the Field: Zambian Case Study
• Chair - Alice Willard, Independent Consultant
Step by Step: Key Points and Audiences for Learning in a Field
Monitoring and Evaluation (M&E) System
• Alice Willard, Independent Consultant
Catholic Relief Service (CRS)/Zambia Impact of Lessons From
Rigorous Evaluation
• James Campbell and Shannon Senefeld, Catholic Relief
Services
Learning by Design: SUCCESS II and Partner Participation in
the Monitoring and Evaluation Design
• Thomas Moyo, Catholic Relief Services; Alice Willard,
422 - Classroom Experiences and the Teaching of
Evaluation
• Chair - Katye Perry, Oklahoma State University
Evaluation of an Evaluation Course: Lessons Learned
• Rama Radhakrishna, Pennsylvania State University
Prosper Doamekpor, Pennsylvania State University
Effective Critical Thinking Teaching Strategies as Perceived by
Program Evaluation Faculty
• Dhaifallah Almatrodi and Brooks Applegate, Western
Michigan University
Teaching Evaluation Graduate Courses Online: Challenges and
Alternatives
• Koralalage Jayaratne, North Carolina State University
Page 69
423 - Applying Guskey's Model to a Reading
Professional Development Program for K-3 Teachers
• Rolanda Bell and Brian O'Connell, Arizona Department of
Education; Allison Larsen, Arizona State University
424 - Focusing on Exposure as a Central Construct in
Health Campaigns Research: Experiences From
Entertainment-Education and Other Interventions in
Africa
• Chair - Rajiv Rimal, Johns Hopkins University
• Discussant - Tara Sullivan, Johns Hopkins University
Character Recognition as a Reliable Measure of Exposure to
Alam Simsim Among Preschool Children in Egypt
• Maria Elena Figueroa, Johns Hopkins University
Development of a Continuous Measure of Exposure to a
Television Drama to Help Prevent AIDS in South Africa
• Lawrence Kincaid, Johns Hopkins University
Measuring Types of Exposure and Their Effects as a Function of
Health Competence: The Integrated Communication for
Healthy Living Project in Egypt
• Douglas Storey, Johns Hopkins University
The Radio Diaries Program in Malawi Designed to Reduce HIV
Stigma: Evaluating the Different Measures of Exposure
• Rajiv Rimal, Johns Hopkins University
425 - Learning From Organizational Level
Evaluations
• Chair - Sheridan Green, JVA Consulting LLC
Framing an Evaluation of a Nonprofit Community Based
Organization: A Comparison of Two Delphi Studies
• Monica Geist, University of Northern Colorado
Resistance to Learning From Evaluation in the Context of Nonprofit Organizations
• Luba Botcheva, Julie Slay, and Lynne Huffman, The
Children's Health Council
Development and Use of a Comprehensive Measure of
Nonprofit Organizational Capacity
• Sheridan Green, Robin Leake, and Veronica Gardner, JVA
Consulting LLC
425 - Continued
Evaluating Technical Assistance Services Provided to Grantees
of Federal Agencies: Approaches of and Lessons From the
MayaTech Model
• Kimberly Jeffries Leonard, Mesfin S Mulatu, James
Bridgers, Darren Fulmore, and Wilhelmena Lee-Ougo, The
MayaTech Corporation
426 - Utilizing Hierarchical Linear Modeling in
Evaluation: Concepts and Applications
• Christopher McKinney, University of Northern Colorado;
Antonio Olmos, Mental Health Center of Denver; Kate
DeRoche, University of Northern Colorado
427 - Indigenous Peoples in Evaluation TIG Business
Meeting
Business Meeting to be held in the McKeldon Room on the
• TIG Leaders - Katherine Tibbetts, Kamehameha Schools;
Morris Lai, University of Hawaii; Joan LaFrance, Mekinak
Consulting
428 - Simultaneous Learning: Four Perspectives
From a University-based Evaluation Center
MultiPaper to be held in the Preston Room on the Cabana
Building TIG
• Chair - Gregory Diggs, University of Colorado, Denver
The University Perspective: What we Are Learning About
Providing Evaluation Services in the Community
• Bonnie Walters, University of Colorado, Denver
Cognitive Apprenticeship for New Evaluators
• Susan Connors, University of Colorado, Denver
Teacher Educator and Evaluator: Reflections on Learning
Across Multiple Contexts
• Kim White, Metropolitan State College, Denver
Learning From Two Roles: Evaluator and Policy Analyst
• Anne Martin, University of Colorado, Denver
Page 70
429 - Evaluation Research Involving Criminal Justice
Interventions
Panel to be held in the Schaefer Room on the Cabana Level in
Sponsor: Crime and Justice TIG
• Chair - Winifred L Reed, United States Department of
Justice
Overview of Evaluation at the National Institute of Justice
• Patrick Clark, National Institutes of Justice
Violence and Victimization Evaluations at the National Institute
of Justice
• Angela Moore Parmley, National Institutes of Justice
Crime Control and Prevention Evaluations at the National
Institute of Justice
• Winifred Reed, National Institutes of Justice
430 - Continuous Improvement: Examining the
Impact of Year-after-Year Evaluations and
Improve Learning Products and Evaluation
Think Tank to be held in the Calvert Ballroom Salon B on the
• Discussants - John Mattox and Heather Maitre, KPMG
• Presenter - John Mattox, KPMG
431 - Challenges and Issues: What Do We Know
About the Role of Evaluation in Organizational
Learning? Where Do We Go From Here?
Think Tank to be held in the Calvert Ballroom Salon C on the
Building TIG
• Rosalie T Torres, Torres Consulting Group
432 - Extension Education Evaluation TIG Business
Meeting
Business Meeting to be held in the Calvert Ballroom Salon E on
• TIG Leaders - Mary Arnold, Oregon State University;
Heather Boyd, Virginia Tech
433 - Professional Communities of Inquiry
Radisson
• Chair - Helen Apthorp, Mid-continent Research for
Learning Through Experiments
• Helen Apthorp, Mid-continent Research for Education
and Learning
Learning Through Purposeful Communities
• Sammye Wheeler-Clouse, Mid-continent Research for
Learning Through Translation
• Kirsten Miller, Mid-continent Research for Education and
Learning
434 - Educational Evaluation Internationally
• Chair - Linda Channell, Jackson State University
Respecting Teacher Autonomy in the Face of Accountability
Mandates: Possibilities for Positive Outcomes
• Sigurlina Davidsdottir, University of Iceland; Penelope
Lisi, Central Connecticut State University
Spreading the Good Word: Strengthening Understanding of
Evaluation in New Zealand
• Graham Stoop, Education Review Office
The Need for Teacher Evaluation in Early Childhood Education
in Korea
• Kyoung jin Kim, University of Illinois at UrbanaChampaign; Jungmi Kim, Sahmyook University
435 - Identifying Challenges to Using Evaluation to
Inform Program Management and Public Policy
Think Tank to be held in the Royal Board Room on the 19th
• Discussants - Connie Chang, United States Department
of Commerce; Rosalie Ruegg, TIA Consulting Inc
• Presenter - Connie Chang, United States Department of
Commerce
Page 71
436 - Substance Abuse Program Evaluation:
Productivity Benefits, Peer Mentorship, Drug Courts
and Jail Interventions
Multipaper to be held in the Royal Conference Foyer on the
• Chair - Samantha Williams, Centers for Disease Control
and Prevention
Going one Step Further: Evaluating the Formation and Impact
of a Substance Abuse Peer Mentorship Team
• Lindsay Gustafson, Central Alberta AIDS Network Society;
Christopher Cameron, Calgary Health Region
Evaluating the Productivity Benefits of Substance Abuse
Treatment
• Angela Snyder, Georgia State University
Jail Interventions for Individuals With Co-occurring Disorders: A
Comparison of Urban and Rural Programs in Pennsylvania
• Holly Wald, HPW Associates; Cynthia Zubritsky, University
of Pennsylvania
The Rochester Drug Court: A Replicated Evaluation
• Stephen L Fielding and Rusti Berent, University of
Rochester
437 - Moving Measures: Employing Visual Theater
and Movement to Convey and Augment Participatory
Learning in Program Evaluation
Skill-building Workshop to be held in the Hanover Suite B on
the Mezzanine Level in the Radisson
Evaluation TIG
• Geri Peak, Two Gems Consulting Services
438 - Advancing Valid Measurement in Evaluation
Multipaper to be held in the Baltimore Theater on the
• Chair - Karen Given Larwin, Gannon University
Scales and Indices: What's the Difference and Does it Matter?
• Michael Hennessy, University of Pennsylvania
Measuring Identity and Identity Change in Evaluations
• Elaine Hogard and Roger Ellis, University of Chester
Test Evaluation Using an Explanatory Item Response Model
• Rachael Tan, University of California, Berkeley
Construction and Interpretation of Composite Variables
• Katherine McKnight, Pearson Achievement Solutions; Lee
Sechrest, University of Arizona
439 - Learning From Experience With Random
Assignment Experiments: Lessons From Social
Security Benefit-Offset Pilot Projects
• Chair - George Julnes, Utah State University
• Discussants - Mark Green, United States Social Security
Administration; Joe Entwisle, National Consortium for Health
Systems Development
The Vermont Social Security Disability Insurance (SSDI) $1 for
$2 Benefit Offset Pilot: Experiences From the Field
• Alydia Payette, James Smith, Alice Porter, Peter Burt,
Vermont Division of Vocational Rehabilitation
Understanding the Challenges and Opportunities of
Randomized Policy Experiments: Lessons From the Utah Social
Security Administration Benefit Offset Study
• Anne Reither, Utah State University; Cathy Chambless
and Sara McCormick, University of Utah; George Julnes, Utah
State University
The Benefits Offset Pilot Project: The Connecticut Experience
• Julie Robison and Cynthia Gruman, University of
Connecticut; Amy Porter, Connecticut Bureau of
Rehabilitation Services
Challenges of Conducting Randomized Field Trials: The
Experience of the Wisconsin Social Security Disability
Insurance (SSDI) Employment Pilot
• Barry S Delin, University of Wisconsin, Stout; Christopher
Sell, University of Wisconsin; Anne Reither, Utah State
University
440 - Learning to Assess Learning: Using the
Instructional Assessment Resources (IAR)
Web Site to Improve Teaching and Learning
Demonstration to be held in the Chesapeake Room in the
Lower Lobby Level in the Radisson
• Joel Heikes and John Kucsera, University of Texas, Austin
441 - From Identity-based Perspectives to Social
Justice in Evaluation
Think Tank to be held in the Versailles Room on the Lobby Level
in the Radisson
Sponsor: Feminist Issues in Evaluation TIG
• Discussants - Saumitra SenGupta, APS Healthcare;
Sharon Brisolara, Evaluation Solutions; Denice Cassaro,
Cornell University
• Saumitra SenGupta, APS Healthcare
•
Page 72
No Primary Sponsor
Session
Session Title
Room Name
442
443
444
445
446
Panel
Business Meeting
Expert Lecture
Business Meeting
Business Meeting
Learning From Research on Evaluation Practices and Theories
PreK-12 Educational Evaluation TIG Business Meeting
Soft Systems and Success Case Method: A Perfect Marriage?
Evaluation Use TIG Business Meeting
Research, Technology, and Development Evaluation TIG Business Meeting
448 Program Theory and Theory-driven Eval TIG
Think Tank
Expert Lecture
The Corruption of Public Evaluation: And What Should We Do About It, Collectively or Individually?
A Practitioner's Guide to Program Theory-driven Evaluation
Business Meeting Government Evaluation TIG Business Meeting
Multipaper
Strategic Design, Measurement, and Accountability in Environmental Program Evaluations
Business Meeting TIG Business Meeting and Presentation: Implementing Evidence-based Programs: A Six-step Protocol…
Mencken Room
453
454
455
456
457
458
Business Meeting
Roundtable
Business Meeting
Multipaper
Expert Lecture
Roundtable
Douglass Boardroom
Hopkins Room
Peale Room
Adams Room
Jefferson Room
Presidential Strand/Theories of Eval TIG
Systems in Evaluation TIG
Evaluation Use TIG
Human Services Evaluation TIG Business Meeting
Strategies to Evaluate Learning in Project and Team-based Environments
Qualitative Methods TIG Business Meeting
Learning Through Evaluation: Brazilian and Other International Development Experiences
Evaluation Skills Beyond Technical Capacities
Lessons Learned From the Evaluation of Partnerships Between One Non-governmental Organization Within the EU…
Business Meeting Crime and Justice TIG Business Meeting and Presentations
Demonstration
Tools and Frameworks for Evaluating Social Change Philanthropy: A Case Study of an Evaluation of Response…
Washington Room
D'Alesandro Room
461 College Access Programs TIG
Demonstration
Calhoun Room
462 Special Needs Populations TIG
Business Meeting Special Needs Populations TIG Business Meeting
Multipaper
Internal Evaluation Capacity Building Through Critical Friends and Communities of Practice
McKeldon Room
Preston Room
464 Evaluation Managers and Supervisors TIG
465 Disaster and Emergency Mgmt Evaluation TIG
Panel
Panel
Schaefer Room
Business Meeting Distance Education and Other Educational Technologies TIG Business Meeting
469 Feminist Issues in Evaluation TIG
Business Meeting Feminist Issues in Evaluation TIG Business Meeting
Federal Hill Suite
Panel
Measuring Sexuality and Gender: Accurately Capturing Dimensions and Categories of Sexuality
Royal Board Room
Business Meeting Alcohol, Drug Abuse, and Mental Health TIG Business Meeting and Roundtable: Soldiers Returning From Combat… Royal Conference Foyer
472 Collaborative, Participatory & Em Eval TIG
Think Tank
When Clients Collect Evaluation Data: Promises and Pitfalls
Hanover Suite B
473
474
475
476
Expert Lecture
Demonstration
Panel
Business Meeting
Increasing Evaluation Capacity: Learning From Social Network Analysis, A Review in Evaluation
Regression Discontinuity Design: Lessons Learned From a Real World Application
A Foot in Each Worlds: An Evaluator in the Assessment World
Evaluating the Arts and Culture TIG Business Meeting
Baltimore Theater
International Room
Chesapeake Room
Versailles Room
Evaluating the Arts and Culture TIG
A Demonstration of the Use of Concept Mapping as Evaluation Tool for the NSF’s Integrative Graduate Education…
Assessing and Improving Evaluation Staff Skills
Using a Participatory Impact Assessment Approach to Measure the Effectiveness of Famine Relief…
Evaluation 2007: Thursday, November 8, 5:15 pm to 6:00 pm, Timeslot Overview
Fairmount Suite
Page 73
442 - Learning From Research on Evaluation
Practices and Theories
Ballroom Section A on the Main Lobby
Sponsor: Presidential Strand and the
• Chair - Jody Fitzpatrick, University of Colorado, Denver
• Discussants - Melvin Mark, Pennsylvania State University;
Marvin Alkin, University of California at Los Angeles
Conducting Research on Evaluation: Necessary, Challenging,
and Insightful
• Christina Christie, Claremont Graduate University
Examining Theories of Evaluation in Practice through Case
Studies
• Jody Fitzpatrick, University of Colorado, Denver
443 - PreK-12 Educational Evaluation TIG Business
Meeting
Section B on the Main Lobby Level in the Sheraton
• TIG Leaders - Alison Williams, Clark County School
District; James Van Haneghan, University of South Alabama;
Linda Channell, Jackson State University; Anane Olatunji,
George Washington University; Tom McKlin, Georgia Institute
of Technology
444 - Soft Systems and Success Case Method: A
Perfect Marriage ?
Expert Lecture to be held in the International Ballroom Section
C on the Main Lobby Level in the Sheraton
• Bob Williams, Independent Consultant
445 - Evaluation Use TIG Business Meeting
Section D on the Main Lobby Level in the Sheraton
• TIG Leaders - Karen Kirkhart, Syracuse University; Susan
Tucker, Evaluation and Development Association; Emmalou
Norland, Institute for Learning Innovation
446 - Research, Technology, and Development
Evaluation TIG Business Meeting
Section E on the Main Lobby Level in the Sheraton
• TIG Leaders - Gretchen Jordan, Sandia National
Laboratories; George Teather, Independent Consultant;
Brian Zuckerman, Science and Technology Policy Institute
447 - The Corruption of Public Evaluation: And What
Should We Do About It, Collectively or Individually?
Think Tank to be held in the Liberty Ballroom, Section A on the
• Discussants - Michael Scriven, Western Michigan
University; Ernie House, University of Colorado
448 - A Practitioner's Guide to Program Theorydriven Evaluation
Expert Lecture to be held in the Liberty Ballroom, Section B on
Sponsor: Program Theory and Theory-driven Evaluation TIG
• Chair - Katrina Bledsoe, The College of New Jersey
• Presenter - Stewart I Donaldson, Claremont Graduate
University
449 - Government Evaluation TIG Business Meeting
Business Meeting to be held in the Mencken Room on the
• TIG Leaders - Kent Hutchinson, Florida State Legislature
450 - Strategic Design, Measurement, and
Accountability in Environmental Program Evaluations
Protection Agency
Environmental Protection Agency's (EPA) Toxics Release
Inventory: A Government Accountability Office (GAO)
Evaluation of its Uses for Environmental Information and
Recent Reporting Changes
• Terry Horner, Karen Febey, and Mark Braza, United States
Process- and Model-based Approaches to the Strategic Design
and Evaluation of Performance Measurement Systems
• William Michaud, SRA International Inc
Page 74
452 - Health Evaluation TIG Business Meeting and
Presentation: Implementing Evidence-based
Programs: A Six-step Protocol for Assuring
Replication With Fidelity
Business Meeting to be held in the Pratt Room, Section A on
the Lower Level in the Sheraton South Tower
• Chair - Ann Zukoski, Oregon State University
• Presenters - Kathryn L Braun and Michiyo Tomioka,
University of Hawaii; Shirley Kidani, Executive Office on Aging
• TIG Leaders - Christel A Woodward, McMaster University;
Ann Zukoski, Oregon State University; Robert LaChausse,
California State University, San Bernardino; Eunice
Rodriguez, Stanford University
453 - Human Services Evaluation TIG Business
Meeting
Business Meeting to be held in the Pratt Room, Section B on
• TIG Leaders - Michel Lahti, University of Southern Maine;
Ann Tvrdik, Region III Behavioral Health Services; James
Sass, LA's BEST After School Enrichment Program; Tracy
Greever-Rice, University of Missouri, Columbia
454 - Strategies to Evaluate Learning in Project and
Team-based Environments
Strategies to Evaluate Learning in Project and Team-based
Environments
• Meghan Kennedy and Jake Walkenhorst, Neumont
University
455 - Qualitative Methods TIG Business Meeting
Business Meeting to be held in the Hopkins Room on the Lower
• TIG Leaders - Jennifer Jewiss, University of Vermont; Leslie
Goodyear, Education Development Center Inc; Eric Barela,
Los Angeles Unified School District; Janet Usinger, University
of Nevada, Reno
456 - Learning Through Evaluation: Brazilian and
Other International Development Experiences
• Chair - Elizabeth Harris, EMT Associates Inc
456 – Continued
Evaluating in at Risk Community Environments: Learning From
a Social Program Evaluation in a Brazilian Slum
• Thereza Penna Firme and Ana Carolina Letichevsky,
Cesgranrio Foundation
Learning Through Evaluation: The Case of International
Development Interventions
• Osvaldo Feinstein, Spanish Evaluation Agency
457 - Evaluation Skills Beyond Technical Capacities
Expert Lecture to be held in the Adams Room on the Cabana
• Claire Tourmen, Ecole Nationale d'Enseignement
Supérieur Agronomique de Dijon
458 - Lessons Learned From the Evaluation of
Partnerships Between One Non-governmental
Organization Within the European Union and Two
Caribbean Organizations
• Lennise Baptiste, Kent State University
459 - Crime and Justice TIG Business Meeting and
Presentations
Business Meeting to be held in the Washington Room on the
TIG Leader - Roger Przybylski, RKC Group
Update on the Federal Budget and Federal Funding Streams
for Criminal and Juvenile Justice-Related Research, Evaluation
and Programming
• Roger Przybylski, RKC Group
Overview of the Office of Management and Budget’s Program
Assessment Rating Tool (PART) and its Relevance for
Evaluation and Performance Measurement in the Criminal
Justice Community
• Roger Przybylski, RKC Group
460 - Tools and Frameworks for Evaluating Social
Change Philanthropy: A Case Study of an Evaluation
of Responses by Women's Foundations to Hurricane
Katrina
Demonstration to be held in the D'Alesandro Room on the
• Hanh Cao Yu and Heather Lewis-Charp, Social Policy
Research Associates
Page 75
461 - A Demonstration of the Use of Concept
Mapping as Evaluation Tool for the National Science
Foundation's Integrative Graduate Education and
Research Traineeships Program
Sponsor: College Access Programs TIG
• Jenny Bergeron, University of Florida
462 - Special Needs Populations TIG Business
Meeting
Sponsor: Special Needs Populations TIG
• TIG Leaders - Carol L Henderson-Dahms, Northern Arizona
University; Janice Grskovic, Indiana University Northwest
463 - Internal Evaluation Capacity Building Through
Critical Friends and Communities of Practice
Multipaper to be held in the Preston Room on the Cabana
Building TIG
• Chair - Valerie Janesick, University of South Florida
• Discussant - Ellen Taylor-Powell, University of Wisconsin
Developing a Collaborative Spirit: Learning Communities at
Work
• Candace Lacey, Nova Southeastern University
Learning and Improving? Or Just Gathering Information?
• Laura Silverstein, New Futures
464 - Assessing and Improving Evaluation Staff
Skills
Sponsor: Evaluation Managers and Supervisors TIG
• Chair - Ann Maxwell, United States Department of Health
and Human Services
Improving the Performance of Internal Evaluators in Local
Government
• Sue Hewitt, Health District of Northern Larimer County
Assessing and Working With Evaluators in the Federal
Government
• Ann Maxwell, United States Department of Health and
Human Services
465 - Using a Participatory Impact Assessment
Approach to Measure the Effectiveness of Famine
Relief and Increase Community Resiliency in SubSaharan Africa
• Chair - Carlisle Levine, Catholic Relief Services
• Discussant - Peter Walker, Feinstein International Center
Using Participatory and Developmental Evaluation Methods to
Contribute to Decreased Food Insecurity and Increased Tribal
Peace in Niger: The Experience of Lutheran World Relief
• Heather Dolphin, Lutheran World Relief; Jindra Cekan,
Jindra Cekan LLC; Abdelah Mobrouk, Lutheran World Relief
Using a Participatory Impact Assessment Approach to Improve
Household Resiliency to Food Security Shocks: Catholic Relief
Services/Mali and the Douentza Circle in Crisis
• Moussa Sangare, Abderahamane Bamba, Catholic Relief
Services
468 - Distance Education and Other Educational
Technologies TIG Business Meeting
Business Meeting to be held in the Fairmount Suite on the
• TIG Leaders - Mark Hawkes, Dakota State University
469 - Feminist Issues in Evaluation TIG Business
Meeting
Business Meeting to be held in the Federal Hill Suite on the
Sponsor: Feminist Issues in Evaluation TIG
• TIG Leaders - Sharon Brisolara, Evaluation Solutions;
Denice Cassaro, Cornell University
470 - Measuring Sexuality and Gender: Accurately
Capturing Dimensions and Categories of Sexuality
Panel to be held in the Royal Board Room on the 19th Floor in
the Radisson
• Chair - A Cassandra Golding, University of Rhode Island
Building Blocks of Measurement with Lesbian, Gay, Bisexual,
Transgendered and Questioning Populations
• A Cassandra Golding, University of Rhode Island
Reducing Error: Measuring Sexuality and Gender Issues in
Everyday Evaluation Practice
• Kari Greene, Oregon Public Health Division
Page 76
471 - Alcohol, Drug Abuse, and Mental Health TIG
Business Meeting and Roundtable: Soldiers
Returning From Combat and Higher Learning
Evaluation
Business Meeting to be held in the Royal Conference Foyer on
the 19th Floor in the Radisson
• Maria Clark, United States Army Command and General
Staff College
• TIG Leaders - Robert Hanson, Health Canada; Garrett E
Moran, Westat
472 - When Clients Collect Evaluation Data:
Promises and Pitfalls
Think Tank to be held in the Hanover Suite B on the Mezzanine
Evaluation TIG
• Discussant - Mary Piontek, University of Michigan
• Presenters - Andrea Beesley, Mid-continent Research for
Education and Learning; Sheila Arens, Mid-continent
Research for Education and Learning
473 - Increasing Evaluation Capacity: Learning From
Social Network Analysis, A Review in Evaluation
475 - A Foot in Each Worlds: An Evaluator in the
Assessment World
• Chair - Jo-Ellen Asbury, Villa Julie College
• Discussant - Molly Engle, Oregon State University
Program Evaluation and Higher Education Assessment:
Different Origins, Same Objectives
• Jo-Ellen Asbury, Villa Julie College
Enhancement Through Integration: What we can Learn From
Each Other
• Martha Ann Carey, Connie Brehm, and Javier Guerra,
Azusa Pacific University
476 - Evaluating the Arts and Culture TIG Business
Meeting
Business Meeting to be held in the Versailles Room on the
• TIG Leaders - Sharon Herpin, WestEd; Kathlyn Steedly,
The Academy for Educational Development; Treseen
McCormick, WestEd
Notes:
Expert Lecture to be held in the Baltimore Theater on the
• Maryann Durland, Durland Consulting
474 - Regression Discontinuity Design: Lessons
Learned From a Real World Application
• Elizabeth Autio, Northwest Regional Educational
Laboratory
Page 77
No Primary Sponsor
Session
Business Meeting Costs, Effectiveness, Benefits, and Economics TIG Business Meeting
Mencken Room
479 Social Work TIG
Business Meeting Advocacy and Policy Change TIG Business Meeting
Business Meeting TIG Business Meeting and Presentation: Using Evaluation as a Learning Tool Within the Social Work Curriculum…
Carroll Room
480
481
483
484
485
486
Business Meeting
Business Meeting
Business Meeting
Business Meeting
Business Meeting
Business Meeting
Hopkins Room
Peale Room
Adams Room
Calhoun Room
Independent Consulting TIG
Integrating Technology Into Evaluation
College Access Programs TIG
Session Title
Multiethnic Issues in Evaluation TIG Business Meeting
Independent Consulting TIG Business Meeting
TIG Business Meeting and Presentation: Data-mining for Academic Success
Non-profits and Foundations Evaluation TIG Business Meeting
Teaching of Evaluation TIG Business Meeting and Idea Exchange
College Access Programs TIG Business Meeting
Evaluation 2007: Thursday, November 8, 6:10 pm to 7:00 pm, Timeslot Overview
Room Name
Page 78
477 - Costs, Effectiveness, Benefits, and Economics
TIG Business Meeting
• TIG Leaders - Brian Yates, American University; Samuel
Bickel, United Nations Children's Fund
478 - Advocacy and Policy Change TIG Business
Meeting
Business Meeting to be held in the Edgar Allen Poe Room on
• TIG Leaders - Julia Coffman, Harvard Family Research
Project; Astrid Hendricks, The California Endowment; Ehren
Reed, Innovation Network Inc; Justin Louie, Blueprint
Research & Design Inc
479 - Social Work TIG Business Meeting and
Presentation: Using Evaluation as a Learning Tool
Within the Social Work Curriculum to Enhance
Research and Practice
Business Meeting to be held in the Carroll Room on the Main
• Aisha Williams, Derrick Gervin, Yarnecia Hamilton, Clark
Atlanta University
• TIG Leaders - Mansoor Kazi, University at Buffalo; Sue
Tungate, Colorado State University; Rob Fischer, Case
Western Reserve University; Kimberly D Farris, University of
Pennsylvania
480 - Multiethnic Issues in Evaluation TIG Business
Meeting
Business Meeting to be held in the Pratt Room, Section A on
• TIG Leaders - Elmima Johnson, National Science
Foundation; Emiel Owens, Texas Southern University
483 - Integrating Technology Into Evaluation TIG
Business Meeting and Presentation: Data-mining for
Academic Success
Business Meeting to be held in the Hopkins Room on the Lower
• Presenter - Jim Julius, San Diego State University
• TIG Leaders - Marcie Bober, San Diego State University;
Margaret Lubke, Utah State University
484 - Non-profits and Foundations Evaluation TIG
Business Meeting
Business Meeting to be held in the Peale Room on the Lower
• TIG Leaders - Diane Manuel, The California Endowment;
Lorna Escoffery, Escoffery Consulting Collaborative Inc; John
Nash, Open Eye Group; Teresa Behrens, W K Kellogg
Foundation
485 - Teaching of Evaluation TIG Business Meeting
and Idea Exchange
Business Meeting to be held in the Adams Room on the
• TIG Leaders - Linda Schrader, Florida State University;
Vanessa Dennen, Florida State University; Neva Nahan,
Wayne State University
486 - College Access Programs TIG Business
Meeting
Business Meeting to be held in the Calhoun Room on the
• TIG Leaders - Rita O'Sullivan, University of North Carolina,
Chapel Hill; Kurt Burkum, National Council for Community
and Education Partnerships
487 – Sock Hop
481 - Independent Consulting TIG Business Meeting
Sock Hop to be held in the Calvert Ballroom in the Radisson
• TIG Leaders - Kathleen Dowell, Partners in Evaluation &
Planning LLC; Frederic Glantz, Kokopelli Associates LLC;
Dawn Hanson Smart, Clegg & Associates
Join your colleagues at AEA’s first Sock Hop!
While the term sock hop refers to dances of
the 1950’s, the evening will be devoted to
music from each of the last 5 decades. The
Sock Hop will be a time for us to let our hair
down, enjoy each other’s company, and to
listen and dance to the music of our generations. There will be
a cash bar, and light snacks will be provided. Tickets are $10
and students get in free!
Evaluation 2007: Thursday, November 8, 6:10 pm to 7:00 pm and 7:30 pm to 10:00 pm
Page 79
Notes:
Evaluation 2007: Thursday, November 8, 6:10 pm to 7:00 pm and 7:30 pm to 10:00 pm
Page 80
Friday, November 9, 2007: Overview of Schedule
7:00 am to 6:30 pm
7:00 am to 7:50 am
Single Conference Session
8:00 am to 9:05 am
Plenary Session
9:25 am to 10:10 am
10:20 am to 11:05 am
11:15 am to 12:00 pm
12:10 pm to 1:45 pm
AEA Awards Luncheon (ticketed event)
1:55 pm to 3:25 pm
3:35 pm to 4:20 pm
4:20 pm to 6:00 pm
6:30 pm to 8:00 pm
Reception and Silent Auction
Evaluation 2007: Friday, November 9, Overview
Page 81
Summary of Sessions for Friday, November 9, 9:25 AM to 10:10 AM
No Primary Sponsor
Session
Session Title
Room Name
Multipaper
Understanding the Link Between Research and Practice
Think Tank
Principles of System Change
Expert Lecture
Shifting the Bell Curve: The Benefits and Costs of Raising Student Achievement
Think Tank
What Counts as Credible Evidence in Contemporary Evaluation Practice?
Demonstration
Designing Federal Evaluations: Developing Good Project Objectives and Performance Measures
Mencken Room
Multipaper
Energy Efficiency, Education, and Intention: Cradle to Grave
Evaluation of Community-based Participatory Research and Community Mobilization Strategies…
Carroll Room
Demonstration
Successful Strategies for Developing Evaluation Instruments Using a Web-based System
Demonstration
Assessment of Stakeholder Needs and Evaluation Use in an Organizational Context: The Real World
Roundtable
Ensuring Fidelity of a Computer Aided Reading Intervention in a Randomized Controlled Study
Douglass Boardroom
Expert Lecture
Moral Knowledge and Responsibilities in Evaluating Programs for Youth
Hopkins Room
Demonstration
Teaching Program Evaluation for Diverse Adult Learners Using a Nine-step Evaluation Plan Project
Adams Room
Roundtable
From Insight to Action: New Directions in Foundation Evaluation
Jefferson Room
Multipaper
Recidivism and Re-entry
Washington Room
Think Tank
Multiethnic Issues Dialogue on Graduate Education and Mentoring
D'Alesandro Room
Demonstration
Understanding Terminology in Multi-level Modeling for Program Evaluation
Calhoun Room
Panel
Lessons From Evaluation Use at the United Kingdom National Audit Office and the World Bank Group
McKeldon Room
520 Lesbian, Gay, Bisexual, Transgender Issues TIG Multipaper
Emerging Perspectives on Curriculum, Pedagogy, and Lesbian, Gay, Bisexual, and Transgender Youth
Preston Room
Expert Lecture
The AEA Ethics Committee's Comparative Analysis of International Evaluation Associations' Ethical Guidelines…
Schaefer Room
Roundtable
Increasing Stakeholders' Understanding of Evaluation Results: How We Report Matters!
Calvert Ballroom Salon A
Roundtable
Mentoring and Growing Local Affiliates of the American Evaluation Association (AEA)
Roundtable
Addressing Evaluation Costs: Producing Rigorous Evaluations on a Shoestring Budget
Calvert Ballroom Salon D
Roundtable
A Dialogue About Building the Cross-cultural Competency of Evaluators
Multipaper
Teacher Evaluation
Fairmount Suite
Roundtable
Global Activities of United States Based Social Work Faculty: Missed Opportunities for Research and Evaluation
Federal Hill Suite
Multipaper
Promising Approaches to the Evaluation of Social Policy
Royal Board Room
Panel
Real-life Lessons Learned in Building Capacity for Advocacy and Policy Evaluation
Panel
Expert Lecture
Who Needs a College Goal Sunday? Using Eval to Expand and Improve a Large-scale Financial Aid Awareness…
The Next Generation of Learning Measurement: Measuring and Communicating the Value of the Learning Function
Hanover Suite B
Baltimore Theater
Multipaper
Challenges and Prospects in the Evaluation of Housing Programs
International Room
Multipaper
Engaging Stakeholders in the Evaluation Process
Chesapeake Room
Demonstration
Fulfilling the Promise: An Alternative to the Traditional Literature Review
Versailles Room
Evaluation 2007: Friday, November 9, 9:25 am to 10:10 am, Timeslot Overview
Page 82
Friday, 7:00 am to 7:50 am
499 - Cluster, Multi-site and Multi-level Evaluation
TIG Business Meeting and Panel: Building Evaluation
Capacity Among Dissimilar Community Programs:
Lessons From the Community
• Chair - Andrea Hegedus, Centers for Disease Control and
Prevention
• Discussant - James W Altschuld, The Ohio State University
Community Capacity Building: Multi-site Issues and Answers
• Andrea Hegedus, Centers for Disease Control and
Prevention
One Size May Fit All: Lessons Learned From Multi-site
Evaluations
• Molly Engle, Oregon State University
• TIG Leaders - Rene Lavinghouze, Centers for Disease
Control and Prevention; Cynthia Phillips, Phillips Wyatt
Knowlton Inc; Martha Ann Carey, Azusa Pacific University
500 - Educating for Intelligent Belief in Evaluation
Plenary to be held in the
International Ballroom on the Main
• Chair - Leslie Goodyear,
Education Development Center Inc
•
501 - Understanding the Link Between Research and
Practice
503 - Principles of System Change
Think Tank to be held in the International Ballroom Section C
• Discussants - Pennie G Foster-Fishman, Michigan State
University; Branda Nowell, North Carolina State University
• Presenter - Teresa Behrens, W K Kellogg Foundation
504 - Shifting the Bell Curve: The Benefits and Costs
of Raising Student Achievement
Expert Lecture to be held in the Liberty Ballroom, Section A on
• Chair - Brian Yates, American University
• Presenter - Stuart Yeh, University of Minnesota
505 - What Counts as Credible Evidence in
Contemporary Evaluation Practice?
• Discussants - Christina Christie, Claremont Graduate
University; Sandra Mathison, University of British Columbia;
Gary T Henry, University of North Carolina, Chapel Hill;
George Julnes, Utah State University; Debra Rog, Westat;
Leonard Bickman, Vanderbilt University; Michael Scriven,
Western Michigan University; Sharon Rallis, University of
Massachusetts, Amherst; Thomas Schwandt, University of
Illinois at Urbana-Champaign; Jennifer Greene, University of
Illinois at Urbana-Champaign
• Presenter - Stewart I Donaldson, Claremont Graduate
University
506 - Designing Federal Evaluations: Developing
Good Project Objectives and Performance Measures
Demonstration to be held in the Mencken Room on the Main
• Courtney Brown, Mindy Hightower King, and Marcey
Moss, Indiana University
Multipaper to be held in the International Ballroom Section A
• Chair - John Gargani, Gargani & Company Inc
The Golden Spike: Creating the Link Between Research and
Practice
• Jennifer Brown and William Trochim, Cornell University
Implications of Scientific versus Stakeholder Theory in
Formulating Program Theory and Designing Theory-driven
Evaluation
• Huey T Chen, University of Alabama, Birmingham
Evaluation 2007: Friday, November 9, 7:00 to 7:50, 8:00 to 9:05, and 9:25 to 10:10 am
Page 83
Friday, 9:25 am to 10:10 am, Continued
507 - Energy Efficiency, Education, and Intention:
Cradle to Grave
• Chair - Annelise Carleton-Hug, Trillium Associates
Is Our Children Learning? Barriers to K-12 Energy Efficiency
Education in Connecticut
• Timothy Pettit, Nexus Market Research Inc; Charles
Bruckerhoff, Curriculum Research & Evaluation Inc
If You Offer it, Will They Buy it?: Differentiating the Program
From the Market in a Voluntary Clean Energy Purchasing
Program
• Greg Clendenning, Nexus Market Research Inc; Bob Wall,
Connecticut Clean Energy Fund; Timothy Pettit and Lynn
Hoefgen, Nexus Market Research Inc
508 - Evaluation of Community-based Participatory
Research and Community Mobilization Strategies to
Prevent Chronic Disease and Youth Violence:
Advances and Lessons Learned by Two Research
Center Programs at the Centers for Disease Control
and Prevention
the Sheraton
• Chair - Alicia Norris, Centers for Disease Control and
Prevention
Using Document Review and Data Abstraction to Inform
Management of a Federal Research Program: Lessons,
Benefits, and Challenges Found by the Centers for Disease
Control and Prevention's Prevention Research Centers
Program
• Demia S Wright, Centers for Disease Control and
Prevention
An Evaluation of Community Based Participatory Research and
Community Mobilization: Formative Research Results From the
National Academic Centers of Excellence on Youth Violence
Prevention
• Nancy Stroupe, Centers for Disease Control and
Prevention
509 - Successful Strategies for Developing
Evaluation Instruments Using a Web-based System
Demonstration to be held in the Pratt Room, Section A on the
• Jennifer Bentlejewski, University of Maryland Cooperative
Extension
510 - Assessment of Stakeholder Needs and
Evaluation Use in an Organizational Context: The
Real World
Demonstration to be held in the Pratt Room, Section B on the
• Amy Gullickson, Western Michigan University; Judith
Steed and Kelly Hannum, Center for Creative Leadership
511 - Ensuring Fidelity of a Computer Aided Reading
Intervention in a Randomized Controlled Study
• Joyce Serido and Mari Wilhelm, University of Arizona
512 - Moral Knowledge and Responsibilities in
Evaluating Programs for Youth
Expert Lecture to be held in the Hopkins Room on the Lower
• Chair - Melissa Freeman, University of Georgia
• Melissa Freeman, Judith Preissle and Steven Havick,
University of Georgia
514 - Teaching Program Evaluation for Diverse Adult
Learners Using a Nine-step
Demonstration to be held in the Adams Room on the Cabana
• Annalisa Batson and Carla Hess, HB Consultation &
Evaluation Associates LLC
515 - From Insight to Action: New Directions in
Foundation Evaluation
• Rebecca Graves and Leigh Fiske, Foundation Strategy
Group Social Impact Advisors
Evaluation 2007: Friday, November 9, 9:25 am to 10:10 am
Page 84
516 - Recidivism and Re-entry
• Chair - Roger Przybylski, RKC Group
Evaluating a Cross-systems Training Approach to Prepare
Communities to Better Serve the Needs of Justice-involved
Individuals with Co-occurring Disorders
• Chanson Noether and Wendy Vogel, Policy Research
Associates
Explaining Program Outcomes: Analyzing the Joint Effects of
Individual, Program and Neighborhoods With Cross-classified
Hierarchical Generalized Linear Modeling
• Heidi Grunwald, Philip Harris, Jeremy Mennis, Zoran
Obradovic, Alan Izenman, and Brian Lockwood, Temple
University
517 - Multiethnic Issues Dialogue on Graduate
Education and Mentoring
Think Tank to be held in the D'Alesandro Room on the Cabana
• Chairs - Craig Love, Westat; Tamara Bertrand, Florida
State University
• Discussant - Elmima Johnson, National Science
Foundation
• Presenters - Deirdre Sharkey, Texas Southern University;
Maurice Samuels, University of Illinois at Urbana Champaign
518 - Understanding Terminology in Multi-level
Modeling for Program Evaluation
• Caroline Wiley and Mei-kuang Chen, University of Arizona;
Julius Najab, George Mason University
•
519 - Lessons From Evaluation Use at the United
Kingdom National Audit Office and the World Bank
Group
• Chair - Keith MacKay, World Bank
Ensuring Learning in an Accountability Setting: Lessons from
Performance Audit as a Form of Evaluation
• Jeremy Lonsdale, United Kingdom National Audit Office
An Empirical Review of the Utilization of Evaluation Knowledge
at the World Bank
• Klaus Tilmes, World Bank
520 - Emerging Perspectives on Curriculum,
Pedagogy, and Lesbian, Gay, Bisexual, and
Transgender Youth
• Chair - Sheryl Hodge, Kansas State University
Queering Evaluation: Understanding and Sensibility
• Francis Broadway, University of Akron
Self-identified Gay Youth; What is Happening to Them in the
Mathematics Classroom
• David Fischer, University of Minnesota
521 - The AEA Ethics Committee's Comparative
Analysis of International Evaluation Associations'
Ethical Guidelines: Similarities, Differences and
Lessons Learned
Expert Lecture to be held in the Schaefer Room on the Cabana
• Chair - Valerie J Caracelli, United States Government
• Discussant - Jules M Marquart, Centerstone Community
Mental Health Centers Inc
• Presenter - Scott Rosas, Nemours Health and Prevention
Services
522 - Increasing Stakeholders' Understanding of
Evaluation Results: How We Report Matters!
Roundtable to be held in the Calvert Ballroom Salon A on the
• Heidi Sweetman and Ximena Uribe, University of
Delaware
523 - Mentoring and Growing Local Affiliates of the
American Evaluation Association (AEA)
Roundtable to be held in the Calvert Ballroom Salon B on the
• Deborah Loesch-Griffin, University of Nevada, Reno;
Rachel Hickson, Montgomery County Public Schools
524 - Addressing Evaluation Costs: Producing
Rigorous Evaluations on a Shoestring Budget
Roundtable to be held in the Calvert Ballroom Salon D on the
• Dennis W Rudy, Lakehouse Evaluation Inc
Page 85
525 - A Dialogue About Building the Cross-cultural
Competency of Evaluators
Roundtable to be held in the Calvert Ballroom Salon E on the
• Kien Lee, Association for the Study and Development of
Community; Nancy Csuti, The Colorado Trust; Lutheria
Peters, Association for the Study and Development of
Community
526 - Teacher Evaluation
in the Radisson
• Chair - Darlene Thurston, Jackson State University
Defining, Assessing, and Developing Teacher Expertise: Using
Evidence to Both Assess and Assist Teachers
• Richard West, Bruce Gabbitas, Arthur Recesso, and
Michael Hannafin, University of Georgia
Evaluating With Lenses to Capture the Multi-faceted Nature of
Teacher Performance
• Bruce Gabbitas, Richard West, Arthur Recesso, and
Michael Hannafin, University of Georgia
527 - Global Activities of United States Based Social
Work Faculty: Missed Opportunities for Research and
Evaluation
Roundtable to be held in the Federal Hill Suite on the 19th
• Goutham Menon, University of Texas, San Antonio
528 - Promising Approaches to the Evaluation of
Social Policy
• Chair - Roger Boothroyd, University of South Florida
• Discussant - Margaret Polinsky, Parents Anonymous Inc
Archival Research and Evaluation: Utilization of Federal and
State Court Data in Evaluating Welfare Policies and Programs
• Elizabeth Hayden, Northeastern University
Learning From Service Users: Measuring the Well-being of
Children and Families, the Elderly, and the Community
• Tina Olsson, Rebecka Arman, and Anna Johansson,
Göteborg University
529 - Real-life Lessons Learned in Building Capacity
for Advocacy and Policy Evaluation
• Chair - Jane Reisman, Organizational Research Services
Evaluating Policy Advocacy Grant making: One Foundation's
Call to Action
• Thomas Kelly, Annie E Casey Foundation
What Do Advocacy and Policy Organizations Need in Order to
Successfully Carry Out Evaluation?
• Cory Anderson and Don Crary, Annie E Casey Foundation
How to Guide Advocacy and Policy Evaluation Organizations in
Successful Evaluations: Lessons Learned From KIDS COUNT
Grantees
• Jane Reisman and Anne Gienapp, Organizational
Research Services; Corey Newhouse, Children Now; Julie
Sharpe, Family Connection Partnership
530 - Who Needs a College Goal Sunday? Using
Evaluation to Expand and Improve a Large-scale
Financial Aid Awareness Program
Panel to be held in the Hanover Suite B on the Mezzanine Level
in the Radisson
• Chair - Wendy Erisman, Institute for Higher Education
Policy
The Challenges of Evaluating an Annual One-day Multi-site
Financial Aid Awareness Event
• Wendy Erisman, Institute for Higher Education Policy
College Access Marketing: Putting Evaluation Data Into Action
• Marcia Weston, National Association of Student Financial
Aid Adminstrators
531 - The Next Generation of Learning Measurement:
Measuring and Communicating the Value of the
Learning Function
Expert Lecture to be held in the
Baltimore Theater on the Mezzanine
• Daniel Blair, American Society for Training &
Development
Page 86
532 - Challenges and Prospects in the Evaluation of
Housing Programs
Multipaper to be held in the International Room across from
• Chair - Paul Longo, Touro Infirmary
• Discussant - Paul Longo, Touro Infirmary
Housing Stability Among Homeless Individuals With Serious
Mental Illness Participating in Housing First Programs
• Carol Pearson, Walter R McDonald & Associates Inc; Ann
Elizabeth Montgomery, University of Alabama, Birmingham
Using a Panel Study of Residents Relocated From Low-Income
Housing to Generate Actionable Information for Evaluation
Stakeholders
• Laurie Dopkins, George Mason University
533 - Engaging Stakeholders in the Evaluation
Process
• Chair - Tessie Catsambas, EnCompass LLC
Building on the Best: Using Appreciative Inquiry to Evaluate
Worker-Trainer Led Health and Safety Training Programs
• Katherine King, Judith Daltuva, and Thomas Robins,
University of Michigan
Evaluators Train Stakeholders to Understand Data Collection
Strategies and to Use Data Base Management Systems: What
Are the Lessons to be Learned?
• Janice Fournillier and Sheryl Gowen, Georgia State
University
534 - Fulfilling the Promise: An Alternative to the
Traditional Literature Review
Demonstration to be held in the Versailles Room on the Lobby
• Brian Marriott and Christopher Cameron, Calgary Health
Region
Notes:
Page 87
Summary of Sessions for Friday, November 9, 10:20 AM to 11:05 AM
No Primary Sponsor
Session
Session Title
Room Name
Demonstration
The Power of Self in Systems: Organizational Learning From Self-Determination Theory-driven Evaluations
Multipaper
Applications of Systems Thinking to Educational Evaluation
Demonstration
How to Write an Evaluation Plan: A Step-by-Step Guide for New Evaluators
540 Costs, Effectiveness, Benefits, and EconTIG
Expert Lecture
Costs Are All That Matters (With Studies That Prove It): About and Beyond Cost-inclusive Evaluation
Liberty Ballroom Section
Multipaper
Empirical Research on Evaluation: Evidence-based Contributions to Evaluation Theory
Liberty Ballroom Section
543 Disaster and Emergency Management Eval TIG MultiPaper
Emergency Preparedness Standards of Acceptability for Evaluation
Strategic Evaluation in a Public Research Institute to Contribute to Innovation
Carroll Room
Demonstration
Introducing SAMMIE - Successful Assessment Methods and Measurement In Eval: A Web-based, Self-paced…
Panel
Intelligence Analysis: Maximizing Learning and Decision Making From Evaluations in Public and Private Sector…
Roundtable
No Child Left Behind Act, Logic Models and Instructional Systems Design Models: Action Research in ESL…
Douglass Boardroom
548 Social Work TIG
Expert Lecture
A Collaborative Practice-based Approach to Evaluation Research
Hopkins Room
549 International and Cross-cultural Evaluation TIG Expert Lecture
Applicability and Eval of Model of Global Baseline Survey Adapted for Use in Bangladesh, Bolivia and Tanzania
Peale Room
Multipaper
Assessing Advocacy: Building Evaluation Frameworks and Models That Work
Adams Room
Roundtable
Evaluation for Public Contracts
Jefferson Room
Multipaper
Studies Dealing With Needs Assessment and Program Development: Focus on Domestic Violence Victims…
Washington Room
Expert Lecture
Using Democratic Eval Principles to Foster Citizen Engagement and Strengthen Neighborhoods in a Place-based…
D'Alesandro Room
Demonstration
A Method to Measure and Numerically Demonstrate the Effectiveness of a University's Planning and Eval Processes Calhoun Room
Demonstration
Making Data Accessible to Organizations, Communities, and the Public: Designing an Interactive Graphing Website McKeldon Room
Think Tank
Straight Talk: Threats to Validity Caused by Heteronormative Bias in Opinion Polls
Preston Room
Think Tank
The Role of the Leadership Recruitment Task Force to Foster Organizational Learning Within AEA
Schaefer Room
Expert Lecture
Measuring Follow-up Support: How Critical Are Those Field Consultants?
Fairmount Suite
Roundtable
Evaluation and Learning: Accomplishing Both Through the Conduct of a Needs Assessment
Federal Hill Suite
Multipaper
Demonstration
Assessing Appropriate Outcomes: Measurement Issues in Human Services Evaluation
Smashing the Mental Health Atom: A Conceptual Framework to Properly Evaluate System, Service, and Clinical…
Royal Board Room
Multipaper
College Success Programs: Evaluating Undergraduate and Graduate Interventions
Hanover Suite B
563 Presidential Strand/Environmental Program TIG MultiPaper
Building Capacity for Planning, Monitoring, Evaluating, and Learning among Conservation Leaders
Baltimore Theater
Multipaper
Innovative Techniques to Assess Learning in Child Welfare Workers' Training
International Room
Demonstration
Using NVIVO 7 in Conducting Evaluation Research
Chesapeake Room
Panel
Performance Measurement and Evaluation: A Distinction With a Difference
Versailles Room
Evaluation 2007: Friday, November 9, 10:20 am to 11:05 am, Timeslot Overview
Page 88
535 - The Power of Self in Systems: Organizational
Learning From Self-Determination Theory-driven
Evaluations
Demonstration to be held in the International Ballroom on the
• Deborah Wasserman, The Ohio State University
537 - Applications of Systems Thinking to
Educational Evaluation
Multipaper to be held in the International Ballroom on the
• Chair - Janice Noga, Pathfinder Evaluation and Consulting
Schooling as a Complex System: Appropriate Frameworks for
• Tamara Walser, University of North Carolina, Wilmington
What Else is Happening With Squishy and Marvin: Combining
Program Logic, Appreciative Inquiry, and Complex Adaptive
Systems Frameworks in Evaluating a K-12 Science Education
Project
• Lois-ellin Datta, Datta Analysis
539 - How to Write an Evaluation Plan: A Step-byStep Guide for New Evaluators
Demonstration to be held in the International Ballroom on the
• Kai Young, Centers for Disease Control and Prevention
540 - Costs Are All That Matters (With Studies That
Prove It): About and Beyond Cost-inclusive
Evaluation
Expert Lecture to be held in the Liberty Ballroom, Section A on
• Brian Yates, American University
541 - Empirical Research on Evaluation: Evidencebased Contributions to Evaluation Theory
Multipaper to be held in the Liberty Ballroom, Section B on the
• Chair - Janice Fournillier, Georgia State University
Evaluator Contextual Responsiveness: A Simulation Study
• Tarek Azzam, University of California, Los Angeles
What's Hot and What's Not? Sifting Through Six Years and
Three Journals Worth of Evaluation Theory and Research
• Bernadette Campbell and Deborah Reid, Carleton
University
543 - Emergency Preparedness Standards of
Acceptability for Evaluation
MultiPaper to be held in the Edgar Allen Poe Room on the Main
• Chair and Discussant - Ralph Renger, University of
Arizona
The Importance of Using Emergency Preparedness Standards
of Acceptability for Evaluation
• Adriana Cimetta, Anneke Jansen, Erin Peacock, and Kim
Fielding, University of Arizona
The Benefits of Understanding the Relationships Between
Emergency Preparedness Standards of Acceptability From an
Evaluation Standpoint
• Anneke Jansen, Adriana Cimetta, Erin Peacock and Kim
Fielding, University of Arizona
544 - Strategic Evaluation in a Public Research
Institute to Contribute to Innovation
MultiPaper to be held in the Carroll Room on the Main Lobby
• Chair - Osamu Nakamura, National Institute of Advanced
Industrial Science and Technology
• Discussant - Naoto Kobayashi, National Institute of
Advanced Industrial Science and Technology
Strategic Evaluation of Research Units Towards Innovation in a
Public Research Institute
• Osamu Nakamura, Shin Kosaka, Michiko Takagi Sawada,
Isao Matsunaga, Masao Koyanagi, Koichi Mizuno, and Naoto
Kobayashi, National Institute of Advanced Industrial Science
and Technology
Evaluation System with PDCA Cycle in the Management of
National Institute of Advanced Technology
• Tomoko Mano, Sunao Kunimatsu, Osamu Nakamura,
Yoshikazu Arai, Hiroshi Sato, Shinichi Kikuchi, Suzuko
Nakatsu, and Naoto Kobayashi, National Institute of
Advanced Industrial Science and Technology
545 - Introducing SAMMIE - Successful Assessment
Methods and Measurement In Evaluation: A Webbased, Self-paced, Evaluation Skill Development
Course
• Karen Bruns, Debby Lewis, and Thomas Archer, The Ohio
State University
Page 89
546 - Intelligence Analysis: Maximizing Learning and
Decision Making From Evaluations in Public and
Private Sector Settings
• Chair - Darryl Lawton, McManis and Monsalve Asociates
Applying Intelligence Analysis to Private Sector Evaluations
• Nancy Potok, Mcmanis and Monsalve Associates
Intelligence Analysis Techniques and Applications in an
Evaluation Environment
• Robert Heibel, Mercyhurst College
547 - No Child Left Behind Act, Logic Models and
Instructional Systems Design Models: Action
Research in English as a Second Language (ESL) and
Music Classrooms: Case Studies in the Making
• Tamara J Barbosa, PhD's Consulting; Rodnie Barbosa,
District of Columbia Public Schools; Mary Jo DePaola,
Orange County Public Schools
548 - A Collaborative Practice-based Approach to
Evaluation Research
Expert Lecture to be held in the Hopkins Room on the Lower
• Carrie Petrucci, EMT Associates Inc
549 - Applicability and Evaluation of Model of Global
Baseline Survey Adapted for Use in Bangladesh,
Bolivia and Tanzania
Expert Lecture to be held in the Peale Room on the Lower Level
• Chair - Paul L Johnson, National Institutes of Health
• Nalin Johri, Hannah Searing, Inés Escandon, Erin Mielke,
Rosemary Duran, Javier Monterrey, Mahboob Alam, and
Grace Lusiola, EngenderHealth
550 - Assessing Advocacy: Building Evaluation
Frameworks and Models That Work
• Chair - Laura Roper, Brandeis University
Learning From Campaigning and Advocacy: There's Method in
the Madness
• Laura Roper, Brandeis University
Developing a 'Community of Practice' in Advocacy Evaluation
• Kristin Kaylor Richardson, Western Michigan University
551 - Evaluation for Public Contracts
• Arlene Hopkins, Los Angeles Unified School District
552 - Studies Dealing With Needs Assessment and
Program Development: Focus on Domestic Violence
Victims and Children of the Incarcerated
• Chair - Roger Przybylski, RKC Group
Program Theory, Development, and External Influences:
Assessing a New Permanent Housing Program for Domestic
Violence Victims
• Hilary Botein and Andrea Hetling, University of
Connecticut
Lessons Learned and Strategies That Worked From a Study on
a Unique and Sensitive Population: Study of Children of
Incarcerated Persons
• Mariah Storey, Mark McNulty, and Trisha Worley,
University of Wyoming
553 - Using Democratic Evaluation Principles to
Foster Citizen Engagement and Strengthen
Neighborhoods in a Place-based Poverty Program
Expert Lecture to be held in the D'Alesandro Room on the
• Chair - Melanie Moore Kubo, See Change Evaluation
• Presenter - Arnold Love, Independent Consultant
Page 90
554 - A Method to Measure and Numerically
Demonstrate the Effectiveness of a University's
Planning and Evaluation Processes
• Kim Bender, Colorado State University
555 - Making Data Accessible to Organizations,
Communities, and the General Public:
Designing an Interactive Graphing Website
Demonstration to be held in the McKeldon Room on the
• Shannon Williams, Eric Canen, and Laura Feldman,
University of Wyoming
556 - Straight Talk: Threats to Validity Caused by
Heteronormative Bias in Opinion Polls
• Che Tabisola, Human Rights Campaign
557 - The Role of the Leadership Recruitment Task
Force to Foster Organizational Learning Within the
American Evaluation Association
Think Tank to be held in the Schaefer Room on the Cabana
• Discussants - Rachel Hickson, Montgomery County Public
Schools; Nicole Bowman, Bowman Performance Consulting
LLC; Henry Frierson Jr, University of North Carolina, Chapel
Hill
• Presenter - Stanley Capela, HeartShare Human Services
558 - Measuring Follow-up Support: How Critical Are
Those Field Consultants?
Expert Lecture to be held in the Fairmount Suite on the 19th
• Tom McKlin and Becky Cocos, Georgia Institute of
Technology
559 - Evaluation and Learning: Accomplishing Both
Through the Conduct of a Needs Assessment
• Katye Perry, Mwarumba Mwavita, Chin-Huey Lee, Tammi
Mitchell, Donell Barnett, Oklahoma State University
560 - Assessing Appropriate Outcomes:
Measurement Issues in Human Services Evaluation
• Chair - Tracy Greever-Rice, University of Missouri,
Columbia
• Discussant - William Cabin, Youth Consultation Service
Evaluating Individually-tailored Services: A Proposed Strategy
• Roger Boothroyd and Steven Banks, University of South
Florida
Evaluating Programs to Reduce Child Abuse and
Maltreatment: The Abilene Replication of the Family
Connections Program
• Darryl Jinkerson, Abilene Christian University; David Cory,
New Horizons Family Connections
561 - Smashing the Mental Health Atom: A
Conceptual Framework to Properly Evaluate
System, Service, and Clinical Practice
Demonstration to be held in the Royal Conference Foyer on the
• Christopher Cameron and Brian Marriott, Calgary Health
Region
562 - College Success Programs: Evaluating
Undergraduate and Graduate Interventions
• Chair - Kurt Burkum, National Council for Community and
Education Partnerships
Lessons Learned in our own Backyard: Evaluation in a
University Setting
• Cidhinnia M Torres Campos, Crafton Hills College; Beatriz
Ornelas, California State University, Los Angeles
Combating the Decline: A Report on Attraction, Retention and
Learning Evaluation Data From Higher Education Computing
Science Classrooms Using Emerging Technologies
• Jamie Cromack, Microsoft Research, External Research
and Programs
Page 91
563 - Building Capacity for Planning, Monitoring,
Evaluating, and Learning Among Conservation
Leaders
MultiPaper to be held in the
Sponsor: Presidential Strand and
the Environmental Program Evaluation TIG
• Chair - Vinaya Swaminathan, Foundations of Success
Developing Monitoring, Evaluation, and Programmatic
Learning Skills in Conservation Project Managers: How the
Worldwide Fund for Nature (WWF) is Institutionalizing Adaptive
Management
• Caroline Stem, Marcia Brown, Guillermo Placci, Richard
Margoluis, Caroline Stem, Nick Salafsky, and Vinaya
Swaminathan, Foundations of Success
Adaptive Management Training at the University of Maryland:
Teaching Planning, Monitoring, and Evaluation Skills to
Tomorrow's Leaders in Conservation
• Vinaya Swaminathan, Foundations of Success; Fabiano
Godoy, Bushmeat Crisis Taskforce; Sara Zeigler, University of
Maryland; Marcia Brown, Nick Salafsky, Richard Margoluis,
Guillermo Placci, and Caroline Stem, Foundations of
Success
566 - Performance Measurement and Evaluation: A
Distinction With a Difference
the Radisson
Prevention
• Discussant - Michael Schooley, Centers for Disease
Thinking in an Integrated Way About Performance
Measurement and Evaluation
• Thomas Chapel, Centers for Disease Control and
Prevention
Federal-level Performance Measurement: Challenges in Public
Health
• Amy DeGroff, Michael Schooley, Goldie MacDonald, and
Thomas Chapel, Centers for Disease Control and Prevention
Notes:
564 - Innovative Techniques to Assess Learning in
Child Welfare Workers' Training
• Chair - Elizabeth Hayden, Northeastern University
• Discussant - Henry Ilian, New York City Administration for
Children's Services
Using Knowledge Assessments to Promote Learning and
Assess Child Welfare Workers' Competencies+
• Jennifer Hicks and Chris Hadjiharalambous, University of
Tennessee, Knoxville
Using Competency Assessments in Evaluating Pre-service
Training for Child Welfare Workers
• Gail Myers, Charlotte Sorensen, and Chris
Hadjiharalambous, University of Tennessee, Knoxville
565 - Using NVIVO 7 in Conducting Evaluation
Research
• Shelly Mahon, University of Wisconsin, Madison
Page 92
Summary of Sessions for Friday, November 9, 11:15 AM to 12:00 PM
No Primary Sponsor
Session
567 Research on Evaluation TIG
Business Meeting Research on Evaluation TIG Business Meeting
Session Title
Room Name
Expert Lecture
Yes, When Will We Ever Learn? How Evaluators Can Learn Better Ways to Understand Cause and Effect
Think Tank
Exploring the Sacrifice Fly Phenomenon in Evaluation Use
Multipaper
Lessons Learned From Evaluation Practice
Multipaper
Measuring Effectiveness, Efficiency, and Sustainability in Innovative Health Programs Reaching the Underserved
Panel
Learning (More) About Evaluation: Unfinished Business
Panel
Strategies for Building and Evaluating Organizational Capacity: A Case Study of 30 Children's Residential Homes… Mencken Room
575 Disaster and Emergency Management Eval TIG Demonstration
The South Central Center for Public Health Preparedness Training Evaluation Process: A Comprehensive Approach… Edgar Allen Poe Room
Think Tank
Arkansas Eval Center and Empowerment Eval: … We Think About How to Build Eval Capacity…
Carroll Room
Demonstration
Using Images as Catalysts for Expression in Evaluation: A Demonstration of Photolanguage
Business Meeting Business and Industry TIG Business Meeting
Roundtable
Evaluating Collaboration Between STEM Programs in the National Girls Collaborative Project
Douglass Boardroom
MultiPaper
Building Evaluation Capacity at the Society for Advancement of Chicanos and Native Americans in Science
Hopkins Room
Expert Lecture
M&E in Sector-wide Approach (SWAps): A New Way of Thinking of M&E in the New Int’l Development Framework
Peale Room
Demonstration
Real Application of a Policy Advocacy Evaluation Tool
Adams Room
Roundtable
Challenges Faced by an External Evaluator in Evaluating a Multi-site Program: Lessons Learned
Jefferson Room
Think Tank
Conducting a Process Evaluation of a Prisoner Reentry Initiative
Washington Room
Demonstration
Implementing Process Evaluation in a Dispersed State Program
D'Alesandro Room
Demonstration
Using Multilevel Discrete-time Survival Models to Predict Whether and When Events Occur
Calhoun Room
Expert Lecture
Using Technology to Enhance Aboriginal Evaluations
McKeldon Room
588 LGBT Issues TIG/PreK-12 Education TIG
Multipaper
Programs for Lesbian, Gay, Bisexual, and Transgender Students: Interventions for Diverse Populations
Preston Room
589 Org Learning TIG/Assessment in Higher Ed TIG Expert Lecture
Organizational Learning in the Context of Higher Education Institutions
Schaefer Room
Multipaper
Issues in Early Childhood and Preschool Evaluation
Fairmount Suite
Roundtable
Measuring Success in Professional Exchange: International Visitor Leadership Program
Federal Hill Suite
592 Research Technology & Development Eval TIG
Multipaper
Peer Review and Learning: New Uses
Royal Board Room
Panel
Think Tank
Challenges Associated With the Implementation and Use of a Statewide Substance Abuse and Mental Health…
Building a World-wide Context for Evaluation: A Discussion With AEA’s International Committee
Hanover Suite B
595 Presidential Strand/College Access TIG
Panel
Beyond the Report: Using Evaluations to Create a College-going Culture
Baltimore Theater
Demonstration
Improving Payment Accuracy in the Child Care Program: Error Rate Measurement in the CCDF
International Room
Multipaper
Quality Indicators in Health Care: From Training to Accreditation
Chesapeake Room
Panel
Learning From Leaders: Evaluating Popular Culture Artifacts as a Development Tool
Versailles Room
Evaluation 2007: Friday, November 9, 11:15 am to 12:00 pm, Timeslot Overview
Page 93
Friday, 11:15 am to 12:00 pm
567 - Research on Evaluation TIG Business Meeting
Section A on the Main Lobby Level in the Sheraton
Sponsor: Research on Evaluation TIG
• TIG Leaders - Tarek Azzam, University of California, Los
Angeles; Christina Christie, Claremont Graduate University
569 - Yes, When Will We Ever Learn? How Evaluators
Can Learn Better Ways to Understand Cause and
Effect
Expert Lecture to be held in the International Ballroom Section
• Chair - Bob Williams, Independent Consultant
• Discussant - Bob Williams, Independent Consultant
• Presenter - Patricia Rogers, Royal Melbourne Institute of
Technology
570 - Exploring the Sacrifice Fly Phenomenon in
Evaluation Use
Think Tank to be held in the International Ballroom Section D
• Discussant - Joe Heimlich, The Ohio State University
Beverly Sheppard, The Institute for Learning Innovation
Julia Washburn, National Park Service
• Emmalou Norland, Institute for Learning Innovation
571 - Lessons Learned From Evaluation Practice
Multipaper to be held in the International Ballroom Section E
• Chair - Gary Miron, Western Michigan University
Evaluation to Go: Problems and Solutions of Consulting With
Time Constraints
• Steven Middleton, Joel Nadler, and Nicole Cundiff,
Southern Illinois University, Carbondale
Evaluation for Educational Accountability: Local Impact of No
Child Left Behind
• Linda Mabry, Washington State University, Vancouver
572 - Measuring Effectiveness, Efficiency, and
Sustainability in Innovative Health Programs
Reaching the Underserved
• Chair - Samuel Bickel, United Nations Children's Fund
572 – Continued
Cost and Effectiveness of Health Delivery in Underserved
Communities: The Evaluation of Education, Community Health
Outreach (ECHO-2) in North Carolina
• Anne D'Agostino, Sarah Heinemeier, and Amy Germuth,
Compass Consulting Group
Measuring Program Support Using the Quantification of
Leveraged Resources
• Antoinette Brown, Independent Consultant
573 - Learning (More) About Evaluation: Unfinished
Business
• Chair - Thomas Schwandt, University of Illinois at UrbanaChampaign
Tools to Evaluate Evaluands?
• Peter Dahler-Larsen, University of Southern Denmark
Practices That Evaluate Practices
574 - Strategies for Building and Evaluating
Organizational Capacity: A Case Study of 30
Children's Residential Homes Utilizing Strategies to
Address Childhood Obesity
• Chair - Toni Freeman, The Duke Endowment
• Discussant - Toni Freeman, The Duke Endowment
An Implementation and Evaluation Planning Process for
Structural Interventions
• Ruth Saunders, University of South Carolina
Environmental Intervention in Children's Homes (ENRICH)
Process Evaluation: Implementation Monitoring Results
• Kelli Kenison, University of South Carolina
575 - The South Central Center for Public Health
Preparedness Training Evaluation Process: A
Comprehensive Approach to Evaluating the
Effectiveness of Emergency Preparedness and
Response Training
Demonstration to be held in the Edgar Allen Poe Room on the
• Sue Ann Sarpy and Laurita Santacaterina, Tulane
University
Evaluation 2007: Friday, November 9, 11:15 am to 12:00 pm
Page 94
Friday, 11:15 am to 12:00 pm, Continued
576 - Arkansas Evaluation Center and Empowerment
Evaluation: We Invite Your Participation as We Think
About How to Build Evaluation Capacity and
Facilitate Organizational Learning in Arkansas
Think Tank to be held in the Carroll Room on the Main Lobby
Evaluation TIG
• Discussant - Linda Delaney, University of Arkansas
• David Fetterman, Stanford University
577 - Using Images as Catalysts for Expression in
Evaluation: A Demonstration of Photolanguage
• Rebecca White, Diane Sasser, Katherine Pace, and Emily
Braud, Louisiana State University
578 - Business and Industry TIG Business Meeting
• TIG Leaders - Amy Gullickson, Western Michigan
University; Sheri Hudachek, Western Michigan University;
Eric Graig, Usable Knowledge LLL; Otto Gustafson, Western
Michigan University
579 - Evaluating Collaboration Between Science,
Technology, Engineering and Mathematics Programs
in the National Girls Collaborative Project
• Brenda Britsch, Karen Peterson, Carrie Liston, and Vicky
Ragan, Puget Sound Center for Teaching, Learning and
Technology
580 - Building Evaluation Capacity at the Society for
Advancement of Chicanos and Native Americans in
Science (SACNAS)
MultiPaper to be held in the Hopkins Room on the Lower Level
• Chair - Jack Mills, Independent Consultant
Preparing the Way for Evaluation: The Experience of the Society
for Advancement of Chicanos and Native Americans in Science
(SACNAS)
• Marigold Linton, University of Kansas; Jack Mills,
580 – Continued
A Theory-based Approach to Measuring Minority Career
Advancement in the Sciences: A Case Study of the Society for
Advancement of Chicanos and Native Americans in Science
(SACNAS)
• Jack Mills, Independent Consultant; Marigold Linton,
University of Kansas
581 - Monitoring and Evaluating (M&E) in Sectorwide Approach (SWAps): A New Way of Thinking of
Monitoring and Evaluation in the New International
Development Framework
• Chair - Nino Saakashvili, Horizonti Foundation
• Presenter - Ryoh Sasaki, Western Michigan University
582 - Real Application of a Policy Advocacy
Evaluation Tool
• Rhonda Ortiz, The California Endowment; Sue
Hoechstetter, Alliance for Justice; Traci Endo Inouye, Social
Policy Research Associates; Catherine Crystal Foster and
Justin Louie, Blueprint Research & Design Inc
583 - Challenges Faced by an External Evaluator in
Evaluating a Multi-site Program: Lessons Learned
• Mary Poulin, Justice Research and Statistics Association
584 - Conducting a Process Evaluation of a Prisoner
Reentry Initiative
Think Tank to be held in the Washington Room on the Cabana
• Discussant - William Davidson, Michigan State University
• Presenter - Aisha Nyandoro, Michigan State University
585 - Implementing Process Evaluation in a
Dispersed State Program
• Richard Bowman and Michele Walsh, University of
Arizona
Page 95
586 - Using Multilevel Discrete-time Survival Models
to Predict Whether and When Events Occur
• Steven Pierce, Michigan State University
587 - Using Technology to Enhance Aboriginal
Evaluations
Expert Lecture to be held in the McKeldon Room on the
• Chair - Joan LaFrance, Mekinak Consulting
• Discussant - Katherine Tibbetts, Kamehameha Schools
• Presenter - Andrea L K Johnston, Johnston Research Inc
588 - Programs for Lesbian, Gay, Bisexual, and
Transgender Students: Interventions for Diverse
Populations
Sponsor: Lesbian, Gay, Bisexual, Transgender Issues TIG and
the Pre-K - 12 Educational Evaluation TIG
• Chair - Sylvia Fisher, United States Department of Health
and Human Services
Making Schools Safe for All Students: Assessing the Utility of
Supportive School Resources for Lesbian, Gay, Bisexual and
Transgender Students of Color
• Elizabeth Diaz and Joseph Kosciw, Gay, Lesbian and
Straight Education Network; Riley Snorton, University of
Pennsylvania
Jump-starting Student Leaders for Creating Safer Schools: An
Evaluation of a Student Leadership Program for Addressing
Lesbian, Gay Bisexual and Transgender Issues in Secondary
Education
• Joseph Kosciw and Elizabeth Diaz, Gay, Lesbian and
Straight Education Network
590 - Issues in Early Childhood and Preschool
Evaluation
in the Radisson
• Chair - Michael P Mueller, The Hospital for Sick Children
School and Community-based Early Education Programming:
Implications for Evaluation
• Kelly Hallberg, Learning Point Associates
The Michigan School Readiness Program Longitudinal
Evaluation: Hierarchical Models for Multi-nomial and Binary
Outcomes
• Elena Malofeeva and Marijata Daniel-Echols,
High/Scope Educational Research Foundation
591 - Measuring Success in Professional Exchange:
International Visitor Leadership Program
• Liudmila Mikhailova, Delphi International of World
Learning
592 - Peer Review and Learning: New Uses
• Chair - David Roessner, SRI International
Peer Review of Transformative Research: Strategies and
Challenges in Identifying Innovation in Ex Ante Evaluation
• Elmer Yglesias, Science and Technology Policy Institute;
David Kaplan, Case Western Reserve University
Peer Reviews or Peers Reviewing? Peer Review as Policy
Learning in Innovation, Research and Education
• Erik Arnold and Isabelle Collinns, Technopolis
589 - Organizational Learning in the Context of
Higher Education Institutions
Building TIG and the Assessment in Higher Education TIG
• Chair - Denise Seigart, Mansfield University
• Discussant - William Rickards, Alverno College
• Presenter - Susan Boser, Indiana University Pennsylvania
Page 96
593 - Challenges Associated With the
Implementation and Use of a Statewide Substance
Abuse and Mental Health Outcome and Program
Performance System
• Chair - Robert Hubbard, National Development and
Research Institutes Inc
The Multi-leveled Tensions Impacting the Implementation and
Use of the North Carolina Treatment Outcomes and Program
Performance System (NC-TOPPS)
• Margaret Cawley and Gail Craddock, National
Development and Research Institutes Inc
The Factors That Facilitate and Impede the Use of the NCTOPPS by Multiple Stakeholders
• Robert Hubbard and Deena Murphy, National
Development and Research Institutes Inc
594 - Building a World-wide Context for Evaluation: A
Discussion With the American Evaluation
Association's International Committee
• Chair - Donna Podems, Macro International Inc
• Discussants - Ross Conner, University of California, Irvine;
Alexey Kuzmin, Process Consulting Company; Thomas E
Grayson, University of Illinois at Urbana-Champaign; Gail
Barrington, Barrington Research Group Inc
595 - Beyond the Report: Using Evaluations to
Create a College-going Culture
Panel to be held in the Baltimore
Theater on the Mezzanine Level in the
Radisson
College Access Programs TIG
• Chair - Janet Usinger, University of Nevada, Reno
Using a Logic Model for Program Development, Evaluation and
• Mari Wilhelm and Margaret R Stone, University of Arizona
Using a Longitudinal Case Study Design for Evaluation and
• Janet Usinger, Bill Thornton, and Edith Rusch, University
of Nevada, Reno
596 - Improving Payment Accuracy in the Child Care
Program: Error Rate Measurement in the Child Care
and Development Fund (CCDF)
• Carol Pearson and Harry Day, Walter R McDonald &
Associates Inc
597 - Quality Indicators in Health Care: From Training
to Accreditation
• Chair - Molly Engle, Oregon State University
Anglo-Saxon Conceptualizations of Performance in
Accreditation
• Pernelle Smits, François Champagne, Damien
Contandriopoulos, Claude Sicotte, and Johanne Préval,
University of Montreal
Developing Quality Leaders in Healthcare: Evaluating the
Impact of a Multi-faceted Learning Intervention
• Daniel McLinden and Gerry Kaminski, Cincinnati
Children's Hospital Medical Center
598 - Learning From Leaders: Evaluating Popular
Culture Artifacts as a Development Tool
the Radisson
• Chair - Jamie Callahan, Texas A&M University
• Discussant - Kelly Hannum, Center for Creative
Leadership
Leadership, Learning, and Evaluation
• Jamie Callahan, Texas A&M University
Popular Culture as a Means to Enhance Learning
• Manda Rosser, Texas A&M University
Friday, 12:10 pm to 1:45 pm
599 – American Evaluation Association Awards
Luncheon
Luncheon to be held in the Calvert Ballroom on the Ballroom
This is a ticketed event. A limited number of tickets may be
available for purchase at the registration desk.
•
Hosts– Nicole Vicinanza, Conference Chair; Jennifer
Martineau, Awards Committee Chair; Hallie Preskill, AEA
President
Evaluation 2007: Friday, November 9, 11:15 am to 12:00 pm and 12:10 pm to 1:45 pm
Page 97
Summary of Sessions for Friday, November 9, 1:55 PM to 3:25 PM
No Primary Sponsor
Session
Session Title
Room Name
MultiPaper
Eyes Wide Open: Learning to Spot Ethical Quandaries in Evaluation Practice
Panel
The Proposed Program Evaluation Standards, Third Edition 2nd Revision: A National Hearing
Demonstration
How to Publish an Article in the American Journal of Evaluation: Guidance for First-time Authors
Multipaper
Studying Process Use on a Large Scale
Business Meeting TIG Business Meeeting and Presentation: Learning for High Quality Evaluation Practice: Training Options…
Multipaper
The Use of Theoretical Models and Perspectives to Inform Evaluations
606 Org Learning/International/Multiethnic TIGs
Multipaper
Evaluation Capacity Development: A Systems Perspective in an International Context
Multipaper
Methods in Evaluation
Mencken Room
608 Disaster and Emergency Management Eval TIG Panel
Evaluating School District Emergency Management Plans Using GPRA Performance Measures and Indicators
Panel
Getting To Outcomes at the Federal, State, County, and Local Levels: Session I
Carroll Room
Panel
When Funders, Evaluators and Service Providers Work Together a Good Idea Gets Better
Panel
Engaging Communities in Sustainable Systemic Change: A Five Year Analysis of the W K Kellogg's Leadership…
Roundtable
Rotation I: Evaluation of an HIV Awareness and Sexual Decision-making Peer Education Progra…
Rotation II: At the Starting Gate: Planning the Eval of an Initiative to Enhance Student Engagement…
Douglass Boardroom
Panel
Culturally Responsive Evaluation Training for Students of Color: From Classroom to Fieldwork and Back
Hopkins Room
MultiPaper
Evaluation of Educational Outcomes: Experience of Jordan
Peale Room
Demonstration
Advocacy Evaluation: Practical Research Findings
Adams Room
Roundtable
Rotation I: Evaluation in Higher Learning Curriculum Development
Rotation II: Enhancing a Masters in Evaluation Curriculum by Learning From Consumers of Evaluation
Jefferson Room
Demonstration
Lessons From the Field in Building Eval Capacity of Restoration Activities: A Field Trip of the Herring Run Watershed… Washington Room
Panel
Variance Explained and Explaining Variance: An Overview of Variance in General, in the General Linear Model…
D'Alesandro Room
Skill-building
Treating Data According to Purpose: Frequentist Versus Bayesian Analyses
Calhoun Room
Panel
Partnering With and Learning From Indigenous Peoples
McKeldon Room
621 Lesbian, Gay, Bisexual, Transgender Issues TIG Multipaper
Educating Educators to Support LGBT Students: Documenting Needs, Exploring Strategies
Preston Room
622 Org Learning TIG/Multethnic Issues TIG
Multipaper
Think Tank
Advancing Organizational Learning Through the Study and Development of Diversity
How Should We Measure Child Outcomes in Early Childhood Evaluations and Accountability Efforts?
Schaefer Room
Fairmount Suite
Roundtable
Rotation I: Facilitating Collaborative Evaluation Projects for Building and Sustaining Evaluation Capacity…
Rotation II: Building Evaluation Capacity in a State Maternal and Child Health Agency
Federal Hill Suite
Multipaper
Evaluation in Non-traditional and Informal Learning Contexts
Royal Board Room
Panel
Evaluating Arizona's School-based Tobacco Prevention Program: Lessons Learned in Outcome Evaluation
Multipaper
Evaluating Graduate Education in Health and Medicine
Hanover Suite B
MultiPaper
Indigenous Knowledge Creation and Evaluation Practice
Baltimore Theater
MultiPaper
Alternative Approaches to Assessing Outcomes in Health Services Research
International Room
Panel
Good, Better, Best: Evaluation Approaches to Determine Best Practices
Chesapeake Room
Panel
Using Strategic Planning and Strategic Evaluation as Learning Processes
Versailles Room
600 - Eyes Wide Open: Learning to Spot Ethical
Quandaries in Evaluation Practice
MultiPaper to be held in the International Ballroom Section A
• Chair - Ken Meter, Crossroads Resource Center
Avoiding Ethical Entanglements: Learning About Self,
Situation, and Stakeholders
• Amy La Goy, Evaluation and Research Consulting
Crossroads Reached in Evaluation Practice: Learning to
Identify Ethical Signposts
• Norma Martinez-Rubin, Evaluation Focused Consulting
601 - The Proposed Program Evaluation Standards,
Third Edition 2nd Revision: A National Hearing
Panel to be held in the International Ballroom Section B on the
• Chair - Elmima Johnson, National Science Foundation
American Evaluation Association and the Program Evaluation
Standards: Where do we Stand?
• Elmima Johnson, National Science Foundation
The Joint Committee and the Program Evaluation Standards:
Standards Development and Use
• Arlen Gullickson, Western Michigan University
Revisions in Standards Format, Content and Organization and
the New Metaevaluation Standards
• Donald Yarbrough, University of Iowa
Proposed Revisions to the Propriety and Utility Standards
• Rodney Hopson, Duquesne University; Lyn Shulha,
Queen's University
Proposed Revisions to the Feasibility and Accuracy Standards
of the Third Edition of the Joint Committee Standards for
• Flora Caruthers, National Legislative Program Evaluation
Society; Donald Yarbrough, University of Iowa
602 - How to Publish an Article in the American
Journal of Evaluation: Guidance for First-time Authors
Demonstration to be held in the International Ballroom Section
• Robin Miller, Michigan State University; Michael
Hendricks, Independent Consultant; Katherine Ryan,
603 - Studying Process Use on a Large Scale
Multipaper to be held in the International Ballroom Section D
• Chair - Susan Tucker, Evaluation and Development
Association
Evaluation in Post War Countries: Tools and Skills Required
• Mushtaq Rahim, ARD Inc
Not by the Books: Models, Impacts and Quality in Ninety
Evaluations
• Verner Denvall, Lund university
Learning From Evaluations in National Governments of
Developing Countries: The Case for Saharan African Countries
• Rosern Rwampororo and Rhino Mchenga, Ministry of
Economic Planning and Development
On the Value-added of the Evaluation Process: Investigating
Process Use in a Government Context
• Courtney Amo, Social Sciences and Humanities Research
Council of Canada; J Bradley Cousins, University of Ottawa
604 - Graduate Student and New Evaluators TIG
Business Meeeting and Presentation: Learning for
High Quality Evaluation Practice: Training Options,
Experiences, and Lessons Learned
Section E on the Main Lobby Level in the Sheraton
• TIG Leaders - Chris Coryn, Western Michigan University;
Stephen Hulme, Brigham Young University; Daniela C
Schroeter, Western Michigan University; Annette Griffith,
University of Nebraska, Lincoln
• Chair - Bianca Montrosse, University of North Carolina,
Chapel Hill
Locating Training Opportunities: Strategies That Work
• John LaVelle, Claremont Graduate University
Being an Urban Education Research Fellow for the Los Angeles
Unified School District
• Eric Barela, Los Angeles Unified School District
Navigating the Non-Profit World: The HeartShare Human
Services of New York Experience
Ariana Brooks, HeartShare Human Services
A Policy-Based Predoctoral Fellowship Program: The Good,
Bad, and In-Between
• Bianca Montrosse, University of North Carolina, Chapel
Hill
Does Size Matter?
• Daniela C Schroeter, Western Michigan University
Evaluation 2007: Friday, November 9, 1:55 pm to 3:25 pm
Page 99
Friday, 1:55 pm to 3:25 pm, Continued
605 - The Use of Theoretical Models and
Perspectives to Inform Evaluations
• Chair - Martha Holleman, The Safe and Sound Campaign
Structures and Impacts on Program Evaluation: Applying a
Peace Builders Model
• Didi Fahey, The Ohio State University
Developing and Testing a Developmental Model to Promote
the Civic Engagement of Youth
• Joyce Serido and Lynne Borden, University of Arizona
The Resiliency Model for Organizations: Using Organizational
Theory to Inform Evaluation Practices
• Taj Carson, Carson Research Consulting Inc; Laurie
Reuben, Cheshire Consulting Group
Logic Model Ownership: Implications for Logic Model
Utilization and Program Effectiveness
• Dustin Duncan, Harvard University
The Importance of Developing Faith Based Program Theory
• Ayana Perkins, Georgia State University
606 - Evaluation Capacity Development: A Systems
Perspective in an International Context
Sponsors: Organizational Learning and Evaluation Capacity
Building TIG and the International and Cross-cultural
Evaluation TIG and the Multiethnic Issues in Evaluation TIG
• Chair - Patricia Rogers, Royal Melbourne Institute of
Technology
Evaluation Standards Development as Organizational
Capability Building
• Melissa Weenink, New Zealand Ministry of Education;
Kate McKegg, The Knowledge Institute Ltd
Knowledge Network for Evaluation Capacity Development in
Developing Countries
• Naonobu Minato, Foundation for Advanced Studies on
International Development
607 - Methods in Evaluation
• Chair - Elizabeth Sale, Missouri Institute of Mental Health
Comparing the Use Standardized and Site-specific
Instrumentation in National and Statewide Multi-site
Evaluations
• Elizabeth Sale, Missouri Institute of Mental Health; Mary
Nistler, Learning Point Associates; Carol Evans, Missouri
Institute of Mental Health
Analysis of Nested Cross-sectional Group-Randomized Trials
With Pretest and Posttest Measurements: A Comparison of Two
Approaches
• Sherri Pals, Centers for Disease Control and Prevention;
Sheana Bull, University of Colorado, Denver
Closing the Gap on Access and Integration: An Evaluation of
Primary and Behavioral Health Care Integration in Twenty-four
States
• Elena Vinogradova and Elham Eid Alldredge, REDA
International Inc
System-level Evaluation: Strategies for Understanding Which
Part of the Elephant Are We Touching?
• Mary Armstrong, Karen Blase, and Frances Wallace,
University of South Florida
608 - Evaluating School District Emergency
Management Plans Using Government Performance
and Review Act (GPRA) Performance Measures and
Indicators
Panel to be held in the Edgar Allen Poe Room on the Main
• Chair - Kathy Zantal-Wiener, Caliber an ICF International
Company
United States Department of Education's Initiative to Improve
School Emergency Management Plans
• Thomas J Horwood, Caliber an ICF International Company
Government Performance and Review Act Performance
Measures and Indicators for Evaluating School Emergency
Response and Crisis Management Plans
• Kathy Zantal-Wiener, Caliber an ICF International
Company
Using Government Performance and Review Act Performance
Measures and Indicators to Improve the Seattle (Washington)
Public Schools Emergency Response and Crisis Management
Grant Projects
• Thomas J Horwood, Caliber an ICF International Company
Page 100
609 - Getting To Outcomes at the Federal, State,
County, and Local Levels: Session I
the Sheraton
Evaluation TIG
• Chair - Abraham Wandersman, University of South
Carolina; Catherine Lesesne, Centers for Disease Control
and Prevention
Improving Teen Pregnancy Prevention Practice Using Getting to
Outcomes: A National Capacity-building Project
• Catherine Lesesne, Centers for Disease Control and
Prevention; Kelly Lewis, James Madison University; Claire
Moore and Diane Green, Centers for Disease Control and
Prevention
Embedding Getting To Outcomes in State and County
Government Operations
• Lawrence Pasti, New York State Office of Children and
Family Services
Getting To Outcomes with State and Local Social Services and
Benefits Offices in New York State
• Marilyn Ray, Finger Lakes Law and Social Policy Center
Inc
Getting to Outcomes for Emergency Preparedness: A Pilot
Adaptation for Local Practitioners
• Melanie Livet, University of South Carolina; Karen
Pendleton, Centers for Disease Control and Prevention;
Duncan Meyers, University of South Carolina; Joselyn
Burdine, Centers for Disease Control and Prevention
610 - When Funders, Evaluators and Service
Providers Work Together a Good Idea Gets Better
• Chair - Anita Baker, Anita Baker Consulting
• Discussant - Beth Bruner, Bruner Foundation
Developing and Modifying Future Care Planning Services: Key
Lessons About Working With Provider Partners, Evaluators and
Funders
• Ann Marie Cook, Lifespan of Greater Rochester; Daniel
Meyers, Al Sigl Center
Supporting FCPS and Partnerships between Evaluators,
Service Providers and Funders
• Ann Costello, Golisano Foundation
Initiating, Implementing, Institutionalizing Future Care
Planning Services
• Doris Green, Future Care Planning Services; Jody Rowe,
The ARC of Monroe County
Developing Implementing and Enhancing Use of Future Care
Planning Services Evaluation
• Anita Baker, Anita Baker Consulting
611 - Engaging Communities in Sustainable
Systemic Change: A Five Year Analysis of the W K
Kellogg's Leadership for Community Change Series
• Chair - Matthew Militello, University of Massachusetts,
Amherst
• Discussant - Teresa Behrens, W K Kellogg Foundation
Evaluating Collective Leadership for Community Change
• Maenette Benham, Michigan State University
Q-Methodology for Collective Leadership
• Matthew Militello, University of Massachusetts, Amherst
Surveying for Collective Leadership
Anna Ortiz, California State University, Long Beach
The Power of the Local Evaluation Team
• Crystal Elissetche, Kalamazoo College
Using the Photovoice Process as a Data Collection Tool
• John Oliver, Michigan State University
612 - Roundtables
Rotation I: Evaluation of an HIV Awareness and Sexual
Decision-making Peer Education Program Among University
Students: Lessons Learned
• Natalie De La Cruz, Nish McCree-Hale, Ann Elizabeth
Montgomery, and Faith Fletcher, University of Alabama,
Birmingham
Rotation II: At the Starting Gate: Planning the Evaluation of an
Initiative to Enhance Student Engagement at a State University
• Marc Braverman, Lizbeth Ann Gray, Anne Hatley, and
Brandi Hall, Oregon State University
Page 101
613 - Culturally Responsive Evaluation Training for
Students of Color: From Classroom to Fieldwork and
Back
• Chair - Veronica Thomas, Howard University
Planning and Implementing Relevant Evaluation Training for
Students of Color: Successes and Hard Lessons Learned
• Veronica Thomas, Howard University
Planning for Fieldwork: How Coursework Prepared (and Didn't
Prepare) the Student-led Team for the Field
• Shelia Mitchell and Janine Jackson, Howard University
The Practical Experience: Successes, Challenges, and Things in
Between
• Janine Jackson and Shelia Mitchell, Howard University
Where Do We Go From Here? Life After Graduate Coursework
and Field Experiences
• Shelia Mitchell Janine Jackson, Howard University
614 - Evaluation of Educational Outcomes:
Experience of Jordan
MultiPaper to be held in the Peale Room on the Lower Level in
• Chair - Husein Abdul-Hamid, University of Maryland
University College
• Discussant - Harry Patrinos, World Bank
Performance of Jordan in International Assessment
• Khattab Abdu-Libdeh, Jordan National Center For Human
Resources Development
An Evaluation of the Discovery Schools' Experiment
• Khaled El-Qudah, Jordan National Center For Human
Resources Development
Assessment of Knowledge Economy Skills in Jordan
• Husein Abdul-Hamid, University of Maryland University
College
615 - Advocacy Evaluation: Practical Research
Findings
• Lily Zandniapour and Johanna Gladfelter, Innovation
Network Inc; Jackie Williams Kaye, The Atlantic
Philanthropies; Thomas Kelly, Annie E Casey Foundation
616 - Roundtables
Rotation I: Evaluation in Higher Learning Curriculum
Development
• Maria Clark and Rhoda Risner, United States Army
Command and General Staff College
Rotation II: Enhancing a Masters in Evaluation Curriculum by
Learning From Consumers of Evaluation
• Sharon Ross, Founder's Trust; Gibbs Kanyongo,
Duquesne University
617 - Lessons From the Field in Building Evaluative
Capacity of Restoration Activities: A Field Trip of the
Herring Run Watershed Association Project
Field trip departing from the the Washington Room on the
Note: You must sign up in advance via the signup sheet on the
AEA message board in order to go on this fieldtrip. Thank you!
•
Matthew Birnbaum, Amanda Bassow, and Brian Kittler,
National Fish and Wildlife Foundation
618 - Variance Explained and Explaining Variance:
An Overview of Variance in General, in the General
Linear Model, and in Statistical Programs
• Chair - Julius Najab, George Mason University
Variance in Distributions
• Julius Najab, George Mason University
Variance Within the General Linear Model
• Susan Han, George Mason University
To Choose or Not to Choose: Examining the Generalized Linear
Model (GLM) Default Options in R, Statistical Package for the
Social Sciences (SPSS), and Statistical Analysis System (SAS)
• Caroline Wiley, University of Arizona
619 - Treating Data According to Purpose:
Frequentist Versus Bayesian Analyses
Skill-building Workshop to be held in the Calhoun Room on the
• J Michael Menke, University of Arizona
Page 102
620 - Partnering With and Learning From Indigenous
Peoples
• Chair - Donna Mertens, Gallaudet University
• Discussant - Donna Mertens, Gallaudet University
Culling: Tenets of Success - From Hawaiian Promising
Practices in Education - Assets Based Inquiry, a Community
Based Process
• Kanani Aton, Hawaiian Education Services
Fiona Cram, Katoa Ltd
Morris Lai, University of Hawaii
Alice Kawakami, University of Hawaii
Listening and Learning: A Canadian Perspective on Evaluation
in Aboriginal Education Circles
• Linda Lee, Proactive Information Services Inc
Transformative Evaluation in Deafness: Learning From
Indigenous Peoples
• Raychelle Harris, Gallaudet University
Heidi Holmes, Gallaudet University
De-colonizing and Cleaning Our Cultural Lenses: Preliminary
Steps
• Pauline Brooks, Brooks Cross Cultural/International
Evaluation, Research and Racism Consulting
Bulding Evaluation Capacity Through Partnerships With
Community-based Organizations Serving Minorities With
Disabilities
• Yolanda Suarez-Balcazar, Edurne Garcia, and Tina TaylorRitzler, University of Illinois, Chicago
621 - Educating Educators to Support Lesbian, Gay,
Bisexual, and Transgender Students: Documenting
Needs, Exploring Strategies
• Chair - Barbara Radecki, University of Nevada, Las Vegas
Preparation of and Provision by School Staff of Health and
Mental Health Services to Gay, Lesbian, Bisexual and
Questioning Students
• Richard Sawyer, Academy for Educational Development
Visibly Safe: Setting Standards of Performance for an
Evaluation of a University Lesbian, Gay, Bisexual, and
Transgender (LGBT) Safe Zone Program
• Virginia Dicken, Southern Illinois University, Carbondale
Educating the Educator: A Theory-based Evaluation of a
Training Program on Supporting Lesbian, Gay, Bisexual, and
Transgender Students and Addressing Homophobia in K-12
Schools
• Emily Greytak and Joseph Kosciw, Gay, Lesbian and
Straight Education Network
622 - Advancing Organizational Learning Through the
Study and Development of Diversity
Building TIG and the Multiethnic Issues in
• Chair - Molly Engle, Oregon State University
• Discussant - Katrina Bledsoe, Planning, Research and
Evaluation Services Associates Inc
Helping the Helpers: The Excellence Through Diversity Institute
as an Assessment-Savvy Leadership Development Initiative
• Hazel L Symonette, University of Wisconsin, Madison
The Quality Assurance Team (QAT): Developing Mechanisms for
Multiple Voices to be Heard in Transdisciplinary Multi-site
Community Research
• Leah Neubauer and Gary Harper, DePaul University;
Audrey Bangi, University of California, San Francisco;
Jonathan Ellen, Johns Hopkins University
The Role of Evaluation in Advancing Organizational Change: A
Case Study in Diversity
• Gwen M Willems and Mary Marczak, University of
Minnesota
623 - How Should We Measure Child Outcomes in
Early Childhood Evaluations and
Accountability Efforts?
Think Tank to be held in the Fairmount Suite on the 19th Floor
in the Radisson
• Discussants - Shari Golan, Lauren Barton, and Michelle
Woodbridge, SRI International
• Presenters - Donna Spiker and Kathy Hebbeler, SRI
International
624 - Roundtables
Rotation I: Building Evaluation Capacity in a State Maternal
and Child Health Agency
• Nurit Fischler and Collette Young, Oregon Public Health
Division
Rotation II: Facilitating Collaborative Evaluation Projects for
Building and Sustaining Evaluation Capacity: Reflections and
Lessons Learned
• Ellen Taylor-Powell and Matthew Calvert, University of
Wisconsin
Page 103
625 - Evaluation in Non-traditional and Informal
Learning Contexts
• Chair - Anane Olatunji, George Washington University
Students Gobble Blood Oranges for Harvest of the Month
• Andy Fourney, Andrew Bellow, Sharon Sugerman, Helen
Magnuson, and Kathy Streng, Network for a Healthy
California
• Chair - Tom McKlin, Georgia Institute of Technology
Learning From School Evaluation: Leadership at a Large HighSchool in a Changing Community
• Laurie Moore, Mid-continent Research for Education and
Learning
Evaluating a Museum-Community Science Collaboration
• Colleen Manning, Goodman Research Group Inc
Children Learning Through Fun: Evaluation of a Universitysponsored Children's Festival
• Heather M Scott, Melinda Hess, James Coraggio, Teresa
Chavez, and Tina Hohlfeld, University of South Florida
626 - Evaluating Arizona's School-based Tobacco
Prevention Program: Lessons Learned in Outcome
Evaluation
• Chair - Frederic Malter, University of Arizona
The Challenges of Evaluating a Tobacco Prevention Program:
Curricula, Coverage and Why a Program Could Make a
Difference
• Arian Sunshine Coffman, University of Arizona
Synthesizing Data Bases for a Quasi-experimental Study of
Program Outcomes and Program Effectiveness
• Frederic Malter, University of Arizona
What we Have Learned from the Evaluation of the Schoolbased Prevention Program in Arizona? Results from a Quasiexperimental Approach
• Mei-kuang Chen, University of Arizona
627 - Evaluating Graduate Education in Health and
Medicine
• Discussant - Beverly Parsons, InSites
627 – Continued
What Physician Competence is Assessed Well by Patient
Surveys of Medical Residents?
• Sue Hamann and Jason Eudy, Coastal Area Health
Education Center
Evaluation and Learning: Experiential Learning in Medical
School Training
• Summers Kalishman, Jan Mines, Lisa Serna, Renee
Quintana, Roger Jerabek, and Phil Szydlowski, University of
New Mexico
Learning From Résumé-Analysis: A Tool to Analyze Career
Pathways and Evaluate Training Programs of National
Institutes of Health (NIH) Funded Alumni
• Susan Tucker and Raymond Ivatt, Evaluation and
Development Association; Simeon Slovacek, California State
University; Jackie Stillisano, Texas A&M University
628 - Indigenous Knowledge Creation and
Evaluation Practice
MultiPaper to be held in the
• Chairs - Carrie Billy, American Indian Higher Education
Consortium; Joan LaFrance, Mekinak Consulting
• Discussant - Karen Kirkhart, Syracuse University
Building the Indigenous Framework
• Iris Prettypaint, University of Montana
Cultural Grounding
• Richard Nichols, Colyer Nichols Inc Consulting
Implications for Evaluation
• Joan LaFrance, Mekinak Consulting
The View From the Field
• Dawn Frank, Oglala Lakota College
629 - Alternative Approaches to Assessing Outcomes
in Health Services Research
• Chair - Souraya Sidani, Ryerson University
Approaches to Outcomes Assessment: Advantages and
Limitations
• Joyal Miranda, University of Toronto
Feasibility and Reliability of Retrospective and Transition
Measures
• Souraya Sidani, Ryerson University
Detecting Changes in Outcomes: Performance of Three
Approaches to Assessment
• David Streiner, University of Toronto
Page 104
Notes:
630 - Good, Better, Best: Evaluation Approaches to
Determine Best Practices
• Chair - James Hersey, RTI International
• Discussant - Maureen Wilce, Centers for Disease Control
and Prevention
Best Practices: Cutting Through the Buzzwords and Jargon
• Michael Schooley, Centers for Disease Control and
Prevention
Best Practices Evaluation: Lessons Learned in the WellIntegrated Screening and Evaluation for
Women Across the Nation Program (WISEWOMAN)
• Rosanne Farris, Centers for Disease Control and
Prevention
Identifying Promising Practices in Heart Disease and Stroke
Prevention
• Pam Williams-Piehota, RTI International
A New Look at Outcomes for Targeted Testing and Treatment
for Latent Tuberculosis Infection Programs
• Amy Roussel, RTI International
631 - Using Strategic Planning and Strategic
Evaluation as Learning Processes
the Radisson
• Chair - David J Bernstein, Westat
• Discussant - Kathryn Newcomer, George Washington
University
Alternative Approaches to Developing Strategic Performance
Plans
• David J Bernstein, Westat
Strategic Thinking as Applied at the Portfolio and Program
Level by the Cooperative State Research Education Extension
Service
• Djimé Adoum, United States Department of Agriculture
Strategically Planning Evaluations to Maximize Learning About
Program Performance
• Stephanie Shipman and Valerie J Caracelli, United States
Communicating Lessons Learned From Strategic Planning and
Evaluation to Policymakers
• Rakesh Mohan, Idaho State Legislature
Page 105
No Primary Sponsor
Session
Session Title
Room Name
MultiPaper
Cost Benefit Analyses in and of Evaluation
Business
TIG Business Meeting and Panel: The Use of Evaluation to Promote Learning: A Theory Based Perspective
Panel
What is Systems Thinking?
Mencken Room
635 Disaster and Emergency Management Eval TIG Multipaper
Evaluating Online Training for Disaster and Emergency Preparedness
Getting To Outcomes at the Federal, State, County, and Local Levels: Session II
Carroll Room
Ex Ante Evaluation: Methods for Estimating Innovation and Other Research Outcomes
Panel
638 Needs Assessment TIG
Business Meeting Needs Assessment TIG Business Meeting
Roundtable
Building Evaluative Capacity in Israeli Social Change Nonprofits
Douglass Boardroom
MultiPaper
Emerging Practitioners in an Emerging Subfield: Vexing Issues, Opportunities and Lessons Learned
Hopkins Room
Expert Lecture
Evaluation Across Policy Networks: Chronic Disease, Obesity, and Community Design
Adams Room
Roundtable
Poetic Devices for Evaluation: Found Data Poems From Interviews and Photography to Augment Qual Eval Reporting Jefferson Room
Panel
Conversation Hour With the 2007 AEA Award Winners
Washington Room
Demonstration
Why be Normal? Nonparametric Data Analysis Methods as an Important Tool to Analyze and Draw Conclusions…
D'Alesandro Room
Demonstration
Applications of Geographic Information Systems in Local and Statewide Evaluation
Calhoun Room
Multipaper
GIS and QDAS: Technological Tools That Reveal Multiple Perspectives and Unique Data Associations
McKeldon Room
Demonstration
Evaluating an Apple When You Are Among a Bunch of Bananas: Meeting Stakeholders' Needs…
Preston Room
649 Org Learning TIG/PreK-12 Education TIG
Expert Lecture
Contextual Variables in Elementary Schools Influencing Organizational Learning and Predicting Evaluative Inquiry
Schaefer Room
Multipaper
Magnet School Evaluation Issues
Fairmount Suite
Roundtable
Barriers to Implementation of Program Design: An Examination of Organizational Capacity…
Federal Hill Suite
652 Research, Technology, & Development Eval TIG Demonstration
A Directory of Evaluation Methods for Managers of Public Research and Technology Programs
Royal Board Room
Expert Lecture
Evaluation to Improve Coordinated Social Marketing Campaigns: Lessons From Tobacco Control
Think Tank
Using Graduate Student Assessment to Evaluate Success of Graduate Programs
Hanover Suite B
Demonstration
Introducing Appreciative Inquiry to Evaluation
Baltimore Theater
Multipaper
Learning Through Applied Research in Social Service Contexts
International Room
Demonstration
Panel
Extending the Reach: Making the Most of Limited Evaluation Resources
Effectiveness and Impact of Federal Safety Risk Reduction Programs: Eval Experience and Lessons Learned…
Chesapeake Room
Versailles Room
Evaluation 2007: Friday, November 9, 3:35 pm to 4:20 pm, Timeslot Overview
Page 106
632 - Cost Benefit Analyses in and of Evaluation
MultiPaper to be held in the Liberty Ballroom Section A on the
• Chair - Sarah Heinemeier, Compass Consulting Group
The Costs and Benefits of Conducting Evaluations
• Sarah Heinemeier, Amy Germuth, Anne D'Agostino, and
Compass Consulting Group
Integrating Cost Benefit and Effectiveness Analyses Into
Comprehensive Evaluations
• Sarah Heinemeier, Compass Consulting Group
633 - Program Theory and Theory-driven Evaluation
TIG Business Meeting and Panel: The Use of
Evaluation to Promote Learning: A Theory Based
Perspective
Business Meeting to be held in the Liberty Ballroom Section B
• TIG Leaders - Katrina Bledsoe, Planning, Research and
Evaluation Services Associates Inc; Lea Witta, University of
Central Florida
• Chair - Katrina Bledsoe, Planning, Research and
Evaluation Services Associates Inc
• Discussant - Craig Thomas, Centers for Disease Control
and Prevention
A Theory-based Evaluation Case Study: Learning About
Teaching About Learning and Teaching
• John Gargani, Gargani & Company Inc
Theory-based Evaluation Promotes Learning About Cultures:
Examples From Three Evaluations Focused on Ethnic
Communities
• Katrina Bledsoe, Planning, Research and Evaluation
Services Associates Inc
What do we Learn From Program Theory?
• Stewart I Donaldson, Claremont Graduate Unviersity
634 - What is Systems Thinking?
• Chair - Cabrera Derek A, Cornell University
The Popularity and Promise of Systems Thinking
• Laura Colosi, Cornell University
Patterns not Taxonomies
• Derek A Cabrera, Cornell University
635 - Evaluating Online Training for Disaster and
Emergency Preparedness
• Chair - Elizabeth Ablah, University of Kansas School of
Medicine
Evaluating Pandemic Influenza Preparedness: The Contribution
of an Online Short Course to Local Health Department
Preparedness in North Carolina
• Molly McKnight Lynch and Richard Rosselli, University of
North Carolina, Chapel Hill; Kristina Simeonsson, East
Carolina State University; Mary Davis, University of North
Emergency Preparedness for Hospital Clinicians: Multi-state
Evaluation for Online Modules
• Elizabeth Ablah, University of Kansas School of Medicine;
Leslie Horn and Kristine Gebbie, Columbia University
636 - Getting To Outcomes at the Federal, State,
County, and Local Levels: Session II
the Sheraton - Sponsor: Collaborative, Participatory &
Empowerment Evaluation TIG
• Chairs - Abraham Wandersman, University of South
Carolina; Catherine Lesesne, Centers for Disease Control
and Prevention
Getting to Outcomes and Systems of Care For Child and Family
Mental Health Services
• Duncan Meyers, Greg Townley, David Asiamah, and
Sheara Fernando, University of South Carolina; David Osher,
American Institutes for Research
Getting to Outcomes in Local Systems Transformations
• Rusti Berent, Children's Institute; Jody Levinson-Johnson,
Coordinated Care Services Inc
637 - Ex Ante Evaluation: Methods for Estimating
Innovation and Other Research Outcomes
• Chair - George Teather, Independent Consultant
Ex Ante Portfolio Analysis of Public R&D Programs for
Industrial Technologies in Korea: Practices at the Korea
Institute of Industrial Technology Evaluation and Planning
• Yongsuk Jang, George Washington University; Jongman
Park, Korea Institute of Industrial Technology Evaluation and
Planning
Impact Evaluation in Preliminary Feasibility Analysis of
National R&D Programs
• Jiyoung Park, Korea Institute of Science and Technology
Evaluation and Planning
Page 107
638 - Needs Assessment TIG Business Meeting
643 - Poetic Devices for Evaluation: Found Data
Poems From Interviews and Photography to Augment
Qualitative Evaluation Reporting
• TIG Leaders - Catherine Sleezer, Baker-Hughes; Jeffry L
White, Ashland University
• Valerie Janesick, University of South Florida; David
Campos, University of the Incarnate Word, San Antonio
639 - Building Evaluative Capacity in Israeli Social
Change Nonprofits
644 - Conversation Hour With the 2007 AEA Award
Winners
• Nancy Strichman, Independent Consultant; Bill Bickel,
University of Pittsburgh
• Chair - Jennifer Martineau, Center for Creative Leadership
640 - Emerging Practitioners in an Emerging
Subfield: Vexing Issues, Opportunities and Lessons
Learned
645 - Why be Normal? Nonparametric Data Analysis
Methods as an Important Tool to Analyze and Draw
Conclusions From Program Evaluation Data
• Chair - Jacqueline Copeland-Carson, Copeland Carson
and Associates
• Discussant - Michael Lieber, University of Illinois, Chicago
Translating Anthropology for Evaluation: An Anthropological
Critique of A Framework for Understanding Poverty
• Carol Hafford, James Bell Associates
Issues in Participatory Evaluation and Social Change:
A Case Study From El Salvador
• James G Huff Jr, Vanguard University
Research, Evaluation, and Program Data: The Politics of
Information
• Karen Snyder, Public Health, Seattle and King County
Building Evidence in Ethnographic Evaluation
• Mary Odell Butler, Battelle Centers for Public Health
• Current Opportunities and Challenges for Anthropologists
Developing Evaluation Careers
• Eve Pinsker, University of Illinois, Chicago
642 - Evaluation Across Policy Networks: Chronic
Disease, Obesity, and Community Design
Expert Lecture to be held in the Adams Room on the Cabana
• Ron Maynard, University of Washington
• Tessa Crume, Rocky Mountain Center for Health
Promotion and Education
646 - Applications of Geographic Information
Systems in Local and Statewide Evaluation
• Susan Voelker, Aunna Elm, and Michele Walsh, University
of Arizona
647 - GIS and QDAS: Technological Tools That
Reveal Multiple Perspectives and Unique Data
Associations
• Chair - Vanessa Dennen, Florida State University
Evaluation Data Analysis: The Importance of Methodology
When Using Qualitative Data Analysis Software
• Dan Kaczynski, University of West Florida; Michelle
Salmona, University of Technology Sydney, Australia
Applications for Geographic Information System Technology in
Program Evaluation
• Janet Lee and Tarek Azzam, University of California, Los
Angeles
Page 108
648 - Evaluating an Apple When You Are Among a
Bunch of Bananas: Meeting Stakeholders' Needs
When Everyone Has Differing (and Conflicting)
Expectations
Demonstration to be held in the Preston Room on the Cabana
• Kimberly Taylor, Schwab Rehabilitation Hospital
649 - Contextual Variables in Elementary Schools
Influencing Organizational Learning and Predicting
Evaluative Inquiry
Building TIG and the Pre-K - 12 Educational
Evaluation TIG
• Chair - Rebecca Gajda, University of Massachusetts,
Amherst
• Discussants - Chris Koliba, University of Massachusetts;
Rebecca Gajda, University of Massachusetts, Amherst
• Presenter - Jeffrey Sheldon, Claremont Graduate
University
650 - Magnet School Evaluation Issues
in the Radisson
• Chair - Donna Lander, Jackson State University
Evaluating Selection Criteria for an Urban Magnet School
• Jill Lohmeier, University of Massachusetts, Lowell;
Jennifer Raad, University of Kansas
Evaluating Educational Reform: Lessons Learned From the
Implementation of Middle School Magnet Programs
• Suzanne Raber, Montgomery County Public Schools
651 - Barriers to Implementation of Program Design:
An Examination of Organizational Capacity,
Collaborative Relationships and Program
Implementation Design Issues
• Kakoli Banerjee, United States Department of Health and
Human Services
652 - A Directory of Evaluation Methods for
Managers of Public Research and Technology
Programs
Demonstration to be held in the Royal Board Room on the 19th
• Rosalie Ruegg, TIA Consulting Inc
653 - Evaluation to Improve Coordinated Social
Marketing Campaigns: Lessons From Tobacco
Control
Expert Lecture to be held in the Royal Conference Foyer on the
• Chair and Discussant - Carolyn Celebucki, University of
Rhode Island
• Presenter - James Hersey, RTI International
654 - Using Graduate Student Assessment to
Evaluate Success of Graduate Programs
• Discussant - Maria Clark, United States Army Command
and General Staff College
• Presenter - Rhoda Risner, United States Army Command
and General Staff College
655 - Introducing Appreciative Inquiry to Evaluation
Demonstration to be held in the
• Tessie Catsambas,
EnCompass LLC
656 - Learning Through Applied Research in Social
Service Contexts
• Chair and Discussant- Darryl Jinkerson, Abilene Christian
University
The Impact of the Automated Information Systems (AIS) for
Child Support Enforcement on Child Support Policy Outcomes
• Jeongsoo Kim, University of California, Berkely
Projecting Staffing Needs for Program Evaluation and Budget
Planning in Public Social Services
• Joy Stewart, Dean Duncan, and Jilan Li, University of
North Carolina, Chapel Hill
Page 109
Notes:
657 - Extending the Reach: Making the Most of
Limited Evaluation Resources
• Tom Summerfelt, University of Chicago; Cidhinnia M
Torres Campos, Crafton Hills College; Rebekah King,
Spectrum Health Healthier Communities
658 - Effectiveness and Impact of Federal Safety
Risk Reduction Programs: Evaluation Experience and
Lessons Learned From Three Government Agencies
Efforts to Improve Industry Safety
the Radisson
• Chair - Michael Coplen, Federal Railroad Administration
Jonathan Morell, New Vectors LLC
• Discussant - Jo Strang, Federal Railroad Administration
Compliance and Oversight of Risk-based Safety Systems in the
Aviation Industry
• Wes Timmons, Federal Aviation Administration
Risk Assessment and Lessons Learned From Transport
Canada's Railway Safety Act
• Luc Burdon, Transport Canada
Page 110
No Primary Sponsor
Session
Session Title
Room Name
Panel
Evaluation as a Learning Tool: Maximizing Outcomes Using Strategic Formative Evaluation
Business Meeting TIG Business Meeting and Presentation: Evaluation Theory: Consolidate it, Nurture it, Learn it, and Teach it. But How? Liberty Ballroom Section B
Skill-building
Telling Your Program's Story: How to Collect, Create, and Deliver an Effective Success Story
Mencken Room
Multipaper
Where Evaluation and Learning Technology Innovations Meet
Multipaper
Collaborative Evaluations: Successes, Challenges, and Lessons Learned
Carroll Room
Panel
Making Sense of Mobility: Household Survey Data From Comprehensive Community Initiatives, Implications…
Panel
Success Measures: Learning From Community Development Results Through Participation, Common Tools…
Roundtable
Rotation I: Developing a Conceptual Framework for Evaluating Policy Change
Douglass Boardroom
Rotation II: Development of an Outcome Monitoring System for Mental Health Programs in a Regional Health Authority
Panel
Building Capacity for Evaluation: A Tale of Four National Youth Development Organizations
Hopkins Room
Skill-building
Peer Reviews for Independent Consultants: New Peer Reviewer Orientation
Peale Room
Demonstration
Lessons Learned: Wrapping up our Evaluation of an Advocacy Campaign
Adams Room
Roundtable
Rotation I: Using a Shared On-line Database to Address Multi-partner Project Management and Evaluation Issues Jefferson Room
Rotation II: Instructionally Linked Versus Norm Referenced Assessments to Determine Impact Within an Even Start…
Multipaper
Conducting Multi-method Evaluations
D'Alesandro Room
Multipaper
Applications of Multilevel Longitudinal Analysis
Calhoun Room
674 International and Cross-cultural Evalluation TIG Business Meeting International and Cross-Cultural TIG Business Meeting
McKeldon Room
Panel
Evaluating Outcomes for Young Children With Disabilities: Issues at the National, State, and Local Levels
Preston Room
Panel
Deliverables as a Tool to Promote and Support Orga Learning: Client-centered Strategies for Data Collection…
Schaefer Room
Skill-building
Living and Learning Evaluation: Teaching Evaluation Through Visual, Narrative and Performative Practice
Panel
Evaluation in Federal Agencies: What Shapes It, and How Could AEA be Part of the "What"?
Multipaper
Evaluation Within Partnerships: Working With Community Groups
Multipaper
Evaluations of Reading and Literacy Programs
Fairmount Suite
Roundtable
Federal Hill Suite
Multipaper
Rotation I: An Evaluation of Ten Years of Progress in an Autistic Impaired Preschool Program
Rotation II: Conducting Successful Field Research in School-based Settings
Issues in Doing Randomized Trials in Educational Evaluation
Multipaper
Recovery/Resilience, Trajectories, Co-occurring Disorders, and Real Time Program Evaluation
Multipaper
Diverse Approaches to Evaluative Inquiry in Higher Education
Hanover Suite B
Panel
Learning From Evaluation in Service of Social Justice: Who learns? What is Learned? And Why Does it Matter?
Baltimore Theater
MultiPaper
Measuring Fidelity and Assessing Impact of Service Interventions in Ohio's Title IV-E Waiver Evaluation
International Room
Skill-building
Using Systems Tools to Understand Multi-site Program Evaluation
Chesapeake Room
Multipaper
Challenges and Opportunities in Evaluating Publicly-Funded Programs
Versailles Room
Evaluation 2007: Friday, November 9, 4:30 pm to 6:00 pm, Timeslot Overview
Royal Board Room
Page 111
659 - Evaluation as a Learning Tool: Maximizing
Outcomes Using Strategic Formative Evaluation
Panel to be held in the Liberty Ballroom, Section A on the Main
Building TIG
• Chair - Linda Thurston, Kansas State University
• Discussant - Jan Middendorf, Kansas State University
Impact of Formative Evaluation on Service Learning Projects to
Restore Water Quality in Kansas
• Christa Smith and Bill Hargrove, Kansas State University;
Christopher Lavergne, WaterLINK
Informing the Development of Graduate Coursework Through
Formative Evaluation
• Jennifer McGee and Amy Conner, Kansas State University;
Marsha Dickson, University of Delaware
The Evolution of Formative Evaluation for a Statewide Multiyear Initiative
• Cindy Shuman, Jan Middendorf, and Cindi Dunn, Kansas
State University
Learning From Evaluation: Capacity Building in a Geoscience
Education Project
• Sheryl Hodge and Iris M Totten, Kansas State University
660 - Theories of Evaluation TIG Business Meeting
and Presentation: Evaluation Theory: Consolidate it,
Nurture it, Learn it, and Teach it. But How?
Business Meeting to be held in the Liberty Ballroom, Section B
• TIG Leader - Bernadette Campbell, Carleton University
• Discussants- Melvin Mark, Pennsylvania State University;
William Shadish, University of California, Merced
• Presenters - Bernadette Campbell, Carleton University;
Marvin Alkin, University of California, Los Angeles
661 - Telling Your Program's Story: How to Collect,
Create, and Deliver an Effective Success Story
Skill-building Workshop to be held in the Mencken Room on
• Rene Lavinghouze, Centers for Disease Control and
Prevention; Ann Price, Community Evaluation Solutions Inc
662 - Where Evaluation and Learning Technology
Innovations Meet
• Chair - Tamara J Barbosa, PhD's Consulting
Cross-cultural Evaluations-building Bridges With Technology
• Yehuda Peled, Western Galilee College; Gloria Dunnivan,
Kent State University
Digital Travels: User-focused Evaluation of Distance Education
in Informal Learning Environments
• Tamara J Barbosa, PhD's Consulting
Evaluating Emerging Mobile and Web-based Technologies in
Education: A Quality Assurance Process
• Nancy Gadzuk and Sheila Cassidy, Wexford
663 - Collaborative Evaluations: Successes,
Challenges, and Lessons Learned
Evaluation TIG
• Chair - Nakia James, Western Michigan University
Learning From Stakeholders: Using A Collaborative Evaluation
Approach With Classroom Teachers to Investigate Cross-site
Outcomes of a Screen Education Intervention
• Karyl Askew and Rita O'Sullivan, University of North
Collaborative Evaluation of Superintendents' Attitudes Toward
Leadership: A Qualitative Perspective
• Rigoberto Rincones-Gomez, MDC Inc; Liliana RodriguezCampos, University of South Florida
Using a Collaborative Approach in Evaluating the Impacts of
the Sustainable Agriculture Research and Education (SARE)
Professional Development Program (PDP) State Allocations
• John O'Sullivan, North Carolina A & T State University;
Rita O'Sullivan, University of North Carolina, Chapel Hill
Lessons Learned, Wisdom Gained: The Collaborative
Evaluation of A College Access Initiative Comes Full Circle
• Michelle Jay, University of South Carolina; Karyl Askew
and Matthew McBee, University of North Carolina; Rita
O'Sullivan, University of North Carolina, Chapel Hill
Creating Observational Tools for the District Standards Support
Review: Focusing a Formative Evaluation With a Collaborative
Approach
• Ranjana Damle, Albuquerque Public Schools
Page 112
664 - Making Sense of Mobility: Household Survey
Data From Comprehensive Community Initiatives,
Implications for Evaluation and Theory
• Chair - Cindy Guy, Annie E Casey Foundation
• Discussant - Claudia Coulton, Case Western Reserve
University
Family Mobility and Neighborhood Change: Implications for
Evaluation and Design From the Making Connections Initiative
• Marge Turner, Urban Institute
Accounting for Mobility in a Multi-site, Multi-method
Evaluation of Comprehensive Community Change
• Beth Weitzman, Charles Brecher, Tod Mijanovich, and
Diana Silver, New York University
Patterns of Residential Longevity in Baltimore: Implications for
Initiative Theory, Design and Evaluation
• Martha Holleman, The Safe and Sound Campaign
665 - Success Measures: Learning From Community
Development Results Through Participation,
Common Tools, Shared Data
• Chair - Maggie Grieve, NeighborWorks America
• Discussant - Dawn Hanson Smart, Clegg & Associates;
Nancy Kopf, NeighborWorks America
Cabrillo Economic Development Corporation: Using Success
Measures to Measure Affordable Multi-family Housing Results
for Individuals and Communities
• Jill Fioravanti, Cabrillo Economic Development
Corporation
Quitman County Development Organization: Measuring
Resident Satisfaction, Security and Stability in the Mississippi
Delta
• Lela Keys, Quitman County Development Corporation
Hispanic Association of Contractors and Enterprises:
Measuring Improved Quality of Life Through Success Measures
Tools
• Maria Gonzalez, Hispanic Association of Contractors and
Enterprises
Building Capacity to Measure Community Level Outcomes in
the NeighborWorks Network
• Brooke Finn, NeighborWorks America
666 - Roundtables
Rotation I: Developing a Conceptual Framework for Evaluating
Policy Change
• Susan Ladd and Jan Jernigan, Centers for Disease Control
and Prevention; Alice Ammerman, University of North
Carolina, Chapel Hill; Semra Aytur, Beverly Garcia, and Amy
Paxton, University of North Carolina
Rotation II: Development of an Outcome Monitoring System for
Mental Health Programs in a Large Regional Health Authority
• Colleen Lucas and Lindsay Guyn, Calgary Health Region
667 - Building Capacity for Evaluation: A Tale of Four
National Youth Development Organizations
Building TIG
• Chairs - Suzanne Le Menestrel, United States Department
of Agriculture; Karen Heller Key, National Human Services
Assembly
• Discussant - Hallie Preskill, Claremont Graduate
University
Evaluating for Impact in the 4-H Youth Development Program
• Suzanne Le Menestrel, United States Department of
Agriculture; Mary Arnold, Oregon State University
Developing the Big Brothers Big Sisters of America Impact
Survey
• Keoki Hansen, Big Brothers Big Sisters of America
Building Capacity for Evaluation - The Girls, Inc Approach
• Heather Johnston Nicholson and PeiYao Chen, Girls
Incorporated
Prove It: Evaluation Tools To Measure Youth Development
Outcomes
• Barry Garst and M Deborah Bialeschki, American Camp
Association
668 - Peer Reviews for Independent Consultants:
New Peer Reviewer Orientation
Skill-building Workshop to be held in the Peale Room on the
• Sally Bond, The Program Evaluation Group; Marilyn Ray,
Finger Lakes Law and Social Policy Center Inc
Page 113
669 - Lessons Learned: Wrapping up our Evaluation
of an Advocacy Campaign
• Chair - Ehren Reed, Innovation Network Inc
• Presenter - Jennifer Bagnell Stuart, Innovation
Network Inc
670 - Roundtables
Rotation I: Using a Shared On-line Database to Address Multipartner Project Management and Evaluation Issues
• Randy Ellsworth, Wichita State University; Larry Gwaltney,
Allied Educational Research and Development Services;
Patrick Hutchison, Wichita State University
Rotation II: Instructionally Linked Versus Norm Referenced
Assessments to Determine Impact Within an Even Start
Program Evaluation
• Zandra Gratz, Kean University
672 - Conducting Multi-method Evaluations
• Chair - Linda Morell, University of California, Berkeley
The Health Disease Process: Social Representations of Rural
Workers Through Q Methodology
• Virginia Gravina and Pedro de Hegedüs, Universidad de la
Republica Uruguay; Carolina Tonini, Universidad Federal de
Santa Maria
Relationships Matter: Using Social Network Analysis to
Evaluate Social Capital in the Kenyan Dairy Sector
• Karabi Acharya, Academy for Educational Development;
Charles Wambugu, Esther Karanja, and Hellen Arimi, World
Agroforestry Centre; Bette Booth, Academy for Educational
Development; Shera Bender, Independent Consultant
Validity Evidence Presented Through a Mixed Model
Conceptual Framework
• Linda Morell, University of California, Berkeley
Data Preparation, Analysis, and Reporting System Evaluation
For a School System
• David MacQuarrie, Western Michigan University
673 - Applications of Multilevel Longitudinal
Analysis
• Chair - Fred Newman, Florida International University
Evaluation of the National Examination's Impact on the Quality
of Learning in Russian Schools
• Zvonnikov Victor and Marina Chelyshkova, State
University of Management
Multi-level Longitudinal Analysis as a Method for Evaluating
Reading First
• Bruce Randel, Mid-continent Research for Education and
Learning
The Application of Multi-level Modeling in the Evaluation of
After-school Programs: Linking Academic Success to
Attendance
• Jeremy Lingle, Carolyn Furlow, Sheryl Gowen, and Syreeta
Skelton, Georgia State University
Comparing Urban and Suburban Schools: An Investigation of
the Intervention Effects of Reading Recovery With Multi-level
Growth Modeling
• Jing Zhu, The Ohio State University; Francisco GómezBellengé, Reading Recovery National Data Evaluation Center
674 - International and Cross-Cultural TIG Business
Meeting
• TIG Leaders - Thomaz Chianca, Western Michigan
University; Gwen M Willems, University of Minnesota; Nino
Saakashvili, Horizonti Foundation
675 - Evaluating Outcomes for Young Children With
Disabilities: Issues at the National, State, and Local
Levels
• Chair - Kathy Hebbeler, SRI International
The Federal Need for Outcome Data on Young Children With
Disabilities
• Kathy Hebbeler, SRI International
State Approaches to Collecting and Using Data on Child
Outcomes
• Lynne Kahn, University of North Carolina
Value at the Grassroots Level: Implications of Child Outcomes
Data for Teachers, Providers, and Local Administrators
• Christina Kasprzak, University of North Carolina, Chapel
Hill
Page 114
676 - Deliverables as a Tool to Promote and Support
Organizational Learning: Client-centered Strategies
for Data Collection and Reporting
Building TIG
• Chair - Debbie Zorn, University of Cincinnati
Old Habits Die Hard: Introducing New Approaches to an
Established Client
• Imelda Castañeda-Emenaker, University of Cincinnati
A Complex Balancing Act: Reporting Across Multiple Years,
Sites, and Program Models for Statewide Professional
Development in Literacy Instruction
• Janice Noga, Pathfinder Evaluation and Consulting
Using Professional Development Standards as a Foundation
for Program Evaluation and Program Improvement
• Stacey Farber, University of Cincinnati
Community Based Weed and Seed Projects: Using Progress
Reports to Promote Continuous Improvement and Improve
Project Sustainability
• Nancy Rogers, University of Cincinnati
Building the Educational Community into a Multi-Methods
Evaluation of the Cincinnati Art Museum's School Program
• Jan Matulis, University of Cincinnati
677 - Living and Learning Evaluation: Teaching
Evaluation Through Visual, Narrative and
Performative Practice
Skill-building Workshop to be held in the Calvert Ballroom
Salon B on the Ballroom Level in the Radisson
• A Rae Clementz and April Munson, University of Illinois at
Urbana-Champaign
678 - Evaluation in Federal Agencies: What Shapes
It, and How Could the American Evaluation
Association be Part of the "What"?
• Chair - Michael Morris, University of New Haven
• Discussant - Debra Rog, Westat
Overview
• Wendell Primus, United States House of Representatives
Evaluation at the Centers for Disease Control and Prevention
• Thomas Chapel, Centers for Disease Control
Evaluation at the National Institute of Justice
• Patrick Clark, National Institutes of Justice
Evaluation at the National Science Foundation
• Bernice Anderson, National Science Foundation
679 - Evaluation Within Partnerships: Working With
Community Groups
• Chair - Mary T Crave, University of Wisconsin
“Catch 'Em Being Good” Cooperative Extension Service Teams
Up with Schools to Promote and Evaluate the School Wide
Positive Behavior Support Program
• Kerri Wade and Allison Nichols, West Virginia University
An Innovative Approach for Building Evaluation Capacity of
Grassroots Level Financial Educators Including Extension
Agents
• Koralalage Jayaratne, North Carolina State University;
Angela Lyons, University of Illinois at Urbana-Champaign;
Lance Palmer, University of Georgia
A Recipe for Understanding Food Safety: Using a Conceptoriented Theoretical Frame for Eliciting Adult Food Service
Employees' Prior Knowledge
• Jason Ellis, University of Nebraska, Lincoln
Evaluating Oregon's Food Stamp Nutrition Education Program:
Issues in Capacity Building and Compliance
• Marc Braverman, Lauren Tobey, Carolyn Raab, Jill Murray,
and Sally Bowman, Oregon State University
680 - Evaluations of Reading and Literacy Programs
in the Radisson
• Chair - Edith Stevens, Macro International Inc
Comparing Self-report Logs with Classroom Observation of
Reading Instruction
• David Quinn, Kelci Price, Annette Marek, Alvin Quinones,
and Mangi Arugam, Chicago Public Schools
Criteria, Interferences, and Flexibility: Issues From a School
District Evaluation
Measuring the Fidelity of Literacy Programs: No Shortcuts
• Nancy Carrillo, Albuquerque Public Schools
681 - Roundtables
Rotation I: An Evaluation of Ten Years of Progress in an Autistic
Impaired Preschool Program
• Carmen Jonaitis and Jinhai Zhang, Western Michigan
University
Rotation II: Conducting Successful Field Research in Schoolbased Settings
• David Dobrowski, First 5 Monterey County; Raul Martinez,
Harder & Company Community Research
Page 115
682 - Issues in Doing Randomized Trials in
• Chair - Burke Johnson, University of South Alabama
Conducting a Randomized Control Trial in Middle Schools:
Challenges and Solutions
• Kelly Feighan and Jill Feldman, Research for Better
Schools
Obtaining Buy-In to Conduct Randomized Controlled Trials in
Schools: Lessons Learned From the Communities in Schools
(CIS) National Evaluation
• Heather Clawson, Caliber an ICF International Company;
Eric Metcalf, Communities in Schools, Central Texas; Mike
Massey, Communities in Schools, Charlotte-Mecklenburg;
Susan Siegel, Communities in Schools
The Consequences of No Child Left Behind: Challenges to
Achieving the "Gold Standard" in a Large Urban School
District
• Cheri Hodson and Regino Chavez, Los Angeles Unified
School District
683 - Recovery/Resilience, Trajectories, Cooccurring Disorders, and Real Time Program
Evaluation
• Chair - Garrett E Moran, Westat
The Process of Mental Health Recovery and Resiliency in
Children and Adolescents
• Erica Gosselin, Riley Rhodes, Kate DeRoche, and Antonio
Olmos, Mental Health Center of Denver
Co-occurring Disorders: Should We Have Different Outcome
Measures?
• Minakshi Tikoo, Department of Mental Health and
Addiction Services
Real Time Evaluation of a Wraparound Program
• Brian Pagkos, University at Buffalo; Heidi Milch, GatewayLongview Inc; Mansoor Kazi, University at Buffalo
Tools for a Mixed Method Approach to Understanding
Trajectories of Youth Movement in Out-of-home Care Settings
• Keren Vergon, Norin Dollard, Ren Chen, and Mary
Armstrong, University of South Florida
684 - Diverse Approaches to Evaluative Inquiry in
Higher Education
Revisiting Alternative Methods for Validating Course
Placement Criteria
• Howard Mzumara, Indiana University Purdue University
Indianapolis
• Chair - Erin Burr, University of Tennessee
• Discussant - Summers Kalishman, University of New
Mexico
Improving Course and Faculty Evaluations With a Multi-method
Approach
• Meghan Kennedy and Jake Walkenhorst, Neumont
University
Collecting Longitudinal Evaluation Data in a College Setting:
Strategies for Managing Mountains of Data
• Jennifer Morrow and Erin Burr, University of Tennessee;
Marcia Cianfrani, Susanne Kaesbauer, and Margot
Ackermann, Old Dominion University
Practice-based Inquiry Models for Evaluation and Assessment
in Community Colleges
• William Rickards, Alverno College
685 - Learning From Evaluation in Service of Social
Justice: Who learns? What is Learned? And Why
Does it Matter?
Panel to be held in the Baltimore
Theater on the Mezzanine Level in the
Radisson
• Chair - Sharon Brisolara, Evaluation Solutions
• Discussant - Saumitra SenGupta, APS Healthcare
Transformative Evaluation in Service of Social Justice
• Donna Mertens, Raychelle Harris, and Heidi Holmes,
Gallaudet University
Contextualizing Social Justice in Evaluation
• Jennifer Greene and Jori Hall, University of Illinois at
Urbana-Champaign
Who is There? Wading Through Labels to Reach Meaning
• Denice Cassaro, Cornell University
From Social Justice to Better Evaluations
• Katrina Bledsoe, The College of New Jersey
Page 116
686 - Measuring Fidelity and Assessing Impact of
Service Interventions in Ohio's Title IV-E Waiver
Evaluation
689 – Evening Reception and Silent Auction
• Chair - Madeleine Kimmich, Human Services Research
Institute
• Discussant - Andrea Sedlak, Westat
Measuring the Fidelity of Protect Ohio Family Team Meetings
• Madeleine Kimmich and Amy Stuczynski, Human Services
Research Institute
Supervised Visitation as a Model Intervention
• Adrienne Zell and Julie Murphy, Human Services Research
Institute
Supporting Kinship Caregivers
• Julie Murphy and Madeleine Kimmich, Human Services
Research Institute
Admission to the Reception and Silent Auction
is included in conference registration. All
attendees are encouraged to attend, to bid on
the many donated items from around the
world, and to build your professional network in
this social setting. Proceeds from the silent
auction go to fund travel awards for evaluators from developing
countries.
Special event to be held in the International Ballroom on the
Notes:
687 - Using Systems Tools to Understand Multi-site
Program Evaluation
Skill-building Workshop to be held in the Chesapeake Room in
the Lower Lobby Level in the Radisson
• Molly Engle, Oregon State University; Andrea Hegedus,
Centers for Disease Control and Prevention
688 - Challenges and Opportunities in Evaluating
Publicly-Funded Programs
Multipaper to be held in the Versailles Room on the Lobby
• Chair - Rakesh Mohan, Idaho State Legislature
The New Federalism and the Paradox of Evaluating State Grant
Programs
• Eileen Poe-Yamagata, IMPAQ International LLC
Creating an Integrated Data System Across Publicly-funded
Agencies in San Francisco
• Deborah Sherwood, San Francisco Department of Public
Health
Evaluation 2007: 4:30 pm to 6:00 pm and 6:30 pm to 8:00 pm
Page 117
Notes:
Evaluation 2007:
Page 118
Saturday, November 10, 2007: Overview of Schedule
7:00 am to 5:00 pm
8:00 am to 9:15 am
Plenary Session
9:35 am to 10:20 am
10:30 am to 12:00 pm
12:10 pm to 1:40 pm
1:50 pm to 3:20 pm
3:30 pm to 5:00 pm
5:15 pm to 6:00 pm
Culminating Plenary
Evaluation 2007: Saturday, November 10, Overview
Page 119
Summary of Sessions for Saturday, November 10, 9:35 AM to 10:20 AM
No Primary Sponsor
Session
Session Title
Room Name
701
702
703
704
705
Expert Lecture
MultiPaper
Panel
Demonstration
Expert Lecture
Teaching About Evaluation: Methods With an Admixture of Epistemology and Ontology
Evaluation in the Context of High Stakes Assessments
What Have We Learned About Evaluation Principles and Practice in International Non-governmental Organizations?
Stakeholder Identification and Assessment in Nonprofit Organizations and Public Agencies
Identifying Critical Processes and Outcomes Across Eval Approaches: Empowerment, Practical Participatory…
Multipaper
Thinking About Systems Thinking
Engaging Communities in Disaster and Emergency Management Planning, Education, and Evaluation
Mencken Room
708
709
710
711
712
Demonstration
Multipaper
MultiPaper
Roundtable
Multipaper
Story Bank: Learning through Story-telling
Approaches to Evaluation in Social work settings
Retention in a Longitudinal Outcomes Study: Exploring Two Sides of the Same Coin, Who Asks and Who Answers
Evaluation and the Institutional Review Board (IRB): A Tale of Two Cities
The Theory Based Models as a Guide to Stakeholder Collaboration, Ownership, and Engagement
Carroll Room
Douglass Boardroom
Hopkins Room
Expert Lecture
Fighting Poverty: What Works? Running Randomized Evaluations of Poverty Programs in Developing Countries
Peale Room
Demonstration
Starting Out Right: How to Begin Evaluating Community Organizing, Advocacy, and Policy Change Efforts…
Adams Room
715
716
717
718
719
720
Roundtable
Multipaper
Demonstration
Multipaper
Demonstration
Panel
Overcoming Mountains and Valleys: Examining the Dynamics of Evaluation With Underserved Populations
Coalitions and Participatory Approaches in Health Partnership Evaluations
Tying it Together: Developing a Web-based Data Collection System for a Multi-site Tobacco Initiative
Contextuality in Needs Assessment: Attention to Divergent Needs
Online Evaluation Systems: One-stop Shops for Administrators, Managers, and Evaluators?
Assessing Strategic Alignment of Learning in Organizations Where Profits Are Not the Bottom Line
Jefferson Room
Washington Room
D'Alesandro Room
Calhoun Room
McKeldon Room
Preston Room
721 Org Learning TIG/PreK-12 Education TIG
Multipaper
Building Local Evaluation Capacity in K-12 Settings
Schaefer Room
Multipaper
Skill-building
Expert Lecture
Methodological Challenges and Solutions for Business and Industry Evaluators
Get Those Data off the Shelf and Into Action: Encouraging Utilization Through Innovative Reporting Strategies
Do Serious Design Flaws Compromise the Objectivity and Credibility of OMB’s PART Evaluation Process?
725
726
727
728
729
Think Tank
Multipaper
Panel
Think Tank
MultiPaper
Linking Smaller Learning Communities to Student Achievement and Related Outcomes Measures
Higher Education Assessment and Evaluation in a Context of Use and Policy Development
Evaluation as an Agent of Program Change: An Example From Austria
Leaving No Stone Unturned: Examining the Evaluation of a Statewide Program at the Local Level
Consumer and Family Member Involvement in Evaluating Federally-Funded Initiatives
Fairmount Suite
Federal Hill Suite
Royal Board Room
Hanover Suite B
Demonstration
Expert Lecture
Panel
Increasing the Value of Items on a Measure: A Practitioner's Guide to Item Response Theory Analysis
Summative Confidence: How Accurate Are Your Evaluative Conclusions?
A Discussion of AEA's Evaluation Policy Initiative
Baltimore Theater
International Room
Versailles Room
Presidential Strand
Non-profit and Foundations Evaluation Eval TIG
Social Work TIG
Program Theory and Theory-driven Eval TIG
Needs Assessment TIG
Integrating Technology Into Evaluation
Org Learning and Evaluation Capacity Bldg TIG
Alcohol, Drug Abuse, and Mental Health TIG
Collaborative, Participatory & Emp Eval TIG
Evaluation 2007: Saturday, November 10, 9:35 am to 10:20 am, Timeslot Overview
Page 120
Saturday, 8:00 am to 9:15 am
700 - Foundational Evaluation Principles and
Processes: Embracing and Engaging Culture
and Context
Ballroom on the Main Lobby Level in
the Sheraton
• Chair - Michael Quinn Patton, Utilization-Focused
Evaluation
Privileged Authority and Sacred Trust: Ethical and Excellence
Imperatives (for Evaluators) in a Globalizing World
• Hazel L Symonette, University of Wisconsin, Madison
Evaluation as Knowledge Vector in Traditional Societies:
Reflections on Roots of Evaluation in Africa
• Sulley Gariba, Institute for Policy Alternatives
Saturday, 9:35 am to 10:20 am
701 - Teaching About Evaluation: Methods With an
Admixture of Epistemology and Ontology
Expert Lecture to be held in the
International Ballroom Section A on
• Sandra Mathison, University of
British Columbia
•
702 - Evaluation in the Context of High Stakes
Assessments
• Chair - M David Miller, University of Florida
Design Alternatives to Measure Effectiveness of Programs With
High Stakes Assessments
• M David Miller, University of Florida
Interpreting High Stakes Test Data: Consequential Evidence
and Multiple Stakeholders
• Jenny Bergeron, University of Florida
703 - What Have We Learned About Evaluation
Principles and Practice in International
Non-governmental Organizations?
• Chair - Michael Scriven, Western Michigan University
• Discussant - Jim Rugh, CARE International
What is out There: Findings From an Empirical Study on
Evaluation Principles and Practice in International NonGovernmental Organizations
• Thomaz Chianca, Western Michigan University
So What: Contextualizing the Relevance of the Study Findings
for the International Non-government Organizations'
Community
• Paul Clements, Western Michigan University
704 - Stakeholder Identification and Assessment in
Nonprofit Organizations and Public Agencies
Demonstration to be held in the Liberty Ballroom, Section A on
• Barbara Wygant, Western Michigan University
705 - Identifying Critical Processes and Outcomes
Across Evaluation Approaches: Empowerment,
Practical Participatory, Transformative, and
Utilization-focused
Expert Lecture to be held in the Liberty Ballroom, Section B on
• Chair - Tanner LeBaron Wallace, University of California,
Los Angeles
• Discussants - J Bradley Cousins, University of Ottawa;
David Fetterman, Stanford University; Donna Mertens,
Gallaudet University; Michael Quinn Patton, UtilizationFocused Evaluation
• Presenter - Marvin Alkin, University of California, Los
Angeles
706 - Thinking About Systems Thinking
• Chair - Derek A Cabrera, Cornell University
Getting Beyond Industrial Age Thinking in Evaluation: A Critical
Look at System Archetypes
• Natasha Jankowski, Western Michigan
• UniversityUnpacking the Logic Model: Systems Thinking
in Practice
• A Cassandra Golding, University of Rhode Island
Evaluation 2007: Saturday, November 10, 8:00 to 9:15 am and 9:35 am to 10:20 am
Page 121
Saturday, 9:35 am to 10:20 am, Continued
707 - Engaging Communities in Disaster and
Emergency Management Planning, Education, and
Evaluation
• Chair - Liesel Ritchie, Western Michigan University
Museum Exhibits and Educational Programming for Natural
Disaster Preparation: Evaluation of a Site-based System
• Wendy Dickinso and Bruce Hall, University of South
Florida; Dave Conley, Museum of Science & Industry
An Evaluation of Tsunami Awareness and Preparedness in Six
United States Coastal Communities — Yes, United States
Communities
• Liesel Ritchie, Western Michigan University; Duane Gill,
Mississippi State University; Stephen Meinhold, University of
North Carolina, Wilmington; Jennifer Horan, University of
North Carolina
708 - Story Bank: Learning through Story-telling
Demonstration to be held in the Carroll Room on the Main
• Cassie Bryant and Diane Monaghan, Cassandra Drennon
& Associates
709 - Approaches to Evaluation in Social Work
Settings
• Chair - Sarita Davis, Clark Atlanta University
Looking for Strengths: The Irony of Internal Auditing of Social
Work Services as a Strengths-based Evaluation Method
• William Cabin, Youth Consultation Service
Applications of Complexity to Social Program Evaluation
• Michael Wolf-Branigin, George Mason University
Understanding the Nature of Work: New York State Child
Welfare Workload Study
• Paul Frankel, American Humane Association; Elizabeth
Oppenheim, Walter R McDonald & Associates Inc
710 - Retention in a Longitudinal Outcomes Study:
Exploring Two Sides of the Same Coin, Who Asks and
Who Answers
MultiPaper to be held in the Pratt Room, Section B on the
• Chair - Stacy Johnson, Macro International Inc
• Discussant - Christine Walrath, Macro International Inc
710 – Continued
Retention in a Longitudinal Outcomes Study: Impact of
Staffing Structure, Agency Policies and Staff Characteristics on
Participants
• Stacy Johnson and Connie Maples, Macro International
Inc
Retention in a Longitudinal Outcomes Study: An Exploration of
the Effects of Respondent Characteristics, Roles and
Consistency
• Tisha Tucker and Laura Whalen, Macro International Inc
711 - Evaluation and the Institutional Review Board
(IRB): A Tale of Two Cities
• Oliver Massey, University of South Florida
712 - The Theory Based Models as a Guide to
Stakeholder Collaboration, Ownership, and
Engagement
• Chair - Dustin Duncan, Harvard University
Using a Program Theory Model to Clarify the Collaboration,
Guide the Program,and Direct an Outcomes-based Evaluation
• Kathryn Race, Race and Associates Ltd
The Evaluation of Complex Theory Based, Professional
Development Programs With “Show Me the Numbers”
Expectations
• Maryann Durland, Durland Consulting
713 - Fighting Poverty: What Works? Running
Randomized Evaluations of Poverty Programs in
Developing Countries
• Rachel Glennerster, Massachusetts Institute of
Technology
714 - Starting Out Right: How to Begin Evaluating
Community Organizing, Advocacy, and Policy Change
Efforts Using a Prospective Approach
• Justin Louie and Catherine Crystal Foster, Blueprint
Research & Design Inc
Evaluation 2007: Saturday, November 10, 9:35 am to 10:20 am
Page 122
715 - Overcoming Mountains and Valleys: Examining
the Dynamics of Evaluation With Underserved
Populations
• Sylvette La Touche, Amy Billing and Nancy Atkinson,
University of Maryland, College Park; Jing Tian and Robert
Gold, University of Maryland
716 - Coalitions and Participatory Approaches in
Health Partnership Evaluations
718 – Continued
Using a Multi-phase Assessment Process to Influence Program
Selection and Evaluation Development
• Caren Bacon and Shannon Stokes, University of Missouri,
Columbia
719 - Online Evaluation Systems: One-stop Shops for
Administrators, Managers, and Evaluators?
• Susanna Kung and Paul Bucci, Academy for Educational
Development
• Chair - Kathryn Bowen, BECS Inc
"More Juice for the Squeeze": Developing Evaluation
Indicators and Reference Materials for State Asthma Control
Partnerships
• Leslie Fierro, Centers for Disease Control and Prevention;
Carlyn Orians, Shyanika Wijesinha Rose, and Linda Winges
Battelle Centers for Public Health Research and Evaluation
Improving the Evaluation of Federally Funded Interventions
Requiring the Use of Government Performance Results Act
(GPRA) Instruments: A Participatory Approach
• Justeen Hyde and Eileen Dryden, Institute for Community
Health; Ayala Livny, Cambridge Cares About AIDS; Karen
Hacker, Institute for Community Health; Monique Tula,
Cambridge Cares About AIDS
720 - Assessing Strategic Alignment of Learning in
Organizations Where Profits Are Not the Bottom Line
717 - Tying it Together: Developing a Web-based
Data Collection System for a Multi-site Tobacco
Initiative
Building TIG and the Pre-K - 12 Educational Evaluation TIG
• Chair - Katherine Ryan, University of Illinois at UrbanaChampaign
• Discussant - Rita O'Sullivan, University of North Carolina,
Chapel Hill
The Need for Evaluation Capacity Building in After-school
Programs: Results From the Michigan Evaluation of 21st
Century Community Learning Centers
• Laurie Van Egeren, Beth Prince, Megan Platte, Celeste
Sturdevant Reed, and Laura Bates, Michigan State
University
Making Some Headway: An Internal Evaluation Branch's
Efforts to Build Evaluation Capacity in an Urban School District
• Eric Barela, Los Angeles Unified School District
• Stephanie Herbers and Nancy Mueller, Saint Louis
University
718 - Contextuality in Needs Assessment: Attention
to Divergent Needs
• Chair - Jeffry L White, Ashland University
• Discussant - Deborah H Kwon, The Ohio State University
Barriers to Continuous Needs Assessment:Client Fatigue,
Governmental Changes in Program Emphases
• Zoe Barley, Mid-continent Research for Education and
Learning
Building TIG
• Chair - Marlaine Lockheed, Independent Consultant
The Challenges of Assessing the Alignment of Knowledge and
Learning with Strategic Priorities
• Dawn Roberts, Independent Consultant
Assessing the Triangular Relation between Business Needs,
Learning Opportunities, Learning Consumption
• Violaine Le Rouzic, World Bank; Marlaine Lockheed,
Independent Consultant; Maurya West Meiers, World Bank
721 - Building Local Evaluation Capacity in K-12
Settings
Page 123
722 - Methodological Challenges and Solutions for
Business and Industry Evaluators
• Chair - Judith Steed, Center for Creative Leadership
Technology Drives Restructuring of Measurement Teams in
Learning Organizations: Doing More With Less in the
Professional Services Industry
• John Mattox, KPMG; Darryl Jinkerson, Abilene Christian
University; Carl Hanssen, Hanssen Consulting LLC
The Challenge of Responders/Non-responders in Evaluative
Data Collection
• Judith Steed, Emily Hoole, Tracy Patterson, and Bill
Gentry, Center for Creative Leadership
723 - Get Those Data off the Shelf and Into Action:
Encouraging Utilization Through Innovative Reporting
Strategies
Skill-building Workshop to be held in the Calvert Ballroom
Salon C on the Ballroom Level in the Radisson
• Mindy Hightower King, Courtney Brown, and Marcey
Moss, Indiana University
724 - Do Serious Design Flaws Compromise the
Objectivity and Credibility of the Office of
Management and Budget's Program Assessment
Rating Tool (PART) Evaluation Process?
Expert Lecture to be held in the Calvert Ballroom Salon E on the
• Eric Bothwell, Independent Consultant
725 - Linking Smaller Learning Communities to
Student Achievement and Related Outcomes
Measures
in the Radisson
• Discussant - Linda Bol, Old Dominion University
John Nunnery, Old Dominion University
Alexander Koutsares, Old Dominion University
• Shana Pribesh, Old Dominion University
726 - Higher Education Assessment and Evaluation
in a Context of Use and Policy Development
• Chair - William Rickards, Alverno College
• Discussant - Molly Engle, Oregon State University
Evaluation Use in the Unique Context of Higher Education
• Georgetta Myhlhousen-Leak, University of Iowa
Strengthening Evaluation in Higher Education: Quality
Assurance and the New Zealand Tertiary Education Reforms
• Syd King, New Zealand Qualifications Authority
727 - Evaluation as an Agent of Program Change: An
Example From Austria
the Radisson
• Chair - Klaus Zinoecker, Vienna Science and Technology
Fund
The Evaluation of Genome Research Austria (GEN-AU):
Overview of the Study's Aims, Structure, Methods, Results,
Implications, and Impacts
• Klaus Zinoecker, Vienna Science and Technology Fund;
Alfred Radauer, Austrian Institute for SME Research; Brigitte
Tempelmaier, Austrian Economic Service; Iris Fischl and
Roald Steiner, Austrian Institute for SME Research; Rosalie
Ruegg, TIA Consulting Inc
Developing a Plan for Future Monitoring and Impact Analysis of
Genome research Austria (GEN-AU)
• Rosalie Ruegg, TIA Consulting Inc
728 - Leaving No Stone Unturned: Examining the
Evaluation of a Statewide Program at the Local Level
Think Tank to be held in the Royal Conference Foyer on the
• Discussants - Laura Feldman, Tiffany Comer Cook, and
Shannon Williams, University of Wyoming
• Presenter - Laura Feldman, University of Wyoming
Did you know? Forty-one percent of AEA’s
members conduct at least part of their work in
health or public health contexts.
Page 124
•
Notes:
729 - Consumer and Family Member Involvement in
Evaluating Federally-Funded Initiatives
MultiPaper to be held in the Hanover Suite B on the Mezzanine
Evaluation TIG
• Chair - Cindy Crusto, Yale University
Facilitating Family Member Involvement in the Evaluation of a
Children's Mental Health Initiative
• Cindy Crusto, Yale University
Comparison of a Consumer Led and an Evaluator Led Needs
Assessments
• Joy Kaufman, Yale University
730 - Increasing the Value of Items on a Measure: A
Practitioner's Guide to Item Response Theory
Analysis
• Heather Chapman and Catherine Callow-Heusser,
EndVision Research and Evaluation
731 - Summative Confidence: How Accurate Are Your
Evaluative Conclusions?
Expert Lecture to be held in the International Room across from
• Chair - Brooks Applegate, Western Michigan University
• Presenter - Cristian Gugiu, Western Michigan University
733 - A Discussion of AEA's Evaluation Policy
Initiative
the Radisson
• William Trochim, Cornell University
• Hallie Preskill, Claremont Graduate University
• George Grob, Center for Public Program Evaluation
Page 125
Summary of Sessions for Saturday, November 10, 10:30 AM to 12:00 PM
No Primary Sponsor
Session
Session Title
Room Name
Skill-building
Get Engaged! Using Adult Learning Principles to Enhance Evaluation Learning
MultiPaper
Learning From the Consequences of No Child Left Behind on Evaluation (Part 1 of 2)
Panel
Lessons for Methodology and Fieldwork in Intl Development Evaluations: The Heifer International Impact Eval…
Panel
Findings From the Cross-site Evaluation of the Safe Schools, Healthy Students Initiative
Think Tank
Can These Checklists Work? Simplifying Cost and Sustainability Evaluations
MultiPaper
Exploring Evaluation Expectations for Nonprofits, Foundations and Government: A Preview of an Upcoming NDE…
Multipaper
Practical Arguments, Checklists, and Meta-Evaluation: Tools for Improving Evaluation Theory and Practice
Think Tank
Unintended Consequences of Program Action: When Are They Problematic for Evaluation, and What Can We Do…
Mencken Room
742 Disaster and Emergency Management Eval TIG Think Tank
Raising the Bar: What Role for Accreditation and Certification in Improving the Quality and Accountability…
Multipaper
Navigating Subjectivity in the Evaluation Process
Carroll Room
Panel
Evaluating Customer Satisfaction: How Public and Private Sector Organizations and Web-managers Learn…
Skill-building
Using a Protective Factor Framework to Measure Program Outcomes and Build Capacity in Community-based…
Roundtable
Rotation I: Using Indigenous Guidelines to Analyze Native Hawaiian Community-based Initiatives…
Rotation II: How Tribal Colleges Help Struggling Students Online
Douglass Boardroom
Panel
Participatory Evaluation Approaches With Latino and Indigenous Populations
Hopkins Room
Panel
Incorporating Development Evaluation Strategies in Education Reform Projects: Opportunities and Challenges
Peale Room
Panel
Evaluating Electronic Advocacy and Communications
Adams Room
Roundtable
Rotation I: Cal-PASS: Data-driven Faculty Decision Making to Improve Transitions Across Segments
Jefferson Room
Rotation II: Evaluating the Retention of First Generation Students in a Community College: A Collaborative Approach
Panel
Constraints and Promising Practices in Evaluating Social Norm Change: Lessons Learned From Tobacco Control
Washington Room
Multipaper
Evaluation Approaches that Support Nonprofit and Foundation Learning
D'Alesandro Room
Panel
Concept Maps, Focus Groups and Rasch Analysis: Converting the Ineffable Qualitative into Quantitative
Calhoun Room
754 Integrating Technology Into Evaluation TIG
Demonstration
Workgroup Solutions for Data Collection, Storage, Analysis, and Reporting With FileMaker Pro 8.5, Adobe Acrobat… McKeldon Room
755 Org Learning and Evaluation Capacity Bldg TIG MultiPaper
Strategic Approach to Developing Sustainable Infrastructure for Program Evaluation in an Organization…
Preston Room
756 Org Learning and Evaluation Capacity Bldg TIG Demonstration
Applying a Participatory Approach to Evaluation Capacity Building
Schaefer Room
Multipaper
Multipaper
Case Studies in Business and Industry Evaluation
Frameworks of Evaluation Use and Empirical Assessments
Panel
Informing Government Policy Through Evaluation
MultiPaper
Documenting Math Science Partnership Projects in New York State
Fairmount Suite
Multipaper
Technology Programs in Higher Education: Considering Digital Horizons
Federal Hill Suite
A Roadmap for Developing a Public Health Research Portfolio Evaluation Program
Royal Board Room
Multipaper
Theory to Practice: Strategic Considerations
Panel
Using Appreciative Inquiry in Evaluation: Exploring Impact and Lessons From the Field
Hanover Suite B
Multipaper
Issues in Measuring Reliability and Retention
International Room
Multipaper
Evaluating Technology Adaptations in Higher Education
Chesapeake Room
Panel
Learning Within the Arts and Through the Process of Arts Evaluation
Versailles Room
Saturday, 10:30 am to 12:00 pm
734 - Get Engaged! Using Adult Learning Principles
to Enhance Evaluation Learning
Skill-building Workshop to be held in
the International Ballroom Section A on
• Ellen Taylor-Powell and Christine
Kniep, University of Wisconsin
•
735 - Learning From the Consequences of No Child
Left Behind on Evaluation (Part 1 of 2)
• Chair - Rebecca Eddy, Claremont Graduate University
An Overview of No Child Left Behind
• Jack Mills, Claremont Unified School District
Consequences of No Child Left Behind from a Local After
School Evaluator
• Maura Harrington and Blanca Flor Guillen-Woods,
Lodestar Management/Research Inc
No Child Left Behind and Evaluative Thinking From a Local
School Perspective
• Meta Nelson, Bassett Unified School District; Rebecca
Eddy, Claremont Graduate University
Using Evaluation Data to Strike a Balance Between
Stakeholders and Accountability Systems: Consequences of
No Child Left Behind From a District Evaluator
• Maria Elise Defino Whitsett and Lisa Schmitt, Austin
Independent School District
736 - Lessons for Methodology and Fieldwork in
International Development Evaluations: The Heifer
International Impact Evaluations in Africa, Asia, and
the Americas
Setting the Stage: The Heifer Hoofprint Evaluation Model
• Thomaz Chianca, Western Michigan University
The Client's Learning: How the Impact Evaluations have
Affected the Agency
• Rienzzie Kern, Heifer International
Learning for Methodology and Fieldwork from the Perspective
of the External Evaluation Team
• Michael Scriven, Western Michigan University
737 - Findings From the Cross-site Evaluation of the
Safe Schools, Healthy Students Initiative
• Chair - James Trudeau, RTI International
Overview of the Safe Schools/Healthy Schools (SS/HS)
Initiative and Cross-site Evaluation
• James Trudeau, RTI International
Safe Schools, Healthy Students Partnerships, Programs, and
Policies
• Phillip Graham, RTI International
School Violence and Safety in the Safe Schools/Healthy
Students Initiative
• Angela Browne and James Trudeau, RTI International
School and Classroom Climate in the Safe Schools/Healthy
Students Initiative
• Steve Murray, RMC Research Corporation; Jason
Williams, RTI International
Student Substance Use in the Safe Schools/Healthy Students
Initiative
• James Trudeau and Jason Williams, RTI International
738 - Can These Checklists Work? Simplifying Cost
and Sustainability Evaluations
Think Tank to be held in the International Ballroom Section E
• Discussants - Nadini Persaud and Daniela C Schroeter,
Western Michigan University
• Presenter - Lori Wingate, Western Michigan University
Did you know? Thirty-seven percent of AEA’s
members conduct at least part of their work in
K-12 education contexts.
Evaluation 2007: Saturday, November 10, 10:30 am to 12:00 pm
Page 127
Saturday, 10:30 am to 12:00 pm, Continued
739 - Exploring Evaluation Expectations for Nonprofits, Foundations and Government: A Preview of
an Upcoming New Directions for Evaluation Volume
MultiPaper to be held in the Liberty Ballroom, Section A on the
• Chair - Joanne Carman, University of North Carolina,
Charlotte
• Discussant - Kimberly Fredericks, Indiana State University
Nonprofits and Evaluation: Empirical Evidence From the Field
• Joanne Carman, University of North Carolina, Charlotte;
Kimberly Fredericks, Indiana State University
Nonprofits and Evaluation: Managing Expectations From the
Leader's Perspective
• Sal Alaimo, Indiana University
Foundations' Expectations (and Capacity) to Support,
Conduct, and Use Evaluations
• Thomas Kelly, Annie E Casey Foundation
Evaluation and the Federal Government
• David Introcaso, United States Department of Health and
Human Services
United Way Experiences in Measuring Program Outcomes and
Community Impact
• Michael Hendricks, Independent Consultant; Margaret
Plantz, United Way of America
740 - Practical Arguments, Checklists, and MetaEvaluation: Tools for Improving Evaluation Theory and
Practice
• Chair - Bernadette Campbell, Carleton University
The Relation Between the Application of the Process Specific
to Program Evaluation and the Quality of Judgments and
Recommendations
• Marthe Hurteau, Université du Québec à Montréal
Stéphanie Mongiat, Université du Québec à Montréal
Sylvain Houle, Université du Québec à Montréal
The Logic of Practical Arguments in Evaluation
• Nick L Smith, Syracuse University
An Evaluation Checklist: Educative and Meta-evaluation
Opportunities
• Jennifer Greene, University of Illinois at UrbanaChampaign; Lois-ellin Datta, Datta Analysis; Jori Hall,
Jeremiah Johnson, Rita Davis, and Lizanne DeStefano,
Using the Metaevaluation Synthesis to Improve the Quality of
State-level Evaluations
• Paul Gale, San Bernardino County Superintendent of
Schools
741 - Unintended Consequences of Program Action:
When Are They Problematic for Evaluation, and What
Can We Do About Them?
Think Tank to be held in the Mencken Room on the Main Lobby
• Discussants - Glenda Eoyang, Human Systems Dynamics
Institute; Deborah Wasserman, The Ohio State University
• Presenter - Jonathan Morell, NewVectors LLC
742 - Raising the Bar: What Role for Accreditation
and Certification in Improving the Quality and
Accountability (Q&A) of International Nongovernment Organization (INGO) Humanitarian
Work?
Think Tank to be held in the Edgar Allen Poe Room on the Main
• Discussants - Jock Baker, CARE International; Daryl
Martyris, Save the Children USA; Malaika Wright, CARE
International
• Presenters - Guy Sharrock, Catholic Relief Services;
Pauline Wilson, CARE USA
743 - Navigating Subjectivity in the Evaluation
Process
• Chair - Jennifer Jewiss, University of Vermont
• Discussant - Jennifer Jewiss, University of Vermont
What do you Mean When I say…: A Serendipitous Lesson in
Evaluation Design
• Dan Kaczynski, University of West Florida; Leigh Wood,
Macquarie University
Using Qualitative Methods to Negotiate Racial Identity and
Insider/Outsider Status With Stakeholders and Participants
• Corrie Davis, Sheryl Gowen, and Syreeta Skelton, Georgia
State University
Do You See What I See? Do You Hear What I Hear?:
Researcher's Role and Subjectivity in Fieldwork Evaluation
Experiences, a Student Researcher's Perspective
• Quiana Cutts, Janice Fournillier, and Sheryl Gowen,
Georgia State University
Page 128
744 - Evaluating Customer Satisfaction: How Public
and Private Sector Organizations and Web-managers
Learn and Drive their Behavior From the American
Customer Satisfaction Index (ACSI)
• Chair - Ted Kniker, Federal Consulting Group
The American Customer Satisfaction Index: It's History and
Findings
• David VanAmburg, University of Michigan
Customer Satisfaction Measurement and Financial Outcomes:
Use of the American Customer Satisfaction Index in the Private
Sector
• Sheri Teodoru, Claes Fornell International Group
Citizen Satisfaction: How the Federal Government is Using the
American Customer Satisfaction Index (ASCI) to Create a
Citizen-Centered, Results Oriented Government
• Susan Grow, Federal Consulting Group
Beyond Page Views and Hits: Evaluating User Satisfaction With
Websites
• Errol Hau, ForeSee Results Inc
745 - Using a Protective Factor Framework to
Measure Program Outcomes and Build Capacity in
Community-based Family Support and Prevention
Programs
• Hallie Goertz, Organizational Research Services; Maria J
Gehl, Children's Trust of Washington
746 - Roundtables
Rotation I: Using Indigenous Guidelines to Analyze Native
Hawaiian Community-based Initiatives: How Does This Work?
• Alice Kawakami, University of Hawaii
Rotation II: How Tribal Colleges Help Struggling Students
Online
• Paule Steichen Asch, Individual Building of Integrated
Success International
747 - Participatory Evaluation Approaches With
Latino and Indigenous Populations
• Chair - David Dobrowski, First 5 Monterey County
• Discussant - Edward Kissam, JBS International Inc
Inclusion of Indigenous Community Members in County-wide
Participatory Strategic Planning Process
• David Dobrowski, First 5 Monterey County
Participatory Evaluation Techniques Training Indigenous
Community Members to Facilitate Focus Groups: Process, Key
Findings, and Lessons Learned
• James Glasnapp and Amparo Bustos-Navarro, JBS
International Inc
The Use of Photovoice as a Participatory Evaluation Method in
Diverse Communities
• Maricela Piña, Harder & Company Community Research
748 - Incorporating Development Evaluation
Strategies in Education Reform Projects:
Opportunities and Challenges
• Chair - John Gillies, Academy for Educational
Development
The Role of Monitoring and Evaluating (M&E) in a Framework
for Education Reform
• John Gillies and Audrey-Marie Moore, Academy for
Empowerment Through Self Assessment Evaluation in Namibia
• Donna Kay Lezcel, Academy for Educational Development
Supporting System Reforms in Georgia
• Jessica Jester Quijada, Academy for Educational
Development
Education Reform in Egypt: The Role of M&E
• Robert Burch, Academy for Educational Development
749 - Evaluating Electronic Advocacy and
Communications
Panel to be held in the Adams Room on the Cabana Level in
the Sheraton North Tower
• Chair - Julia Coffman, Harvard Family Research Project
Gauging Nonprofit Online Effectiveness
• Tarek Rizk, Global Interdependence Initiative
But What do the Numbers Mean? Benchmarks for E-Advocacy
and Fundraising
• Karen Matheson, M+R Strategic Services
Tracking Blogs to Gauge Buzz
• Julia Coffman, Harvard Family Research Project
Page 129
750 - Roundtables
Rotation I: California Partnership for Achieving Student
Success (Cal-PASS): Data-driven Faculty Decision Making to
Improve Transitions Across Segments
• Jordan Horowitz, California Partnership for Achieving
Student Success
Rotation II: Evaluating the Retention of First Generation
Students in a Community College: A Collaborative Approach
• Liliana Rodriguez-Campos, University of South Florida;
John Hoye and Maxine Gilling, Western Michigan University
751 - Constraints and Promising Practices in
Evaluating Social Norm Change: Lessons Learned
From Tobacco Control
• Chair - Jenica Huddleston, University of California, Davis
• Discussant - Robert LaChausse, California State
University, San Bernardino
California's Approach to Evaluating Social Norm Change in
Tobacco Control
• Leslie Cooksy, Jenica Huddleston, Julie Elmen, Jean
Lamming, Jeanette Treiber, and Maria Tuccori, University of
California, Davis
Evaluating Social Norm Change at the Local Level: Sacramento
County's Tobacco Control Work
• Jenica Huddleston, University of California, Davis; Carlene
Henriques, Kristina Clinton, and Megan Trautman,
Sacramento County Dept of Health Services
Social Climate Analysis as a Tool to Measure and Monitor the
Social Penetration of Tobacco Control
• Robert McMillen and Nell Valentine, Mississippi State
University
752 - Evaluation Approaches that Support Nonprofit
and Foundation Learning
"Don't Test Me, Let Me Play!" Evaluation Alternatives to the
Standard Pre- Post-test for Latina/o Adolescents
• Lyn Paleo, Evaluation Research and Training; Gina Malan,
Central American Resources Center
752 – Continued
Using Outcome Measurement for Organizational Learning:
From Rhetoric to Reality
• Sandra Ortega, Kent State University; James W Altschuld,
The Ohio State University
753 - Concept Maps, Focus Groups and Rasch
Analysis: Converting the Ineffable Qualitative into
Quantitative
• Chair - Ann Doucette, George Washington University
Concept Map of Elder Financial Exploitation
• John Ridings, Metropolitan Family Services of Chicago
Using Qualitative Data in the Design of a Measure for Financial
Exploitation of the Elderly
• Madelyn Iris, Council for Jewish Elderly
Developing Theoretical Construct Maps and Testing Them with
Rasch Person/Item Maps
• Kendon Conrad, University of Illinois, Chicago
754 - Workgroup Solutions for Data Collection,
Storage, Analysis, and Reporting With FileMaker Pro
8.5, Adobe Acrobat 8, and Microsoft Excel
• Susan Saka and Susan York, University of Hawaii; Milton
Shak, 1:1 Inc
755 - Strategic Approach to Developing Sustainable
Infrastructure for Program Evaluation in an
Organization: Multiple Perspectives
MultiPaper to be held in the Preston Room on the Cabana
Building TIG
• Chair - Bret Feranchak, Chicago Public Schools
The Internal Management Perspective
• Bret Feranchak, Chicago Public Schools
The Internal Evaluator Perspective
• Kelci Price, Chicago Public Schools
The External Evaluator Perspective
• Stacy Wenzel, University of Illinois, Chicago
The Graduate Student Intern Perspective
• Natalya Gnedko, Chicago Public Schools
Page 130
756 - Applying a Participatory Approach to
Demonstration to be held in the Schaefer Room on the Cabana
Building TIG
• Ehren Reed, Innovation Network Inc
757 - Case Studies in Business and Industry
Evaluation
• Chair - Otto Gustafson, Western Michigan University
The Blind Men and the Elephant: Making Sense of Knowledge
Management
• Thomas E Ward, United States Army Command and
General Staff College
Evaluating the Strategic Collaboration Model: Towards the
Assessment of Mentoring–centered Succession Management
Programs
• Ray Haynes and Rajashi Ghosh, University of Louisville
Integrating Evaluation into 360-degree Feedback: Enhancing
Executive Development Training and Program Impact
• Zita Unger, Evaluation Solutions
Putting Product Evaluation Theory into Practice: Lessons From
Two Case Studies on Efficacy of Products Designed for Persons
With Disabilities
• Vathsala Stone, University at Buffalo; Douglas Usiak,
Western New York Independent Living Project Inc; Sajay
Arthanat, University at Buffalo; Michelle Lockett, Western
New York Independent Living Project Inc
758 - Frameworks of Evaluation Use and Empirical
Assessments
Multipaper to be held in the Calvert Ballroom Salon C on the
• Chair - Edward McLain, University of Alaska, Anchorage
Investing Stakeholders in the Process of Generating a Contentspecific Evaluation
• Susan Marshall, Joel Nadler, Nicholas Hoffman, and Jack
McKillip, Southern Illinois University, Carbondale
An Evaluation Use Framework and Empirical Assessment
• Laura Peck and Lindsey Gorzalski, Arizona State
University
758 – Continued
The Continuous Quality Improvement (CQI) Benchmarking
Initiative: Using Performance Measurement and Benchmarking
to Support Organizational Learning
• Brigitte Manteuffel, Macro International Inc; Sylvia Fisher
and Gary Blau, United States Department of Health and
Human Services
Does Performance Measurement Facilitate Learning?
• Leanne Kallemeyn, University of Illinois at UrbanaChampaign
759 - Informing Government Policy Through
Evaluation
• Chair - Teserach Ketema, United States Department of
Labor
Evaluation of Research Demonstration Programs: Customized
Employment
• Richard Horne, United States Department of Labor
Measuring Changes to the Workforce Development System: A
Qualitative Approach
• Martha Palan, Westat
Measuring Employment Outcomes: A Qualitative Approach
• Lynn Elinson and William Frey, Westat
Lessons Learned
• Richard Horne, United States Department of Labor
760 - Documenting Math Science Partnership
Projects in New York State
MultiPaper to be held in the Fairmount Suite on the 19th Floor
in the Radisson
• Chair - Dianna Newman, University at Albany
The Role of Professional Development: How to Document it
and What Works
• Mary J Pattison and Dianna Newman, University at Albany
Multiple Avenues to Documenting Student Achievement:
Results From Two Large Scale Math Science Partnership
Grants
• Leigh Mountain, University at Albany
High Quality Local Evaluation of Federal Projects: At Long Last,
Necessary!
• Kathleen Toms, Research Works Inc
Promoting High Quality Evaluation of Math Science
Partnership (MSP) Projects
• Amy Germuth, Compass Consulting Group
Page 131
761 - Technology Programs in Higher Education:
Considering Digital Horizons
• Chair - Shaila Khan, Tougaloo College
• Discussant - Linda Thurston, Kansas State University
Online Programme of Excellence Model
• Luis Villar, University of Seville; Olga Alegre, University of
La Laguna
Online and Flexible: The Changing Nature of Course Evaluation
in Australian Universities
• Christina Ballantyne, Murdoch University
Aligning Evaluation of Instructional Technology Programs to
the Innovation Cycle: The Case of the Duke Digital Initiative
• Yvonne Belanger, Duke University
762 - A Roadmap for Developing a Public Health
Research Portfolio Evaluation Program
the Radisson
• Chair - Robin Wagner, Centers for Disease Control and
Prevention
Overview of Methodology Used to Develop a Research
Evaluation Program
• Jerald O'Hara, John Araujo, Mona Choi, Catherine
Pepper, Robin Wagner, Guijing Wang, and Trevor Woollery,
MEDLINE Search Strategies vs. Relevant Retrieval: How Closely
do They Match for a Research Evaluation Topic?
• Catherine Pepper, John Araujo, Mona Choi, Jerald
O'Hara, Robin Wagner, Guijing Wang, and Trevor Woollery,
Evaluating Public Research Investment: A Literature Review
• Guijing Wang, John Araujo, Mona Choi, Jerald O'Hara,
Catherine Pepper, Robin Wagner, and Trevor Woollery,
Extending the Pay-Back Model to Incorporate Costs as Well as
Benefits to Measure the Net Impacts of Organizational
Expenditures on Public Health Research
• Trevor Woollery, John Araujo, Mona Choi, Jerald O'Hara,
Catherine Pepper, Robin Wagner, and Guijing Wang, Centers
for Disease Control and Prevention
A Bibliometric Methodology to Inform a Logic Model for
Evaluating a Public Health Research Portfolio
John Araujo, Mona Choi, Catherine Pepper, Jerald O'Hara,
Robin Wagner, Guijing Wang, and Trevor Woollery, Centers for
Disease Control and Prevention
763 - Theory to Practice: Strategic Considerations
• Chair - Robert Hanson, Health Canada
Using Evaluation Findings to Enhance Learning: From Theory to
Practice
• Paul Stiles, Catherine Batsche, Amber Gum, and Roger
Boothroyd, University of South Florida
Challenges for Evaluating Model Programs to Reduce Alcohol
Related Problems Among Youth: Communities Mobilizing for
Change on Alcohol
• Linda Bosma, Bosma Consulting LLC
The Relationship Between Large Scale Student Surveys and
Program Evaluation: Risks and Rewards
• Gregory Rainone, New York State Office of Alcoholism and
Substance Abuse Services; Michael Maranda, Independent
Consultant
The Non-use of a Longer-term Follow-up Evaluation in Drug
and Alcohol Treatment Programs
• Sharon Ross, Founder's Trust
764 - Using Appreciative Inquiry in Evaluation:
Exploring Impact and Lessons From the Field
in the Radisson
Evaluation TIG
• Discussant - Tessie Catsambas, EnCompass LLC
A Comparison of Appreciative Inquiry and Nominal Group
Techniques in the Evaluation of a College Counseling Center
• Liz McGough, University at Buffalo;
Applying Appreciative Inquiry to Focus Groups in a Postconflict Context
• Patty Hill, EnCompass LLC
Using Appreciative Inquiry to Develop an Evaluation System for
an Anti-trafficking Project in Albania
• Mary Gutmann, EnCompass LLC
Did you know? Thirty-nine percent of AEA’s
members plan or contract for evaluations that
other conduct.
Page 132
766 - Issues in Measuring Reliability and Retention
• Chair - Brian Dates, Southwest Counseling Solutions
Factors Affecting the Behavior of Interrater Reliability Statistics
• Brian Dates, Southwest Counseling Solutions; Jason
King, Baylor College of Medicine
A General Method for Estimating the Reliability of High-stakes
Educational Decisions
• Karen Douglas, International Reading Association
Surveying Nonresponders: Implications for Surveying Methods
• Jacey Payne, Howard Research & Management
Consulting Inc; Teresa Roeske, Howard Research &
Management Consulting Inc
Calculating Retention With Caution: A Look at How Much
Measurement Matters
• Mary Kay Falconer, Ounce of Prevention Fund of Florida
767 - Evaluating Technology Adaptations in Higher
Education
768 - Learning Within the Arts and Through the
Process of Arts Evaluation
the Radisson
• Chair - Kathlyn Steedly, The Academy for Educational
Development
A Model and Instrumentation for Evaluating Arts Programs
• Rob Horowitz, Teachers College, Columbia University
Applying the Horowitz Model to Evaluating Arts Integration in
Public Elementary Schools
• Melanie Hwalek, Social Program Evaluators and
Consultants Inc
Application of Cognitive, Social and Personal Dimensions of
Learning to Mixed-Method and Quasi-Experimental Designs in
Arts Evaluations
• Dan Serig, Massachusetts College of Art; Rob Horowitz,
Teachers College, Columbia University
Notes:
• Chair - Marcie Bober, San Diego State University
Formative Computer-based Assessment in Higher Education:
Evaluation of an E-learning Instrument
• Tess Miller, Queen's University
Course Transformation: A Descriptive Evaluation of the
Experiences of 1000 Freshman Enrolled in a Blended
Introductory Psychology Course
• Marcie Bober, San Diego State University
Surfing the Tidal Wave of Information on the Web: A
Collaborative Evaluation of the Use of the Internet in Graduate
Level Classrooms
• Michelle Bakerson, Western Michigan University
Page 133
Summary of Sessions for Saturday, November 10, 12:10 PM to 1:40 PM
No Primary Sponsor
Session
Session Title
Room Name
769 Presidential Strand/Org Learning TIG
Think Tank
Evaluation Capacity Building Within a Self-organizing Systems Framework
MultiPaper
771 International and Cross-cultural TIG
Panel
Building Communities in the Context of Transitional Countries: Challenges and Approaches for Program Evaluation
Think Tank
Sustaining and Supporting AEA Affiliates: Strategies for Success
Panel
Successfully Publishing Your Dissertation
Demonstration
Community of Learners in Evaluation: The Triple Threat
Panel
What is or Should be the Value-added of an Evaluator?
Skill-building
Practicing Systemic Methods for Evaluation of Food Systems
Mencken Room
Multipaper
Multiple Methods, Multiple Perspectives
Multipaper
Qualitative Analyses of Education Reform Efforts
Carroll Room
Panel
Expert Eval of Federal Agencies' Program Portfolios in the Program Assessment Rating Tool (PART) Environment
Multipaper
Connecting Evaluation Theory and Practice via Experiential Learning
Roundtable
Rotation I: Eval of an In-class Versus an Online Alcohol Diversion Program to Reduce Alcohol Consumption…
Rotation II: Pearls and Pitfalls in Evaluating Student Assistance Programs: A Seven-Year Longitudinal Study
Douglass Boardroom
Panel
The Illogic of Privileging Western Mainstream Ways of Knowing and Evaluation Practice in Indigenous and Other…
Hopkins Room
Skill-building
Fun and Games With Logframes
Peale Room
Roundtable
Rotation I: Empowering the Individual: Considerations for Evaluation in a Flat World
Rotation II: Can Using Communities of Practice Explicate Informal Knowledge in Evaluation Practice?
Jefferson Room
MultiPaper
Evaluating Health Improvement Collaboratives Using a Systems Thinking Developmental Evaluation Approach
Washington Room
Panel
Multiple Levels of Evaluation: Organizational Learning in a Foundation-Supported Initiative
D'Alesandro Room
Multipaper
Longitudinal/Growth Curve Analysis of Program Impacts
Calhoun Room
789 Multiethnic Issues TIG/Assessment in HE TIG
Panel
Consortium-wide Evaluation of a Minority Science, Technology, Engineering, and Mathematics Retention Project
McKeldon Room
MultiPaper
Advancing Personnel Evaluation in Business & Industry
Demonstration
New Developments in Utilization-focused Evaluation: Implications for Learning
Panel
Learning From Quality Assurance and Improvement Processes
Panel
The Challenges and Opportunities of Evaluating Mathematics and Science Partnership (MSP) Projects:…
Fairmount Suite
Multipaper
Assessment Issues in Education
Federal Hill Suite
Using Logic Models to Evaluate Research and Technology Diffusion Results: Two Cases
Royal Board Room
MultiPaper
MultiPaper
Helping Communities Improve: Evaluation as Feedback for Learning
Using Empowerment Eval to Facilitate Organizational Transformation: A Stanford University Medical Center Case…
Hanover Suite B
Panel
Is There Anything Left to Say About Logic Models?
Baltimore Theater
Panel
Place Randomized Trials: Design, Implementation and First Results From Evaluating Ambulatory Psychotherapy
International Room
802 Distance Ed. & Other Educational
Multipaper
Educational Technology: Evaluation Opportunities
Chesapeake Room
Evaluation 2007: Saturday, November 10, 12:10 pm to 1:40 pm, Timeslot Overview
Page 134
Saturday, 12:10 pm to 1:40 pm
769 - Evaluation Capacity Building Within a Selforganizing Systems Framework
Think Tank to be held in the
Organizational Learning and Evaluation Capacity Building TIG
• Beverly Parsons, InSites; Dawn Hanson Smart, Clegg &
Associates
770 - Learning From the Consequences of No Child
Left Behind on Evaluation (Part 2 of 2)
• Chair - Rebecca Eddy, Claremont Graduate University
Measuring Student Progress: Changes and Challenges Under
No Child Left Behind
• Mariam Azin and Miriam Resendez, Planning, Research
and Evaluation Services Associates Inc
Using Research to Inform Educational Curricula
• Marcy Baughman, Pearson Educational Measurement
Consequences of No Child Left Behind on Evaluation Purpose,
Design, and Practice
No Child Left Behind and the Discipline of Evaluation:
Challenges and Opportunities
• Rebecca Eddy and Tiffany Berry, Claremont Graduate
University
771 - Building Communities in the Context of
Transitional Countries: Challenges and Approaches
for Program Evaluation
• Chair - Robert Stake, University of Illinois at UrbanaChampaign
Re-constructing Program Theory for the Post-ante Evaluation of
the Ukraine-Belarus Partnership for Community Development
• Kseniya Temnenko, Eurasia Foundation
Institute for Sustainable Communities' Local Partnership
Grantees in Macedonia: An Example of Mid-course Corrections
in Evaluation Design as a Result of Evolving Understandings of
Community and Capacity
• Gretchen Elias, Institute for Sustainable Communities
Enabling Roma Children to Attend Ordinary Schools
• Robert Stake, University of Illinois at Urbana-Champaign
772 - Sustaining and Supporting AEA Affiliates:
Strategies for Success
Think Tank to be held in the International Ballroom Section D
• Neva Nahan, Wayne State University; Sue Hewitt, Health
District of Northern Larimer County
773 - Successfully Publishing Your Dissertation
• Chair - Liz McGough, University at Buffalo
• Discussant - Shelly Mahon, University of Wisconsin,
Madison
Where Do I Begin? Transforming Student Research Into a
Publishable Manuscript
• Chris Coryn, Western Michigan University
From Conference to Publication; Transforming a Conference
Presentation into a Volume of New Directions for Evaluation
• Michael Harnar, Claremont Graduate University
Publishing Qualitative Research
• Sandra Mathison, University of British Columbia
Submitting Your Manuscript
• Jonathan Morell, New Vectors LLC
Regrouping and Revising
• Robin Miller, Michigan State University
774 - Community of Learners in Evaluation: The
Triple Threat
Demonstration to be held in the Liberty Ballroom, Section A on
• Chantell Johnson, TCC Group; Allison Crean, Informed
Educators Consulting Group
775 - What is or Should be the Value-added of an
Evaluator?
• Chair - Melvin Mark, Pennsylvania State University
Evaluators: Value-added, Value-subtracted
• Lois-ellin Datta, Datta Analysis
Working with Close Relatives
• George Grob, Center for Public Program Evaluation
Value-added (or Subtracted) by an Evaluator
• William Shadish, University of California, Merced
Value-Added by an Evaluator: What Should it be? And so
What?
• Melvin Mark, Pennsylvania State University
Evaluation 2007: Saturday, November 10, 12:10 pm to 1:40 pm
Page 135
Saturday, 12:10 pm to 1:40 pm, Continued
776 - Practicing Systemic Methods for Evaluation of
Food Systems
Skill-building Workshop to be held in the Mencken Room on
• Chair - Glenda Eoyang, Human Systems Dynamics
Institute
• Presenter - Ken Meter, Crossroads Resource Center
777 - Multiple Methods, Multiple Perspectives
• Chair - Melissa Cater, Louisiana State University
An Alternative Approach for Narrative Documentation of
Extension Programs: Tales of an Internal Evaluator
• Michael Duttweiler, Cornell University
Characteristics Associated With Increasing the Response
Rates of Web-based Surveys
• Thomas Archer, The Ohio State University
A Stakeholder Valuation Approach to Evaluating a Program's
Public Benefits: The University of Minnesota Extension's
Master Gardener Program
• Tom Bartholomay, University of Minnesota
Improving the Content of Penn State Cooperative Extension
ArcView Geographic Information System Workshops Through
Analysis of Participant Evaluations
• Stewart Bruce, Pennsylvania State University
778 - Qualitative Analyses of Education Reform
Efforts
• Chair - Eric Barela, Los Angeles Unified School District
• Discussant - Bill Thornton, University of Nevada, Reno
The Power of Q-methodology: Getting Beyond Perceptions to
Uncovering Actions (or Inactions)
• Matthew Militello and Sharon Rallis, University of
Massachusetts, Amherst
Developing Protocols for Qualitative Analysis of Education
Sector Reform: Possibilities and Limitations of Research
Protocols for Identifying and Informing on Non-linear, Iterative,
and Generative Characteristics of Reform Processes
• David Balwanz and Jessica Jester Quijada, Academy for
Success Case Study: A Retroactive Look at Impact Using the
Success Case Method
• Ravneet Tiwana, University of California, Los Angeles
779 - Expert Evaluation of Federal Agencies'
Program Portfolios in the Program Assessment
Rating Tool (PART) Environment
• Chair - Raymond Sinclair, Centers for Disease Control and
Prevention
Expert Evaluation of the National Institute for Occupational
Safety and Health's Portfolio of Research Programs in the
Program Assessment Rating Tool (PART) Environment
• Raymond Sinclair, Centers for Disease Control and
Prevention
Assisting Federal Programs in Expert Evaluation: Tools and
Processes
• Valerie Williams, RAND Corporation
The National Academies Review of the Programs of the
National Institute for Occupational Safety and Health
• Evan Douple, The National Academies
The Use of Independent Evaluation in the Program Assessment
Rating Tool Process (PART)
• Norris Cochran, United States Department of Health and
Human Services
780 - Connecting Evaluation Theory and Practice via
Experiential Learning
• Chair - Vanessa Dennen, Florida State University
Learning Evaluation and Applied Research Consultants
• Gargi Bhattacharya, Kristin Pankey, and Joel Nadler,
Extending the Teaching of Evaluation Through Experiential
Learning: Connecting Evaluation Theory and Planning With
Grant-Making
• Melissa Kelly, University of Illinois, Chicago; Dan
Kaczynski, University of West Florida
The Evaluation Internship: Engaging Undergraduate Students
in Applied Learning Opportunities
• Kristi Lekies, The Ohio State University
Did you know? There are delegates from over
fifty countries at Evaluation 2007.
Page 136
781 - Roundtables
Rotation I: Evaluation of an In-class Versus an Online Alcohol
Diversion Program to Reduce Alcohol Consumption and
Negative Consequences Among College Students
• Peggy Glider, David Salafsky, and Carlos Moll, University
of Arizona
Rotation II: Pearls and Pitfalls in Evaluating Student
Assistance Programs: A Seven-Year Longitudinal Study
• Sharon Wilburn and Kenneth Wilburn, University of North
Florida; Dax Weaver, Health-Tech Consultants Inc; Kathy
Bowles, Duval County Public Schools
782 - The Illogic of Privileging Western Mainstream
Ways of Knowing and Evaluation Practice in
Indigenous and Other Non-western or Nonmainstream Contexts
• Chair - Morris Lai, University of Hawaii
• Discussant - Nan Wehipeihana, Research Evaluation
Consultancy Ltd
Dastardly Deeds and Words Should Lead to Loss of Privileges
• Morris Lai, University of Hawaii
Managing for Maori Outcomes
Kumu o ka 'Aina (Teachers of Our Land): Home Grown New
Teacher Development
• Alice Kawakami, University of Hawaii
Assets Based Inquiry: Culling Tenets of Success From
Promising Practices in Hawaiian Education
• Kanani Aton, Kapuahi
783 - Fun and Games With Logframes
Skill-building Workshop to be held in the Peale Room on the
• Scott Chaplowe, American Red Cross
785 - Roundtables
Rotation I: Empowering the Individual: Considerations for
Evaluation in a Flat World
• Stacey Hoopes and David Williams, Brigham Young
University
Rotation II: Can Using Communities of Practice Explicate
Informal Knowledge in Evaluation Practice?
• Shannon Coulter, University of Tennessee, Knoxville
786 - Evaluating Health Improvement Collaboratives
Using a Systems Thinking Developmental Evaluation
Approach
MultiPaper to be held in the Washington Room on the Cabana
Applying the Collaboratives Model to Developing Country
Settings
• Jorge Hermida, University Research Company LLC; Mary
Gutmann, EnCompass LLC
Investing in Collaboratives
• Lynne Franco, University Research Company, LLC
Evaluating Collaboratives
• Tessie Catsambas, EnCompass LLC
787 - Multiple Levels of Evaluation: Organizational
Learning in a Foundation-Supported Initiative
• Chair - Andrea Berger, American Institutes for Research
• Discussant - Victor Kuo, Bill & Melinda Gates Foundation
Collaboration Within a National Evaluation
• Andrea Berger, American Institutes for Research
Participating in and Learning From Evaluation
• Linda Campbell, Center for Native American Educational
Advancement
Connecting all of the Evaluation Pieces to Facilitate Initiative
Learning
• Leslie Haynes, Jobs for the Future
Facilitating Connections Across the Initiative to Meet Funder
Information Needs
• Yee-Ann Cho, Bill & Melinda Gates Foundation
Page 137
88 - Longitudinal/Growth Curve Analysis of Program
Impacts
• Chair - Lihshing Wang, University of Cincinnati
The Long Road of Longitudinal Studies: Learning What to Do
and Not to Do Along the Way
• Bruce Yelton, Paula Plonski, Grant Morgan, Mary Beth
Gilbert, Praxis Research Inc
Using Cox Regression Modeling to Predict Recidivism for Youth
Departing Out-of-home Care: Implications for Program
Evaluation and Treatment of At-risk Youth
• Jay Ringle, Girls and Boys Town; David Kingsley, University
of Kansas; Stephanie Ingram, Beth Chmelka, and Ron
Thompson, Girls and Boys Town
Evaluating Impacts of Place-based Initiatives: An Application
of a Spatially Improved Interrupted Time Series Design
• Julia Koschinsky, University of Illinois at UrbanaChampaign
Evaluating Value-added Methodology for Standards-based
Accountability Assessment
• Lihshing Wang and Kent Seidel, University of Cincinnati;
Suzane Franco, Wright State University
789 - Consortium-wide Evaluation of a Minority
Science, Technology, Engineering, and Mathematics
Retention Project
Sponsor: Multiethnic Issues in Evaluation TIG and the
• Chair - Jing Zhu, The Ohio State University
Problems and Issues in Conceptualization and Implementation
• Jeffry L White, Ashland University; James W Altschuld, The
Ohio State University; Yi-Fang Lee, National Chi Nan
University
Comparisons of Multiple Years of Data
• James W Altschuld, Deborah H Kwon, Jing Zhu, The Ohio
State University; Jeffry L White, Ashland University; Yi-Fang
Lee, National Chi Nan University
Capturing the Impact of Academic Self-efficacy and Career
Perceptions
• Deborah H Kwon, James W Altschuld, Jing Zhu, The Ohio
State University; Jeffry L White, Ashland University
The Effects of Interaction on Decisions to Persist
• Jing Zhu, James W Altschuld, Deborah H Kwon, The Ohio
State University; Jeffry L White, Ashland University
792 - Advancing Personnel Evaluation in Business &
Industry
MultiPaper to be held in the Calvert Ballroom Salon B on the
• Chair - Liliana Rodriguez-Campos, University of South
Florida
Getting to Good: Evaluating the Impact of Personnel Selection
Systems
• Wes Martz, Western Michigan University
Evaluating the Effectiveness of the 5-step Career Planning
Process
• Willis Thomas, Western Michigan University
Splitting the Atom: A Metaevaluation of a Nuclear Power
Plant's Personnel Evaluation System
• Otto Gustafson, Western Michigan University
793 - New Developments in Utilization-focused
Evaluation: Implications for Learning
Demonstration to be held in the Calvert Ballroom Salon C on
• Michael Quinn Patton, Utilization-Focused Evaluation
794 - Learning From Quality Assurance and
Improvement Processes
• Chair - Rakesh Mohan, Idaho State Legislature
• Discussant - David J Bernstein, Westat
Quality Assurance and Quality Improvement Fosters Quality
Management
• Stanley Capela, HeartShare Human Services
Rabbit Season? Duck Season? Proposal Season!
• Jennifer Dewey, Macro International Inc
Ensuring Quality of Evaluations on a Shoestring Budget
• Rakesh Mohan, Idaho State Legislature
Page 138
795 - The Challenges and Opportunities of
Evaluating Mathematics and Science Partnership
(MSP) Projects: Michigan's Design, Strategies and
Instruments
Radisson
• Chair - Shannan McNair, Oakland University
Western Michigan University: Looking at the Michigan
Mathematics Rural Initiative and Muskegon Middle School
Mathematics Improvement Projects
• Sandy Madden, Western Michigan University
Oakland Schools Math Science Partnership Project
• Wendy Tackett, iEval; Valerie Mills, Oakland Schools
Sustained Professional Development and Achievement:
Washtenaw Intermediate School District
• Frederica Frost, Wayne County Research Educational
Service Agency; Naomi Norman, Washtenaw Intermediate
School District
The Role of Statewide Evaluators for Math Science Partnership
(MSP) Projects
• Dennis W Rudy, Lakehouse Evaluation Inc; Shannan
McNair, Oakland University
796 - Assessment Issues in Education
• Chair - Zandra Gratz, Kean University
Proximal Assessment for Learner Diagnosis (PALD): A Dynamic
Approach to Classroom Assessment aimed at Reducing
Learner Gaps in Subject Area Domains
• Madhabi Chatterji, Teachers College Columbia University
Edmund W Gordon, Teachers College Columbia University
Objective Criteria for Assessing the Validity of Traditional and
Performance-based Classroom Assessment
• Bruce B Frey, University of Kansas
Vicki L Schmitt, University of Kansas
Evaluation of the Elementary Grading and Reporting Policy
• Kecia Addison-Scott, Montgomery County Public Schools
An Analysis of the School-based Assessment for Youth (S-BAY)
in Ohio's Alternative Education Program: A Focus on Gender
Sensitive Evaluation
• Aundrey Somerville, Bureau of Research, Training and
Services
797 - Using Logic Models to Evaluate Research and
Technology Diffusion Results: Two Cases
the Radisson
• Chair - Jeff Dowd, United States Department of Energy
Cutting Edge Logic Models for Research and Technology
Programs
• Gretchen Jordan, Sandia National Laboratories
Linking Projects to Program Outcomes in Metrics for
Technology Development Programs
• John Mortensen, Energetics Inc
The Logic of Indirect Programs to Diffuse Technologies: The
Example of Training
• John Reed, Innovologie
Getting From Training to Credible Energy Savings: An
Evaluation Template
• Harley Barnes, LM Business Process Solutions
798 - Helping Communities Improve: Evaluation as
Feedback for Learning
• Chair - Carolyn Lichtenstein, Walter R McDonald &
Associates Inc
• Discussant - Brigitte Manteuffel, Macro International Inc
The National Evaluation of the Comprehensive Community
Mental Health Services for Children
and Their Families Program (CMHI): The Federal Perspective
• Sylvia Fisher, United States Department of Health and
Human Services
National Evaluation Results as a Mechanism for Continuous
Quality Improvement in Grantee Communities
• Carolyn Lichtenstein, Walter R McDonald & Associates
Inc
The Evidence-based Practices and Cultural and Linguistic
Competence Studies: Complex Topics for Complex Systems
• Kurt Moore and John Fluke, Walter R McDonald &
Associates Inc
Data Reporting: Information to Guide Learning
• Susan Drilea and John Fluke, Walter R McDonald &
Associates Inc
Page 139
799 - Using Empowerment Evaluation to Facilitate
Organizational Transformation: A Stanford University
Medical Center Case Example
MultiPaper to be held in the Hanover Suite B on the Mezzanine
Evaluation TIG
• Chair - David Fetterman, Stanford University
• Discussant - Abraham Wandersman, University of South
Carolina
Using Empowerment Evaluation to Engage Stakeholders and
Facilitate Curriculum Reform
• Jennifer Berry and David Fetterman, Stanford University
Organizational Learning Through Empowerment Evaluation:
Improving Reflection Skills With a 360 Degree Evaluation
• Kambria Hooper, Stanford University
Overestimation of Skills in Medical School: The Need to Train
Students How to Self-assess
• Andrew Nevins, Stanford University
Empowerment Evaluation: The Power of Dialogue
• David Fetterman and Jennifer Berry, Stanford University
Using Principles of Empowerment Evaluation to Build Capacity
for Institutional Learning: A Pilot Project at Stanford Hospital
• Heather A Davidson, Stanford University
• Empowerment Evaluation: A Catalyst for Culture Change
in Post Graduate Medical Education
• Alice Edler, Stanford University
800 - Is There Anything Left to Say About Logic
Models?
Panel to be held in the Baltimore Theater on the Mezzanine
• Chair - John Stevenson, University of Rhode Island
When Does Linear Logic Help?
• John Stevenson, University of Rhode Island
Multi-site Evaluations and Logic Models: Development
Strategies, Uses, and Cautions
• Debra Rog, Westat
A Developmental Approach to Using Logic Models in
Evaluation
• George Julnes, Utah State University
Constructing Logic Models of Impact to Guide Evaluation
Designs of Multi-level Programs
• Robert Orwin, Westat
801 - Place Randomized Trials: Design,
Implementation and First Results From Evaluating
Ambulatory Psychotherapy
• Chair - Lee Sechrest, University of Arizona
• Discussant - Fred Newman, Florida International
University
Designing a Place Randomized Trial in a Field Setting
• Werner Wittmann, University of Mannheim
Tailoring Assessment Tools to Different Stakeholder Groups,
Randomization and Treatment Integrity Checks
• Andros Steffanowski and David Kriz, University of
Mannheim
Evaluating Ambulatory Psychotherapy in a Field Setting With a
Place Randomized Trial, First Results
• Manuel Voelkle, University of Mannheim
802 - Educational Technology: Evaluation
Opportunities
• Chair - Shani Reid, Macro International Inc
It's not Just Fun and Games: Evaluating Games in the
Classroom
• Shani Reid and Helene Jennings, Macro International Inc;
Betsy Peisach, Maryland Public Television
Evaluative Learning and Technology Use in Educational
Innovation Programs
• Juna Snow, InnovatEd Consulting
Evaluation of the Computer's Efficacy in Education
• Paul Lorton Jr, University of San Francisco
Page 140
No Primary Sponsor
Session
Session Title
Room Name
Skill-building
Promoting and Assessing Individual and Organizational Knowledge Building
Panel
Evaluation in Education: Promises, Challenges, Booby Traps and Some Empirical Data
Panel
International Efforts to Strengthen Evaluation as a Profession and Build Evaluation Capacity
Panel
Revisiting the Logic Modeling Process: Emerging Benefits, Challenges and the Role of E-Technology
Panel
Learning How to Start and Succeed as an Independent Evaluation Consultant
Panel
Examining the Form and Function of Evaluation in Philanthropy
809 Quantitative MethodsTIG/Cost Benefit TIG
Panel
Money Talks: Including Costs in Your Evaluation
Multipaper
Systems Methodologies for Evaluation
Mencken Room
Demonstration
NC Cooperative Extension's Program Development Institute: A Multi-faceted, Multi-level, Multi-disciplinary…
MultiPaper
Empowerment Evaluation Communities of Learners: From Rural Spain to the Arkansas Delta
Carroll Room
The Follow-up Monitoring and Outcome Survey for National Research and Development Projects in NEDO
Skill-building
Ethics in Evaluation: At the Crossroads of Principle to Practice
Roundtable
Rotation I: What Exactly Are Life Skills Anyway?
Rotation II: Teen Interactive Theater Education: Eval of a Youth Development Approach to the Reduction of Risk…
Douglass Boardroom
MultiPaper
Learning From the Evaluation of Voluntary Environmental Partnership Programs
Hopkins Room
MultiPaper
Does Aid Eval Work?: Reducing World Poverty by Improving Learning, Accountability and Harmonization in Aid Eval
Peale Room
Multipaper
Advocacy, Community Mobilization and Systems Change: Assessing Unique Strategies to Impact Comm Health
Adams Room
Roundtable
Challenges of Evaluating a Multi-disciplinary, Multi-agency, School Based, Safe Schools/Healthy Students Project
Jefferson Room
Multipaper
Capacity Factors in Prevention and New Tobacco Control Strategies and Evaluations
Washington Room
Panel
Put That in Writing: Communicating Evaluation Results in a Way That Promotes Learning and Use
D'Alesandro Room
Panel
Of Mice and Men: How to Conduct a Random Assignment Study
Calhoun Room
Multipaper
Cultural Isses in Multiethnic Evaluation
McKeldon Room
824 Org Learning TIG/Multiethnic Issues TIG
Think Tank
Building Capacity for Cross-cultural Leadership Development Evaluation
Preston Room
Building Organizational Capacity for Self-evaluation
Schaefer Room
Demonstration
Comparing Apples to Apples: Applying the Rasch Measurement Framework to a Statewide Parent Survey
Multipaper
Case Studies of Evaluation Use
Multipaper
Rating Tools, Causation, and Performance Measurement
Think Tank
Panel
Articulating Authentic and Rigorous Science Education Eval Through the Inquiry Science Instruction Observation…
Summer School Ain't So Bad, But Evaluating It Can Be: Lessons Learned From Outcome Evaluations of Summer…
Fairmount Suite
Federal Hill Suite
831 RT&D TIG/Environmental Program TIG
Panel
Forging a Strong Link Between Research and Science Policy for Air Quality Decisions
Royal Board Room
Panel
Putting it All Together: Integrating Evaluation Components to Create a Comprehensive Statewide Evaluation
Multipaper
Engaging Participants in the Evaluation Process: A Participatory Approach
Hanover Suite B
Panel
Advances and Applications in Using Propensity Scores to Reduce Selection Bias in Quasi-Experiments
Baltimore Theater
Panel
Unintended Interventions
International Room
Multipaper
Evaluating College Access Programs: Evaluation Models and Methods for Different Interventions…
Chesapeake Room
803 - Promoting and Assessing Individual and
Organizational Knowledge Building
Skill-building Workshop to be held
in the International Ballroom
Section A on the Main Lobby Level in
the Sheraton
• Lyn Shulha, Queen's University; Glenda Eoyang, Human
Systems Dynamics Institute
804 - Evaluation in Education: Promises, Challenges,
Booby Traps and Some Empirical Data
Panel to be held in the International Ballroom Section B on the
• Chair - Katherine McKnight, Pearson Achievement
Solutions
Evaluations as Tests of Theory
• Lee Sechrest, University of Arizona
What do we Mean by "What Works?"
• Katherine McKnight, Pearson Achievement Solutions
Education and Instructional Materials Development: Towards
Evidenced Based Practice
• Christopher Brown, Pearson School Companies
What is Taught and What is Tested? Evidence From the
Program of International Student Assessment
• Werner Wittmann, University of Mannheim
A Research and Development (R&D) Approach to Education
Interventions
• Ronald Gallimore, Pearson Achievement Solutions
805 - International Efforts to Strengthen Evaluation
as a Profession and Build Evaluation Capacity
• Chair - Arnold Love, Independent Consultant
• Discussant - Arnold Love, Independent Consultant
Strengthening Evaluation as a Profession in the United Nations
System and Throughout Latin America and the Caribbean
• Ada Ocampo, United Nations Children's Fund
Building the Evaluation Profession in Japan: Experience of the
Japanese Evaluation Society (JES) Accreditation Program
• Masafumi Nagao, Hiroshima University
Innovative Approaches for Increasing the Evaluation Capacity
of International Educators and School Evaluators
• Keiko Kuji-Shikatani, Independent Consultant
806 - Revisiting the Logic Modeling Process: Emerging Benefits, Challenges and the Role of ETechnology
• Chair - Ralph Renger, University of Arizona
Emerging Benefits of the Logic Modeling Process
• Jessica Surdam, University of Arizona
Challenges Encountered in the Logic Modeling Process
• Erin Peacock, University of Arizona
Understanding the Role of E-Technology in the Logic Modeling
Process
• Kim Fielding, University of Arizona
807 - Learning How to Start and Succeed as an
Independent Evaluation Consultant
• Chair - Jennifer Williams, J E Williams and Associates LLC
• Discussant - Michael Hendricks, Independent Consultant
Evaluation of National Evaluation Programs: A Partnership
Perspective
• Amy Germuth, Compass Consulting Group
Learning to Grow and Direct a Small Business in the Field of
• Kathleen Haynie, Kathleen Haynie Consulting
Learning From Reflections of 30 Years of Evaluation Experience
• Mary Ann Scheirer, Scheirer Consulting
International Evaluation Consulting: Learning From one
Woman's Perspective
• Tristi Nichols, Manitou Inc
Lessons Learned in Transitioning From Employee to Consultant
• Jennifer Williams, J E Williams and Associates LLC
808 - Examining the Form and Function of Evaluation
in Philanthropy
• Chair - Pennie G Foster-Fishman, Michigan State
University
Evaluation and Learning in the World of Philanthropy
• Pennie G Foster-Fishman, Michigan State University;
Branda Nowell, North Carolina State University; Kevin Ford,
Michigan State University
Evaluation at the W.K. Kellogg Foundation
• Teresa Behrens, W K Kellogg Foundation
Evaluation at the Packard Foundation
• Gail Berkowitz, Packard Foundation
Evaluation at the Barr Foundation
• Roberto Cremonini, Barr Foundation
Page 142
809 - Money Talks: Including Costs in Your
Evaluation
Sponsor: Quantitative Methods: Theory and Design TIG and the
Costs, Effectiveness, Benefits, and Economics
• Chair - Patricia Herman, University of Arizona
• Discussant - Brian Yates, American University
Overview of Cost-based Evaluation
• Patricia Herman, University of Arizona
Cost-effectiveness of Smoking Cessation Programs: A
Preliminary Analysis
• Dee Dee Avery and Patricia Herman, University of Arizona
Costs and Effects From Several Sources? Putting it All Together
With a Monte Carlo Simulation
• Michele Walsh and Patricia Herman, University of Arizona
Threshold Analysis: How Much Reduced Exposure Does it Take
to Make a Secondhand Smoke Media Campaign Worthwhile?
• Crystal Schemp and Patricia Herman, University of
Arizona
810 - Systems Methodologies for Evaluation
• Chair - Bob Williams, Independent Consultant
Evaluating Participants' Conceptual Changes Around Complex
Program Outcomes: Measuring Thinking Around Integrated
Food Systems
• Rita O'Sullivan, University of North Carolina, Chapel Hill;
John O'Sullivan, North Carolina A & T State University; Jeni
Corn, Technology in Learning SERVE
Independent Science Review in Watershed Management
Projects: What Insights Does Critical Systems Heuristics
Provide in Understanding the Quest for Best Available
Science?
• Mary A McEathron, University of Minnesota
How Do Evaluation Concepts Travel? Using Social Network
Analysis to Trace Knowledge Transfer in the International
Program for Development Evaluation Training
• Rahel Kahlert, University of Texas, Austin; Robert Kahlert,
University of Vienna
811 - North Carolina Cooperative Extension's
Program Development Institute: A Multi-faceted,
Multi-level, Multi-disciplinary Training Approach
812 - Empowerment Evaluation Communities of
Learners: From Rural Spain to the Arkansas Delta
MultiPaper to be held in the Carroll Room on the Main Lobby
Evaluation TIG
• Chair - David Fetterman, Stanford University
• Discussant - Stewart I Donaldson, Claremont Graduate
University
Learning From Empowerment Evaluation in Rural Spain:
Implications for the European Union
• Jose Maria Diaz Puente, Polytechnic University, Madrid
Empowerment Evaluation: Transforming Data Into Dollars and
the Politics of Community Support in Arkansas Tobacco
Prevention Projects
• Linda Delaney, Fetterman and Associates; David
Fetterman, Stanford University
Empowerment Evaluation and the Web: (interactive Getting to
Outcomes) iGTO
• Abraham Wandersman, University of South Carolina
813 - The Follow-up Monitoring and Outcome Survey
for National Research and Development Projects in
New Energy and Industrial Technology Development
MultiPaper to be held in the Pratt Room, Section A on the
• Chair - Takahisa Yano, New Energy and Industrial
Technology Development Organization
Study of the Correlation Between Ex-post Evaluation and
Follow-up Monitoring of National Research and Development
(Part I)
• Hiroyuki Usuda and Momoko Okada, New Energy and
Industrial Technology Development Organization
Study for the Important Management Factors Based on Followup Monitoring Data (Part II)
• Setsuko Wakabayashi, Tsutomu Kitagawa, Takahisa
Yano, and Kazuaki Komoto, New Energy and Industrial
Approach for the Understanding of Outcomes Derived from
National Research and Development of Energy Conservation
Project (Part III)
• Kazuaki Komoto, Tsutomu Kitagawa, Takahisa Yano, and
Setsuko Wakabayashi, New Energy and Industrial
Demonstration to be held in the Edgar Allen Poe Room on the
• Lisa Guion, North Carolina State University
Page 143
814 - Ethics in Evaluation: At the Crossroads of
Principle to Practice
• Chair - Linda Schrader, Florida State University
• Michael Morris, University of New Haven
815 - Roundtables
Rotation I: What Exactly Are Life Skills Anyway?
• Benjamin Silliman, North Carolina State University;
Daniel Perkins, Pennsylvania State University
Rotation II: Teen Interactive Theater Education: Evaluation of a
Youth Development Approach to the Reduction of Risk
Behaviors
• Ruth Carter and Daniel McDonald, University of Arizona
816 - Learning From the Evaluation of Voluntary
Environmental Partnership Programs
Protection Agency
The Lay of the Land: "Voluntary" Partnership Programs at the
United States Environmental Protection Agency
• Laura Pyzik, United States Environmental Protection
Agency
Measuring the Effectiveness of Environmental Protection
Agency's Indoor Air Quality Tools for Schools Program
• Dena Moglia, United States Environmental Protection
Agency
Evaluating the Hospitals for a Healthy Environment (H2E)
Program's Partner Hospitals' Environmental Improvements
• Chen Wen, United States Environmental Protection
Agency
Evaluating the Next Generation of Environmental Protection
Agency (EPA) Partnership Programs: Where Do We Go From
Here?
• Laura Pyzik, United States Environmental Protection
Agency
817 - Does Aid Evaluation Work?: Reducing World
Poverty by Improving Learning, Accountability and
Harmonization in Aid Evaluation
MultiPaper to be held in the Peale Room on the Lower Level in
• Chair - Michael Scriven, Western Michigan University
Reducing World Poverty by Improving Evaluation of
Development Aid
• Paul Clements, Western Michigan University
Lessons Learned from the Embedded Institutional
Arrangement in Aid Evaluation
• Ryoh Sasaki, Western Michigan University
Hope for High Impact Aid: Real Challenges, Real Opportunities
and Real Solutions
• Ronald Scott Visscher, Western Michigan University
818 - Advocacy, Community Mobilization and
Systems Change: Assessing Unique Strategies to
Impact Community Health
• Chair - Zoe Clayson, Abundantia Consulting
Follow the Money: Assessing Clinic Consortia Policy Advocacy
Capacity
• Annette Gardner and Claire Brindis, University of
California, San Francisco; Astrid Hendricks, The California
Endowment
Community Mobilization: Framing the Strategy and Evaluating
Results
• Roberto Garcia, Abundantia Consulting; Paul Speer,
Vanderbilt University; Zoe Clayson, Abundantia Consulting
Critical Components of Using a Systems Approach to Effect
Environmental Asthma Policies and Reduce Health Disparities
• Mary Kreger, Claire Brindis, and Dana Hughes, University
of California, San Francisco; Diane Manuel, The California
Endowment; Diana Lee, National Community Development
Institute; Annalisa Robles and Marion Standish, The
California Endowment; Lauren Sassoubre, University of
California, San Francisco
819 - Challenges of Evaluating a Multi-disciplinary,
Multi-agency, School Based, Safe Schools/Healthy
Students Project
• Carl Brun, Betty Yung, Cheryl Meyer, Carla Clasen,
Katherine Cauley, and Kay Parent, Wright State University
Page 144
820 - Capacity Factors in Prevention and New
Tobacco Control Strategies and Evaluations
822 - Of Mice and Men: How to Conduct a Random
Assignment Study
• Chair - Carrie Markovitz, Abt Associates Inc
The Benefit Offset National Demonstration (BOND)
• Larry Orr, Abt Associates Inc
The National Random Assignment Study of Youth Corps
• Carrie Markovitz, Abt Associates Inc
Impact Evaluation of Upward Bound's Increased Emphasis on
Higher-Risk Students
• Ryoko Yamaguchi, Abt Associates Inc
• Chair - Robert LaChausse, California State University, San
Bernardino
Capacity Factors Influencing Evaluation Scope Among
Prevention Coalitions
• Julianne Manchester and James W Altschuld, The Ohio
State University
Safe Schools/Healthy Students Project Directors' Perspectives
on Evaluation and Evaluators
• Jenifer Cartland, Childrens' Memorial Hospital, Chicago;
Holly Ruch-Ross, Independent Consultant; Maryann Mason,
Children's Memorial Hospital, Chicago; William Donohue,
Michigan State University
Evaluating School-based Tobacco Prevention Initiatives:
Challenges and Strategies
• Patricia Lauer and Rebecca Van Buhler, Rocky Mountain
Center for Health Promotion and Education
Ready, Set, ACTION: Evaluating the Multi-site Effectiveness
Study of the Adolescent Cessation of Tobacco: Independent of
Nicotine (ACTION) Adolescent Tobacco Cessation Program in
Tobacco-growing Communities
• Laurie Stockton, Al Stein-Seroussi, and Paul Brodish,
Pacific Institute for Research and Evaluation
Combining Qualitative and Quantitative Methods in the
Evaluation of Health Prevention Programs Targeting Hard-toreach Populations
• Violeta Dominguez, University of Arizona
• Chair - Tamara Bertrand, Florida State University
• Discussant - Emiel Owens, Texas Southern University
Does Revising the Language on a Survey Capture Non-native
English Speakers' Opinions More Accurately?
• Sally Francis, and Eric Riedel, Walden University
Evaluating the Effectiveness of a 'Small Learning Community'
Project on Inner-City Students
• Deirdre Sharkey and Emiel Owens, Texas Southern
University
Diversity in the Evaluation Field: Expanding the Pipeline for
Racial/Ethnic Minorities
• Dustin Duncan, Harvard University
The Case Against Cultural Competence
• Gregory Diggs, University of Colorado, Denver
821 - Put That in Writing: Communicating Evaluation
Results in a Way That Promotes Learning and Use
824 - Building Capacity for Cross-cultural Leadership
Development Evaluation
• Chair - Toni Freeman, The Duke Endowment
Communicating Evaluation Results With Your Audience in Mind
• David Scheie, Touchston Center for Collaborative Inquiry
Some Things Just Happen: Writing Isn't one of Them
• Mary Grcich Williams, Lumina Foundation for Education
Who Owns Your Evaluation Report?
• Toni Freeman, The Duke Endowment
823 - Cultural Isses in Multiethnic Evaluation
Building TIG and the Multiethnic Issues in
• Discussants - Claire Reinelt, Leadership Learning
Community; Emily Hoole and Kelly Hannum, Center for
Creative Leadership
• Presenter - Kelly Hannum, Center for Creative Leadership
825 - Building Organizational Capacity for Selfevaluation
Building TIG
• Trilby Smith and Kathleen Agaton, Metis Associates
Page 145
826 - Comparing Apples to Apples: Applying the
Rasch Measurement Framework to a Statewide
Parent Survey
Demonstration to be held in the Calvert Ballroom Salon B on
• Kathleen Lynch, Virginia Commonwealth University;
William Fisher, Avatar International Inc
827 - Case Studies of Evaluation Use
829 - Articulating Authentic and Rigorous Science
Education Evaluation Through the Inquiry Science
Instruction Observation Protocol (ISIOP)
in the Radisson
• Discussants - Daphne Minner and Neil Schiavo,
Education Development Center Inc
• Presenter - Daphne Minner, Education Development
Center Inc
830 - Summer School Ain't So Bad, But Evaluating It
Can Be: Lessons Learned From Outcome Evaluations
of Summer Programs
Multipaper to be held in the Calvert Ballroom Salon C on the
• Chair - Emmalou Norland, Institute for Learning
Innovation
Initial Results From “Beyond Evaluation Use”: A Study of
Involvement and Influence in Large, Multi-site National
Science Foundation (NSF) Evaluations
• Jean King, Lija Greenseid, Kelli Johnson, Frances
Lawrenz, Stacie Toal, and Boris Volkov, University of
Minnesota
Case Studies of Evaluation Use and Influence in a School
District
• John Ehlert and Jean King, University of Minnesota
Process Use and Organizational Learning: A Different
Perspective: The Case of the World Bank
• Silvia Paruzzolo, World Bank; Giovanni Fattore, Bocconi
University
Building Learning Communities With Evaluation Data Teams: A
Collective Case Study of Six Alaskan School Districts
• Edward McLain, University of Alaska, Anchorage; Susan
Tucker, Evaluation and Development Association; Diane
Hirshberg, University of Alaska, Anchorage; Alexandra Hill,
University of Alaska
the Radisson
• Chair - Elizabeth Cooper-Martin, Montgomery County
Public Schools
• Discussant - Cindy Tananis, University of Pittsburgh
The Use of Next Year's Course Enrollment, Test Scores, and
Course Grades in an Evaluation of Summer Intervention and
Enrichment Courses for Middle School Students
• Elizabeth Cooper-Martin and Rachel Hickson,
Montgomery County Public Schools
The Use of Multiple Stakeholder Surveys in the Evaluation of
Summer Programs for Elementary Students
• Nyambura Maina and Julie Wade, Montgomery County
Public Schools
Evaluation of Cumulative Effects of a Summer Elementary
Education Program
• Scot McNary, Montgomery County Public Schools
Evaluating Outcomes of a Summer Learning Program Using
Non-Randomized Comparison Group Pretest-Posttest QuasiExperimental Design
• Helen Wang, Montgomery County Public Schools
828 - Rating Tools, Causation, and Performance
Measurement
831 - Forging a Strong Link Between Research and
Science Policy for Air Quality Decisions
• Chair - David J Bernstein, Westat
Causation in Federal Government Evaluations
• Mina Zadeh, United States Department of Health and
Human Services
Selecting Measures for External Performance Accountability:
Standards, Criteria, and Purpose
• James Derzon, Pacific Institute for Research and
Evaluation
Evaluating an Evaluation Process: Lessons Learned From the
Evaluation of the National Flood Insurance Program
• Marc Shapiro, Independent Consultant
the Radisson
and the Environmental Program Evaluation TIG
• Chair - Dale Pahl, US Environmental Protection Agency
An Overview of National Ambient Air Quality Standards
• Ron Evans, US Environmental Protection Agency
A Paradigm for Federal Particulate Matter Research
• James Vickery, US Environmental Protection Agency
Relationships Among Atmospheric Contaminants, Air Quality,
Human Exposure, and Health
• Rochelle Araujo, US Environmental Protection Agency
Synthesis and Evaluation of New Scientific Knowledge
• William Wilson, US Environmental Protection Agency
Page 146
832 - Putting it All Together: Integrating Evaluation
Components to Create a Comprehensive Statewide
Evaluation
• Chair - Tiffany Comer Cook, University of Wyoming
• Discussant - Laura Feldman, University of Wyoming
Administering Surveys to Assess Attitudes
• Russ Miller, University of Wyoming
Evaluating Outcomes Related to Prevalence
• Shannon Williams, University of Wyoming
Analyzing Policy
• Tiffany Comer Cook, University of Wyoming
833 - Engaging Participants in the Evaluation
Process: A Participatory Approach
Evaluation TIG
• Chair - Arlene Hopkins, Los Angeles Unified School
District
Participatory Systems Change Evaluation: Involving all Users in
All Stages of Systems Change Assessment
• Dianna Newman, University at Albany; Anna Lobosco,
New York State Developmental Disabilities Planning Council
Rethinking Participatory Evaluation's Conceptualization:
Toward the Development of a of a “Full-Blown”, Useful Concept
• Pierre-Marc Daigneault and Steve Jacob, Université Laval
Participatory Evaluative Action Research (PEAR): Social
Learning and Place-based Data as Democratic Practice
• Annalisa Raymer, Cornell University
Hear Us Out: Youth-led Participatory Evaluation in an Urban
Community
• Sherri Lauver, University of Rochester
834 - Advances and Applications in Using Propensity
Scores to Reduce Selection Bias in QuasiExperiments
Panel to be held in the Baltimore Theater on the Mezzanine
• Chair - M H Clark, Southern Illinois University, Carbondale
A Simulation Study Comparing Propensity Score Methods
• Jason Luellen, Vanderbilt University
Freshmen Interest Groups: Effects of Academic Success and
Retention
• Joel Nadler, M H Clark, Heather Falat, and Chad Briggs,
834 – Continued
Assessing the Success and Attrition of College Students: A
University 101 Study
• Nicole Cundiff, M H Clark, Heather Falat, and Chad
Briggs, Southern Illinois University Carbondale
835 - Unintended Interventions
• Chair - Melinda Davis, University of Arizona
Non-specific Effects of Treatment: Vignettes
• Melinda Davis, University of Arizona; Souraya Sidani,
Ryerson University
Non-specific Effects of Treatment: Assessments
• Andrea Chambers and Melinda Davis, University of
Arizona; John Mark, Stanford University
Non-specific Effects of Treatment: Biomarkers
• Melinda Davis and Dan Shapiro, University of Arizona
836 - Evaluating College Access Programs:
Evaluation Models and Methods for Different
Interventions: Middle School Programs, High School
Programs, Summer Bridge Programs, and College
Scholarships
• Chair - Kurt Burkum, National Council for Community and
Education Partnerships
Increasing College Access for Underrepresented Youth:
Developing a Comprehensive Evaluation of a Summer Bridge
Program
• Brianna Kennedy, University of Southern California
Evaluating College Access Program Effects: A Dosage Model
and Perspective
• Gary Skolits, University of Tennessee, Knoxville
The Detroit Area Pre-college Engineering Program (DAPCEP)
National Science Foundation (NSF) Information Technology
Experiences for Students and Teachers (ITEST) Project:
Embedding Evaluation in Program Experiences
• Shannan McNair, Oakland University; Margaret Tucker
and Jason Lee, Detroit Area Pre-College Engineering
Program; Karla Korpela, Michigan Technological University
Evaluating Scholarship Programs: Models, Methods, and
Illustrative Findings
• Gary Miron, Western Michigan University
Page 147
No Primary Sponsor
Session
Session Title
Room Name
837 Pres Strand/Needs Assessment & B&I TIGs
Think Tank
Needs Assessment and Evaluation: Strategies and Practical Applications
Multipaper
Applications Quasi-Experimental Evaluation Techniques
Panel
Promoting Organizational Learning to Increase International Development Effectiveness: Examples From…
Demonstration
Multiple Intelligences, Diversity in Learning Styles, and Implications for Program Evaluation
Panel
Still Learning, After All These Years
Panel
Evaluation and Social Metrics in the Nonprofit Sector
Panel
Opportunities and Challenges: Evaluating for Impact in Formal and Informal Learning Settings
MultiPaper
Working to Address the Evaluation Needs of More of the People More of the Time: Conducting Eval inMulti-site…
Mencken Room
MultiPaper
Connecting Research and Implementation to Enhance Youth Development Programming
Panel
Storytelling in Program Evaluation: Putting the Timeless Miracles Into the Particulars of Experience
Carroll Room
847 Research, Technology, & DevelopmentEval TIG MultiPaper
National Performance Evaluation System of Research and Development Programs in Korea: System and Applications Pratt Room, Section A
Skill-building
Outcomes Measurement in Human Services Evaluation: An Introduction
Panel
Crossing the Threshold: Addressing Methodological, Institutional and Cultural Challenges in Environmental Eval…
Hopkins Room
Panel
Evaluating Educational Programs in the Department of State's Bureau of Educational and Cultural Affairs…
Peale Room
Panel
Examining Evaluation Training, Practice and Contexts in Various Settings
Adams Room
Roundtable
Rotation I: Attending to the Learning Needs of Program Stakeholders: Using Planned Variation Strategy…
Rotation II: The Influence of Context on the Collection of Needs Assessment Data
Jefferson Room
Multipaper
Evaluation Lessons in International Contexts: Health Services and Infectious Diseases
Washington Room
Think Tank
Does Quality Improvement Lead to Organizational Learning?
D'Alesandro Room
Panel
Cross-validation of Empirical Findings From Evaluations
Calhoun Room
Multipaper
Multicultural Evaluation: Issues in Health and Education Settings
McKeldon Room
858 Org Learning and Evaluation Capacity Bldg TIG Skill-building
Using Appreciative Inquiry to Facilitate Change in Organizational Practice
Preston Room
Using Baseline Assessment to Build Eval Capacity and Foster Organizational Learning as Part of a Transformative… Schaefer Room
Federal, State, and Local Disaster and Emergency Planning and Preparedness: Strategies and Case Studies for Eval Calvert Ballroom Salon B
Multipaper
Perspectives on Federal Evaluation
Multipaper
Multipaper
Math and Science Evaluation
Evaluating After School, Supplemental Services, and Out of School Programs
Fairmount Suite
Federal Hill Suite
Centralized E-Tool for Organizational Performance Management: NIH GPRA and PART Assessments
Royal Board Room
865 Research, Technology, & Development Eval TIG Expert Lecture
Multipaper
Substance Abuse Programming: Assessing Fidelity of Implementation and Community-readiness
Panel
Building and Assessing Capacity for Evaluation: Creating Communities of Learners Among Service Providers
Hanover Suite B
Demonstration
Missing Data: Its Not Just for Statisticians Anymore
Baltimore Theater
Demonstration
Application of Computerized Adaptive Testing in Clinical Assessment
International Room
Evaluation 2007: Saturday, November 10, 3:30 pm to 5:00 pm, Timeslot Overview
Page 148
837 - Needs Assessment and Evaluation: Strategies
and Practical Applications
Think Tank to be held in the
Business and Industry and Needs Assessment TIGs
• Discussants - Catherine Sleezer, Baker-Hughes; Marcie
Bober, San Diego State University; Kelly Hannum and
Jennifer Martineau, Center for Creative Leadership
• Presenter - Darlene Russ-Eft, Oregon State University
838 - Applications Quasi-Experimental Evaluation
Techniques
Multipaper to be held in the International Ballroom Section B
• Chair - Sally Bond, The Program Evaluation Group
Findings and Methodological Lessons From an Evaluation of a
Project to Integrate the Arts Into Elementary School Reading
and Mathematics Instruction
• Paul Brandon and Brian Lawton, University of Hawaii
Selecting Matched Samples Using Propensity Scoring Analysis
• Manya Walton, Windwalker Corporation
Applying an Experimental Design to Evaluate the Effects on
Student Achievement and Attitudes of a Materials Science
Program Versus a Traditional Science Curriculum
• Kris Juffer, Action Research & Associates Inc
839 - Promoting Organizational Learning to Increase
International Development Effectiveness: Examples
From Three Catholic Relief Services Field Offices,
Europe; Middle East; Southern Africa; and El
Salvador
840 - Multiple Intelligences, Diversity in Learning
Styles, and Implications for Program Evaluation
Demonstration to be held in the International Ballroom Section
D on the Main Lobby Level in the Sheraton
• Eric Mundy, University of Akron
841 - Still Learning, After All These Years
Panel to be held in the International Ballroom on the Main
• Chair - Deborah Bonnet, DBonnet Associates
• Discussants - Michael Quinn Patton, Independent
Consultant; Michael Hendricks, Independent Consultant;
Marilyn Ray, Finger Lakes Law and Social Policy Center Inc
Old Tricks, New Territory
• Deborah Bonnet, DBonnet Associates
There's a First for Everything
• John Seeley, Federal Emergency Relief Administration
Life Lessons 2007: The Secrets of Senior Evaluators Revealed!
• Gail Barrington, Barrington Research Group Inc
842 - Evaluation and Social Metrics in the Nonprofit
Sector
• Chair - Huilan Yang, W K Kellogg Foundation
• Discussant - Victor Kuo, Bill & Melinda Gates Foundation
Performance Metrics and Evaluation in Large Foundations
• Victor Kuo, Bill & Melinda Gates Foundation
Social Metrics for Accountability
• Jianping Shen, Western Michigan University
Social Metrics for Organizational Learning
• Shao-Chee Sim, TCC Group
• Discussant - Guy Sharrock, Catholic Relief Services
Promoting a Participatory and Local Approach to
Organizational Learning in Catholic Relief Services' Europe
and Middle East Region
• Velida Dzino-Silajdzic, Catholic Relief Services
Meri Ghorkhmazyan, Catholic Relief Services
Managing Monitoring, Evaluation and Learning within Catholic
Relief Services' Southern African Regional Office
• Christopher Michael Reichert, Driss Moumane, and Guy
Sharrock, Catholic Relief Services
Institutionalizing Learning in Catholic Relief Services' El
Salvador Program
• Carolina Castrillo, Catholic Relief Services
Page 149
843 - Opportunities and Challenges: Evaluating for
Impact in Formal and Informal Learning Settings
• Chair - Sylvia James, National Science Foundation
Introductory Remarks From the Panel Chair
• Sylvia James, National Science Foundation
Evaluating for Impact: The 4-H Science, Engineering, and
Technology Initiative
• Suzanne Le Menestrel, United States Department of
Agriculture; Jill Stephanie Walahoski, University of Nebraska
Opportunities and Challenges Associated With the Informal
Science Education Program's Transformation From
Documenting Outputs to Outcomes: Experiences With the
Informal Science Education Online Monitoring System
• Gary Silverstein, Westat
Impacts and Legacies From Learning in Higher Education
Settings
• Mary Frances Sladek, NASA Headquarters
844 - Working to Address the Evaluation Needs of
More of the People More of the Time: Conducting
Evaluation in Multi-site and Multi-context Settings
MultiPaper to be held in the Mencken Room on the Main Lobby
• Chair - Frances Lawrenz, University of Minnesota
• Discussant - Frances Lawrenz, University of Minnesota
Results From the National Science Foundation (NSF) Advanced
Technological Education (ATE) Survey: Project-level Evaluation
Practices
• Arlen Gullickson, Western Michigan University
Evaluation of Workforce Needs Assessments Conducted by
Advanced Technological Education Projects and Centers
• Liesel Ritchie, Western Michigan University
Progression and Challenges of Conducting an Annual
Evaluation in Multi-site Settings
• Barbara Wygant, Western Michigan University
845 - Connecting Research and Implementation to
Enhance Youth Development Programming
MultiPaper to be held in the Edgar Allen Poe Room on the Main
• Chair - Melissa Cater, Louisiana State University
High School Youth: What do They Want?
• Robert Richard and Krisanna Machtmes, Louisiana State
University
Evaluating A Youth Development Program for Belonging and
Independence
• Melissa Cater and Krisanna Machtmes, Louisiana State
University
Promising Practices for Volunteers for Including Youth Voice in
the Decision-making Process
• Todd Tarifa and Krisanna Machtmes, Louisiana State
University
The Questioning Mind: Utilizing Reflection to Promote Critical
Thinking
• Janet Fox and Melissa Cater, Louisiana State University
Now What? We Have the Pieces. Can We Complete the Puzzle?
• Karol Osborne, Melissa Cater, and Robert Richard,
Louisiana State University
846 - Storytelling in Program Evaluation: Putting the
Timeless Miracles Into the Particulars of Experience
the Sheraton
Evaluation TIG
• Chair - Nuria Ciofalo, The California Endowment
Why Include Stories in Program Evaluation?
• Joseph Tobin, Arizona State University
Digital Storytelling: Empowering Community Residents to Tell
Their Stories and Getting Funders to Listen and Act Upon These
Stories
• Zoe Clayson, Abundantia Consulting
Community-based Organizations Tell Their Stories
• Michael Lyde and Larry Ginn, Role of Men
Popular Theater: Moving Ahead with Storytelling and Social
Change
• Mily Trevino, Organizacion en California de Lideres
Campesinas
Page 150
847 - National Performance Evaluation System of
Research and Development Programs in Korea:
System and Applications
MultiPaper to be held in the Pratt Room, Section A on the
• Chair - Sang-Youb Lee, Korea Institute of Science and
Technology Evaluation and Planning
• Discussant - Jiyoung Park, Korea Institute of Science and
Technology Evaluation and Planning
Method and Application of the Survey and Analysis of National
Research and Development (R&D) Programs for the
Performance Evaluation in Korea
• Keun-Ha Chung, Hyejung Joo, and Herin Ahn, Korea
Institute of Science and Technology Evaluation and Planning
The Performance Evaluation of Research and Development
Programs in Korea
• Seong-jin Kim and Soon Cheon Byeon, Korea Institute of
Science and Technology Evaluation and Planning
Design of Metaevaluation Model for National Research and
Development Programs in Korea
• Young Soo Ryu and Soon Cheon Byeon, Korea Institute of
Science and Technology Evaluation and Planning; Byung Dae
Choi, Hanyang University
Development of the Evaluation Methodology for the Basic
Research in Korea
• Hyeyoung Yang and Sangki Jeong, Korea Institute of
Science and Technology Evaluation and Planning
Performance Evaluation of Agriculture Research and
Development Programs in Korea
• Hoijong Jung, Korea Institute of Science and Technology
Evaluation and Planning
848 - Outcomes Measurement in Human Services
Evaluation: An Introduction
• James Sass, LA's BEST After School Enrichment Program
850 - Crossing the Threshold: Addressing
Methodological, Institutional and Cultural
Challenges in Environmental Evaluation in an Era of
Performance Management
• Chair - Katherine Dawes, US Environmental Protection
Agency
850 – Continued
The Methodological Challenge of Estimating Net Impacts of
Conservation Efforts: A Meta-Evaluation Analysis of Ten Impact
Studies Conducted by the National Fish and Wildlife
Foundation, 2003-2007
• Matthew Birnbaum, National Fish and Wildlife
Foundation
Environmental Program Evaluation Practice and Theory: Gaps
and Overlaps
• Matt Keene, US Environmental Protection Agency
The Environmental Evaluator's Networking Forum: Insights and
Future Applications
• Katherine Dawes, US Environmental Protection Agency
851 - Evaluating Educational Programs in the
Department of State's Bureau of Educational and
Cultural Affairs: Multiple Goal Sets and Multidimensional Changes
• Chair - Melinda Crowley, United States Department of
State
Department of State International Educational Programs and
Multiple Goal Sets
• Robin Silver, United States Department of State
Approaches to Learning: Department of State Educational
Program Evaluation Methodologies
• Norma Fleischman, United States Department of State
School Connectivity Program Evaluation: Methodology and
Findings
• Jill Tirnauer, United States Department of State
English Access Microscholarship Program: Methodology and
Findings
• Leslie Esterrich, United States Department of State
852 - Examining Evaluation Training, Practice and
Contexts in Various Settings
Panel to be held in the Adams Room on the Cabana Level in
the Sheraton North Tower
• Chair - Christina Christie, Claremont Graduate University
• Discussant - Christina Christie, Claremont Graduate
University
What Are we Preparing for? Evaluation Pedagogy Within
Master's Level Epidemiology Programs at Schools of Public
Health
• Leslie Fierro, Centers for Disease Control and Prevention
Filling the Training Gap: A Short Course Curriculum for
Practicing Evaluators
• Nicola Dawkins, Macro International Inc
Understanding the Development of Energy Program Evaluation
• Cynthia Austin, Heschong Mahone Group Inc
Page 151
853 - Roundtables
856 - Cross-validation of Empirical Findings From
Evaluations
Rotation I: Attending to the Learning Needs of Program
Stakeholders: Using Planned Variation Strategy in a College
Access Program Evaluation
• Kathryn Hill and Mary Lou Dresbach, Minnesota Office of
Higher Education
Rotation II: The Influence of Context on the Collection of Needs
Assessment Data
• Terry Ann Higa and Aric Nakamura, University of Hawaii
• Chair - Barbara Brumbach, Northern Arizona University
Rationale for Cross-validation
• Lee Sechrest, University of Arizona
The Quasi-population Approach as a Tool for Cross-validation
• Mei-kuang Chen, University of Arizona
Cross-validation of Parameter Estimates
• Michele Walsh, University of Arizona
Cross-validation of Models
• Barbara Brumbach, Northern Arizona University
854 - Evaluation Lessons in International Contexts:
Health Services and Infectious Diseases
857 - Multicultural Evaluation: Issues in Health and
Education Settings
• Chair - Monica Ruiz-Casares, McGill University
The Tradeoff Between Centralized and Decentralized Health
Services: Evidence From a Major Anti-Poverty Program in
Mexico
• Arturo Vargas-Bustamante, University of California,
Berkeley
Using the Extended Parallel Processing Model to Evaluate the
Impact of Avian and Pandemic Flu Communication Programs:
Lessons From Egypt's National Communication Campaign
2006
• Douglas Storey, Johns Hopkins University
Evaluation of HIV/AIDS Awareness Programs: How Well African
American Religious Community Do?
• Julien Kouame and Fatma Ayyad, Western Michigan
University
Health Workers' Performance Evaluation: A Better Approach
for Developing Countries
• Julien Kouame, Western Michigan University
855 - Does Quality Improvement Lead to
Organizational Learning?
Think Tank to be held in the D'Alesandro Room on the Cabana
• Discussants - Margaretta Fox, Harlem United Community
AIDS Center; Heather N Chapman, Chesapeake Center for
Youth Development Inc; Charles Gasper, Missouri
Foundation for Health; Candi Chitty, Quality First Healthcare
Consulting Inc; Melanie Hwalek, Social Program Evaluators
and Consultants Inc
• Presenters - Stanley Capela, HeartShare Human Services;
Rashi Rohatgi, Harlem United Community AIDS Center
• Chair - Kien Lee, Association for the Study and
• Discussant - Imelda Castañeda-Emenaker, University of
Cincinnati
How Culture Influences Program Impact: Evaluating a
HIV/AIDS Prevention Program in Tanzania
• Dominica McBride, Arizona State University
Evaluating Systems, Delivery, and Organizational Structure of a
Health Care Delivery Program in India
• Vamsi Vasireddy, University of Illinois, Chicago; Shankar
Rao Vasireddy, National Leprosy Eradication Programme,
India
858 - Using Appreciative Inquiry to Facilitate Change
in Organizational Practice
Skill-building Workshop to be held in the Preston Room on the
Building TIG
• Elaine Van Melle and Sheila Pinchin, Queen's University
859 - Using Baseline Assessment to Build Evaluation
Capacity and Foster Organizational Learning as Part
of a Transformative Change Process
Building TIG
• Srik Gopalakrishnan, Michael Palmisano, and Rex
Babiera, The Ball Foundation
Page 152
860 - Federal, State, and Local Disaster and
Emergency Planning and Preparedness: Strategies
and Case Studies for Evaluation
• Chair - Denise Bulling, University of Nebraska
• Discussant - Mary Davis, University of North Carolina,
Chapel Hill
Public Health Readiness: Lessons Learned From Using a
Community-Based, Participatory Approach to Evaluate Local
Public Health Preparedness Planning in Massachusetts
• Bryan Hall and Justeen Hyde, Institute for Community
Health
Homeland Security: The Federal, State, and Local Conundrum
• Christopher Cihlar and Sean McLaughlin, DFI Government
Services
Planning for Pandemic Influenza: Evaluation of a National
Public Engagement Process
• Denise Bulling and Mark DeKraai, University of Nebraska
Responder Alert Prophylaxis Initiative Drill (Operation RAPID):
Developing a Comprehensive Evaluation Strategy for a Multisite Evaluation
• Elizabeth Ablah and Kurt Konda, University of Kansas
School of Medicine; Eileen Scanlon, Nassau County
Department of Health; Leslie Horn and Kristine Gebbie,
Columbia University
862 - Perspectives on Federal Evaluation
• Chair - Kent Hutchinson, Florida State Legislature
Measuring the Effectiveness of Safety Training in the Mining
Industry: A Mixed-methods
• Lori Matthews, Spokane Research Laboratory
Striking a Balance: Guiding Local Evaluations From a Federal
Program Perspective
• Melanie Besculides and Charlotte Hanson, Mathematica
Policy Research Inc; Heather Zaveri, Mathematica Policy
Research Inc; Ryan Loo and Lisa Levy, Centers for Disease
Conducting a Utilization-focused Evaluation in Government
Contract Work: Perspectives From the Contractor and the
Government Client
• Sarah Shoemaker, Abt Associates Inc; Claire Kendrick,
Agency for Healthcare Research and Quality; Meg
Hargreaves and Rachel Sayko Adams, Abt Associates Inc;
Tricia Trinite, Agency for Healthcare Research and Quality;
Janice L Genevro, MasiMax Resources Inc; Harmon Jordan,
Abt Associates Inc
863 - Math and Science Evaluation
in the Radisson
• Chair - Anane Olatunji, George Washington University
Do You Really Know What You're Using? A Comparison of Two
Widely Used Science and Math Observation Instruments
• Martha Henry and Keith Murray, M A Henry Consulting
LLC
The Impact of Benchmark Assessments Aligned to State
Standards on Student Achievement
• Susan Henderson, WestEd; Sarah Guckenburg, Learning
Innovations at WestEd; Anthony Petrosino and Steve
Hamilton, WestEd
Layered Learning: Evaluating a Constructivist Mathematics
Approach in the Accountability Era
• Jennifer Coyne Cassata, Prince William County Public
Schools
864 - Evaluating After School, Supplemental
Services, and Out of School Programs
• Chair - Alison Williams, Clark County School District
Assessing the Effectiveness of Online Supplemental Education
Services
• Joel Shapiro, Rockman Et Al
Considering Dosage in After-School Programs: Linking Activity
Types to Outcomes
• Laurie Van Egeren, Celeste Sturdevant Reed, Heng-Chieh
Wu, and Nai-Kuan Yang, Michigan State University
Building Evaluation Capacity in 21st Century Community
Learning Center After-school Programs
• Tara Donahue, Learning Point Associates
Keeping Youth Engaged in Out-of-school Time Programs:
Results From a Five-year Evaluation in Denver Public Schools
• Robin Leake, Veronica Gardner, and Sheridan Green, JVA
Consulting LLC
865 - Centralized E-Tool for Organizational
Performance Management: National Institutes of
Health (NIH) Government Performance Result Acts
(GPRA) & Program Assessment Rating Tool (PART)
Assessments
Expert Lecture to be held in the Royal Board Room on the 19th
• Deborah Duran, National Institutes of Health
Page 153
866 - Substance Abuse Programming: Assessing
Fidelity of Implementation and Community-readiness
• Chair - Rena A. Agee, Macro International Inc
Analysis of Strategic Plans to Assess Fidelity to a Model-based
Planning Process
• Melissa Gutierrez Barrett, Ann Landy, and Robert Orwin,
Westat
Assessing School “Community Readiness” to Take Action:
Comparison of Structured Versus Semi-structured Interview
Methods
• Kristen Ogilvie, and Knowlton Johnson, Pacific Institute
for Research and Evaluation
Evaluating the Fidelity of Implementation of Research-based
Substance Abuse/School Crime Prevention Programs in
Schools
• Scott Crosse, Michele Harmon, Barbara Williams, Carol
Hagen, and Liam Ristow, Westat
26 States, 300 Communities, and One Fidelity Instrument:
Fabulous Feat or Futile Folly in the Strategic Prevention
Framework Cross-site
• Robert Orwin, Westat; Roy Gabriel, RMC Research
Corporation; Ann Landy and Janis Wolford, Westat
867 - Building and Assessing Capacity for
Evaluation: Creating Communities of Learners
Among Service Providers
868 - Missing Data: Its Not Just for Statisticians
Anymore
• Patrick McKnight, George Mason University
869 - Application of Computerized Adaptive Testing
in Clinical Assessment
• Chair - Kendon Conrad, University of Illinois, Chicago
• Presenters - Barth Riley, University of Illinois, Chicago;
Michael Dennis, Chestnut Health Systems
871 - Evaluation and Learning: The Challenges of
and Possibilities for Ongoing Learning and Reflective
Practice Among Evaluators
Plenary to be held in the
International Ballroom on the Main
• Chair - Michael Quinn Patton, Utilization-Focused
Evaluation
• Presenter - Hallie Preskill, Claremont Graduate University
in the Radisson
Evaluation TIG
• Chair - Tina Taylor-Ritzler, University of Illinois, Chicago
• Discussant - David Fetterman, Stanford University
Building Capacity for Evaluation Among Service Providers:
Conceptual Framework and Exemplar
• Yolanda Suarez-Balcazar, University of Illinois, Chicago
Measuring Evaluation Capacity: Methodologies and
Instruments
• Tina Taylor-Ritzler, University of Illinois, Chicago
Using Collaborative Evaluation as a Strategy for Evaluation
Capacity Building: First 5 Los Angeles' Quality Care Initiative
• Rita O'Sullivan, University of North Carolina, Chapel Hill
A Review of Research on Evaluation Capacity Building
Strategies
• Jennifer Duffy, University of South Carolina
Evaluation 2007: Saturday, November 10, 3:30 pm to 5:00 pm and 5:15 pm to 6:00 pm Page 154
Appendix A: Index of Presenters and Contributors
AAAAAAAA
Abdul-Hamid, Husein [614] University of Maryland University College; 240-582-2755; [email protected]
Abdu-Libdeh, Khattab [614] Jordan National Center For Human Resources Development; 011-962-6-533-1451; [email protected]
Ablah, Elizabeth [635-860] University of Kansas School of Medicine; 316-293-2627; [email protected]
Aboki, Lawal [414] Office of the Senior Special Assistant to the President on Millenium Development Goals; 234 9 234 8345;
[email protected]
Abrami, Philip [327] Concordia University; 514-848-2424; [email protected]
Acharya, Karabi [672] Academy for Educational Development; 202-884-8993; [email protected]
Achatz, Mary [352] Westat; 240-314-7523; [email protected]
Ackerman, Jason [348] Catholic Relief Services; 410-625-2220; [email protected]
Ackermann, Margot [131-684] Old Dominion University; 804-355-4443; [email protected]
Acosta, Joie [107-318-347] Association for the Study and Development of Community; 301-519-0722 x110; [email protected]
Adams, Jill [375] Colorado Foundation for Families and Children; 303-837-8466 x120; [email protected]
Adams, Kristin [418] Girls Incorporated; 317-634-7546; [email protected]
Adams, Laurie [418] Chautauqua County Health Department; 716-484-3325; [email protected]
Adams, Rachel Sayko [862] Abt Associates Inc; 617-349-2589; [email protected]
Addison-Scott, Kecia [796] Montgomery County Public Schools; 301-279-3194; [email protected]
Adoum, Djimé [631] United States Department of Agriculture; 202-401-0183; [email protected]
Afele-Faamuli, Saleia [111] United States Department of Agriculture; 202-720-0384; sfaamuliwcsrees.usda.gov
Affholter, Dennis [312-339] Affholter and Associates; 641-636-3045; [email protected]
Agaton, Kathleen [825] Metis Associates; 212-425-8833; [email protected]
Agee, Rena A. [866] Macro International Inc; 301-572-0340; [email protected]
Aguilar-Fernandez, Victor [131] Universidad Autonoma de Yucatan; 52-999-919-5824; [email protected]
Ahmadi, Mohammad Javad [110-351] Creative Associates International Inc; 93-0799 555 422; [email protected]
Ahn, Herin [847] Korea Institute of Science and Technology Evaluation and Planning; 82-2-589-2923; [email protected]
Ahn, Jeehae [305] University of Illinois at Urbana-Champaign; 217-332-2799; [email protected]
Alaimo, Sal [739] Indiana University; 404-297-9105; [email protected]
Alam, Mahboob [549] EngenderHealth; 011-880-2-811-9234; [email protected]
Alegre, Olga [761] University of La Laguna; 34922632924; [email protected]
Alexander, James [350] United States Department of State; 202-203-7831; [email protected]
Alkin, Marvin [442-660-705] University of California at Los Angeles; 310-825-4800; [email protected]
Alldredge, Elham Eid [607] REDA International Inc; 301-946-9790 x101; [email protected]
Allen, Josephine [131] Cornell University; 617-255-1973; [email protected]
Allen, Katy [131] University of Rochester; 585-223-3531; [email protected]
Allen, Marisa [131-407] Case Western Reserve University; 505-471-8177; [email protected]
Allison, Paige [131] Alachua County Public Schools; [email protected]
Almatrodi, Dhaifallah [422] Western Michigan University; 269-823-8695; [email protected]
Altschuld, James W [315-342-499-752-789-820] The Ohio State University; 614-292-7741; [email protected]
Ammerman, Alice [666] University of North Carolina, Chapel Hill; 919-966-6082; [email protected]
Amo, Courtney [603] Social Sciences and Humanities Research Council of Canada; 613-944-6232; [email protected]
Anderson, Bernice [678] National Science Foundation; 703-292-9179; [email protected]
Anderson, Cory [529] Annie E Casey Foundation; 410-547-6600; [email protected]
Anthony, Beth [131] Georgia State University; 404-323-6046; [email protected]
Applegate, Brooks [422-731] Western Michigan University; 269-387-3886; [email protected]
Appleton, Sarah [113] University of Auckland; 64 9 373 7599; [email protected]
Apt, Betty [335-389] Centers for Disease Control and Prevention; 404-639-8035; [email protected]
Apthorp, Helen [433] Mid-continent Research for Education and Learning; 303-623-5622; [email protected]
Arai, Yoshikazu [544] National Institute of Advanced Industrial Science and Technology; 81-29-861-6096; [email protected]
Araujo, John [762] Centers for Disease Control and Prevention; 404-639-7266; [email protected]
Araujo, Rochelle [831] United States Environmental Protection Agency; [email protected]
Archer, Gregory [365] Archer, Searfoss and Associates Inc; 602-997-1627; [email protected]
Archer, Thomas [545-777] The Ohio State University; 614-292-0179; [email protected]
Arens, Sheila [127-323-472] Mid-continent Research for Education and Learning; 303-632-5625; [email protected]
Arimi, Hellen [672] World Agroforestry Centre; [email protected]
Arkison, Brad [131] University of Alberta; 780-492-1720; [email protected]
Evaluation 2007: Appendix A – Index of Presenters and Contributors
Page 155
Arman, Rebecka [528] Göteborg University; [email protected]
Armstead, Clifford [131] Working For Togetherness; 773-265-5626; [email protected]
Armstrong, Mary [607-683] University of South Florida; 813-974-4601; [email protected]
Arnold, Erik [329-592] Technopolis; 01273 204320; [email protected]
Arnold, Mary [121-397-432-667] Oregon State University; 541-737-1315; [email protected]
Arora, Sanjeev [131] University of New Mexico; 505-272-2808; [email protected]
Arteaga, S Sonia [318] Association for the Study and Development of Community; 301-519-0722; [email protected]
Arthanat, Sajay [757] University at Buffalo; 716-829-3141 x158; [email protected]
Arugam, Mangi [680] Chicago Public Schools; 312-765-0291; [email protected]
Asbury, Jo-Ellen [475] Villa Julie College; 443-334-2181; [email protected]
Ashley, Shena [390] Georgia State University; 404-931-9759; [email protected]
Asiamah, David [636] University of South Carolina; 803-777-4137
Askew, Karyl [340-663] University of North Carolina, Chapel Hill; 919-843-7878; [email protected]
Atkinson, David [131] Community Care Services; 313-389-7525; [email protected]
Atkinson, Jeff [131] Montreal Children's Hospital; 514-412-4400
Atkinson, Nancy [715] University of Maryland, College Park; 301-405-2522; [email protected]
Aton, Kanani [620-782] Hawaiian Education Services; 808-969-6864; [email protected]
Austin, Cynthia [852] Heschong Mahone Group Inc; 916-962-7001 x15; [email protected]
Autio, Elizabeth [474] Northwest Regional Educational Laboratory; 503-275-9593; [email protected]
Avery, Dee Dee [809] University of Arizona; 520-381-7259 x144; [email protected]
Aytur, Semra [666] University of North Carolina; 919-960-9893; [email protected]
Ayyad, Fatma [854] Western Michigan University; 269-267-2347; [email protected]
Azin, Mariam [102-770] Planning, Research and Evaluation Services Associates Inc; 307-733-3255; [email protected]
Azzam, Tarek [541-567-647] University of California, Los Angeles; 909-374-5355; [email protected]
BBBBBBBB
Babiera, Rex [859] The Ball Foundation; 630-469-6270; [email protected]
Babu, Ajit [131] Amrita Institute of Medical Sciences; 91-0-484-280-1234; [email protected]
Bacon, Caren [718] University of Missouri, Columbia; 573-884-3381; [email protected]
Baehr, Allyson [398] LeCroy & Milligan Associates Inc; 520-326-5154 x112; [email protected]
Baggett, Connie [131] Pennsylvania State University; 814-863-7415; [email protected]
Baggett, Rebecca [131] JVA Consulting LLC; 303-477-4896; [email protected]
Bagnell Stuart, Jennifer [669] Innovation Network Inc; 202-728-0727 x118; [email protected]
Baizerman, Michael [394] University of Minnesota; 651-308-0345; [email protected]
Baker, Anita [610] Anita Baker Consulting; 609-397-8722; [email protected]
Baker, Jock [742] CARE International; 41 22 795 1020; [email protected]
Bakerson, Michelle [767] Western Michigan University; 269-684-5566; [email protected]
Baldwin, Kevin [328] Wellsys Corporation; 770-717-5119; [email protected]
Ballantyne, Christina [761] Murdoch University; 61-8-9360-2289; [email protected]
Ballesteros, Edith [418] LA's BEST After School Enrichment Program; 213-745-1900 x52939; [email protected]
Baltes, Jessica [114] Center for Creative Leadership; 719-329-7822; [email protected]
Balwanz, David [778] Academy for Educational Development; 202-607-5772; [email protected]
Bamba, Abderahamane [465] Catholic Relief Services; [email protected]
Bamberger, Michael [413] Independent Consultant; 503-641-8633; [email protected]
Banerjee, Kakoli [651] United States Department of Health and Human Services; 408-792-5683; [email protected]
Bangi, Audrey [622] University of California, San Francisco; 773-325-4476; [email protected]
Banks, Steven [560] University of South Florida; 813-974-7956; [email protected]
Baptiste, Lennise [458] Kent State University; 330-812-4394; [email protected]
Barbosa, Rodnie [547] District of Columbia Public Schools; 202-465-2493; [email protected]
Barbosa, Tamara J [362-547-662] PhD's Consulting; 202-271-7033; [email protected]
Barela, Eric [307-455-604-721-778] Los Angeles Unified School District; 213-241-8287; [email protected]
Barile, John [131] Georgia State University; 404-651-3394; [email protected]
Barley, Zoe [718] Mid-continent Research for Education and Learning; 303-632-5611; [email protected]
Barlow, Amy [131] University of California, Davis; 530-754-9085 x1; [email protected]
Barnes, Dionne [107] RAND Corporation; 310-393-0411 x7313; [email protected]
Barnes, Harley [797] LM Business Process Solutions; 301-519-6322; [email protected]
Barnett, Donell [559] Oklahoma State University; 405-204-4546; [email protected]
Barrington, Gail [594-841] Barrington Research Group Inc; 403-289-2221; [email protected]
Page 156
Bartholomay, Tom [777] University of Minnesota; 612-626-2162; [email protected]
Barton, Lauren [623] SRI International; 650-859-4856; [email protected]
Basson, Ray [366] University of the Witwatersrand; 27 11 717-3091; [email protected]
Bassow, Amanda [617] National Fish and Wildlife Foundation; 202-857-0166; [email protected]
Basta, Kelle [131-390] Caliber an ICF International Company; 703-279-4678; [email protected]
Bates, Laura [721] Michigan State University; 517-353-8977; [email protected]
Batsche, Catherine [763] University of South Florida; 813-974-7196; [email protected]
Batson, Annalisa [514] HB Consultation & Evaluation Associates LLC; 701-775-5443; [email protected]
Bauer, Cynthia Agens [343] Administration on Aging; 202-357-0145; [email protected]
Baughman, Marcy [770] Pearson Educational Measurement; 617-671-2652; [email protected]
Bauldry, Shawn [131] University of North Carolina; 919-967-7045; [email protected]
Baum, Herbert [346] National Institutes of Health; 301-572-0816; [email protected]
Baumer, Steve [131] Mental Health Center of Denver; 303-575-5245; [email protected]
Bechberger, Elena [413] London School of Economics and Political Science; 00-44-207-798-7873; [email protected]
Beesley, Andrea [127-472] Mid-continent Research for Education and Learning; 303-632-5541; [email protected]
Behrens, Joy [369] World Bank; 202-578-8631; [email protected]
Behrens, Teresa [484-503-611-808] W K Kellogg Foundation; 269-969-2038; [email protected]
Belanger, Jean L [327] University of Montreal; 514-987-3000 x4256; [email protected]
Belanger, Yvonne [761] Duke University; 919-660-6936; [email protected]
Bell, Rolanda [423] Arizona Department of Education; 602-542-5151; [email protected]
Bellamy, Nikki [330] United States Department of Health and Human Services; 240-276-2418; [email protected]
Bellatty, Paul [391] Oregon Department of Corrections; 503-947-1010; [email protected]
Belle, Stuart [348] World Vision International; 202-572-6530; [email protected]
Bellow, Andrew [625] Network for a Healthy California; 916-449-5547; [email protected]
Bender, Kim [554] Colorado State University; 970-491-5388; [email protected]
Bender, Shera [672] Independent Consultant; 202-566-1264; [email protected]
Benham, Maenette [392-611] Michigan State University; 517-355-6613; [email protected]
Benjamin, Lehn [303] George Mason University; [email protected]
Bentlejewski, Jennifer [509] University of Maryland Cooperative Extension; 301-334-6960; [email protected]
Bentley, Joanne [387] Utah State University; 435-797-2689; [email protected]
Berent, Rusti [436-636] University of Rochester; 585-295-1000 x246; [email protected]
Berger, Andrea [787] American Institutes for Research; 202-403-6927; [email protected]
Berger, Dale [332-367] Claremont Graduate University; 909-625-5783; [email protected]
Berger, Jill [390] Caliber an ICF International Company; 703-277-6687; [email protected]
Bergeron, Jenny [461-702] University of Florida; 352-392-0723; [email protected]
Berkley, Anthony [328] W K Kellogg Foundation; 269-969-2235; [email protected]
Berkowitz, Gail [808] Packard Foundation; 510-287-2174; [email protected]
Berkowitz, Gale [355] Packard Foundation; 510-287-2174; [email protected]
Bernard, Robert [327] Concordia University; 514-848-2424; [email protected]
Bernstein, David J [631-794-828] Westat; 301-738-3520; [email protected]
Berry, Jennifer [799] Stanford University; 650-498-4954; [email protected]
Berry, Tiffany [770] Claremont Graduate University; 909-607-1540; [email protected]
Bertrand, Tamara [517-823] Florida State University; 850-644-5590; [email protected]
Besculides, Melanie [862] Mathematica Policy Research Inc; 609-945-3369; [email protected]
Bessell, Ann [338] University of Miami; 305-284-5826; [email protected]
Beverly, Monifa [131] University of North Carolina, Chapel Hill; 919-843-7878; [email protected]
Bhattacharya, Gargi [780] Southern Illinois University, Carbondale; 618-453-3504; [email protected]
Bialeschki, M Deborah [667] American Camp Association; 765-349-3318; [email protected]
Bickel, Bill [109-639] University of Pittsburgh; 412-624-7091; [email protected]
Bickel, Samuel [477-572] United Nations Children's Fund; 212-326-7504; [email protected]
Bickman, Leonard [505] Vanderbilt University; 615-322-8694; [email protected]
Billing, Amy [715] University of Maryland, College Park; 301-405-9167; billing@umd,edu
Billy, Carrie [628] American Indian Higher Education Consortium; 703-838-0400; [email protected]
Birnbaum, Matthew [415-617-850] National Fish and Wildlife Foundation; 202-715-0700; [email protected]
Blair, Daniel [531] American Society for Training & Development; 703-683-8120; [email protected]
Blake, Eileen [131] Yale New Haven Health; 203-688-2519; [email protected]
Blanchette, Cheryl [125] Harder & Company Community Research; 619-398-1980; [email protected]
Blase, Karen [607] University of South Florida; 813-974-4463; [email protected]
Blau, Gary [758] United States Department of Health and Human Services; 240-276-1921; [email protected]
Page 157
Bledsoe, Katrina [448-622-633-685] The College of New Jersey; 609-771-2582; [email protected]
Bleiker, Charles [328] Florida International University; 305-348-0462; [email protected]
Boardman, P Craig [329] Science and Technology Policy Institute; 202-419-5480; [email protected]
Bober, Marcie [307-483-767-837] San Diego State University; 619-594-0587; [email protected]
Bogatova, Tania [333] KeyStone Research Corporation; 814-836-9295; [email protected]
Bol, Linda [725] Old Dominion University; 757-683-6684; [email protected]
Bolland, Kathleen [371] University of Alabama; 205-348-3926; [email protected]
Bolton, Patricia [359] Battelle Centers for Public Health Research and Evaluation; 206-528-3310; [email protected]
Bond, Sally [668-838] The Program Evaluation Group; 919-932-7273; [email protected]
Bonnet, Deborah [841] DBonnet Associates; 317-259-0071; [email protected]
Bonnie, Swaine [131] University of Montreal; 514-343-6111; bonnie.swaine@umontreal
Booth, Bette [672] Academy for Educational Development; 505-424-8866; [email protected]
Boothroyd, Roger [528-560-763] University of South Florida; 813-974-1915; [email protected]
Borden, Lynne [113-605] University of Arizona; 520-621-1063; [email protected]
Boser, Susan [377-589] Indiana University Pennsylvania; 724-357-1291; [email protected]
Bosma, Linda [763] Bosma Consulting LLC; 612-721-4998; [email protected]
Botcheva, Luba [425] The Children's Health Council; 650-617-3869; [email protected]
Botein, Hilary [552] University of Connecticut; 203-236-9813; [email protected]
Bothwell, Eric [724] Independent Consultant; 301-774-4976; [email protected]
Bowen, Cathy [131] Pennsylvania State University; 814-863-7870; [email protected]
Bowen, Kathryn [716] BECS Inc; 570-882-9481; [email protected]
Bowles, Kathy [781] Duval County Public Schools; 904-390-2131; [email protected]
Bowman, Nicole [116-557] Bowman Performance Consulting LLC; 715-526-9240; [email protected]
Bowman, Richard [585] University of Arizona; 520-318-7259 x165; [email protected]
Bowman, Sally [679] Oregon State University; 541-737-1020; [email protected]
Boyd, Heather [307-361-397-432] Virginia Tech; 540-231-9423; [email protected]
Boyd, Ian [131] DFI Government Services; 202-533-0022; [email protected]
Boyle, Shanelle [306-341] Claremont Graduate University; 909-921-6099; [email protected]
Brackett, Ann [402] Learning Innovations at WestEd; 781-481-1100; [email protected]
Braitman, Abby [131] Old Dominion University; 757-683-4463; [email protected]
Brandi, Karen [104] Children's Services Council of Palm Beach County; 561-655-1010 x2206; [email protected]
Brandon, Paul [838] University of Hawaii; 808-956-4928; [email protected]
Braud, Emily [577] Louisiana State University; 225-578-2633; [email protected]
Braun, Kathryn L [382-452] University of Hawaii; 808-330-1759; [email protected]
Braun, Margaret [119] Portland State University; 503-803-0528; [email protected]
Braverman, Marc [612-679] Oregon State University; 541-737-1021; [email protected]
Braza, Mark [450] United States Government Accountability Office; 202-512-7187; [email protected]
Brecher, Charles [664] New York University; 212-998-7449; [email protected]
Brehm, Connie [475] Azusa Pacific University; 626-815-5215; [email protected]
Breslin, Deanna [131] Circle Solutions; 703-451-6166; [email protected]
Bridgers, James [425] The MayaTech Corporation; 301-587-1600 x2101; [email protected]
Bridgers Jr, James C [131] University of Maryland, College Park; 301-587-1600; [email protected]
Bridges, Keith [406] Charter Theatre; 202-333-7009; [email protected]
Briggs, Chad [834] Southern Illinois University, Carbondale; 618-453-3551; [email protected]
Brindis, Claire [345-818] University of California, San Francisco; 415-476-5255; [email protected]
Brisolara, Sharon [441-469-685] Evaluation Solutions; 530-244-4407; [email protected]
Britsch, Brenda [579] Puget Sound Center for Teaching, Learning and Technology; 425-368-1020; [email protected]
Broadway, Francis [520] University of Akron; 330-972-6983; [email protected]
Brodish, Paul [820] Pacific Institute for Research and Evaluation; 919-265-2618; [email protected]
Brooks, Ariana [604] HeartShare Human Services; 718-422-4231; [email protected]
Brooks, Constance W [382] University of Missouri, Columbia; 573-882-0206; [email protected]
Brooks, Pauline [620] Brooks Cross Cultural/International Evaluation, Research and Racism Consulting; 323-821-5891;
[email protected]
Brown, Antoinette [572] Independent Consultant; 919-376-8746; [email protected]
Brown, Christopher [804] Pearson School Companies; 201-236-5385; [email protected]
Brown, Clarice [113] Social & Scientific Systems Inc; 301-628-0324; [email protected]
Brown, Courtney [506-723] Indiana University; 812-855-4438; [email protected]
Brown, Jennifer [501] Cornell University; 607-255-2864; [email protected]
Brown, Marcia [563] Foundations of Success; [email protected]
Page 158
Brown, Tanya [337] Duquesne University; 412-606-1809; [email protected]
Browne, Angela [737] RTI International; 202-974-7859; [email protected]
Bruce, Stewart [777] Pennsylvania State University; 814-863-7609; [email protected]
Bruckerhoff, Charles [507] Curriculum Research & Evaluation Inc; 860-455-1229; [email protected]
Brumbach, Barbara [856] Northern Arizona University; 520-903-1296; [email protected]
Brun, Carl [819] Wright State University; 937-775-2751; [email protected]
Bruner, Beth [610] Bruner Foundation; 585-385-2997; [email protected]
Brunner, Jason [340] Kansas State University; 785-410-7429; [email protected]
Bruns, Karen [545] The Ohio State University; 614-292-9613; [email protected]
Bryant, Cassie [708] Cassandra Drennon & Associates; 706-543-2971; [email protected]
Bucci, Paul [719] Academy for Educational Development; 202-884-8158; [email protected]
Bull, Sheana [607] University of Colorado, Denver; [email protected]
Bulling, Denise [860] University of Nebraska; 402-472-1509; [email protected]
Burch, Robert [748] Academy for Educational Development; 2-02-338-4781; [email protected]
Burdine, Joselyn [609] Centers for Disease Control and Prevention; 803-978-7584; [email protected]
Burdon, Luc [658] Transport Canada; 613-998-2984; [email protected]
Burgon, Holli [336] University of Illinois at Urbana-Champaign; 217-333-5350; [email protected]
Burke, Meghan [322] University of Illinois, Chicago; 312-413-3656; [email protected]
Burkum, Kurt [486-562-836] National Council for Community and Education Partnerships; 202-530-1135; [email protected]
Burleson, Les [400] Syracuse University; 315-443-8700; [email protected]
Burling, Andrea S [131] American Institutes for Research; 650-843-8159; [email protected]
Burns, Melissa [124] Concept Systems Inc; 607-272-1206; [email protected]
Burr, Erin [131-684] University of Tennessee; 757-567-9058; [email protected]
Burrus, Barri [117] RTI International; 941-486-0245; [email protected]
Burt, Peter [439] Vermont Division of Vocational Rehabilitation; 802-786-5926; [email protected]
Busch, Melissa [390] Caliber an ICF International Company; 703-219-4364; [email protected]
Bustos-Navarro, Amparo [747] JBS International Inc; 650-272-4900; [email protected]
Butler, Catherine [131] Old Dominion University; 757-650-8672; [email protected]
Butler, Mary Odell [640] Battelle Centers for Public Health Research and Evaluation; 800-201-2011; [email protected]
Byeon, Soon Cheon [847] Korea Institute of Science and Technology Evaluation and Planning; 82-2-589-2947; [email protected]
CCCCCCCC
Cabin, William [131-560-709] Youth Consultation Service; 201-445-9180; [email protected]
Cabrera, Derek A [409-634-706] Cornell University; 607-592-4562; [email protected]
Cachaper, Cecile [323] Independent Consultant; 540-392-2494; [email protected]
Callahan, Jamie [598] Texas A&M University; 979-458-3584; [email protected]
Callow-Heusser, Catherine [363-730] EndVision Research and Evaluation; 435-757-2724; [email protected]
Calvert, Matthew [624] University of Wisconsin; 608-262-1912; [email protected]
Cameron, Christopher [436-534-561] Calgary Health Region; 403-297-2452; [email protected]
Cameron, Sonya [354] Department of Child, Youth and Family Services; 644-919-9311; [email protected]
Campbell, Bernadette [541-660-740] Carleton University; 613-520-2600 x4080; [email protected]
Campbell, James [421] Catholic Relief Services; 260-1-224131; [email protected]
Campbell, Linda [787] Center for Native American Educational Advancement; 206-268-4607; [email protected]
Campos, David [643] University of the Incarnate Word, San Antonio; 210-434-5456; [email protected]
Canavero, Steve [306-420] University of Nevada, Reno; 445-322-5208; [email protected]
Canen, Eric [555] University of Wyoming; 307-742-4208; [email protected]
Capela, Stanley [557-794-855] HeartShare Human Services; 718-422-4248; [email protected]
Caracelli, Valerie J [413-521-631] United States Government Accountability Office; 202-512-9792; [email protected]
Carbullido, Celine [324] United Methodist Committee on Relief-Katrina Aid Today; 202-955-4072; [email protected]
Carey, Catherine [131] Practical Research; 443-320-0570; [email protected]
Carey, Martha Ann [104-307-475-499] Azusa Pacific University; 626-815-5386 x5215; [email protected]
Carey, Nancy [304] Maryland State Department of Education; 410-767-0441; [email protected]
Carleton-Hug, Annelise [380-415-507] Trillium Associates; 406-579-5145; [email protected]
Carman, Joanne [739] University of North Carolina, Charlotte; 704-687-4533; [email protected]
Carnohan, Bruce [333] KeyStone Research Corporation; 814-836-9295; [email protected]
Carpenter, Kelly [131] Old Dominion University; 757-285-9182; [email protected]
Carran, Deborah [391] Johns Hopkins University; 410-309-9535; [email protected]
Carrillo, Nancy [131-680] Albuquerque Public Schools; 505-848-8725; [email protected]
Page 159
Carson, Taj [605] Carson Research Consulting Inc; 410-366-1779; [email protected]
Carter, Ruth [815] University of Arizona; 602-470-8086; [email protected]
Cartland, Jenifer [820] Childrens' Memorial Hospital, Chicago; 312-573-7772; [email protected]
Caruthers, Flora [601] National Legislative Program Evaluation Society; 850-487-9226; [email protected]
Cassaro, Denice [307-400-441-469-685] Cornell University; 607-256-0373; [email protected]
Cassi, Lorenzo [364] Luigi Bocconi University; [email protected]
Cassidy, Sheila [662] Wexford; 310-548-0077; [email protected]
Castañeda-Emenaker, Imelda [676-857] University of Cincinnati; 513-556-3816; [email protected]
Castrillo, Carolina [839] Catholic Relief Services; 011-503 2298 1688; [email protected]
Cater, Melissa [777-845] Louisiana State University; 318-744-5442; [email protected]
Catsambas, Tessie [409-533-655-764-786] EnCompass LLC; 301-299-3266; [email protected]
Cauley, Katherine [819] Wright State University; [email protected]
Causton, Alex [348] Catholic Relief Services; 92-300-852-0214; [email protected]
Cawley, Margaret [593] National Development and Research Institutes Inc; 919-863-4600 x223; [email protected]
Cekan, Jindra [465] Jindra Cekan LLC; [email protected]
Celebucki, Carolyn [653] University of Rhode Island; 401-277-5490; [email protected]
Cerpas, Nayeli [125] Harder & Company Community Research; 415-522-5400; [email protected]
Chabot, Alexandre [327] University of Montreal; 514-393-4666 x2019; [email protected]
Chambers, Andrea [835] University of Arizona; 434-243-5243; [email protected]
Chambless, Cathy [439] University of Utah; 801-585-0371; [email protected]
Champagne, François [131-597] University of Montreal; 514-343-6111; [email protected]
Chan, Ya-Fen [128-403] Chestnut Health Systems; 309-820-3543; [email protected]
Chang, Connie [435] United States Department of Commerce; 202-482-6814; [email protected]
Channell, Linda [434-443] Jackson State University; 601-979-1023; [email protected]
Chantry, Brian [108] Brigham Young University; 801-422-5336; [email protected]
Chapel, Thomas [117-335-389-566-678] Centers for Disease Control and Prevention; 678-296-8436; [email protected]
Chaplowe, Scott [324-417-783] American Red Cross; 94 0 77 3596449; [email protected]
Chapman, Heather [363-730] EndVision Research and Evaluation; 801-710-5987; [email protected]
Chapman, Heather N [855] Chesapeake Center for Youth Development Inc; 410-355-4698 x21; [email protected]
Chapman, Lauren [131] Boston College; [email protected]
Chatterji, Madhabi [796] Teachers College Columbia University; 212-678-3357; [email protected]
Chavez, Regino [682] Los Angeles Unified School District; 213-241-6476; [email protected]
Chavez, Teresa [625] University of South Florida; 813-974-3220; [email protected]
Chavis, David [318-347] Association for the Study and Development of Community; 301-519-0722 x109; [email protected]
Chelyshkova, Marina [673] State University of Management; 7 495 590-97-91; [email protected]
Chen, Huey T [501] University of Alabama, Birmingham; 205-934-7717; [email protected]
Chen, Karen [131-344] Wheeling Jesuit University; 304-243-2377; [email protected]
Chen, Mei-kuang [518-626-856] University of Arizona; 520-621-5463; [email protected]
Chen, PeiYao [667] Girls Incorporated; 212-509-2000 x215; [email protected]
Chen, Ren [683] University of South Florida; 813-974-4466; [email protected]
Cheng, Shu-Huei [339] National Hsinchu University of Education; 886-3-5341095; [email protected]
Chianca, Thomaz [106-674-703-736] Western Michigan University; 269-387-3207; [email protected]
Chitty, Candi [855] Quality First Healthcare Consulting Inc; 352-473-0580; [email protected]
Chmelka, Beth [788] Girls and Boys Town; 402-498-3213; [email protected]
Cho, Yee-Ann [787] Bill & Melinda Gates Foundation; 206-709-3151; [email protected]
Choi, Byung Dae [847] Hanyang University; 82-2-2220-0810; [email protected]
Choi, Mona [762] Centers for Disease Control and Prevention; 404-498-6627; [email protected]
Chollette, Veronica [131] National Institutes of Health; 301-435-2837; [email protected]
Chouinard, Jill [410] University of Ottawa; 613-722-6384; [email protected]
Christian, Jeanine [347] Battelle Centers for Public Health Research and Evaluation; 410-372-2751; [email protected]
Christie, Christina [306-442-505-567-852] Claremont Graduate University; 909-607-9020; [email protected]
Chung, Keun-Ha [847] Korea Institute of Science and Technology Evaluation and Planning; 82-2-589-2812; [email protected]
Cianfrani, Marcia [684] Old Dominion University; 757-683-4591; [email protected]
Cihlar, Christopher [131-860] DFI Government Services; 202-416-0135; [email protected]
Cimetta, Adriana [543] University of Arizona; 520-626-0735; [email protected]
Ciofalo, Nuria [846] The California Endowment; 213-928-8670; [email protected]
Cioffi, Joan [117-389] Centers for Disease Control and Prevention; 404-498-6429; [email protected]
Cisneros-Cohernour, Edith J [131-323] Universidad Autonoma de Yucatan; 52-999-919-5824; [email protected]
Clark, M H [834] Southern Illinois University, Carbondale; 618-453-3551; [email protected]
Page 160
Clark, Maria [471-616-654] United States Army Command and General Staff College; 913-684-7275; [email protected]
Clark, Patrick [429-678] National Institutes of Justice; 202-353-9482; [email protected]
Claros, Elias [331] Consultative Group on International Agricultural Research; 572-4450000; e.claros.cgiar.org
Clasen, Carla [819] Wright State University; [email protected]
Clawson, Heather [682] Caliber an ICF International Company; 703-219-4427; [email protected]
Clayson, Zoe [355-818-846] Abundantia Consulting; 415-359-9671; [email protected]
Clements, Paul [106-703-817] Western Michigan University; 269-387-5699; [email protected]
Clementz, A Rae [118-305-677] University of Illinois at Urbana-Champaign; 217-848-1561; [email protected]
Clendenning, Greg [507] Nexus Market Research Inc; 202-232-4870; [email protected]
Clinton, Janet [113] University of Auckland; 64 9 3737599; [email protected]
Clinton, Kristina [751] Sacramento County Dept of Health Services; 916-875-5869; [email protected]
Clymer, Carol [131] Public/Private Ventures; 215-557-4495; [email protected]
Cochran, Norris [779] United States Department of Health and Human Services; 202-690-7846; [email protected]
Cocos, Becky [373-558] Georgia Institute of Technology; 404-385-0889; [email protected]
Coe, Michael [129] Northwest Regional Educational Laboratory; 503-275-9497; [email protected]
Coffman, Arian Sunshine [626] University of Arizona; 520-318-7259 x145; [email protected]
Coffman, Julia [310-478-749] Harvard Family Research Project; 703-837-8358; [email protected]
Cohen, Alex [329] The National Academies; 734-276-2872; [email protected]
Cohen, Elena [107] Safe Start Center; 240- 645-4824; [email protected]
Cole, Brendan [124] National Institutes of Health; 301-451-2729; [email protected]
Collinns, Isabelle [592] Technopolis; 44 1273 204320; [email protected]
Collins, Dayne [335] Centers for Disease Control and Prevention; 404-639-8188; [email protected]
Colosi, Laura [634] Cornell University; 607-592-1530; [email protected]
Comer Cook, Tiffany [728-832] University of Wyoming; 307-760-1911; [email protected]
Compton, Donald [394] Centers for Disease Control and Prevention; 678-457-3155; [email protected]
Conley, Dave [707] Museum of Science & Industry; 813-987-6340; [email protected]
Conner, Amy [659] Kansas State University; 785-494-2339; [email protected]
Conner, Ross [130-311-594] University of California, Irvine; 949-824-6746; [email protected]
Connors, Susan [386-428] University of Colorado, Denver; 303-556-6179; [email protected]
Conrad, Karen [128] University of Illinois, Chicago; 312-413-0739; [email protected]
Conrad, Kendon [128-403-753-869] University of Illinois, Chicago; 312-996-3185; [email protected]
Contandriopoulos, Damien [597] University of Montreal; 514-343-6111 x0323; [email protected]
Cook, Ann Marie [610] Lifespan of Greater Rochester; 585-244-8400; [email protected]
Cook, Cheryl [314-349] United States Department of State; 202-453-8813; [email protected]
Cooksey, Clay [335] Centers for Disease Control and Prevention; 770-488-1034; [email protected]
Cooksy, Leslie [413-751] University of California, Davis; 530-757-3190; [email protected]
Cooper-Martin, Elizabeth [363-830] Montomgery County Public Schools; 301-279-3186; [email protected]
Copeland-Carson, Jacqueline [640] Copeland Carson and Associates; 612-868-0737; [email protected]
Coplen, Michael [658] Federal Railroad Administration; 202-493-6346; [email protected]
Coraggio, James [625] University of South Florida; 727-533-8866; [email protected]
Corn, Jeni [129-810] University of North Carolina, Greensboro; 919-402-1060; [email protected]
Corrocher, Nicoletta [364] Luigi Bocconi University; 39-02-5836-3391; [email protected]
Cory, David [560] New Horizons Family Connections; 325-437-1852; [email protected]
Coryn, Chris [307-340-604-773] Western Michigan University; 269-345-1415; [email protected]
Costello, Ann [610] Golisano Foundation; 585-340-1203; [email protected]
Coulter, Shannon [785] University of Tennessee, Knoxville; 865-769-1761; [email protected]
Coulton, Claudia [131-664] Case Western Reserve University; [email protected]
Cousins, J Bradley [306-342-410-603-705] University of Ottawa; 613-562-5800 x4036; [email protected]
Coyne Cassata, Jennifer [863] Prince William County Public Schools; 703-791-7277; [email protected]
Craddock, Gail [593] National Development and Research Institutes Inc; 919-863-4600 x226; [email protected]
Craig, Bart [376] North Carolina State University; 919-513-0518; [email protected]
Cram, Fiona [116-354-620-782] Katoa Ltd; 644-976-1473; [email protected]
Crary, Don [381-529] Annie E Casey Foundation; 410-547-6600; [email protected]
Crave, Mary T [679] University of Wisconsin; 608-262-6677; [email protected]
Crean, Allison [774] Informed Educators Consulting Group; 484-373-0167; [email protected]
Cremonini, Roberto [808] Barr Foundation; 617-854-3132; [email protected]
Cromack, Jamie [562] Microsoft Research, External Research and Programs; 425-421-9179; [email protected]
Crosse, Scott [866] Westat; 301-294-3979; [email protected]
Crowley, Kathleen [131] Circle Solutions; 703-902-1273; [email protected]
Page 161
Crowley, Melinda [350-851] United States Department of State; 202-203-7136; [email protected]
Crume, Tessa [645] Rocky Mountain Center for Health Promotion and Education; 303-239-6976; [email protected]
Crusto, Cindy [729] Yale University; 203-789-7645; [email protected]
Crystal Foster, Catherine [582-714] Blueprint Research & Design Inc; 650-325-0187; [email protected]
Csuti, Nancy [375-525] The Colorado Trust; 303-837-1200; [email protected]
Cui, YunHuo [366] East China Normal University; 0086-21-62233405; [email protected]
Cullen, Jim [342] Thomas More Institute; 514-707-1549; [email protected]
Cundiff, Nicole [571-834] Southern Illinois University, Carbondale; 618-453-3536; [email protected]
Curtis, Patrick [328] Walter R McDonald & Associates Inc; 301-881-2590 x245; [email protected]
Cutts, Quiana [743] Georgia State University; 678-791-8071; [email protected]
DDDDDDDD
Dagenais, Christian [327] University of Montreal; 514-393-8772; [email protected]
D'Agostino, Anne [572-632] Compass Consulting Group; 919-544-9004; [email protected]
Dahler-Larsen, Peter [410-573] University of Southern Denmark; 45 65503276; [email protected]
Daigneault, Pierre-Marc [833] Université Laval; 418-656-2131 x14994; [email protected]
Daltuva, Judith [533] University of Michigan; 734-936-0756; [email protected]
D'Amico, Leigh [370] University of South Carolina; 803-777-3459; [email protected]
Damle, Ranjana [663] Albuquerque Public Schools; 505-821-4772; [email protected]
Dammann, Stacey [391] York College of Pennsylvania; 717-767-3639; [email protected]
Daniel-Echols, Marijata [590] High/Scope Educational Research Foundation; 734-485-2000; [email protected]
Daniels, Jason [131] University of Alberta; 780-492-6332; [email protected]
Dannemann, Angela [131] D&S Engenheiras Associadas Ltda; 55 21 25432214; [email protected]
Darnell, Adam [131] EMSTAR Research Inc; 404-713-7043; [email protected]
Darnell, Doyanne [131] Georgia State University; 770-329-3059; [email protected]
Dates, Brian [766] Southwest Counseling Solutions; 313-841-7442; [email protected]
Datta, Lois-ellin [301-537-740-775] Datta Analysis; 808-323-8168; [email protected]
Davidsdottir, Sigurlina [434] University of Iceland; 354-820-1887; [email protected]
Davidson, Heather A [799] Stanford University; 650-723-5948; [email protected]
Davidson, Marc [103] First 5 Los Angeles; 213-482-7538; [email protected]
Davidson, William [584] Michigan State University; 517-353-5015; [email protected]
Davis, Corrie [743] Georgia State University; 404-651-2582; [email protected]
Davis, Darnella [344] COSMOS Corporation; 301-215-9100; [email protected]
Davis, Mary [324-635-860] University of North Carolina, Chapel Hill; 919-843-5558; [email protected]
Davis, Melinda [835] University of Arizona; 520-626-7820; [email protected]
Davis, Nia [337] University of New Orleans; 504-418-7090; [email protected]
Davis, Rita [740] University of Illinois at Urbana-Champaign; 217-898-6827; [email protected]
Davis, Sarita [709] Clark Atlanta University; 404-880-6703; [email protected]
Davis, Steve [408] American Institutes for Research; 202-403-5232; [email protected]
Dawes, Katherine [415-450-816-850] United States Environmental Protection Agency; 202-566-2189; [email protected]
Dawkins, Nicola [852] Macro International Inc; 404-321-3211; [email protected]
Day, Harry [596] Walter R McDonald & Associates Inc; 301-881-2590 x248; [email protected]
de Alteriis, Martin [413] United States Government Accountability Office; 202-512-4222; [email protected]
de Hegedüs, Pedro [672] Universidad de la Republica Uruguay; 598 2 358 1603; [email protected]
De La Cruz, Natalie [612] University of Alabama, Birmingham; 801-319-5579; [email protected]
De Luca, Chris [131] Queen's University; 613-533-6000 x75016; [email protected]
Dean, Kelley [399] Georgia State University; 404-463-9905; [email protected]
Deaton Maynard, Candace [346] National Institutes of Health; 301-594-9072; [email protected]
Deckard, Gloria [382] Florida International University; 305-348-0429; [email protected]
Decker, Sarah [390] Caliber an ICF International Company; 703-219-4419; [email protected]
Defino Whitsett, Maria Elise [735] Austin Independent School District; 512-414-4540; [email protected]
DeGroff, Amy [566] Centers for Disease Control and Prevention; 770-488-2415; [email protected]
DeKraai, Mark [860] University of Nebraska; 402-472-1496; [email protected]
Delaney, Linda [576-812] University of Arkansas; 870-225-1103; [email protected]
Delin, Barry S [439] University of Wisconsin, Stout; 608-261-7813; [email protected]
Delnevo, Cristine [396] University of Medicine and Dentistry of New Jersey; 732-235-9746; [email protected]
Demery, James [397] McGraw-Hill; 614-750-7430; [email protected]
Demestihas, Nicole [417] Mercy Corps; 94-77-321-5419; [email protected]
Page 162
Dennen, Vanessa [385-485-647-780] Florida State University; 850-644-8783; [email protected]
Denneson, Lauren [119] Portland State University; 503-224-4372; [email protected]
Dennis, Michael [128-403-869] Chestnut Health Systems; 309-827-6026; [email protected]
Denvall, Verner [603] Lund university; 46-46 2229425; [email protected]
DePaola, Mary Jo [547] Orange County Public Schools; 407-321-3168; [email protected]
Derek A, Cabrera [634] Cornell University; 607-592-4562; [email protected]
DeRoche, Kate [426-683] University of Northern Colorado; 303-504-6664; [email protected]
Derzon, James [127-828] Pacific Institute for Research and Evaluation; 240-505-7488; [email protected]
Deshmukh Towery, Nathaniel [329] Science and Technology Policy Institute; 617-270-3357; [email protected]
Desjarlais, Julie [356] Turtle Mountain Community College; 701-477-7862; [email protected]
DeStefano, Lizanne [740] University of Illinois at Urbana-Champaign; 217-333-8520; [email protected]
Dewey, Jennifer [794] Macro International Inc; 404-592-2178; [email protected]
Diaz, Elizabeth [588] Gay, Lesbian and Straight Education Network; 212-727-0135 x8051; [email protected]
Diaz Puente, Jose Maria [812] Polytechnic University, Madrid; 650 327 1675; [email protected]
Dicken, Virginia [621] Southern Illinois University, Carbondale; 618-453-3536; [email protected]
Dickerson, Shawn [131] Old Dominion University; 804-852-9341; [email protected]
Dickinson, Wendy [707] University of South Florida; 941-323-1177; [email protected]
Dickson, Marsha [659] University of Delaware; quattro.oet.udel.edu
Diggs, Gregory [386-428-823] University of Colorado, Denver; 303-393-6148; [email protected]
Dion, Denise [131] University of New Mexico; 505-272-8069; [email protected]
Doamekpor, Prosper [422] Pennsylvania State University; 814-865-6551; [email protected]
Doan, Henry [111] United States Department of Agriculture; 202-401-0791; [email protected]
Dobrowski, David [681-747] First 5 Monterey County; 831-444-8549; [email protected]
Doggette, Cecil H [131] Health Services for Children with Special Needs Inc; 202-835-2771; [email protected]
Dollard, Norin [683] University of South Florida; 813-974-3761; [email protected]
Dolphin, Heather [465] Lutheran World Relief; 410-230-2855; [email protected]
Dominguez, Jaime [105] Catholic Relief Services; 410-951-7298; [email protected]
Dominguez, Violeta [820] University of Arizona; 520-318-7259 x156; [email protected]
Donahue, Tara [131-864] Learning Point Associates; 630-649-6527; [email protected]
Donaldson, Stewart I [448-505-633-812] Claremont Graduate University; 909-702-7316; [email protected]
Donna, Joel [131] University of Minnesota; [email protected]
Donohue, William [820] Michigan State University; 517-355-7580; [email protected]
Dopkins, Laurie [532] George Mason University; 703-993-1428; [email protected]
Dorabawila, Vajeera [418] New York State Office of Children and Family Services; 518-473-8736; [email protected]
Dorman, Kym [125] Harder & Company Community Research; 415-522-5400; [email protected]
Doucette, Ann [403-753] George Washington University; 202-530-3921; [email protected]
Douglas, Elizabeth [131] Macro International Inc; 404-321-3211 x2175; [email protected]
Douglas, Karen [766] International Reading Association; 410-997-8433; [email protected]
Douple, Evan [779] The National Academies; [email protected]
Douville, LaVonne [398] United Way of Tucson; 520-903-9000 x430; [email protected]
Dowd, Jeff [797] United States Department of Energy; 202-586-7258; [email protected]
Dowell, Kathleen [481] Partners in Evaluation & Planning LLC; 410-707-0763; [email protected]
Dresbach, Mary Lou [853] Minnesota Office of Higher Education; 651-259-3940; [email protected]
Drilea, Susan [798] Walter R McDonald & Associates Inc; 301-881-2590 x224; [email protected]
Droegemeier, Ellen [398] Tucson Unified School District; 520-232-7040; [email protected]
Dryden, Eileen [716] Institute for Community Health; 617-499-6695; [email protected]
Dubow, Wendy [386] National Research Center Inc; 303-444-7863; [email protected]
Duffy, Jennifer [867] University of South Carolina; 803-600-8550; [email protected]
Dunavin, River [363] Albuquerque Public Schools; 505-848-8743; [email protected]
Dunaway, Krystall [131] Old Dominion University; 757-683-4463; [email protected]
Duncan, Dean [656] University of North Carolina, Chapel Hill; 919-962-7897; [email protected]
Duncan, Dustin [605-712-823] Harvard University; 301-502-9719; [email protected]
Duncan, Teresa [362] American Institutes for Research; 202-403-6853; [email protected]
Dunkle, Michelle [309] Maryland State Department of Education; 410-767-5654; [email protected]
Dunlap, Alton [117] RTI International; 770-234-5045; [email protected]
Dunn, Cindi [659] Kansas State University; 620-624-6313; [email protected]
Dunnivan, Gloria [662] Kent State University; 330-495-8543; [email protected]
Dupont, Didier [327] University of Montreal; 514-393-4666 x2006; [email protected]
Duppong Hurley, Kristin [418] University of Nebraska, Lincoln; 402-472-5501; [email protected]
Page 163
Duran, Deborah [865] National Institutes of Health; 301-496-4145; [email protected]
Duran, Rosemary [549] EngenderHealth; 591-2-2440896 x2318; [email protected]
Durant, Natasha [131] University of Maryland Medical System; 410-448-6624; [email protected]
Durland, Maryann [115-473-712] Durland Consulting; 630-650-9944; [email protected]
Dutil, Julie [327] University of Montreal; 514-393-4666 x2019; [email protected]
Duttweiler, Michael [326-777] Cornell University; 607-255-2105; [email protected]
Dwertmann, David [131] University of Mannheim; 49-621-181-2131; [email protected]
Dzino-Silajdzic, Velida [839] Catholic Relief Services; 011-387 33614662; [email protected]
EEEEEEEE
Eddy, Rebecca [735-770] Claremont Graduate University; 909-607-1549; [email protected]
Edler, Alice [799] Stanford University; 650-723-6412; [email protected]
Edwards, Carladenise [382] The Bae Company; 305-754-8550; [email protected]
Egan, Crystelle [401-419] University of Rhode Island; 401-277-5491; [email protected]
Ehlert, John [827] University of Minnesota; 612-919-3830; [email protected]
Elal-Englert, Pnina [410] Ben-Gurion University of Negev; 972-03-532-0076; [email protected]
Elias, Gretchen [771] Institute for Sustainable Communities; 802-229-2905; [email protected]
Elinson, Lynn [759] Westat; 412-480-2838; [email protected]
Elissetche, Crystal [611] Kalamazoo College; 956-262-4505; [email protected]
Ellen, Jonathan [622] Johns Hopkins University; 410-955-2910
Elliott, Catherine [410] University of Ottawa; 613-728-2967; [email protected]
Ellis, Jason [679] University of Nebraska, Lincoln; 402-472-9782; [email protected]
Ellis, Roger [438] University of Chester; 01244375444; [email protected]
Ellsworth, Randy [670] Wichita State University; 316-978-6943; [email protected]
Elm, Aunna [646] University of Arizona; 520-318-7259 x114; [email protected]
Elmen, Julie [751] University of California, Davis; 530-297-4659; [email protected]
El-Qudah, Khaled [614] Jordan National Center For Human Resources Development; 011-962-6-533-1451; [email protected]
Emshoff, James [131] EMSTAR Research Inc; 404-651-2029; [email protected]
Emshoff, Jim [131] Georgia State University; 404-651-2029; [email protected]
Endo Inouye, Traci [582] Social Policy Research Associates; 510-763-1499 x632; [email protected]
Engle, Molly [475-499-597-622-687-726] Oregon State University; 541-737-4126; [email protected]
Enkhtor, Dary [131] Georgia State University; 404-906-4008; [email protected]
Enright Patterson, Tracy [114] Center for Creative Leadership; 336-286-4418; [email protected]
Entwisle, Joe [439] National Consortium for Health Systems Development; 312-401-3909; [email protected]
Eoyang, Glenda [374-741-776-803] Human Systems Dynamics Institute; 763-783-7206; [email protected]
Erickson, Steve [131] EMSTAR Research Inc; 770-394-0514; [email protected]
Erisman, Wendy [530] Institute for Higher Education Policy; 202-861-8223 x201; [email protected]
Ernst, Kristina [335] Centers for Disease Control and Prevention; 770-488-5633; [email protected]
Escandon, Inés [549] EngenderHealth; 212-561-8078; [email protected]
Escoffery, Lorna [484] Escoffery Consulting Collaborative Inc; 305-987-8975; [email protected]
Essenmacher, Victoria [102] Social Program Evaluators and Consultants Inc; 313- 964-0500 x204; [email protected]
Esterrich, Leslie [851] United States Department of State; 202-453-8817; [email protected]
Eudy, Jason [627] Coastal Area Health Education Center; 910-343-0161 x252; [email protected]
Evans, Carol [607] Missouri Institute of Mental Health; 314-877-6433; [email protected]
Evans, Ron [831] United States Environmental Protection Agency; [email protected]
FFFFFFFF
Fahey, Didi [605] The Ohio State University; 740-803-0830; [email protected]
Falat, Heather [834] Southern Illinois University, Carbondale; 618-453-3551; [email protected]
Falconer, Mary Kay [766] Ounce of Prevention Fund of Florida; 850-921-4494; [email protected]
Farber, Stacey [676] University of Cincinnati; 513-556-3543; [email protected]
Farris, Kimberly D [479] University of Pennsylvania; 216-368-2711; [email protected]
Farris, Rosanne [117-630] Centers for Disease Control and Prevention; 770-488-5007; [email protected]
Fattore, Giovanni [827] Bocconi University; 39 338 7816605; [email protected]
Faxio, Adrienne [345] University of California, San Francisco; 415-502-4058; [email protected]
Febey, Karen [450] United States Government Accountability Office; 612-226-8822; [email protected]
Feighan, Kelly [682] Research for Better Schools; 215-568-6150 x285; [email protected]
Feinstein, Osvaldo [456] Spanish Evaluation Agency; 3491-350-8405; [email protected]
Page 164
Feldman, Debbie [131] University of Montreal; 514-343-6111
Feldman, Jill [682] Research for Better Schools; 215-568-6150 x276; [email protected]
Feldman, Laura [555-728-832] University of Wyoming; 307-399-1914; [email protected]
Feldman Berger, Hila [396] University of Medicine and Dentistry of New Jersey; 732-235-9727; [email protected]
Fendt, Carol [322] University of Illinois, Chicago; 312-413-3367; [email protected]
Feranchak, Bret [322-755] Chicago Public Schools; 773-553-2497; [email protected]
Fernandez, Felix [344] Caliber an ICF International Company; 703-385-3200; [email protected]
Fernando, Sheara [636] University of South Carolina; 803-777-4137
Fetterman, David [126-576-705-799-812-867] Stanford University; 650-269-5689; [email protected]
Fetzer, Linda [131] Pennsylvania State University; 814-864-7488; lmf8@psu,edu
Fielding, Kim [543-806] University of Arizona; 520-626-0735; [email protected]
Fielding, Stephen L [436] University of Rochester; 585-295-1000 x286; [email protected]
Fierro, Leslie [716-852] Centers for Disease Control and Prevention; 404-290-4482; [email protected]
Fifield, Steve [400] University of Delaware; 302-831-4437; [email protected]
Figueroa, Maria Elena [424] Johns Hopkins University; 410-659-6362; [email protected]
Finn, Brooke [665] NeighborWorks America; 617-585-5035; [email protected]
Fioravanti, Jill [665] Cabrillo Economic Development Corporation; 805-672-2585; [email protected]
Fisch, Peter [110-364] European Commission; 322-295-2468; [email protected]
Fischbein, Kelly [317] American Red Cross; 703-206-7625; [email protected]
Fischer, David [131-520] University of Minnesota; 612-408-3501; [email protected]
Fischer, Rob [131-479] Case Western Reserve University; 216-368-2711; [email protected]
Fischl, Iris [727] Austrian Institute for SME Research; 43-01-505-97-61; [email protected]
Fischler, Nurit [624] Oregon Public Health Division; 971-673-0344; [email protected]
Fisher, Christine [370] Winthrop University; 803-323-2451; [email protected]
Fisher, Sylvia [131-588-758-798] United States Department of Health and Human Services; 240-276-1923; [email protected]
Fisher, William [826] Avatar International Inc; 407-805-9506; [email protected]
Fiske, Leigh [515] Foundation Strategy Group Social Impact Advisors; 617-357-4000 x127; [email protected]
Fitzpatrick, Jody [336-405-442] University of Colorado, Denver; 303-556-5989; [email protected]
Fleischer, Dreolin [358] Claremont Graduate University; 617-680-2775; [email protected]
Fleischman, Norma [315-350-851] United States Department of State; 202-203-7510; [email protected]
Fleming, Tangie [131] University of North Carolina, Chapel Hill; 919-832-1531; [email protected]
Fletcher, Aisha [131] Professional Associates Inc; 601-982-1593; [email protected]
Fletcher, Bettye [131] Professional Associates Inc; 601-982-1593; [email protected]
Fletcher, Faith [612] University of Alabama; 985-628-2882; [email protected]
Florez, Ana [131] Academy for Educational Development; 202-884-8000; [email protected]
Florin, Paul [401] University of Rhode Island; 401-277-5302; [email protected]
Flowers, Lisa [380-415] University of Montana; 406-466-2078; [email protected]
Fluke, John [798] Walter R McDonald & Associates Inc; 303-486-6937; [email protected]
Flynn, Cynthia [131] University of South Carolina; 803-777-1378; [email protected]
Flynn, Priscilla [353] Mayo Clinic; 507-255-7038; [email protected]
Folkman, Daniel [357] University of Wisconsin, Milwaukee; 414-227-3285; [email protected]
Ford, Kevin [808] Michigan State University; [email protected]
Fortner, C Kevin [399] Georgia State University; 404-651-0423; [email protected]
Foster, Rex [131] University of Minnesota; 210-373-2427; [email protected]
Foster-Fishman, Pennie G [503-808] Michigan State University; 517-353-5015; [email protected]
Fourney, Andy [625] Network for a Healthy California; 916-449-5386; [email protected]
Fournillier, Janice [323-533-541-743] Georgia State University; 404-651-3292; [email protected]
Fox, Janet [845] Louisiana State University; 225-578-2196; [email protected]
Fox, Margaretta [855] Harlem United Community AIDS Center; 212-803-2850 x445; [email protected]
Francis, Anika [131] University of Georgia; 706-542-4824; [email protected]
Francis, Sally [823] Walden University; 612-312-2351; [email protected]
Franco, Lynne [786] University Research Company, LLC; 301-941-8539; [email protected]
Franco, Suzane [788] Wright State University; 513-317-9415; [email protected]
Frank, Dawn [628] Oglala Lakota College; 605-441-2558; [email protected]
Frankel, Paul [709] American Humane Association; 303-925-9429; [email protected]
Franz, Nancy [121] Virginia Cooperative Extension; 540-231-1634; [email protected]
Fraser, Elvis [390] Evaluation and Knowledge Services Group; 202-521-1900; [email protected]
Fredericks, Kimberly [114-739] Indiana State University; 812-237-2504; [email protected]
Freeman, Melissa [512] University of Georgia; 706-542-3613; [email protected]
Page 165
Freeman, Toni [574-821] The Duke Endowment; 704-969-2136; [email protected]
Freimanis Hance, Laura [389] Westat; 240-314-2508; [email protected]
Freitag, Patricia K [344] COSMOS Corporation; 240-223-5255; [email protected]
Frey, Bruce B [796] University of Kansas; 785-864-9706; [email protected]
Frey, William [759] Westat; [email protected]
Frierson Jr, Henry [557] University of North Carolina, Chapel Hill; 919-962-7507; [email protected]
Frost, Frederica [795] Wayne County Research Educational Service Agency; 734-334-1574; [email protected]
Fuller-Rowell, Thomas [104] Cornell University; 720-987-5798; [email protected]
Fulmer, Erika [117] RTI International; 770-986-5011; [email protected]
Fulmore, Darren [425] The MayaTech Corporation; 301-587-1600 x2323; [email protected]
Furlow, Carolyn [673] Georgia State University; 404-651-3292; [email protected]
Furry, Marilyn [131] Pennsylvania State University; 814-863-7428; [email protected]
GGGGGGGG
Gabbitas, Bruce [526] University of Georgia; 706-621-7955; [email protected]
Gabriel, Roy [866] RMC Research Corporation; 503-223-8248; [email protected]
Gadomski, Anne [418] Bassett Research Institute; 607-547-3066; [email protected]
Gadzuk, Nancy [662] Wexford; 310-548-0077; [email protected]
Gagnon, Isabelle [131] University of Montreal; 514-412-4407; [email protected]
Gaither, Steven [349] United States Department of State; 202-203-8816; [email protected]
Gajda, Rebecca [377-649] University of Massachusetts, Amherst; 413-545-1751; [email protected]
Gale, Paul [363-740] San Bernardino County Superintendent of Schools; 909-254-1789; [email protected]
Gallimore, Ronald [804] Pearson Achievement Solutions; 310-428-5937; [email protected]
Gallivan, Joanne [113] National Institutes of Health; 301-496-6110; [email protected]
Gambler, Rebecca [308] United States Government Accountability Office; 202-512-6912; [email protected]
Gandha, Tysza [323-336-407] University of Illinois at Urbana-Champaign; 216-235-1232; [email protected]
Garcia, Beverly [666] University of North Carolina; 919-966-6088; [email protected]
Garcia, Edurne [620] University of Illinois, Chicago; [email protected]
Garcia, Roberto [818] Abundantia Consulting; 559-897-8104; [email protected]
Gardner, Annette [818] University of California, San Francisco; 415-514-1543; [email protected]
Gardner, Joel [387] Utah State University; 435-750-0280; [email protected]
Gardner, Veronica [425-864] JVA Consulting LLC; 303-477-4896; [email protected]
Gargani, John [501-633] Gargani & Company Inc; 510-291-4226; [email protected]
Gariba, Sulley [700] Institute for Policy Alternatives; +233-21-784540; [email protected]
Garrett, Brent [304] Independent Consultant; 502-762-3515; [email protected]
Garst, Barry [667] American Camp Association; 765-342-456 x312; [email protected]
Gasper, Charles [345-855] Missouri Foundation for Health; 314-345-5581; [email protected]
Gebbie, Kristine [635-860] Columbia University; 212-305-1794; [email protected]
Gehl, Maria J [745] Children's Trust of Washington; 206-389-3297; [email protected]
Geierstanger, Sara [345] University of California, San Francisco; 415-476-0746; [email protected]
Geist, Monica [425] University of Northern Colorado; 303-404-5280; [email protected]
Genevro, Janice L [862] MasiMax Resources Inc; [email protected]
Gentry, Bill [722] Center for Creative Leadership; 336-286-4598; [email protected]
Gerardi, Nicole [338] University of California, Los Angeles; 310-767-6637; [email protected]
Germuth, Amy [572-632-760-807] Compass Consulting Group; 919-544-9004; [email protected]
Gervin, Derrick [479] Clark Atlanta University; 404-304-8099; [email protected]
Ghorkhmazyan, Meri [839] Catholic Relief Services; 374-10-514-391; [email protected]
Ghosh, Rajashi [757] University of Louisville; 502-852-3354; [email protected]
Gienapp, Anne [529] Organizational Research Services; 206-728-0474 x14; [email protected]
Gilbert, Mary Beth [788] Praxis Research Inc; 704-523-2999; [email protected]
Gilhuly, Kim [352] University of California; 510-684-1275; [email protected]
Gill, Duane [707] Mississippi State University; 662-325-1570; [email protected]
Gillies, John [748] Academy for Educational Development; 202-412-3943; [email protected]
Gilling, Maxine [750] Western Michigan University; 269-375-1755; [email protected]
Ginn, Larry [846] Role of Men; 562-843-2689; [email protected]
Given Larwin, Karen [367-438] Gannon University; 330-537-5266; [email protected]
Gladfelter, Johanna [615] Innovation Network Inc; 202-728-0727 x103; [email protected]
Glantz, Frederic [481] Kokopelli Associates LLC; 505-983-0785; [email protected]
Page 166
Glasnapp, James [747] JBS International Inc; 415-225-5694; [email protected]
Glennerster, Rachel [713] Massachusetts Institute of Technology; 617-324-0098; [email protected]
Glider, Peggy [781] University of Arizona; 520-621-5973; [email protected]
Glover, Denise [308] Westat; 301-251-2269; [email protected]
Gmyrek, Amanda [131] University of Maryland; 410-646-1743; [email protected]
Gnedko, Natalya [755] Chicago Public Schools; 773-553-2323; [email protected]
Godoy, Fabiano [563] Bushmeat Crisis Taskforce; [email protected]
Goertz, Hallie [745] Organizational Research Services; 206-728-0474 x24; [email protected]
Goh, Swee C [410] University of Ottawa; 613-562-5800 x4743; [email protected]
Golan, Shari [623] SRI International; 650-859-4007; [email protected]
Gold, Robert [715] University of Maryland; 301-405-2437; [email protected]
Golding, A Cassandra [470-706] University of Rhode Island; 401-743-2907; [email protected]
Gómez-Bellengé, Francisco [673] Reading Recovery National Data Evaluation Center; 614-292-0977; [email protected]
Gonzalez, Maria [665] Hispanic Association of Contractors and Enterprises; 215-426-8025 x116; [email protected]
Goodyear, Leslie [122-303-455-500] Education Development Center Inc; 617-618-2354; [email protected]
Gopalakrishnan, Srik [859] The Ball Foundation; 630-469-6270; [email protected]
Gordon, Edmund W [796] Teachers College Columbia University; 212-678-3444; [email protected]
Gorzalski, Lindsey [758] Arizona State University; [email protected]
Gosselin, Erica [131-683] Mental Health Center of Denver; 303-504-6578; [email protected]
Gowen, Sheryl [533-673-743] Georgia State University; 404-651-2582; [email protected]
Graham, Michele [131] JVA Consulting LLC; 303-477-4896; [email protected]
Graham, Phillip [737] RTI International; 919-485-7752; [email protected]
Graig, Eric [395-578] Usable Knowledge LLC; 775-363-8593; [email protected]
Grandgenett, Neal [122] University of Nebraska, Omaha; 402-554-2690; [email protected]
Gratz, Zandra [131-670-796] Kean University; 908-709-4049; [email protected]
Graves, Rebecca [515] Foundation Strategy Group Social Impact Advisors; 206-624-6745 x102; [email protected]
Gravina, Virginia [672] Universidad de la Republica Uruguay; 598 2 358 1603; [email protected]
Gray, Denis [376] North Carolina State University; 919-515-1721; [email protected]
Gray, Lizbeth Ann [612] Oregon State University; 541-737-5972; [email protected]
Gray, Peter J [315] United States Naval Academy; 410-280-2547; [email protected]
Gray Fleming, Tangie [340] University of North Carolina, Chapel Hill; 919-832-1531; [email protected]
Grayson, Thomas E [323-594] University of Illinois at Urbana-Champaign; 217-333-7336; [email protected]
Green, Brandeis [131] Georgia State University; 404-651-2209; [email protected]
Green, Diane [609] Centers for Disease Control and Prevention; 770-488-6564; [email protected]
Green, Doris [610] Future Care Planning Services; 585-340-5883; [email protected]
Green, Mark [439] United States Social Security Administration; 410-965-9852; [email protected]
Green, Nicole [395] KPMG; 201-307-7956; [email protected]
Green, Sheridan [131-425-864] JVA Consulting LLC; 970-215-8087; [email protected]
Greenberg, Rachel [113] Marketing and Communications Consulting; 202-337-8448; [email protected]
Greenberg, Saadia [343] United States Department of Health and Human Services; 202-357-3554; [email protected]
Greenberg, Sallie E [305] University of Illinois at Urbana-Champaign; 217-244-4068; [email protected]
Greene, George [131] Working For Togetherness; 773-265-5626; [email protected]
Greene, Jennifer [302-505-685-740] University of Illinois at Urbana-Champaign; 217-333-8736; [email protected]
Greene, Joelle [343] National Community Renaissance; 909-483-2444; [email protected]
Greene, Kari [400-470] Oregon Public Health Division; 971-673-0599; [email protected]
Greenseid, Lija [344-827] University of Minnesota; 612-730-2294; [email protected]
Greever-Rice, Tracy [453-560] University of Missouri, Columbia; 573-884-5116; [email protected]
Greytak, Emily [621] Gay, Lesbian and Straight Education Network; 646-388-8054; [email protected]
Grieve, Maggie [665] NeighborWorks America; 202-220-2337; [email protected]
Griffith, Annette [418-604] University of Nebraska, Lincoln; 402-472-4729; [email protected]
Grob, George [733-775] Center for Public Program Evaluation; 540-454-2888; [email protected]
Grover, Jane [116] RMC Research Corporation; 503-857-0255; [email protected]
Grow, Susan [744] Federal Consulting Group; 202-504-3646; [email protected]
Grskovic, Janice [462] Indiana University Northwest; 219-980-6610; [email protected]
Gruman, Cynthia [439] University of Connecticut; 860-679-7960; [email protected]
Grunwald, Heidi [516] Temple University; 215-204-8583; [email protected]
Grusenmeyer, Linda [123] University of Delaware; 302-831-0732; [email protected]
Guckenburg, Sarah [402-863] Learning Innovations at WestEd; 781-481-1116; [email protected]
Guerra, Javier [475] Azusa Pacific University; 626-815-6000; [email protected]
Page 167
Gugiu, Cristian [731] Western Michigan University; 269-267-0471; [email protected]
Guillen-Woods, Blanca Flor [735] Lodestar Management/Research Inc; 818-470-4530; [email protected]
Guimarães, Vilma [131] Roberto Marinho Foundation; 55 21 22738506; [email protected]
Guion, Lisa [811] North Carolina State University; 919-513-2350; [email protected]
Gullickson, Amy [131-510-578] Western Michigan University; 269-387-3775; [email protected]
Gullickson, Arlen [601-844] Western Michigan University; 269-387-5895; [email protected]
Gum, Amber [763] University of South Florida; 813-974-1980; [email protected]
Gundermann, Dawn [361] University of Wisconsin; 608- 262-5239; [email protected]
Gustafson, Lindsay [436] Central Alberta AIDS Network Society; 403-346-8858; [email protected]
Gustafson, Otto [307-378-578-757-792] Western Michigan University; 269-330-3240; [email protected]
Guthrie, David [335] Centers for Disease Control and Prevention; 770-488-1174; [email protected]
Gutierrez Barrett, Melissa [866] Westat; 240-314-2526; [email protected]
Gutmann, Mary [764-786] EnCompass LLC; 970-513-9685; [email protected]
Guy, Cindy [664] Annie E Casey Foundation; 410-223-2902; [email protected]
Guyn, Lindsay [666] Calgary Health Region; 403-297-8057; [email protected]
Gwaltney, Larry [670] Allied Educational Research and Development Services; 316-684-3202; [email protected]
HHHHHHHH
Hacker, Karen [716] Institute for Community Health; 617-499-6671
Haddad, Maryam [389] Centers for Disease Control and Prevention; 404-639-8480; [email protected]
Haden, Carol [325] Magnolia Consulting LLC; 928-522-9041; [email protected]
Hadjiharalambous, Chris [383-564] University of Tennessee, Knoxville; 865-974-4737; [email protected]
Hafford, Carol [640] James Bell Associates; 703-528-3230; [email protected]
Hage, Jerald [411] University of Maryland; 301-405-6437; [email protected]
Hagen, Carol [866] Westat; 301-294-3877; [email protected]
Hahn, Christine [389] Idaho Department of Health and Welfare; 208-334-5939; [email protected]
Hale, Michelle [349] United States Department of State; 202-453-8815; [email protected]
Hall, Brandi [612] Oregon State University; [email protected]
Hall, Bruce [707] University of South Florida; 813-974-3220; [email protected]
Hall, Bryan [860] Institute for Community Health; 617-499-6682; [email protected]
Hall, Jori [685-740] University of Illinois at Urbana-Champaign; 217-384-8429; [email protected]
Hall, Melvin [302] Northern Arizona University; 480-348-0589; [email protected]
Hallberg, Kelly [590] Learning Point Associates; 312-288-7641; [email protected]
Halpern, Gerald [342] Fair Findings Inc; 613-761-9010; [email protected]
Hamann, Sue [627] Coastal Area Health Education Center; 910-343-0161 x285; [email protected]
Hamar, Michael [773] Claremont Graduate University; 909-524-7800; [email protected]
Hamilton, Steve [863] WestEd; 781-481-1104
Hamilton, Yarnecia [479] Clark Atlanta University; 850-321-7664; [email protected]
Hammond, Terry [324] Salvation Army; 404-728-1384; [email protected]
Han, Susan [618] George Mason University; 703-993-8292; [email protected]
Hannafin, Michael [526] University of Goergia; 706-542-3157; [email protected]
Hannum, Kelly [510-598-824-837] Center for Creative Leadership; 336-286-4425; [email protected]
Hansen, Keoki [667] Big Brothers Big Sisters of America; 315-254-9759; [email protected]
Hanson, Charlotte [862] Mathematica Policy Research Inc; 202-554-7547; [email protected]
Hanson, Mary Ann [131] Caliber an ICF International Company; 651-222-3540; [email protected]
Hanson, Robert [307-471-763] Health Canada; 613-948-8954; [email protected]
Hanson Smart, Dawn [102-481-665-769] Clegg & Associates; 206-448-0749; [email protected]
Hanssen, Carl [115-395-722] Hanssen Consulting LLC; 616-808-2867 x11; [email protected]
Harcek, Todd [106] Western Michigan University; 517-214-6389; [email protected]
Hargreaves, Meg [382-862] Abt Associates Inc; 617-349-2479; [email protected]
Hargrove, Bill [659] Kansas State University; 785-532-7419; [email protected]
Harmon, Michele [866] Westat; 301-251-1500; [email protected]
Harper, Gary [622] DePaul University; 773-325-2056; [email protected]
Harrington, Maura [102-735] Lodestar Management/Research Inc; 213-891-1113; [email protected]
Harris, Elizabeth [103-330-456] EMT Associates Inc; 818-990-8301; [email protected]
Harris, Philip [516] Temple University; 215-205-7802; [email protected]
Harris, Raychelle [620-685] Gallaudet University; [email protected]
Harris, Roderick [337] University of Pittsburgh; 412-683-3862; [email protected]
Page 168
Hatley, Anne [612] Oregon State University; [email protected]
Hau, Errol [744] ForeSee Results Inc; 734-205-2552; [email protected]
Havick, Steven [512] University of Georgia; 404-663-4930; [email protected]
Hawkes, Mark [468] Dakota State University; 605-256-5274; [email protected]
Hayden, Elizabeth [528-564] Northeastern University; 860-961-4396; [email protected]
Haynes, Leslie [787] Jobs for the Future; 617-728-4446; [email protected]
Haynes, Ray [757] University of Louisville; 502-852-0618; [email protected]
Haynie, Kathleen [807] Kathleen Haynie Consulting; 609-466-2990; [email protected]
Heath, Barbara [362] East Main Educational Consulting LLC; 910-784-9523; [email protected]
Heath, Linda [131-340] Loyola University, Chicago; 773-508-3023; [email protected]
Hebbeler, Kathy [311-623-675] SRI International; 530-758-7483; [email protected]
Heberger, Anne [329] National Academies; 949-387-3964; [email protected]
Hegedus, Andrea [499-687] Centers for Disease Control and Prevention; 770-488-5462; [email protected]
Heibel, Robert [546] Mercyhurst College; 703-331-3891; [email protected]
Heikes, Joel [440] University of Texas, Austin; 512-475-8679; [email protected]
Heimlich, Joe [570] The Ohio State University; 614-292-6926; [email protected]
Heinemeier, Sarah [572-632] Compass Consulting Group; 919-544-9004; [email protected]
Heller Key, Karen [667] National Human Services Assembly; 202-347-2080 x22; [email protected]
Helvig, Kristi [131] Mental Health Center of Denver; 303-504-6561; [email protected]
Henderson, Susan [863] WestEd; 781-481-1118; [email protected]
Henderson-Dahms, Carol L [462] Northern Arizona University; 928-380-8899; [email protected]
Hendricks, Astrid [109-381-478-818] The California Endowment; 213-928-8671; [email protected]
Hendricks, Michael [602-739-807-841] Independent Consultant; 301-654-7884; [email protected]
Hennessy, Michael [438] University of Pennsylvania; 215-573-8709; [email protected]
Henriques, Carlene [751] Sacramento County Dept of Health Services; 916-875-5869; [email protected]
Henry, Gary T [399-505] University of North Carolina, Chapel Hill; 404-808-9352; [email protected]
Henry, Martha [408-863] M A Henry Consulting LLC; 314-353-8905; [email protected]
Herbers, Stephanie [717] Saint Louis University; 314-977-8233; [email protected]
Herman, Patricia [809] University of Arizona; 520-906-8902; [email protected]
Herman, Tracy [325] Magnolia Consulting LLC; 585-750-9597; [email protected]
Hermida, Jorge [786] University Research Company LLC; 301-941-8505; [email protected]
Hernandez, Arthur [356] University of Texas, San Antonio; 210-458-2610; [email protected]
Hernandez, Luis Alfredo [331] Consultative Group on International Agricultural Research; 572-445-0000; [email protected]
Hernandez, Trish [351] JBS International Inc; 650-373-4961; [email protected]
Herpin, Sharon [476] WestEd; 562-799-5101; [email protected]
Herrell, James [365] United States Department of Health and Human Services; 240-276-2789; [email protected]
Hersey, James [117-630-653] RTI International; 202-728-2486; [email protected]
Hershey-Arista, Molly [308] Westat; 301-610-4908; [email protected]
Hertzog, Sarah [326] Cornell University; 607-255-2864; [email protected]
Hess, Carla [514] HB Consultation & Evaluation Associates LLC; 701-775-0297; [email protected]
Hess, Melinda [131-625] University of South Florida; 813-974-7668; [email protected]
Hetling, Andrea [552] University of Connecticut; 860-570-9345; [email protected]
Hewitt, Bart [361] United States Department of Agriculture; 202-720-0747; [email protected]
Hewitt, Sue [394-464-772] Health District of Northern Larimer County; 970-224-5209; [email protected]
Hickman, Laura [107] RAND Corporation; 310-393-0411 x6006; [email protected]
Hicks, Jennifer [564] University of Tennessee, Knoxville; 865-974-4550; [email protected]
Hickson, Rachel [523-557-830] Montgomery County Public Schools; 301-570-1425; [email protected]
Higa, Terry Ann [853] University of Hawaii, Manoa; 808-956-4931; [email protected]
Hightower King, Mindy [506-723] Indiana University; 812-855-4438; [email protected]
Hill, Alexandra [827] University of Alaska; 907-786-5436; [email protected]
Hill, Kathryn [853] Minnesota Office of Higher Education; 651-259-3934; [email protected]
Hill, Patty [764] EnCompass LLC; 301-518-5120; [email protected]
Hill, Shanise [131] The Lewin Group; 703-269-5629; [email protected]
Hirshberg, Diane [827] University of Alaska, Anchorage; 907-786-5413; [email protected]
Hites, Lisle [348] Tulane University; 504-250-0533; [email protected]
Hodge, Sheryl [385-520-659] Kansas State University; 785-532-7171; [email protected]
Hodson, Cheri [682] Los Angeles Unified School District; 213-241-8260; [email protected]
Hoechstetter, Sue [582] Alliance for Justice; 202-822-6070 x334; [email protected]
Hoefgen, Lynn [507] Nexus Market Research Inc; 617-497-7544; [email protected]
Page 169
Hoffman, Nicholas [758] Southern Illinois University, Carbondale; 618-453-3536; [email protected]
Hoffman, Richard [335] Centers for Disease Control and Prevention; 770-488-5035; [email protected]
Hogard, Elaine [438] University of Chester; 01244373164; [email protected]
Hohl, Carrie [131] University of Kansas; 785-864-9675; [email protected]
Hohlfeld, Tina [625] University of South Florida; 813-974-3220; [email protected]
Hoke, Robert [102] Independent Consultant; 317-632-0609; [email protected]
Holas, Igor [131] Public/Private Ventures; 215-557-4465; [email protected]
Holleman, Martha [605-664] The Safe and Sound Campaign; 410-662-8109; [email protected]
Holmes, Heidi [620-685] Gallaudet University; [email protected]
Honess-Morreale, Lauren [107] RAND Corporation; 703-413-1100 x5937; [email protected]
Hood, Stafford [302-337] Arizona State University; 480-727-8657; [email protected]
Hoole, Emily [114-377-722-824] Center for Creative Leadership; 336-286-4442; [email protected]
Hooper, Kambria [799] Stanford University; 650-725-8803; [email protected]
Hoopes, Stacey [785] Brigham Young University; 571-334-7962; [email protected]
Hopkins, Arlene [551-833] Los Angeles Unified School District; 310-392-5910; [email protected]
Hopson, Rodney [337-601] Duquesne University; 412-396-4034; [email protected]
Horan, Jennifer [707] University of North Carolina; 910-862-7929; [email protected]
Horn, Leslie [635-860] Columbia University; 212-342-4173; [email protected]
Horne, Richard [759] United States Department of Labor; 202-693-4923; [email protected]
Horner, Terry [450] United States Government Accountability Office; 202-512-6910; [email protected]
Horowitz, Jordan [750] California Partnership for Achieving Student Success; 562-743-7920; [email protected]
Horowitz, Rob [768] Teachers College, Columbia University; 212-781-3730; [email protected]
Horrigan, Paula [420] Cornell University; 607-255-1607; [email protected]
Horwood, Thomas J [131-608] Caliber an ICF International Company; 703-279-6234; [email protected]
Hos, Rabia [131-362] University of Rochester; 585-259-0972; [email protected]
Houle, Sylvain [740] Université du Québec à Montréal; 514-098-3000 x4775; [email protected]
House, Ernie [447] University of Colorado; 720-938-1826; [email protected]
Houseal, Ana [305] University of Illinois at Urbana-Champaign; 217-333-0672; [email protected]
Howe, Ann [122] SUCCEED Apprentiship Program; 919 834 7547; [email protected]
Howell, Embry [382] The Urban Institute; 202-833-7200; [email protected]
Hoye, John [750] Western Michigan University; 269-274-7593; [email protected]
Hrywna, Mary [396] University of Medicine and Dentistry of New Jersey; 732-235-9728; [email protected]
Hsu, Helen [131] University of British Columbia; 604-822-5358; [email protected]
Hubbard, Robert [593] National Development and Research Institutes Inc; 919-863-4600; [email protected]
Hubelbank, Jeanne [131] Independent Consultant; 978-443-3877; [email protected]
Hudachek, Sheri [106-578] Western Michigan University; 260-964-0164; [email protected]
Huddleston, Jenica [751] University of California, Davis; 925-202-3133; [email protected]
Huff, Kristin [331-360] Independent Consultant; 317-750-3601; [email protected]
Huff Jr, James G [640] Vanguard University; 714-556-3610 x454; [email protected]
Huffman, Douglas [131] University of Kansas; 913-384-3568; [email protected]
Huffman, Lynne [425] The Children's Health Council; 650-688-3609; [email protected]
Hug, J William [380] Trillium Associates; 406-579-5145; [email protected]
Hughes, Dana [818] University of California, San Francisco; 415-476-0780; [email protected]
Hulme, Stephen [108-419-604] Brigham Young University; 801-787-9684; [email protected]
Humbert, Roxann [122] Fairmont State University; 304-367-4160; [email protected]
Hung, Hsin-Ling [315] National Taiwan Normal University; 886-2-23935028 x15; [email protected]
Hurley, Nancy [402] Learning Innovations at WestEd; 781-481-1105; [email protected]
Hurteau, Marthe [740] Université du Québec à Montréal; 514-987-3000 x4702; [email protected]
Hutchinson, Kent [449-862] Florida State Legislature; 850-487-9164; [email protected]
Hutchinson, Susan [128-131-403] University of Northern Colorado; 970-351-1643; [email protected]
Hutchison, Patrick [670] Wichita State University; 316-978-6279; [email protected]
Hwalek, Melanie [343-768-855] Social Program Evaluators and Consultants Inc; 313-964-0500; [email protected]
Hyde, Justeen [716-860] Institute for Community Health; 617-499-6684; [email protected]
Hyde, Mary [318] Association for the Study and Development of Community; 301-519-0722 x107; [email protected]
IIIIIIII
Ibe, Chidinma [131] Johns Hopkins University; 978-828-1142; [email protected]
Ijaz, Kashef [389] Centers for Disease Control and Prevention; 404-639-5314; [email protected]
Page 170
Ilian, Henry [383-564] New York City Administration for Children's Services; 646-935-1410; [email protected]
In, Ga-jin [395] Ewha Womans University; 82-11-347-1801; [email protected]
Inahashi, Kazuyuki [124] Ministry of Economy, Trade and Industry; 81-3-3501-0681; [email protected]
Ingram, Stephanie [788] Girls and Boys Town; 402-498-3034; [email protected]
Intili, Jo Ann [351] JBS International Inc; 650-533-1174; [email protected]
Introcaso, David [739] United States Department of Health and Human Services; 202-401-6119; [email protected]
Iris, Madelyn [753] Council for Jewish Elderly; 773-508-1076; [email protected]
Iriti, Jennifer [109] University of Pittsburgh; 412-624-7091; [email protected]
Ishida, Kenichi [131] Ocean Research Institute; 81-3 5351-6516; [email protected]
Itang'ata, Mukaria [115-131] Western Michigan University; 269-373-5673; [email protected]
Ivatt, Raymond [627] Evaluation and Development Association; 415-730-6263; [email protected]
Izenman, Alan [516] Temple University; 215-204-8166; [email protected]
JJJJJJJJ
Jackson, Annabel [406] Annabel Jackson Associates; 441225446614; [email protected]
Jackson, Janine [613] Howard University; 301-318-6433; [email protected]
Jacob, Steve [833] Université Laval; 418-656-2131 x12330; [email protected]
James, Nakia [388-663] Western Michigan University; 269-719-6582; [email protected]
James, Sylvia [122-843] National Science Foundation; 703-292-5333; [email protected]
Janesick, Valerie [463-643] University of South Florida; 813-984-8951; [email protected]
Jang, Yongsuk [637] George Washington University; 202-994-1640; [email protected]
Janis, Amanda [324] United Methodist Committee on Relief-Katrina Aid Today; 202-955-5072; [email protected]
Jankowski, Natasha [706] Western Michigan University; 269-387-6862; [email protected]
Janosz, Michel [327] University of Montreal; 514-279-8383; [email protected]
Jansen, Anneke [543] University of Arizona; 520-626-0735; [email protected]
Jay, Michelle [663] University of South Carolina; 803-777-0538; [email protected]
Jayaratne, Koralalage [397-422-679] North Carolina State University; 919-515-6079; [email protected]
Jaycox, Lisa [107] RAND Corporation; 703-413-1100 x5118; [email protected]
Jeffries Leonard, Kimberly [425] The MayaTech Corporation; 301-587-1600 x2301; [email protected]
Jennings, Helene [304-802] Macro International Inc; 301-572-0248; [email protected]
Jeong, Sangki [847] Korea Institute of Science and Technology Evaluation and Planning; 82-2-589-2249; [email protected]
Jeong, YeonBaek [414] Seoul National University; 82-2-880-4097
Jerabek, Roger [627] University of New Mexico; 505-272-8069; [email protected]
Jernigan, Jan [117-396-666] Centers for Disease Control and Prevention; 770-488-5224; [email protected]
Jessup, Patricia [374] InSites; 734-761-5412; [email protected]
Jester Quijada, Jessica [778] Academy for Educational Development; 202-884-8090; [email protected]
Jewiss, Jennifer [420-455-743] University of Vermont; 802-656-2711; [email protected]
Jinkerson, Darryl [405-560-656-722] Abilene Christian University; 325-674-2493; [email protected]
Jinnah, Hamida [131] University of Georgia; 706-254-0477; [email protected]
Johansson, Anna [528] Göteborg University; 011-46-31-7865625; [email protected]
Johnsen, Julia [353] University of Minnesota; 612-626-5655; [email protected]
Johnson, Burke [682] University of South Alabama; 251-380-2751; [email protected]
Johnson, Cary [108-419] Brigham Young University; 801-360-8122; [email protected]
Johnson, Chantell [774] TCC Group; 312-794-7780; [email protected]
Johnson, Elmima [307-480-517-601] National Science Foundation; 703-292-5137; [email protected]
Johnson, Jeremiah [740] University of Illinois at Urbana-Champaign; 212-714-6774; [email protected]
Johnson, Kelli [344-827] University of Minnesota; 612-624-1457; [email protected]
Johnson, Knowlton [866] Pacific Institute for Research and Evaluation; 502-238-7339; [email protected]
Johnson, Lenora [346] National Institutes of Health; 301-594-0066; [email protected]
Johnson, Paul L [113-549] National Institutes of Health; 301-402-3213; [email protected]
Johnson, Stacy [710] Macro International Inc; 503-236-1626; [email protected]
Johnson, Trav [405] Brigham Young University; 801-422-5845; [email protected]
Johnston, Andrea L K [587] Johnston Research Inc; 416-913-4777; [email protected]
Johnston Nicholson, Heather [418-667] Girls Incorporated; 317-634-7546; [email protected]
Johri, Nalin [549] EngenderHealth; 212-561-8079; [email protected]
Jonaitis, Carmen [681] Western Michigan University; 269-382-2314; [email protected]
Joo, Hyejung [847] Korea Institute of Science and Technology Evaluation and Planning; 82-2-589-2933; [email protected]
Jordan, Audrey [352] Annie E Casey Foundation; 410-223-2952; [email protected]
Page 171
Jordan, Gretchen [376-411-446-797] Sandia National Laboratories; 505-844-9075; [email protected]
Jordan, Harmon [862] Abt Associates Inc; 617-349-2421; [email protected]
Juffer, Kris [414-838] Action Research & Associates Inc; 410-465-1299; [email protected]
Julius, Jim [483] San Diego State University; 619-594-5852; [email protected]
Julnes, George [301-367-439-505-800] Utah State University; 435-797-1633; [email protected]
Jung, Hoijong [847] Korea Institute of Science and Technology Evaluation and Planning; 82-2-589-2809; [email protected]
KKKKKKKK
Kaaria, Susan [331] International Centre for Tropical Agriculture; 256-41-567804; [email protected]
Kaczynski, Dan [647-743-780] University of West Florida; 850-474-2618; [email protected]
Kaesbauer, Susanne [684] Old Dominion University; 757-683-4591; sk'[email protected]
Kagan, Jonathan [124] National Institutes of Health; 301-896-4063; [email protected]
Kahlert, Rahel [131-810] University of Texas, Austin; 512-502-2375; [email protected]
Kahlert, Robert [810] University of Vienna; 512-502-2375; [email protected]
Kahn, Lynne [675] University of North Carolina; 919-962-2781; [email protected]
Kala, Mandira [331] University of Massachusetts, Boston; 617-287-5557; [email protected]
Kalishman, Summers [131-627-684] University of New Mexico; 505-272-3998; [email protected]
Kallemeyn, Leanne [758] University of Illinois at Urbana-Champaign; 217-244-1578; [email protected]
Kaminski, Gerry [597] Cincinnati Children's Hospital Medical Center; 513-636-0173; [email protected]
Kane, Cath [326] Cornell University; 212-340-2952; [email protected]
Kane, Mary [124] Concept Systems Inc; 607-272-1206; [email protected]
Kanyongo, Gibbs [616] Duquesne University; 412-396-5190; [email protected]
Kaplan, David [592] Case Western Reserve University; 216-368-1279; [email protected]
Karanja, Esther [672] World Agroforestry Centre; [email protected]
Kasprzak, Christina [675] University of North Carolina, Chapel Hill; 919-962-2783; [email protected]
Kaufman, Joy [729] Yale University; 203-789-7645; [email protected]
Kavanaugh, Maureen [131] Boston College; [email protected]
Kawakami, Alice [620-746-782] University of Hawaii; 808-348-9659; [email protected]
Kaylor Richardson, Kristin [550] Western Michigan University; 248-770-3430; [email protected]
Kazi, Mansoor [113-416-479-683] University at Buffalo; 716-645-3381 x232; [email protected]
Keene, Matt [850] United States Environmental Protection Agency; 202-566-2240; [email protected]
Kelly, Melissa [780] University of Illinois, Chicago; 773-826-8318; [email protected]
Kelly, Thomas [352-529-615-739] Annie E Casey Foundation; 410-223-2932; [email protected]
Kelsey, Kathleen [121] Oklahoma State University; 405-744-8137; [email protected]
Kemp, Amy [123] Indiana University; 812-855-4438; [email protected]
Kendrick, Claire [862] Agency for Healthcare Research and Quality; 301-427-1577; [email protected]
Kenison, Kelli [574] University of South Carolina; 803-777-1902; [email protected]
Kennedy, Brianna [836] University of Southern California; 323-257-5023; [email protected]
Kennedy, Meghan [454-684] Neumont University; 801-362-8371; [email protected]
Kennedy, Michaela [131] Family Services of Western Pennsylvania; 412-820-2050 x405; [email protected]
Kennedy, Sandra [418] LA's BEST After School Enrichment Program; 213-745-1900 x52993; [email protected]
Kern, Rienzzie [736] Heifer International; 501-907-2659; [email protected]
Kerr, Andrew [373] Georgia Institute of Technology; 404-894-9880; [email protected]
Ketema, Teserach [759] United States Department of Labor; 202-693-7908; [email protected]
Keys, Lela [665] Quitman County Development Corporation; 662-624-3484; [email protected]
Khan, Shaila [761] Tougaloo College; 601-977-7805; [email protected]
Kidani, Shirley [452] Executive Office on Aging; 808-586-7321; [email protected]
Kikuchi, Shinichi [544] National Institute of Advanced Industrial Science and Technology; 81-29-861-6096; [email protected]
Kim, HyeJin [131] Academy for Educational Development; 202-884-8000; [email protected]
Kim, Jeongsoo [656] University of California, Berkely; 510-717-2339; [email protected]
Kim, Jungmi [434] Sahmyook University; 82-02-3399-1570; [email protected]
Kim, Kellie [390] Caliber an ICF International Company; 703-279-6280; [email protected]
Kim, Kyoung jin [434] University of Illinois at Urbana-Champaign; 217-419-4053; [email protected]
Kim, Seong-jin [847] Korea Institute of Science and Technology Evaluation and Planning; 82-2-589-2978; [email protected]
Kimmich, Madeleine [686] Human Services Research Institute; 503-924-3783 x12; [email protected]
Kimura, Yoshitaka [124] Ministry of Economy, Trade and Industry; 81-3-3501-0681; [email protected]
Kincaid, Lawrence [424] Johns Hopkins University; 410-659-6300; [email protected]
King, Jason [766] Baylor College of Medicine; 713-798-8547; [email protected]
Page 172
King, Jean [100-339-377-827] University of Minnesota; 612-626-1614; [email protected]
King, Katherine [533] University of Michigan; 734-764-3946; [email protected]
King, Nicki [304] University of California, Davis; 530-752-3863; [email protected]
King, Rebekah [657] Spectrum Health Healthier Communities; 616-391-3312; [email protected]
King, Syd [726] New Zealand Qualifications Authority; 64 4 802 3000; [email protected]
Kingsbury, Nancy [413] United States Government Accountability Office; 202-512-2700; [email protected]
Kingsley, David [788] University of Kansas; 785-842-3807; [email protected]
Kingsley, Gordon [373] Georgia Institute of Technology; 404-894-0450; [email protected]
Kirkhart, Karen [302-337-445-628] Syracuse University; 315-443-5574; [email protected]
Kissam, Edward [351-747] JBS International Inc; 510-482-9979; [email protected]
Kistler, Susan [307] American Evaluation Association; 508-748-3326; [email protected]
Kitagawa, Tsutomu [813] New Energy and Industrial Technology Development Organization; 81-44-520-5160; [email protected]
Kittler, Brian [617] National Fish and Wildlife Foundation; 202-957-0166; [email protected]
Klein, Andrew [379] Advocates for Human Potential; 978-261-1435; [email protected]
Kloosterman, Valentina [338] University of Miami; 305-284-5815; [email protected]
Kniep, Christine [734] University of Wisconsin; 920-424-1973; [email protected]
Kniker, Ted [744] Federal Consulting Group; 202-504-3654; [email protected]
Ko, Kilkon [414] National University of Singapore; [email protected]
Kobayashi, Naoto [544] National Institute of Advanced Industrial Science and Technology; 81-29-861-2009; [email protected]
Koblinsky, Sally [131] University of Maryland; 301-405-4009; [email protected]
Koliba, Chris [649] University of Massachusetts; 802-656-3772; [email protected]
Komoto, Kazuaki [813] New Energy and Industrial Technology Development Organization; 81-44-520-5160; [email protected]
Konda, Kurt [860] University of Kansas School of Medicine; 316-293-2627; [email protected]
Konrad, Ellen L [383] Independent Consultant; 971-255-2528; [email protected]
Kopf, Nancy [665] NeighborWorks America; 202-220-2437; [email protected]
Koppelman, Jane [131] The Lewin Group; 703-269-5519; [email protected]
Korom-Djakovic, Danijela [131] Public/Private Ventures; 215-557-4439; [email protected]
Korpela, Karla [836] Michigan Technological University; 906-487-2219; [email protected]
Kosaka, Shin [544] National Institute of Advanced Industrial Science and Technology; 81-29-861-5145; [email protected]
Koschinsky, Julia [788] University of Illinois at Urbana-Champaign; 217-714-3779; [email protected]
Kosciw, Joseph [588-621] Gay, Lesbian and Straight Education Network; 646-388-8050; [email protected]
Kosheleva, Natalia [131] Ideas for Radiostations and Communities; 7-499-194-8254; [email protected]
Kouame, Julien [854] Western Michigan University; 404-441-0500; [email protected]
Koutsares, Alexander [725] Old Dominion University; 757-683-6684; [email protected]
Koyanagi, Masao [544] National Institute of Advanced Industrial Science and Technology; 81-29-861-5146; [email protected]
Kozik, Jen [398] LeCroy & Milligan Associates Inc; 520-326-5154 x111; [email protected]
Kracke, Kristen [107-318] United States Department of Justice; 202-616-3649; [email protected]
Kreger, Mary [818] University of California, San Francisco; 415-502-4544; [email protected]
Kriz, David [801] University of Mannheim; 49-621-181-2137; [email protected]
Kroenke, Kurt [131] Regenstrief Institute; 317-630-7447; [email protected]
Kromrey, Jeffrey [131] University of South Florida; 813-974-3220; [email protected]
Kucsera, John [440] University of Texas, Austin; 512-232-2635; [email protected]
Kuji-Shikatani, Keiko [410-805] Independent Consultant; 416-439-5223; [email protected]
Kung, Susanna [719] Academy for Educational Development; 212-367-4606; [email protected]
Kunimatsu, Sunao [544] National Institute of Advanced Industrial Science and Technology; 81-29-861-8289; [email protected]
Kuo, Victor [787-842] Bill & Melinda Gates Foundation; 206-709-3530; [email protected]
Kushner, Saville [303] University of the West of England; 00-44-117-344-4258; [email protected]
Kusi-Appouh, Deladem [131] Cornell University; 607-339-9558; [email protected]
Kuzmin, Alexey [594] Process Consulting Company; [email protected]
Kwon, Deborah H [111-718-789] The Ohio State University; 614-975-8325; [email protected]
LLLLLLLL
La Goy, Amy [338-600] Evaluation and Research Consulting; 510-665-5680; [email protected]
La Touche, Sylvette [715] University of Maryland, College Park; 301-405-3427; [email protected]
Lacey, Candace [463] Nova Southeastern University; 954-262-8575; [email protected]
LaChausse, Robert [311-452-751-820] California State University, San Bernardino; 909-537-7229; [email protected]
Ladage, Jessica [131] Old Dominion University; 757-309-4065; [email protected]
Ladd, Susan [396-666] Centers for Disease Control and Prevention; 770-488-5448; [email protected]
Page 173
LaFrance, Joan [392-427-587-628] Mekinak Consulting; 206-706-6829; [email protected]
Lahey, Robert [410] REL Solutions Inc; 613-728-4272; [email protected]
Lahti, Michel [453] University of Southern Maine; 207-626-5274; [email protected]
Lai, Chung [417] Land O'Lakes International Development Division; 703-247-7576; [email protected]
Lai, Morris [328-427-620-782] University of Hawaii; 808-956-7900; [email protected]
Lakshmanan, Aruna [362] University of North Carolina, Wilmington; 910-784-9523; [email protected]
Lamb, Yvette [107] Association for the Study and Development of Community; 301-519-0722 x112; [email protected]
Lambur, Michael [131] Virginia Tech; 540-239-3965; [email protected]
Lamming, Jean [751] University of California, Davis; 530-297-4659; [email protected]
Lamphear, Paul [106] Western Michigan University; 269-833-5799; [email protected]
Lander, Donna [650] Jackson State University; 601-979-2439; [email protected]
Landy, Ann [866] Westat; 301-251-2219; [email protected]
Larsen, Allison [423] Arizona State University; 480-620-8488; [email protected]
Larsen, Mandi [418] Safe Horizon; 212-577-8827; [email protected]
Lasch, Kathryn E [311] Mapi Values; 617-399-9641; [email protected]
Laszlo, Anna [131] Circle Solutions; 206-352-0464; [email protected]
Lauer, Patricia [820] Rocky Mountain Center for Health Promotion and Education; 303-867-9105; [email protected]
Lauver, Sherri [833] University of Rochester; 585-275-0057; [email protected]
LaVelle, John [340-604] Claremont Graduate University; 952-807-3777; [email protected]
Lavergne, Christopher [380-659] WaterLINK; 785-532-2732; [email protected]
Lavinghouze, Rene [344-499-661] Centers for Disease Control and Prevention; 770-488-5905; [email protected]
Lawrence, Irma [111] United States Department of Agriculture; 202-720-2082; ilawrencewcsrees.usda.gov
Lawrenz, Frances [344-827-844] University of Minnesota; 612-625-2046; [email protected]
Lawton, Brian [838] University of Hawaii; 808-956-4919; [email protected]
Lawton, Darryl [546] McManis and Monsalve Asociates; 814-460-6258; [email protected]
Le Menestrel, Suzanne [667-843] United States Department of Agriculture; 202-720-2297; [email protected]
Le Rouzic, Violaine [720] World Bank; 202-473-6430; [email protected]
Leake, Robin [375-425-864] JVA Consulting LLC; 303-477-4986; [email protected]
Leary, Heather [387] Utah State University; 435-797-2650; [email protected]
LeBaron Wallace, Tanner [705] University of California, Los Angeles; 310-701-8731; [email protected]
Lee, Anthony [131] University of South Carolina, Columbia; 803-545-3826; [email protected]
Lee, Chin-Huey [559] Oklahoma State University; 405-744-8003; [email protected]
Lee, Diana [818] National Community Development Institute; 510-763-4120 x215; [email protected]
Lee, Janet [647] University of California, Los Angeles; 310-625-4883; [email protected]
Lee, Jason [836] Detroit Area Pre-College Engineering Program; 313-831-3050; [email protected]
Lee, Kien [525-857] Association for the Study and Development of Community; 301-519-0722 x108; [email protected]
Lee, Linda [620] Proactive Information Services Inc; 204-943-2370; [email protected]
Lee, Sang-Youb [847] Korea Institute of Science and Technology Evaluation and Planning; 82-2-589-2910; [email protected]
Lee, Silvia [362] American Institutes for Research; 202-403-6922; [email protected]
Lee, Steven [387] University of Kansas; 785-864-9701; [email protected]
Lee, Tammy [352] Alameda County Public Health Department; 510-268-2619; [email protected]
Lee, Wonsuk [323] University of Illinois, Urbana; 217-766-3568; [email protected]
Lee, Yi-Fang [315-789] National Chi Nan University; 886-2-2362-7553; [email protected]
Lee-Ougo, Wilhelmena [425] The MayaTech Corporation; 301-587-1600 x2309; [email protected]
Lefebvre, Helene [131] University of Montreal; 514-343-6111
Lekies, Kristi [131-780] The Ohio State University; 614-688-3537; [email protected]
Lemaitre, Catalina [350] United States Department of State; 202-203-7134; [email protected]
Leon, Ana [131] JVA Consulting LLC; 303-477-4896; [email protected]
Lesesne, Catherine [609-636] Centers for Disease Control and Prevention; 770-488-6564; [email protected]
Letichevsky, Ana Carolina [131-315-456] Cesgranrio Foundation; 55 21 21039640; [email protected]
Letourneau, Lawrence [391] University of Nevada, Las Vegas; 702-730-6114; [email protected]
Levenson, Cheri [118-358] Cherna Consulting; 602-380-8367; [email protected]
Leverett, Aisha [131-340] Loyola University, Chicago; 773-508-7330; [email protected]
Levesque, Jonathan [327] University of Montreal; 514-279-4221; [email protected]
Levin, Henry M [301] Columbia University; 212-678-3857; [email protected]
Levine, Carlisle [348-465-736-839] Catholic Relief Services; 410-951-7395; [email protected]
Levine, Roger E [131] American Institutes for Research; 650-843-8160; [email protected]
Levin-Rozalis, Miri [410] Ben-Gurion University of Negev; 972 03 532 0076; [email protected]
Levinson-Johnson, Jody [636] Coordinated Care Services Inc; 585-613-7648; [email protected]
Page 174
Levy, Deborah [319] Points of Light Foundation; 202-729-8190; [email protected]
Levy, Lisa [862] Centers for Disease Control and Prevention; 770-488-8489; [email protected]
Lewa, Kenga Kadenge [331] Kenya Agricultural Research Institute; 254-722284640; [email protected]
Lewis, Ashlee [118] University of South Carolina; 803-777-3459; [email protected]
Lewis, Debby [545] The Ohio State University; 614-292-5089; [email protected]
Lewis, Kelly [609] James Madison University; 540-434-6299; [email protected]
Lewis, Kristi [382] James Madison University; 540-434-6299; [email protected]
Lewis-Charp, Heather [460] Social Policy Research Assocaites; 510- 763-1499; [email protected]
Lezcel, Donna Kay [748] Academy for Educational Development; [email protected]
Li, Jilan [656] University of North Carolina, Chapel Hill; 919-962-1225; [email protected]
Liang, Shu [391] Oregon Department of Corrections; 503-945-9037; [email protected]
Lichtenstein, Carolyn [798] Walter R McDonald & Associates Inc; 301-881-2590 x237; [email protected]
Lieber, Michael [640] University of Illinois, Chicago; 312-996-7000; [email protected]
Liebow, Edward [359] Battelle Centers for Public Health Research and Evaluation; 206-528-3155; [email protected]
Light, Daniel [110] Education Development Center Inc; 212-807-4200; [email protected]
Lingle, Jeremy [673] Georgia State University; 404-463-0821; [email protected]
Linton, Marigold [580] University of Kansas; 480-946-1181; [email protected]
Lippy, Caroline [131] Georgia State University; 410-916-5447; [email protected]
Lisi, Penelope [434] Central Connecticut State University; [email protected]
Liston, Carrie [579] Puget Sound Center for Teaching, Learning and Technology; 425--68-1020 x1052; [email protected]
Little, Sean [131] Independent Consultant; 954-565-6679; [email protected]
Livet, Melanie [609] University of South Carolina; 803-978-7577; [email protected]
Livny, Ayala [716] Cambridge Cares About AIDS; 617-661-2803; [email protected]
Llewellyn, Donna [373] Georgia Institute of Technology; 404-894-2340; [email protected]
Lloyd, Andrea [376] North Carolina State University; 919-515-3237; [email protected]
Lobosco, Anna [833] New York State Developmental Disabilities Planning Council; 518-486-7505; [email protected]
Lockett, Michelle [757] Western New York Independent Living Project Inc; 716-836-0822 x112; [email protected]
Lockheed, Marlaine [720] Independent Consultant; 609-921-3930; [email protected]
Lockwood, Brian [516] Temple University; 215-204-7918; [email protected]
Loesch-Griffin, Deborah [523] University of Nevada, Reno; 775-843-2275; [email protected]
Lohmeier, Jill [387-650] University of Massachusetts, Lowell; 978-934-4617; [email protected]
Lombardi, Karen [131] University of Kansas; 785-864-9675; [email protected]
Long, Michael [123] Macro International Inc; 301-572-0945; [email protected]
Longo, Paul [368-385-532] Touro Infirmary; 504-367-7568; [email protected]
Lonsdale, Jeremy [413-519] United Kingdom National Audit Office; 00-44-207-798-7412; [email protected]
Loo, Ryan [862] Centers for Disease Control and Prevention; 770-488-5698; [email protected]
Lopez, Rachel [407] Claremont Graduate University; [email protected]
Lorton Jr, Paul [363-406-802] University of San Francisco; 650 854 2406; [email protected]
Lott, LaTonya [131] Professional Associates Inc; 601-982-1593; [email protected]
Louie, Justin [478-582-714] Blueprint Research & Design Inc; 415-677-9700 x15; [email protected]
Love, Arnold [553-805] Independent Consultant; 416-485-2159; [email protected]
Love, Craig [517] Westat; 401-954 5683; [email protected]
Lu, Xuejin [104] Children's Services Council of Palm Beach County; 561-655-1010 x2210; [email protected]
Lubke, Margaret [483] Utah State University; 435-797-4536; [email protected]
Lucas, Colleen [666] Calgary Health Region; 403-297-5189; [email protected]
Lucero, Ed [375] The Colorado Trust; 303-837-1200; [email protected]
Luellen, Jason [834] Vanderbilt University; 615-343-4561; [email protected]
Lugo, Barbara [131] New Mexico State University; 505-646-7438; [email protected]
Luluquisen, Mia [352] Alameda County Public Health Department; 510-267-3224; [email protected]
Lusiola, Grace [549] EngenderHealth; 255-22-2772365; [email protected]
Luther, James [102] Luther Consulting LLC; 317-636-0282 x102; [email protected]
Lyde, Michael [846] Role of Men; 562-342-6605; [email protected]
Lynch, Christy [105] Partners in Evaluation and Planning; 410-371-0706; [email protected]
Lynch, Kathleen [826] Virginia Commonwealth University; 804-828-9580; [email protected]
Lyons, Angela [679] University of Illinois at Urbana-Champaign; 217-244-2612; [email protected]
Lysenco, Larysa [327] Concordia University; 514-571-1227; [email protected]
MMMMMMMM
Page 175
Mabry, Linda [571-680-770] Washington State University, Vancouver; 360-546-9428; [email protected]
MacDonald, Goldie [566] Centers for Disease Control and Prevention; 770-488-553; [email protected]
Machtmes, Krisanna [845] Louisiana State University; 225-578-7844; [email protected]
MacKay, Keith [519] World Bank; 202-473-7178; [email protected]
Mackievsky, Polina [319] Points of Light Foundation; 202-729-8297; [email protected]
MacQuarrie, David [672] Western Michigan University; 269-382-6877; [email protected]
Madden, Sandy [795] Western Michigan University; 269-387-4010; [email protected]
Magnuson, Helen [625] Network for a Healthy California; 916-449-5420; [email protected]
Magombo, Tennyson [331] Consultative Group on International Agricultural Research; 265-1-7-7387; [email protected]
Mahon, Shelly [565-773] University of Wisconsin, Madison; 608-770-1342; [email protected]
Maina, Nyambura [830] Montgomery County Public Schools; 301-517-5828; [email protected]
Maitre, Heather [395-430] KPMG; 201-307-8177; [email protected]
Maker, Liz [352] Alameda County Public Health Department; 510-267-8096; [email protected]
Malan, Gina [752] Central American Resources Center; 415-648-4407; [email protected]
Malerba, Franco [364] Luigi Bocconi University; 39-02-5836-3391; [email protected]
Malofeeva, Elena [590] High/Scope Educational Research Foundation; 734-485-2000; [email protected]
Malter, Frederic [626] University of Arizona; 520-318-7259 x119; [email protected]
Mamary, Edward [338] San Jose State University; 510-452-4657; [email protected]
Manchester, Julianne [820] The Ohio State University; 614-284-2987; [email protected]
Manning, Colleen [625] Goodman Research Group Inc; 617-491-7033; [email protected]
Mano, Tomoko [544] National Institute of Advanced Industrial Science and Technology; [email protected]
Manteuffel, Brigitte [758-798] Macro International Inc; 404-321-3211; [email protected]
Manuel, Diane [311-484-818] The California Endowment; 800-449-4149 x8674; [email protected]
Maples, Connie [710] Macro International Inc; 503- 321-3211; [email protected]
Maranda, Michael [763] Independent Consultant; 322-779-8808; [email protected]
Marczak, Mary [622] University of Minnesota; 612-626-3968; [email protected]
Marek, Annette [680] Chicago Public Schools; 312-203-7003; [email protected]
Margoluis, Richard [563] Foundations of Success; [email protected]
Mark, John [835] Stanford University; [email protected]
Mark, Melvin [300-367-371-442-660-775] Pennsylvania State University; 814-863-1755; [email protected]
Markovitz, Carrie [379-822] Abt Associates Inc; 301-634-1807; [email protected]
Marquart, Jules M [312-521] Centerstone Community Mental Health Centers Inc; 615-460-4168; [email protected]
Marriott, Brian [366-534-561] Calgary Health Region; 403-297-2498; [email protected]
Marshall, Susan [758] Southern Illinois University, Carbondale; 618-453-3536; [email protected]
Martens, Krystin [106] Western Michigan University; 616-335-8280; [email protected]
Martin, Anne [428] University of Colorado, Denver; 303-556-6179; [email protected]
Martin, Gwen [131] Center for Women's Business Research; 202-638-3060; [email protected]
Martin, Judy [131-344] Wheeling Jesuit University; 304-243-2491; [email protected]
Martineau, Jennifer [114-407-644-837] Center for Creative Leadership; 336-286-4419; [email protected]
Martinez, Heyda [356] SUAGM; 787-766-1717; [email protected]
Martinez, Raul [681] Harder & Company Community Research; 415-522-5400; [email protected]
Martinez-Rubin, Norma [131-600] Evaluation Focused Consulting; 510-724-9509; [email protected]
Martyris, Daryl [742] Save the Children USA; 202-293-4170; [email protected]
Martz, Wes [313-792] Western Michigan University; 269-273-3076 x2263; [email protected]
Mason, Jennifer [347] Battelle Centers for Public Health Research and Evaluation; 410-372-2724; [email protected]
Mason, Maryann [820] Children's Memorial Hospital, Chicago; [email protected]
Massey, Mike [682] Communities in Schools, Charlotte-Mecklenburg; 704-943-9441; [email protected]
Massey, Oliver [711] University of South Florida; 813-974-6403; [email protected]
Matheson, Karen [749] M+R Strategic Services; 206-447-9089; [email protected]
Mathison, Sandra [338-505-701-773] University of British Columbia; 604-879-7386; [email protected]
Matsunaga, Isao [544] National Institute of Advanced Industrial Science and Technology; 81-29-861-8201; [email protected]
Matthews, Lori [131-862] Spokane Research Laboratory; 509-354-8066; [email protected]
Mattingly, Kate [406] Windwalker Corporation; 703-970-3503; [email protected]
Mattox, John [395-430-722] KPMG; 615-591-1032; [email protected]
Matulis, Jan [676] University of Cincinnati; 513-556-1479; [email protected]
Maxwell, Ann [307-394-464] United States Department of Health and Human Services; 312-353-9871; [email protected]
May, Ken [370] South Carolina Arts Commission; 803-734-8689; [email protected]
Mayes, Brandii [389] Saint Louis City Department of Health Communicable Disease; 314-612-5182; [email protected]
Maynard, Ron [642] University of Washington; 206-522-5390; [email protected]
Page 176
McBee, Matthew [663] University of North Carolina; 919-843-0448; [email protected]
McBride, Dominica [857] Arizona State University; 480-430-9709; [email protected]
McCormick, Sara [439] University of Utah; 801-585-7764; [email protected]
McCormick, Treseen [476] WestEd; 562-799-5169; [email protected]
McCree-Hale, Nish [612] University of Alabama, Birmingham; 205-276-4401; [email protected]
McDonald, Daniel [397-815] University of Arizona; 520-626-5161; [email protected]
McDonald, Katherine [119] Portland State University; 503-725-3995; [email protected]
McEathron, Mary A [810] University of Minnesota; 612-728-3850; [email protected]
McEwen, Laura [131] Queen's University; 613-533-6000 x75016; [email protected]
McGee, Jennifer [659] Kansas State University; 785-532-2684; [email protected]
McGough, Liz [764-773] University at Buffalo; 716-835-0620; [email protected]
McGowen, Lindsey [376] North Carolina State University; 919-515-3237; [email protected]
McGroder, Sharon [131] The Lewin Group; 703-269-5530; [email protected]
Mchenga, Rhino [603] Ministry of Economic Planning and Development; 265-9-604-879; [email protected]
McKegg, Kate [354-372-606] The Knowledge Institute Ltd; 6421-475-919; [email protected]
McKillip, Jack [127-758] Southern Illinois University, Carbondale; 618-536-2301; [email protected]
McKinney, Christopher [426] University of Northern Colorado; 303-504-6638; [email protected]
McKlin, Tom [307-373-443-558-625] Georgia Institute of Technology; 404-894-0297; [email protected]
McKnight, Katherine [438-804] Pearson Achievement Solutions; 703-389-5401; [email protected]
McKnight, Patrick [367-868] George Mason University; 703-349-3137; [email protected]
McKnight Lynch, Molly [635] University of North Carolina, Chapel Hill; 919-966-9325; [email protected]
McLain, Edward [758-827] University of Alaska, Anchorage; 907-952-8940; [email protected]
McLaughlin, Sean [860] DFI Government Services; 202-533-0015; [email protected]
McLinden, Daniel [597] Cincinnati Children's Hospital Medical Center; 513-636-8933; [email protected]
McMillen, Robert [751] Mississippi State University; 662-325-2742; [email protected]
McNair, Shannan [795-836] Oakland University; 248-320-5637; [email protected]
McNamara, Lynne [315] Vietnam Education Foundation; 703-351-5053; [email protected]
McNary, Scot [830] Montgomery County Public Schools; 301-279-3209; [email protected]
McNulty, Mark [552] University of Wyoming; 307-742-4204; [email protected]
Mech, Edmund [127] Indiana University Purdue University Indianapolis; 360-738-1774; mechresearch.qwest.net
Medina, Adriana [338] University of Miami; 305-284-5815; [email protected]
Medina, Ricky [306] Carson City School District; 775-283-1532; [email protected]
Meinhold, Stephen [707] University of North Carolina, Wilmington; 910-962-3223; [email protected]
Melzer, Becky A [131] Independent Consultant; 240-994-0143; [email protected]
Menke, J Michael [619] University of Arizona; 520-887-4327; [email protected]
Mennis, Jeremy [516] Temple University; 215-204-7692; [email protected]
Menon, Goutham [527] University of Texas, San Antonio; 210-458-2465; [email protected]
Menon, Roshni [110] Education Development Center Inc; 212-807-4233; [email protected]
Merola, Stacey [408] American Institutes for Research; 202-403-5356; [email protected]
Mertens, Donna [620-685-705] Gallaudet University; 202-651-5545; [email protected]
Metcalf, Eric [682] Communities in Schools, Central Texas; 512-464-9723; [email protected]
Meter, Ken [600-776] Crossroads Resource Center; 612-869-8664; [email protected]
Metz, Stacie [131] West Chester University; 610-436-2101; [email protected]
Meyer, Cheryl [819] Wright State University; [email protected]
Meyers, Daniel [610] Al Sigl Center; 585-442-4102; [email protected]
Meyers, Duncan [609-636] University of South Carolina; 803-978-7578; [email protected]
Michaud, William [380-450] SRA International Inc; 860-738-7501; [email protected]
Middendorf, Jan [659] Kansas State University; 785-532-4716; [email protected]
Middleton, Steven [571] Southern Illinois University, Carbondale; 618-453-3536; [email protected]
Mielke, Erin [549] EngenderHealth; 212-561-8061; [email protected]
Migotsky, Christopher [317] University of Illinois at Urbana-Champaign; 217-333-3470; [email protected]
Mijanovich, Tod [664] New York University; 212-998-7467; [email protected]
Mikelbank, Kristen [131] Case Western Reserve University; [email protected]
Mikhailova, Liudmila [591] Delphi International of World Learning; 202-294-8128; [email protected]
Milch, Heidi [683] Gateway-Longview Inc; 716-883-4531; [email protected]
Miles, Martha [131] Training Inc; 317-264-6740; [email protected]
Militello, Matthew [611-778] University of Massachusetts, Amherst; 413-545-1188; [email protected]
Miller, Joyce A [333] KeyStone Research Corporation; 814-336-9295; [email protected]
Miller, Kirsten [433] Mid-continent Research for Education and Learning; 303-632-5632; [email protected]
Page 177
Miller, Louise [382] University of Missouri, Columbia; 573-884-9542; [email protected]
Miller, M David [702] University of Florida; 352-392-0723 x238; [email protected]
Miller, Robin [602-773] Michigan State University; 517-432-3267; [email protected]
Miller, Russ [832] University of Wyoming; 307-399-1433; [email protected]
Miller, Tess [767] Queen's University; 613-533-6000 x75952; [email protected]
Miller-Stevens, Katrina [405] University of Colorado, Denver; 720-252-6945; [email protected]
Millington, Wayne [335] Centers for Disease Control and Prevention; 770-488-2537; [email protected]
Mills, Jack [580-735] Independent Consultant; 909-624-7572; [email protected]
Mills, Valerie [795] Oakland Schools; 909-624-7572; [email protected]
Minato, Naonobu [606] Foundation for Advanced Studies on International Development; 81-3-5226-0305; [email protected]
Mines, Jan [131-627] University of New Mexico; 505-272-8069; [email protected]
Minner, Daphne [829] Education Development Center Inc; 617-969-7100; [email protected]
Minyard, Karen [131] Georgia State University; 404-651-3104; [email protected]
Miranda, Joyal [404-629] University of Toronto; 416-946-8183; [email protected]
Mireault, Gilles [131] Centre Jeunesse de Québec-Institut Universitaire; 418-661-6951; [email protected]
Miron, Gary [571-836] Western Michigan University; 269-387-3771; [email protected]
Mitchell, Shelia [613] Howard University; 301-509-1111; [email protected]
Mitchell, Tammi [559] Oklahoma State University; 405-478-0360; [email protected]
Miyokawa, Chikahiro [124] Ministry of Economy, Trade and Industry; 81-3-3501-0681; [email protected]
Mizuno, Koichi [544] National Institute of Advanced Industrial Science and Technology; 81-29-862-6499; [email protected]
Mobrouk, Abdelah [465] Lutheran World Relief; [email protected]
Moglia, Dena [816] United States Environmental Protection Agency; 202-343-9221; [email protected]
Mohan, Rakesh [631-688-794] Idaho State Legislature; 208-334-3880; [email protected]
Moll, Carlos [781] University of Arizona; 520-603-1622; [email protected]
Monaghan, Diane [708] Cassandra Drennon & Associates; 706-543-2971; [email protected]
Monahan-Gibson, Liz [324] Federal Emergency Management Agency; 202-251-0233; [email protected]
Mongiat, Stéphanie [740] Université du Québec à Montréal; 514-098-3000 x4702; [email protected]
Monterrey, Javier [549] Independent Consultant; 591-2-24408096; [email protected]
Montgomery, Ann Elizabeth [532-612] University of Alabama, Birmingham; 205-253-9900; [email protected]
Montoya, Daniel [124] Hill and Knowlton; 202-944-1978; [email protected]
Montrosse, Bianca [305-604] University of North Carolina, Chapel Hill; 919-966-9153; [email protected]
Moore, Audrey-Marie [131-748] Academy for Educational Development; 202-884-8187; [email protected]
Moore, Claire [609] Centers for Disease Control and Prevention; 770-488-6564; [email protected]
Moore, Kurt [798] Walter R McDonald & Associates Inc; 303-486-6961; [email protected]
Moore, Laurie [625] Mid-continent Research for Education and Learning; 303-632-5564; [email protected]
Moore Kubo, Melanie [553] See Change Evaluation; 415-637-3000; [email protected]
Moore Parmley, Angela [429] National Institutes of Justice; 202-307-0145; [email protected]
Mooss, Angela [131] Georgia State University; 404-651-3394; [email protected]
Moran, Garrett E [471-683] Westat; 301-294-3821; [email protected]
Morell, Jonathan [658-741-773] New Vectors LLC; 734-302-4668; [email protected]
Morell, Linda [672] University of California, Berkeley; 510-329-3998; [email protected]
Morgan, Grant [788] Praxis Research Inc; 704-523-2999; [email protected]
Morgan, Sean [131] Working For Togetherness; 773-265-5626; [email protected]
Morgan, Vernita [131] University of Iowa; 319-353-5373; [email protected]
Morris, Amy [112] University of Nevada, Las Vegas; 702-895-3253; [email protected]
Morris, Michael [336-678-814] University of New Haven; 203-932-7289; [email protected]
Morrow, Jennifer [131-684] University of Tennessee; 757-683-4448; [email protected]
Mortensen, John [797] Energetics Inc; 847-289-0082; [email protected]
Moss, Marcey [506-723] Indiana University; 812-855-4438; [email protected]
Moss-Summers, Vanessa [131-395] Xerox Corporation; 703-724-6105; [email protected]
Mote, Jonathon [411] University of Maryland; 301-405-9746; [email protected]
Moumane, Driss [839] Catholic Relief Services; 260-97-740-929; [email protected]
Mountain, Leigh [760] University at Albany; 518-442-3267; [email protected]
Moyo, Thomas [421] Catholic Relief Services; 260 1 224131; [email protected]
Mozzer, Michael [131] Yale New Haven Health; 203-688-2594; [email protected]
Mueller, Michael P [131-590] The Hospital for Sick Children; 416-813-7654 x8836; [email protected]
Mueller, Nancy [717] Saint Louis University; 314-977-4027; [email protected]
Mukhopadhyay, Kankana [131] University of Rochester; 585-356-9677; [email protected]
Mulatu, Mesfin S [425] The MayaTech Corporation; 301-587-1600 x3006; [email protected]
Page 178
Mulford, Carrie [379] United States Department of Justice; 202-307-2959; [email protected]
Mundy, Eric [840] University of Akron; 330-972-5465; [email protected]
Munson, April [677] University of Illinois at Urbana-Champaign; 859-277-0128; [email protected]
Munya, Stella [344] Caliber an ICF International Company; 703-219-3950; [email protected]
Murphy, Deena [306-593] National Development and Research Institutes Inc; 919-863-4600 x224; [email protected]
Murphy, Julie [686] Human Services Research Institute; 503-924-3783 x25; [email protected]
Murray, Bianca [351] JBS International Inc; 650-373-4900; [email protected]
Murray, Jill [679] Oregon State University; 541-737-8839; [email protected]
Murray, Keith [408-863] M A Henry Consulting LLC; 314-353-8905; [email protected]
Murray, Steve [737] RMC Research Corporation; 800-788-1887; [email protected]
Muscella, Deborah [122] Girls Get Connected Collaborative; [email protected]
Mwavita, Mwarumba [559] Oklahoma State University; 405-744-9451; [email protected]
Myers, Gail [564] University of Tennessee, Knoxville; 865-974-4924; [email protected]
Myhlhousen-Leak, Georgetta [726] University of Iowa; 631-569-0027; [email protected]
Myrick, Shannon [119] Portland State University; 503-730-1359; [email protected]
Mzumara, Howard [307-517-684] Indiana University Purdue University Indianapolis; 317-278-2214; [email protected]
NNNNNNNN
Nadler, Joel [571-758-780-834] Southern Illinois University, Carbondale; 618-453-3519; [email protected]
Nagao, Masafumi [805] Hiroshima University; 81-82-424-6249; [email protected]
Nahan, Neva [307-387-485-772] Wayne State University; 313-577-9918; [email protected]
Naidoo, Gordon [129] Open Learning Systems Education Trust; 27 11 3395491; [email protected]
Najab, Julius [518-618] George Mason University; 703-993-8282; [email protected]
Nakamura, Aric [853] University of Hawaii, Manoa; 808-956-9090; [email protected]
Nakamura, Osamu [124-544] National Institute of Advanced Industrial Science and Technology; 81-29-862-6096; [email protected]
Nakatsu, Suzuko [544] National Institute of Advanced Industrial Science and Technology; 81-29-861-6096; [email protected]
Nargiso, Jessica [401-419] University of Rhode Island; 401-277-5491; [email protected]
Nash, John [307-355-484] Open Eye Group; 650-799-6703; [email protected]
Nault-Brière, Frederic [327] University of Montreal; 514-393-4666 x2006; [email protected]
Naumann, Craig [351] JBS International Inc; 650-373-4900; [email protected]
Navarro, Alice [407] Texas State University-San Marcos; 512-947-8573; [email protected]
Nelson, Catherine [109] Independent Consultant; 412-478-5342; [email protected]
Nelson, Meta [735] Bassett Unified School District; 626-931-3000; [email protected]
Nelson, Randi K [131] University of Minnesota; 763-557-9585; [email protected]
Nelson, Robert [131] ASPEN Associates Inc; 715-376-4311; [email protected]
Neubauer, Leah [622] DePaul University; 773-325-4768; [email protected]
Nevins, Andrew [799] Stanford University; 650-354-8115; [email protected]
Newcomer, Kathryn [631] George Washington University; 202-994-6295; [email protected]
Newhouse, Corey [529] Children Now; 510-763-2444; [email protected]
Newman, Dianna [760-833] University at Albany; 518-442-5018; [email protected]
Newman, Fred [367-673-801] Florida International University; 305-348-0426; [email protected]
Ngoma, Peter [417] Land O'Lakes International Development Division; 265 -1-775119; [email protected]
Nguyen, Phuong [315] Vietnam Education Foundation; 703-351-5053; [email protected]
Nichols, Allison [343-397-679] West Virginia University; 304-293-2796 x3451; [email protected]
Nichols, Lindsay [340] Loyola University, Chicago; 773-508-3023; [email protected]
Nichols, Richard [116-628] Colyer Nichols Inc Consulting; 505-747-0190; [email protected]
Nichols, Tristi [807] Manitou Inc; 914-737-7443; [email protected]
Nistler, Mary [607] Learning Point Associates; 312-288-7629; [email protected]
Njuki, Jemimah [331] Consultative Group on International Agricultural Research; 265-170-7387; [email protected]
Nochajski, Tom [416] University at Buffalo; 716-645-3381; [email protected]
Noether, Chanson [516] Policy Research Associates; 518-439-7415 x224; [email protected]
Noga, Janice [307-362-409-537-676] Pathfinder Evaluation and Consulting; 513-533-1643; [email protected]
Nolan, Charles [389] Public Health - Seattle and King County; 206-324-2113; [email protected]
Norels, Gregory [131] Working For Togetherness; 773-265-5626; [email protected]
Norland, Emmalou [102-307-445-570-827] Institute for Learning Innovation; 410-956-5144 x103; [email protected]
Norman, Naomi [795] Washtenaw Intermediate School District; 734-994-8100 x1263; [email protected]
Norris, Alicia [508] Centers for Disease Control and Prevention; 770-488-8523; [email protected]
Norris, Kim [320] Independent Consultant; 802-985-5024; [email protected]
Page 179
Nowell, Branda [503-808] North Carolina State University; 919-513-1768; [email protected]
Nunnery, John [725] Old Dominion University; 757-683-6684; [email protected]
Nyandoro, Aisha [584] Michigan State University; 517-432-7160; [email protected]
OOOOOOOO
Obradovic, Zoran [516] Temple University; 215-204-6265; [email protected]
Ocampo, Ada [805] United Nations Children's Fund; 212-824-6748; [email protected]
O'Connell, Brian [423] Arizona Department of Education; 602-542-3131; brian.o'[email protected]
Odumbe, Michael [417] Land O'Lakes International Development Division; 254-20-3746034; [email protected]
Oeltmann, John [389] Centers for Disease Control and Prevention; 404-639-2429; [email protected]
Ogasahara, Kazuki [124] Ministry of Economy, Trade and Industry; 81-3-3501-0681; [email protected]
Ogilvie, Kristen [866] Pacific Institute for Research and Evaluation; 907-565-1218; [email protected]
O'Hara, Jerald [762] Centers for Disease Control and Prevention; 404-639-4856; [email protected]
Ohkubo, Saori [311] Johns Hopkins University; 410-659-6398; [email protected]
Okada, Momoko [813] New Energy and Industrial Technology Development Organization; 81-44-520-5161; [email protected]
Olafson, Lori [380] University of Nevada, Las Vegas; 702-895-1313; [email protected]
Olatunji, Anane [131-443-625-863] George Washington University; 202-496-2200; [email protected]
O'Leary, Lisa [115] Tufts University; 617-627-5217; [email protected]
Oleksiw, Catherine A [113] Academy for Educational Development; 202-884-8622; [email protected]
Oliver, John [611] Michigan State University; [email protected]
Oliver, Monica [390] Georgia State University; 404-931-9759; [email protected]
Olmos, Antonio [131-426-683] Mental Health Center of Denver; 303-504-6661; [email protected]
Olsson, Tina [528] Göteborg University; 011-46-31-201937; [email protected]
Oppenheim, Elizabeth [709] Walter R McDonald & Associates Inc; 301-881-2590 x243; [email protected]
Orians, Carlyn [716] Battelle Centers for Public Health Research and Evaluation; 206-528-3320; [email protected]
Ornelas, Beatriz [562] California State University, Los Angeles; 323-327-7178; [email protected]
Orr, Larry [822] Abt Associates Inc; 301-634-1724; [email protected]
Ortega, Milton [337] Portland State University; 971-732-0171; [email protected]
Ortega, Sandra [752] Kent State University; 330-672-0746; [email protected]
Ortiz, Anna [611] California State University, Long Beach; 562-985-9367; [email protected]
Ortiz, Rhonda [582] The California Endowment; 213-928-8675; [email protected]
Orwin, Robert [800-866] Westat; 301-251-2277; [email protected]
Ory, John [317] University of Illinois at Urbana-Champaign; 217-333-3370; [email protected]
Osborne, Karol [845] Louisiana State University; 318-574-2465; [email protected]
Osher, David [636] American Institutes for Research; 202-251-2892; [email protected]
Osuji, Thearis [317] Macro International Inc; 404-321-3211; [email protected]
O'Sullivan, John [663-810] North Carolina A & T State University; 919-960-6952; [email protected]
O'Sullivan, Rita [131-307-486-663-721-810-867] University of North Carolina, Chapel Hill; 919-843-7878; [email protected]
Otero-Fisher, Karen [131] Old Dominion University; 757-589-9680; [email protected]
Ottenritter, Nan [131] Virginia Community College System; 804-819-4966; [email protected]
Owens, Emiel [480-823] Texas Southern University; 713-313-4274; [email protected]
Owens Jr, Emiel W [307] Texas Southern University; 703-313-4274; [email protected]
Ozdogru, Asil [366] University at Albany; 518-961-1583; [email protected]
Öztürk, Mehmet Dali [344] Arizona State University; 480-965-3696; [email protected]
PPPPPPPP
Pace, Katherine [577] Louisiana State University; 318-226-6805; [email protected]
Pagkos, Brian [683] University at Buffalo; 716-628-1853; [email protected]
Pahl, Dale [831] United States Environmental Protection Agency; 919-696-6086; [email protected]
Palan, Martha [759] Westat; 240-314-7546; [email protected]
Paleo, Lyn [752] Evaluation Research and Training; 510-967-6792; [email protected]
Palmer, Lance [679] University of Georgia; 706-542-4916; [email protected]
Palmer, Louise [382] The Urban Institute; 202-261-5376; [email protected]
Palmisano, Michael [859] The Ball Foundation; 630-469-6270; [email protected]
Pals, Sherri [607] Centers for Disease Control and Prevention; 404-639-6174; [email protected]
Pankey, Kristin [780] Southern Illinois University, Carbondale; 618-920-1130; [email protected]
Parent, Kay [819] Wright State University; [email protected]
Park, Jiyoung [637-847] Korea Institute of Science and Technology Evaluation and Planning; 82-2-589-2842; [email protected]
Page 180
Park, Jongman [637] Korea Institute of Industrial Technology Evaluation and Planning; 703-459-3222; [email protected]
Parsons, Beverly [374-627-752-769] InSites; 661-343-5052; [email protected]
Paruzzolo, Silvia [827] World Bank; 202-299-6422; [email protected]
Pascopella, Lisa [389] Francis J Curry National Tuberculosis Center; 415-502-4600; [email protected]
Pasti, Lawrence [609] New York State Office of Children and Family Services; 518 561 8740; [email protected]
Pastore, Serafina [358] University of Bari; 039-349-877-8918; [email protected]
Patchner, Michael [127] Indiana University Purdue University Indianapolis; [email protected]
Patrinos, Harry [614] World Bank; 202-473-5510; [email protected]
Patrizi, Patricia [355] Patrizi Associates; 215-572-1647; [email protected]
Patterson, Davis [359] Battelle Centers for Public Health Research and Evaluation; 206-528-3029; [email protected]
Patterson, Tracy [722] Center for Creative Leadership; 336-286-4418; [email protected]
Pattison, Mary J [760] University at Albany; 518-442-9996; [email protected]
Patton, Michael Quinn [120-700-705-793-841-871] Utilization-Focused Evaluation; 651-690-3254; [email protected]
Paxton, Amy [666] University of North Carolina; 757-561-6511; apaxton@@email.unc.edu
Payette, Alydia [439] Vermont Division of Vocational Rehabilitation; 802-334-4455; [email protected]
Payne, Jacey [766] Howard Research & Management Consulting Inc; 403-932-0180; [email protected]
Pazos-Rego, Ana Marie [356] University of Miami; 305-284-8178; [email protected]
Peabody, Joseph [405] Brigham Young University; 801-422-1304; [email protected]
Peacock, Erin [543-806] University of Arizona; 520-626-0735; [email protected]
Peak, Geri [102-437] Two Gems Consulting Services; 410-323-7212; [email protected]
Pearsall, Tara [118] University of South Carolina; 803-777-3459; [email protected]
Pearson, Carol [532-596] Walter R McDonald & Associates Inc; 301-881-2590 x252; [email protected]
Peck, Laura [758] Arizona State University; 602-496-0460; [email protected]
Peisach, Betsy [802] Maryland Public Television; 410-581-4042; [email protected]
Peled, Yehuda [662] Western Galilee College; 972-52-3737-604; [email protected]
Pelton, Chris [383] University of Tennessee, Knoxville; [email protected]
Pendleton, Karen [609] Centers for Disease Control and Prevention; 803-978-7584; [email protected]
Peng, Pu [370] University of South Carolina; 803-777-3459; [email protected]
Penna Firme, Thereza [131-456] Cesgranrio Foundation; 55 21 2279-5879; [email protected]
Pepper, Catherine [762] Centers for Disease Control and Prevention; 404-639-6018; [email protected]
Perkins, Ayana [131-383-605] Georgia State University; 404-663-1506; [email protected]
Perkins, Daniel [815] Pennsylvania State University; 814-865-6988; [email protected]
Perkins, Peggy [112] University of Nevada, Las Vegas; 702-895-1386; [email protected]
Perlmutter, Aaron [362] East Main Educational Consulting LLC; 910-784-9523; [email protected]
Perreault, Marty [329] National Academies; 949-387-5783; [email protected]
Perry, Katye [422-559] Oklahoma State University; 405-744-9447; [email protected]
Perry, Suzanne [107] RAND Corporation; 301-393-0411 x7473; [email protected]
Persaud, Nadini [378-738] Western Michigan University; 269-387-5753; [email protected]
Perumal, Chithra [304] University of Kentucky; 859-257-6877; [email protected]
Peterman, Karen [122] Goodman Research Group Inc; 617-491-7033; [email protected]
Peters, Lutheria [525] Association for the Study and Development of Community; 301-519-0722 x121; [email protected]
Peterson, Karen [579] Puget Sound Center for Teaching, Learning and Technology; 425-368-1028; [email protected]
Petrosino, Anthony [863] WestEd; 781-481-1117; [email protected]
Petrucci, Carrie [416-548] California State University, Los Angeles; 818-667-9167; [email protected]
Pettit, Timothy [507] Nexus Market Research Inc; 703-241-3880; [email protected]
Phillips, Cynthia [499] Phillips Wyatt Knowlton Inc; 269-441-1940; [email protected]
Phillips Martinez, Amanda [382] Georgia State University; 404-651-0608; [email protected]
Picard, Mary [417] CARE International; 514-402-2526; [email protected]
Pierce, Ben [347] Battelle Centers for Public Health Research and Evaluation; 614-424-3905; [email protected]
Pierce, Steven [586] Michigan State University; 517-355-3825; [email protected]
Pigeon, Marie [327] University of Montreal; 514-987-3000 x7654; [email protected]
Pilonieta, Paola [338] University of Miami; 305-284-5815; [email protected]
Piña, Maricela [125-747] Harder & Company Community Research; 415-522-5400; [email protected]
Pinchin, Sheila [858] Queen's University; 613-533-6000 x78757; [email protected]
Pinkney, Debra [113] University of Arizona; 520-621-7127; [email protected]
Pinsker, Eve [640] University of Illinois, Chicago; 312-996-7000; [email protected]
Piontek, Mary [472] University of Michigan; 734-615-4617; [email protected]
Placci, Guillermo [563] Foundations of Success; [email protected]
Plantz, Margaret [739] United Way of America; 703-836-7112 x268; [email protected]
Page 181
Platte, Megan [721] Michigan State University; 517-432-0061; [email protected]
Plonski, Paula [131-788] Praxis Research Inc; 704-523-2999; [email protected]
Podems, Donna [594] Macro International Inc; [email protected]
Poe-Yamagata, Eileen [688] IMPAQ International LLC; 443-539-1391; [email protected]
Poirier, Jeffrey [131] American Institutes for Research; 202-403-5368; [email protected]
Polinsky, Margaret [368-528] Parents Anonymous Inc; 909-621-6184 x213; [email protected]
Pope, Paul [131] Texas Cooperative Extension; 979-845-7202; [email protected]
Porowski, Allan [344] Caliber an ICF International Company; 703-219-4366; [email protected]
Porter, Alan [329] Georgia Institute of Technology; [email protected]
Porter, Alice [439] Vermont Division of Vocational Rehabilitation; 802-241-4260; [email protected]
Porter, Amy [439] Connecticut Bureau of Rehabilitation Services; 860-424-4844; [email protected]
Poth, Cheryl-Anne [339] Queen's University; 613-331-0300; [email protected]
Potok, Nancy [546] Mcmanis and Monsalve Associates; 240-441-5455; [email protected]
Potter, Charles [129] University of the Witwatersrand; 27 11 4428509; [email protected]
Poulin, Mary [583] Justice Research and Statistics Association; 202-842-9330; [email protected]
Powell, Alfred [411] National Oceanic and Atmospheric Administration; 301-763-8127 x101; [email protected]
Power, Grant [103] Semics LLC; 626-683-7338; [email protected]
Preissle, Judith [512] University of Georgia; 706-542-6489; [email protected]
Preskill, Hallie [100-300-306-341-371-407-667-733-871] Claremont Graduate University; 909-607-0457; [email protected]
Prettypaint, Iris [356-628] University of Montana; 406-243-6350; [email protected]
Préval, Johanne [597] University of Montreal; 514-343-5611 x2498; [email protected]
Pribesh, Shana [725] Old Dominion University; 757-683-6684; [email protected]
Price, Ann [661] Community Evaluation Solutions Inc; 770-367-0942; [email protected]
Price, Kelci [680-755] Chicago Public Schools; 773-553-5022; [email protected]
Primus, Wendell [678] United States House of Representatives; 202-226-9928; [email protected]
Prince, Beth [721] Michigan State University; 517-432-0061; [email protected]
Przybylski, Roger [459-516-552] RKC Group; 303-949-8551; [email protected]
Pyzik, Laura [816] United States Environmental Protection Agency; 202-566-2843; [email protected]
QQQQQQQQ
Quartaroli, MaryLynn [392] Northern Arizona University; 928-523-1026; [email protected]
Quijada, Jessica Jester [748] Academy for Educational Development; 202-884-8090; [email protected]
Quinlan, Kathleen M [124] Concept Systems Inc; 607-272-1206; [email protected]
Quinn, David [680] Chicago Public Schools; 312-765-0291; [email protected]
Quinones, Alvin [680] Chicago Public Schools; 773-517-6257; [email protected]
Quintana, Renee [627] University of New Mexico; 505-272-8069; [email protected]
RRRRRRRR
Raab, Carolyn [679] Oregon State University; 541-737-1019; [email protected]
Raad, Jennifer [650] University of Kansas; 785-864-7097; [email protected]
Raber, Suzanne [650] Montgomery County Public Schools; 301-279-3866; [email protected]
Race, Kathryn [102-712] Race and Associates Ltd; 773-878-8535; [email protected]
Radauer, Alfred [727] Austrian Institute for SME Research; 43-01-505-97-61; [email protected]
Radecki, Barbara [621] University of Nevada, Las Vegas; 702-450-6763; [email protected]
Radhakrishna, Rama [131-422] Pennsylvania State University; 814-863-7069; [email protected]
Ragan, Vicky [579] Puget Sound Center for Teaching, Learning and Technology; 425-368-1029; [email protected]
Rahim, Mushtaq [603] ARD Inc; 0093-799-003404; [email protected]
Rai, Kalyani [357] University of Wisconsin, Milwaukee; 414-227-3271; [email protected]
Rainone, Gregory [763] New York State Office of Alcoholism and Substance Abuse Services; 646-728-4607; [email protected]
Rallis, Sharon [377-505-778] University of Massachusetts, Amherst; 413- 545-1056; [email protected]
Randel, Bruce [673] Mid-continent Research for Education and Learning; 303-337-0990; [email protected]
Randolph, Suzanne M [131] University of Maryland, College Park; 301-405-4012; [email protected]
Rangarajan, Anu [418] Mathematica Policy Research Inc; 609- 936-2765; [email protected]
Raphael, Lisa [322] University of Illinois, Chicago; 312-413-3656; [email protected]
Rasnake, Roger [351] JBS International Inc; 202-263-9268; [email protected]
Ratner, Shanna [320] Yellow Wood Associates Inc; 802-524-6141; [email protected]
Rawiri, Miri [354] Department of Child, Youth and Family Services; 6429-200-8876; [email protected]
Ray, Marilyn [609-668-841] Finger Lakes Law and Social Policy Center Inc; 607 539 7778; [email protected]
Page 182
Raymer, Annalisa [420-833] Cornell University; 607-229-2330; [email protected]
Raymond, Jennifer [331] University of Massachusetts, Boston; 617-287-5557; [email protected]
Raynor, Jared [381] TCC Group; 215-568-0399; [email protected]
Ready, Douglas [301] Columbia University; 212-678-3850; [email protected]
Recesso, Arthur [526] University of Georgia; 706-542-4010; [email protected]
Reed, Celeste Sturdevant [721-864] Michigan State University; 517-353-8977; [email protected]
Reed, Ehren [310-478-669-756] Innovation Network Inc; 202-728-0727 x109; [email protected]
Reed, John [797] Innovologie; 301-340-8701; [email protected]
Reed, Leslie [345] Missouri Foundation for Health; 314-345-5504; [email protected]
Reed, Winifred [429] National Institutes of Justice; 202-307-2952; [email protected]
Reed, Winifred L [429] United States Department of Justice; 202-307-2952; [email protected]
Reeve, Neville [124-364] European Commission; 322-298-9329; [email protected]
Reeves, Iris [131] Maryland Mental Hygiene Administration; 410-402-8326; [email protected]
Reichert, Christopher Michael [839] Catholic Relief Services; 011-260 99 650 919; [email protected]
Reid, Deborah [541] Carleton University; [email protected]
Reid, Karen M [112] University of Nevada, Las Vegas; 702-531-6293; [email protected]
Reid, Shani [802] Macro International Inc; 301-572-0534; [email protected]
Reinelt, Claire [114-824] Leadership Learning Community; 510-238-9080; [email protected]
Reischl, Thomas [131] University of Michigan; 734-763-5568; [email protected]
Reisman, Jane [529] Organizational Research Services; 206-728-0474 x13; [email protected]
Reither, Anne [439] Utah State University; 435-757-9314; [email protected]
Renaud, Jeanette [117] RTI International; 770-234-5011; [email protected]
Renger, Ralph [113-543-806] University of Arizona; 520-626-0726; [email protected]
Resendez, Miriam [770] Planning, Research and Evaluation Services Associates Inc; 307-733-3255; [email protected]
Reuben, Laurie [605] Cheshire Consulting Group; 301-498-1792; [email protected]
Rho, Wha-Joon [414] Seoul National University; 82-2-584-4418; [email protected]
Rhodes, Riley [683] Mental Health Center of Denver; 303-504-6500; [email protected]
Richard, Robert [845] Louisiana State University; 225-578-6194; [email protected]
Rickards, William [111-589-684-726] Alverno College; 414-382-6256; [email protected]
Rickman, Dana [399] Georgia State University; 404-651-4825; [email protected]
Ridings, John [753] Metropolitan Family Services of Chicago; 312-986-4037; [email protected]
Riedel, Eric [823] Walden University; 612-312-2393; [email protected]
Riedel, James [127] Girl Scout Research Institute; 212-852-6552; [email protected]
Riley, Barth [128-403-869] University of Illinois, Chicago; 312-355-4054; [email protected]
Rimal, Rajiv [424] Johns Hopkins University; 410-502-0026; [email protected]
Rincones-Gomez, Rigoberto [663] MDC Inc; 269-330-2966; [email protected]
Ringle, Jay [788] Girls and Boys Town; 402-498-3223; [email protected]
Risner, Rhoda [616-654] United States Army Command and General Staff College; 913-684-2029; [email protected]
Ristow, Liam [866] Westat; 301-251-1500; [email protected]
Ritchie, Liesel [307-324-707-844] Western Michigan University; 269-387-5895; [email protected]
Rivera, Noelle [383] University of California, Los Angeles; 562-691-7039; [email protected]
Rizk, Tarek [749] Global Interdependence Initiative; 202-736-5837; [email protected]
Roberts, Dawn [720] Independent Consultant; 301-891-1879; [email protected]
Roberts-Gray, Cindy [324] Third Coast Research and Development Inc; 409-762-2499; [email protected]
Robertshaw, M Brooke [387] Utah State University; 435-752-3571; [email protected]
Robins, Thomas [533] University of Michigan; 734-936-0757; [email protected]
Robison, Julie [439] University of Connecticut; 860-679-4278; [email protected]
Robles, Annalisa [818] The California Endowment; 800-449-4149 x8756; [email protected]
Rodriguez, Eunice [113-131-307-452] Stanford University; 650-251-9410; [email protected]
Rodriguez-Campos, Liliana [126-393-663-750-792] University of South Florida; 269-387-5942; [email protected]
Roehrig, Gillian [131] University of Minnesota; [email protected]
Roengsumran, Arisara [131] University of Minnesota; 651-707-7431; [email protected]
Roeske, Teresa [766] Howard Research & Management Consulting Inc; 780-496-9994; [email protected]
Roessner, David [329-592] SRI International; 928-541-0094; [email protected]
Rog, Debra [301-505-678-800] Westat; 301-279-4594; [email protected]
Rogers, Juan [124] Georgia Institute of Technology; 404-894-6697; [email protected]
Rogers, Nancy [676] University of Cincinnati; 513-556-1476; [email protected]
Rogers, Patricia [569-606] Royal Melbourne Institute of Technology; 613-9925-2854; [email protected]
Rohatgi, Rashi [855] Harlem United Community AIDS Center; 212-803-2850 x803; [email protected]
Page 183
Rohrbaugh, Kathlyn [131] Macro International Inc; 301-572-0288; [email protected]
Roper, Laura [550] Brandeis University; 617-623-5127; [email protected]
Rosas, Scott [312-521] Nemours Health and Prevention Services; 302-444-9131; [email protected]
Rosenstein, Barbara [410] Ben-Gurion University of Negev; 972 03 532 0076; [email protected]
Rosheim, Christine [389] Centers for Disease Control and Prevention; 404-498-6010; [email protected]
Ross, Sharon [616-763] Founder's Trust; 412-201-4137; [email protected]
Rosselli, Richard [635] University of North Carolina, Chapel Hill; 919-966-6287; [email protected]
Rosser, Manda [598] Texas A&M University; 979-862-3015; [email protected]
Roussel, Amy [630] RTI International; 919-990-8324; [email protected]
Rowe, Jody [610] The ARC of Monroe County; 585-256-7330; [email protected]
Rowley, Alice [131] Search for Common Ground; 202-777-2210; [email protected]
Ruberg, Laurie [131-344] Wheeling Jesuit University; 304-243-2480; [email protected]
Rubin, Maureen [131] Program Development and Evaluation Associates; 803-771-2250; [email protected]
Ruch-Ross, Holly [820] Independent Consultant; 847-673-1403; [email protected]
Rudy, Dennis W [524-795] Lakehouse Evaluation Inc; 269-469-7946; [email protected]
Ruegg, Rosalie [435-652-727] TIA Consulting Inc; 252-354-9321; [email protected]
Rugh, Jim [417-703] CARE International; 865-908-3133; [email protected]
Ruiz-Casares, Monica [854] McGill University; 514-412-4400 x22476; [email protected]
Rusch, Edith [595] University of Nevada, Las Vegas; 702-895-2891; [email protected]
Russ-Eft, Darlene [131-837] Oregon State University; 541-737-9373; [email protected]
Russell, Stephen [113] University of Arizona; 520-621-1231; [email protected]
Russon, Karen [131] Evaluation Capacity Development Group; 269-668-7188; [email protected]
Rwampororo, Rosern [603] Ministry of Economic Planning and Development; 265-9-966-255; [email protected]
Ryan, James [329] CIRCA Group Europe Ltd; 00353 1 2806231; [email protected]
Ryan, Katherine [408-602-721] University of Illinois at Urbana-Champaign; 217-344-3130; [email protected]
Rycraft, Joan [127] University of Texas, Arlington; 817-272-5225; [email protected]
Ryu, Young Soo [847] Korea Institute of Science and Technology Evaluation and Planning; 82-2-589-2838; [email protected]
SSSSSSSSS
Saab, Hana [131] Queen's University; 613-966-7944; [email protected]
Saakashvili, Nino [307-417-581-674] Horizonti Foundation; 995 32 332816; [email protected]
Saka, Susan [754] University of Hawaii; 808-956-7900; [email protected]
Salafsky, David [781] University of Arizona; 520-621-8297; [email protected]
Salafsky, Nick [563] Foundations of Success; [email protected]
Sale, Elizabeth [607] Missouri Institute of Mental Health; 314-877-6471; [email protected]
Salmona, Michelle [647] University of Technology Sydney, Australia; [email protected]
Salzman, James [123] Cleveland State University; 216-875-9977; [email protected]
Samuels, Maurice [517] University of Illinois at Urbana Champaign; 217-344-9343; [email protected]
Sanborn, Wendy [363] EndVision Research and Evaluation; 435-881-8811; [email protected]
Sandberg, Lisa [340] Loyola University, Chicago; 773-508-3021; [email protected]
Sangare, Moussa [465] Catholic Relief Services; 011-223 2234457; [email protected]
Sangole, Noel [331] International Center for Tropical Agriculture; [email protected]
Santacaterina, Laurita [575] Tulane University; 503-988-3906; [email protected]
Sarigiannis, Amy [131] University of Michigan; 734-647-0124; [email protected]
Sarpy, Sue Ann [575] Tulane University; 434-295-4810; [email protected]
Sasaki, Ryoh [106-581-817] Western Michigan University; 269-387-7492; [email protected]
Sass, James [307-368-418-453-848] LA's BEST After School Enrichment Program; 213-745-1900 x52995; [email protected]
Sasser, Diane [577] Louisiana State University; 225-578-4448; [email protected]
Sassoubre, Lauren [818] University of California, San Francisco; 510-295-7976; [email protected]
Sato, Hiroshi [544] National Institute of Advanced Industrial Science and Technology; 81-29-861-6096; [email protected]
Sato, Yuriko [391] Tokyo Institute of Technology; 81-3-5734-3524; [email protected]
Saunders, Lee [382] University of Miami; 305-243-3819; [email protected]
Saunders, Ruth [574] University of South Carolina; 803-777-1902; [email protected]
Sawyer, Richard [621] Academy for Educational Development; 202-884-8868; [email protected]
Sawyer, Thomas [401-419] University of Rhode Island; 401-277-5318; [email protected]
Scanlon, Eileen [860] Nassau County Department of Health; 516-571-2672; [email protected]
Scheie, David [821] Touchston Center for Collaborative Inquiry; 612-825-9100; [email protected]
Scheirer, Mary Ann [378-807] Scheirer Consulting; 609-951-8686; [email protected]
Page 184
Schemp, Crystal [809] University of Arizona; 520-318-7259 x146; [email protected]
Schiavo, Neil [829] Education Development Center Inc; 617-969-7100; [email protected]
Schmidt, Anna Marie [104] JBS International Inc; 650-373-4909; [email protected]
Schmitt, Lisa [735] Austin Independent School District; 512-414-9845; [email protected]
Schmitt, Vicki L [796] University of Kansas; 417-766-9491; [email protected]
Schneider, Jennifer [376] North Carolina State University; 919-515-3237; [email protected]
Schooley, Michael [117-396-566-630] Centers for Disease Control and Prevention; 770-488-5780; [email protected]
Schott, Elizabeth [131] New Mexico State University; 505-646-4923; [email protected]
Schrader, Linda [485-814] Florida State University; 850-644-8780; [email protected]
Schraw, Gregory [380] University of Nevada, Las Vegas; 702-895-2606; [email protected]
Schroeter, Daniela C [307-378-604-738] Western Michigan University; 269-267-8227; [email protected]
Schulman, Roger [309] The Maryland Practitioner Teacher Program; 410-235-5773; [email protected]
Schultz, Dana [107] RAND Corporation; 412-683-2300 x4613; [email protected]
Schurig, Michelle [131] Macro International Inc; 404-592-2261; [email protected]
Schwandt, Thomas [336-500-505-573] University of Illinois at Urbana-Champaign; 217-333-5350; [email protected]
Scott, Heather M [625] University of South Florida; 813-974-6064; [email protected]
Scriven, Michael [106-378-447-505-703-736-817] Western Michigan University; 269-387-5906; [email protected]
Searing, Hannah [549] EngenderHealth; 212-561-8451; [email protected]
Searle, Michelle [387-407] Queen's University; 613-767-1133; [email protected]
Seawright, Larry [405] Brigham Young University; 801-422-8151; [email protected]
Sechrest, Lee [438-801-804-856] University of Arizona; 520-621-9182; [email protected]
Sedlak, Andrea [686] Westat; 301-251-4211; [email protected]
Seeley, John [841] Federal Emergency Relief Administration; 734-646-4613; [email protected]
Seidel, Kent [788] University of Cincinnati; 513-556-2006; [email protected]
Seigart, Denise [384-589] Mansfield University; 607-748-2191; [email protected]
Sell, Christopher [439] University of Wisconsin; 608-266-5279; [email protected]
Senefeld, Shannon [421] Catholic Relief Services; 410-625-2220; [email protected]
SenGupta, Saumitra [441-685] APS Healthcare; 510-872-9230; [email protected]
Serido, Joyce [511-605] University of Arizona; 520 621-5820; [email protected]
Serig, Dan [768] Massachusetts College of Art; 212-781-3730; [email protected]
Serna, Lisa [627] University of New Mexico; 505-272-8069; [email protected]
Sewing, Daphne [380] University of Nevada; [email protected]
Seybolt, Diana [131] University of Maryland; 410-646-1756; [email protected]
Shadish, William [301-660-775] University of California, Merced; 209-228-4372; [email protected]
Shaffer, LaShorage [305] University of Illinois at Urbana-Champaign; 217-333-0260; [email protected]
Shak, Milton [754] 1:1 Inc; 808-533-3309; [email protected]
Shamblen, Steve [330] Pacific Institute for Research and Evaluation; 502-238-7336; [email protected]
Shannon, Lisa [325] Magnolia Consulting LLC; 919-367-9433; [email protected]
Shapiro, Dan [835] University of Arizona; [email protected]
Shapiro, Joel [864] Rockman Et Al; 312-604-0880; [email protected]
Shapiro, Kenneth [347] Office of National Drug Control Policy; 202-395-4681; [email protected]
Shapiro, Marc [131-828] Independent Consultant; 703-861-5188; [email protected]
Shapley, Kathy [362] Edvance Research Inc; 210-558-4141; [email protected]
Sharkey, Deirdre [517-823] Texas Southern University; 713-313-4274; [email protected]
Sharpe, Julie [529] Family Connection Partnership; 229-388-8770; [email protected]
Sharrock, Guy [742-839] Catholic Relief Services; 44 1303 262006; [email protected]
Shaw, Tanya [418] Girls and Boys Town; 402-498-3047; [email protected]
Sheldon, Jeffrey [649] Claremont Graduate University; 909-447-5474; [email protected]
Shen, Jianping [842] Western Michigan University; 269-387-3887; [email protected]
Sheppard, Beverly [570] The Institute for Learning Innovation; 410-268-2179; [email protected]
Sherman, Bernette [382] Georgia State University; 404-463-9565; [email protected]
Sherman, John [310] Headwaters Group; 615-383-9606; [email protected]
Sherwood, Deborah [688] San Francisco Department of Public Health; 415-642-4501; [email protected]
Shettle, Carolyn [308] Westat; 301-251-4324; [email protected]
Shipman, Stephanie [631] United States Government Accountability Office; 202-512-4041; [email protected]
Shoemaker, Sarah [862] Abt Associates Inc; 617-349-2472; [email protected]
Shulha, Lyn [601-803] Queen's University; 613-533-6000 x75016; [email protected]
Shuman, Cindy [322-659] Kansas State University; 785-532-3463; [email protected]
Sicotte, Claude [597] University of Montreal; 514-343-5611; [email protected]
Page 185
Sidani, Souraya [404-629-835] Ryerson University; 416-978-2856; [email protected]
Siegel, Susan [344-390-682] Communities in Schools; 703-518-2548; [email protected]
Silliman, Benjamin [121-815] North Carolina State University; 919-515-8485; [email protected]
Silver, Diana [664] New York University; 212-998-7558; [email protected]
Silver, Robin [851] United States Department of State; 202-453-8828; [email protected]
Silverstein, Gary [843] Westat; 301-251-2244; [email protected]
Silverstein, Laura [463] New Futures; 206-248-9647; [email protected]
Sim, Shao-Chee [381-842] TCC Group; 212-949-0990; [email protected]
Simeonsson, Kristina [635] East Carolina State University; 919-733-9607; [email protected]
Simon, Noah [324] Coordinated Assistance Network; 202-303-4376; [email protected]
Simons, Kate [328] Walter R McDonald & Associates Inc; 301-881-2590 x239; [email protected]
Sinclair, Raymond [779] Centers for Disease Control and Prevention; 513-600-7519; [email protected]
Sirineo, Josephine [337] University of Michigan; 734-276-2782; [email protected]
Sitaker, Marilyn [396] Washington State Department of Health; 360-236-3463; [email protected]
Skelton, Adam [117] Centers for Disease Control and Prevention; 404-498-1176; [email protected]
Skelton, Syreeta [673-743] Georgia State University; 404-651-3293; [email protected]
Skolits, Gary [836] University of Tennessee, Knoxville; 865-974-2777; [email protected]
Sladek, Mary Frances [843] NASA Headquarters; 202-358-0861; [email protected]
Slaughter, Jenny [113] East Lancashire Primary Care Trust; 001 44 0 1282 657395; [email protected]
Slavsky, David [131] Loyola University, Chicago; 773-508-8352; [email protected]
Slay, Julie [425] The Children's Health Council; 650-688-3622; [email protected]
Sleezer, Catherine [638-837] Baker-Hughes; 918-342-8527; [email protected]
Slifer-Mbacke, Lisa [315] Macro International Inc; [email protected]
Slovacek, Simeon [627] California State University; 323-343-5622; [email protected]
Smith, Christa [380-659] Kansas State University; 785-532-5127; [email protected]
Smith, James [439] Vermont Division of Vocational Rehabilitation; 802-241-4480; [email protected]
Smith, Nick L [740] Syracuse University; 315-443-5259; [email protected]
Smith, Robin [366] Florida State University; 850-644-1142; [email protected]
Smith, Trilby [825] Metis Associates; 954-757-1436; [email protected]
Smits, Pernelle [597] University of Montreal; 514-343-7365; [email protected]
Snorton, Riley [588] University of Pennsylvania; 347-463-3553; [email protected]
Snow, Juna [802] InnovatEd Consulting; 503-481-5555; [email protected]
Snyder, Angela [131-382-436] Georgia State University; 404-651-3104; [email protected]
Snyder, Karen [640] Public Health, Seattle and King County; 312-922-9920; [email protected]
Solomon, Felicia [346] National Institutes of Health; 301-594-8989; [email protected]
Somerville, Aundrey [796] Bureau of Research, Training and Services; 330-672-0743; [email protected]
Sommers, Anna [382] The Urban Institute; 202-833-7200; [email protected]
Sondgeroth, Mary [324] Third Coast Research and Development Inc; 409-762-2499; [email protected]
Sorensen, Charlotte [564] University of Tennessee, Knoxville; 865-974-2381; [email protected]
Speckhard, Sara [308] United States Citizenship and Immigration Services; 202-272-1471; [email protected]
Speer, Paul [818] Vanderbilt University; [email protected]
Spiker, Donna [623] SRI International; 650-859-6184; [email protected]
Springer, J Fred [330] EMT Associates Inc; 615-585-2230; [email protected]
Sridharan, Sanjeev [115] University of Edinburgh; 0131 651 1449; [email protected]
Stake, Robert [303-771] University of Illinois at Urbana-Champaign; 217-333-3770; [email protected]
Standish, Marion [818] The California Endowment; 415-343-0222; [email protected]
Steed, Judith [510-722] Center for Creative Leadership; 719-633-3891; [email protected]
Steedly, Kathlyn [406-476-768] The Academy for Educational Development; 202-884-8094; [email protected]
Steffanowski, Andros [801] University of Mannheim; 49-621-181-2137; [email protected]
Steichen Asch, Paule [746] Individual Building of Integrated Success International; 513-289-5998; [email protected]
Steiner, Roald [727] Austrian Institute for SME Research; 43-01-505-97-61; [email protected]
Steingart, Karen R [389] Francis J Curry National Tuberculosis Center; 510-225-5575; [email protected]
Stein-Seroussi, Al [820] Pacific Institute for Research and Evaluation; 919-265-2616; [email protected]
Stem, Caroline [563] Foundations of Success; 518-581-0762; [email protected]
Stephens, Jennnifer [131] American Institutes for Research; 202-403-5476; [email protected]
Stephens, Lisa [353] National Cancer Institute; 507-284-1072; [email protected]
Stevens, Edith [309-680] Macro International Inc; 301-572-0558; [email protected]
Stevenson, John [401-800] University of Rhode Island; 401-874-4240; [email protected]
Stewart, Joy [656] University of North Carolina, Chapel Hill; 919-962-6500; [email protected]
Page 186
Stewart, Tanis [112] University of Nevada, Las Vegas; 702-774-2565; [email protected]
Stiles, Paul [763] University of South Florida; 813-974-9349; [email protected]
Stillisano, Jackie [627] Texas A&M University; 979-845-8098; [email protected]
Stockton, Laurie [820] Pacific Institute for Research and Evaluation; 919-265-2629; [email protected]
Stokes, Shannon [718] University of Missouri, Columbia; 573-884-6322; [email protected]
Stone, Margaret R [595] University of Arizona; 520-621-7130; [email protected]
Stone, Vathsala [757] University at Buffalo; 716-829-3141 x101; [email protected]
Stoneman, Zolinda [131] University of Georgia; 706-542-4827; [email protected]
Stoop, Graham [434] Education Review Office; [email protected]
Storey, Douglas [424-854] Johns Hopkins University; 410-659-6266; [email protected]
Storey, Mariah [552] University of Wyoming; 307-760-3657; [email protected]
Strang, Jo [658] Federal Railroad Administration; 202-493-6386; [email protected]
Streiner, David [404-629] University of Toronto; 416-785-2500 x2534; [email protected]
Streng, Kathy [625] Network for a Healthy California; 916-552-9843; [email protected]
Strichman, Nancy [639] Independent Consultant; 011-972-495-4081; [email protected]
Stroupe, Nancy [508] Centers for Disease Control and Prevention; 770-488-1022; [email protected]
Struss, Herbert [131] University of Minnesota; 715-246-8915; [email protected]
Stuczynski, Amy [686] Human Services Research Institute; 503-924-3783 x22; [email protected]
Stufflebeam, Daniel [378] Western Michigan University; 269-345-3266; [email protected]
Suarez-Balcazar, Yolanda [620-867] University of Illinois, Chicago; 312-413-0117; [email protected]
Sugerman, Sharon [625] Network for a Healthy California; 916-449-5406; [email protected]
Sukumar, Bhuvana [131] Macro International Inc; 404-321-3211 x2122; [email protected]
Sullivan, Tara [311-424] Johns Hopkins University; 845-758-6855; [email protected]
Summerfelt, Tom [657] University of Chicago; 773-834-7449; [email protected]
Surdam, Jessica [806] University of Arizona; 520 626-4706; [email protected]
Swaminathan, Vinaya [563] Foundations of Success; 202-254-7156; [email protected]
Swan, Aubrie [131] Rutgers University; 585-368-8842; [email protected]
Sweeney, Jennifer [131] University of California, Davis; 530-754-9085 x2; [email protected]
Sweetman, Heidi [388-522] University of Delaware; 302-737-3219; [email protected]
Syam, Devarati [357] University of Wisconsin, Milwaukee; 414-227-3232; [email protected]
Symonette, Hazel L [622-700] University of Wisconsin, Madison; 608-262-5347; [email protected]
Szydlowski, Phil [627] University of New Mexico; 505-272-8069; [email protected]
TTTTTTTT
Tabisola, Che [556] Human Rights Campaign; 202-423-2854; [email protected]
Tackett, Wendy [795] iEval; 269-420-3417; [email protected]
Takagi Sawada, Michiko [544] National Institute of Advanced Industrial Science and Technology; 81-29-862-6101;
[email protected]
Tallman, Nancy [418] Bassett Research Institute; 607-547-7632; [email protected]
Tan, Rachael [438] University of California, Berkeley; 510-526-2231; [email protected]
Tananis, Cindy [830] University of Pittsburgh; 412-648-7171; [email protected]
Taouti-Cherif, Ratiba [131] Search for Common Ground; 202-777-2210; [email protected]
Tarifa, Todd [845] Louisiana State University; 225-578-2196; [email protected]
Taylor, Ede [131] Belair-Edison Healthy Community Coalition; 410-485-2776; [email protected]
Taylor, Kimberly [648] Schwab Rehabilitation Hospital; 773-522-2010 x5176; [email protected]
Taylor-Powell, Ellen [463-624-734] University of Wisconsin; 608-262-2169; [email protected]
Taylor-Ritzler, Tina [119-620-867] University of Illinois, Chicago; 312-413-4149; [email protected]
Teather, George [446-637] Independent Consultant; 613-824-2423; [email protected]
Temnenko, Kseniya [771] Eurasia Foundation; 38-044-200-38-24; [email protected]
Tempelmaier, Brigitte [727] Austrian Economic Service; 43-01-501-75-541; [email protected]
Teodoru, Sheri [744] Claes Fornell International Group; 734-623-1318; [email protected]
Terao, Kenneth [104] JBS International Inc; 650-373-4901; [email protected]
Terway, Arushi [131] Academy for Educational Development; 202-884-8000; [email protected]
Teske, Theodore [131] Spokane Research Laboratory; 509-354-8071; [email protected]
Thiessen Love, Lois [368-383] Uhlich Children's Advantage Network; 773-429-9330; [email protected]
Thomas, Craig [359-633] Centers for Disease Control and Prevention; 404-639-0617; [email protected]
Thomas, Kelli [131] University of Kansas; 785-864-9675; [email protected]
Thomas, Mark [131] The Lewin Group; 703-269-5564; [email protected]
Page 187
Thomas, Veronica [613] Howard University; 202-806-9093; [email protected]
Thomas, Willis [408-792] Western Michigan University; 269-271-1343; [email protected]
Thompson, Charles [399] East Carolina University; 252-328-1140; [email protected]
Thompson, Ron [418-788] Girls and Boys Town; 402-498-3102; [email protected]
Thomson, Barbara [362] The Ohio State University; 614-895-2252; [email protected]
Thornton, Bill [306-420-595-778] University of Nevada, Reno; 775-682-9096; [email protected]
Thornton, Karla [131] University of New Mexico; 505-272-3793; [email protected]
Thurston, Darlene [526] Jackson State University; 601-979-3355; [email protected]
Thurston, Linda [659-761] Kansas State University; 785-532-6943; [email protected]
Tian, Jing [715] University of Maryland; 301-405-9626; [email protected]
Tibbetts, Katherine [392-427-587] Kamehameha Schools; 808-541-5321; [email protected]
Tierney, William [131] Regenstrief Institute; 317-630-6911; [email protected]
Tiffany, Jennifer [131] Cornell University; 607-255-1942; [email protected]
Tikoo, Minakshi [683] Department of Mental Health and Addiction Services; 860-418-6824; [email protected]
Till, Lance [104] Children's Services Council of Palm Beach County; 651-655-1010 x2210; [email protected]
Tilmes, Klaus [519] World Bank; 202-473-4903; [email protected]
Timmons, Wes [658] Federal Aviation Administration; 202-267-5205; [email protected]
Tirnauer, Jill [851] United States Department of State; 202-453-8826; [email protected]
Titcomb, Allison [398] LeCroy & Milligan Associates Inc; 520-326-5154 x121; [email protected]
Tiwana, Ravneet [778] University of California, Los Angeles; 661-900-0012; [email protected]
Toal, Stacie [131-827] University of Minnesota; 612-221-6832; [email protected]
Tobey, Lauren [679] Oregon State University; 541-737-1017; [email protected]
Tobias, Donald [326] Cornell University; 212-340-2905; [email protected]
Tobin, Joseph [846] Arizona State University; 480-235-1248; [email protected]
Todd, Christine [131] University of Georgia; 706-542-4830; [email protected]
Tomasello, Nicole [113] University at Buffalo; 716 645 3381 x232; [email protected]
Tomioka, Michiyo [452] University of Hawaii; 808-728-0507; [email protected]
Toms, Kathleen [760] Research Works Inc; 518-869-9272; [email protected]
Tonini, Carolina [672] Universidad Federal de Santa Maria; 598 2 358 1603; [email protected]
Torres, Rosalie T [431] Torres Consulting Group; 510-681-6567; [email protected]
Torres Campos, Cidhinnia M [562-657] Crafton Hills College; 517-410-8553; [email protected]
Totten, Iris M [385-659] Kansas State University; 785-532-2251; [email protected]
Tourmen, Claire [387-457] Ecole Nationale d'Enseignement Supérieur Agronomique de Dijon; 33 0 380772328; [email protected]
Townley, Greg [636] University of South Carolina; 803-777-4137
Trautman, Megan [751] Sacramento County Dept of Health Services; 916-875-5869; [email protected]
Treiber, Jeanette [751] University of California, Davis; 530-297-4659; [email protected]
Trent, Tererai [106] Heifer International; 517-541-2087; [email protected]
Trevino, Mily [846] Organizacion en California de Lideres Campesinas; 909-865-7776; [email protected]
Trinite, Tricia [862] Agency for Healthcare Research and Quality; 301-427-1583; [email protected]
Trochim, William [124-326-367-371-501-733] Cornell University; 607-257-7234; [email protected]
Trudeau, James [737] RTI International; 919-485-7751; [email protected]
Tubman, Winnehl [131] Academy for Educational Development; 202-884-8000; [email protected]
Tuccori, Maria [751] University of California, Davis; 530-297-4659; [email protected]
Tucker, Margaret [836] Detroit Area Pre-College Engineering Program; 313-831-3050; [email protected]
Tucker, Susan [304-445-603-627-827] Evaluation and Development Association; 415-385-8396; [email protected]
Tucker, Tisha [710] Macro International Inc; 404-592-2190; [email protected]
Tula, Monique [716] Cambridge Cares About AIDS; 617-661-3040; [email protected]
Tungate, Sue [479] Colorado State University; 970-491-4695; [email protected]
Turner, Marge [664] Urban Institute; 202-833-7200; [email protected]
Tvrdik, Ann [453] Region III Behavioral Health Services; 308-237-5113 x255; [email protected]
UUUUUUUU
Ujaama, Dawud [382] Georgia State University; 404-651-4339; [email protected]
Unger, Zita [757] Evaluation Solutions; 61 3 9863 7555; [email protected]
Urbanas, Diana [131] National Institutes of Health; 301-451-9657; [email protected]
Uribe, Ximena [388-522] University of Delaware; 302-831-4662; [email protected]
Usiak, Douglas [757] Western New York Independent Living Project Inc; 716-836-0822 x117; [email protected]
Usinger, Janet [420-455-595] University of Nevada, Reno; 775-682-9083; [email protected]
Page 188
Usselman, Marion [373] Georgia Institute of Technology; 404-894-9673; [email protected]
Usuda, Hiroyuki [813] New Energy and Industrial Technology Development Organization; 81-44-520-5161; [email protected]
VVVVVVVV
Valdivia, Frank [417] Land O'Lakes International Development Division; 651-494-5147; [email protected]
Valentine, Leanne [131] Georiga State University; 404-651-3395; [email protected]
Valentine, Nell [751] Mississippi State University; 662-325-7127; [email protected]
Valle, Ramón (Ray) [365] San Diego State University; 619-463-3631; [email protected]
Valles-Rosales, Delia J [131-356] New Mexico State University; 505-646-2978; [email protected]
Van Buhler, Rebecca [820] Rocky Mountain Center for Health Promotion and Education; 303-867-9101; [email protected]
Van der Woerd, Kim [131] Simon Fraser University; 604-731-3536; [email protected]
Van Egeren, Laurie [721-864] Michigan State University; 517-355-0140; [email protected]
Van Haneghan, James [408-443] University of South Alabama; 251-380-2760; [email protected]
Van Melle, Elaine [858] Queen's University; 613-533-6000 x77730; [email protected]
VanAmburg, David [744] University of Michigan; 734-763-9061; [email protected]
Vargas-Bustamante, Arturo [854] University of California, Berkeley; 510-664-0823; [email protected]
Varnhagen, Stanley [131-405] University of Alberta; 780-492-3641; [email protected]
Vasireddy, Shankar Rao [857] National Leprosy Eradication Programme, India; [email protected]
Vasireddy, Vamsi [857] University of Illinois, Chicago; 773-578-7833; [email protected]
Vergon, Keren [683] University of South Florida; 813-974-8949; [email protected]
Vicinanza, Nicole [307-371] American Evaluation Association; 650-373-4952; [email protected]
Vickery, James [831] United States Environmental Protection Agency; [email protected]
Victor, Zvonnikov [673] State University of Management; 7 495 456-56-95; [email protected]
Villar, Luis [761] University of Seville; 34954556829; [email protected]
Villarejo, Merna [131] University of California, Davis; 530-756-2342; [email protected]
Vinogradova, Elena [607] REDA International Inc; 301-946-9790 x114; [email protected]
Visscher, Ronald Scott [106-817] Western Michigan University; 616-510-8206; [email protected]
Vito, Robert [394] Office of Inspector General; 215-861-4558; [email protected]
Voelker, Susan [646] University of Arizona; 520-318-7259 x173; [email protected]
Voelkle, Manuel [131-801] University of Mannheim; 49-621-181-2131; [email protected]
Vogel, Wendy [516] Policy Research Associates; 518-439-7415 x231; [email protected]
Volkov, Boris [827] University of Minnesota; 612-617-9589; [email protected]
Vonhof, Wendy [131] Cornell University; [email protected]
Vonortas, Nicholas [364] George Washington University; 202-994-6458; [email protected]
Vorbach, Uta [396] New Jersey Department of Health and Senior Services; 609-984-3317; [email protected]
Vowels, Christopher L [340-385] Kansas State University; 785-410-7429; [email protected]
WWWWWWWW
Wade, Julie [830] Montgomery County Public Schools; 301-279-3075; [email protected]
Wade, Kerri [679] West Virginia University; 304-768-1202; [email protected]
Wagner, Robin [762] Centers for Disease Control and Prevention; 404-639-4898; [email protected]
Wakabayashi, Setsuko [813] New Energy and Industrial Technology Development Organization; 81-44-520-5160; [email protected]
Walahoski, Jill Stephanie [843] University of Nebraska; [email protected]
Wald, Holly [436] HPW Associates; 412-731-6200; [email protected]
Walkenhorst, Jake [454-684] Neumont University; 801-362-8371; [email protected]
Walker, Peter [465] Feinstein International Center; 617-627-3361; [email protected]
Walker-Egea, Connie [388] Western Michigan University; 787-604-9769; [email protected]
Wall, Bob [507] Connecticut Clean Energy Fund; 860-257-2354; [email protected]
Wall, Hilary [396] Massachusetts Department of Public Health; 617-624-5411; [email protected]
Wallace, Frances [607] University of South Florida; 813-974-7367; [email protected]
Wallace, Michael [302] Howard University; 202-806-8485; [email protected]
Walrath, Christine [131-710] Macro International Inc; 646-695-8154; [email protected]
Walser, Tamara [406-537] University of North Carolina, Wilmington; 910-962-4175; [email protected]
Walsh, Jane [131] Denver Public Schools Early Reading First; 720-423-8209; [email protected]
Walsh, Michele [585-646-809-856] University of Arizona; 520-318-7259 x130; [email protected]
Walsh, Pamela [131] Eastern Michigan University; 734-487-2383; [email protected]
Walters, Bonnie [362-428] University of Colorado, Denver; 303-556-6512; [email protected]
Walton, Manya [838] Windwalker Corporation; 703-970-3563; [email protected]
Page 189
Wambugu, Charles [672] World Agroforestry Centre; [email protected]
Wandersman, Abraham [609-636-799-812] University of South Carolina; 803-777-7671; [email protected]
Wang, Guijing [762] Centers for Disease Control and Prevention; 404-639-4666; [email protected]
Wang, Helen [830] Montgomery County Public Schools; 301-279-3363; [email protected]
Wang, Lihshing [788] University of Cincinnati; 513-556-3628; [email protected]
Ward, Thomas E [313-757] United States Army Command and General Staff College; 913-651-6476; [email protected]
Washburn, Julia [570] National Park Service; 301-270-4325; [email protected]
Wasserman, Deborah [535-741] The Ohio State University; 614-572-3113; [email protected]
Watking-Buttler, Akilah [131] Loyola University, Chicago; 773-363-9818; [email protected]
Watkins, Ryan [369] George Washington University; 202-994-2263; [email protected]
Watson, Dennis [131] Loyola University, Chicago; 773-425-2179; [email protected]
Watts, Brad [131] Western Michigan University; 269-978-6828; [email protected]
Weatherholt, Tara [131] Education Development Center Inc; 212-807-4238; [email protected]
Weaver, Dax [131-781] Health-Tech Consultants Inc; 904-246-9719; [email protected]
Webb, Anna Kathryn [105] Catholic Relief Services; 410-951-7554; [email protected]
Weenink, Melissa [606] New Zealand Ministry of Education; 64 4 463 8043; [email protected]
Wehipeihana, Nan [354-782] Research Evaluation Consultancy Ltd; 644-472-2724; [email protected]
Weibel, Michelle [380] University of Nevada, Las Vegas; 702-496-0391; [email protected]
Weinberg, Joanna [131] Georgia State University; 404-651-3394; [email protected]
Weitzman, Beth [664] New York University; 212-998-7446; [email protected]
Weller, Bridget [340] University of North Carolina, Chapel Hill; 919-360-5036; [email protected]
Wen, Chen [816] United States Environmental Protection Agency; 202-564-8849; [email protected]
Wenzel, Stacy [322-755] University of Illinois, Chicago; 312-413-9221; [email protected]
Wernet, Steven [127] Saint Louis University; [email protected]
West, Richard [526] University of Georgia; 706-542-4508; [email protected]
West Meiers, Maurya [369-720] World Bank; 202-473-8543; [email protected]
Weston, Marcia [530] National Association of Student Financial Aid Adminstrators; 202-785-0453 x111; [email protected]
Whalen, Laura [710] Macro International Inc; 404-592-2244; [email protected]
Wheatley, Katharine [315] Macro International Inc; 301-572-0914; [email protected]
Wheeler-Clouse, Sammye [433] Mid-continent Research for Education and Learning; 303-632-5626; [email protected]
White, Jeffry L [638-718-789] Ashland University; 419-289-5643; [email protected]
White, Kim [428] Metropolitan State College, Denver; 303-556-4461; [email protected]
White, Rebecca [577] Louisiana State University; 225-578-3921; [email protected]
Wijesinha Rose, Shyanika [716] Battelle Centers for Public Health Research and Evaluation; 919-544-3717 x118; [email protected]
Wilburn, Kenneth [131-781] University of North Florida; 904-620-2990; [email protected]
Wilburn, Sharon [131-781] University of North Florida; 904-247-0020; [email protected]
Wilce, Maureen [389-630] Centers for Disease Control and Prevention; 404-639-5330; [email protected]
Wiley, Caroline [518-618] University of Arizona; 520-621-7847; [email protected]
Wilhelm, Mari [511-595] University of Arizona; 520 621-7130; [email protected]
Wilkerson, Stephanie [325] Magnolia Consulting LLC; 540-967-5540; [email protected]
Willard, Alice [421] Independent Consultant; 703-533-3126; [email protected]
Willems, Gwen M [622-674] University of Minnesota; 651-646-8854; [email protected]
Willemse, Machteld [131] Artnotion; 0031302931719; [email protected]
Williams, Aisha [479] Clark Atlanta University; 404-583-0667; [email protected]
Williams, Alison [443-864] Clark County School District; 702-799-5049; [email protected]
Williams, Barbara [866] Westat; 301-251-4249; [email protected]
Williams, Bob [372-409-444-569-606-800-810] Independent Consultant; 644-586-2790; [email protected]
Williams, David [108-419-785] Brigham Young University; 801-422-2765; [email protected]
Williams, Jason [737] RTI International; 919-541-6734; [email protected]
Williams, Jennifer [807] J E Williams and Associates LLC; 513-542-6636; [email protected]
Williams, Lindy [131] Cornell University; 607-255-4609; [email protected]
Williams, Mary Grcich [821] Lumina Foundation for Education; 317-951-5350; [email protected]
Williams, Samantha [436] Centers for Disease Control and Prevention; 404-639-1825; [email protected]
Williams, Shannon [351-555-728-832] JBS International Inc; 650-373-4900; [email protected]
Williams, Valerie [779] RAND Corporation; 703-413-1100 x5239; [email protected]
Williams Kaye, Jackie [615] The Atlantic Philanthropies; 212-916-7359; [email protected]
Williams-Piehota, Pam [630] RTI International; 919-541-7384; [email protected]
Willimann, Carrie [131] Academy for Educational Development; 202-884-8000; [email protected]
Wilson, Heather [363] Montomgery County Public Schools; 301-517-5040; [email protected]
Page 190
Wilson, Mary [383] East Point Community Action Team; [email protected]
Wilson, Pauline [742] CARE USA; 44-1727-857947; [email protected]
Wilson, William [831] United States Environmental Protection Agency; [email protected]
Wingate, Lori [738] Western Michigan University; 269-387-5913; [email protected]
Winges, Linda [716] Battelle Centers for Public Health Research and Evaluation; 206-528-3151; [email protected]
Witta, Lea [633] University of Central Florida; 407-823-3220; [email protected]
Wittmann, Werner [801-804] University of Mannheim; 49-621-181-2138; [email protected]
Wolf-Branigin, Michael [709] George Mason University; 703-993-4229; [email protected]
Wolford, Janis [866] Westat; 301-610-5588; [email protected]
Wolinsky, Frederic [131] University of Iowa; 319-384-5129; [email protected]
Wood, Leigh [743] Macquarie University; 61 2 9850 4756; [email protected]
Woodbridge, Michelle [623] SRI International; 650-859-6923; [email protected]
Woodruff-Bolte, Stacy [131] Public/Private Ventures; 212-822-2416; [email protected]
Woodward, Christel A [452] McMaster University; 905-525-9140 x22568; [email protected]
Woollery, Trevor [762] Centers for Disease Control and Prevention; 404-639-4663; [email protected]
Worley, Trisha [552] University of Wyoming; 307-760-6632; [email protected]
Wright, Demia S [508] Centers for Disease Control and Prevention; 770-488-5506; [email protected]
Wright, Malaika [742] CARE International; 404-681-2552; [email protected]
Wu, Heng-Chieh [864] Michigan State University; 517-353-8977; [email protected]
Wygant, Barbara [704-844] Western Michigan University; 269-387-5895; [email protected]
Wyrwich, Kathleen [131] Saint Louis University; 314-977-8192; [email protected]
XXXXXXXX
Xia, XueMei [366] East China Normal University; 0086-21-62233405; [email protected]
Yamaguchi, Ryoko [822] Abt Associates Inc; 301-634-1778; [email protected]
YYYYYYYY
Yang, Huilan [842] W K Kellogg Foundation; 269-968-1611; [email protected]
Yang, Hyeyoung [847] Korea Institute of Science and Technology Evaluation and Planning; 82-2-589-2890; [email protected]
Yang, Nai-Kuan [864] Michigan State University; 517-353-8977; [email protected]
Yano, Takahisa [813] New Energy and Industrial Technology Development Organization; 81-44-520-5160; [email protected]
Yap, Ching Ching [118-370] University of South Carolina; 803-777-3459; [email protected]
Yarbrough, Donald [601] University of Iowa; 319-335-5567; [email protected]
Yates, Brian [378-412-477-504-540-809] American University; 301-775-1892; [email protected]
Yee, Patricia [343] Vital Research, LLC; 323-951-1670; [email protected]
Yee, Sue Lin [335-359] Centers for Disease Control and Prevention; 404-639-3236; [email protected]
Yeh, Stuart [504] University of Minnesota; 612-624-0285; [email protected]
Yellowbird, Elizabeth [356] University of North Dakota; 701-777-4508; [email protected]
Yelton, Bruce [131-788] Praxis Research Inc; 704 523-2999; [email protected]
Yglesias, Elmer [592] Science and Technology Policy Institute; 202-419-3726; [email protected]
Yoon, Kwang Suk [362] American Institutes for Research; 202-403-5358; [email protected]
Yoon, Mijung [131-339-407] University of Illinois at Urbana-Champaign; 217-398-8314; [email protected]
York, Pete [381] TCC Group; 215-568-0399; [email protected]
York, Susan [328-754] University of Hawaii; 808-956-9210; [email protected]
Young, Collette [624] Oregon Public Health Division; 971-673-0318; [email protected]
Young, Kai [539] Centers for Disease Control and Prevention; 404-915-2839; [email protected]
Yu, Hanh Cao [460] Social Policy Research Assocaites; 510-763-1499 x631; [email protected]
Yuan, Wenhui [110] Western Michigan University; 269-372-2821; [email protected]
Yuen, JoAnn W L [356] University of Hawaii, Manoa; 808-956-5462; [email protected]
Yung, Betty [819] Wright State University; [email protected]
ZZZZZZZZ
Zadeh, Mina [828] United States Department of Health and Human Services; 770-630-2542; [email protected]
Zandniapour, Lily [615] Innovation Network Inc; 202-728-0727 x117; [email protected]
Zantal-Wiener, Kathy [608] Caliber an ICF International Company; 703-219-4414; [email protected]
Zaveri, Heather [862] Mathematica Policy Research Inc; 202-264-3441; [email protected]
Zeigler, Sara [563] University of Maryland; [email protected]
Zell, Adrienne [686] Human Services Research Institute; 503-924-3783 x15; [email protected]
Page 191
Zhang, Jie [305] Syracuse University; 315-382-7695; [email protected]
Zhang, Jinhai [681] Western Michigan University; 269-387-7427; [email protected]
Zhang, Lei [131] Georgia State University; 404-386-8877; [email protected]
Zhou, Mei [382] Georgia State University; 404-651-1532; [email protected]
Zhu, Jing [673-789] The Ohio State University; 614-592-0136; [email protected]
Zief, Susan [418] Mathematica Policy Research Inc; 609-275-2291; [email protected]
Zimmerman, Lindsey [131] Georgia State University; 517-862-7697; [email protected]
Zinoecker, Klaus [727] Vienna Science and Technology Fund; 0043-1-402314312; [email protected]
Zorn, Debbie [676] University of Cincinnati; 513-556-3818; [email protected]
Zubritsky, Cynthia [436] University of Pennsylvania; 215-349-8700; [email protected]
Zuckerman, Brian [329-446] Science and Technology Policy Institute; 202-419-5485; [email protected]
Zukoski, Ann [307-452] Oregon State University; 541-737-3832; [email protected]
Page 192
Appendix B: Directory of Sessions by Sponsor
Index of Sessions for the Presidential Strand
#
Time
Session Type
Session Title
Room Name
100
120
300
301
336
372
407
442
500
531
563
595
628
655
685
700
701
734
769
803
Wed, 3:10 PM to 4:10 PM
Wed, 4:30 PM to 6:00 PM
Thu, 8:00 AM to 9:15 AM
Thu, 9:35 AM to 11:05 AM
Thu, 11:15 AM to 12:45 PM
Thu, 1:55 PM to 3:25 PM
Thu, 3:35 PM to 5:05 PM
Thu, 5:15 PM to 6:00 PM
Fri, 8:00 AM to 9:05 AM
Fri, 9:25 AM to 10:10 AM
Fri, 10:20 AM to 11:05 AM
Fri, 11:15 AM to 12:00 PM
Fri, 1:55 PM to 3:25 PM
Fri, 3:35 PM to 4:20 PM
Fri, 4:30 PM to 6:00 PM
Sat, 8:00 AM to 9:15 AM
Sat, 9:35 AM to 10:20 AM
Sat, 10:30 AM to 12:00 PM
Sat, 12:10 PM to 1:40 PM
Sat, 1:50 PM to 3:20 PM
Plenary
Demonstration
Plenary
Panel
Panel
Skill-building
Panel
Panel
Plenary
Expert Lecture
MultiPaper
Panel
MultiPaper
Demonstration
Panel
Panel
Expert Lecture
Skill-building
Think Tank
Skill-building
Bringing Evaluative Learning to Life
Facilitating Fast-paced Learning: Developmental Evaluation for Complex Emergent Innovations
Presidential Address - Evaluation’s Second Act: A Spotlight on Learning
Learning Practical Knowledge Through the Study of Cases
Learning Systems and Systems of Learning in Practice
Exploring Evaluation and Learning: Winners of the Student Competition
Educating for Intelligent Belief in Evaluation
The Next Generation of Learning Measurement: Measuring and Communicating the Value of the Learning Function
Indigenous Knowledge Creation and Evaluation Practice
Introducing Appreciative Inquiry to Evaluation
Learning From Evaluation in Service of Social Justice: Who learns? What is Learned? And Why Does it Matter?
Foundational Evaluation Principles and Processes: Embracing and Engaging Culture and Context
Teaching About Evaluation: Methods With an Admixture of Epistemology and Ontology
Get Engaged! Using Adult Learning Principles to Enhance Evaluation Learning
Promoting and Assessing Individual and Organizational Knowledge Building
Baltimore Theater
Baltimore Theater
Baltimore Theater
Baltimore Theater
Baltimore Theater
Baltimore Theater
837
871
Sat, 3:30 PM to 5:00 PM
Sat, 5:15 PM to 6:00 PM
Think Tank
Plenary
Eval and Learning: The Challenges of and Possibilities for Ongoing Learning and Reflective Practice Among Evaluators
Evaluation 2007: Appendix B – Directory of Sessions by Sponsor
Page 193
Index of Sessions for the Advocacy and Policy Change TIG
#
Time
Session Type
Session Title
Room Name
310
345
381
478
529
550
582
615
642
669
714
749
818
Thu, 9:35 AM to 11:05 AM
Thu, 11:15 AM to 12:45 PM
Thu, 1:55 PM to 3:25 PM
Thu, 6:10 PM to 7:00 PM
Fri, 9:25 AM to 10:10 AM
Fri, 10:20 AM to 11:05 AM
Fri, 11:15 AM to 12:00 PM
Fri, 1:55 PM to 3:25 PM
Fri, 3:35 PM to 4:20 PM
Fri, 4:30 PM to 6:00 PM
Sat, 9:35 AM to 10:20 AM
Sat, 10:30 AM to 12:00 PM
Sat, 1:50 PM to 3:20 PM
Panel
Multipaper
Panel
Business Meeting
Panel
Multipaper
Demonstration
Demonstration
Expert Lecture
Demonstration
Demonstration
Panel
Multipaper
Policy Evaluation: Learning About What, When and For Whom?
Foundation Policy Change Efforts: Internal and External Evaluation Strategies
Evaluating Policy and Advocacy Organizations Through Short Term Measures of Organizational Capacity
Advocacy and Policy Change TIG Business Meeting
Real-life Lessons Learned in Building Capacity for Advocacy and Policy Evaluation
Assessing Advocacy: Building Evaluation Frameworks and Models That Work
Real Application of a Policy Advocacy Evaluation Tool
Advocacy Evaluation: Practical Research Findings
Evaluation Across Policy Networks: Chronic Disease, Obesity, and Community Design
Lessons Learned: Wrapping up our Evaluation of an Advocacy Campaign
Starting Out Right: How to Begin Evaluating Community Organizing, Advocacy, and Policy Change Efforts Using…
Evaluating Electronic Advocacy and Communications
Advocacy, Community Mobilization and Systems Change: Assessing Unique Strategies to Impact Community
Carroll Room
Carroll Room
Carroll Room
Adams Room
Adams Room
Adams Room
Adams Room
Adams Room
Adams Room
Adams Room
Adams Room
Index of Sessions for the Alcohol, Drug Abuse, and Mental Health TIG
#
Time
Session Type
Session Title
Room Name
107
330
347
365
401
436
471
561
593
626
653
683
728
763
798
832
Wed, 4:30 PM to 6:00 PM
Thu, 9:35 AM to 11:05 AM
Thu, 11:15 AM to 12:45 PM
Thu, 11:15 AM to 12:45 PM
Thu, 1:55 PM to 3:25 PM
Thu, 3:35 PM to 5:05 PM
Thu, 5:15 PM to 6:00 PM
Fri, 10:20 AM to 11:05 AM
Fri, 11:15 AM to 12:00 PM
Fri, 1:55 PM to 3:25 PM
Fri, 3:35 PM to 4:20 PM
Fri, 4:30 PM to 6:00 PM
Sat, 9:35 AM to 10:20 AM
Sat, 10:30 AM to 12:00 PM
Sat, 12:10 PM to 1:40 PM
Sat, 1:50 PM to 3:20 PM
Panel
MultiPaper
Panel
Panel
MultiPaper
Multipaper
Business Meeting
Demonstration
Panel
Panel
Expert Lecture
Multipaper
Think Tank
Multipaper
MultiPaper
Panel
Building Capacity to Strengthen the Evaluation of Safe Start Promising Approaches: An Evidence-based Approach
Evaluation in the Era of Evidence-based Prevention
Evaluating the Effectiveness of Community Prevention Coalitions: An Interim Report on the Evaluation of the Drug-free…
Evaluating the Cultural Competence of Substance abuse and Mental Health Services: Policy, Technology, and Practice
Small Wins are Winsome: Aggregating Learning From Small Evaluations Into Systems Change
Substance Abuse Program Evaluation: Productivity Benefits, Peer Mentorship, Drug Courts and Jail Interventions
TIG Business Meeting and Roundtable: Soldiers Returning From Combat and Higher Learning Evaluation
Smashing the Mental Health Atom: A Conceptual Framework to Properly Evaluate System, Service, and Clinical Practice
Challenges Associated With the Implementation and Use of a Statewide Substance Abuse and Mental Health Outcome…
Evaluating Arizona's School-based Tobacco Prevention Program: Lessons Learned in Outcome Evaluation
Evaluation to Improve Coordinated Social Marketing Campaigns: Lessons From Tobacco Control
Recovery/Resilience, Trajectories, Co-occurring Disorders, and Real Time Program Evaluation
Leaving No Stone Unturned: Examining the Evaluation of a Statewide Program at the Local Level
Theory to Practice: Strategic Considerations
Helping Communities Improve: Evaluation as Feedback for Learning
Putting it All Together: Integrating Evaluation Components to Create a Comprehensive Statewide Evaluation
866
Sat, 3:30 PM to 5:00 PM
Multipaper
Substance Abuse Programming: Assessing Fidelity of Implementation and Community-readiness
Page 194
Index of Sessions for the Assessment in Higher Education TIG
#
Time
Session Type
Session Title
Room Name
111
Wed, 4:30 PM to 6:00 PM
Business Meeting
TIG Business Meeting and Presentation: Evaluating Alaska Native-Serving/Native Hawaiian-Serving Institutions…
Adams Room
405
Thu, 1:55 PM to 3:25 PM
Multipaper
Evaluating Student Learning Outcomes
Chesapeake Room
440
Thu, 3:35 PM to 5:05 PM
Demonstration
Learning to Assess Learning: Using the Instructional Assessment Resources Web Site to Improve Teaching and Learning
Chesapeake Room
475
Thu, 5:15 PM to 6:00 PM
Panel
A Foot in Each Worlds: An Evaluator in the Assessment World
Chesapeake Room
589
Fri, 11:15 AM to 12:00 PM
Expert Lecture
Schaefer Room
627
Fri, 1:55 PM to 3:25 PM
Multipaper
Evaluating Graduate Education in Health and Medicine
Hanover Suite B
654
Fri, 3:35 PM to 4:20 PM
Think Tank
Using Graduate Student Assessment to Evaluate Success of Graduate Programs
Hanover Suite B
684
Fri, 4:30 PM to 6:00 PM
Multipaper
Diverse Approaches to Evaluative Inquiry in Higher Education
Hanover Suite B
726
Sat, 9:35 AM to 10:20 AM
Multipaper
Higher Education Assessment and Evaluation in a Context of Use and Policy Development
Federal Hill Suite
761
Sat, 10:30 AM to 12:00 PM
Multipaper
Technology Programs in Higher Education: Considering Digital Horizons
Federal Hill Suite
789
Sat, 12:10 PM to 1:40 PM
Panel
McKeldon Room
Index of Sessions for the Business and Industry TIG
#
Time
Session Type
Session Title
Room Name
395
Thu, 1:55 PM to 3:25 PM
Multipaper
Evaluation, Learning, and Training in Business Industry Settings
430
Thu, 3:35 PM to 5:05 PM
Think Tank
Continuous Improvement: Examining the Impact of Year-after-Year Evaluations and Improve Learning Products and Eval
510
Fri, 9:25 AM to 10:10 AM
Demonstration
Assessment of Stakeholder Needs and Evaluation Use in an Organizational Context: The Real World
546
Fri, 10:20 AM to 11:05 AM
Panel
Intelligence Analysis: Maximizing Learning and Decision Making From Evaluations in Public and Private Sector Settings
578
Fri, 11:15 AM to 12:00 PM
Business Meeting
Business and Industry TIG Business Meeting
722
Sat, 9:35 AM to 10:20 AM
Multipaper
Methodological Challenges and Solutions for Business and Industry Evaluators
757
Sat, 10:30 AM to 12:00 PM
Multipaper
Case Studies in Business and Industry Evaluation
792
Sat, 12:10 PM to 1:40 PM
MultiPaper
Advancing Personnel Evaluation in Business & Industry
837
Sat, 3:30 PM to 5:00 PM
Think Tank
Page 195
Index of Sessions for the Cluster, Multi-site and Multi-level Evaluation TIG
#
Time
Session Type
Session Title
Room Name
104
Wed, 4:30 PM to 6:00 PM
Multipaper
Community Focus
309
Thu, 9:35 AM to 11:05 AM
Panel
Three Perspectives on Using Eval for Alternative Teacher Preparation: Insights From the Evaluator, the Policymaker…
344
Thu, 11:15 AM to 12:45 PM
Multipaper
Evaluation in Education
499
Fri, 7:00 AM to 7:50 AM
Business Meeting
TIG Business Meeting and Panel: Building Evaluation Capacity Among Dissimilar Community Programs: Lessons…
Mencken Room
607
Fri, 1:55 PM to 3:25 PM
Multipaper
Methods in Evaluation
Mencken Room
661
Fri, 4:30 PM to 6:00 PM
Skill-building
Telling Your Program's Story: How to Collect, Create, and Deliver an Effective Success Story
Mencken Room
844
Sat, 3:30 PM to 5:00 PM
MultiPaper
Working to Address the Evaluation Needs of More of the People More of the Time: Conducting Evaluation in Multi-site…
Mencken Room
Index of Sessions for the Collaborative, Participatory & Empowerment Evaluation TIG
#
Time
Session Type
Session Title
Room Name
126
Wed, 4:30 PM to 6:00 PM
Business Meeting
Collaborative, Participatory and Empowerment Evaluation TIG Business Meeting
Hanover Suite B
331
Thu, 9:35 AM to 11:05 AM
Multipaper
Strengthening Communities Through the Use of Evaluation: Issues and Perspectives
Hanover Suite B
366
Thu, 11:15 AM to 12:45 PM
Multipaper
Empowerment Evaluations: Insights, Reflections, and Implications
Hanover Suite B
393
Thu, 1:55 PM to 3:25 PM
Skill-building
Collaborative Evaluations: A Step-by-Step Model for the Evaluator
Preston Room
402
Thu, 1:55 PM to 3:25 PM
Demonstration
Lessons Learned Through Building Capacity in Collaborative Evaluation in the Field of Education
Hanover Suite B
437
Thu, 3:35 PM to 5:05 PM
Skill-building
Moving Measures: Employing Visual Theater and Movement to Convey and Augment Participatory Learning in
Program Evaluation
Hanover Suite B
472
Thu, 5:15 PM to 6:00 PM
Think Tank
When Clients Collect Evaluation Data: Promises and Pitfalls
Hanover Suite B
576
Fri, 11:15 AM to 12:00 PM
Think Tank
Arkansas Evaluation Center and Empowerment Evaluation: We Invite Your Participation as We Think About How to Build… Carroll Room
609
Fri, 1:55 PM to 3:25 PM
Panel
Getting To Outcomes at the Federal, State, County, and Local Levels: Session I
Carroll Room
636
Fri, 3:35 PM to 4:20 PM
Panel
Getting To Outcomes at the Federal, State, County, and Local Levels: Session II
Carroll Room
663
Fri, 4:30 PM to 6:00 PM
Multipaper
Collaborative Evaluations: Successes, Challenges, and Lessons Learned
Carroll Room
729
Sat, 9:35 AM to 10:20 AM
MultiPaper
Consumer and Family Member Involvement in Evaluating Federally-Funded Initiatives
Hanover Suite B
764
Sat, 10:30 AM to 12:00 PM
Panel
Using Appreciative Inquiry in Evaluation: Exploring Impact and Lessons From the Field
Hanover Suite B
799
Sat, 12:10 PM to 1:40 PM
MultiPaper
Using Empowerment Evaluation to Facilitate Organizational Transformation: A Stanford University Medical Center Case… Hanover Suite B
812
Sat, 1:50 PM to 3:20 PM
MultiPaper
Empowerment Evaluation Communities of Learners: From Rural Spain to the Arkansas Delta
Carroll Room
833
Sat, 1:50 PM to 3:20 PM
Multipaper
Engaging Participants in the Evaluation Process: A Participatory Approach
Hanover Suite B
846
Sat, 3:30 PM to 5:00 PM
Panel
Storytelling in Program Evaluation: Putting the Timeless Miracles Into the Particulars of Experience
Carroll Room
867
Sat, 3:30 PM to 5:00 PM
Panel
Building and Assessing Capacity for Evaluation: Creating Communities of Learners Among Service Providers
Hanover Suite B
Page 196
Index of Sessions for the College Access Programs TIG
#
Time
Session Type
Session Title
Room Name
461
Thu, 5:15 PM to 6:00 PM
Demonstration
A Demonstration of the Use of Concept Mapping as Evaluation Tool for NSF’s Integrative Graduate Education…
Calhoun Room
486
Thu, 6:10 PM to 7:00 PM
Business Meeting
College Access Programs TIG Business Meeting
Calhoun Room
530
Fri, 9:25 AM to 10:10 AM
Panel
Who Needs a College Goal Sunday? Using Eval to Expand and Improve a Large-scale Financial Aid Awareness Program
Hanover Suite B
562
595
836
Fri, 10:20 AM to 11:05 AM
Fri, 11:15 AM to 12:00 PM
Sat, 1:50 PM to 3:20 PM
Multipaper
Panel
Multipaper
College Success Programs: Evaluating Undergraduate and Graduate Interventions
Evaluating College Access Programs: Eval Models and Methods for Different Interventions: Middle School Programs…
Hanover Suite B
Baltimore Theater
Chesapeake Room
Index of Sessions for the Costs, Effectiveness, Benefits, and Economics TIG
#
Time
Session Type
Session Title
Room Name
412
Thu, 3:35 PM to 5:05 PM
Skill-building
Starting a "Cost Study": Measuring and Improving Costs, Cost-effectiveness, and Cost-benefit in Human Services
477
Thu, 6:10 PM to 7:00 PM
Business Meeting
Costs, Effectiveness, Benefits, and Economics TIG Business Meeting
Mencken Room
504
Fri, 9:25 AM to 10:10 AM
Expert Lecture
Shifting the Bell Curve: The Benefits and Costs of Raising Student Achievement
540
Fri, 10:20 AM to 11:05 AM
Expert Lecture
Costs are All That Matters (With Studies That Prove It): About and Beyond Cost-inclusive Evaluation
572
Fri, 11:15 AM to 12:00 PM
Multipaper
Measuring Effectiveness, Efficiency, and Sustainability in Innovative Health Programs Reaching the Underserved
632
Fri, 3:35 PM to 4:20 PM
MultiPaper
Cost Benefit Analyses in and of Evaluation
713
Sat, 9:35 AM to 10:20 AM
Expert Lecture
Fighting Poverty: What Works? Running Randomized Evaluations of Poverty Programs in Developing Countries
Peale Room
809
Sat, 1:50 PM to 3:20 PM
Panel
Index of Sessions for the Crime and Justice TIG
#
Time
Session Type
Session Title
Room Name
429
Thu, 3:35 PM to 5:05 PM
Panel
Evaluation Research Involving Criminal Justice Interventions
Schaefer Room
459
Thu, 5:15 PM to 6:00 PM
Business Meeting
Crime and Justice TIG Business Meeting and Presentations
Washington Room
516
Fri, 9:25 AM to 10:10 AM
Multipaper
Recidivism and Re-entry
Washington Room
552
Fri, 10:20 AM to 11:05 AM
Multipaper
Studies Dealing With Needs Assessment and Program Development: Focus on Domestic Violence Victims and Children…
Washington Room
584
Fri, 11:15 AM to 12:00 PM
Think Tank
Conducting a Process Evaluation of a Prisoner Reentry Initiative
Washington Room
737
Sat, 10:30 AM to 12:00 PM
Panel
Findings From the Cross-site Evaluation of the Safe Schools, Healthy Students Initiative
Page 197
Index of Sessions for the Disaster and Emergency Management Evaluation TIG
#
Time
Session Type
Session Title
Room Name
324
Thu, 9:35 AM to 11:05 AM
Business Meeting
TIG Business Meeting and Panel: Evaluation of the National Case Management Consortium Katrina Aid Today…
359
Thu, 11:15 AM to 12:45 PM
Panel
State and Local Public Health Emergency Preparedness: Evaluation at the CDC Expands Focus on Capacities to Include… Calvert Ballroom Salon B
465
Thu, 5:15 PM to 6:00 PM
Panel
Using a Participatory Impact Assessment Approach to Measure the Effectiveness of Famine Relief and Increase…
543
Fri, 10:20 AM to 11:05 AM
MultiPaper
Emergency Preparedness Standards of Acceptability for Evaluation
575
Fri, 11:15 AM to 12:00 PM
Demonstration
The South Central Center for Public Health Preparedness Training Evaluation Process: A Comprehensive Approach…
608
Fri, 1:55 PM to 3:25 PM
Panel
Evaluating School District Emergency Management Plans Using GPRA Performance Measures and Indicators
635
Fri, 3:35 PM to 4:20 PM
Multipaper
Evaluating Online Training for Disaster and Emergency Preparedness
707
Sat, 9:35 AM to 10:20 AM
Multipaper
Engaging Communities in Disaster and Emergency Management Planning, Education, and Evaluation
742
Sat, 10:30 AM to 12:00 PM
Think Tank
Raising the Bar: What Role for Accreditation and Certification in Improving the Quality and Accountability of INGO…
860
Sat, 3:30 PM to 5:00 PM
Multipaper
Federal, State, and Local Disaster and Emergency Planning and Preparedness: Strategies and Case Studies for Evaluation Calvert Ballroom Salon B
Index of Sessions for the Distance Ed. & Other Educational Technologies TIG
#
Time
Session Type
Session Title
Room Name
129
Wed, 4:30 PM to 6:00 PM
Multipaper
Evaluation Methodology in Educational Technology Contexts
Chesapeake Room
468
Thu, 5:15 PM to 6:00 PM
Business Meeting
Distance Education and Other Educational Technologies TIG Business Meeting
Fairmount Suite
662
Fri, 4:30 PM to 6:00 PM
Multipaper
Where Evaluation and Learning Technology Innovations Meet
767
Sat, 10:30 AM to 12:00 PM
Multipaper
Evaluating Technology Adaptations in Higher Education
Chesapeake Room
802
Sat, 12:10 PM to 1:40 PM
Multipaper
Educational Technology: Evaluation Opportunities
Chesapeake Room
Index of Sessions for the Environmental Program Evaluation TIG
#
Time
Session Type
Session Title
Room Name
380
Thu, 1:55 PM to 3:25 PM
Multipaper
Connecting People and Nature: Models of Environmental Education
415
Thu, 3:35 PM to 5:05 PM
Business Meeting
Environmental Program Evaluation TIG Business Meeting and Preview of the Fieldtrip to the Herring Run Watershed…
450
Thu, 5:15 PM to 6:00 PM
Multipaper
Strategic Design, Measurement, and Accountability in Environmental Program Evaluations
507
Fri, 9:25 AM to 10:10 AM
Multipaper
Energy Efficiency, Education, and Intention: Cradle to Grave
563
Fri, 10:20 AM to 11:05 AM
MultiPaper
Baltimore Theater
617
Fri, 1:55 PM to 3:25 PM
Demonstration
Lessons From the Field in Building Evaluative Capacity of Restoration Activities: A Field Trip of the Herring Run Watershed Washington Room
816
Sat, 1:50 PM to 3:20 PM
MultiPaper
Learning From the Evaluation of Voluntary Environmental Partnership Programs
Hopkins Room
831
Sat, 1:50 PM to 3:20 PM
Panel
Royal Board Room
850
Sat, 3:30 PM to 5:00 PM
Panel
Crossing the Threshold: Addressing Methodological, Institutional and Cultural Challenges in Environmental Eval…
Hopkins Room
Page 198
Index of Sessions for the Evaluating the Arts and Culture TIG
#
Time
Session Type
Session Title
Room Name
370
Thu, 11:15 AM to 12:45 PM
MultiPaper
Multi-year Evaluation of the Arts Education Reform Efforts in South Carolina
Versailles Room
406
Thu, 1:55 PM to 3:25 PM
Multipaper
Exploring Innovation and Process in Arts Evaluation
Versailles Room
476
Thu, 5:15 PM to 6:00 PM
Business Meeting
Evaluating the Arts and Culture TIG Business Meeting
Versailles Room
768
Sat, 10:30 AM to 12:00 PM
Panel
Learning Within the Arts and Through the Process of Arts Evaluation
Versailles Room
Index of Sessions for the Evaluation Managers and Supervisors TIG
#
Time
Session Type
Session Title
Room Name
394
Thu, 1:55 PM to 3:25 PM
Business Meeting
TIG Business Meeting and Presentation: Managing Evaluation: Towards a Text for Practitioners
Schaefer Room
464
Thu, 5:15 PM to 6:00 PM
Panel
Assessing and Improving Evaluation Staff Skills
Schaefer Room
Index of Sessions for the Evaluation Use TIG
#
Time
Session Type
Session Title
Room Name
304
Thu, 9:35 AM to 11:05 AM
Multipaper
Organizational Learning and Evaluation Use at the State Level
339
Thu, 11:15 AM to 12:45 PM
Multipaper
Models of Evaluation Use and Influence in Social and Educational Services
375
Thu, 1:55 PM to 3:25 PM
Panel
Building Evaluation Capacity in Youth Serving Organizations for Bullying Prevention
410
Thu, 3:35 PM to 5:05 PM
MultiPaper
Conceptual and Empirical Advances in Evaluation Capacity Building
445
Thu, 5:15 PM to 6:00 PM
Business Meeting
Evaluation Use TIG Business Meeting
519
Fri, 9:25 AM to 10:10 AM
Panel
Lessons From Evaluation Use at the United Kingdom National Audit Office and the World Bank Group
McKeldon Room
570
Fri, 11:15 AM to 12:00 PM
Think Tank
Exploring the Sacrifice Fly Phenomenon in Evaluation Use
603
Fri, 1:55 PM to 3:25 PM
Multipaper
Studying Process Use on a Large Scale
723
Sat, 9:35 AM to 10:20 AM
Skill-building
Get Those Data off the Shelf and Into Action: Encouraging Utilization Through Innovative Reporting Strategies
758
Sat, 10:30 AM to 12:00 PM
Multipaper
Frameworks of Evaluation Use and Empirical Assessments
793
Sat, 12:10 PM to 1:40 PM
Demonstration
New Developments in Utilization-focused Evaluation: Implications for Learning
827
Sat, 1:50 PM to 3:20 PM
Multipaper
Case Studies of Evaluation Use
Page 199
Index of Sessions for the Extension Education Evaluation TIG
#
Time
Session Type
Session Title
Room Name
121
Wed, 4:30 PM to 6:00 PM
Multipaper
Building Evaluation Capacity Within Organizations
326
Thu, 9:35 AM to 11:05 AM
Panel
Building Evaluation Capacity in Extension Systems
361
Thu, 11:15 AM to 12:45 PM
Think Tank
Locating Evidence of Research-based Extension Education Programs
397
Thu, 1:55 PM to 3:25 PM
Panel
Eval Specialists: How Those who Evaluate Cooperative Extension Services and Other Educational Organizations Define…
432
Thu, 3:35 PM to 5:05 PM
Business Meeting
Extension Education Evaluation TIG Business Meeting
509
Fri, 9:25 AM to 10:10 AM
Demonstration
Successful Strategies for Developing Evaluation Instruments Using a Web-based System
545
Fri, 10:20 AM to 11:05 AM
Demonstration
Introducing SAMMIE - Successful Assessment Methods and Measurement In Eval: A Web-based, Self-paced, Eval Skill…
577
Fri, 11:15 AM to 12:00 PM
Demonstration
Using Images as Catalysts for Expression in Evaluation: A Demonstration of Photolanguage
679
Fri, 4:30 PM to 6:00 PM
Multipaper
Evaluation Within Partnerships: Working With Community Groups
777
Sat, 12:10 PM to 1:40 PM
Multipaper
Multiple Methods, Multiple Perspectives
811
Sat, 1:50 PM to 3:20 PM
Demonstration
North Carolina Cooperative Extension's Program Development Institute: A Multi-faceted, Multi-level, Multi-disciplinary… Edgar Allen Poe Room
845
Sat, 3:30 PM to 5:00 PM
MultiPaper
Connecting Research and Implementation to Enhance Youth Development Programming
Index of Sessions for the Feminist Issues in Evaluation TIG
#
Time
Session Type
Session Title
Room Name
441
Thu, 3:35 PM to 5:05 PM
Think Tank
From Identity-based Perspectives to Social Justice in Evaluation
Versailles Room
469
Thu, 5:15 PM to 6:00 PM
Business Meeting
Feminist Issues in Evaluation TIG Business Meeting
Federal Hill Suite
Page 200
Index of Sessions for the Government Evaluation TIG
#
Time
Session Type
Session Title
Room Name
103
Wed, 4:30 PM to 6:00 PM
Panel
Eval and Learning in a Changing Landscape: How Changes to First 5 LA's Evaluation Framework are Integrated by Eval…
Mencken Room
308
Thu, 9:35 AM to 11:05 AM
Panel
Putting the Pieces Together: Making Inferences in a Complex Multimodal Evaluation
Mencken Room
343
Thu, 11:15 AM to 12:45 PM
Panel
Exploring the Implications of the Administration of Aging's Performance Outcomes Measures Project for Evaluators
Mencken Room
379
Thu, 1:55 PM to 3:25 PM
Panel
Evaluating Department of Justice Faith and Community-Based Initiatives That Serve Victims of Crime
Mencken Room
414
Thu, 3:35 PM to 5:05 PM
Multipaper
International Issues in Evaluation
Mencken Room
449
Thu, 5:15 PM to 6:00 PM
Business Meeting
Government Evaluation TIG Business Meeting
Mencken Room
506
Fri, 9:25 AM to 10:10 AM
Demonstration
Designing Federal Evaluations: Developing Good Project Objectives and Performance Measures
Mencken Room
631
Fri, 1:55 PM to 3:25 PM
Panel
Using Strategic Planning and Strategic Evaluation as Learning Processes
Versailles Room
658
Fri, 3:35 PM to 4:20 PM
Panel
Effectiveness and Impact of Federal Safety Risk Reduction Programs: Eval Experience and Lessons Learned…
Versailles Room
688
Fri, 4:30 PM to 6:00 PM
Multipaper
Challenges and Opportunities in Evaluating Publicly-Funded Programs
Versailles Room
724
Sat, 9:35 AM to 10:20 AM
Expert Lecture
Do Serious Design Flaws Compromise the Objectivity and Credibility of the OMG’s PART Evaluation Process?
759
Sat, 10:30 AM to 12:00 PM
Panel
Informing Government Policy Through Evaluation
779
Sat, 12:10 PM to 1:40 PM
Panel
Expert Evaluation of Federal Agencies' Program Portfolios in the Program Assessment Rating Tool (PART) Eval Process
794
Sat, 12:10 PM to 1:40 PM
Panel
Learning From Quality Assurance and Improvement Processes
828
Sat, 1:50 PM to 3:20 PM
Multipaper
Rating Tools, Causation, and Performance Measurement
862
Sat, 3:30 PM to 5:00 PM
Multipaper
Perspectives on Federal Evaluation
Index of Sessions for the Graduate Student and New Evaluator TIG
#
Time
Session Type
Session Title
Room Name
305
Thu, 9:35 AM to 11:05 AM
Multipaper
Critical Reflections: Theory and Practice
340
Thu, 11:15 AM to 12:45 PM
Multipaper
Evaluation Training: Developing Professionals
539
Fri, 10:20 AM to 11:05 AM
Demonstration
How to Write an Evaluation Plan: A Step-by-Step Guide for New Evaluators
571
Fri, 11:15 AM to 12:00 PM
Multipaper
Lessons Learned From Evaluation Practice
604
Fri, 1:55 PM to 3:25 PM
Business Meeting
Graduate Student and New Evaluators TIG Business Meeeting and Presentation: Learning for High Quality Eval Practice… International Ballroom E
738
Sat, 10:30 AM to 12:00 PM
Think Tank
Can These Checklists Work? Simplifying Cost and Sustainability Evaluations
773
Sat, 12:10 PM to 1:40 PM
Panel
Successfully Publishing Your Dissertation
Page 201
Index of Sessions for the Health Evaluation TIG
#
Time
Session Type
Session Title
Room Name
105
Wed, 4:30 PM to 6:00 PM
Think Tank
Awareness and Education: Did You Change Your Behavior This Week?
Carroll Room
113
Wed, 4:30 PM to 6:00 PM
Multipaper
New Evaluation Initiatives on Diabetes Prevention and Childhood Obesity: From the National to the School Level
Washington Room
311
Thu, 9:35 AM to 11:05 AM
Multipaper
Logic Models are Alive and Well: New Applications in the Health Field
318
Thu, 9:35 AM to 11:05 AM
Panel
The Safe Start Demonstration Project: Design, Approaches and Outcomes of Evaluating a Systems Change Continuum…
Washington Room
335
Thu, 9:35 AM to 11:05 AM
Panel
Performance Measurement: Getting to Yes With Grantees and Partners
Versailles Room
346
Thu, 11:15 AM to 12:45 PM
Panel
Conducting Large Scale Evaluations of Federal Cancer Control Programs
353
Thu, 11:15 AM to 12:45 PM
Panel
Evaluating a State Comprehensive Cancer Control Program: Planning, Implementation and Initial Results
Washington Room
382
Thu, 1:55 PM to 3:25 PM
Multipaper
Making Health Evaluation More Culturally Competent Using Mixed Methods and Case Studies
389
Thu, 1:55 PM to 3:25 PM
Panel
Outbreaks: How Do You Evaluate Responses to the Unexpected?
Washington Room
424
Thu, 3:35 PM to 5:05 PM
Panel
Focusing on Exposure as a Central Construct in Health Campaigns Research: Experiences From Entertainment-Education… Washington Room
452
Thu, 5:15 PM to 6:00 PM
Business Meeting
TIG Business Meeting and Presentation: Implementing Evidence-based Programs: A Six-step Protocol for Assuring…
597
Fri, 11:15 AM to 12:00 PM
Multipaper
Quality Indicators in Health Care: From Training to Accreditation
Chesapeake Room
630
Fri, 1:55 PM to 3:25 PM
Panel
Good, Better, Best: Evaluation Approaches to Determine Best Practices
Chesapeake Room
657
Fri, 3:35 PM to 4:20 PM
Demonstration
Extending the Reach: Making the Most of Limited Evaluation Resources
Chesapeake Room
687
Fri, 4:30 PM to 6:00 PM
Skill-building
Using Systems Tools to Understand Multi-site Program Evaluation
Chesapeake Room
716
Sat, 9:35 AM to 10:20 AM
Multipaper
Coalitions and Participatory Approaches in Health Partnership Evaluations
Washington Room
751
Sat, 10:30 AM to 12:00 PM
Panel
Constraints and Promising Practices in Evaluating Social Norm Change: Lessons Learned From Tobacco Control
Washington Room
786
Sat, 12:10 PM to 1:40 PM
MultiPaper
Evaluating Health Improvement Collaboratives Using a Systems Thinking Developmental Evaluation Approach
Washington Room
820
Sat, 1:50 PM to 3:20 PM
Multipaper
Capacity Factors in Prevention and New Tobacco Control Strategies and Evaluations
Washington Room
854
Sat, 3:30 PM to 5:00 PM
Multipaper
Evaluation Lessons in International Contexts: Health Services and Infectious Diseases
Washington Room
Page 202
Index of Sessions for the Human Services Evaluation TIG
#
Time
Session Type
Session Title
Room Name
333
Thu, 9:35 AM to 11:05 AM
Demonstration
Creating a Culture of Process Improvement in the Human Services: An Application of Lean Philosophy
International Room
368
Thu, 11:15 AM to 12:45 PM
Panel
Quality Counts: Becoming Bilingual in Quality Improvement and Evaluation in Human Services and Health Care Settings
International Room
383
Thu, 1:55 PM to 3:25 PM
Multipaper
Evaluation to Promote Collective and Individual Learning: Applications in the Human Services
418
Thu, 3:35 PM to 5:05 PM
Multipaper
Current Approaches to Evaluating Programs for Children, Youth and Parents
453
Thu, 5:15 PM to 6:00 PM
Business Meeting
Human Services Evaluation TIG Business Meeting
528
Fri, 9:25 AM to 10:10 AM
Multipaper
Promising Approaches to the Evaluation of Social Policy
Royal Board Room
532
Fri, 9:25 AM to 10:10 AM
Multipaper
Challenges and Prospects in the Evaluation of Housing Programs
International Room
560
Fri, 10:20 AM to 11:05 AM
Multipaper
Assessing Appropriate Outcomes: Measurement Issues in Human Services Evaluation
Royal Board Room
564
Fri, 10:20 AM to 11:05 AM
Multipaper
Innovative Techniques to Assess Learning in Child Welfare Workers' Training
International Room
596
Fri, 11:15 AM to 12:00 PM
Demonstration
Improving Payment Accuracy in the Child Care Program: Error Rate Measurement in the Child Care and Development Fund International Room
656
Fri, 3:35 PM to 4:20 PM
Multipaper
Learning Through Applied Research in Social Service Contexts
International Room
686
Fri, 4:30 PM to 6:00 PM
MultiPaper
Measuring Fidelity and Assessing Impact of Service Interventions in Ohio's Title IV-E Waiver Evaluation
International Room
710
Sat, 9:35 AM to 10:20 AM
MultiPaper
Retention in a Longitudinal Outcomes Study: Exploring Two Sides of the Same Coin, Who Asks and Who Answers
745
Sat, 10:30 AM to 12:00 PM
Skill-building
Using a Protective Factor Framework to Measure Program Outcomes and Build Capacity in Community-based Family…
848
Sat, 3:30 PM to 5:00 PM
Skill-building
Outcomes Measurement in Human Services Evaluation: An Introduction
Index of Sessions for the Independent Consulting TIG
#
Time
Session Type
Session Title
Room Name
102
Wed, 4:30 PM to 6:00 PM
Think Tank
Intermediate Consulting Skills: A Self-Help Fair
325
Thu, 9:35 AM to 11:05 AM
Panel
An Overview of Proven Customer Service Practices for Independent Evaluation Consultants
360
Thu, 11:15 AM to 12:45 PM
Demonstration
Evaluation Contracts: Considerations, Clauses, and Concerns
481
Thu, 6:10 PM to 7:00 PM
Business Meeting
Independent Consulting TIG Business Meeting
600
Fri, 1:55 PM to 3:25 PM
MultiPaper
Eyes Wide Open: Learning to Spot Ethical Quandaries in Evaluation Practice
668
Fri, 4:30 PM to 6:00 PM
Skill-building
Peer Reviews for Independent Consultants: New Peer Reviewer Orientation
Peale Room
807
Sat, 1:50 PM to 3:20 PM
Panel
Learning How to Start and Succeed as an Independent Evaluation Consultant
841
Sat, 3:30 PM to 5:00 PM
Panel
Still Learning, After All These Years
Page 203
Index of Sessions for the Indigenous Peoples in Evaluation TIG
#
Time
Session Type
Session Title
Room Name
116
Wed, 4:30 PM to 6:00 PM
Panel
Providing Meaningful Evaluations for Prevention Projects in Indigenous Communities
McKeldon Room
356
Thu, 11:15 AM to 12:45 PM
Think Tank
Reflections and Recommendations Concerning Culturally Competent Evaluation
McKeldon Room
392
Thu, 1:55 PM to 3:25 PM
Multipaper
Indigenizing Approaches to Evaluation in American Indian, First Nations, and Native Hawaiian Communities
McKeldon Room
427
Thu, 3:35 PM to 5:05 PM
Business Meeting
Indigenous Peoples in Evaluation TIG Business Meeting
McKeldon Room
587
Fri, 11:15 AM to 12:00 PM
Expert Lecture
Using Technology to Enhance Aboriginal Evaluations
McKeldon Room
620
Fri, 1:55 PM to 3:25 PM
Panel
Partnering With and Learning From Indigenous Peoples
McKeldon Room
747
Sat, 10:30 AM to 12:00 PM
Panel
Participatory Evaluation Approaches With Latino and Indigenous Populations
Hopkins Room
782
Sat, 12:10 PM to 1:40 PM
Panel
The Illogic of Privileging Western Mainstream Ways of Knowing and Eval Practice in Indigenous and Other Non-western…
Hopkins Room
Index of Sessions for the Integrating Technology Into Evaluation
#
Time
Session Type
Session Title
Room Name
314
Thu, 9:35 AM to 11:05 AM
Demonstration
There's More Than One Way to Skin a Cat: Cost Effective Online Surveying and Evaluation
Hopkins Room
349
Thu, 11:15 AM to 12:45 PM
Panel
Exchange Outcome Assessment Linkage System (E-GOALS): A US Dept of State Web-Based Approach to Assessing…
Hopkins Room
385
Thu, 1:55 PM to 3:25 PM
Multipaper
Technological Tools That Build Evaluation Capacity: The Power of Blogs, Clickers and Web-based Customized Reports
Hopkins Room
483
Thu, 6:10 PM to 7:00 PM
Business Meeting
Integrating Technology Into Evaluation TIG Business Meeting and Presentation: Data-mining for Academic Success
Hopkins Room
555
Fri, 10:20 AM to 11:05 AM
Demonstration
Making Data Accessible to Organizations, Communities, and the General Public: Designing an Interactive Graphing…
McKeldon Room
647
Fri, 3:35 PM to 4:20 PM
Multipaper
GIS and QDAS: Technological Tools That Reveal Multiple Perspectives and Unique Data Associations
McKeldon Room
719
Sat, 9:35 AM to 10:20 AM
Demonstration
Online Evaluation Systems: One-stop Shops for Administrators, Managers, and Evaluators?
McKeldon Room
754
Sat, 10:30 AM to 12:00 PM
Demonstration
Workgroup Solutions for Data Collection, Storage, Analysis, and Reporting With FileMaker Pro 8.5, Adobe 8, MS Excel
McKeldon Room
Page 204
Index of Sessions for the International and Cross-cultural Evaluation TIG
#
Time
Session Type
Session Title
Room Name
106
110
315
350
351
386
417
421
456
549
581
591
606
614
674
703
736
748
771
783
805
817
839
851
Wed, 4:30 PM to 6:00 PM
Wed, 4:30 PM to 6:00 PM
Thu, 9:35 AM to 11:05 AM
Thu, 11:15 AM to 12:45 PM
Thu, 11:15 AM to 12:45 PM
Thu, 1:55 PM to 3:25 PM
Thu, 3:35 PM to 5:05 PM
Thu, 3:35 PM to 5:05 PM
Thu, 5:15 PM to 6:00 PM
Fri, 10:20 AM to 11:05 AM
Fri, 11:15 AM to 12:00 PM
Fri, 11:15 AM to 12:00 PM
Fri, 1:55 PM to 3:25 PM
Fri, 1:55 PM to 3:25 PM
Fri, 4:30 PM to 6:00 PM
Sat, 9:35 AM to 10:20 AM
Sat, 10:30 AM to 12:00 PM
Sat, 10:30 AM to 12:00 PM
Sat, 12:10 PM to 1:40 PM
Sat, 12:10 PM to 1:40 PM
Sat, 1:50 PM to 3:20 PM
Sat, 1:50 PM to 3:20 PM
Sat, 3:30 PM to 5:00 PM
Sat, 3:30 PM to 5:00 PM
Think Tank
Multipaper
Multipaper
Panel
MultiPaper
Debate
Multipaper
Panel
Multipaper
Expert Lecture
Expert Lecture
Roundtable
Multipaper
MultiPaper
Business Meeting
Panel
Panel
Panel
Panel
Skill-building
Panel
MultiPaper
Panel
Panel
International Development Evaluation: Opportunities and Challenges for the Use of the DAC Criteria
Evaluation of Multi-Country Teacher Training Programs and Curriculum Policies
Evaluation of Various Educational Programs in Different Countries of the Globe
Building a Framework for Public Diplomacy Evaluations: Lessons Learned and Best Practices in Public Diplomacy Eval
Macro-level and Micro-level Methodologies for Evaluating Education System Functioning in Afghanistan
Learning From Each “Other”: Should The Cultural Characteristics of the Evaluator Match the Cultural Characteristics…
Evaluation: A Tool for Planning, Implementation, and Organizational Development
Lessons From the Field: Zambian Case Study
Learning Through Evaluation: Brazilian and Other International Development Experiences
Applicability and Evaluation of Model of Global Baseline Survey Adapted for Use in Bangladesh, Bolivia and Tanzania
M&E in Sector-wide Approach (SWAps): A New Way of Thinking of M&E in the New International Development Framework
Measuring Success in Professional Exchange: International Visitor Leadership Program
Evaluation of Educational Outcomes: Experience of Jordan
International and Cross-Cultural TIG Business Meeting
What Have We Learned About Evaluation Principles and Practice in International Non-governmental Organizations?
Lessons for Methodology and Fieldwork in International Development Evaluations: The Heifer International Impact Evals…
Incorporating Development Evaluation Strategies in Education Reform Projects: Opportunities and Challenges
Building Communities in the Context of Transitional Countries: Challenges and Approaches for Program Evaluation
Fun and Games With Logframes
International Efforts to Strengthen Evaluation as a Profession and Build Evaluation Capacity
Does Aid Evaluation Work?: Reducing World Poverty by Improving Learning, Accountability and Harmonization inAid Eval
Promoting Organizational Learning to Increase International Development Effectiveness: Examples…
Evaluating Educational Programs in the Department of State's Bureau of Educational and Cultural Affairs…
Peale Room
Peale Room
Peale Room
Adams Room
Peale Room
Peale Room
Peale Room
Peale Room
Peale Room
Federal Hill Suite
Peale Room
McKeldon Room
Peale Room
Peale Room
Peale Room
Peale Room
Index of Sessions for the Lesbian, Gay, Bisexual, Transgender Issues TIG
#
Time
Session Type
Session Title
Room Name
400
470
520
556
588
621
Thu, 1:55 PM to 3:25 PM
Thu, 5:15 PM to 6:00 PM
Fri, 9:25 AM to 10:10 AM
Fri, 10:20 AM to 11:05 AM
Fri, 11:15 AM to 12:00 PM
Fri, 1:55 PM to 3:25 PM
Business Meeting
Panel
Multipaper
Think Tank
Multipaper
Multipaper
TIG Business Meeting and Think Tank: Lesbian, Gay, Bisexual, Transgender and Intersex Issues and Queer Theory…
Measuring Sexuality and Gender: Accurately Capturing Dimensions and Categories of Sexuality
Emerging Perspectives on Curriculum, Pedagogy, and Lesbian, Gay, Bisexual, and Transgender Youth
Straight Talk: Threats to Validity Caused by Heteronormative Bias in Opinion Polls
Educating Educators to Support Lesbian, Gay, Bisexual, and Transgender Students: Documenting Needs,
Royal Board Room
Royal Board Room
Preston Room
Preston Room
Preston Room
Preston Room
Page 205
Index of Sessions for the Multiethnic Issues in Evaluation TIG
#
Time
Session Type
Session Title
Room Name
125
Wed, 4:30 PM to 6:00 PM
Panel
Practicing Culturally-Based Evaluation: Learnings From the Field
302
Thu, 9:35 AM to 11:05 AM
Panel
Understanding Culturally and Contextually Responsive Evaluation Through the Experiences of a Multi-year …
337
Thu, 11:15 AM to 12:45 PM
MultiPaper
Practicing What we Preach: Exploring the Transformative Potential of Evaluation Processes
480
Thu, 6:10 PM to 7:00 PM
Business Meeting
Multiethnic Issues in Evaluation TIG Business Meeting
517
Fri, 9:25 AM to 10:10 AM
Think Tank
Multiethnic Issues Dialogue on Graduate Education and Mentoring
D'Alesandro Room
580
606
613
Fri, 11:15 AM to 12:00 PM
Fri, 1:55 PM to 3:25 PM
Fri, 1:55 PM to 3:25 PM
MultiPaper
Multipaper
Panel
Building Evaluation Capacity at the Society for Advancement of Chicanos and Native Americans in Science
Culturally Responsive Evaluation Training for Students of Color: From Classroom to Fieldwork and Back
Hopkins Room
Hopkins Room
622
Fri, 1:55 PM to 3:25 PM
Multipaper
Schaefer Room
789
Sat, 12:10 PM to 1:40 PM
Panel
McKeldon Room
823
Sat, 1:50 PM to 3:20 PM
Multipaper
Cultural Isses in Multiethnic Evaluation
McKeldon Room
824
Sat, 1:50 PM to 3:20 PM
Think Tank
Preston Room
857
Sat, 3:30 PM to 5:00 PM
Multipaper
Multicultural Evaluation: Issues in Health and Education Settings
McKeldon Room
Index of Sessions for the Needs Assessment TIG
#
Time
Session Type
Session Title
Room Name
369
Thu, 11:15 AM to 12:45 PM
Panel
Mainstreaming and Supporting Needs Assessment in a Large Organization
Chesapeake Room
638
Fri, 3:35 PM to 4:20 PM
Business Meeting
Needs Assessment TIG Business Meeting
718
Sat, 9:35 AM to 10:20 AM
Multipaper
Contextuality in Needs Assessment: Attention to Divergent Needs
Calhoun Room
837
Sat, 3:30 PM to 5:00 PM
Think Tank
Page 206
Index of Sessions for the Non-profit and Foundations Evaluation TIG
#
Time
Session Type
Session Title
Room Name
109
Wed, 4:30 PM to 6:00 PM
Think Tank
Hopkins Room
114
Wed, 4:30 PM to 6:00 PM
MultiPaper
When Leadership Moves From I to We: Evaluating Collective Leadership Development Efforts
D'Alesandro Room
319
Thu, 9:35 AM to 11:05 AM
Panel
Evaluating Volunteering in Low-income Communities: A Participatory Approach
D'Alesandro Room
320
Thu, 9:35 AM to 11:05 AM
Demonstration
Introduction to You Get What You Measure ™
Calhoun Room
354
Thu, 11:15 AM to 12:45 PM
MultiPaper
The Contribution of Evaluation to Building the Capacity of Indigenous, Not for Profit Organizations in New Zealand…
D'Alesandro Room
355
Thu, 11:15 AM to 12:45 PM
Panel
Evaluation Reports: Reframing the Concept for the Real World
Calhoun Room
390
Thu, 1:55 PM to 3:25 PM
Multipaper
Learning From Each Other: Cross-cutting Issues and Opportunities
D'Alesandro Room
425
Thu, 3:35 PM to 5:05 PM
Multipaper
Learning From Organizational Level Evaluations
D'Alesandro Room
460
Thu, 5:15 PM to 6:00 PM
Demonstration
Tools and Frameworks for Evaluating Social Change Philanthropy: A Case Study of an Eval of Responses by Women's…
D'Alesandro Room
484
Thu, 6:10 PM to 7:00 PM
Business Meeting
Non-profits and Foundations Evaluation TIG Business Meeting
Peale Room
553
Fri, 10:20 AM to 11:05 AM
Expert Lecture
Using Democratic Eval Principles to Foster Citizen Engagement and Strengthen Neighborhoods in a Place-based Poverty … D'Alesandro Room
574
Fri, 11:15 AM to 12:00 PM
Panel
Strategies for Building and Evaluating Organizational Capacity: A Case Study of 30 Children's Residential Homes…
Mencken Room
610
Fri, 1:55 PM to 3:25 PM
Panel
When Funders, Evaluators and Service Providers Work Together a Good Idea Gets Better
611
Fri, 1:55 PM to 3:25 PM
Panel
Engaging Communities in Sustainable Systemic Change: A Five Year Analysis of the W K Kellogg's Leadership…
664
Fri, 4:30 PM to 6:00 PM
Panel
Making Sense of Mobility: Household Survey Data From Comprehensive Comm Initiatives, Implications for Eval and Theory Pratt Room, Section A
665
Fri, 4:30 PM to 6:00 PM
Panel
Success Measures: Learning From Community Development Results Through Participation, Common Tools, Shared Data
704
Sat, 9:35 AM to 10:20 AM
Demonstration
Stakeholder Identification and Assessment in Nonprofit Organizations and Public Agencies
717
Sat, 9:35 AM to 10:20 AM
Demonstration
Tying it Together: Developing a Web-based Data Collection System for a Multi-site Tobacco Initiative
D'Alesandro Room
739
Sat, 10:30 AM to 12:00 PM
MultiPaper
Exploring Evaluation Expectations for Nonprofits, Foundations and Government: A Preview of an Upcoming NDE Volume
752
Sat, 10:30 AM to 12:00 PM
Multipaper
Evaluation Approaches that Support Nonprofit and Foundation Learning
D'Alesandro Room
774
Sat, 12:10 PM to 1:40 PM
Demonstration
Community of Learners in Evaluation: The Triple Threat
787
Sat, 12:10 PM to 1:40 PM
Panel
Multiple Levels of Evaluation: Organizational Learning in a Foundation-Supported Initiative
D'Alesandro Room
808
Sat, 1:50 PM to 3:20 PM
Panel
Examining the Form and Function of Evaluation in Philanthropy
821
Sat, 1:50 PM to 3:20 PM
Panel
Put That in Writing: Communicating Evaluation Results in a Way That Promotes Learning and Use
D'Alesandro Room
842
Sat, 3:30 PM to 5:00 PM
Panel
Evaluation and Social Metrics in the Nonprofit Sector
855
Sat, 3:30 PM to 5:00 PM
Think Tank
Does Quality Improvement Lead to Organizational Learning?
D'Alesandro Room
Page 207
Index of Sessions for the Organizational Learning and Evaluation Capacity Building TIG
#
Time
Session Type
Session Title
Room Name
109
Wed, 4:30 PM to 6:00 PM
Think Tank
Hopkins Room
117
Wed, 4:30 PM to 6:00 PM
Panel
Evaluation of Organizations as Enterprises: Approaches, Appropriate Outcome Expectations, and Potential Indicators
Preston Room
306
Thu, 9:35 AM to 11:05 AM
Multipaper
What Theory and Research Tell Us About Evaluation Capacity Building
322
Thu, 9:35 AM to 11:05 AM
Think Tank
What Have We Learned From/What Do We Still Need to Learn About Developing Evaluation Organizations?
Preston Room
341
Thu, 11:15 AM to 12:45 PM
Think Tank
Evaluation Capacity Building Unplugged
357
Thu, 11:15 AM to 12:45 PM
Panel
Reflective Inquiry Into Learning Through Evaluation Practice
Preston Room
377
Thu, 1:55 PM to 3:25 PM
Business Meeting
TIG Business Meeting and Presentation: Learning and Meaning in Organizations: How Evaluation Stops the DRIP
428
Thu, 3:35 PM to 5:05 PM
MultiPaper
Simultaneous Learning: Four Perspectives From a University-based Evaluation Center
Preston Room
431
Thu, 3:35 PM to 5:05 PM
Think Tank
Challenges and Issues: What Do We Know About the Role of Eval in Organizational Learning? Where Do We Go From Here? Calvert Ballroom Salon C
463
Thu, 5:15 PM to 6:00 PM
Multipaper
Internal Evaluation Capacity Building Through Critical Friends and Communities of Practice
Preston Room
589
Fri, 11:15 AM to 12:00 PM
Expert Lecture
Schaefer Room
606
Fri, 1:55 PM to 3:25 PM
Multipaper
622
Fri, 1:55 PM to 3:25 PM
Multipaper
Schaefer Room
649
Fri, 3:35 PM to 4:20 PM
Expert Lecture
Schaefer Room
659
Fri, 4:30 PM to 6:00 PM
Panel
Evaluation as a Learning Tool: Maximizing Outcomes Using Strategic Formative Evaluation
667
Fri, 4:30 PM to 6:00 PM
Panel
Building Capacity for Evaluation: A Tale of Four National Youth Development Organizations
Hopkins Room
676
Fri, 4:30 PM to 6:00 PM
Panel
Deliverables as a Tool to Promote and Support Organizational Learning: Client-centered Strategies for Data Collection…
Schaefer Room
720
Sat, 9:35 AM to 10:20 AM
Panel
Assessing Strategic Alignment of Learning in Organizations Where Profits are Not the Bottom Line
Preston Room
721
Sat, 9:35 AM to 10:20 AM
Multipaper
Schaefer Room
755
Sat, 10:30 AM to 12:00 PM
MultiPaper
Strategic Approach to Developing Sustainable Infrastructure for Program Eval in an Organization: Multiple Perspectives
Preston Room
756
769
824
Sat, 10:30 AM to 12:00 PM
Sat, 12:10 PM to 1:40 PM
Sat, 1:50 PM to 3:20 PM
Demonstration
Think Tank
Think Tank
Applying a Participatory Approach to Evaluation Capacity Building
Schaefer Room
Preston Room
825
Sat, 1:50 PM to 3:20 PM
Demonstration
Building Organizational Capacity for Self-evaluation
Schaefer Room
858
Sat, 3:30 PM to 5:00 PM
Skill-building
Using Appreciative Inquiry to Facilitate Change in Organizational Practice
Preston Room
859
Sat, 3:30 PM to 5:00 PM
Demonstration
Using Baseline Assessment to Build Eval Capacity and Foster Organizational Learning as Part of a Transformative…
Schaefer Room
Page 208
Index of Sessions for the Pre-K - 12 Educational Evaluation TIG
#
Time
Session Type
Session Title
Room Name
122
123
327
328
362
363
373
398
399
408
433
434
443
526
558
588
590
623
625
649
650
680
682
702
721
725
735
760
770
795
796
804
829
Wed, 4:30 PM to 6:00 PM
Wed, 4:30 PM to 6:00 PM
Thu, 9:35 AM to 11:05 AM
Thu, 9:35 AM to 11:05 AM
Thu, 11:15 AM to 12:45 PM
Thu, 11:15 AM to 12:45 PM
Thu, 1:55 PM to 3:25 PM
Thu, 1:55 PM to 3:25 PM
Thu, 1:55 PM to 3:25 PM
Thu, 3:35 PM to 5:05 PM
Thu, 3:35 PM to 5:05 PM
Thu, 3:35 PM to 5:05 PM
Thu, 5:15 PM to 6:00 PM
Fri, 9:25 AM to 10:10 AM
Fri, 10:20 AM to 11:05 AM
Fri, 11:15 AM to 12:00 PM
Fri, 11:15 AM to 12:00 PM
Fri, 1:55 PM to 3:25 PM
Fri, 1:55 PM to 3:25 PM
Fri, 3:35 PM to 4:20 PM
Fri, 3:35 PM to 4:20 PM
Fri, 4:30 PM to 6:00 PM
Fri, 4:30 PM to 6:00 PM
Sat, 9:35 AM to 10:20 AM
Sat, 9:35 AM to 10:20 AM
Sat, 9:35 AM to 10:20 AM
Sat, 10:30 AM to 12:00 PM
Sat, 10:30 AM to 12:00 PM
Sat, 12:10 PM to 1:40 PM
Sat, 12:10 PM to 1:40 PM
Sat, 12:10 PM to 1:40 PM
Sat, 1:50 PM to 3:20 PM
Sat, 1:50 PM to 3:20 PM
Panel
Panel
Panel
Panel
Multipaper
Multipaper
MultiPaper
Panel
MultiPaper
Multipaper
Panel
Multipaper
Business Meeting
Multipaper
Expert Lecture
Multipaper
Multipaper
Think Tank
Multipaper
Expert Lecture
Multipaper
Multipaper
Multipaper
MultiPaper
Multipaper
Think Tank
MultiPaper
MultiPaper
MultiPaper
Panel
Multipaper
Panel
Think Tank
When Does Evaluation Not Feel Like Evaluation? Embedding Evaluation Activities Into Programs
Evaluating the Reading First Program: Best Practices and Lessons Learned
Integrating Research-based Information into the Educational Practices of School Workers: What We've Learned…
Supporting Partnerships to Assure Ready Kids (SPARK): Cultural Connections to Ready Schools, Native Hawaiians…
Evaluating Teacher Professional Development
Evaluating Schools and Processes Within Schools
Distributed Leadership & Social Network Analysis in K-12 Education
Weaving Collaborative Learning Principles into a Multi-dimensional Evaluation of an Early Learning Partnership
Using Mixed Methods to Evaluate the NC Disadvantage Student Supplement Fund on Academically Disadvantaged…
Accountability, Federal Programs, and No Child Left Behind
Professional Communities of Inquiry
Educational Evaluation Internationally
PreK-12 Educational Evaluation TIG Business Meeting
Teacher Evaluation
Measuring Follow-up Support: How Critical are Those Field Consultants?
Issues in Early Childhood and Preschool Evaluation
How Should We Measure Child Outcomes in Early Childhood Evaluations and Accountability Efforts?
Evaluation in Non-traditional and Informal Learning Contexts
Magnet School Evaluation Issues
Evaluations of Reading and Literacy Programs
Issues in Doing Randomized Trials in Educational Evaluation
Evaluation in the Context of High Stakes Assessments
Linking Smaller Learning Communities to Student Achievement and Related Outcomes Measures
Documenting Math Science Partnership Projects in New York State
The Challenges and Opportunities of Evaluating Mathematics and Science Partnership (MSP) Projects…
Assessment Issues in Education
Evaluation in Education: Promises, Challenges, Booby Traps and Some Empirical Data
Articulating Authentic and Rigorous Science Education Evaluation Through the Inquiry Science Instruction Observation…
Fairmount Suite
Federal Hill Suite
Fairmount Suite
Federal Hill Suite
Fairmount Suite
Federal Hill Suite
Fairmount Suite
Federal Hill Suite
Fairmount Suite
Federal Hill Suite
Fairmount Suite
Fairmount Suite
Preston Room
Fairmount Suite
Fairmount Suite
Royal Board Room
Schaefer Room
Fairmount Suite
Fairmount Suite
Royal Board Room
Schaefer Room
Fairmount Suite
Fairmount Suite
Fairmount Suite
Federal Hill Suite
Fairmount Suite
830
Sat, 1:50 PM to 3:20 PM
Panel
Summer School Ain't So Bad, But Evaluating It Can Be: Lessons Learned From Outcome Evaluations of Summer Programs Federal Hill Suite
838
Sat, 3:30 PM to 5:00 PM
Multipaper
Applications Quasi-Experimental Evaluation Techniques
863
Sat, 3:30 PM to 5:00 PM
Multipaper
Math and Science Evaluation
Fairmount Suite
864
Sat, 3:30 PM to 5:00 PM
Multipaper
Evaluating After School, Supplemental Services, and Out of School Programs
Federal Hill Suite
Index of Sessions for the Program Theory and Theory-driven Evaluation TIG
#
Time
Session Type
Session Title
Room Name
448
Thu, 5:15 PM to 6:00 PM
Expert Lecture
A Practitioner's Guide to Program Theory-driven Evaluation
501
Fri, 9:25 AM to 10:10 AM
Multipaper
Understanding the Link Between Research and Practice
535
Fri, 10:20 AM to 11:05 AM
Demonstration
The Power of Self in Systems: Organizational Learning From Self-Determination Theory-driven Evaluations
605
Fri, 1:55 PM to 3:25 PM
Multipaper
The Use of Theoretical Models and Perspectives to Inform Evaluations
633
Fri, 3:35 PM to 4:20 PM
Business Meeting(p)
TIG Business Meeting and Panel: The Use of Evaluation to Promote Learning: A Theory Based Perspective
712
Sat, 9:35 AM to 10:20 AM
Multipaper
The Theory Based Models as a Guide to Stakeholder Collaboration, Ownership, and Engagement
Hopkins Room
Index of Sessions for the Qualitative Methods TIG
#
Time
Session Type
Session Title
Room Name
303
Thu, 9:35 AM to 11:05 AM
Panel
Accountability, Democracy and Representation in the Global Evaluation Context
338
Thu, 11:15 AM to 12:45 PM
Multipaper
Incorporating Technological Innovations in Data Collection
420
Thu, 3:35 PM to 5:05 PM
Multipaper
Capturing Theoretical Underpinnings of Programs Through Qualitative Inquiry
Hopkins Room
455
Thu, 5:15 PM to 6:00 PM
Business Meeting
Qualitative Methods TIG Business Meeting
Hopkins Room
512
Fri, 9:25 AM to 10:10 AM
Expert Lecture
Moral Knowledge and Responsibilities in Evaluating Programs for Youth
Hopkins Room
533
Fri, 9:25 AM to 10:10 AM
Multipaper
Engaging Stakeholders in the Evaluation Process
Chesapeake Room
565
Fri, 10:20 AM to 11:05 AM
Demonstration
Using NVIVO 7 in Conducting Evaluation Research
Chesapeake Room
640
Fri, 3:35 PM to 4:20 PM
MultiPaper
Emerging Practitioners in an Emerging Subfield: Vexing Issues, Opportunities and Lessons Learned
Hopkins Room
708
Sat, 9:35 AM to 10:20 AM
Demonstration
Story Bank: Learning through Story-telling
Carroll Room
743
Sat, 10:30 AM to 12:00 PM
Multipaper
Navigating Subjectivity in the Evaluation Process
Carroll Room
778
Sat, 12:10 PM to 1:40 PM
Multipaper
Qualitative Analyses of Education Reform Efforts
Carroll Room
Page 210
Index of Sessions for the Quantitative Methods: Theory and Design TIG
#
Time
Session Type
Session Title
Room Name
115
127
128
301
332
367
391
403
404
426
438
439
473
474
518
554
585
586
618
619
629
645
646
672
673
730
731
753
766
788
Wed, 4:30 PM to 6:00 PM
Wed, 4:30 PM to 6:00 PM
Wed, 4:30 PM to 6:00 PM
Thu, 9:35 AM to 11:05 AM
Thu, 9:35 AM to 11:05 AM
Thu, 11:15 AM to 12:45 PM
Thu, 1:55 PM to 3:25 PM
Thu, 1:55 PM to 3:25 PM
Thu, 1:55 PM to 3:25 PM
Thu, 3:35 PM to 5:05 PM
Thu, 3:35 PM to 5:05 PM
Thu, 3:35 PM to 5:05 PM
Thu, 5:15 PM to 6:00 PM
Thu, 5:15 PM to 6:00 PM
Fri, 9:25 AM to 10:10 AM
Fri, 10:20 AM to 11:05 AM
Fri, 11:15 AM to 12:00 PM
Fri, 11:15 AM to 12:00 PM
Fri, 1:55 PM to 3:25 PM
Fri, 1:55 PM to 3:25 PM
Fri, 1:55 PM to 3:25 PM
Fri, 3:35 PM to 4:20 PM
Fri, 3:35 PM to 4:20 PM
Fri, 4:30 PM to 6:00 PM
Fri, 4:30 PM to 6:00 PM
Sat, 9:35 AM to 10:20 AM
Sat, 9:35 AM to 10:20 AM
Sat, 10:30 AM to 12:00 PM
Sat, 10:30 AM to 12:00 PM
Sat, 12:10 PM to 1:40 PM
Multipaper
Multipaper
Panel
Panel
Demonstration
Business Meeting
Multipaper
MultiPaper
MultiPaper
Demonstration
Multipaper
Panel
Expert Lecture
Demonstration
Demonstration
Demonstration
Demonstration
Demonstration
Panel
Skill-building
MultiPaper
Demonstration
Demonstration
Multipaper
Multipaper
Demonstration
Expert Lecture
Panel
Multipaper
Multipaper
Learning From Alternative Models of Evaluation
Assessing Randomized Control Trials and Alternatives
Crime, Violence and IRT/Rasch Measurement
A Gentle Introduction to Resampling Techniques
Quantitative Methods: Theory and Design TIG Business Meeting and Presentation - Theory Soup for the Quantitative Soul
Innovative Approaches to Impact Assessments
Measurement to Improve Precision and Validity of Evaluation Outcomes
Patient Preferences for Treatment: Correlates and Impact
Utilizing Hierarchical Linear Modeling in Evaluation: Concepts and Applications
Advancing Valid Measurement in Evaluation
Learning From Experience With Random Assignment Experiments: Lessons From Social Security Benefit-Offset Pilot…
Increasing Evaluation Capacity: Learning From Social Network Analysis, A Review in Evaluation
Regression Discontinuity Design: Lessons Learned From a Real World Application
Understanding Terminology in Multi-level Modeling for Program Evaluation
A Method to Measure and Numerically Demonstrate the Effectiveness of a University's Planning and Evaluation Processes
Implementing Process Evaluation in a Dispersed State Program
Using Multilevel Discrete-time Survival Models to Predict Whether and When Events Occur
Variance Explained and Explaining Variance: An Overview of Variance in General, in the General Linear Model…
Treating Data According to Purpose: Frequentist Versus Bayesian Analyses
Alternative Approaches to Assessing Outcomes in Health Services Research
Why be Normal? Nonparametric Data Analysis Methods as an Important Tool to Analyze and Draw Conclusions…
Applications of Geographic Information Systems in Local and Statewide Evaluation
Conducting Multi-method Evaluations
Applications of Multilevel Longitudinal Analysis
Increasing the Value of Items on a Measure: A Practitioner's Guide to Item Response Theory Analysis
Summative Confidence: How Accurate are Your Evaluative Conclusions?
Concept Maps, Focus Groups and Rasch Analysis: Converting the Ineffable Qualitative into Quantitative
Issues in Measuring Reliability and Retention
Longitudinal/Growth Curve Analysis of Program Impacts
Calhoun Room
Baltimore Theater
International Room
Baltimore Theater
Baltimore Theater
Calhoun Room
Baltimore Theater
International Room
Calhoun Room
Baltimore Theater
International Room
Baltimore Theater
International Room
Calhoun Room
Calhoun Room
D'Alesandro Room
Calhoun Room
D'Alesandro Room
Calhoun Room
International Room
D'Alesandro Room
Calhoun Room
D'Alesandro Room
Calhoun Room
Baltimore Theater
International Room
Calhoun Room
International Room
Calhoun Room
800
801
809
822
834
Sat, 12:10 PM to 1:40 PM
Sat, 12:10 PM to 1:40 PM
Sat, 1:50 PM to 3:20 PM
Sat, 1:50 PM to 3:20 PM
Sat, 1:50 PM to 3:20 PM
Panel
Panel
Panel
Panel
Panel
Is There Anything Left to Say About Logic Models?
Place Randomized Trials: Design, Implementation and First Results From Evaluating Ambulatory Psychotherapy
Of Mice and Men: How to Conduct a Random Assignment Study
Advances and Applications in Using Propensity Scores to Reduce Selection Bias in Quasi-Experiments
Baltimore Theater
International Room
Calhoun Room
Baltimore Theater
Page 211
Index of Sessions for the Quantitative Methods: Theory and Design TIG, Continued
#
Time
Session Type
Session Title
Room Name
835
856
868
869
Sat, 1:50 PM to 3:20 PM
Sat, 3:30 PM to 5:00 PM
Sat, 3:30 PM to 5:00 PM
Sat, 3:30 PM to 5:00 PM
Panel
Panel
Demonstration
Demonstration
Unintended Interventions
Cross-validation of Empirical Findings From Evaluations
Missing Data: Its Not Just for Statisticians Anymore
Application of Computerized Adaptive Testing in Clinical Assessment
International Room
Calhoun Room
Baltimore Theater
International Room
Index of Sessions for the Research, Technology, and Development Evaluation TIG
#
Time
Session Type
Session Title
Room Name
124
329
364
376
411
435
446
508
544
592
637
652
727
762
797
813
831
847
865
Wed, 4:30 PM to 6:00 PM
Thu, 9:35 AM to 11:05 AM
Thu, 11:15 AM to 12:45 PM
Thu, 1:55 PM to 3:25 PM
Thu, 3:35 PM to 5:05 PM
Thu, 3:35 PM to 5:05 PM
Thu, 5:15 PM to 6:00 PM
Fri, 9:25 AM to 10:10 AM
Fri, 10:20 AM to 11:05 AM
Fri, 11:15 AM to 12:00 PM
Fri, 3:35 PM to 4:20 PM
Fri, 3:35 PM to 4:20 PM
Sat, 9:35 AM to 10:20 AM
Sat, 10:30 AM to 12:00 PM
Sat, 12:10 PM to 1:40 PM
Sat, 1:50 PM to 3:20 PM
Sat, 1:50 PM to 3:20 PM
Sat, 3:30 PM to 5:00 PM
Sat, 3:30 PM to 5:00 PM
Multipaper
Multipaper
Multipaper
MultiPaper
Panel
Think Tank
Business Meeting
Panel
MultiPaper
Multipaper
Multipaper
Demonstration
Panel
Panel
Panel
MultiPaper
Panel
MultiPaper
Expert Lecture
Closing the Loop: Mapping Value to Inform Research Management
Hard Cases: Measuring and Facilitating Interdisciplinarity and Inter-Organizational Interactions
Research Evaluation of the Upcoming Europeans Union’s Framework Programme
Looking Inside the Research Center Black Box: Using Eval Research to Promote Organizational Effectiveness of Scientific…
Tools for Useful Performance Assessment of Science and Technology Programs: An Example
Identifying Challenges to Using Evaluation to Inform Program Management and Public Policy
Research, Technology, and Development Evaluation TIG Business Meeting
Evaluation of Community-based Participatory Research and Community Mobilization Strategies to Prevent Chronic…
Strategic Evaluation in a Public Research Institute to Contribute to Innovation
Peer Review and Learning: New Uses
Ex Ante Evaluation: Methods for Estimating Innovation and Other Research Outcomes
A Directory of Evaluation Methods for Managers of Public Research and Technology Programs
Evaluation as an Agent of Program Change: An Example From Austria
A Roadmap for Developing a Public Health Research Portfolio Evaluation Program
Using Logic Models to Evaluate Research and Technology Diffusion Results: Two Cases
The Follow-up Monitoring and Outcome Survey for National Research and Development Projects in NEDO
National Performance Evaluation System of Research and Development Programs in Korea: System and Applications
Centralized E-Tool for Organizational Performance Management: NIH GPRAA & PART Assessments
Royal Board Room
Royal Board Room
Royal Board Room
Royal Board Room
Carroll Room
Carroll Room
Royal Board Room
Royal Board Room
Royal Board Room
Royal Board Room
Royal Board Room
Royal Board Room
Royal Board Room
Index of Sessions for the Social Work TIG
#
Time
Session Type
Session Title
Room Name
416
479
548
709
Thu, 3:35 PM to 5:05 PM
Thu, 6:10 PM to 7:00 PM
Fri, 10:20 AM to 11:05 AM
Sat, 9:35 AM to 10:20 AM
Demonstration
Business Meeting
Expert Lecture
Multipaper
Applying Binary Logistic, Ordered and Unordered Multinomial Logistic Regression Models to Illuminate Learning…
TIG Business Meeting and Presentation: Using Evaluation as a Learning Tool Within the Social Work Curriculum…
A Collaborative Practice-based Approach to Evaluation Research
Approaches to Evaluation in Social Work Settings
Carroll Room
Carroll Room
Hopkins Room
Page 212
Index of Sessions for the Special Needs Populations TIG
#
Time
Session Type
Session Title
Room Name
462
Thu, 5:15 PM to 6:00 PM
Business Meeting
Special Needs Populations TIG Business Meeting
McKeldon Room
648
Fri, 3:35 PM to 4:20 PM
Demonstration
Evaluating an Apple When You are Among a Bunch of Bananas: Meeting Stakeholders' Needs When Everyone Has…
Preston Room
675
Fri, 4:30 PM to 6:00 PM
Panel
Evaluating Outcomes for Young Children With Disabilities: Issues at the National, State, and Local Levels
Preston Room
826
Sat, 1:50 PM to 3:20 PM
Demonstration
Comparing Apples to Apples: Applying the Rasch Measurement Framework to a Statewide Parent Survey
Index of Sessions for the Systems in Evaluation TIG
#
Time
Session Type
Session Title
Room Name
374
Thu, 1:55 PM to 3:25 PM
Panel
Evaluation From a Self-organizing Versus Predictive Systems Perspective: Examples From the Field
409
Thu, 3:35 PM to 5:05 PM
Business Meeting
Systems in Evaluation TIG Business Meeting and Think Tank: Early Steps to Next Steps: Where Are We Now?
444
Thu, 5:15 PM to 6:00 PM
Expert Lecture
Soft Systems and Success Case Method: A Perfect Marriage ?
503
Fri, 9:25 AM to 10:10 AM
Think Tank
Principles of System Change
537
Fri, 10:20 AM to 11:05 AM
Multipaper
Applications of Systems Thinking to Educational Evaluation
569
Fri, 11:15 AM to 12:00 PM
Expert Lecture
Yes, When Will We Ever Learn? How Evaluators Can Learn Better Ways to Understand Cause and Effect
634
Fri, 3:35 PM to 4:20 PM
Panel
What is Systems Thinking?
Mencken Room
706
Sat, 9:35 AM to 10:20 AM
Multipaper
Thinking About Systems Thinking
Mencken Room
741
Sat, 10:30 AM to 12:00 PM
Think Tank
Unintended Consequences of Program Action: When are They Problematic for Eval, and What Can We Do About Them?
Mencken Room
776
Sat, 12:10 PM to 1:40 PM
Skill-building
Practicing Systemic Methods for Evaluation of Food Systems
Mencken Room
810
Sat, 1:50 PM to 3:20 PM
Multipaper
Systems Methodologies for Evaluation
Mencken Room
Index of Sessions for the Teaching of Evaluation TIG
#
Time
Session Type
Session Title
Room Name
119
Wed, 4:30 PM to 6:00 PM
Panel
Evaluating the Teaching of Program Evaluation: Student and Teacher Assessments
387
Thu, 1:55 PM to 3:25 PM
Multipaper
Learning Through Practice: Developing Evaluation Knowledge Across Settings
Adams Room
422
Thu, 3:35 PM to 5:05 PM
Multipaper
Classroom Experiences and the Teaching of Evaluation
Adams Room
457
Thu, 5:15 PM to 6:00 PM
Expert Lecture
Evaluation Skills Beyond Technical Capacities
Adams Room
485
Thu, 6:10 PM to 7:00 PM
Business Meeting
Teaching of Evaluation TIG Business Meeting and Idea Exchange
Adams Room
514
Fri, 9:25 AM to 10:10 AM
Demonstration
Teaching Program Evaluation for Diverse Adult Learners Using a Nine-step Evaluation Plan Project
Adams Room
677
Fri, 4:30 PM to 6:00 PM
Skill-building
Living and Learning Evaluation: Teaching Evaluation Through Visual, Narrative and Performative Practice
780
Sat, 12:10 PM to 1:40 PM
Multipaper
Connecting Evaluation Theory and Practice via Experiential Learning
814
Sat, 1:50 PM to 3:20 PM
Skill-building
Ethics in Evaluation: At the Crossroads of Principle to Practice
852
Sat, 3:30 PM to 5:00 PM
Panel
Examining Evaluation Training, Practice and Contexts in Various Settings
Adams Room
Page 213
Index of Sessions for the Theories of Evaluation TIG
#
Time
Session Type
Session Title
Room Name
323
Thu, 9:35 AM to 11:05 AM
Multipaper
The Centrality of Learning to Evaluation Practice and Theory
Schaefer Room
378
Thu, 1:55 PM to 3:25 PM
Panel
Cost and Sustainability Checklists: Theory and Practice
413
442
505
Thu, 3:35 PM to 5:05 PM
Thu, 5:15 PM to 6:00 PM
Fri, 9:25 AM to 10:10 AM
Panel
Panel
Think Tank
Reflecting on Practice: Strategies and Lessons Learned
What Counts as Credible Evidence in Contemporary Evaluation Practice?
541
Fri, 10:20 AM to 11:05 AM
Multipaper
Empirical Research on Evaluation: Evidence-based Contributions to Evaluation Theory
573
Fri, 11:15 AM to 12:00 PM
Panel
Learning (More) About Evaluation: Unfinished Business
660
Fri, 4:30 PM to 6:00 PM
Business Meeting
Theories of Evaluation TIG Business Meeting and Presentation: Evaluation Theory: Consolidate it, Nurture it, Learn it…
705
Sat, 9:35 AM to 10:20 AM
Expert Lecture
Identifying Critical Processes and Outcomes Across Evaluation Approaches: Empowerment, Practical Participatory…
740
Sat, 10:30 AM to 12:00 PM
Multipaper
Practical Arguments, Checklists, and Meta-Evaluation: Tools for Improving Evaluation Theory and Practice
775
Sat, 12:10 PM to 1:40 PM
Panel
What is or Should be the Value-added of an Evaluator?
Page 214
Appendix C: Directory of Exhibitors
Alliance for Justice will demonstrate the new electronic version of its groundbreaking advocacy evaluation and capacity assessment
tools. Drop by to view them and possibly win a free set! The participatory tools are designed for funders or evaluators to use with
nonprofit grantees. Alliance for Justice helps foundations and grantees to strengthen their support for and engagement in advocacy
work -- including nonpartisan voter/candidate education, lobbying, ballot measure work, etc. -- as well as to pragmatically assess
nonprofits’ advocacy capacity and evaluate their advocacy work. They provide in-person and online training, easy to use legal
guides, and free technical assistance. http://www.afj.org/
The Center for Research and Evaluation on Abstinence Education was established to improve the quality of abstinence education
(AE) evaluation by building capacity to conduct scientifically-sound evaluations in the field. Funded in 2006 by the US Department
of Health and Human Services and operated by The Lewin Group, the Center will achieve this mission by fostering relationships
between AE evaluators and practitioners; developing a cadre of AE evaluators, and strengthening the connections between research
and AE practice through developing and disseminating evaluation guides; hosting webinars; and presenting at professional
conferences
Claremont Graduate University in Southern California is one of the leading providers of education and training in Evaluation and
Applied Research Methods. CGU offers one of the largest graduate programs in evaluation, with concentrations at both the MA and
PhD level. They offer a distance-based Certificate Program that stresses rigorous training and a high level of competence, and a
popular summer workshop series for professional development that is open to the public. CGU’s research institutes also perform
evaluations for private and public clientele, utilizing world-renowned faculty and an extensive network of evaluation alumni.
http://www.cgu.edu/pages/665.asp
Florida State University offers doctoral and masters degree programs in Educational Policy and Evaluation. Their program prepares
individuals for academic and policy-related careers that involve designing, developing, implementing, analyzing and evaluating
federal, state and local educational policies. Students take a core set of policy and evaluation courses along with additional
courses in the social sciences, humanities, and in advanced research methods. The department continues to build upon longstanding traditions of innovative research, well-known faculty and nationally recognized programs to provide students with some of
the best resources available. More information about FSU’s programs can be found at http://www.fsu.edu/
Gravic Inc - Remark Products Group offers software for assisting researchers and evaluators to collect and
analyze data from paper and web forms (surveys, evaluations, assessments). Use any word processor to create
and print your own plain-paper evaluations and then scan them with Remark Office OMR using an image scanner.
Or, create, host and administer online surveys using Remark Web Survey. Host your own online forms; there are
no form or respondent limitations. Use both products to combine data from paper and web evaluations. Easily generate analysis
reports and graphs with Remark Quick Stats, a built-in analysis component. Or, export data to 35+ different formats (SPSS, Excel,
ASCII, etc.). For more information visit their website http://www.gravic.com/remark
Guilford Publications is one of the premiere independent publishers in psychology and education, has expanded into the fields of
research methods (both quantitative & qualitative) and evaluation led by long-time AEA attendee and member, C. Deborah
Laughton. Come see their “hot off the press” books by AEA members, Michael Morris’ Evaluation Ethics for Best Practice and
Patrick and Katherine McKnight, Souraya Sidani’s and Aurelio Figueredo’s Missing Data. Be the first to see Holstein and Gubrium’s
just published Handbook of Constructionist Research as well as Bickel’s Multilevel Analysis for Applied Research. Guilford is an AEA
partner and offers special discounts to members! http://www.guilford.com/
Independent Data Collection Center (IDCC) is an unaffiliated, nationwide nonprofit data collection-only research organization
providing scientific, high quality, reliable and valid data collection (including bi-lingual). This includes CATI Telephone Surveys
(questionnaire formatting, sample design/development, programming, interviewer training, telephone data collection, editing,
cleaning, coding and tabulation); Focus Groups (set-up, recruited and conducted anywhere, In-Depths (30-60 minute one-on-one
interviews), and Field Interviews (intercepts, entrance-exit interviews, on-site observations/evaluations, mystery shops,
demographics, ethnography and mapping) for evaluators, principal investigators, statisticians, analysts, moderators, agency
administrators, project directors, and research consultants. Instant response to requests for quotes on their website at
http://www.independentdata.org/
Evaluation 2007: Appendix C – Directory of Exhibitors
Page 215
Appendix C: Directory of Exhibitors, Continued
Jossey-Bass, an Imprint of Wiley - For over two hundred years, John Wiley & Sons has published relevant and lively books,
periodicals, and training materials to help support professionals in their work to affect change in the communities they serve. In
addition to a growing list of book resources in evaluation and research methods, they are also the publisher of New Directions for
Evaluation, an official publication of the American Evaluation Association. http://www.josseybass.com/WileyCDA/
KnowledgeAdvisors Inc is a Human Capital Analytics firm, providing measurement systems and solutions primarily for Human
Capital and Learning and Development organizations to help them align processes with organizational objectives. Leading
organizations work with KnowledgeAdvisors Inc to measure, communicate and improve the impact of their people. Their world-class
analytics technology, Metrics that Matter®, generates evaluations, tests, assessments and surveys. Metrics that Matter integrates
with LMS and ERP systems to provide very robust reporting across an enterprise. For more, please go to
http://www.knowledgeadvisors.com/
Learning Point Associates is a nonprofit educational organization. The Afterschool Group at Learning Point Associates provides
evaluation, research, and professional services for out-of-school time programs. Evaluation work includes collecting and analyzing
national data from the 21st Century Community Learning Centers program. The evaluation team helps states develop statewide
evaluation systems that focus on process and content attributes as well as outcome measures. LPA staff conduct local evaluations
of out-of-school time programs and have been involved in research-based projects such as the South Carolina Extended Learning
Initiative. http://www.learningpt.org/page.php?pageID=5
Luther Consulting provides comprehensive evaluation support services for researchers and evaluators. These services include online
surveys, digital scanning, web-based data collection and reporting applications, as well as other traditional evaluation services.
Their web-based database application, EvaluationWeb, allows multi-site users and administrators to collect and report on almost
any type of data. This user-friendly system allows for photo upload, document upload, online customized reports, ad hoc reports,
and geographical report mapping. Overall, Luther Consulting’s unique experience with both evaluation and technology allows you to
receive the technology you need, from a company that understands research and evaluation. http://www.lutherconsulting.com/
Lyceum Books Inc since its founding in 1988, has earned a reputation for excellent in the field of social service education. Lyceum
Books is an independent publishing house with the editorial freedom to select books for the quality of their ideas, research, writing,
and their usefulness to students and practitioners. http://www.lyceumbooks.com/
Macro International has 40 years’ experience in virtually all areas of public policy and social and health
concerns. Their evaluation and performance measurement projects help ensure that policies and programs
achieve their goals and make good use of resources. Macro’s diverse pool of researchers is ready to tackle tough
questions regarding everything from the need for an initiative to its operational details and specific effects. They specialize in
health-related surveys, program and policy evaluation, program development, public education and more. We help governments
and businesses increase their impact on the world—enhancing performance and improving lives. http://www.orcmacro.com/
Mosaic Network Inc is an evaluation solutions company. They provide evaluation software and consulting to help you evaluate
community services and their impacts. Mosaic’s flagship product GEMS (Grant Evaluation and Management Solution) empowers
both the funding and the funded agencies alike in answering questions like "Is this working?" and "What should we change?".
Mosaic’s findings and tools show you where the resources are being spent, track results of all funded programs, and perform large
multi project cross agency evaluation. For more information, please call (805) 692-0992 or visit http://www.mosaic-network.com/
The National Science Foundation (NSF) is an independent United States federal agency that supports science
and engineering (S&E) research, education and evaluation through an annual budget of over $5.9 billion. NSF
funds grants and contracts to individuals, academic institutions, and for-profit and non-profit entities selected
from over 40,000 proposals received annually. About 50,000 S&E experts volunteer to serve as NSF reviewers
each year as part of the grant merit review process that selects promising proposals. Discover more about NSF online at
http://www.nsf.gov/, or by phone at 703-292-5111 ( TDD 703-292-5090 or 800-281-8749), or create a free subscription to
MyNSF at http://www.nsf.gov/mynsf
Page 216
Platform Research and Technology Policy Evaluation’s mission is to encourage more, better and more transparent evaluations for
an optimal strategic planning of RTD-policy in Austria and to develop a culture of evaluation together with relevant decision-makers.
Platform Research and Technology Policy Evaluation exchanges ideas with international experts and tries to learn from them within
the scope of its platform events and Newsletters in order to arouse growing interest among Austrian clients of evaluations and
evaluators. http://www.fteval.at/home.php?lang=en
Primescape Solution Inc, headquartered in Arlington, VA, is an award-winning provider of performance-based solutions to the
federal government since 1998. Our core competencies include Performance Measurement, System and Software Engineering; and
Intelligent Business Solutions. Our web-based, full life cycle performance evaluation/intelligent survey tools capture and report on
organizational performance metrics. Our database-driven tools maintain a library of questions for future use and allow data analysis
across surveys down to the question level. http://www.primescape.net/
Provalis Research is the leading expert in software development for mixed methods research. Its product line includes QDA Miner, a
mixed-model qualitative data analysis software, WordStat, a powerful quantitative content analysis and text mining module and
Simstat, an easy yet powerful statistical software. A distinctive feature of these tools is their interoperability, allowing researchers to
integrate numerical, textual and graphical data into a single project, seamlessly move back and forth between quantitative and
qualitative data analysis, and explore relationships between numerical, textual and graphical data. Provalis Research's tools are
thus well-suited for mixed methods, qualitative, as well as quantitative evaluations. For more information, visit
http://www.provalisresearch.com
QUERI Inc developed one of the tutorial data sets that accompanies NVivo 7 software (produced by QSR International), and provides
training one-on-one, in large or small groups, or through distance-learning (via telephone or internet). QUERI also offers four Social
Justice Scholarships each year to individuals conducting social or restorative justice research. The scholarship includes a one-year
license for the NVivo 7 software, a training fee waiver, and a small stipend. See the QUERI web site for additional information.
http://queri.org/
SAGE Publications is an independent international publisher in the social sciences, technology and medicine.
SAGE provides journals, books, and electronic media of the highest caliber. Researchers, students, and
professionals have relied on our innovative resources for over 40 years. Please stop by our booth or visit us
at http://www.sagepub.com/
Snap Surveys - Snap Survey Software is a powerful, intuitive Windows-based program for questionnaire design, publishing, data
collection and analysis. Snap supports all survey modes (Web, E-mail, Paper, Kiosk, Phone, PDA, Scanning, Tablet PC). Snap has
robust analysis capability (Tables, Charts, Reports, Descriptive & Multivariate Statistics) and is very extensible - MS Access or SQL
database connectivity and seamless integration with MS Office (Word, Excel, PowerPoint, Access) and SPSS. For more information,
visit our website at: http://www.snapsurveys.com
Social & Scientific Systems Inc (SSS) has supported public and private sector public health programs and research initiatives since
1978. SSS improves public health worldwide through program evaluation, survey research, epidemiology studies, and international
public health program management. Whether they are evaluating a multifaceted health communication program directed at
preventing and controlling chronic disease in the United States or providing monitoring and evaluation services in Africa in support
of HIV/AIDS programs, SSS consistently provides the highest quality research services available. To learn more, please visit their
website at http://www.s-3.com/
Success Measures at NeighborWorks America is an innovative participatory outcome evaluation approach that engages community
stakeholders in the evaluation process and gives them tools to document outcomes, measure impact and inform change. Designed
by more than 300 community development practitioners, residents, and researchers, the methodology and web-based data system
strengthen programs and help translate results into follow-up action. Choose from a list of more than 44 indicators and 100 data
collection tools, available in Spanish and English, specific to measuring the success of housing, economic development, and
community building programs. Now offering a Consultant Certification program. http://www.successmeasures.org/
Page 217
University of Illinois, Urbana Champaign - Students who study evaluation at the University of Illinois, Urbana-Champaign will pursue
coursework and applied field experiences in evaluation theory, evaluation practice, and multiple traditions of research methods. A
distinctive character of our evaluation program is its emphasis multiple, diverse methods, including coursework and fieldwork in
mixed methods evaluation. Moreover, the curriculum also features particular attention to the socio-political character of the
contexts in which evaluation is conducted, notably the public policies and programmatic innovations involved. Our evaluation
graduates are well prepared for jobs in universities, research organizations, or public or private evaluation offices.
http://www.ed.uiuc.edu/edpsy/divisions/queries/
University of North Carolina/Evaluation, Assessment and Policy Connections (EvAP) - Specializes in training evaluators and
conducting program evaluations. In all of our work, we are committed to sharing evaluation expertise, instruments, and processes
while serving as an evaluation training center for our students and the broader education and service communities. Together, EvAP’s
team of 12 evaluators and support staff delivers technically sound strategies that are innovative and reflective of the client’s
evaluation goals and objectives. http://www.unc.edu/depts/ed/evap/index.html
The Evaluation Center-Western Michigan University has a 40-year history of providing national and international leadership for
advancing the theory, practice, and utilization of evaluation. Unlike most evaluation units in academic settings, the Center is not
affiliated with a single academic department or college. This reflects the transdisciplinary nature of evaluation and enables Center
personnel to work effectively in an array of subject areas. The Evaluation Center houses WMU's Interdisciplinary Ph.D. in Evaluation,
which features practice-linked learning; more than 30 faculty members from 13 academic departments and The Evaluation Center;
and a fully tailored, challenging curriculum. Please visit their website for more information. http://www.wmich.edu/evalctr/
Westat is an employee-owned research corporation serving Federal, state, local, and international government agencies,
businesses, nonprofit organizations, and foundations. In addition to Westat’s capabilities as a leading survey research and data
collection and analysis organization, they has extensive skill and experience in evaluation, strategic planning, performance
measurement, and quantitative/qualitative research methods across a broad range of subject areas. Westat offers a full-range of
evaluation services to meet its clients’ needs, including evaluation planning and design, implementation, data analysis, and
reporting for process, implementation, and impact evaluation of programs and services at various stages of development. See their
website at http://www.westat.com
WestEd is a nonprofit research, development, and service agency that works with education and other communities to promote
excellence, achieve equity, and improve learning for children, youth, and adults. Through resources, services, programs, and
projects, WestEd’s more than 450 staff members address many issues in human development, from birth to senior care, and in
education, from pre-service into the world of work. In addition, WestEd focuses on disseminating relevant, research-based
knowledge targeted to the needs of key audiences. Find out more information at http://www.wested.org
Page 218
The Complete
Survey Solution!
Integrated software for design, data collection and analysis
of all your research needs
Paper, Scan, Web, Email, PDA, Tablet, Kiosk, Phone surveys
Online Analysis and Response Management
Full outsourcing services
Call us for a FREE online demonstration! (603) 610-8700
www.snapsurveys.com
Abstinence Education Program Evaluation:
New and Expanding Opportunities.
The field of abstinence education is relatively new and expanding quickly.
To build knowledge and improve programs, the federal government is investing significant resources to
evaluate abstinence education programs.
The Center for Research and Evaluation on Abstinence Education seeks to help local programs find
talented evaluators. Our mission is to improve the quality of abstinence education research and evaluation
by building this field’s capacity to conduct scientifically sound evaluations.
Abstinence education programs in communities across the country need your help.
To learn more about the abstinence education field and how you can become involved, stop by our poster
exhibit on Wednesday, Nov. 7 from 6:30-8pm or email the Center at [email protected]
The Center for Research and Evaluation on Abstinence Education is funded by the Office of the Assistant
Secretary for Planning and Evaluation in the U.S. Department of Health and Human Services and operated
by The Lewin Group.
Come visit
our booth
The Latest in Evaluation & Research Methods from Guilford
New
Evaluation Ethics for Best Practice
20% Off
for AEA
Conferenc
Attendeese
Cases and Commentaries
Edited by Michael Morris, PhD, University of New Haven
“Morris and his colleagues are to be congratulated for providing the field with a comprehensive,
thought-provoking, highly practical, and very useable book on the topic of evaluation ethics.
The book’s organization takes us through the stages of evaluation practice, providing concise and
relevant case scenarios that have few simple answers, yet lend critical insights into what one might do
in a given situation. Particularly helpful are the guiding and ‘What If ’ questions, which are excellent tools to facilitate
conversations with students, colleagues, and evaluation clients. This book should be on every evaluator’s bookshelf.”
—Hallie Preskill, Claremont Graduate University
New
2007, 230 Pages, Paperback, ISBN 978-1-59385-569-7, Cat. #5H5569, $34.00, Special Discount Price: $27.20
Also Available in Hardcover: ISBN 978-1-59385-570-3, Cat. #5H5570, $54.00
Handbook of Constructionist Research
SPECIAL
Edited by James A. Holstein, PhD, Marquette University, and Jaber F. Gubrium, PhD, University of Missouri
Pre-Publication Price
“It would be difficult to imagine a more complete compendium on the state of constructionism at this time. For those
committed to the constructionist approach to phenomenological research, there is no better guide to the many practices and theoretical avenues from which to choose, nor could anyone find a better set of discussions of how social
constructionist/constructivist philosophies might be utilized with differing methodological strategies and texts.”
—Yvonna S. Lincoln, Texas A&M University
2007, 832 Pages, 7" x 10" Hardcover, ISBN 978-1-59385-305-1, Cat. #5H5305, $125.00, Special Discount Price: $95.00
New
Fundamental Issues in Evaluation
Edited by Nick L. Smith, PhD, Syracuse University, and Paul R. Brandon, PhD, University of Hawaii at Manoa
“A first-rate examination of theories, methods, and practices in contemporary evaluation, this book is a necessity for the
library of any professional evaluator and is equally valuable for graduate study. It offers outstanding consideration of
enduring, important questions surrounding stakeholder involvement, diverse participation, social justice, and appropriate
methodologies. Chapter authors are writing ‘at the top of their game,’ and almost every chapter is clear, eloquent, and
about the best statement one could find on the issues. Smith and Brandon have brought together a timely book of
enormous value, one that will join other classics in our field. Treat yourself to excellence and get a copy today!”
—Lois-ellin Datta, President, Datta Analysis, Waikoloa, Hawaii
2007, 238 Pages, Paperback, ISBN 978-1-59385-342-6, Cat. #5H5342, $35.00, Special Discount Price: $28.00
Also Available in Hardcover: ISBN 978-1-59385-604-5, Cat. #5H5604, $55.00
Missing Data
Multilevel Analysis
for Applied
Research
A Gentle Introduction
Patrick E. McKnight,
George Mason University
It’s Just Regression!
Katherine M. McKnight,
Robert Bickel,
LessonLab Research Institute
Marshall University
Souraya Sidani,
Program Evaluation
THIRD EDITION
Forms and Approaches
John M. Owen,
Centre for Program Evaluation,
The University of Melbourne,
Australia
University of Toronto
Aurelio José Figueredo,
University of Arizona
2007, 251 Pages, Paperback
ISBN 978-1-59385-393-8, Cat. #5H5393, $38.00
Special Discount Price: $30.40
2007, 355 Pages, 7" x 10" Paperback
ISBN 978-1-59385-191-0, Cat. #5H5191, $44.00
2007, 298 Pages, Paperback
ISBN 978-1-59385-406-5, Cat. #5H5406, $38.00
Also Available in Hardcover:
ISBN 978-1-59385-429-4, Cat. #5H5429, $70.00
ISBN 978-1-59385-411-9, Cat. #5H5411, $58.00
ISBN 978-1-59385-394-5, Cat. #5H5394, $60.00
For details on Guilford’s growing interdisciplinary research methods program—which includes research design and techniques
(both quantitative and qualitative), evaluation, measurement, and survey research—visit www.guilford.com/research
Professors: This symbol indicates that a title is Free for Adoption Consideration.
Visit www.guilford.com/instructors for information on our policy and to order. All other titles are available for 60-day review.
GUILFORD PUBLICATIONS,
Promotional Code 5H • 72 Spring Street, New York, NY 10012
Order Online www.guilford.com • Call Toll-Free (800) 365-7006 • Fax (212) 966-6708
VISIT THE LYCEUM BOOTH!
The Ethics of Practice with Children
Kim Strom-Gottfried, University of North Carolina, Chapel Hill
For professionals working in child welfare, factors such as confidentiality,
informed consent, and self-determination are complicated when clients’
rights and choices are constrained by age, maturity, and legal and parental
prerogatives. With these issues in mind, the author introduces memorable
frameworks for understanding ethical dilemmas and ethical decisions. The
author’s conversational style provides an accessible treatment of complex
topics and makes this book a valuable and practical resource.
A Practical Guide to Social Service Evaluation
Carl F. Brun, Wright State University
Unlike other evaluation manuals, which focus purely on theory, A Practical
Guide to Social Service Evaluation uses literature reviews and logic models,
as well as complete case studies, to help social service practitioners
connect theory to planning and evaluation. Brun breaks down the complex
process of evaluation; practitioners and educators can now easily and
successfully integrate evaluation into their program approach and
operations.
2008, Paper, 230 Pages, ISBN 978-1-933478-12-8, Price $34.95
Nonprofits and Technology: Emerging Research for Usable Knowledge
Michael Cortés and Kevin M. Rafter, University of San Francisco
This book identifies the ways that new information and communication technology both help and hinder nonprofit effectiveness. The book establishes a
body of dependable research on the subject, compiling the resources needed
to make better technology-adoption and management decisions in the nonprofit sector. Contributors range from practitioners to scholars, giving the
book a balanced and thorough approach to common issues.
Social Work with Volunteers
Michael E. Sherr, Baylor University
As the primary profession in the development, provision, and evaluation
of social services, social workers are in a position to shape how agency
administrators, direct staff, and volunteers work together to provide
services. The first book to specifically address the relationship between
social work and volunteers, Social Work with Volunteers examines the
current shift in social welfare services and the growing need to develop
effective partnerships with volunteers.
Secondary Traumatic Stress and the Child
Welfare Professional
Josephine G. Pryce, University of Alabama,
Kimberly K. Shackelford, University of Mississippi,
and David H. Pryce
2207, Paper, 200 Pages,
ISBN 978-1-933478-05-0, Price $29.95
How to Teach Anything:
A Guide to Effective Educational
and Training Experiences
Bruce D. Friedman,
Bakersfield University
ISBN 978-1-933478-18-0, Price $19.95
Practical Tips for Publishing Scholarly Articles:
Writing and Publishing in the Helping Professions
Rich Furman,
University of North Carolina at Charlotte
ISBN 978-1-933478-07-4, Price $19.95
Straight Talk About Professional Ethics
Kim Strom-Gottfried,
University of North Carolina, Chapel Hill
ISBN 978-1-933478-03-6, Price $36.95
Best Practices in Mental Health:
An International Journal
ISSN 1553-555X,
$40 Individual, $90 Institution
(annual subscription)
Social Development Issues
ISSN 0147-1473,
$60 Individual, $90 Institution
(annual subscription)
LYCEUM
B O O K S, I N C.
5758 S. Blackstone, Chicago, IL 60637
4 EASY WAYS TO ORDER
Call 773+643-1902 Fax 773+643-1903 E-mail [email protected] Web www.lyceumbooks.com/shop
The National Science Foundation
Discoveries are most powerful when they are shared with other researchers and
students, when they involve underrepresented groups, when they encourage new
partnerships and novel collaborations, when they strengthen America’s educational
capabilities, and when they are communicated to the public that makes federally
funded research possible.
See our accessible and visually rich website, where we explain our use of public
funds and the results derived from it.
Visit the new www.NSF.gov...your link to information, inspiration, innovation and
imagination
Your Natural Home for Career-Building Evaluation Resources
BOOKS
BOOKS
JOURNALS
American Journal of Evaluation
Editor: Robin L. Miller, Michigan State University,
USA
International Handbook
of Practice-Based
Performance Management
An Official Journal of the American Evaluation Association
Patria de Lancer Julnes
Frequency: March, June, September, December
For more information: http://aje.sagepub.com
Utah State University
Frances Berry, Florida State University
Maria P. Aristiqueta, University of
Delaware
Kaifeng Yang, Florida State University
AEA members have access to this journal with
their Member Login at http://www.eval.org
Evaluation Review: A Journal
of Applied Social Research
Hardcover: 978-1-4129-4012-2, $125.00
September 2007, 560 pages
Editor: Richard A. Berk, University of California,
Conducting Online Surveys
Los Angeles, USA
Frequency: February, April, June, August,
October, December
For more information:
http://evalreview.sagepub.com
Valerie M. Sue and Lois A. Ritter
California State University, East Bay
Paperback: 978-1-4129-3754-2, $34.95
March 2007, 208 pages
Evaluation: The International
Journal of Theory, Research
and Practice
Reframing Evaluation
Through Appreciative
Inquiry
Hallie S. Preskill
Editor: Elliot Stern, EDRU, The Tavistock
Claremont Graduate University
Institute, London, UK
Tessie Tzavaras Catsambas
Published in Association with The Tavistock Institute,
London, UK
EnCompass LLC
Frequency: January, April, July, October
For more information: http://evi.sagepub.com
Evaluation & the
Health Professions
Editor: R. Barker Bausell, University of
Maryland, USA
Frequency: March, June, September, December
For more information: http://ehp.sagepub.com
www.sagepublications.com
Paperback: 978-1-4129-0951-8, $34.95
June 2006, 192 pages
The SAGE Handbook of
Evaluation
Ian F. Shaw, University of York, U.K.
Jennifer C. Greene, University of Illinois
Melvin M. Mark, Pennsylvania State
University
Hardcover: 978-0-7619-7305-8, $130.00
July 2006, 632 pages
SAGE Publications Inc.
SAGE Publications Ltd.
2455 Teller Road • Thousand Oaks, CA 91320, U.S.A.
Tel: (800) 818-7243 • (805) 499-9774
Fax: (800) 583-2665 • (805) 499-0871
Email: [email protected]
1 Oliver’s Yard, 55 City Road • London EC1Y 1SP, U.K.
Tel: +44 (0)20 7324 8500
Fax: +44 (0)20 7324 8600
Email: [email protected]
HB070802
Your Natural Home for Career-Building Evaluation Resources
BOOKS
JOURNALS
Evaluation Methodology
Basics
Journal of Mixed Methods
Research (NEW!)
Jane Davidson
Editors: John W. Creswell, University of
Nebraska - Lincoln, USA and Abbas Tashakkori,
Florida International University, USA
Davidson Consulting Limited
Paperback: 978-0-7619-2930-7, $41.95
August 2004, 280 pages
Frequency: January, April, July, October
For more information: http://jmmr.sagepub.com
Be sure to sign up for your free individual online
subscription to Volume 1 and stop by the SAGE booth
for your free AEA preview copy of the first issue!
Concept Mapping for
Planning and Evaluation
Statistical Modeling
Editors: Herwig Friedl, Graz University of
Technology, Austria, John Hindel, National
University of Ireland, Galway, Republic of Ireland,
and Brian Marx, Louisiana State University, USA
Mary Kane
Concept Systems, Inc.
William M.K. Trochim
Cornell University
Frequency: April, July, October, December
For more information: http://smj.sagepub.com
Paperback: 978-1-4129-4028-3, $32.95
October 2006, 216 pages
RealWorld Evaluation
Qualitative Inquiry
Working Under Budget, Time,
Data, and Political Constraints
Editor: Norman K. Denzin, University of Illinois
at Urbana-Champaign, USA and Yvonna S.
Lincoln, Texas A&M University, USA
Michael J. Bamberger
Jim Rugh, CARE International
Frequency: February, April, June, August,
October, December
For more information:
http://qualitativeinquiry.sagepub.com
Linda Mabry
Washington State University, Vancouver
Paperback: 978-1-4129-0946-4, $48.95
February 2006, 504 pages
Program Evaluation and
Performance Measurement
Now published on behalf of the American Educational Research
Association by SAGE:
An Introduction to Practice
American Educational Research Journal
Educational Evaluation and Policy Analysis
Educational Researcher
Journal of Educational and Behavioral Statistics
Review of Educational Research
Review of Research in Education
James C. McDavid
University of Victoria, Canada
Laura R. L. Hawthorn
Paperback: 978-1-4129-0668-5, $63.95
August 2005, 496 pages
SAGE Publications Pvt. Ltd.
SAGE Publications Asia-Pacific
B-1/I-1, Mohan Cooperative Industrial Area
Mathura Road, New Delhi 110 044, India
Tel: ++(91-11) 4053 9222 • Fax: ++(91-11) 4053 9234
[email protected]
33 Pekin Street #02-01 • Far East Square
Singapore 049568
Tel: +65-6220-1800
Fax: +65-6438-1008
www.sagepublications.com
HB070802
5
ways to get better
program logics
®
with new DoView
Evaluators’ software
1
Build Better Logics Faster
Designed to be simple enough for you to build
or amend your models when in stakeholder
meetings
2
Keep It Simple
Have short outcomes titles because you can
put descriptions and other information in the
accompanying record table – great for storing
evidence about causal links too
3
Quickly Move Through Your Models
Use hyperlinks to move quickly and easily
through multiple diagrams in larger models
4
Keep It Visible
With DoView, every model you build can be
5
Plan Your Evaluation
Insert indicators and evaluation questions
seen easily when projected in a meeting or
right onto your model and have your whole
printed to pdf
evaluation plan at your fingertips
Lay out logics in minutes
which would take hours using
traditional drawing software
Quickly insert boxes for
steps and outcomes
Quick affordable software
designed by a practicing
evaluator for evaluators
Parents As Teachers program logic
Put evaluation
questions onto
the logic
Unique link icon
avoids ‘lines and
arrows’ link layout
problem
Better education
Parents with
better skills
% feel confident about
helping with math
Better links
between parents
and schools
Number of meetings
per year
Sufficent teaching
resources in home
Number of children’s
books in home
‘Clone’ outcomes
and be able to
update them right
across the logic
Use the hyperlink
to quickly jump
between diagrams
Put indicators
onto diagram
Store additional information about an outcome,
link, indicator or evaluation question in the record
table at the bottom of the screen
Download a 14-day FREE TRIAL of DoView now from www.doview.com
Exclusive offer for Evaluation 2007 Attendees – buy DoView online now for only $35.95
(buy using coupon code: EVAL07 before 30 November 2007)
HIGH QUALITY
DATA COLLECTION RESEARCH
FOR EVALUATORS, ACADEMIC AND
GOVERNMENT RESEARCHERS AND
CONSULTANTS
NATIONWIDE CATI TELEPHONE SURVEYS
and ON-LINE SURVEYS: Surveys from 5-60
minutes. Experienced, trained staff of data
collectors, including multi-cultural and bi-lingual.
NATIONWIDE FOCUS GROUPS: Focus groups
scheduled, set-up, recruited, coordinated and
moderated anywhere in the United States.
Team of multi-cultural/bi-lingual moderators.
NATIONWIDE FIELD SERVICE: Intercepts,
on-site observations and In-depth interviews.
Contact Ken Lyons: 1-866-377-8955
E-mail: [email protected]
Instant Quote Request:
www.independentdata.org
Real Solutions, Real Time
E-GOALS
E-GOALS measures and reports performance metrics to
support the Government Performance and Results Act
(GPRA), the President’s Management Agenda (PMA),
and the Office of Management and Budget (OMB).



Web-based performance measurement
Quantitative and qualitative data collection
Data imported from existing applications
Features & Benefits






Dashboard summary
Library of reusable
questions
Surveys in any language
Results are “rolled up”
and “drilled down”
Supports multiple survey
types
Assists with strategic
planning and budgeting
Primescape Solutions, Inc.
an 8(a) certified small business
1005 N. Glebe Road, Suite 160, Arlington, VA 22201
Office: 703.650.1900 Fax: 703.650.1901
www.primescape.net
Advocacy Evaluation:
It’s just a click away.
Now available online: Build Your Advocacy Grantmaking.
If you’re evaluating advocacy, you’ll want this new online version of our
acclaimed evaluation and capacity assessment tools. The electronic format
makes it easier than ever before to measure the success of advocacy
grantmaking. Be sure to use it with our groundbreaking legal guide, Investing
in Change: A Funder’s Guide to Supporting Advocacy.
For pricing and more information:
advocacyevaluation.org 1-866-675-6229
www.QUERI.org
Better Questions.
Qualitative Evaluation Research
Qualitative Data Analysis Software Training
Qualitative Research Grant Writing
QUERI provides customized, flexible, and high quality services in qualitative evaluation research,
qualitative data analysis software training, and qualitative research grant writing. We listen to you
carefully while helping you develop and clarify attainable research objectives. We use customized
approaches rather than boiler-plates in order to avoid “cookie-cutter” approaches to qualitative research.
NVivo 7 Software Training ¤ November 12-13, 2007 ¤ 9AM – 4PM
¤ Sheraton Baltimore City Center
We are hosting a two-day NVivo 7 training following the AEA conference on November 12 –13, 2007 in the Sheraton
Baltimore City Center Hotel. Your trainer, Kristi Jackson, combines 15 years of grant-funded evaluation research with over
10 years of qualitative software training to facilitate a training that is pragmatic, engaging, and fun.
The training includes an exploration of all areas of the software and also allows you to work on your own data (or a sample
data set we will provide). The second day of working with your data helps solidify the skills learned in the first day.
Additional trainings are held in the USA throughout the year. See www.QUERI.org for more information, or stop by the
QUERI table for registration information, dates, and other research services.
Making Aid Work Better
Through Evaluation.
The OECD – DAC Network on Development Evaluation
is a unique body, bringing together evaluation managers and specialists from development co-operation
agencies and multilateral development institutions, to work to increase the effectiveness of international
development programmes by supporting robust, informed and independent evaluation.
Visit the Development Evaluation Resource Centre!
DEReC:
• Enables you to quickly and easily access and learn from a wide array of key evaluation publications and reports from around the world.
• Is designed for researchers, students, academics, development agencies, NGOs, foundations,
donors, international organisations and the wider evaluation community.
• Is a free and public web-based resource.
• Is constantly updated and expanded!
www.oecd.org/dac/evaluationnetwork
www.oecd.org/dac/evaluationnetwork/derec
New from
Stanford University Press
Living Into Leadership
Standardized Childhood
A Journey in Ethics
The Political and
Cultural Struggle over
Early Education
BOWEN H. “BUZZ” MCCOY
$24.95 cloth
Handbook of
Transformative
Cooperation
New Designs and
Dynamics
Edited by SANDY KRISTIN
PIDERIT, RONALD E. FRY, and
DAVID L. COOPERRIDER
$95.00 cloth
Organizations and
Environments
HOWARD E. ALDRICH
Stanford Business Classics
$27.95 paper
BRUCE FULLER
$29.95 cloth
Cuba’s Academic
Advantage
Why Students in Cuba
Do Better in School
MARTIN CARNOY
$19.95 paper $50.00 cloth
After War
The Political Economy of
Exporting Democracy
CHRISTOPHER J. COYNE
$24.95 paper $65.00 cloth
Achieving Strategic
Excellence
An Assessment of
Human Resource
Organizations
EDWARD E. LAWLER III,
JOHN W. BOUDREAU, and
SUSAN ALBERS MOHRMAN,
with ALICE YEE MARK,
BETH NEILSON, and
NORA OSGANIAN
$50.00 paper
Stanford
University Press
800.621.2736
www.sup.org
Guilford Ave
Aisquith St
Exeter St
South St
Commerce St
Calvert St
Light St
Gay St
Fleet St
Rash Field
Key Hwy
Montgomery St
Churchill St
Light St
Henrietta St
Federal
Hill
Federal
Hill
Park
Warren Ave
Cross St
American
Visionary
Art Museum
Key Hwy
Historic Charles Street
A
Light St
Sharp St
Hanover St
Hanover St
MA
RC
Cam
den
Line
Market Pl
Sharp St Hopkins Pl
Light Rail
Light Rail
Howard St
Holliday St
St
r ty
Park Ave
Libe
Howard St
Eutaw St
Calvert St
St Paul St
Light Rail
Howard St
Eutaw St
Paca St
Greene St
Emory St
sell
St
Rus
t
hS
Lee St
Cross Street
Market
St
St
Ost
end
South
Baltimore
St
Hig
M&T
Bank
Stadium
L
Lloyd
t
n
Faw
Harbor
East
Hughes St
bur
gS
t
tS
Inner
Harbor
Little
Italy
St
S
en
National
Aquarium
in Baltimore
Baltimore
Visitor
Center
Maryland
Science Center/
IMAX
Ham
s
tile
sid
Conway St
Otterbein
Pratt St
Harborplace
L
Camden Station
Marc Trains to
Washington, D.C.
Camden
Yards
The
Gallery
To the Baltimore
Museum of Industry
& the Fort McHenry
National Monument
West St
Map jointly produced by Downtown Partnership and the Baltimore Area Convention and Visitors Association
N
1
Days Inn Inner Harbor Hotel
2
Radisson Plaza Lord Baltimore Hotel
3
Sheraton Baltimore City Center
4
The Tremont Plaza Hotel
= Event headquarters
Historic
Jonestown
Reginald F. Lewis
Museum
St
Oriole
Park
at Camden Yards
Water St
M
P re
Ridgley’s
Delight
Power Plant
Live!
Water St
Lombard St
◆
M
arle
Sports Legends
at Camden Yards
Baltimore St
M
Redwood St
Baltimore
Convention
Center
Camden St
Shot Tower
Metro Subway
St
em
1
L
2
A
tte
Faye
Alb
Geppi’s
Entertainment
Museum
Pratt St
83
Fayette St
M
St
St
Bromo L
Seltzer
Tower
Westside
Lexington St
w
Lo
n
Saratoga St
3
1st
Mariner
Arena
Municipal
Center
St
y
wa
Hippodrome
Performing
Arts Center
y
Ga
vi
H
4
November 5-11, 2007
Orleans St
ls
Fal
Fayette St
St
l
Co
L
Mercy
Medical
Center
Evaluation 2007
St
M
St
Lexington
Market
Saratoga St
n
lle
Hi
City
Center
Baltimore
Basilica
M
gh
Franklin St
American Evaluation
Association
er
et
Ex
Hamilton St
Hi
Mulberry St
Centre St
Light Rail
St
Metro Subway
M
y
Paca St
St
ar
American Evaluation Association
MISSION, GOAL, AND VALUES
AEA Mission: To improve evaluation practices and methods, increase evaluation use,
promote evaluation as a profession, and support the contribution of evaluation to
the generation of theory and knowledge about effective human action.
Evaluation
practices that add value to
decision-making processes
and policy development
We encourage the development and
dissemination of knowledge about
evaluation theories, practices, skills, and
ethics that contribute to improved
decision-making and policy
development.
A sense of
professional
community
We foster cohesion and
solidarity among evaluators,
providing members with a
sense of belonging to a
professional community.
A multicultural, global, and
international understanding
of evaluation practices
We are committed to understanding and
building awareness of the worldwide
context for evaluation. We support
developing relationships and
collaborations with evaluation
communities around the globe
to understand international
evaluation issues.
Inclusiveness
We welcome evaluators at all
levels of experience, in all types
of practice, and from all kinds of
organizations and communities
to our association.
L U E S
VA
AEA Goal
To promote high
quality evaluation; to
be a primary source
for evaluation
information.
VA
L U E S
Evaluation
practices that lead
to social betterment
We support our members in their efforts
to make a difference in society through
evaluation and building evaluation capacity.
We strive to promote a robust understanding of
the role, use, and value of evaluation in
organizational and social change processes.
Continual
development
of evaluation
professionals
We support increasing the
professional competence of all
evaluators. We provide high quality
professional development
opportunities, yet do not seek to be
the sole source of such offerings.
A diverse community
and the development
of evaluators from
under-represented groups
We actively work to diversify the pool of
evaluation scholars and practitioners so
as to reflect the populations served by
evaluators. We encourage and
support efforts to recruit,
educate, and support
evaluators from
underrepresented
groups.
This framework is a working document of the AEA Board of Directors. As such, we anticipate refinement over time and welcome input to [email protected]
A Message from the President-elect
Evaluation 2008: Evaluation Policy and Evaluation Practice
Next November AEA will convene in the beautiful mile-high city of Denver. The theme I would like to explore at this
conference is Evaluation Policy and Evaluation Practice. What is “evaluation policy”? An evaluation policy is any rule or
principle that a group or organization uses to guide its decisions and actions when doing evaluation. Every group and
organization that engages in evaluation – including government agencies, private businesses, and nonprofit
organizations – has evaluation policies. Sometimes these are formal, explicit and written; at other times they are more
implicit and ad hoc principles or norms that have simply evolved over time. In the absence of formally stated evaluation
policies, organizations seem to make policies up as they go along—too often without thoroughly consulting what others
have done or informing themselves about evaluation best practices. Evaluation policies profoundly affect the day-to-day
work of all evaluators. Many recent and current controversies or conflicts in the field of evaluation can be viewed, at least
in part, as struggles around evaluation policy. Because evaluation policies typically apply across multiple evaluations,
influencing policies directly may have systemic and far-reaching effects for practice. Here is a sample of questions we
hope to explore at Evaluation 2008:
•
•
•
•
•
•
•
•
What is evaluation policy? What questions or issues should a comprehensive organizational evaluation policy
address? How and by whom does evaluation policy get formed and disseminated?
How does evaluation policy influence evaluation practice? What are the major evaluation policies that affect
your practice of evaluation?
When does systematic evaluation get deployed? What programs, policies, or practices are chosen as the subject
of evaluation, when, and why?
What policies should guide the identification and selection of evaluators? What credentials should evaluators
have? What kind of relationship should evaluators have to the program or entity being evaluated?
What policies should guide the timing, planning, budgeting and funding, contracting, implementation, methods
and approaches, reporting, use and dissemination of evaluations?
What policies should guide how evaluation participants and respondents are engaged and protected?
How can existing (e.g., the Guiding Principles for Evaluators) or prospective professional standards inform
evaluation policy?
How can you as an evaluator and AEA generally become more engaged in shaping effective evaluation policies?
This theme is a critically important one for our profession. AEA has just launched a multi-year Evaluation Policy Task
Force to examine how we can be more proactive in influencing the evaluation policies that guide practice. And, the
conference in Denver opens one day after national elections in the U.S., a time when key policymakers at all levels of
government consider new policy directions. My hope is that our discussions will enhance our understanding of the
relationships between evaluation policy and evaluation practice and help improve the policy landscape for more
effective evaluation.
I am excited and honored to serve as President of AEA and invite you to join us in Denver – the gateway to the Rockies,
Colorado’s state capital, and home to many world-class museums and attractions – for what promises to be an exciting
and important conference that will help us set the course for the future of evaluation.
William Trochim
AEA 2008 AEA President

to the entire program as a pdf

Transcription

Similar documents

2713 Hot Rod - Watson Gloves

Untitled

AG TOLERIE LASER CLADDING

Aruba`s streetcars are powered by batteries augmented by hydrogen

Maxstar® 150 STL

Stick Welders: Invertec V155-S

classes for all ages : first course spring term

consistently creating value for investors