a downloadable pdf of the conference program sans ads
Transcription
a downloadable pdf of the conference program sans ads
Evaluation 2010 President’s Welcome On behalf of the American Evaluation Association’s Board of Directors, the AEA staff, and many volunteers, I am delighted to welcome you to the 2010 AEA Annual Conference. The conference provides wonderful opportunities for sharing our work, learning from others, developing and strengthening professional relationships, renewing old and starting new friendships, and experiencing San Antonio, our host city. This year, the Presidential Strand theme is “Evaluation Quality.” Evaluation quality is an umbrella theme, with room underneath for all kinds of ideas – quality from the perspective of different evaluation approaches, the role of certification in quality assurance, metaevaluation and the standards used to judge quality, and so on. The call for proposals encouraged us to think of quality broadly. Following that guidance, my Presidential Strand Co-Chairs, Valerie Caracelli and Rodney Hopson, have organized three wonderful Plenary sessions. At Wednesday’s opening Plenary, we have three luminaries in the field who will highlight a timely topic for our nation, the world and especially our field. Eleanor Chelimsky, Laura Leviton and Michael Quinn Patton offer diverse perspectives in a discussion entitled Tensions Among Evaluative Perspectives in the Age of Obama: Influences on Evaluation Quality, Thinking and Values. The Thursday Plenary offers perspectives from outside the evaluation profession: James E. Davis, a long time member of AEA, will facilitate a discussion with Crispin Sartwell, a philosopher who has written about justice and beauty, most recently in a book titled Political Aesthetics, and Psyche WilliamsForson, an expert in American material culture, whose book Building Houses out of Chicken Legs received the American Folklore Society’s book prize. I am excited to share my thoughts on Evaluation Quality: The Good, the Bad, the Beautiful and the Ugly in my session on Friday. And, the final plenary will be Saturday afternoon, when the 2005-2009 Presidents will briefly reflect on the conference theme. We will conclude with a toast to celebrate our days together engaged in conversation about evaluation quality. The Presidential Strand sessions have a similar diversity of perspectives from within and across disciplinary and practical boundaries. For example, sessions on Design Thinking from the world of business and industry) and quality from the perspective of anthropology will bring ideas from outside the field, while sessions on quality in the international context and in mixed-method evaluation, among other topics, will explore evaluation quality in more familiar terms. The Presidential Strand also includes sessions highlighting the statement on Culturally Competent Evaluation and the new edition of the Program Evaluation Standards. In addition, Ernest House will hold an informal conversation about his conceptions of evaluation quality, including the “Truth, Beauty, and Justice” dimensions that were part of my inspiration for the theme. Evaluation quality will also be addressed in panels and presentations outside the Presidential Strand and, I hope, in conversations at the receptions and various other gathering places. I hope you have a great time, professionally and personally, at Evaluation 2010. And may we all leave with an enriched way of thinking about evaluation quality and with new skills for making our evaluations as good as they can be! Leslie J. Cooksy American Evaluation Association Annual Conference BOARD OF DIRECTORS TABLE OF CONTENTS PAGE OFFICERS President Leslie Cooksy Past-President/Secretary Debra Rog President-elect Jennifer Greene Treasurer Brian Yates President‘s Welcome Inside Front Cover Board Member directory 1 Table of Contents 1 Conference Program Schedule Detail 2 Conference Hotel Map 3 Registration Information 4 Career Boards Information 4 Future Conferences 4 Hospitality Suites 4 FAQs About the Conference and AEA 5-6 Topical Interest Group (TIG) directory 7-8 Sponsors and Acknowledgements 9-11 Professional Development Sessions 12-13 Wednesday, November 10 Sessions 15-32 Thursday, November 11 Sessions 33-84 Friday, November 12 Sessions 85-126 Saturday, November 13 Sessions 127-170 BOARD MEMBERS Katrina Bledsoe Stewart Donaldson Mike Hendricks Elmima Johnson Rakesh Mohan Tristi Nichols Beverly Parsons Patricia Rogers Veronica Thomas ANNUAL MEETING Chair Katherine McKnight JOURNAL EDITORS Appendix A: Index of Presenters & Contributors 171-215 Appendix B: Directory of Sessions by Sponsor 216-245 Appendix C: Directory of Exhibitors 246-249 Advertisements 250-258 Looking Toward 2011 Inside Back Cover American Journal of Evaluation Thomas Schwandt New Directions for Evaluation Sandra Mathison If you are in need of assistance as you prepare for the conference, please call the AEA office at 1-508-748-3326, or email us at [email protected]. Conference Program Schedule Detail Timeslot Activity Page Monday, November 8, 9:00 am to 4:00 pm Concurrent Pre-conference Workshops (Ticketed) 12 Tuesday, November 9, 9:00 am to 4:00 pm Concurrent Pre-conference Workshops (Ticketed) 12 Wednesday, November 10, 8:00 am to 3:00 pm Concurrent Pre-conference Workshops (Ticketed) 12-13 Wednesday, November 10, 3:15 pm to 4:15 pm Opening Plenary (All Welcome) 18 Wednesday, November 10, 4:30 pm to 6:00 pm Concurrent Sessions (All Welcome) 18-23 Wednesday, November 10, 6:10 pm to 6:40 pm New Member/Attendee Orientation (All Welcome) 23 Wednesday, November 10, 6:30 pm to 8:00 pm Opening Reception and Exhibition (All Welcome) 24-31 Thursday, November 11, 8:00 am to 8:45 am Second Plenary (All Welcome) 36 Thursday, November 11, 9:15 am to 10:45 am Concurrent Sessions (All Welcome) 36-42 Thursday, November 11, 10:55 am to 12:25 pm Concurrent Sessions (All Welcome) 46-53 Thursday, November 11, 12:35 pm to 1:30 pm AEA Business Meeting (All Welcome) 53 Thursday, November 11, 1:40 pm to 3:10 pm Concurrent Sessions (All Welcome) 56-62 Thursday, November 11, 3:35 pm to 4:20 pm Concurrent Sessions (All Welcome) 66-70 Thursday, November 11, 4:30 pm to 6:00 pm Concurrent Sessions (All Welcome) 74-80 Thursday, November 11, 6:10 pm to 7:00 pm Concurrent TIG Meetings (All Welcome) 82-83 Friday, November 12, 7:00 am to 7:50 am Concurrent TIG Meetings (All Welcome) 87 Friday, November 12, 8:00 am to 8:45 am Third Plenary (All Welcome) 87 Friday, November 12, 9:15 am to 10:45 am Concurrent Sessions (All Welcome) 90-95 Friday, November 12, 10:55 am to 11:40 am Concurrent Sessions (All Welcome) 98-101 Friday, November 12, 11:50 am to 1:30 pm Awards Luncheon (Ticketed) 104 Friday, November 12, 1:40 pm to 3:10 pm Concurrent Sessions (All Welcome) 104-110 Friday, November 12, 3:35 pm to 4:20 pm Concurrent Sessions (All Welcome) 114-117 Friday, November 12, 4:30 pm to 6:00 pm Concurrent Sessions (All Welcome) 120-126 Friday, November 12, 6:30 pm to 8:00 pm Reception and Silent Auction (All Welcome) 126 Saturday, November 13, 8:00 am to 9:30 am Concurrent Sessions (All Welcome) 130-136 Saturday, November 13, 10:00 am to 10:45 am Concurrent Sessions (All Welcome) 140-145 Saturday, November 13, 10:55 am to 12:25 pm Concurrent Sessions (All Welcome) 148-153 Saturday, November 13, 12:35 pm to 1:30 pm TIG Business Meeting / Lunch Break (On own) 153 Saturday, November 13, 1:40 pm to 2:25 pm Concurrent Sessions (All Welcome) 156-160 Saturday, November 13, 2:50 pm to 4:20 pm Concurrent Sessions (All Welcome) 164-170 Saturday, November 13, 4:30 pm to 5:30 pm Fourth Plenary (All Welcome) 170 Sunday, November 14, 9:00 am to 12:00 pm Concurrent Post-conference Workshops (Ticketed) 13 Evaluation 2010 Page 2 Grand Hyatt San Antonio Hotel Map Registration Desk and Career Boards Registration: Conference sessions will be held exclusively at the Grand Hyatt. The Registration Desk for Evaluation 2010 is located on the fourth level adjacent to the escalators. Day Monday, November 8 Tuesday, November 9 Wednesday, November 10 Thursday, November 11 Friday, November 12 Saturday, November 13 Sunday, November 14 Registration Desk Hours 8:00 am – 5:30 pm 8:00 am – 5:30 pm 7:00 am – 6:30 pm 7:00 am – 6:30 pm 7:00 am – 6:30 pm 7:00 am – 5:00 pm 8:00 am – 12:00 pm (Noon) Career Boards: Our career services will be provided this year via career boards. Look for Job Boards and Resume Boards at one end of the Exhibits in the fourth floor on the same level as the AEA Registration Area. You may bring your resume or position descriptions on site and add them to one of the pockets there yourself. The Career Boards will be available Thursday through Saturday. Be sure to peruse the position and resume listings! Future Conferences Plan ahead and save the dates! The sites have already been selected for the following conferences. Evaluation 2011 Dates: Wednesday, November 2 through Saturday, November 5, 2011 Location: Hilton Anaheim – Anaheim, California Evaluation 2012 Dates: Wednesday, October 24 through Saturday, October 27, 2012 Location: Hilton Minneapolis and Minneapolis Convention Center – Minneapolis, Minnesota Diversity and International Hospitality Suites Are you a member of a diversity-focused TIG or an evaluator working with issues of culture and diversity? We welcome your use of the Diversity Hospitality Suite. Suite locations will appear in the addendum and posted on site. Are you one of the over 300 international attendees at Evaluation 2010, a member of the Research, Technology and Development Evaluation TIG or the International and Cross-cultural TIG, or an evaluator working in international contexts? We welcome your use of the International Hospitality Suite. Suite locations will appear in the addendum and posted on site. Day Hospitality Suite Hours Wednesday, November 8 Thursday, November 9 Friday, November 10 Saturday, November 11 6:00 pm – 7:00 pm Open House 7:00 am – 6:00 pm 7:00 am – 6:00 pm 7:00 am – 11:00 am Evaluation 2010 Page 4 Frequently Asked Questions About the AEA Annual Conference What should I do when I arrive at the conference? Begin by checking in, and picking up your nametag and materials, at the AEA conference registration desk located on the fourth floor of the Grand Hyatt, 600 East Market Street, San Antonio, Texas. May I register or make purchases on site? You may register for the conference, or add to your existing conference registration, on site at the conference registration desk. You may enroll in any open professional development workshops, but many have filled before the conference. Lunch tickets for the Friday awards luncheon are usually available through noon on Thursday or until sold out. A limited number of t-shirts are available for on site purchase as well. What is included in my registration? Standard conference registration includes admission to all of the sessions held after 3:10 pm on Wednesday through 5:30 pm on Saturday with the exception of Friday‘s awards luncheon, which is a separate ticketed event. Registration includes the receptions Wednesday and Friday evenings. Meals are not included, but beverages are available in the foyers each morning after the plenary and each afternoon before the penultimate session. Do I need to sign up for sessions in advance? The professional development workshops that precede and follow the conference require a separate registration and are filled on a first-come, first-served basis. All other sessions held during the conference are open to all attendees. You may attend any session by arriving at the appropriate room before the session begins. We make every effort to ensure that the room size is adequate for the attendance; however, occasionally, a session‘s seating will fill. If there is a session that you especially wish to see, it is a good idea to arrive at the beginning of the break rather than at the end. What is the Presidential Strand? The Presidential Strand is a set of sessions highlighting the year‘s conference theme of Evaluation Quality. There is one Strand session during each set of concurrent sessions, plus four plenary, or general sessions – one opening the conference, one each on Thursday and Friday mornings at 8:00 a.m., and one closing the conference on Saturday afternoon. What is a TIG and what do they do? AEA has 45 Topical Interest Groups, or TIGs. One of the major activities of each TIG is to review conference proposals and sponsor conference sessions. Under each session in the program you will see the sponsoring group, and the program is indexed by TIG in Appendix B. Checking the TIG sponsor will give you an idea as to the topical bent of the overall session. Each TIG also holds a business meeting during the conference, and attending one is a great way to connect with others who share your interests and to learn of the TIG‘s plans for the coming year. Many TIG members may be identified by ribbons attached to their nametags stating TIG affiliations. Pick up free ribbons showing your topical interests when you check in at the registration desk and look for others throughout the conference who share your interests. How can I meet people? It can be difficult to connect with others your first time at a conference. One great way to meet colleagues is to attend the Wednesday Reception and Poster Exhibition and take the opportunity to connect with over 100 poster presenters sharing their work as well as AEA leaders and authors. Purchase a ticket to Friday‘s awards luncheon and sit with colleagues to enjoy a good meal and great company while honoring the best in the field. Friday is topped off by a reception and silent auction hosted by the International and Cross-Cultural Evaluation TIG. Meet attendees from around the world and bid on a range of items from texts to talismans. Finally, attending a TIG business meeting will help you to connect with people who share your disciplinary interests. What should I do if I have questions during the conference? Please feel free to come to the registration desk at any time. We‘re happy to answer your questions, give a little advice, or point you in the right direction. When out and about, look for attendees with ―Ambassador‖ ribbons. These past and present Association leaders will be happy to help. Be sure to attend the first-time attendee‘s orientation session held in the Lonestar Ballroom from 6:10 to 6:40 pm on Wednesday evening to learn more about the Association and the Conference. Evaluation 2010 Page 5 Frequently Asked Questions About AEA How long has AEA been around? The American Evaluation Association (AEA) came into being in 1986 out of the merger of two existing evaluation groups: The Evaluation Network and the Evaluation Research Society. What is the mission of AEA? AEA‘s mission is to: Improve evaluation practice and methods Increase evaluation use Promote evaluation as a profession, and Support the contribution of evaluation to the generation of theory and knowledge about effective human action. Why should I become a member? Membership in AEA signifies to yourself and to others that you consider yourself an evaluation professional. The Association‘s two journals, subscriptions to both of which come with full membership, provide you with up-to-date information on current theory and practice. The American Journal of Evaluation includes articles on topics of current interest, information about upcoming conferences, book reviews, and more. Published quarterly, New Directions for Evaluation focuses on various aspects of a single salient topic with each issue. AEA members also receive electronic access to two additional journals Evaluation and the Health Professions and Evaluation Review, a listing on AEA‘s ―Find an Evaluator‖ pages, free registration for monthly coffee break webinars and the thought leaders forum, access to the online member directory, and informational materials. Finally, AEA members enjoy considerable discounts on conference and professional development workshop registrations. Where can I turn with professional questions? EVALTALK is the official listserv of AEA. Subscribers to EVALTALK engage in lively, sometimes heated, usually thought provoking, discussions of topics related to evaluation. EVALTALK can be received in real time via ongoing emails throughout the day, or as a digest so that you receive one email each day that includes the indexed, full discussion from the past 24 hours. The AEA office can direct you to information on how to sign on to EVALTALK or check the AEA website at www.eval.org. Another option for your professional questions is to connect with a Topical Interest Group either through attending TIG-sponsored sessions at the annual conference or communicating with the TIG leaders. What is a TIG? AEA‘s 45 Topical Interest Groups (TIGs) span the methodological, disciplinary, and ideological gamut. These subgroups of the Association allow members to connect with others who share their interests as well as provide a forum for sharing knowledge and skills during the annual conference. Some TIGs are very active and produce a newsletter, manage their own website, and solicit and develop special conference sessions. Other TIGs focus primarily on providing reviewers for topical presentations for the annual conference. AEA members may be members in up to five TIGs and may change their TIG choices at any time by contacting the AEA office or making the changes on your membership renewal form. What is a Local Affiliate? AEA‘s Local Affiliates (LAs) are independent associations that provide a regional home to evaluators. You do not need to be a member of AEA to join an Affiliate and you do not need to participate in an Affiliate to be a member of AEA. Affiliates provide their own programming and outreach activities, yet share with AEA a focus on serving evaluators and the evaluation community. How can I get involved? AEA is a professionally run, volunteer lead association. The most obvious way to get involved is to participate: submit a proposal to present at the conference, vote in AEA elections, nominate a colleague for an award, or fill out an online volunteer profile. Share your knowledge by submitting an article to The American Journal of Evaluation – manuscript guidelines can be found online or through the AEA office. Become a leader by attending a TIG business meeting at the annual conference and offering your services. TIGs are seeking people to do everything from design websites to write newsletters to review conference proposals. If you want to influence the actions of the Association, consider running for office on the AEA Board or connecting with an AEA Board member or TIG leader at the Wednesday evening Info Fair. Only members may serve on the AEA Board or as Topical Interest Group leaders. Where should I turn with questions outside of the conference? A good place to start is with Heidi Nye, AEA‘s Member Services Director in our AEA office. Heidi can answer most administrative or member services questions and will point you in the right direction for other resources. She may be reached at [email protected] or 1-508-748-3326. Evaluation 2010 Page 6 Topical Interest Group Directory AEA‘s 45 Topical Interest Groups are the primary reviewers and sponsors of sessions. All attendees are welcome at their business meetings! Topical Interest Group Chair(s) Program Chair(s) Business Meeting Time Location Advocacy and Policy Change Ehren Reed Jackie Williams Kaye Annette Gardner James Riedel Thu, 6:10 PM to 7:00 PM Goliad Alcohol, Drug Abuse, and Mental Health Marge Cawley Diana Seybolt Marge Cawley Diana Seybolt Fri, 10:55 AM to 11:40 AM Presidio C Assessment in Higher Ed Rhoda Risner Audrey Rorrer George Reinhart Thu, 6:10 PM to 7:00 PM Travis A Business and Industry Eric Abdullateef Thomas Ward Tala Davidson Jennifer Martineau Thu, 6:10 PM to 7:00 PM Crockett C Cluster, Multi-site and Multi-level Rene Lavinghouze Martha Ann Carey Thu, 4:30 PM to 6:00 PM Lone Star F Collaborative, Participatory & Empowerment Evaluation David Fetterman Liliana Rodriguez-Campos Liliana Rodriguez-Campos Thu, 6:10 PM to 7:00 PM Lone Star C College Access Programs Rita O'Sullivan Kurt Burkum Thu, 6:10 PM to 7:00 PM Bonham B Costs, Effectiveness, Benefits, Econ Ronald Scott Visscher Nadini Persaud Thu, 6:10 PM to 7:00 PM Texas C Crime and Justice Roger K Przybylski Roger K Przybylski Thu, 3:35 PM to 4:20 PM Crockett D Disabilities and Other Vulnerable Populations June Gothberg Jennifer Sullivan Sulewski Patricia Mueller Fri, 7:00 AM to 7:50 AM Mission B Disaster & Emergency Management Evaluation S Scott Aminov Karen Pendleton Patricia (Trish) Bolton Brandi R Gilbert Thu, 6:10 PM to 7:00 PM Crockett D Distance Ed & Other Ed Tech Talbot Bielefeldt Talbot Bielefeldt Thu, 3:35 PM to 4:20 PM Presidio A Environmental Program Evaluation Annelise Carleton-Hug Kara Crohn Mary McEathron Thu, 6:10 PM to 7:00 PM Bonham E Evaluating the Arts & Culture Kathlyn Steedly Ching Ching Yap Thu, 6:10 PM to 7:00 PM Travis D Evaluation Managers and Supervisors Ann Maxwell Sue Hewitt Laura L Feldman Thu, 4:30 PM to 6:00 PM Travis B Evaluation Policy Lisa Rajigah Kristin Kaylor Richardson Thu, 6:10 PM to 7:00 PM Texas F Evaluation Use J Bradley Cousins Susan Tucker Fri, 7:00 AM to 7:50 AM Seguin B Extension Education Eval Lisa Townson Joseph Donaldson Thu, 6:10 PM to 7:00 PM Crockett A Feminist Issues in Evaluation Kathryn Bowen Michael Bamberger Linda Thurston Sat, 12:35 PM to 1:30 PM Goliad Government Evaluation Stan Capela David J Bernstein Sam Held Thu, 4:30 PM to 6:00 PM Texas A Graduate Student and New Evaluators Gargi Bhattacharya Nora Gannon Jason Burkhardt Thu, 3:35 PM to 4:20 PM Seguin B Health Evaluation Robert G LaChausse Jenica Huddleston Debora Goldberg Thu, 4:30 PM to 6:00 PM Republic B Evaluation 2010 Page 7 Topical Interest Group Chair(s) Program Chair(s) Business Meeting Time Location Human Services Evaluation Tania Rempert Todd Michael Franke Vajeera Dorabawila Barry Cohen Thu, 6:10 PM to 7:00 PM Independence Independent Consulting Fred Glantz Rita S Fierro Michelle Baron Thu, 4:30 PM to 6:00 PM Bowie A Indigenous Peoples Katherine Tibbetts Kalyani Rai Joan LaFrance Thu, 4:30 PM to 6:00 PM Bowie C Integrating Tech Into Evaluation Margaret Lubke Nathan Balasubramanian Thu, 6:10 PM to 7:00 PM Travis B Internal Evaluation Boris B Volkov Wendy M DuBow Boris B Volkov Thu, 10:55 AM to 12:25 PM Lone Star F International and Cross Cultural Evaluation Tessie Tzavaras Catsambas Mary Crave Paula Bilinsky Thu, 6:10 PM to 7:00 PM Republic A Lesbian, Gay, Bisexual, and Transgender Issues Kari Greene John Daws Joe E Heimlich Kathleen McKay Thu, 6:10 PM to 7:00 PM Presidio A Mixed Methods Evaluation Donna Mertens Mika Yamashita Fri 7:00 AM to 7:50 AM Crockett A Multiethnic Issues in Evaluation Tamara Bertrand Jones Leona Johnson Stella L Hargett Pamela Frazier-Anderson Thu, 6:10 PM to 7:00 PM Bowie B Needs Assessment Hsin-Ling (Sonya) Hung Janet Matulis Ann Del Vecchio Thu, 6:10 PM to 7:00 PM Travis C Non-profit and Foundations Eval Lester Baxter Charles Gasper Joanne G Carman Helen Davis Picher Thu, 4:30 PM to 6:00 PM Lone Star D Organizational Learning and Evaluation Capacity Building Michelle Baron Gary Skolits Stephen J Ruffini Megan Bennett Wed, 4:30 PM to 6:00 PM Presidio B Pre-K - 12 Educational Evaluation Anane Olatunji Antionette (Toni) Stroter Tom McKlin Chad T Gree Fri, 7:00 AM to 7:50 AM Bonham C Program Theory & Theory-Driven John A Gargani Katrina Bledsoe Sat, 10:00 AM to 10:45 AM Lone Star A Qualitative Methods Jennifer Jewiss Leslie Goodyear Janet Usinger Eric Barela Thu, 6:10 PM to 7:00 PM Texas B Quantitative Methods: Theory and Design Patrick McKnight George Julnes Karen Larwin Ray Hart Thu, 10:55 AM to 12:25 PM Lone Star E Research on Evaluation Christina Christie Tarek Azzam Thu, 3:35 PM to 4:20 PM Texas F Research, Technology, and Development Evaluation Cheryl J Oros Brian Zuckerman George Teather Juan D Rogers Thu, 6:10 PM to 7:00 PM Texas D Social Network Analysis Maryann Durland Stacey Friedman Thu, 6:10 PM to 7:00 PM Bowie A Social Work Donna Parrish Tracy C Wharton Karen Anderson Aisha Tucker Brown Thu, 6:10 PM to 7:00 PM Mission B Systems in Evaluation Jan Noga Meg Hargreaves Mary McEathron Thu, 4:30 PM to 6:00 PM Lone Star B Teaching of Evaluation Linda B Schrader Neva Nahan Thu, 6:10 PM to 7:00 PM Crockett B Theories of Evaluation James Griffith Bianca Montrosse James Griffith Bianca Montrosse Thu, 3:35 PM to 4:20 PM Republic C Evaluation 2010 Page 8 Thank you to our sponsors AEA would like to thank the following parties for contributing funds and services as sponsors of this year‘s annual conference. The contributions of people and groups such as these allow the Association to keep registration fees as low as possible. If you know of anyone who would like to sponsor next year‘s conference in Anaheim, California, please contact the AEA office. Annie E Casey Foundation: National Science Foundation Reception and Student Attendance Gravic Inc: Conference Evaluations National Science Foundation: Pens/Highlighters for Each Attendee Sage Publications: Meet the Author Reception Westat: Evaluation Futures, Student Registrant Sponsorships Thank you to our volunteers AEA would like to thank the many people who lend their time and talents to making Evaluation 2010 an event to remember. Conference Chair Katherine McKnight Presidential Strand Co-chairs Valerie Caracelli Rodney Hopson Professional Development Program Reviewers Katherine McKnight (Chair) Derrick Gervin Victor Kuo Leigh Wang Art Hernandez Silent Auction Coordinator Tessie Catsambas Thank you to our on site staff Cady Berkel Aleise Matheson Marcus Bolton Gwen Fariss Newman Susan Kistler Heidi Nye Thank you to our amazing presenters Of course, the most thanks must go to the 1,000+ people who contribute their time, knowledge, and expertise as presenters for this year‘s conference. Their names and contributions appear in the body of this program. Evaluation 2010 Page 9 Thank you to all 702 conference proposal reviewers! The following 702 individuals contributed their knowledge and expertise as reviewers for the Evaluation 2010 program. Eric Abdullateef Lois Abel Yvonne Abel Margot Ackermann Sandra Adams Omolola Adedokun Lokman Akbay Liya Aklilu Salvatore Alaimo Flanny Alamparambil Kasia Alderman Asma Ali Metta Alsobrook Eusebio Alvaro S Scott Aminov Courtney Amo Trena Anastasia Laura Anderson Shirley Anderson Karen Anderson Andrea AndersonHamilton Nanette Antwi-Donkor Sarah Appleton-Dyer Sheila Arens Amy Laura Arnold Elise Arruda Laorenza Kas Aruskevich Elizabeth Autio Tarek Azzam EunKyeng Baek RichAnn Baetz Haiyan Bai Anita Baker Michelle Bakerson Nathan Balasubramanian Michael Baldwin Dorene Balmer Michael Bamberger Lennise Baptiste Eric Barela Zoe Barley Susan Barnes Michelle Baron Catherine Batsche Joseph Bauer Herb Baum Lester Baxter Rachel Becker-Klein Barbara Bedney Aarti Bellara Carolla Belle Lehn Benjamin Gregory Benjamin Megan Bennett Rusti Berent Evaluation 2010 Dale Berger Nancy Berglas David Bernstein Tiffany Berry Tamara Bertrand Jones Hannah Betesh Stevens Beth Amee Bhalakia Gargi Bhattacharya William Bickel Talbot Bielefeldt Gretchen Biesecker Margaret Biggerstaff Yakup Bilgili Diane Binder Pamela Bishop Katrina Bledsoe Marcie Bober-Michel Patricia Bolton Sally Bond Robert Boody Roger Boothroyd John Bosma Kathryn Bowen Ann Brackett Wendy Bradshaw Margaret Braun Ann Briehan Edward Broughton Courtney Brown Lisanne Brown Clete Bulach Michael Burke Jason Burkhardt Kurt Burkum Amy Burns Erin Burr Ellie Buteau William Cabin Eric Canen Stanley Capela Gisela Cardoso Martha Ann Carey Annelise Carleton-Hug Joanne Carman Deborah Carran Nancy Carrillo Frances Carter Karen Carter Imelda CastañedaEmenaker Tessie Tzavaras Catsambas Sharon Caudle Marge Cawley Melissa Chapman SeriaShia Chatters Scott Chazdon Mei-kuang Chen Lynn Chen Soon Cheon Byeon Karen Childs Pedro Paulo Chrispim Christina Christie Seung Youn Chyung Kristen Cici Nolan Clare Laura Clark Janet Clinton Jamie Coburn Michael Coe Julia Coffman Barry Cohen Benjamin Cohen Sarah Cohn Emil Coman Tiffany Comer Cook Susan Connors Chris L S Coryn Humphrey Costello Bridget Cotner J Bradley Cousins Pamela Cox Mary Crave Senobia Crawford Kara Crohn Jodi Cullum Rebecca Culyba Leigh D'Amico Evangeline Danseco Kamarrie Davis Mende Davis Helen Davis Picher John Daws H Pamela De La Cerda Karen Debrot Lauren Decker Dana DeHart Laura Deitrick Ann Del Vecchio Connie Della-Piana Gabe Della-Piana Amy Dellinger David Devlin-Foltz Caroline DeWitt Marycruz Diaz Rebeca Diaz Virginia Dick Tammiee Dickenson David Diehl David Dobrowski Denece Dodson Joseph Donaldson Stewart Donaldson Vajeera Dorabawila Ann Doucette Malinda Douglas Nevein Dous Linda Drach Mary Drake Christie Drew Wendy DuBow River Dunavin Kristin Duppong Hurley Maryann Durland Sandra Eames Adam Eckerd Ligia Elliot Katrina Ellis Molly Engle Mariana EnriquezOlmos Melissa Evenson Stephanie Evergreen Bellarmine Ezumah Anupa Fabain Didi Fahey Mary Kay Falconer Beverlie Fallik Kevin Favor Laura Feldman David Fetterman Marta Fetterman Leslie Fierro Rita Fierro Pamela Finney Robert Fischer Dreolin Fleischer Lynette Fleming Lisa Flowers Cynthia Flynn Shannon Flynn Susan Foutz Judith Francis Karen Franck Todd Franke James Frasier Pamela FrazierAnderson Kimberly Fredericks Melissa Freeman Stacey Friedman David Frood Stephanie Fuentes Nick Fuhrman Karu Gajaweera Matt Galen Nora Gannon Annette Gardner John Gargani Wendy Garrard Pamela Garrett Charles Gasper Marie Gervais Diane Gibbs Brandi Gilbert Karen Given Larwin Johanna Gladfelter Morariu Fred Glantz Marlene Glassman Rebecca GloverKudon Darlene Goetzman Debora Goldberg Ricardo Gomez Alfredo Gonzalez Cambero Ayo Gooden Warren Gooden Leslie Goodyear June Gothberg Michele Graham Eric Graig Douglas Grane Billie-Jo Grant Nicole Gray Tom Grayson Chad Green Joelle Greene Kari Greene Lija Greenseid James Griffith Gwenn Grondal Luisa Guillemard Amy Gullickson Otto Gustafson Jessica Hafetz Emily Hagstrom Meg Haller Sue Hamann Jennifer Hamilton Marie Hammond Tanis Hampe Mark Hansen Stella Hargett Meg Hargreaves Michael Harnar Raymond Hart Kathy Hayes Kathleen Haynie Barbara Heath Debra Heath Anne Heberger John Hecklinger Ferrari Heidrun Joe Heimlich Sam Held Gerd-Michael Hellstern Barbara Helms Susan Henderson Astrid Hendricks Tabia Henry Akintobi Se Jin Heo Stephanie Herbers Anne Hewitt Sue Hewitt Susan Hibbard Alexandra Hill John Hitchcock Lisle Hites Sheryl Hodge Cheri Hoffman Joann Hoffman Elaine Hogard William Holmes Stafford Hood Rodney Hopson Christopher Horne John Hornik David Hough Duane House Ray Howard Tina Howard Tamika Howell Jeanne Hubelbank Jenica Huddleston Douglas Huffman Bob Hughes Mary Beth Hughes Campbell Richard Hummelbrunner Hsin-Ling Hung Yvonne Hunter Marlene Hurley Marthe Hurteau Claire Hutchings Melanie Hwalek Jari Hyvärinen Marta Induni Jo Ann Intili Jennifer Elise Iriti Miriam Jacobson Nakia James Valerie Janesick Tania Jarosewich Michelle Jay Koralalage Jayaratne Jessica Jerney Jennifer Jewiss Page 10 Beth Johnson Chantall Johnson Elmima Johnson Kelli Johnson Leona Johnson Robert Johnson Andrea Johnston George Julnes Susanne Kaesbauer James Kakooza Leanne Kallemeyn Mustafa Karakus Jacob Kawonga Jacqueline Kaye Kaylor Richardson Kristin Mansoor Kazi Tom Kelly Sarah Kershner Sheila Kessler Teserach Ketema Nicki King Georgia Kioukis Randahl Kirkendall Anita Kliewer Naoto Kobayashi Sarah Kohler Chrestman Shelia Kohn Karen Kortecamp Julien Kouame Howard Kress Richard Kunkel Candace Lacey Robert LaChausse Joan LaFrance Michel Lahti Undurthy Lakshmi Narayana Tony Lam Glenn Landers Ann Landy R Sam Larson David Larwin Karen Larwin John LaVelle Rene Lavinghouze Nikki Lawhorn Tanner LeBaron Wallace Israel Lederhendler Andrea Lee Chris Lee Janet Lee Yoon Been Lee Ligia Leite Kristi Lekies Suzanne LeMenestrel Tara Leung Deborah Lewis Rhonda Lewis-Moss Edward Liebow Cindy Lin Tob Lippin Evaluation 2010 Adele Liskov Sean Little Che-Hao Liu Sunny Liu Shanna Livermore Anna Lobosco Jill Lohmeier Paul Lorton Jr Margaret Lubke Jane Nell Luster Linda Lynch Stephen Magura Janet Mahowski Brigitte Maicher Ayanava Majumdar Sheetal Malhotra Leslie Mandel Colleen Manning Cat Marlow Ian Martin Jennifer Martineau Zoe Masonsong Oliver Massey Linda Masters Sandra Mathison Janet Matulis Ann Maxwell Donna McBey Dominica McBride Sheena McConnell Marci McCoy-Roth Mary McEathron Richard McGahey Mark McGivern Kathleen McKay Tom McKlin Patrick McKnight Ed McLain Shannan McNair Miles McNall Keith McNeil Goutham Menon Gale Menzer Lynn Merkin Stacy Merola Donna Mertens R Gregory Michaels William Michaud Rochelle Michel Jan Middendorf Eleanore Miller M David Miller Dale Miller Hill Cheryl Milloy Christine MinjaTrupin Roger Miranda Rakesh Mohan David Mohr Ruth Mohr Melinda Mollette Bianca Montrosse Angela Moore Garrett Moran Jon Morell Dewayne Morgan Unique Morris Shannon Morrison Dieudonne Mouafo Patricia Mueller April Munson Ottis Murray Carol Mutch Kristina Mycek Barry Nagel Neva Nahan Julius Najab John Nash Randi Nelson Leah Neubauer Frederick Newman James Newman Jan Noga Emma Norland Kathleen Norris Kim Norris Karen Odhiambo Saori Ohkubo Olaoye Olanrewaju Anane Olatunji Pablo Olmos-Gallo So O'niel Carlyn Orians Cheryl Oros Sandra Ortega Rita O'Sullivan Corina Owens Elizabeth Oyer Mehmet Dali Ozturk Dale Pahl Kirimatao Paipa Lyn Paleo Hui-Ling Pan Susan Parker Donna Parrish Serafina Pastore Christine Paulsen Tara Pearsall Daniel Pearson Karen Pendleton Nadini Persaud Rajinder Peshin James Petrovich Carrie Petrucci John Pfaff Nevein Philip Laura Pinsoneault Mary Piontek Paula Plonski Margaret Polinsky Elena Polush Branco Ponomariov Paul Pope Charles Potter Shana Pribesh Ali Protik Roger Przybylski Marylynn Quartaroli Martha Quinn Linnea Rademaker Kalyani Rai Lisa Rajigah Jared Raynor Ehren Reed John Reed Jennifer Reeves George Reinhart Tania Rempert Weijia Ren Rose Ann Renteria Adrian Reyes Jessica Rice Margaret Richardson James Riedel Martina Rillo Otero Rhoda Risner Melissa Rivera Cynthia Roberts-Gray Jane Rodd Joseph Rodriguez Liliana RodriguezCampos Elizabeth Roen Willem Roestenburg Debra Rog Juan Rogers Kate Rohrbaugh Magdalena Rood Audrey Rorrer Denise Roseland Wim Rostenburg Laurie Ruberg Maureen Rubin Jonathan Rubright Stephen Ruffini Craig Russon Katherine Ryan Maurice Samuels Jafeth Sanchez Edgar Sanchez Meenakshi Sankar Tobey Sapiano Sue Ann Sarpy Mildred Savidge Monika Schaffner David Scheie Rhonda Schlangen Evanthia Schmidt Lisa Schmitt Heather Scholz Linda Schrader Daniela Schröter Russell Schuh Diana Seybolt Julie Shaftel Vidhya Shanker Katherine Shaw Jeffrey Sheldon David Shellard Tara Shepperson Scott Sheri Kate Shimshock Gitanjali Shrestha Lyn Shula Juan Shu-Ping Aimee Sickels Mary Siegrist Benjamin Silliman Kisira Simon Gary Skolits Christa Smith Michael Smith Veronica Smith Juna Snow Necole Sommersell John Spence Sarah Stachowiak Robert Stake Kathlyn Steedly Marla Steinberg Nicole Stephens Beth Stevens Joseph Stevens Xuan Stevens Jacqueline Stillisano Ramona Stone Brenda StoneWiggins Sharon Stout Antionette Stroter Jennifer Sullivan Sulewski Sandra Sundeen Stephanie Sutherland Mary Sutter Mary Anne Sydlik Michael Szanyi Laura Tagle Cynthia Tananis Li Tang Michele Tarsilla Erica Taylor George Teather Bing-ru Teh Lois Thiesson Kelly Thomas Yelena Thomas Linda Thurston Katherine Tibbetts Minakshi Tikoo Kate Tinley Kathleen Toms Lisa Townson Keith Trahan Rosanna Tran Jeanette Treiber Tina Trent Suprabha Tripathi Jeannette Truxillo Susan Tucker Aisha Tucker Brown Christina Tuttle Zita Unger Janet Usinger Kim Van Der Woerd Gita Varagoor Stanley Varnhagen Delores Vaughn Rodolfo Vega Jon Vencil Keren Vergon Nicole Vicinanza Ronald Scott Visscher Boris Volkov Gary Walby Elaine Walker Kate Walker Uda Walker Connie Walker-Egea Michael Wallace Lihshing Wang Thomas Ward Lora Warner Yukiko Watanabe Kenneth Watson Hillel Weinberg Staci Wendt Carl Westine Tracy Wharton David White Jianglan White Bessa Whitmore Maria Whitsett Belinda Wholeben Gwen Willems Machteld Willemse Bob Williams Jackie Williams Kaye Lori Wingate Linda Winges Werner Wittmann Mike Wolf-Branigin Susan Wolfe Cindy Wong Anne Worthington Mary Worzala Francesca Wright Yiyan Wu Biligi Yakup Kai Chi Yam Mika Yamashita Bo Yan Ching Ching Yap SeungJun Yoo Jennifer Young Ping Yu Hugh Yuan Ronda Zakocs Karen Zannini Bull Jie Zhang Jinhai Zhang Jing Zhao Kristen Zimmerman Debbie Zorn Brian Zuckerman Keith Zvoch Victor Zvonnikov Page 11 Professional Development Workshops Professional development workshops precede and follow the conference. They require a separate registration fee and are filled on a first-come, first-served basis. We expect that most of the workshops will be full prior to the event. For those workshops that have not filled, on-site registration is available in San Antonio. Rooms are assigned at the conference and appear on your conference nametag. Full descriptions of these workshops may be found online or requested from the registration desk. Since most people have pre-registered for workshops, the full descriptions are not included in this program but may be found online or at the registration desk. Two-day Workshops, Monday and Tuesday, November 8 and 9, 9 am to 4 pm 1. Qualitative Methods in Evaluation, with Raymond Maietta 2. Quantitative Methods for Evaluators, with Katherine McKnight 3. Evaluation 101: Intro to Evaluation Practice, with John McLaughlin 4. Logic Models for Program Evaluation and Planning, with Thomas Chapel 5. Participatory Evaluation, with Jean King and Laurie Stevahn 6. Consulting Skills for Evaluators: Getting Started, with Gail Barrington 7. Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use, with Michael Quinn Patton 8. Building Evaluation Capacity of Community Organizations, with Ellen Taylor-Powell Tuesday Workshops, November 9, 9 am to 4 pm 9. Reconceptualizing Evaluation, with Michael Scriven 10. Experimental and Quasi-experimental Designs for Evaluation, with Chris Coryn 11. RealWorld Evaluation: Practical Tips for Doing Evaluation in Spite of Constraints, with Jim Rugh 12. Advanced Focus Group Moderator Training, with Nancy-Ellen Kiernan 13. Introduction to GIS and Spatial Analysis in Evaluation, with Arlene Hopkins and Stephen Maack 14. Systems Thinking and Evaluation Practice: Tools to Bridge the Gap, with Noga, Hargreaves, Hummelbrunner and Williams 15. Creative Surveys to Measure Performance and Assess Needs, with Michelle Kobayashi 16. Longitudinal Analysis Using Structural Equation Models, with Manuel Voelkle and Werner Wittmann Wednesday Full Day Workshops, November 10, 8 am to 3 pm 17. Collaborative Evaluations: A Step-by-Step Model for the Evaluator, with Liliana Rodriguez-Campos 18. Needs Assessment, with James Altschuld and Jeffry White 19. Logic Models - Beyond the Traditional View, with Jonathan Morell 20. Transformative Mixed Methods Evaluations, with Donna Mertens and Katrina Bledsoe 21. How to Prepare an Evaluation Dissertation Proposal, with Nick Smith 22. Utilization-focused Evaluation, with Michael Quinn Patton 23. Advanced Topics in Concept Mapping for Evaluation, with Mary Kane 24. Evaluating Organizational Collaboration, with Rebecca Woodland 25. Using Effect Size and Association Measures in Evaluation, with Jack Barnette Evaluation 2010: Pre- and Post-Conference Workshops Page 12 Wednesday Full Day Workshops, November 10, 8 am to 3 pm, continued 26. Canceled 27. Multilevel Models in Program and Policy Evaluation, with Sanjeev Sridharan 28. Getting Actionable Answers for Real-World Decision Makers, with E Jane Davidson 29. Theory-driven Evaluation for Assessing and Improving Planning, Implementation, and Effectiveness, with Huey Chen 30. Identifying, Naming, Measuring and Interpreting Racism in Contexts of Evaluations, with Pauline Brooks 31. Navigating the Waters of Evaluation Consulting Contracts, with Kristin Huff 32. Survey Design 101, with Courtney Malloy and Harold Urman 33. Operations Research (OR) Techniques for Program Evaluation, with Edith Cook 34. Tools for Integrating System Dynamics and System Intervention Elements,with Margaret Hargreaves and Bevery Parsons 35. Social Network Analysis: Theories, Methods, and Applications, with Kimberly Fredericks 36. Practical Propensity Score Analysis, with Jason Luellen and MH Clark 37. Qualitative Tools for Deeper Understanding, with Deborah Potts Wednesday Half Day Workshops, November 10, 8 am to 11 am 38. Empowerment Evaluation, with David Fetterman 39. Rethinking Fidelity of Implementation (FOI), with Jeanne Century 40. Practical Strategies for Moderating Meaningful Focus Groups, with Robert Kahle 41. Nonparametric Statistics: When Your Data is Skewed or Your Sample Size is Small, with Jennifer Camacho Catrambone 42. Increasing 'Interpersonal Validity' and Ethical Practice: An Integral Evaluator Model, with Hazel Symonette 43. Impact Evaluation of International Development Programs: The Heifer Hoofprint Model, with M Scriven, T Chianca, & R Kern Wednesday Half Day Workshops, November 10, 12 pm to 3 pm 44. An Executive Summary is Not Enough: Effective Reporting Techniques for Evaluators, with Kylie Hutchinson 45. Integrated Data Analysis in Mixed Methods Evaluation, with Jennifer Greene 46. The Basics of Using Theory to Improve Evaluation Practice, with Stewart Donaldson and John LaVelle 47. The Tools and Techniques of Gender Responsive Evaluation, with M Bamberger, K Bowen, B San Luque, and T Catsambas 48. Methods for Evaluating RTD Projects and Programs with Gretchen Jordan, Rosalie Ruegg, and Cheryl Oros 49. Cost-Effectiveness Analysis of Health and Human Services Programs, with Edward Broughton Sunday Half Day Workshops, November 14, 9 am to 12 pm 50. Doing Cost-Inclusive Evaluation: We Should, You Can, and Here's How, with Brian Yates 51. Hearing Silenced Voices: Using Visual Methods to Include Traditionally Disenfranchised Populations, with Linda Lee 52. Participatory Program Implementation Tools for Evaluators and M&E Personnel, with Scott Yetter and Carlene Baugh 53. Purposeful Program Theory, with Patricia Rogers 54. Data Preparation and Management, and Allison Minugh, Susan Janke and Nicoletta Lomuto Evaluation 2010: Pre- and Post-Conference Workshops Page 13 Notes: Evaluation 2010: Pre- and Post-Conference Workshops Page 14 Wednesday, November 10, 2010: Overview of Schedule 7:00 am to 6:30 pm Registration Desk Open 8:00 am to 5:00 pm Exhibits Open at Exhibitor Discretion 8:00 am to 11:00 am Professional Development Workshops (Require separate registration) 12:00 pm to 3:00 pm Professional Development Workshops (Require separate registration) 3:15 pm to 4:15 pm Opening Plenary 4:30 pm to 6:00 pm Concurrent Conference Sessions 6:10 pm to 6:40 pm Orientation for First Time Attendees and New Members 6:30 pm to 8:00 pm AEA Poster Exhibition and Reception My Schedule: Evaluation 2010: Wednesday, November 10 Page 15 Summary of Sessions for Wednesday, November 10, 4:30 PM to 6:00 PM No Primary Sponsor Type Session Title Room 102 Presidential Strand Panel Improving the Quality of Evaluation Practice by Attending to Context Lone Star A 103 Indigenous Peoples in Evaluation TIG Skill-building Waawiyeyaa (Circular) Evaluation Tool Lone Star B 104 Collaborative, Participatory & Empowerment Panel Building a Learning Culture Within Community Initiatives and Organizations Lone Star C 105 Non-profit and Foundations Evaluation TIG Think Tank Successful Outcome Measurement in Nonprofits: Overcoming Challenges Lone Star D 106 Quantitative Methods: Theory and Design TIG Panel Place Randomized Trials and Alternatives in a Field Setting: Examples From Psychotherapy Research Lone Star E 107 Cluster, Multi-site & Multi-level Evaluation TIG MultiPaper Balancing Autonomy and Uniformity in a Multi-site Evaluation: Evaluation of Program Integration Efforts at the CDC Lone Star F 108 Distance Education & Other Ed Technologies Roundtable Rotation I: Using Technological Pedagogical Content Knowledge and an Evaluation Framework to Evaluate Online Courses… Rotation II: REMOTE Messages: The Job Value of a Distance Learning Graduate Program for the Pacific Region Mission A 109 Mixed Methods Evaluation TIG Roundtable Rotation I: Increasing Nonprofit Sustainability Activities With Effective RFP's: A Mixed Methods Evaluation… Rotation II: Improving the Process of Reviewing Research Proposals: Reflections of a Research Review Committee Mission B 110 Systems in Evaluation TIG Skill-building A Tool for Designing Evaluations of Paradigm Shifts in Complex System Interventions Bowie A 111 Multiethnic Issues in Evaluation TIG Mega-roundtable Maximizing Our Collective Talent: Conversations With Senior Evaluators Bowie B 112 Advocacy and Policy Change TIG MultiPaper Understanding, Building, and Evaluating Advocacy Capacity Bowie C 113 Government Evaluation TIG Roundtable Rotation I: A Conceptual Framework to Assess the Sustainability of Community Coalitions Post-Federal Funding Rotation II: Using Community Partnerships to Reach Hard-to-Reach Populations in Health-Related Evaluations Goliad 114 Quantitative Methods: Theory and Design TIG Roundtable Rotation I: Non-response Bias a Limitation: Practical Perspectives of Evaluation Quality Using Survey and Questionnaire Data Rotation II: Coding Open-Ended Survey Items: A Discussion of Codebook Development and Coding Procedures San Jacinto 115 Assessment in Higher Education TIG Multipaper Assessing Student Learning Outcomes I: Incorporating Feedback Travis A 116 Integrating Technology Into Evaluation Multipaper Viabilities of Technologies in Evaluation Research Travis B 117 Needs Assessment TIG Multipaper Planning Programs: Allocating Scarce Resources Based on Needs Assessment Travis C 118 Health Evaluation TIG MultiPaper Emerging Strategies and Tools for Evaluating Environmental and Policy Change Approaches to Chronic Disease Prevention Travis D 119 Human Services Evaluation TIG MultiPaper Are Universal School-based Prevention Programs Effective? It Depends on the Students and Outcomes Targeted Independence 120 Quantitative Methods: Theory and Design TIG Panel Innovative Applications of Propensity Scores and Propensity Score Methodology Adjustments to Address Data Constraints Presidio A 121 Org Learning & Evaluation Capacity Bldg Business Meeting TIG Business Meeting and Presentations: Advancing Quality in Evaluation Capacity Building Presidio B 122 Alcohol, Drug Abuse, and Mental Health TIG Skill-building Presidio C Integrating Realist Evaluation Strategies in a SAMHSA System of Care Local Evaluation Evaluation 2010: Wednesday, November 10, 2010 4:30 – 6:00 PM Timeslot Overview Page 16 Summary of Sessions for Wednesday, November 10, 4:30 PM to 6:00 PM, Continued No Primary Sponsor Type Session Title Room 123 Pre-K - 12 Educational Evaluation TIG Roundtable Rotation I: Evaluating the Effects of Year-Long Professional Development on Teachers… Rotation II: Evaluation Quality in Measuring Teacher Quality: The Impact of the Targeted Assistance Coaching Model on LEA… Bonham A 124 Non-profit and Foundations Evaluation TIG Panel The Intersection of Strategy and Evaluation: What Are We Learning? Bonham B 125 Pre-K - 12 Educational Evaluation TIG Panel Managing Quality Through the Stages of Science, Technology, Engineering and Mathematics (STEM) Educational Evaluation Bonham C 126 Pre-K - 12 Educational Evaluation TIG Multipaper Evaluating Supplementary Programs in Educational Settings Bonham D 127 Environmental Program Evaluation TIG Multipaper Environmental and Energy Evaluations: Strategies for Pursuing Innovative Approaches… Bonham E 128 Extension Education Evaluation TIG Panel Standards of Evidence for Evaluating Extension Programs: A Changing Picture? Crockett A 129 Teaching of Evaluation TIG Demonstration Using an Interest-Driven Project to Teach Program Planning and Evaluation Crockett B 130 Graduate Student and New Evaluator TIG Skill-building Networking and Getting Involved With the American Evaluation Association Crockett C 131 Government Evaluation TIG MultiPaper Informing Government Policy Through Evaluation: A Cross-site Evaluation of the Self-Employment Initiative (Start-Up USA) Crockett D 132 International and Cross-cultural Evaluation TIG Multipaper Evaluation and the Complexities of International Financial Assistance Programs Republic A 133 Health Evaluation TIG Panel Evaluation of the Clinical and Translational Science Awards (CTSA) Programs: A Focus on Quality Republic B 134 Collaborative, Participatory & Empowerment Skill-building Round Robin Focus Groups: Participatory Inquiry - From Data Gathering to Reporting in an Hour Republic C Evaluation 2010: Wednesday, November 10, 2010 4:30 – 6:00 PM Timeslot Overview Page 17 Wednesday, 3:15 pm to 4:15 pm 100 – Tensions Among Evaluative Perspectives in the Age of Obama: Influences on Evaluation Quality, Thinking and Values Plenary to be held in Texas A Sponsored by the Presidential Strand Chair - Leslie Cooksy, University of Delaware Presenters – Eleanor Chelimsky, Independent Consultant; Laura Leviton, Robert Wood Johnson Foundation; Michael Quinn Patton, Utilization-Focused Evaluation Wednesday, 4:30 pm to 6:00 pm 102 - Improving the Quality of Evaluation Practice by Attending to Context Panel to be held in Lone Star A Sponsored by the Presidential Strand Chair - George Julnes, University of Baltimore Discussant - Eleanor Chelimsky, Independent Consultant Striving for Truth, Beauty, and Justice in Evaluation Practice: A Methodological Analysis of Contextually Sensitive Practice Debra Rog, Westat Recognizing and Reconciling Differences in Stakeholders‘ Contexts as a Prelude to High Quality Evaluation: The Cases of Cultural and Community Contexts Ross Conner, University of California, Irvine Comparative Evaluation Practice and Politics: The Role of Political Context in Influencing Quality Jody Fitzpatrick, University of Colorado, Denver 103 - Waawiyeyaa (Circular) Evaluation Tool Skill-building Workshop to be held in Lone Star B Sponsored by the Indigenous Peoples in Evaluation TIG Andrea LK Johnston, Johnston Research Inc 104 - Building a Learning Culture Within Community Initiatives and Organizations Panel to be held in Lone Star C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Chair - David Scheie, Touchstone Center for Collaborative Inquiry Discussant - Prudence Brown, Independent Consultant Cultivating a Learning Culture in a Community Development Corporation Kate Tilney, Hope Community Inc Building a Learning Partnership in a Neighborhood Transformation Initiative Sue Tripathi, Making Connections, Denver Developing a Learning and Evaluation Partnership in a Regional Capacity Building Initiative David Scheie, Touchstone Center for Collaborative Inquiry 105 - Successful Outcome Measurement in Nonprofits: Overcoming Challenges Think Tank to be held in Lone Star D Sponsored by the Non-profit and Foundations Evaluation TIG Lora Warner, University of Wisconsin, Green Bay 106 - Place Randomized Trials and Alternatives in a Field Setting: Examples From Psychotherapy Research Panel to be held in Lone Star E Sponsored by the Quantitative Methods: Theory and Design TIG Chair - Lee Sechrest, University of Arizona Discussant - Frederick Newman, Florida International University Evaluating a Feedback System in Ambulatory Psychotherapy Using a Longitudinal Place Randomized Trial Manuel Voelkle, Max-Planck-Institute for Human Development Berlin Evaluating a Feedback System in Ambulatory Psychotheray Using a Classical Pre-Post Test Design With a One Year Follow-up Andrés Steffanowski, University of Mannheim Comparing Two Different Research Designs in Program Evaluation: Problems, Advantages, Pitfalls and Implications for Causal Evidence Werner Wittmann, University of Mannheim 107 - Balancing Autonomy and Uniformity in a Multisite Evaluation: Evaluation of Program Integration Efforts at the Centers for Disease Control and Prevention (CDC) MultiPaper to be held in Lone Star F Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG Chair - Thomas Chapel, CDC On Rowing in the Right Direction: Creating an Evaluation Design for a Program Integration Effort Thomas Chapel, CDC Measuring Program Integration at the State Level: Wisconsin Alison Bergum and Amanda Jovaag, University of Wisconsin Using Social Network Analysis to Measure Integration April Reese and Jennifer Woody, North Carolina Department of Health Evaluation 2010: Wednesday, November 10, 3:15 – 4:15 PM, 4:30 – 6:00 PM Page 18 108 - Roundtables in Mission A The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Distance Education & Other Educational Technologies TIG Rotation 1: Using Technological Pedagogical Content Knowledge and an Evaluation Framework to Evaluate Online Courses and Tools Andrea Velasquez and David D Williams, Brigham Young University Rotation 2: Regional Education Master‘s Online Training in Evaluation (REMOTE) Messages: The Job Value of a Distance Learning Graduate Program for the Pacific Region Charles Giuli, Pacific Resources for Education and Learning (PREL) 109 - Roundtables in Mission B The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Mixed Methods Evaluation TIG and the Pre-K - 12 Educational Evaluation TIG Rotation 1: Increasing Nonprofit Sustainability Activities With Effective Request for Proposals (RFP's): A Mixed Methods Evaluation of RFPs as an Instrument for Success Nakia James, Western Michigan University Rotation 2: Improving the Process of Reviewing Research Proposals: Reflections of a Research Review Committee River Dunavin, Nancy Carrillo, and Ranjana Damle, Albuquerque Public Schools 110 - A Tool for Designing Evaluations of Paradigm Shifts in Complex System Interventions Skill-building Workshop to be held in Bowie A Sponsored by the Systems in Evaluation TIG Beverly A Parsons and Pat Jessup, InSites; Marah Moore, i2i Institute Inc 111 - Maximizing Our Collective Talent: Conversations With Senior Evaluators Mega-roundtable to be held in Bowie B Sponsored by the Multiethnic Issues in Evaluation TIG Tamara Bertrand Jones, Florida State University; Pamela Frazier-Anderson, Lincoln University; Stafford Hood, University of Illinois at Urbana-Champaign; Kevin E Favor, Lincoln University; Elmima Johnson, National Science Foundation; Henry Frierson, University of Florida; Ceasar Jackson, National Science Foundation; Rodney Hopson, Duquesne University; Michelle Jay, University of South Carolina; Katherine A Tibbetts, Kamehameha Schools 112 - Understanding, Building, and Evaluating Advocacy Capacity MultiPaper to be held in Bowie C Sponsored by the Advocacy and Policy Change TIG Chair - Brian Quinn, Robert Wood Johnson Foundation What is Advocacy Capacity? Susan Sherry and Jacquie Anderson, Community Catalyst What Does Advocacy Capacity Mean to Consumer Advocates? Cathy Levine, The Universal Health Care Action Network of Ohio; Elizabeth Doyle, Take Action Minnesota; Kathleen Gmeiner, Universal Health Care Action Network of Ohio Measuring Advocacy Capacity Jung Kim and Debra Strong, Mathematica Policy Research 113 - Roundtables in Goliad The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Roundtable to be held in Goliad Sponsored by the Government Evaluation TIG and the Health Evaluation TIG Rotation 1: A Conceptual Framework to Assess the Sustainability of Community Coalitions Post-Federal Funding Alycia Infante, Jennifer Benz, Hilary Scherer, and Caitlin Oppenheimer, NORC at the University of Chicago; Wilma Tilson, United States Department of Health and Human Services Rotation 2: Using Community Partnerships to Reach Hard-toReach Populations in Health-Related Evaluations Julia Alvarez and Nancy Zuercher, JVA Consulting LLC 114 – Roundtables in San Jacinto The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Quantitative Methods: Theory and Design TIG Rotation 1: Non-response Bias a Limitation: Practical Perspectives of Evaluation Quality Using Survey and Questionnaire Data Michelle Bakerson, Indiana University South Bend Rotation 2: Coding Open-Ended Survey Items: A Discussion of Codebook Development and Coding Procedures Heather Bennett, Joanna Gilmore, and Grant Morgan, University of South Carolina Evaluation 2010: Wednesday, November 10, 4:30 – 6:00 PM Page 19 Wednesday, 4:30 pm to 6:00 pm, continued 115 - Assessing Student Learning Outcomes I: Incorporating Feedback Multipaper to be held in Travis A Sponsored by the Assessment in Higher Education TIG Chair - Jean-Marc Wise, Florida State University Determining the Quality of Student Feedback in Course Evaluations Jean-Marc Wise, Florida State University Student Perceptions of Providing Quality Feedback in Course Evaluations Jean-Marc Wise, Florida State University Maximizing Evaluation Impact in Higher Education: Using Program Evaluation Results to Measure Student Learning Outcomes Joel Heikes and Jeanette Herman, University of Texas, Austin Adding an Evaluative Focus to Assessment of Higher Education Student Learning Outcomes Jeanne Hubelbank, Independent Consultant 116 - Viabilities of Technologies in Evaluation Research Multipaper to be held in Travis B Sponsored by the Integrating Technology Into Evaluation TIG Chair - Margaret Lubke, Utah State University Improving Evaluation Quality Through Use of an Interactive Database Jan Middendorf, Aaron Schroeder, Sarah Bradford, and Valerie York, Kansas State University Lessons Learned From Using Technology to Increase Study Participation Among Child Welfare Service Recipients Lara Kaye, Center for Human Services Research; Lynn Warner, State University of New York at Albany; Rose Greene and Corinne Noble, Center for Human Services Research Database Use in Evaluation Research: Opportunities and Challenges for Supporting Continuous Improvement of Partnerships, Programs, and Projects William R Penuel and Barbara Means, SRI International Evaluating Technology in Health Care: Testing the Usability of a Clinical Trial Query Tool Using Think Aloud Methods Stuart Henderson, Estella Geraghty, and Julie Rainwater, University of California, Davis Women Religious in a Changing Urban Landscape Rob Fischer, and Jenni Bartholomew, Case Western Reserve University Evaluation Learning Needs, Assets, and Interests of National Science Foundation (NSF) Principal Investigators and Evaluators Daniela Schroeter, Western Michigan University; Alyssa Na'im, Education Development Center; and Lori Wingate and Mohammed Alyami, Western Michigan University Needs Assessment as a Precursor to Quality Program and Evaluation of the Mt. Healthy Ohio Mathematics and Science Partnership (OMSP) Program Imelda Castañeda-Emenaker, University of Cincinnati; Hsin-Ling Hung, University of North Dakota; Ted Fowler and Kathie Maynard, University of Cincinnati 118 - Emerging Strategies and Tools for Evaluating Environmental and Policy Change Approaches to Chronic Disease Prevention MultiPaper to be held in Travis D Sponsored by the Health Evaluation TIG Chair - Nicola Dawkins, ICF Macro Discussant - Laura Leviton, Robert Wood Johnson Foundation Shifting Landscapes: Overview of Environmental and Policy Change Approaches and Measurement Tools for Chronic Disease Prevention Dana Keener and Amber Robinson, ICF Macro Evaluating New York City Daycare Regulations to Prevent Childhood Obesity Kenneth Goodman, ICF Macro; Lillian L Dunn, New York City Department of Health and Mental Hygiene; L Beth Dixon, New York University; Nicola Dawkins and Andrew Breck, ICF Macro; Laura Lessard, Emory University; and Laura Leviton, Robert Wood Johnson Foundation Evaluating Efforts to Impact Federal Transportation Policy Nicole Lezin, Cole Communications Inc Did you know? There are 636 Sessions on this year‘s conference program. 117 - Planning Programs: Allocating Scarce Resources Based on Needs Assessment Multipaper to be held in Travis C Sponsored by the Needs Assessment TIG Chair - Sue Hamann, National Institutes of Health Discussants - James Altschuld, The Ohio State University; and Sue Hamann, National Institutes of Health Evaluation 2010: Wednesday, November 10, 4:30 – 6:00 PM Page 20 119 - Are Universal School-based Prevention Programs Effective? It Depends on the Students and Outcomes Targeted MultiPaper to be held in Independence Sponsored by the Human Services Evaluation TIG Chair - Wendy Garrard, University of Michigan Discussant - Ann Doucette, George Washington University Second Step Violence Prevention: A Meta-analysis of Thirty Treatment\Control Studies Stephanie Reich, University of California, Irvine; and Wendy Garrard, University of Michigan I Can Problem Solve: A Meta-analysis of 25 Treatment\Control Studies Sarah Domoff, Bowling Green State University; Wendy Garrard, University of Michigan; and Stephanie Reich, University of California, Irvine Conflict Resolution Education: A Meta-analysis of 60 Treatment\Control Studies Wendy Garrard, University of Michigan 120 - Innovative Applications of Propensity Scores and Propensity Score Methodology Adjustments to Address Data Constraints Panel to be held in Presidio A Sponsored by the Quantitative Methods: Theory and Design TIG Chair - Vajeera Dorabawila, New York State Office of Children and Family Services Discussant - MH Clark, University of Central Florida A Step-by-Step Application of Propensity Score Matching With ACT Data Oksana Wasilik and Anita Drever, University of Wyoming Multiple Imputation and Propensity Scores Matching to Address Data Constraints in Constructing a Control Group to Evaluate an Intervention to Reduce Recidivism of Juvenile Delinquents Released From Residential Facilities Vajeera Dorabawila, Leigh Bates, Susan Mitchell-Herzfeld, Therese Shady, and Do Han Kim, New York State Office of Children and Family Services An Innovative Use of Propensity Score Matching to Evaluate Alcoholics Anonymous‘ Effect on Drinking Stephen Magura, Western Michigan University 121 – Organizational Learning and Evaluation Capacity Building TIG Business Meeting and Presentations: Advancing Quality in Evaluation Capacity Building Business Meeting to be held in Presidio B Sponsored by the Organizational Learning and Evaluation Capacity Building TIG TIG Leaders - Michelle Baron, The Evaluation Baron LLC; Gary Skolits, University of Tennessee, Knoxville; Stephen J Ruffini, Wested; Megan Bennett, Training Evaluation and Metrics Chairs - Michelle Baron, The Evaluation Baron LLC; and Gary Skolits, University of Tennessee, Knoxville Evaluation Capacity and Quality in Evaluation: Exploring Interrelations Sebastian Lemire and Steffen Bohni Nielsen, Rambøll Management Consulting What, Me Evaluate? Building the Evaluation Capacity of School District Personnel Patricia Lauer, Rocky Mountain Center for Health Promotion and Education 122 - Integrating Realist Evaluation Strategies in a Substance Abuse and Mental Health Services Administration (SAMHSA) System of Care Local Evaluation Skill-building Workshop to be held in Presidio C Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG Mansoor Kazi, State University of New York at Buffalo; Connie Maples, ICF Macro; Rachel Ludwig, Chautauqua Tapestry 123 – Roundtable in Bonham A Sponsored by the Pre-K - 12 Educational Evaluation TIG Evaluating the Effects of Year-Long Professional Development on Teachers: Final Refinement of the University of California, Los Angeles (UCLA) Center X and Social Research Methodology (SRM) Evaluation Group Teacher Pre/Post Survey Nicole Gerardi and Janet Lee, University of California, Los Angeles 124 - The Intersection of Strategy and Evaluation: What Are We Learning? Panel to be held in Bonham B Sponsored by the Non-profit and Foundations Evaluation TIG Chair - Sarah Stachowiak, Organizational Research Services Discussant - Julia Coffman, Center for Evaluation Innovation Perspectives From Hallie Preskill, Foundation Strategy Group (FSG) Social Impact Advisors Hallie Preskill, Strategic Learning & Evaluation Center Perspectives From Lance Potter, Bill & Melinda Gates Foundation Lance Potter, Bill & Melinda Gates Foundation Strategy, Evaluation and Strategic Learning at the Packard Foundation, Perspectives From Gale Berkowitz Gale Berkowitz, David and Lucile Packard Foundation Perspectives From Mayur Patel, Knight Foundation Mayur Patel, John S and James L Knight Foundation Perspectives From Organizational Research Services Sarah Stachowiak, Organizational Research Services Perspectives from Tom Kelly, Annie E Casey Foundation Thomas Kelly, Annie E Casey Foundation Evaluation 2010: Wednesday, November 10, 4:30 – 6:00 PM Page 21 Wednesday, 4:30 pm to 6:00 pm, continued 125 - Managing Quality Through the Stages of Science, Technology, Engineering and Mathematics (STEM) Educational Evaluation Panel to be held in Bonham C Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Leslie Goodyear, National Science Foundation Planning for Quality: Balancing Partner Needs in a Multi-site Evaluation of Science Education Ardice Hartry, University of California, Berkeley Relation of Data Quality and Participant Burden in a Sciencecentered Leadership Evaluation Design Juna Snow, University of California, Berkeley Not My Plan: Executing Someone Else‘s Analysis Design While Balancing Partner Needs and Communicating Useable Findings Ellen Middaugh, University of California, Berkeley Attention to Quality in Reporting Evaluation Findings in STEM Education Programs Bernadette Chi, University of California, Berkeley 126 - Evaluating Supplementary Programs in Educational Settings Multipaper to be held in Bonham D Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Sheila A Arens, Mid-Continent Research for Education and Learning Discussant - Javan Ridge, Colorado Springs School District 11 Aligning Evaluation Tools in Curriculum and Non-curriculumbased After School Programs Kelly Murphy, Tiffany Berry and Krista Collins, Claremont Graduate University Understanding Bullying Program Implementation Benjamin Cohen and Heather Cecil, Center for Schools and Communities The Playworks Evaluation: A Randomized Study of a Schoolbased Intervention to Promote Physical Activity and Play Daniel Finkelstein, Susanne James-Burdumy, and Martha Bleeker, Mathematica Policy Research Quality Assessment of Woodcraft Rangers After-School Program: Challenges and Solutions Lisa Garbrecht, EVALCORP, Cathie Mostovoy, Woodcraft Rangers; Julie Slay, Kristen Donovan, and Mona Desai, EVALCORP 127 - Environmental and Energy Evaluations: Strategies for Pursuing Innovative Approaches That Demonstrate Impact, Promote Continuous Improvement and Foster Organizational Learning Multipaper to be held in Bonham E Sponsored by the Environmental Program Evaluation TIG Chair - Mary McEathron, University of Minnesota Adapting Interdisciplinary Methods to Evaluate the Social Outcomes of Environmental Programs: Five Lessons from Minnesota Karlyn Eckman, University of Minnesota; Erika Rivers, Minnesota Department of Natural Resources; Kimberly Nuckles, Minnesota Pollution Control Agency; Valerie Were, University of Minnesota Methodological Reflections and Organizational Learning Generated by a Qualitative Evaluation of a Leadership Development Program of the United States National Park Service Jennifer Jewiss, University of Vermont; Daniel Laven and Nora Mitchell, National Park Service Continuous Improvement in Energy Efficiency: Helping Clients Shift From One-Shot Evaluations Towards Assessing the Effectiveness Within and Across Programs Marjorie McRae and Jane Peters, Research Into Action 128 - Standards of Evidence for Evaluating Extension Programs: A Changing Picture? Panel to be held in Crockett A Sponsored by the Extension Education Evaluation TIG Chair - Nicki King, University of California, Davis Randomized Trials in Extension Evaluation: How Big a Tool in the Tool Chest? Marc Braverman, Oregon State University Cooperative Extension Programs‘ Capacity to Produce Evidence of Effectiveness Suzanne Le Menestrel, United States Department of Agriculture The Role of Evidence in Building Mature Program Theory Roger Rennekamp, Oregon State University 129 - Using an Interest-Driven Project to Teach Program Planning and Evaluation Demonstration to be held in Crockett B Sponsored by the Teaching of Evaluation TIG David Diehl, University of Florida Evaluation 2010: Wednesday, November 10, 4:30 – 6:00 PM Page 22 130 - Networking and Getting Involved With the American Evaluation Association 133 - Evaluation of the Clinical and Translational Science Awards (CTSA) Programs: A Focus on Quality Skill-building Workshop to be held in Crockett C Sponsored by the Graduate Student and New Evaluator TIG Nicole Cundiff, University of Alaska, Fairbanks; and Cady Berkel, Arizona State University MultiPaper to be held in Crockett D Sponsored by the Government Evaluation TIG Chair - Teserach Ketema, United States Department of Labor Discussant - Richard Horne, United States Department of Labor Evaluation of Research Demonstration Programs: Self Employment Richard Horne, United States Department of Labor Cross-site Evaluation of Start-Up USA: Self-Employment for People With Disabilities Doug Klayman, Social Dynamics LLC Evaluation Methodology and Factors Contributing to Entrepreneurial Success Laura F Skaff, Altarum Institute Panel to be held in Republic B Sponsored by the Health Evaluation TIG Chair - D Paul Moberg, University of Wisconsin Discussant - William M Trochim, Cornell University Using the Program Evaluation Standards, Third Edition, to Investigate and Improve CTSA Program Evaluation Emily Lai, Melissa Chapman, and Donald Yarbrough, University of Iowa External Advisory Committee Recommendations Incorporated Into Utilization-Focused Evaluation Janice A Hogle, D Paul Moberg, and Christina Spearman, University of Wisconsin, Madison; and Jennifer L Bufford, Marshfield Clinic In-depth Interviews With CTSA Investigators: Contributions to Quality Evaluation Christine Weston and Jodi B Segal, Johns Hopkins University Linking Clinical and Translational Science Evaluation Purpose to Quality Christine Minja-Trupin, Meharry Medical College ―And So It Is Written‖: Publication Data as a Measure of Quality and the Quality of Publication Data as an Evaluative Tool Cathleen Kane, Cornell University 132 - Evaluation and the Complexities of International Financial Assistance Programs 134 - Round Robin Focus Groups: Participatory Inquiry - From Data Gathering to Reporting in an Hour 131 - Informing Government Policy Through Evaluation: A Cross-site Evaluation of the SelfEmployment Initiative (Start-Up USA) Multipaper to be held in Republic A Sponsored by the International & Cross-cultural Evaluation TIG Chair - Zenda Ofir, Evalnet South Africa A Look Inside Development: What Do the Monitoring and Evaluation Framework Designs of Foreign-Funded Urban Development Programs in Metro Manilla, Philippines Reveal? Romeo Santos, University of the Philippines Does Aid Evaluation Work? Meta-evaluation of Aid Evaluation Quality Ryoh Sasaki, International Development Center of Japan; Paul Clements, Western Michigan University; Michael Scriven, Claremont Graduate University; and Liliana RodriguezCampos, University of South Florida Evaluation of the Performance-based Concessionary Resources Allocation Systems of the Multilateral Development Banks and Funds Kenneth Watson, International Monetary Fund Improving Development Evaluation Product Quality in Africa: Experience From the African Development Bank Foday Turay, James Edwin, Mohamed Manai, and Colin Kirk, African Development Bank Doing Better at Doing Well by Doing Good: Evaluating Corporate Social Responsibility Projects in Developing Countries Catherine Elkins, RTI International Skill-building Workshop to be held in Republic C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Cynthia Tananis, and Cara Ciminillo, University of Pittsburgh Wednesday, 6:10 pm to 6:40 pm First Time Attendee and New Member Orientation Orientation to be held in Lone Star A Join us for this short orientation to the conference and the association in order to make the most of the event. We will then proceed to the evening‘s reception and poster exhibition. Evaluation 2010: Wednesday, November 10, 4:30 – 6:00 PM, 6:10 – 6:40 PM Page 23 Wednesday, 6:30 pm to 8:00 pm 137 - Opening Reception, Poster Exhibition, and Meet the Authors Exhibition to be held in Texas A Admission to the Reception and Poster exhibition is included in conference registration. All attendees are encouraged to attend, to view the work represented in over 150 poster presentations, to meet the authors at our author tables, and to build your professional network in this social setting. This is the most widely attended event of the conference and we hope to see you there. Colleagues from the Visitor Studies Association will be performing a live demonstration during the Poster Exhibition – look for their display at the front of the ballroom to learn more Evaluation in Action Skill-building: Tracking and Timing With the Visitor Studies Association Cheryl Kessler, Independent Consultant; Joe E Heimlich, Ohio State University; Carey Tisdal, Tisdal Consulting; Cláudia Figueiredo, Institute for Learning Innovation; and Kathleen Tinworth, Denver Museum of Nature & Science Poster 1: A Quantitative Approach to Program Dosage and Fidelity for Substance Abuse and Mental Health Treatment Programs Robert Orwin, Westat; Carrie Petrucci, Evaluation, Management & Training Associates Inc; and Timothy Ho, University of California, Los Angeles Poster 2: Strategies for Quantitative Analysis of Student and Teacher Longitudinal Outcomes in K-12 Settings Amy Overbay, Melinda Mollette, and Shevaun Neupert, North Carolina State University Poster 3: Using Network Analysis in the Evaluation of Community Partnership Building Heather Clark, Monica Wendel, and Corliss Outley, Texas A&M University Poster 4: Evaluating Nursing Education at the Program Level Susan Forneris, Suellen Campbell, Vicki Schug, Linda Blazovich, Suzanne Lehman, and Linda Blazovich, St Catherine University Poster 5: Using Technology to Improve Collaboration and Stakeholder Communication Anna de Guzman, Laricia Longworth-Reed, and Kathryn Schroeder, University of Denver Poster 6: Conducting Comprehensive Workforce Assessments of Public and Tribal Child Welfare Agencies: Lessons Learned Kathryn Schroeder, Laricia Longworth-Reed, Anna de Guzman, Sheridan Green, Julie Morales, Robin Leake, University of Denver; and Joe Walker, Native American Training Institute Poster 7: The DoView Generic Outcomes Model for a Country: A Generic Outcomes Model From Which You Can Borrow Parts to Quickly Build Your Own Outcomes Models (Logic Models) Paul Duignan, Parker Duignan Consulting Poster 8: How to Quickly Assess the Quality of Any Performance Indicator List Paul Duignan, Parker Duignan Consulting Poster 9: Best Practices for Web-based Surveys Deborah K Lewis, Ohio State University Poster 10: Educator Sexual Abuse in Virginia: A Policy Study Billie-Jo Grant, University of Virginia Poster 11: The Impact of Food Supplementation on Infant Weight Gain in Rural Bangladesh: An Assessment of the Bangladesh Integrated Nutritional Program (BINP) Begum Housne, University of Dhaka; and Mascie Taylor, University of Cambridge, United Kingdom Poster 12: Evaluation and Organizational Learning and Use Fahad Khan, Catholic Relief Services Poster 13: The Matthew Effect: Enhancing Internal Evaluation Credibility Using an External Regulatory Instrument William Cabin, Richard Stockton College Poster 14: Strategies and Principles Which Guide the Work of the Staff in Branco Weiss Schools for Youth at Risk: What Have We Learned From Our Successes and Identifying Future Challenges? Chen Lifshitz and Michal Yaacov, Branco Weiss Institute Poster 15: Lessons Learned in the School Evaluations: An Evaluation of a Counter-Marketing Student-Led Campaign to Decrease Sedentary Behavior and Fast Food Intake Among Fourth and Fifth Grade Students Mary Martinasek and Karen Perrin, University of South Florida; and Marisa Mowat and Melanie Hall, St Joseph's Children's Advocacy Center; Dewey Carouthers, 180 Degree Change Poster 16: Methods of Monitoring and Evaluation of Community Projects Ngole Masango Eugene, Non-governmental Organization (NGO) Poster 17: Dimensions in Self-Assessment Research Tony Lam, University of Toronto Poster 18: Heroin Dependent Offenders‘ Assessment of Buprenorphine Versus Methadone Treatment in Jail Ezechukwu Awgu and Stephen Magura, Western Michigan University; Andrew Rosenblum, National Development and Research Institutes (NDRI) Poster 19: An Evaluation Coaching Model That Encourages Prolonged Stakeholder Involvement Tania Rempert, University of Illinois at Urbana-Champaign Poster 20: Are Natural Family Planning Methods Viable Birth Control Options? Providers and Clients Perspectives Afsaneh Rahimian, Karen Deluhosh, Sarah Goldenkranz, and David Fine, Center for Health Training Evaluation 2010: Wednesday, November 10, 6:30 – 8:00 PM Exhibition Page 24 Poster 21: Leading in the New Learning Ecology: A Leadership Framework for Technology Innovation Projects in Schools Jenifer Corn, North Carolina State University Poster 22: Iterative Reasoning: The Art of Determining Good Enough Karen Zannini Bull, Syracuse University Poster 23: The Critical Role of Process Evaluation in Telling the Story Linda Winges, Battelle Memorial Institute; Margaret J Gunter, LCF Research; Judith Lee Smith, Centers for Disease Control and Prevention; Katarzyna Alderman, Gary Chovnick, and Susan Pearce, Battelle Memorial Institute; April Salisbury, LCF Research; Deirdre Shires, Henry Ford Health System; Danuta Kasprzyk and Daniel Montano, Battelle Memorial Institute; and Jennifer Elston Lafata, Virginia Commonwealth University Poster 24: External Validity: Documenting Replicability and Transferability in Technology Programs Meghan Morris and Kevin Murphy, State University of New York at Albany Poster 25: Using Qualitative Methods to Assess Effectiveness of a Public-Private Collaboration to Ensure Healthy and Active Living Through Land Use Marina Kaplan, Patricia Miller, and Gregory Benjamin, Nemours Health and Prevention Services Poster 26: Healthy Eating and Physical Activity Policy and Practice Changes in Delaware Schools: 2006 - 2008 Gregory Benjamin, Vonna Drayton, and Zhongcui Gao, Nemours Health and Prevention Services Poster 27: Caught in the Middle: Turning Around Middle School Performance Gary Timko, Community Research Partners Poster 28: Participatory Evaluation for Organizational Learning in an Inquiry-based Chemistry Laboratory Curriculum Hui-Jung Chen and Mei-Hung Chiu, National Taiwan Normal University Poster 29: Evaluation of a Social Justice Leadership Institute in Higher Education: Learning From the First Year Nicole Cundiff, University of Alaska, Fairbanks; Roy Joy, Jennifer Beckjord, and Andrea Coulter, Southern Illinois University Carbondale Poster 30: Economic Analysis of National Research and Development (R&D) Program Developing a Geostationary Satellite: The Case of Korea Yoon Been Lee, Jiyoung Park, and Jiho Hwang, Korea Institute of Science & Technology Evaluation and Planning (KISTEP) Poster 31: Developing Quality Assessments of Observational Research John Pfaff, Fordham Law School Poster 32: An Evaluation of a Capacity Building Performance Management Project: Results From the First Two Years Lauren Decker and Leslie Grunden, Edvance Research Poster 33: New Logic Model Approach Fayez Shafloot, Western Michigan University Poster 34: Embracing the Context of Pediatric Rehabilitation Programs: A Survey Investigating the Role of Family-Centered Philosophy in Program Evaluation Katherine Moreau and J Bradley Cousins, University of Ottawa Poster 35: Using Case Studies to Assess Promising Practices and Lessons Learned in Comprehensive Evaluations of Multilevel Tobacco Control and Childhood Obesity Interventions Jenica Huddleston, University of California, Berkeley Poster 36: Evaluation is a Program Requirement, Now, How Do You Ensure Quality? Evaluation Technical Assistance: An Approach for Center for Disease Control and Prevention's (CDC) National Heart Disease and Stroke Prevention Program Eileen Chappelle and Diane Dunet, Centers for Disease Control and Prevention Poster 37: Overcoming Authoritarian Approach to School Evaluation: Systemic Change Towards Democratization - Polish Case Grzegorz Mazurkiewicz, Jagiellonian University Poster 38: Applying Program Evaluation Standards to Improve Education Through Meta-evaluation: The Brazilian Experience Thereza Penna-Firme and Ana Carolina Letichevsky, Cesgranrio Foundation Poster 39: Creating Sustainable Structural Changes in State Mental Health and Substance Abuse Systems: Findings From the National Evaluation of the Substance Abuse and Mental Health Services Administration‘s (SAMHSA) Co-occurring State Incentive Grant Program John Hornik, Advocates for Human Potential Poster 40: The Importance of Context in Understanding Career Academies: A Case Study Approach Bridget Cotner, Maressa Dixon, Margaret Allsopp, TashaNeisha Wilson, Margeaux Chavez, and Kathryn Borman, University of South Florida Poster 41: National Institute of Environmental Health Sciences (NIEHS) Small Grants: Do They Lead Down the Intended Path? Jerry Phelps and Elizabeth Ruben, National Institute of Environmental Health Sciences; Joshua D Schnell and Duane E Williams, Discovery Logic Poster 42: The Road to Behavior Change is Both Bumpy and Smooth: Barriers and Facilitators of Patient Safety Training Outcomes Kristina Moster, Stacey Farber, and Britteny Howell, Cincinnati Children's Hospital Medical Center Poster 43: Using Bibliometric Information for Benchmarking and Research and Development (R&D) Portfolio Management Brian Zuckerman, Science and Technology Policy Institute; and Kevin Wright and Brandie Taylor, National Institutes of Health Evaluation 2010: Wednesday, November 10, 6:30 – 8:00 PM Exhibition Page 25 Poster 44: Evaluation Capacity Building at the National Institute of Allergy and Infectious Diseases (NIAID): One Block at a Time Brandie K Taylor, Tarsha McCrae, and Kevin Wright, National Institutes of Health Poster 45: One Central Florida School District‘s Efforts to Help Struggling Readers: An Evaluation of the Effectiveness of the READ 180 Reading Intervention Program on Student Achievement and Student Perceptions on Reading Yakup Bilgili, Polk County Public Schools Poster 46: Evaluating Program Impact in Alignment With Cultural Expectations of Success Leigh D'Amico and Robert Petrulis, University of South Carolina; and Cynthia Bolton-Gary, University of South Carolina, Beaufort Poster 47: Lessons Learned Coordinating Evaluations of Multisite Community-based Initiatives Laurie Carpenter and Martha Quinn, University of Michigan Poster 48: Using Mixed Methods to Develop and Evaluate a Safe-Ride Program for Tweens Krystall Dunaway, Kelli Will, and Edward Lorek, Eastern Virginia Medical School Poster 49: The Texas Strategic Prevention Framework State Incentive Grant (SPF-SIG): How the Keep It Simple Stupid (KISS) Principle Works in Evaluation Daniel Jorgensen, Texas A&M University Poster 50: Effect of Read180 Program on Incarcerated Youth‘s Reading Performance: An Evaluation Study Weijia Ren, William Loadman, Raeal Moore, Jing Zhao, Deborah Kwon, and Charles Okonkwo, The Ohio State University Poster 51: Using Developmental Evaluation to Inform Development of a Complex Education Program Gretchen Biesecker, City Year Inc; Belle Brett, Brett Consulting Group; Kathryn Race, Race & Associates Ltd; and Dannalea D'Amante, City Year Inc Poster 52: A Person-Oriented Approach to Evaluation: Profiles of Young Adult Volunteers in a National Nonprofit Gretchen Biesecker and Tavia Lewis, City Year Inc Poster 53: Enhancing Evaluation Capacity of a Tribal Juvenile Justice Program: Evaluating Creating Restitution and Following Traditions (C.R.A.F.T.) Melissa Boeke, Minnesota Institute of Public Health; and Sharon Rosebear, Red Lake Band of Chippewa Indians Poster 54: Assessing Reasons for High School Dropout: Dropout Typologies Stacey Merola, Allan Porowski, and Kazuaki Uekawa, ICF International Poster 55: From Smolt to Salmon Project: Lessons Learned From a Culturally Responsive Mentoring Project Annie Woo, Education Northwest Poster 56: Evaluating the Effectiveness of Warning Systems in Extreme Weather Events Brandi Gilbert, Liesel Ritchie, and Alexandra Jordan, University of Colorado, Boulder Poster 57: Understanding the Structure and Operations of State Offices in a Large-Scale Youth-Serving Organization: A Multi-state Study of Communities In Schools Heather Clawson, Aikaterini Passa, and Sarah Decker, ICF International; and Susan Siegel, Communities In Schools Poster 58: Put Your Money Where Your Fat is: Evaluating Healthy Communities Funding and Obesity Rate Patterns, 2000-2010 Dave Brewington and Andrea Lee, YMCA of the USA Poster 59: Exploring Technology Access and Adoption With Low-Income Families Carlin Llorente, Ann House, Gabe Novais, Patrik Lundh, and Vera Michalchik, SRI International Poster 60: Using Collaborative Evaluation Approaches to Improve Implementation and Understanding of a 3-D Virtual World Initiative in Schools Nita Matzen, Appalachian State University; Rita O'Sullivan, University of North Carolina at Chapel-Hill; Sean Williams, Clemson University; and Lauren Kendall and Johnavae Campbell, University of North Carolina at Chapel-Hill Poster 61: Evaluation Techniques to Assess Behavioral Changes Related to the Adoption of Best Management Practices by New Landowners Philip Shackelford, Theresa Murphrey, and Jeff Ripley, Texas A&M University Poster 62: Measuring Treatment Outcomes Across Two Substance Abuse Treatment Programs for Adults and Adolescents Charles Brown, Gisoo Barnes, and Catherine Sewall, Centerstone Research Institute Poster 63: Evaluation of Online Extension Programs for Improvement and Accountability: Challenges and Alternatives Koralalage Jayaratne, North Carolina State University Poster 64: Teaching an Evaluation Graduate Course: Use of Learning Assessment as a Teaching Strategy Koralalage Jayaratne, North Carolina State University Poster 65: Developing Core Competence Indicators for General Education Che-Hao Liu, National Normal University; and Chin-Wen Chang, National Applied Research Laboratories Poster 66: On Q: Promoting Quality in Basic Education Through Positive Incentives Monika Schaffner, Planning and Learning Technologies Inc; and Abdel-Kareem Badran, National Center for Examinations & Educational Evaluation Poster 67: Strengthening Impact Evaluation Quality in Africa Through Partnerships: A Pathway to Sustainable Development Winston Allen, Heartlands International Evaluation 2010: Wednesday, November 10, 6:30 – 8:00 PM Exhibition Page 26 Poster 68: Improving Effectiveness of Household Treatment of Diarrhea of Young Children in Nepal: Increasing Use of Zinc to Reduce Severity of Diarrhea While Maintaining Use of Oral Rehydration Solution (ORS) to Reduce Dehydration – Results From a Population-based Household Survey Prakash Dev Pant, N-MARC Project; and Lonna B Shafritz and Peter Oyloe, Academy for Educational Development Poster 69: Using Archival Public School Data In Cross-State Evaluations Philip Nickel and Dennis Johnston, AVID Center Poster 70: Experiences of Program Personnel From an Intimate Partner Violence Prevention Program Lennise Baptiste, Kent State University Poster 71: An Empirical Study to Develop and Pilot an Instrument to Validate the Essential Competencies for Evaluators Yuanjing Xue and Jean A King, University of Minnesota; and Laurie Stevahn, Seattle University Poster 72: Adherence to the Directly Observed Treatment Short-Course's (DOTs) Strategy: An Evaluative Approach From Actors Perspective Gisela Cardoso, National School of Public Health (ENSP/Fiocruz), Marly Cruz, and Pedro Paulo Chrispim, National School of Public Health (ENSP/Fiocruz), Dolores Abreu, Laboratório de Avaliação de Situações Endêmicas Regionais; and Paula Vita Decotelli, and Juliana Borenstein, National School of Public Health (ENSP/Fiocruz) Poster 73: Effectiveness Evaluation of Brazilian Nongovernmental Organizations (NGO) STD/AIDS Prevention Programs Targeting Men Who Have Sex With Men Marly Cruz, National School of Public Health (ENSP/Fiocruz); Elizabeth Moreira dos Santos, Oswaldo Cruz Foundation (Fiocruz); Paula Vita Decotelli, Sonia Santos, Raquel Torres, and Ana Reis, National School of Public Health (ENSP/Fiocruz) Poster 74: Using the Leprosy Control Program Evaluation in a Timely Elizabeth Moreira dos Santos, Oswaldo Cruz Foundation (Fiocruz); Maria Aparecida Patroclo, Rafaela Souza, Ana Reis, and Gisela Cardoso, National School of Public Health (ENSP/Fiocruz) Poster 75: A Commented Review on Cost-Effectiveness of Directly Observed Treatment (DOTs) in Tuberculosis Control Programs Pedro Paulo Chrispim, National School of Public Health (ENSP/Fiocruz); Luisa Oliveira, Fluminense Federal University; and Elizabeth Moreira dos Santos, Oswaldo Cruz Foundation (Fiocruz) Poster 76: Implementation Evaluation of the Disability Prevention in Leprosy in the Cabo Frio, Rio de Janeiro, Brazil Rafaela Souza, National School of Public Health (ENSP/Fiocruz); Elizabeth Moreira dos Santos, Oswaldo Cruz Foundation (Fiocruz); and Marly Cruz, National School of Public Health (ENSP/Fiocruz) Poster 77: Evaluation of the Implementation of an Education Program in Nutrition in Order to Control Obesity in Rio De Janeiro Aline Leal, National School of Public Health (ENSP/Fiocruz); and Elizabeth Moreira dos Santos, Oswaldo Cruz Foundation (Fiocruz); and Marly Cruz, National School of Public Health (ENSP/Fiocruz) Poster 78: Performance Evaluation of a Cervical Cancer Screening Program: An Integrated Model for Local Analysis at Rio De Janeiro, Brazil Oliveira Thais, Elizabeth Moreira dos Santos, and Marly Cruz, Oswaldo Cruz Foundation Poster 79: Are Workshops Effective? Assessing the Quality and Impact of Evaluation Training Workshops in New Zealand Jeffery Adams and Pauline Dickinson, Massey University Poster 80: The Critical Role of Data Use in Instructional Improvement and Innovation Xinsheng Cai, Daniel Aladjem, Sarah Bardack, and Victoria R Marks, American Institutes for Research Poster 81: A Birdseye View of One Community‘s Success in Preventing and Ending Homelessness Margot Ackermann, Homeward Poster 82: Evaluating School-based Arts Integration Projects: Opportunities and Challenges Elaine Walker and Martin Finkelstein, Seton Hall University; and Carmine Tabone, Education Arts Team Poster 83: A Tool for Monitoring and Evaluating Pre-service Teachers in Field Experiences Susan Hibbard, Robert Triscari, and Diane Kratt, Florida Gulf Coast University Poster 84: Conducting Anonymous Focus Groups: Escaping Politics and Bias? Susan Hibbard, Florida Gulf Coast University Poster 85: Improving Evaluation Quality: Challenges for Evaluating Community Initiatives During Economic Downturns Brandy Pratt, Diane Rogers, and Mohammed Alyami, Western Michigan University Poster 86: Evidence-based Guidelines: Evaluating Diffusion in State Tobacco Control Programs Max Bryant, Stephanie Herbers, Lana Wald, Douglas Luke, and Jennifer Hobson, Washington University in St Louis Poster 87: So Much Information, So Little Time: Evaluating the Impact of Using Brief Addiction Curriculum Infusions as a Teaching Method in Criminal Justice, Nursing, and Social Work Courses Joyce Hartje, Nancy Roget, and Michelle Berry, University of Nevada, Reno Poster 88: Assessing the Quality of Instrumentation Using IRT Kristina Mycek and Susan Rogers, State University of New York at Albany Poster 89: Teaching Program Evaluation to Novices: Steps, Pitfalls, and Lessons Learned Susan Rogers, State University of New York at Albany Evaluation 2010: Wednesday, November 10, 6:30 – 8:00 PM Exhibition Page 27 Poster 90: Development of an Implementation Fidelity Framework: Implications for District-wide Multi-classroom Interventions Cindi Dunn and Sheryl Hodge, Kansas State University Poster 91: Investigation Into Delivery Modes of Adult Education Programs by a Cooperative Extension Jane A Rodd and Dianna L Newman, State University of New York at Albany Poster 92: Developing an Objective Measuring of Tempo Consistency Tara Pearsall, Savannah College of Art and Design Poster 93: Linking Communities to Advance Evaluation Capacity Building in Historically Black Colleges and Universities (HBCUs) Ruth Greene, Johnson C Smith University Poster 94: Implementation Fidelity of Environmental Strategies: The Strategic Prevention Framework – State Incentive Grant (SPF-SIG) Experience Phillip Graham and A Monique Clinton-Sherrod, RTI International Poster 95: Comparing Comparisons: Contrasting EthnicSpecific Factor Coefficient Weighted Depression With the Invariant Unit-Weight Measure and Comparing Puerto-Rican and African-American Elderly on on Depression Development Processes Emil Coman and Jay Schensul, Institute for Community Research Poster 96: Assessing the Impact of Career Academies on Student Achievement Becky Smeardon, Frances Burden, and Aimee Evan, Quill Research Associates; Rheta Lanehart, University of South Florida; and Kellie Kim, Quill Research Associates Poster 97: Impact of School Based Evaluation on Learning Outcomes Undurthy Lakshmi Narayana, Regional Institute of Education Poster 98: Assessing the Impact of a National Teacher Evaluation Pilot Program Hui-Ling Pan, National Taiwan Normal University Poster 99: Enhancing the Quality of a National Multi-site Evaluation Through Involvement of Site Participants Frances Lawrenz, University of Minnesota Poster 100: The Strategy for Implementation of Evaluation Methods in the Specific Conditions of Universities for the Increase of Evaluation Culture and Successful Implementation of Their Development Projects: The Case Study of Institute of Tropics and Subtropics in the Czech University of Life Sciences in Prague, Czech Republic (ITS CULS) Jirina Svitakova, Czech University of Life Sciences Poster 101: How Much Do HIV/AIDS Service Providers Evaluate Their Programs? Kylie Hutchinson, Community Solutions Planning & Evaluation; and Bubli Chakraborty and Francisco IbanezCarrasco, Provincial Health Services Authority of Bristish Columbia Poster 102: Workable Strategies for Assessing Change Among Health Care Professionals Following Continuing Education Heather Becker, University of Texas, Austin; and Kristin Hamlett, Nurse Oncology Education Program Poster 103: Using an Empowerment Approach to Plan and Evaluate a Sexual Health Education Summit for Minority Teens Lynn Chen, Adama Brown, and Heather Becker, University of Texas, Austin Poster 104: Approach: Analysis of Needs Assessments to Assess Availability of Mental Health and Substance Abuse Services for HIV Infected Individuals in Texas Michele Rountree and Lynn Chen, University of Texas, Austin Poster 105: The Amazing You: An External Evaluation of Museum-based Exhibits About the Human Body Wendy Dickinson, Ringling College of Art and Design; Bruce Hall, University of South Florida; and Dave Conley, Museum of Science and Industry Poster 106: A-Tv-S-Gv Capacity in Cherokee Community Organizations Mark Parman, Cherokee Nation; dn Ronetta Briggs, O Si Yo Communications Poster 107: The Assessment of a Professional Development Workshop: Emic and Etic Perspectives on Junior Faculty Experiences Deborah Bennett and Susan Geier, Purdue University Poster 108: The Evaluation of the Geology, Environmental Science and Meteorology (GEM) Scholar Program: A Participatory Approach Susan Geier, Deborah Bennett, and Suzanne M ZurnBirkhimer, Purdue University Poster 109: An Evaluation of the Introduction of Concurrency Concepts Across a Four-Year Postsecondary Curriculum Melissa Yale and Deborah Bennett, Purdue University Poster 110: An Evaluation Study of a Multicultural Student Mentoring Program Kai Chi Yam, Gitanjali Shrestha, and Laura Hill, Washington State University Poster 111: The Role of Exploratory Factor Analysis in Evaluation Kai Chi Yam, Brian French,and Laura Hill, Washington State University Poster 112: Examining Aspirations and Expectations for Youth in Foster Care: An Evaluation of Kansas Kids at Gaining Early Awareness and Readiness for Undergraduate Programs (GEAR UP) Rhonda Lewis-Moss, Chris Kirk, Corinne Nilsen, and Delta Q Colvin, Wichita State University Evaluation 2010: Wednesday, November 10, 6:30 – 8:00 PM Exhibition Page 28 Poster 113: Challenges and Good Practices in Evaluating AntiChild Labor and Basic Education Programs Worldwide Mary Anne Anderson, ICF Macro International Poster 114: Three Levels of Change on a Retrospective Post as a Program Improvement Tool Paul Pope, Texas A&M University Poster 115: Another Side of Program Effectiveness: Percent Potential Improvement Paul Pope, Texas A&M University Poster 116: Educational Evaluation‘s History: Present and Future in Mainland China Gang Wu and Huihua He, Shanghai Normal University Poster 117: Evaluating Social Media Use and Nonprofits‘ Quest for Effectiveness Kristen Cici, University of Minnesota Poster 118: Evaluating Communities of Practice in Academic Medicine Dorene Balmer, Boyd Richards, and Rita Charon, Columbia University Poster 119: Evaluating Social Networks using InFlow and Network Genie Oliwier Dziadkowiec, Trisha Peaster and Scott Wituk, Wichita State University Poster 120: A Cost Analysis of the Tandem Teen Parenting Program Toni Watt, Texas State University Poster 121: Energy Program Evaluation Building Blocks Lark Lee and Laura Schauer, PA Consulting Group Poster 122: Using Systems Engineering Tools to Inform a Geographic Needs Assessment Angela Snyder and Natalie Towns, Georgia State University; and Christina Scherer, Southern Polytechnic State University Poster 123: A Statewide Evaluation of Supplemental Educational Services (SES) Programming: Challenges and Lessons Learned Pamela B Finney, Melissa Williams, and Alexa Edwards, University of North Carolina at Greensboro Poster 124: Informing Truth Through Formative Evaluation: A Needs Assessment of One Federally Funded Homeless Education Center Alexa Edwards and Lynn Amwake, University of North Carolina at Greensboro Poster 125: Process Evaluation of Data Collection and Reporting Systems for United States Environmental Protection Agency Office of Brownfields and Land Revitalization David Shellard, SRA International Inc Poster 126: Optimizing the Baseline Phase of a Pay for Performance Multi-Year Evaluation in the Federal Government Heather Prather and Sarah Johnson, United States Office of Personnel Management Poster 127: Promoting Sound Evaluation Practices in the Field of Suicide Prevention Philip Rodgers, American Foundation for Suicide Prevention Poster 128: Longitudinal Changes in Capacity and Readiness to Provide Training and Technical Assistance (TA): Developing Effective TA Providers Catherine Lesesne, Duane House, Kristin Brown, Kim Burley, and Ndidi Nwangwu, Centers for Disease Control and Prevention Poster 129: Evaluation of the Satisfaction Level Among Pregnant Patients Who Attended the Prenatal Care Clinics in a Teaching Hospital Ida Sanabria and Ruth Ríos, University of Puerto Rico Poster 130: Evaluation and Adjustment of Performance Evaluation System in a Middle-Size East European Industrial Organization Jana Kotrcova, University of Saskatchewan Poster 131: Enhancing Traditional and Innovative Approaches to Advanced Composition in Academic Disciplines Maria Jimenez and Ayesha Boyce, University of Illinois at Urbana-Champaign Poster 132: A Crucial Issue of Evaluation: Technological Universities Reevaluation in Taiwan Shu-Hui Tseng and Shu-Ping Juan, National Taipei University of Technology Poster 133: Facilitating Data Interpretation With Preschool Teachers Juanita Pelt and Joel Philp, The Evaluation Group Poster 134: Measuring and Reporting on School Climate in a Rigorous Magnet Evaluation Bianca Montrosse, Western Carolina University; Jane Meli and Holli Bayonas, University of North Carolina at Greensboro Poster 135: Evaluation of Adherence to AIDS Treatment in Patients Suffering Variation in the Distribution of Body Fat Due to Lypodistrophy Rachel Baccarini, Ministry of Health of Brazil Poster 136: Using Propensity Scores and the National Educational Longitudinal Survey, 88:2000, to Evaluate the Effectiveness of Upward Bound Programs Bradley Coverdale, University of Maryland, College Park Poster 137: Disproportionality in the Child Welfare System: Using Geographic Information Systems (GIS) to Evaluate Differences in Child Welfare Outcomes Virginia Dick, University of Georgia Poster 138: Parents as Reporters on Program Effectiveness: The Need to Disaggregate by Parent and Child Characteristics Tiffany Berry, Susan Menkes, and Desiree Nangle, Claremont Graduate University Poster 139: The Development and Validation of an Evaluation Tool Designed to Measure the Distinctive Needs of High School Students After School Tiffany Berry and John Coffey, Claremont Graduate University Evaluation 2010: Wednesday, November 10, 6:30 – 8:00 PM Exhibition Page 29 Poster 140: Connecting Evaluation Quality and Object Effectiveness: Evaluative Inquiry Practice Patterns in a High Performing School Kathryn Hill, Minnesota Office of Higher Education Poster 141: Using Evaluation to Strengthen Program Quality in New Models of Teacher Preparation Edith Stevens, ICF Macro Poster 142: Using Observational Methods and Geographic Information Systems (GIS) to Evaluate Relationships Between Physical and Social Environmental Features and Community Walking Duncan Meyers and Dawn Wilson, University of South Carolina Poster 143: Two-Year Evaluation of an Initiative Designed to Encourage Young Women to Seek Engineering Careers: The Engineer Your Life Initiative Christine Paulsen and Christopher Bransfield, Concord Evaluation Group LLC Poster 144: A Culturally Sensitive Community-Participative Program to Promote Minority Support for HIV/AIDS Vaccine Research: A Social Networking Approach Robin Kelley, National Minority AIDS Council Poster 145: Strengths, Weaknesses, Opportunities, Threats (SWOT) Improving Evaluation Quality by Engaging Community Agencies in the Evaluation Process Korinne Chiu and Kelly Graves, University of North Carolina at Greensboro Poster 146: Technology-Enabled Evaluation: Advantages and Disadvantages Kristy Jang, Arwa Alkhalaf and Sandra Mathison, University of British Columbia Poster 147: Meta-evaluation Model for Assessing Evaluations of Professional Development Programs Julie Sexton, University of Northern Colorado; Leslie Reid, University of Calgary; and Erin Dokter, University of Arizona Poster 148: Assessing Context and Culture to Evaluate Sexual Health Programs for African American Youth in Metropolitan Atlanta Tabia Henry Akintobi, Cagney Stigger, Nastassia Laster, DeBran Jacobs, and Donoria Evans, Morehouse School of Medicine; and Jennie Trotter, Tarita Johnson, Melody Jackson, Jewel Crawford, and Audra Woodard, Wholistic Stress Control Institute Inc Poster 149: Impact of Support on Application of Training Sandhya Rao Hermon and Steven Torkel, Pricewaterhouse Coopers LLP Poster 150: Finding the Right Target: The Case for Informal Science Education Chris Caveny-Cox and Benjamin Silliman, North Carolina State University Poster 151: Mapping Teacher Education Evaluative Use to Evaluation Use Standards Georgetta Myhlhousen-Leak, University of Iowa Poster 152: Assessing Individual Substance Use Based on Information from Multiple Data Sources: Lessons for Evaluation About Understanding and Reconciling Differences Lynn Wallisch, Thomas Bohman, and Kristin Christensen, University of Texas, Austin; and Dena Stoner, Texas Department of State Health Services Poster 153: Linking Evaluation Quality and Program Implementation: A Quasi-Study of A National Implementation Melissa Rivera and Scott Steger, National Center for Prevention and Research Solutions Poster 154: Evaluating Teachers‘ Use of Technology for Improving High School Academic Achievement: A Multi-level Analysis George Chitiyo, Jamie Coburn, Diana Wood, Tennessee Technological University Poster 155: Randomized Control Evaluation of a Farm Safety Intervention: Using Theory of Planned Behavior for Changing Power-Take Off (PTO) Related Behaviors of Youth on Farms Haminda JIinnah-Ghelani and Zolinda Stoneman, University of Georgia Poster 156: The Program Might Work, but Does it Fit the Context? Looking at One Special Education Leadership Program in Terms of National Policy and Research Priorities Matthew Linick, Cristin Geoghegan, Kim Wolowiec-Fisher and Daniel Araya, University of Illinois at Urbana-Champaign Poster 157: Monitoring and Evaluation Network to Control Tuberculosis in Brazil Verônica Machado, Independent Consultant; Claudia Fonseca, Independent Consultant Poster 158: Constructivist Success Case Method (SCM): An Alternative Use of the SCM for the Evaluation of New Initiatives Julien Kouame, Western Michigan University Poster 159: Quality Evaluation and Dynamic Initiatives: Mixing Methods and Creativity Shaunti Knauth, National Louis University; and Maryann Durland and John Durland, Durland Consulting Poster 160: Striving for a Safer Campus Alcohol Environment: A Process Evaluation Jason Black, Daniel Reilly, and Jennifer Morrow, University of Tennessee, Knoxville Poster 161: Metaphors We Evaluate By: Randomized Controlled Trials and the Definition of Evaluands Aaron Pannone and Walter Heinecke, University of Virginia Poster 162: Evaluating Recidivism and Risk Factors of Juvenile Offenders Participating in Jail Diversion Programs Xuan Stevens, Florida International University; Jesus Perez, Lou Panci, Citrus Health Network; and Nicole DavisWhite, Family Resource Center of South Florida Poster 163: The Importance of Using Multiple Metrics to Investigate a Single Program Goal Carl Westine, Lori Wingate, and Arlen Gullickson, Western Michigan University Evaluation 2010: Wednesday, November 10, 6:30 – 8:00 PM Exhibition Page 30 Poster 164: Co-constructing Knowledge in Participatory Evaluation: A Case Study of Logic Model Development for a Power-based Community Organization Charles Collins and Tiffeny Jimenez, Michigan State University Poster 165: Decision Process for Integration of Design and Methods Jason Burkhardt and Lee Balcom, Western Michigan University Poster 166: Evaluating the Diffusion and Implementation of Health Policies Within and Across School Districts Jennifer Mortensen, Michigan State University Poster 167: Revisiting the Post Plus Retrospective Pretest: Its Use in Evaluating a National Health Training Program for Health Care Professionals Elaine Cohen, National Parkinson Foundation; Gladys Gonzalez-Ramos, New York University; and Ruth Hagestuen, National Parkinson Foundation Poster 168: The Value of Impact Statements to Evaluate Participants‘ Experience in a National Interdisciplinary Training Program for Health Care Professionals Elaine Cohen, National Parkinson Foundation; Gladys Gonzalez-Ramos, New York University; Ruth Hagestuen, National Parkinson Foundation Poster 169: A Culturally Responsive Evaluation of a Historically Black Colleges and Universities (HBCU) Health Service April Waterford, Anthony Fluellen, Pamela FrazierAnderson, and Kevin E Favor, Lincoln University Poster 170: Learning From Change: A Collaborative Evaluation of a Community-Focused Cancer Outreach Program Carolla Belle, and Lokman Akbay, Huaye Li, and Jane-Van Trumpet, University of South Florida Poster 171: Overcoming Barriers: A Case Study in a Program Evaluation of Alcohol and Other Drug Abuse Outpatient Treatment Linda Jourdan and Lora Warner, University of Wisconsin, Green Bay Poster 172: Essential Nutrition Action (ENA) in Bangladesh: Using Administrative Data to Show Evidence of Impact Jillian Waid, Washington University in St Louis Poster 173: Assessing the Quality of the Program: Preparation for Work in Southern Mexico Miguel Sosa-Molina and Edith J Cisneros-Cohernour, University of Yucatan Poster 174: A Review of Three Decades of Evaluations of Research Center and Network Programs at the National Institutes of Health: Lessons Learned and Recommendations for Future Evaluations Jack Scott and Margaret Blasinsky, The Madrillon Group Inc; Brooke Stipelman, Kara Hall, Amanda Vogel, and Annie Feng, National Institutes of Health; and Dan Stokols, University of California, Irvine Poster 175: A Multi-method Evaluation of a Large National Institutes of Health-Funded Transdisciplinary Research and Training Center Program Annie Feng, Amanda Vogel, Kara Hall, and Brooke Stipelman, National Institutes of Health; and Dan Stokols, University of California, Irvine Poster 176: Building Multi-cultural and Cross-Cultural Aspects of Evaluation Through a Values-based Holistic Community Development Model: Sixty Years of Heifer International‘s Experiences in International Development Tererai Trent, Western Michigan University Poster 177: Deconstructing Caribbean Masculinity to End Domestic Violence Cecilia Hegamin-Younger, TUI University; and Rohan Jeremiah, St George's University Evaluation 2010: Wednesday, November 10, 6:30 – 8:00 PM Exhibition Page 31 Notes: Evaluation 2010: Wednesday, November 10, 6:30 – 8:00 PM Exhibition Page 32 Thursday, November 11, 2010: Overview of Schedule 7:00 am to 6:30 pm Registration Desk Open 8:00 am to 8:45 am Plenary Session 9:15 am to 10:45 am Concurrent Conference Sessions 10:55 am to 12:25 pm Concurrent Conference Sessions 12:35 pm to 1:30 pm AEA Business Meeting 1:40 pm to 3:10 pm Concurrent Conference Sessions 3:35 pm to 4:20 pm Concurrent Conference Sessions 4:30 pm to 6:00 pm Concurrent Conference Sessions 6:10 pm to 7:00 pm TIG Business Meetings and Socials My Schedule and Notes: Evaluation 2010: Thursday, November 11 Page 33 Summary of Sessions for Thursday, November 11, 9:15 AM to 10:45 AM No Primary Sponsor Session Session Title Room 202 Presidential Strand Panel Rigor at Stake: Quality Evaluation of Change and Impact in a Complex World Lone Star A 203 Program Theory and Theory-driven Eval TIG Panel Implementation From the Ground Up: Defining, Promoting, and Sustaining Fidelity at All Levels of a State Program Lone Star B 204 Collaborative, Participatory & Empowerment MultiPaper The Essential Features of Collaborative, Participatory, and Empowerment Evaluation Lone Star C 205 Non-profit and Foundations Evaluation TIG Think Tank Nonprofit Rating Systems and Implications for Evaluation Lone Star D 206 Quantitative Methods: Theory and Design TIG Panel Comparative Effectiveness Research in Program Evaluation Lone Star E 207 Cluster, Multi-site & Multi-level Evaluation TIG Panel Serving Two Masters: Local Evaluators Trying to Maintain Evaluation Quality and Use While Participating in a National… Lone Star F 208 Graduate Student and New Evaluator TIG Roundtable Rotation I: Truth, Beauty, and Justice for All: A Conversation With Graduate Students Examining Issues of Power, Control… Rotation II: The Role of Evaluation and Research Support in Ensuring Evaluation Quality Mission A 209 Social Work TIG Multipaper Evaluating the Intervention: A Look at Clinical Treatments and Client Implications Mission B 210 Systems in Evaluation TIG MultiPaper Using a Multi-stage, Mixed Methods Approach to Improve the Design of System Change Evaluations Bowie A 211 Multiethnic Issues in Evaluation TIG Think Tank Third Annual Asa G. Hilliard III Think Tank on Culture and Evaluation Bowie B 212 Advocacy and Policy Change TIG Multipaper Maintaining Quality in Challenging Contexts Bowie C 213 Teaching of Evaluation TIG Roundtable Rotation I: Engaging Social Justice in a Graduate Course on Program Evaluation Rotation II: Issues of Quality: Guiding Principles for Culturally Competent Teaching and Practice Goliad 214 Integrating Technology Into Evaluation Roundtable Rotation I: Using Technology for Efficiency in Evaluation Rotation II: Integrating Website Use Analytics into a Mixed Method Evaluation of a Professional Development Website San Jacinto 216 Evaluation Managers and Supervisors TIG Demonstration Project Management Software: An Important Multi-Purpose Tool in an Evaluation Unit‘s Toolbox Travis B 217 Org Learning & Evaluation Capacity Bldg TIG Demonstration Assessing Evaluation Capacity: Using the Evaluation Capacity Diagnostic Tool Travis C 218 Evaluating the Arts and Culture TIG Multipaper Improving Evaluation Quality Through and In the Arts Travis D 219 Human Services Evaluation TIG MultiPaper Mixed-Method Evaluation in Human Services Settings Independence 220 Quantitative Methods: Theory and Design TIG Multipaper Back to the Basics and Beyond Presidio A 221 Org Learning & Evaluation Capacity Bldg TIG Skill-building The Power of Metaphor: Using Images for Organizational Analysis Presidio B 222 Alcohol, Drug Abuse, and Mental Health TIG Multipaper Evaluation of Youth Mental Health and Substance Abuse Interventions Presidio C 223 Pre-K - 12 Educational Evaluation TIG Roundtable Rotation I: Learning About Educational Reform From a Seven-Year Math-Science Partnership Rotation II: When Quality and Policy Collide in Evaluating Math-Science Partnership Programs: Strategies for Resolution Bonham A 224 Non-profit and Foundations Evaluation TIG Multipaper How Did You Do It? Implementing Performance Measurement and Monitoring Systems Bonham B 225 Pre-K - 12 Educational Evaluation TIG Multipaper Evaluating K-8 Literacy Programs: Methods and Models Bonham C 226 Pre-K - 12 Educational Evaluation TIG Multipaper Methods Leading to Higher Quality Evaluations in Education Evaluation Bonham D Evaluation 2010: Thursday, November 11, 9:15 – 10:45 AM Page 34 Summary of Sessions for Thursday, November 11, 9:15 AM to 10:45 AM, Continued No Primary Sponsor Session Session Title Room 227 Collaborative, Participatory & Empowerment Panel Enhancing the Quality of Evaluation Through Collaboration Among Funders, Programs, and Evaluators… Bonham E 228 Government Evaluation TIG Panel Methodological Choices in Assessing the Quality and Strength of Evidence on Effectiveness Texas A 229 Theories of Evaluation TIG Panel Evaluating With Validity: Truth, Justice, and the Beautiful Way Texas B 230 Mixed Methods Evaluation TIG Multipaper Dealing With Technical Challenges in Mixed Methods Evaluation Texas C 231 Research, Technology, and Development Eval Panel Analysis and Evaluation of Research Portfolios Using Quantitative Science Metrics: Practice Texas D 232 Evaluation Use TIG Demonstration Why Evaluators Need Graphic Design Skills Texas E 233 Research on Evaluation Panel New Directions for Research on Evaluation Texas F 234 AEA Conference Committee Think Tank Respecting and Protecting Boundaries: Social Evaluation Competencies Crockett A 235 Business and Industry TIG Panel Evaluation Utilization and the Story of the Federal Railroad Administration‘s 10 Year Research and Development Effort… Crockett B 236 International and Cross-cultural Evaluation TIG Think Tank Assessing Impacts in Real World Evaluations: Alternatives to the Conventional Statistical Counterfactual Crockett C 237 Government Evaluation TIG Evaluation and Quality: Examples From Government Crockett D 238 International and Cross-cultural Evaluation TIG Multipaper Navigating the Intricacies of Culture and Context in International Program Evaluation Republic A 239 Health Evaluation TIG Think Tank Evaluating Health Program Sustainability: Improving the Quality of Methods and Measures Republic B 240 Collaborative, Participatory & Empowerment Demonstration Using a Practical Lens to Develop National-Level Participatory Projects Republic C Multipaper Evaluation 2010: Thursday, November 11, 9:15 – 10:45 AM Page 35 Thursday, 8:00 am to 8:45 am 200 - Interdisciplinary Perspectives on Evaluation Quality Plenary to be held in Texas A Sponsored by the Presidential Strand Chair - Rodney Hopson, Duquesne University Discussant - James Earl Davis, Temple University Presenters - Psyche Williams-Forson, University of Maryland; and Crispin Sartwell, Dickinson College Thursday, 8:45 am to 9:15 am – Coffee Break! Thursday, 9:15 am to 10:45 am 202 - Rigor at Stake: Quality Evaluation of Change and Impact in a Complex World Panel to be held in Lone Star A Sponsored by the Presidential Strand Chair - Indran Naidoo, Office of the South African Public Service Commission Discussant - Patricia Rogers, Royal Melbourne Institute of Technology Impact Evaluation: Serving Development? Zenda Ofir, Evalnet South Africa The Social Transformation of Evaluation? Thomas Schwandt, University of Illinois at UrbanaChampaign Rigorous Evaluative Practice That Embraces Complexity: Reflections from ‗Evaluation Revisited‘ Irene Guijt, Learning by Design 203 - Implementation From the Ground Up: Defining, Promoting, and Sustaining Fidelity at All Levels of a State Program Panel to be held in Lone Star B Sponsored by the Program Theory and Theory-driven Evaluation TIG Chair - Elizabeth Oyer, EvalSolutions Inc Understanding State-level Program Impact: Leveraging State Policies and Resources for Effective Implementation Elizabeth Oyer, EvalSolutions Inc; and Marica Cullen and Gilbert Downey, Illinois State Board of Education Understanding the Forest by Examining the Trees: Creating Profiles of Local Grantees to Develop Themes in Implementation of a State Mathematics and Science Partnership Program Tania Jarosewich, Censeo Group and Debra Greaney, Area V Learning Technology Center Measuring Implementation and Building Adherence: Assessing Fidelity and Improving Understanding in an Illinois Mathematics and Science Program James Salzman, Ohio University 204 - The Essential Features of Collaborative, Participatory, and Empowerment Evaluation MultiPaper to be held in Lone Star C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Chair - Abraham Wandersman, University of South Carolina Collaborative Evaluation Essentials: Highlighting the Essential Features of Collaborative Evaluation Liliana Rodríguez-Campos, University of South Florida; and Rita O'Sullivan, University of North Carolina at Chapel-Hill Participatory Evaluation Essentials: Highlighting the Essential Features of Participatory Evaluation Lyn Shulha, Queen's University at Kingston Empowerment Evaluation Essentials: Highlighting the Essential Features of Empowerment Evaluation David Fetterman, Fetterman & Associates; and Abraham Wandersman, University of South Carolina 205 - Nonprofit Rating Systems and Implications for Evaluation Think Tank to be held in Lone Star D Sponsored by the Non-profit and Foundations Evaluation TIG Debra Natenshon, The Center for What Works; and Johanna Morariu, Innovation Network 206 - Comparative Effectiveness Research in Program Evaluation Panel to be held in Lone Star E Sponsored by the Quantitative Methods: Theory and Design TIG Chair - James Michael Menke, University of Arizona Epistemological and Methodological Issues in Comparative Effectiveness Research Lee Sechrest, University of Arizona Comparisons and Second Order Comparisons of Comparisons James Michael Menke, University of Arizona Comparative Effectiveness in Educational Settings Katherine McKnight, Pearson Corporation Comparing Tobacco Control Interventions Frederic Malter, University of Arizona 207 - Serving Two Masters: Local Evaluators Trying to Maintain Evaluation Quality and Use While Participating in a National Multi-site Evaluation Panel to be held in Lone Star F Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG Chair - Thomas Kelly, Annie E Casey Foundation Discussant - Mary Achatz, Westat Evaluation 2010: Thursday, November 11, 8:00 – 8:45 AM, 9:15 – 10:45 AM Page 36 Two Bosses, Two Clients, Two Timetables: Local Evaluators‘ Challenges in Meeting Expectations of Community Partners and National Funder and Evaluators Sue Tripathi, Making Connections, Denver Building Local Evaluation Capacity of Coalition Partners Sebastian Schreiner, City of San Antonio Defining and Measuring Community Engagement at Local and National Levels Tanja Kubas-Meyer, Independent Consultant Using Qualitative Methods to Identify System Dynamics and Inform System Evaluation Design Margaret Hargreaves, Mathematica Policy Research Using Quantitative Research Methods in Evaluations of Simple, Organized Systems Heather Koball, Mathematica Policy Research Applying Social Network Analysis to Evaluations of Complicated Systems Todd Honeycutt, Mathematica Policy Research 208 – Roundtables in Mission A 211 - Third Annual Asa G. Hilliard III Think Tank on Culture and Evaluation The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Graduate Student and New Evaluator TIG Rotation 1: Truth, Beauty, And Justice For All: A Conversation With Graduate Students Examining Issues of Power, Control, and Evaluation Quality Within the Realm of Graduate Assistantships Ayesha Boyce, Maria Jimenez, Jeehae Ahn, and Holly Downs, University of Illinois at Urbana-Champaign Rotation 2: The Role of Evaluation and Research Support in Ensuring Evaluation Quality Laricia Longworth-Reed, Kathryn Schroeder, and Anna de Guzman, University of Denver 209 - Evaluating the Intervention: A Look at Clinical Treatments and Client Implications Multipaper to be held in Mission B Sponsored by the Social Work TIG Chairs - Derrick Gervin, The Evaluation Group; Jenny Jones, Virginia Commonwealth University Evaluating the Implementation of a Trauma-Informed and Human Rights Curriculum in a School of Social Work Thomas H Nochajski and Bincy Wilson, State University of New York at Buffalo Exploring Behavioral Health Perceptions of United States Army Chaplains: Incorporating Quality From Conceptualization to Conclusion Kimberly Farris, United States Army Integrating Realist Evaluation in Social Work Practice Mansoor Kazi, State University of New York at Buffalo Evaluating Mental Health Instruments Within a Cultural Context Maureen Rubin and Goutham Menon, University of Texas, San Antonio 210 - Using a Multi-stage, Mixed Methods Approach to Improve the Design of System Change Evaluations MultiPaper to be held in Bowie A Sponsored by the Systems in Evaluation TIG Chair - Beth Stevens, Mathematica Policy Research Think Tank to be held in Bowie B Sponsored by the Multiethnic Issues in Evaluation TIG Presenter - Cindy A Crusto, Yale University Discussants- Julie Nielsen, NorthPoint Health and Wellness Center Inc; Katherine A Tibbetts, Kamehameha Schools; Joanne Farley, Human Development Institute; Jenny Jones, Virginia Commonwealth University; and Itihari Toure, The Jegna Collective 212 - Maintaining Quality in Challenging Contexts Multipaper to be held in Bowie C Sponsored by the Advocacy and Policy Change TIG Chair - Julia Coffman, Center for Evaluation Innovation Quality Seems to Be the Hardest Word: How One United Kingdom (UK) Funder Uses Evaluation to Achieve Policy Change Andrew Cooper, Diana, Princess of Wales Memorial Fund Building the Advocacy Evaluation Capacity of Community Coalitions: Lessons Learned From the Northwest Community Changes Initiative Ronda Zakocs, Independent Consultant; Christopher Kabel, Northwest Health Foundation; Noelle Dobson, Community Health Partnership; and Susan Briggs, Independent Consultant Agent-based Modeling as a Tool for Evidence-based Public Policy Analysis Andrea Hegedus and Jay Schindler, Northrop Grumman Corporation 213 – Roundtables in Goliad The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Teaching of Evaluation TIG and the Multiethnic Issues in Evaluation TIG Rotation 1: Engaging Social Justice in a Graduate Course on Program Evaluation Leanne Kallemeyn, Loyola University, Chicago Rotation 2: Issues of Quality: Guiding Principles for Culturally Competent Teaching and Practice Arthur Hernandez, Texas A&M University; and JoAnn Yuen, University of Hawaii, Manoa Evaluation 2010: Thursday, November 11, 9:15 AM – 10:45 AM Page 37 Thursday, 9:15 am to 10:45 am, continued 214 – Roundtables in San Jacinto The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Integrating Technology Into Evaluation TIG Rotation 1: Integrating Website Use Analytics into a Mixed Method Evaluation of a Professional Development Website Randahl Kirkendall, Ellen Iverson, and Monica Bruckner, Carleton College Rotation 2: Using Technology for Efficiency in Evaluation Marycruz Diaz and Donna Winston, WestEd Employee Satisfaction and Retention in Human Services Erin Farr and John Lodge, Wright State University Program Evaluation of a Youth Partial Hospitalization Program Dustin Hamilton and Stephanie Gemmer, Wright State University 220 - Back to the Basics and Beyond Demonstration to be held in Travis C Sponsored by the Organizational Learning and Evaluation Capacity Building TIG Lande Ajose, BTW Informing Cchange; and Kristi Kimball, William and Flora Hewlett Foundation Multipaper to be held in Presidio A Sponsored by the Quantitative Methods: Theory and Design TIG Chair - Raymond Hart, Georgia State University Consequences of Violating Fundamental Assumptions of the Central Limit Theorem in Evaluation and Research Practice Raymond Hart, Georgia State University The Chi-Square Test: Often Used and More Often Misinterpreted Todd Franke and Christina Christie, University of California, Los Angeles Data Reduction and Classification Decisions: Using a Factor Analytic Approach to Examine Exemplary Teaching Characteristics Sheryl Hodge and Jan Middendorf, Kansas State University; Linda Thurston, National Science Foundation; and Cindi Dunn, Kansas State University Estimating Program Impact Using the Bloom Adjustment for Treatment No-Shows: Evaluation of a Literacy Intervention With Hierarchical Linear Modeling Jing Zhu, Jonathan Tunik, and Alan Simon, Metis Associates 218 - Improving Evaluation Quality Through and In the Arts 221 - The Power of Metaphor: Using Images for Organizational Analysis 216 - Project Management Software: An Important Multi-Purpose Tool in an Evaluation Unit‘s Toolbox Demonstration to be held in Travis B Sponsored by the Evaluation Managers and Supervisors TIG Stacey Farber, Tracy Gnadinger, and Janet Matulis, Cincinnati Children's Hospital Medical Center 217 - Assessing Evaluation Capacity: Using the Evaluation Capacity Diagnostic Tool Multipaper to be held in Travis D Sponsored by the Evaluating the Arts and Culture TIG Chair - Ashlee Lewis, University of South Carolina Discussant - Debra Smith, Lesley University Arts Integration to Enhance Learning Outcomes Dawson Hancock, University of North Carolina at Charlotte The Potential for Arts-Informed Inquiry in Educational Program Evaluation Michelle Searle, Queen's University at Kingston State of the Arts: Evaluation of a K-12 Arts Education Program Janet Mahowski, University of South Florida 219 - Mixed-Method Evaluation in Human Services Settings MultiPaper to be held in Independence Sponsored by the Human Services Evaluation TIG Chair - Cheryl Meyer, Wright State University Program Evaluation of Multidisciplinary Training on Trauma Informed Care Jessica Heschel and Anne Willis, Wright State University Skill-building Workshop to be held in Presidio B Sponsored by the Organizational Learning and Evaluation Capacity Building TIG Maggie Huff-Rousselle and Bonnie Shepard, Social Sectors Development Strategies 222 - Evaluation of Youth Mental Health and Substance Abuse Interventions Multipaper to be held in Presidio C Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG Chair - Melissa Rivera, National Center for Prevention and Research Solutions Out-of-Home Treatment for Youth With Mental Health Needs and Juvenile Justice Involvement John Robst, Mary Armstrong, and Norin Dollard, University of South Florida Establishing Quality Evaluation Methods in New Terrain: Lessons Learned From a Social Host Ordinance Impact Evaluation Kristen Donovan, Shanelle Boyle, and Julie Slay, EVALCORP, and Dan Hicks, Ventura County Behavioral Health Department Evaluation 2010: Thursday, November 11, 9:15 AM – 10:45 AM Page 38 Reducing School Violence to Improve Mental Health and Scholastic Achievement in New Orleans High Schools Marsha Broussard and Lisanne Brown, Louisiana Public Health Institute; Paul Hutchinson and Nathalie Ferrell, Tulane University; and Sarah Kohler Chrestman, Louisiana Public Health Institute Evaluation of School Counseling Programs in Rural Middle Tennessee Randall Reiserer, Ajanta Roy, and Brad Martin, Centerstone Research Institute 225 - Evaluating K-8 Literacy Programs: Methods and Models Sponsored by the Pre-K - 12 Educational Evaluation TIG and the Independent Consulting TIG Rotation 1: Learning About Educational Reform From a SevenYear Math-Science Partnership Cynthia Tananis, Cara Ciminillo, Tracy Pelkowski, Keith Trahan, Yuanyuan Wang, Gail Yamnitzky, and Rebecca Price, University of Pittsburgh Rotation 2: When Quality and Policy Collide in Evaluating Math-Science Partnership Programs: Strategies for Resolution MaryLynn Quartaroli, Professional Evaluation & Assessment Consultants; and Hollace Bristol, Coconino County Education Services Agency Multipaper to be held in Bonham C Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Andrea Beesley, Mid-continent Research for Education and Learning Discussant - Lizanne Destefano, University of Illinois at Urbana-Champaign Challenges to the Utility of Evaluation of Early Elementary Tutoring and Learning Support Services Magdalena Rood and Cindy Roberts-Gray, Third Coast R&D Inc Evaluation of Reading Intervention Effectiveness Using Growth Models Tammiee Dickenson, University of South Carolina; and Jennifer Young, South Carolina Department of Education Impact of READ180 on At-Risk Middle School Students‘ Literacy Outcomes Margaret Gheen and Shahpar Modarresi, Montgomery County Public Schools Evaluating Professional Development Training in Early Literacy: Alternatives for Measuring Participant Use of New Skills Post Training– Use of Action Plans and Levels of Use Indicators Ann Zukoski, Rainbow Research Inc; Joanne Knapp-Philo, National Head Start Family Literacy Center; and Kim Stice, National Head Start Family Literacy Center 224 - How Did You Do It? Implementing Performance Measurement and Monitoring Systems 226 - Methods Leading to Higher Quality Evaluations in Education Evaluation Multipaper to be held in Bonham B Sponsored by the Non-profit and Foundations Evaluation TIG Chair - Eric Barela, Partners in School Innovation Monitoring and Evaluation (M&E) at Room to Read: Concepts and Practice in an International Non-Profit Educational Organization Michael Wallace, Rebecca Dorman, and Peter Cooper, Room to Read Approach to Performance Measurement and Effectiveness of the Children‘s Investment Fund Foundation Nalini Tarakeshwar, Peter McDermott, Anna Hakobyan, and Tomohiro Hamakawa, Children's Investment Fund Foundation A Strategic Planning Case Study: Implementing a Data Dashboard for a Nonprofit Board‘s Self-Evaluation, Monitoring, and Evidence-based Decision Making Veronica Smith, data2insight Building and Implementing a Performance Management System to Inform Evaluation: Lessons Learned Eric Barela, Partners in School Innovation Multipaper to be held in Bonham D Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Tom McKlin, The Findings Group LLC Discussant - Anane Olatunji, Fairfax County Public Schools Maturation Effects of Multi-cycle Initiatives: The Importance of Time Sensitive Indicators When Evaluating Impact Lindsey Rosecrans and Kathy Gullie, State University of New York at Albany Enhancing Evaluation Quality of Programs Serving Youth: Data Collection Strategies and Ethical Issues Katherine LaVelle, Five Acres; and Tiffany Berry, Susan Menkes, and Krista Collins, Claremont Graduate University Impacts of Comprehensive Teacher Induction: Results From the Second Year of a Randomized Controlled Study Eric Isenberg, Steven Glazerman, Martha Bleeker, Amy Johnson, Julieta Lugo-Gil, Mary Grider, and Sarah Dolfin, Mathematica Policy Research; and Edward Britton, WestEd Using a Mixed Methods Design to Identify Exemplary College Access Centers in Texas High Schools Jacqueline Stillisano, Hersh Waxman, Yuan-Hsuan Lee, Kayla Braziel Rollins, Rhonda Goolsby, and Chyllis Scott, Texas A&M University 223 – Roundtables in Bonham A The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Evaluation 2010: Thursday, November 11, 9:15 AM – 10:45 AM Page 39 Thursday, 9:15 am to 10:45 am, continued 227 - Enhancing the Quality of Evaluation Through Collaboration Among Funders, Programs, and Evaluators: The Example of the New York City Health Bucks Program Evaluation Panel to be held in Bonham E Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Chair - Jan Jernigan, Centers for Disease Control and Prevention The Intersection of Quality and Collaboration: From a Funder's Perspective Gayle Payne and Jan Jernigan, Centers for Disease Control and Prevention The Intersection of Quality and Collaboration: From a Program's Perspective Sabrina Baronberg, New York City Department of Health and Mental Hygiene The Intersection of Quality and Collaboration: From an Evaluator's Perspective Yvonne Abel, Lauren Olsho, Debbie Walker, Cristina Booker, Jacey Greece, Cheryl Hewitt, and Leah Staub-DeLong, Abt Associates Inc 228 - Methodological Choices in Assessing the Quality and Strength of Evidence on Effectiveness Panel to be held in Texas A Sponsored by the Government Evaluation TIG Chair - Valerie J Caracelli, United States Government Accountability Office Comparing the Top Tier Evidence Approach to Other Systematic Evidence Reviews Stephanie Shipman and Valerie J Caracelli, United States Government Accountability Office Methodological Considerations in Selecting Programs for the Model Programs Guide Marcia Cohen, Development Services Group Inc National Registry of Evidence-based Programs and Practices Approach to Evaluating the Evidence Kevin Hennessy, United States Department of Health and Human Services The Evidence-based Practice Centers: A National Approach to Systematically Assessing Evidence of Effectiveness of Health Care Interventions Jean Slutsky, United States Department of Health and Human Services 229 - Evaluating With Validity: Truth, Justice, and the Beautiful Way Panel to be held in Texas B Sponsored by the Theories of Evaluation TIG Chair - James Griffith, Claremont Graduate University Discussant - Ernest House, University of Colorado Truth, Beauty, and Justice: Conceptualizing House‘s Framework for Evaluation in Community-based Settings Katrina Bledsoe, Walter R McDonald and Associates Inc Truth, Beauty, and Justice: The Best Way to Spot a Real, Genuine, Authentic Evaluation? Jane Davidson, Real Evaluation Ltd Whose Roots? Pushing the Justice Envelope in Evaluation Rodney Hopson, Duquesne University 230 - Dealing With Technical Challenges in Mixed Methods Evaluation Multipaper to be held in Texas C Sponsored by the Mixed Methods Evaluation TIG Chair - Virginia Dick, University of Georgia Discussant - Susan Labin, Independent Consultant A Mixed Methods Toolkit for Evaluating Translational Science Education Programs Julie Rainwater and Stuart Henderson, University of California, Davis The Tale of Two Mixed Methods Projects Jori Hall, University of Georgia; and Katherine Ryan, University of Illinois at Urbana-Champaign 231 - Analysis and Evaluation of Research Portfolios Using Quantitative Science Panel to be held in Texas D Sponsored by the Research, Technology, and Development Evaluation TIG Chair - Laurel Haak, Discovery Logic Practical Applications of Bibliometrics: What Makes Sense in Different Contexts? Frédéric Bertrand and David Campbell, Science-Metrix Corporation Applying Metrics to Evaluate the Continuum of Research Outputs: Near to Long-term Impact Joshua Schnell, Beth Masimore, Laurel Haak, Matt Probus, and Michael Pollard, Discovery Logic 232 - Why Evaluators Need Graphic Design Skills Demonstration to be held in Texas E Sponsored by the Evaluation Use TIG Stephanie Evergreen, Western Michigan University Evaluation 2010: Thursday, November 11, 9:15 AM – 10:45 AM Page 40 233 - New Directions for Research on Evaluation Panel to be held in Texas F Sponsored by the Research on Evaluation TIG Chair - John LaVelle, Claremont Graduate University Research on Evaluation Context: Examples and Ideas Michael Szanyi, Claremont Graduate University Research on Evaluation Consequences: A Meta-analysis of Evaluation Use Mark Hansen and Anne Vo, University of California, Los Angeles Research on Professional Issues in Evaluation: Next Steps John LaVelle, Claremont Graduate University 234 - Respecting and Protecting Boundaries: Social Evaluation Competencies Think Tank to be held in Crockett A Sponsored by the AEA Conference Committee Presenter - Phyllis Clay, Albuquerque Public Schools Discussants - Ranjana Damle, River Dunavin, Debra Heath, and Nancy Carillo, Albuquerque Public Schools 235 - Evaluation Utilization and the Story of the Federal Railroad Administration‘s 10 Year Research and Development Effort to Change Safety Culture in the United States Rail Industry Panel to be held in Crockett B Sponsored by the Business and Industry TIG Chair - Michael Quinn Patton, Utilization-Focused Evaluation Discussant - Deborah Bonnet, Fulcrum Corporation High Quality Evaluation Utilization as a Method to Improve Safety Culture Change in the United States Railroad Industry: Challenges, Opportunities, Failures, and Success Michael Coplen, United States Department of Transportation Overview of Safety Culture Evaluation Designs Jonathan Morell, Vector Research Center; and Joyce Ranney and Michael Zuschlag, Volpe National Transportation Systems Center Empirical Findings of Safety Culture Initiatives: Data Sources, Analyses, and Findings Joyce Ranney and Michael Zuschlag, Volpe National Transportation Systems Center; and Jonathan Morell, Vector Research Center Promoting Industry-wide Impact: Safety Culture Policy, Current Accomplishments, and Plans for the Future Stephanie Morrow, Volpe National Transportation Systems Center; Michael Coplen, United States Department of Transportation; and Joyce Ranney, Volpe National Transportation Systems Center 236 - Assessing Impacts in Real World Evaluations: Alternatives to the Conventional Statistical Counterfactual Think Tank to be held in Crockett C Sponsored by the International & Cross-cultural Evaluation TIG Presenter - Michael Bamberger, Independent Consultant Discussant - Jim Rugh, Independent Consultant; Megan Steinke, Save the Children; and J Bradley Cousins, University of Ottawa 237 - Evaluation and Quality: Examples From Government Multipaper to be held in Crockett D Sponsored by the Government Evaluation TIG Chair - Sam Held, Oak Ridge Institute for Science and Education The Long and Winding Road: How the Integration of Evaluation Performance Measures and Results Can Lead to Better Quality Evaluations Gale Mentzer, University of Toledo The External Reviewer's Role in Helping to Promote Evaluation Quality: Examples From the Government Accountability Office's (GAO) Recent Experience Martin de Alteriis, United States Government Accountability Office Evaluating Data Quality in the Veterans Health Administration All Employee Survey Katerine Osatuke, Scott C Moore, Boris Yanovsky, and Sue R Dyrenforth, United States Department of Veterans Affairs Employment and Training Administration: Increased Authority and Accountability Could Improve Evaluation and Research Program Kathleen White and Ashanta Williams, United States Government Accountability Office 238 - Navigating the Intricacies of Culture and Context in International Program Evaluation Multipaper to be held in Republic A Sponsored by the International & Cross-cultural Evaluation TIG Chair - Mary Crave, University of Wisconsin Personalizing Outcomes: Feasibility and Utilization of Individual Goal-Setting in an International Context Melissa Velazquez, Christian Foundation for Children and Aging Do Evaluation Frameworks Support Equity and Social Justice? Lessons Learned in East Central and South-Eastern Europe Linda E Lee and Larry K Bremner, Proactive Information Services Inc Evaluation 2010: Thursday, November 11, 9:15 AM – 10:45 AM Page 41 Thursday, 9:15 am to 10:45 am, continued 239 - Evaluating Health Program Sustainability: Improving the Quality of Methods and Measures Think Tank to be held in Republic B Sponsored by the Health Evaluation TIG and the Non-profit and Foundations Evaluation TIG Mary Ann Scheirer, Scheirer Consulting 240 - Using a Practical Lens to Develop NationalLevel Participatory Projects Demonstration to be held in Republic C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Tobi Lippin, New Perspectives Consulting Group; Thomas McQuiston, Tony Mazzocchi Center for Health, Safety and Environmentt; and Kristin Bradley-Bull, New Perspectives Consulting Group Evaluation 2010: Thursday, November 11, 9:15 AM – 10:45 AM Page 42 Notes: Evaluation 2010: Thursday, November 11, 9:15 AM – 10:45 AM Page 43 Summary of Sessions for Thursday, November 11, 10:55 AM to 12:25 PM No Primary Sponsor Session Session Title Room 242 Presidential Strand Think Tank Cultural Competency in Evaluation: Discussion of the American Evaluation Association's Public Statement… Lone Star A 243 Program Theory and Theory-driven Eval TIG Multipaper Improving the Practice of Theory-driven Evaluation: Understanding the Role of Stakeholders and Context in Evaluation… Lone Star B 244 Collaborative, Participatory & Empowerment Think Tank What We Don‘t Say Can Hurt Us: Working with Undiscussables Lone Star C 245 Non-profit and Foundations Evaluation TIG Multipaper Evaluating Social Service Programs for Government and Foundations Lone Star D 246 Quantitative Methods: Theory and Design TIG Business Meeting Business Meeting and Presentation: What is New in Multiple Comparison Procedures Lone Star E 247 Internal Evaluation TIG Business Meeting Business Meeting and Presentation: A Decade of Internal Evaluation in One School District - How Times Changes Lone Star F 248 Graduate Student and New Evaluator TIG Roundtable Rotation I: Grad Students on Grad Students: Evaluating Peers in a Professional Context Rotation II: A Student-Generated Collaborative Approach to Developing New Evaluator Competencies Mission A 249 Disabilities and Other Vulnerable Populations Panel Issues and Models: Evaluating Universal Design for Learning Mission B 250 Systems in Evaluation TIG Think Tank Systems Theories in Evaluation Planning: Differentiating Planning Process from Evaluation Plan Bowie A 251 Multiethnic Issues in Evaluation TIG Panel Race, Class, and Power: Bringing The Issues Into Discussion and Evaluation Bowie B 252 Indigenous Peoples in Evaluation TIG Multipaper Culturally Responsive Evaluation: Three Cases From Aboriginal Peoples and First Nations in Canada Bowie C 253 Advocacy and Policy Change TIG Roundtable Rotation I: Theory of Change Evaluation in the Real World: Lessons Learned from Applying (and Modifying) the TOC Approach… Goliad Rotation II: Evaluating Foundation Advocacy Strategies: When Theory and Practice Collide 254 Research, Technology, and Development Eval Roundtable Rotation I: Choices of R&D Evaluation Approaches in Chinese Academy of Sciences (CAS) Institutes…. Rotation II: Producing Evidence of Effectiveness Data in the Real World of Early Childhood Education San Jacinto 255 Assessment in Higher Education TIG Multipaper Assessing Student Learning Outcomes II: Three Sides of the Coin Travis A 256 Integrating Technology Into Evaluation Multipaper Visualizing Data for Strategic Planning Travis B 257 Non-profit and Foundations Evaluation TIG Panel Measuring the Immeasurable: Lessons for Building Grantee Capacity to Evaluate Hard-to-assess Efforts Travis C 258 Evaluating the Arts and Culture TIG Panel Evaluation in Action: A Sampler of Tracking and Timing Methodologies in Museums, Culturals, and Informal Education… Travis D 259 Human Services Evaluation TIG Multipaper Implementing Quality Randomized Control Trials in Human Service Evaluations: Applications Addressing Challenges… Independence 260 Lesbian, Gay, Bisexual, Transgender Issues TIG Multipaper Including Everyone: Lesbian, Gay, Bisexual, Transgender, People of Color, and Double Winners Presidio A 261 Org Learning & Evaluation Capacity Bldg TIG Multipaper Building, Enhancing, and Sustaining Evaluation Quality for Organizational Learning Presidio B 262 Alcohol, Drug Abuse, and Mental Health TIG Multipaper Analytic and Measurement Approaches in Substance Abuse and Mental Health Evaluation Presidio C Evaluation 2010: Thursday, November 11, 10:55 AM – 12:25 PM Page 44 Summary of Sessions for Thursday, November 11, 10:55 AM to 12:25 PM, Continued No Primary Sponsor Session Session Title Room 263 Non-profit and Foundations Evaluation TIG Roundtable Rotation I: Evaluation as a Management and Learning Tool for the Successful Development and Scaling of Innovative… Rotation II: Evaluating Enterprising Nonprofits: The Social Return on Investment Bonham A 264 Non-profit and Foundations Evaluation TIG Panel Using Evaluation to Improve the Quality of the Initial Implementation of a Statewide Community and State Level Policy… Bonham B 265 Pre-K - 12 Educational Evaluation TIG Multipaper Group and Cluster Randomized-Control Experimental Interventions in Educational Evaluation Studies Bonham C 266 Pre-K - 12 Educational Evaluation TIG Panel Integrating High Quality Evaluation Into a National Integrated Services in Schools Initiative Bonham D 267 Environmental Program Evaluation TIG Multipaper Environmental Education Evaluation: Examining Citizen Collected Data, Mixed Method Designs, and Professional Dev… Bonham E 268 Government Evaluation TIG Multipaper International Approaches to Government Evaluation Texas A 269 Qualitative Methods TIG Skill-building Circular Dialogue and Other Dialectical Methods of Inquiry Texas B 270 Mixed Methods Evaluation TIG Demonstration Better Evaluation - A Toolbox of Evaluation Methods and Applications That Supports Quality and Methodological Diversity Texas C 271 Research, Technology, and Development Eval Panel Analysis and Evaluation of Research Portfolios Using Quantitative Science Metrics: Theory Texas D 272 Evaluation Use TIG Panel Mainstreaming Evaluation in Diverse Organizational Contexts Texas E 273 AEA Conference Committee MultiPaper Truth, Beauty, and Justice: Thirty Years Later Texas F 274 Extension Education Evaluation TIG Panel The Role of Evaluation During Tough Fiscal Times: Sage Advice From Evaluation Leaders Crockett A 275 Business and Industry TIG Multipaper Evaluating Leadership Development in Organizations Crockett B 276 International and Cross-cultural Evaluation TIG Panel National Evaluation Capacity Development Crockett C 277 Government Evaluation TIG NASA Office of Education‘s Portfolio Evaluation Approach: Focus on Questions That Provide High Value Answers Crockett D 278 International and Cross-cultural Evaluation TIG Multipaper Evaluating Education, Health Education and Agriculture Education Around the Globe Republic A 279 Health Evaluation TIG Panel Keep an Eye on the Basics: The Importance of Evaluating Public Health Program Infrastructure Republic B 280 Collaborative, Participatory & Empowerment Multipaper A Checklist for Planning, Implementing and Evaluating Implementation Quality Republic C MultiPaper Evaluation 2010: Thursday, November 11, 10:55 AM – 12:25 PM Page 45 Thursday, 10:55 am to 12:25 pm 242 - Cultural Competency in Evaluation: Discussion of the American Evaluation Association's Public Statement on the Importance of Cultural Competence in Evaluation Think Tank to be held in Lone Star A Sponsored by the Presidential Strand Presenter - Cindy A Crusto, Yale University Discussants - Katrina Bledsoe, Walter R McDonald and Associates Inc; Karen E Kirkhart, Syracuse University; Bessa Whitmore, Carleton University; Jenny Jones, Virginia Commonwealth University; and Katherine A Tibbetts, Kamehameha Schools Visual Recorder - Terry Uyeki, Humboldt State University 243 - Improving the Practice of Theory-driven Evaluation: Understanding the Role of Stakeholders and Context in Evaluation Settings Multipaper to be held in Lone Star B Sponsored by the Program Theory & Theory-driven Evaluation TIG Chairs- Cindy Gilbert, United States Government Accountability Office; and Uda Walker, Gargani + Company Learning for and From Change: Application of Theory of Change-based Monitoring and Evaluating (M&E) to FastTracking Capacities of African Women Scientists in Agricultural Research and Development James Kakooza and Margaret Kroma, African Women in Agricultural Research and Development; Zenda Ofir, Evalnet South Africa Theory-based Stakeholder Evaluation Morten Balle Hansen, University of Southern Denmark; and Evert Vedung, Uppsala University Issues on Social Science Theory Versus Stakeholder Theorybased Interventions: Leasons Learned From Evaluating an Environmental Tobacco Smoke Intervention Program Huey Chen, Centers for Disease Control and Prevention; and Nannette Turner, Mercer University Evidence-based Interventions in the Context of Program Evaluation: A Critique and Alternative Perspective Huey Chen and Paul Garbe, Centers for Disease Control and Prevention Did you know? AEA received over 1100 proposals to present at Evaluation 2010. 244 - What We Don‘t Say Can Hurt Us: Working with Undiscussables Think Tank to be held in Lone Star C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Presenter - Alexis Kaminsky, Kaminsky Consulting Discussants - Hazel Symonette, University of Wisconsin; Jennifer Dewey, James Bell Associates; Virginia Dick, University of Georgia; Maggie Dannreuther, Stennis Space Center; Ranjana Damle, Albuquerque Public Schools; and Elena Polus, Iowa State University 245 - Evaluating Social Service Programs for Government and Foundations Multipaper to be held in Lone Star D Sponsored by the Non-profit and Foundations Evaluation TIG Chair - Beth Stevens, Mathematica Policy Research Foundation Requests for Rigorous Evaluation and the Response of Their Community-based Grantees Beth Stevens, Daniel Finkelstein, Jung Kim, Michaella Morzuch, and Cicely Thomas, Mathematica Policy Research Evaluating Programs Funded by Government and Delivered by Nonprofits: A Grounded Model for More Accurate and Useful Evaluation of Contracted Social Services Christopher Horne, University of Tennessee, Chattanooga Successes and Challenges of a Nonprofit Organization‘s Effort to Improve Evaluation Quality by Adopting a Client Information System (CIS) Adrienne Adams and Nidal Karim, Michigan State University; Sue Coats, Turning Point Inc; Sallay Barrie, Nkiru Nnawulezi, Cris Sullivan, and Katie Gregory, Michigan State University 246 - Quantitative Methods Theory and Design TIG Business Meeting and Presentation: What is New in Multiple Comparison Procedures Business Meeting to be held in Lone Star E Sponsored by the Quantitative Methods: Theory and Design TIG Chair - Dale Berger, Claremont Graduate University Presenter - Roger Kirk, Baylor University TIG Leaders - Patrick McKnight, George Mason University; George Julnes, University of Baltimore; Karen Larwin, Youngstown State University; and Raymond Hart, Georgia State University 247 - Internal Evaluation TIG Business Meeting and Presentation: A Decade of Internal Evaluation in One School District - How Times Change Business Meeting to be held in Lone Star F Sponsored by the Internal Evaluation TIG Presenter - Jean A King, University of Minnesota TIG Leaders - Boris Volkov, University of North Dakota; and Wendy DuBow, National Center for Women and Information Technology Evaluation 2010: Thursday, November 11, 10:55 AM – 12:25 PM Page 46 248 – Roundtables in Mission A The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Graduate Student and New Evaluator TIG Rotation 1: Grad Students on Grad Students: Evaluating Peers in a Professional Context Matthew Linick, Marjorie Dorime-Williams, and Seung Won Hong, University of Illinois at Urbana-Champaign Rotation 2: A Student-Generated Collaborative Approach to Developing New Evaluator Competencies Jason Black, Pamela Bishop, Shayne Harrison, Susanne Kaesbauer; and Thelma Woodard, University of Tennessee, Knoxville 249 - Issues and Models: Evaluating Universal Design for Learning Panel to be held in Mission B Sponsored by the Disabilities & Other Vulnerable Populations TIG Chair - Bob Hughes, Seattle University Assessment of Learning in Universal Design for Learning Tracey Hall, Center for Applied Special Technology Logic Model and Evaluation Plan of a Universal Design for Learning Project at the University of Vermont David Merves, Evergreen Educational Consulting LLC Evaluating the Impact of Universal Design for Learning in Early Childhood Education Donald Smith, Texas Early Childhood Education Coalition Addressing the Complexity: A Model for Designing Universal Design for Learning Evaluations Bob Hughes, Seattle University 250 - Systems Theories in Evaluation Planning: Differentiating Planning Process from Evaluation Plan Think Tank to be held in Bowie A Sponsored by the Systems in Evaluation TIG Presenters - Claire Hebbard, Cornell University Discussants - William M Trochim, Thomas Archibald, and Monica Hargraves, Cornell University 251 - Race, Class, and Power: Bringing The Issues Into Discussion and Evaluation Panel to be held in Bowie B Sponsored by the Multiethnic Issues in Evaluation TIG Chair - Dawn Smart, Clegg & Associates Race, Class, and Power in Rural Development Tracey Greene-Dorsett, National Rural Funders Collaborative Developing Tools to Measure Race, Class and Power Jessica Anders, NeighborWorks America Evaluating Race, Class and Power Dawn Smart, Clegg & Associates 252 - Culturally Responsive Evaluation: Three Cases From Aboriginal Peoples and First Nations in Canada Multipaper to be held in Bowie C Sponsored by the Indigenous Peoples in Evaluation TIG Chair and Discussant- Andrea LK Johnston, Johnston Research Inc The Aboriginal ActNow Health Promotion Initiative: The Role of Context Kim van der Woerd, Reciprocal Consulting; and Donna Atkinson, University of Northern British Columbia Deconstructing and Rebuilding Evaluation Practices With Indigenous Communities: Examples From the Canadian Context Larry K Bremner, Proactive Information Services Inc A Journey Toward Understanding Evaluation Quality and Complexity in Aboriginal Communities: A Discussion of Three National Evaluation Initiatives Jill Anne Chouinard and Katherine Moreau, University of Ottawa 253 – Roundtables in Goliad The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Advocacy and Policy Change TIG and the Evaluation Policy TIG Rotation 1: Theory of Change Evaluation in the Real World: Lessons Learned from Applying (and Modifying) the TOC Approach in the Evaluation of the Tobacco Policy Change Program Andrea Anderson-Hamilton, Anderson Hamilton Consulting Rotation 2: Evaluating Foundation Advocacy Strategies: When Theory and Practice Collide Catherine Borgman-Arboleda and Rachel Kulick, City University of New York (CUNY) 254 – Roundtables in San Jacinto The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Research, Technology, and Development Evaluation TIG and the Pre-K - 12 Educational Evaluation TIG Rotation 1: Choices of Research and Development (R&D) Evaluation Approaches in Chinese Academy of Sciences (CAS) Institutes: We Reap What We Sow? Xiaoxi Xiao, Changhai Zhou, and Tao Dai, Chinese Academy of Sciences Rotation 2: Producing Evidence of Effectiveness Data in the Real World of Early Childhood Education Cindy Lin and Marijata Daniel-Echols, HighScope Educational Research Foundation Evaluation 2010: Thursday, November 11, 10:55 AM – 12:25 PM Page 47 Thursday, 10:55 am to 12:25 pm, continued 255 - Assessing Student Learning Outcomes II: Three Sides of the Coin Multipaper to be held in Travis A Sponsored by the Assessment in Higher Education TIG Chair - Audrey Rorrer, University of North Carolina at Charlotte Discussant - Jeanne Hubelbank, Independent Consultant Assessing Student Engagement in the Classroom: Pilot Studies of an Instrument for Studying Student Engagement and Its Determinants in Higher Education Rick Axelson, University of Iowa; and Arend Flick, Norco College End of Course Evaluations: Enhancing the Curriculum Evaluation Process Through Faculty Feedback Katherine Shaw, Westwood College Organizational Readiness for Outcomes Assessment in Higher Education Yukiko Watanabe, University of Hawaii, Manoa 256 - Visualizing Data for Strategic Planning Multipaper to be held in Travis B Sponsored by the Integrating Technology Into Evaluation TIG Chair - Metta Alsobrook, University of Texas, Dallas Creating a Comprehensive Dashboard for Strategic Planning: Inception to Implementation Jennifer Reeves, Barbara Packer-Muti, and Candace Lacey, Nova Southeastern University Listserv Activity as an Indicator of Vitality and Growth in International Community of Practice Networks Stacey Friedman, Page Morahan, Williams Burdick, and Deborah Diserens, Foundation for Advancement of International Medical Education & Research; Avinash Supe, GS Medical College; Tejinder Singh, Christian Medical College; Thomas Chacko, PSG Institute of Medical Sciences and Research; Eliana Amaral, Universidade Estadual de Campinas; Henry Campos, Universidade Federal do Ceará; Vanessa Burch, University of Cape Town; and Gboyega Ogunbanjo, University of Limpopo Public Comprehension of Published Data: Technology to the Rescue? Paul Lorton Jr, University of San Francisco 257 - Measuring the Immeasurable: Lessons for Building Grantee Capacity to Evaluate Hard-to-Assess Efforts Panel to be held in Travis C Sponsored by the Non-profit and Foundations Evaluation TIG Chair - Lande Ajose, BTW Informing Cchange The Hewlett Foundation‘s Education Program Grantee Evaluation Kristi Kimball, William and Flora Hewlett Foundation; Jennifer Curry Villeneuve, Lande Ajose, and Kim Ammann Howard, BTW Informing Change Evaluation Capacity Building: A Grantee‘s Perspective John Affeldt, Public Advocates Measuring the Immeasurable: Lessons for Building Grantee Capacity to Evaluate Hard-to-Assess Efforts Lande Ajose, Kim Ammann Howard, and Ellen Irie, BTW Informing Change 258 - Evaluation in Action: A Sampler of Tracking and Timing Methodologies in Museums, Culturals, and Informal Education Settings Panel to be held in Travis D Sponsored by the Evaluating the Arts and Culture TIG Chair and Discussant - Kathleen Tinworth, Denver Museum of Nature & Science Tracking Among the Ruins: Informing Interpretive Planning at Eastern State Penitentiary Cheryl Kessler, Independent Consultant Reflective Tracking: When It‘s Simply too Large Joe E Heimlich, Ohio State University Unspoken Narratives: What Visitor Behavior Reveals About Exhibit Usage and Selection Carey Tisdal, Tisdal Consulting Analysis and Visualization of Timing and Tracking Data: Examples From Two Exhibit Evaluations Cláudia Figueiredo, Institute for Learning Innovation 259 - Implementing Quality Randomized Control Trials in Human Service Evaluations: Applications Addressing Challenges and Barriers Multipaper to be held in Independence Sponsored by the Human Services Evaluation TIG and the Quantitative Methods: Theory and Design TIG Chair - Todd Franke, University of California, Los Angeles Discussant - Tania Rempert, University of Illinois at Urbana-Champaign Determining the Impact of Communities In Schools, Inc (CIS) Programs: Student-level Randomized Controlled Trials Heather Clawson, Allan Porowski, Felix Fernandez,and Christine Leight, ICF International Perils, Pitfalls, and Successes: The Implementation of a Randomized Controlled Trial (RCT) to Examine the Effects of Alternative Response in Child Welfare Madeleine Kimmich and Linda Newton-Curtis, Human Services Research Institute Evaluation 2010: Thursday, November 11, 10:55 AM – 12:25 PM Page 48 260 - Including Everyone: Lesbian, Gay, Bisexual, Transgender, People of Color, and Double Winners Multipaper to be held in Presidio A Sponsored by the Lesbian, Gay, Bisexual, and Transgender Issues TIG Chair and Discussant - Kathleen McKay, Connecticut Children's Medical Center The Meeting of Minds: Integrating Collaborative and Anthropological Evaluation to Improve the Lives of Men Who Sleep With Men (MSM) of Color in Tampa, Florida Candace Sibley and Matthew Hart, University of South Florida Engaging the Transformative Paradigm to Assess the HIV Prevention Needs of Young Gay and Bisexual Black Men Robin Lin Miller and Miles McNall, Michigan State University 261 - Building, Enhancing, and Sustaining Evaluation Quality for Organizational Learning Multipaper to be held in Presidio B Sponsored by the Organizational Learning and Evaluation Capacity Building TIG Chair - Imelda Castañeda-Emenaker, University of Cincinnati Discussant - Beverly A Parsons, InSites Enhancing Evaluation Quality and Use for Dynamic Organizations: Lessons Learned from a Developmental Evaluation of a Competency-based Medical Education Innovation Cheryl Poth, Shelley Ross, Rebecca Georgis, Mike Donoff, Paul Humphries, and Ivan Steiner, University of Alberta The Challenge of Secondary School Reform: When Evaluation Improves Practice Cathleen Armstead, Ann G Bessell, and Sabrina F Sembiante University of Miami Sustainable Quality Evaluation: Evaluating Continuous Quality Improvement Processes Matthew Galen, Claremont Graduate University; Deborah Grodzicki, University of California, Los Angeles Building Evaluation Culture and Evaluation Quality in Brazil Daniel Brandão and Martina Otero, Fonte Institute 262 - Analytic and Measurement Approaches in Substance Abuse and Mental Health Evaluation Multipaper to be held in Presidio C Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG Chair - Roger Boothroyd, University of South Florida Evaluating Intervention Effects On Marijuana Use Among Youth by Comparing Alternative Structural Equation Modeling: Decision-Trees Based On Formal Model Comparisons Marlene Berg and Emil Coman, Institute for Community Research Finding Meaning in Numbers: How Well Do Our Measures Capture What We Evaluate? Ann Doucette, George Washington University Barriers to Treatment of the Chronic Homeless with Cooccurring Disorders M David Miller, University of Florida 263 – Roundtables in Bonham A The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Roundtable to be held in Bonham A Sponsored by the Non-profit and Foundations Evaluation TIG Rotation 1: Evaluation as a Management and Learning Tool for the Successful Development and Scaling of Innovative Program Models Helen Davis Picher and Sandra Adams, William Penn Foundation Rotation 2: Evaluating Enterprising Nonprofits: The Social Return on Investment Goutham Menon and Maureen Rubin, University of Texas, San Antonio 264 - Using Evaluation to Improve the Quality of the Initial Implementation of a Statewide Community and State Level Policy and Systems Change Initiative Panel to be held in Bonham B Sponsored by the Non-profit and Foundations Evaluation TIG Chair - Astrid Hendricks, California Endowment Discussant - Marie Colombo, Skillman Foundation Positioning the Foundation to Use Evaluation for Learning and Improved Performance Astrid Hendricks, Mona K Jwahar, and Lori Nascimento, California Endowment The California Endowment‘s Building Healthy Communities: Lessons From the Site-selection Process Hanh Cao Yu, Social Policy Research Associates Use of Logic Models to Structure a Cohesive Planning Approach and an Evaluable Cross-site Comprehensive Community Initiative Jared Raynor, TCC Group The Planning Phase Evaluation: Getting Ready for Implementation of the California Endowment Building Healthy Communities Comprehensive Community Initiative Denise L Baer, Johns Hopkins University; and David M Chavis, Community Science Evaluation 2010: Thursday, November 11, 10:55 AM – 12:25 PM Page 49 Thursday, 10:55 am to 12:25 pm, continued 265 - Group and Cluster Randomized-Control Experimental Interventions in Educational Evaluation Studies Multipaper to be held in Bonham C Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Anane Olatunji, Fairfax County Public Schools Discussant - Melissa Chapman, University of Iowa Lessons Learned from the Implementation of Randomized Trials in the Field of Education Jessaca Spybrook, Anne Cullen, and Monica Lininger, Western Michigan University Effectiveness of Selected Supplemental Reading Comprehension Interventions: Impacts on Two Cohorts of FifthGrade Students Susanne James-Burdumy, John Deke, and Julieta LugoGil, Mathematica Policy Research Rigor Is Only Half the Story: Design Decisions and Context Influences in a Cluster-Randomized Evaluation Study Andrea Beesley, Mid-continent Research for Education and Learning Comparative Advantage in Teaching: A Randomized Experiment Steven Glazerman, Jeffrey Max, and Ali Protik, Mathematica Policy Research 266 - Integrating High Quality Evaluation Into a National Integrated Services in Schools Initiative Panel to be held in Bonham D Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Keith McNeil, University of Texas, El Paso Overview of the Elev8 Model and Evaluation Plan Jacqueline Williams Kaye, Atlantic Philanthropies Crucial Role of Relationship Building in a Multilayered Evaluation Maria Luisa Gonzalez, University of Texas, El Paso Relationship Between Maximizing Integration and Maximizing Effects of the Program Lauren Rich, Chapin Hall Making the Case for Qualitative, Formative Evaluation in a Quantitative, Outcomes-driven Environment Stephen La France, LFA Group 267 - Environmental Education Evaluation: Examining Citizen Collected Data, Mixed Method Designs, and Professional Development Multipaper to be held in Bonham E Sponsored by the Environmental Program Evaluation TIG Chair - Annelise Carleton-Hug, Trillium Associates A National Study of the Professional Development Needs of Formal, Informal, and Nonformal Environmental Educators Lynette Fleming, Research, Evaluation & Development Services A Grounded Theory Exploration of Science Identity in Informal Contexts Tina Phillips, Cornell Univeristy; Elizabeth Danter and John Fraser, Institute for Learning Innovation; and Richard Bonney, Cornell Univeristy Walking in the Footsteps of Aldo Leopold: Evaluation of an Environmental Education Initiative Using a Mixed Method Design Nancy Carrillo, Albuquerque Public Schools 268 - International Approaches to Government Evaluation Multipaper to be held in Texas A Sponsored by the Government Evaluation TIG Chair - Jennifer Bisgard, Khulisa Management Services (Pty) Ltd How has Twenty Years of Educational Evaluation Contributed to Lifting the Quality of Government Evaluation in New Zealand? Kathleen Atkins and Steffan Brough, Education Review Office Recommendations That Catch the Eye, Stimulate the Grey Cells and Generate Change: What Makes a Good Evaluation Recommendation? Lessons from the United Kingdom‘s Department for International Development (DFID) Jonathan Patrick, Department for International Development Implementing Government of Canada Evaluation Policy Requirements: Using Risk to Determine Evaluation Approach and Level of Effort Courtney Amo and Shannon Townsend, National Research Council Canada Government, Implementation And Evaluation: The Viability and Evaluability of National Policy Programs Anna Petersén, Lars Oscarsson, and Christian Kullberg, Orebro University; and Ove Karlsson Vestman, Malardalen University Whose Fault is It? A Federal Government's Effort to Improve Evaluation Quality Laura Tagle, Italy's Ministry for Economic Development; and Massimiliano Pacifico, Evaluation Unit of Region Lazio 269 - Circular Dialogue and Other Dialectical Methods of Inquiry Skill-building Workshop to be held in Texas B Sponsored by the Qualitative Methods TIG Richard Hummelbrunner, OEAR Regional Development Consultants Evaluation 2010: Thursday, November 11, 10:55 AM – 12:25 PM Page 50 270 - Better Evaluation - A Toolbox of Evaluation Methods and Applications That Supports Quality and Methodological Diversity Demonstration to be held in Texas C Sponsored by the Mixed Methods Evaluation TIG Patricia Rogers, Royal Melbourne Institute of Technology; and Suman Sureshbabu, Rockefeller Foundation 271 - Analysis and Evaluation of Research Portfolios Using Quantitative Science Metrics: Theory Panel to be held in Texas D Sponsored by the Research, Technology, and Development Evaluation TIG Chair - Israel Lederhendler, National Institutes of Health Discussant - Gretchen Jordan, Sandia National Laboratories How Can Portfolio Analysis Assist Government Research Agencies to Make Wise Research Investments? Wagner Robin and Matthew Eblen, National Institutes of Health Limits of Portfolio Analysis to Address Evaluation Questions Brian Zuckerman, Science and Technology Policy Institute Reinventing Portfolio Analysis at the National Institutes of Health: Explorations in the Structure and Evolution of Biomedical Research Israel Lederhendler, Kirk Baker, Archna Bhandari, and Carole Christian, National Institutes of Health Intersections Among Scientometrics, Science Portfolio Analysis, and Research Evaluation: Does Complex Systems Science Offer Workable Theory? Caroline Wagner, Science-Metrix Corp 272 - Mainstreaming Evaluation in Diverse Organizational Contexts Panel to be held in Texas E Sponsored by the Evaluation Use, Organizational Learning & Evaluation Capacity Building and Research on Evaluation TIGs Chair - Gloria Sweida-DeMania, Claremont Graduate University Mainstreaming Evaluation: Practices and Innovations Amy Gullickson, Western Michigan University Mainstreaming Evaluation Into Faculty Professional Development Programs Randahl Kirkendall and Ellen R Iverson, Carleton College Mainstreaming Evaluation in Agricultural Research and Development Rachel Muthoni, International Center for Tropical Agriculture Working Backwards: Using the Evaluation Report to Write Evaluation Questions Sam Held, Oak Ridge Institute for Science and Education 273 - Truth, Beauty, and Justice: Thirty Years Later MultiPaper to be held in Texas F Sponsored by the AEA Conference Committee Chair - Timothy Cash, University of Illinois at UrbanaChampaign Vitality and Disorder Thirty Years Later: Reflections Inspired by House (1980) Melvin Mark, Pennsylvania State University An Examination of Validity in Evaluation: Reflections Inspired by House (1980) Laura Peck, Arizona State University Evidence-based Policy and Practice and the Idea of Social Justice Thomas Schwandt and Timothy Cash, University of Illinois at Urbana-Champaign Democratizing Evaluation and Its Pitfalls Beth Weitzman, Tod Mijanovich, and Diana Silver, New York University 274 - The Role of Evaluation During Tough Fiscal Times: Sage Advice From Evaluation Leaders Panel to be held in Crockett A Sponsored by the Extension Education Evaluation TIG Chair - Joseph Donaldson, University of Tennessee Discussant - Nancy Franz, Virginia Tech Evaluator‘s Role in Building Capacity and Demonstrating Public Value Joseph Donaldson, University of Tennessee Evaluator‘s Role in Organizational Transformation Molly Engle, Oregon State University 275 - Evaluating Leadership Development in Organizations Multipaper to be held in Crockett B Sponsored by the Business and Industry TIG Chairs - Ray Haynes, Indiana University; and Eric Abdullateef, Directed Study Services Assessing a High Performing Organization‘s Leadership Selection and Development: The Use of the Leadership3 Instrument as an Evaluation Tool in Organizational Development Darryl Jinkerson and Phil Vardiman, Abilene Christian University Evaluation and Performance of University Boards: A Framework for Analysis Zita Unger, Evaluation Solutions Pty Ltd Leader Development and Leadership Development Programs: The Must Haves in Determining Program Value Ray Haynes, Barbara Bichelmeyer, and Ria Roy, Indiana University Evaluation Quality as Authentic Alignment Between People and Goals Eric Abdullateef, Directed Study Services Evaluation 2010: Thursday, November 11, 10:55 AM – 12:25 PM Page 51 Thursday, 10:55 am to 12:25 pm, continued 276 - National Evaluation Capacity Development Panel to be held in Crockett C Sponsored by the International & Cross-cultural Evaluation TIG Chair - Hallie Preskill, FSG Social Impact Advisors Discussant - Michael Quinn Patton, Utilization-Focused Evaluation Towards a Conceptual Framework for National Evaluation Capacity Development Marco Segone, United Nations Children's Fund Successes and Failures in Development of Citizens‘ and Their Representatives‘ Evaluative Capacities Christina Bierring, United Nations Children's Fund Use of Training in Evaluation Capacity Building Alexey Kuzmin, Process Consulting Company 277 - National Aeronautics and Space Administration (NASA) Office of Education‘s Portfolio Evaluation Approach: Focus on Questions That Provide High Value Answers MultiPaper to be held in Crockett D Sponsored by the Government Evaluation TIG Chair - Brian Yoder, National Aeronautics and Space Administration NASA‘s Requirements for and Uses of Program Evaluation Brian Yoder, National Aeronautics and Space Administration Evaluation of NASA‘s Higher Education Portfolio Clemencia Cosentino de Cohen, Urban Institute; and Jennifer Carney, Abt Associates Inc Evaluation of NASA‘s Science, Engineering, Mathematics, and Aerospace Academy (SEMAA) Program: A National Program Impact and Implementation Study Alina Martinez, Abt Associates Inc; and Clemencia Cosentino de Cohen, Urban Institute Evaluation of NASA's Informal Education Program: A Qualitative Approach Alyssa Rulf Fountain and Hilary Rhodes, Abt Associates Inc; and Abigail Levy, Education Development Center 278 - Evaluating Education, Health Education and Agriculture Education Around the Globe Multipaper to be held in Republic A Sponsored by the International & Cross-cultural Evaluation TIG Chair - Maria Whitsett, Moak, Casey and Associates Satisfaction of Employers for Agricultural Graduates: Perspective for the Future Virginia Gravina, University of the Republic A Cross-Case Analyses of Different Stakeholders‘ Perceptions About the Quality of an Evaluation Program: Colombia‘s National Bilingual Program Alexis Lopez, University of Los Andes, Colombia Balancing Global Focus With Local Perspectives: A Comparative Study of Innovative Teaching and Learning in Four Countries Presenters - Corinne Singleton, Savitha Moorthy, and Linda Shear, SRI International Use of the Task Analysis Methodology to Strengthen Education of Nurses, Midwives, and Physician Assistants in Liberia Presenters - Mary Drake, A Udaya Thomas, and Marion Subah, Jhpiego 279 - Keep an Eye on the Basics: The Importance of Evaluating Public Health Program Infrastructure Panel to be held in Republic B Sponsored by the Health Evaluation TIG Chair - Leslie Fierro, SciMetrika Evaluation in Support Of High-quality Asthma Partnerships Carlyn Orians, Shyanika Wijesinha Rose, and Linda Winges, Battelle Memorial Institute; Sarah Gill, Cazador; and Robin Shrestha-Kuwahara, Centers for Disease Control and Prevention The Value and Utility of Evaluating Public Health Partnerships: An Example From Utah Rebecca Giles, Utah Department of Health Asthma Program Evaluation as a Program Improvement Tool: Evaluation of Asthma Surveillance Systems Amanda Savage Brown, Cazador; Leslie Fierro, SciMetrika; Linda Winges, Battelle Memorial Institute The Value and Utility of Evaluating Public Health Surveillance: Asthma Mortality Rates Among Seniors in Minnesota Wendy Brunner, Minnesota Department of Health 280 - A Checklist for Planning, Implementing and Evaluating Implementation Quality MultiPaper to be held in Republic C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Chair - Jason Katz, University of South Carolina Discussant - Sandra Naoom, National Implementation Research Network The Getting to Outcomes (GTO) Implementation and Process Evaluation Tools: Conceptual Basis and Overview Jason Katz, Victoria Chien, Duncan Meyers, Jonathan Scaccia, Annie Wright, Sheara Fernando, Pamela Imm, and Abraham Wandersman, University of South Carolina Planning and Monitoring Implementation: The Maternal Outreach Management Services (MOMS) Project Jonathan Scaccia, Jennifer Castellow, Isha W Metzger, Aimee Sickels, John D Terry, Jason Katz, and Abraham Wandersman, University of South Carolina Implementing a Community-driven Project With Quality to Enhance Client Outcomes in a University-based Community Mental Health Facility Duncan Meyers and Abraham Wandersman, University of South Carolina Evaluation 2010: Thursday, November 11, 10:55 AM – 12:25 PM Page 52 Thursday, 12:35 pm to 1:30 pm American Evaluation Association Annual Business Meeting Business Meeting to be held in Lone Star A Leslie J Cooksy, University of Delaware; Jennifer Greene, University of Illinois at Urbana-Champaign; Debra Rog, Westat; Brian Yates; American University; Katherine McKnight; Pearson Corporation Evaluation 2010: Thursday, November 11, 12:35 PM – 1:30 PM Page 53 Summary of Sessions for Thursday, November 11, 1:40 PM to 3:10 PM No Primary Sponsor Session Session Title Room 281 Environmental Program Evaluation TIG Demonstration San Antonio River Improvements Project: Field Trip to Ecosystem Restoration Sites Fieldtrip 282 Presidential Strand Panel The Role of Metaevaluation in Promoting Evaluation Quality: National and International Cases Lone Star A 283 Systems in Evaluation TIG Multipaper From Agent-Based Modeling to Cynefin: The ABC's of Systems Frameworks for Evaluation Lone Star B 284 Collaborative, Participatory & Empowerment Think Tank I See What You Mean: Applications of Visual Methods in Evaluation Lone Star C 285 Non-profit and Foundations Evaluation TIG Panel Contextual Issues in a Randomized Control Group Evaluation of a School-based Intervention… Lone Star D 286 Quantitative Methods: Theory and Design TIG Demonstration Estimating Rater Consistency: Which Method Is Appropriate? Lone Star E 287 AEA Conference Committee Panel Influencing Evaluation Policy and Evaluation Practice: A Progress Report From AEA‘s Evaluation Policy Task Force Lone Star F 288 Cluster, Multi-site & Multi-level Evaluation TIG Roundtable Rotation I: Evaluating Twenty-first Century Community Learning Centers: Reconciling Evaluation Needs… Rotation II: Simplifying the Complex: Creating Transparent Evaluation in Multi-institutional Education Partnerships Mission A 289 Disabilities and Other Vulnerable Populations Panel Constructing Relevant Guidelines for Disability Program Evaluations Mission B 290 Independent Consulting TIG Panel The Fight for Evaluation Quality: Perspectives From the Trenches Bowie A 291 Multiethnic Issues in Evaluation TIG Multipaper Advancing Multiethnic Program Evaluation Through Theory and Practice: An Examination of Culture, Cultural Context… Bowie B 292 Advocacy and Policy Change TIG Think Tank Who Are Champions, What Are Their Impact and How Do You Know? Considerations for Advocates, Funders, and Evaluators Bowie C 293 Health Evaluation TIG Roundtable Measuring Communication Campaign Intermediate Outcomes: Tools and Techniques Goliad 294 International and Cross-cultural Evaluation TIG Roundtable Rotation I: Assessing Principals' Needs for Professional Development Rotation II: Reflection on an Instrument for Capturing School Conditions in Developing Countries San Jacinto 295 Social Network Analysis TIG Demonstration Why Settle for Silos? Four Applications of Social Network Analysis for Building More Effective Organizational Networks… Travis A 296 Integrating Technology Into Evaluation TIG Multipaper Contribution of Technology to Evaluation Practice Travis B 297 Needs Assessment TIG Skill-building Introduction to Designing Needs Assessment Surveys Travis C 298 AEA Conference Committee Multipaper Attending to Context and Situation to Improve Evaluation Process and Reporting Travis D 299 Human Services Evaluation TIG Panel Use of Fidelity Scores in Measuring Outcomes for Children Involved in the Child Welfare System Independence 300 Quantitative Methods: Theory and Design TIG MultiPaper Propensity Score Matching: Further Methodological Development Presidio A 301 Org Learning & Evaluation Capacity Bldg TIG Multipaper Improving Medical and Prevention Services Through Continuous Evaluation and Organizational Learning Presidio B 302 Alcohol, Drug Abuse, and Mental Health TIG Multipaper Outcome Assessment in Substance Abuse and Mental Health Presidio C 303 Non-profit and Foundations Evaluation TIG Roundtable Rotation I: Small Foundations With Big Learning Agenda: A Case of Using Analysis of Past Grant Making… Rotation II: Challenges in Developing Multi-level Logic Models Bonham A 304 Non-profit and Foundations Evaluation TIG Multipaper Insights Into Foundation Evaluation Bonham B 305 Pre-K - 12 Educational Evaluation TIG Multipaper Current Topics in Educational Evaluation: An Eclectic Set of Noteworthy Projects Bonham C Evaluation 2010: Thursday, November 11, 1:40 PM – 3:10 PM Page 54 Summary of Sessions for Thursday, November 11, 1:40 PM to 3:10 PM, Continued No Primary Sponsor Session Session Title Room 306 Pre-K - 12 Educational Evaluation TIG Multipaper Methods and Models for Evaluating Pre-Kindergarten and School Readiness Programs Bonham D 307 Systems in Evaluation TIG Panel Grappling With Uncertainty in Innovative and Complex Settings: Weaving Quality in Developmental Evaluation Bonham E 308 Government Evaluation TIG Panel Tips From the Trenches: The Role of the Evaluator in Designing a Quality Evaluation Texas A 309 AEA Conference Committee Panel The Future of Knowledge Production and Dissemination in Evaluation Texas B 310 Mixed Methods Evaluation TIG Multipaper Using Mixed Methods to Expand Frameworks for Program Evaluation Texas C 311 Research, Technology, and Development Eval Demonstration Third Generation Research Knowledge Tracking: Citation Analyses Texas D 312 Evaluation Use TIG Panel The Cycle of Evidence-based Policy and Practice: Synthesis, Translation, and Evaluation Capacity Building Texas E 313 Evaluation Policy TIG Think Tank Change is a Process, Not An Outcome: Implication for Evolving Federal Evaluation Policy Texas F 314 Qualitative Methods TIG Panel Quality in Evaluation: How Do We Know It When We See It in Qualitative Evaluations? Crockett A 315 Teaching of Evaluation TIG Multipaper Strategies for Preparing Quality Evaluation Practitioners Crockett B 316 International and Cross-cultural Evaluation TIG Panel Evaluating Support to Poverty and Gender in Cross Country Aid Programs Crockett C 317 Government Evaluation TIG MultiPaper Towards an Understanding of the Role of the Local Evaluator in Federally Funded Demonstration Projects… Crockett D 318 Feminist Issues in Evaluation TIG Panel Gender and Human Rights Evaluation Seguin B 319 International and Cross-cultural Evaluation TIG Panel Reflections From Applying a Complexity Lens to Monitoring and Evaluation Republic A 320 Health Evaluation TIG Multipaper Improving School-Based Health Through Campus Centers, Nursing, and Effective Interventions Republic B 321 Collaborative, Participatory & Empowerment Panel Five Partners, One Evaluation: A Cohesive Evaluation of the Action Communities for Health, Innovation… Republic C Evaluation 2010: Thursday, November 11, 1:40 PM – 3:10 PM Page 55 Thursday, 1:40 pm to 3:10 pm 281 - San Antonio River Improvements Project: Field Trip to Ecosystem Restoration Off Site Fieldtrip – Sign up at Wednesday‘s Reception Sponsored by the Environmental Program Evaluation TIG Coordinator - Annelise Carleton-Hug, Trillium Associates 282 - The Role of Metaevaluation in Promoting Evaluation Quality: National and International Cases Panel to be held in Lone Star A Sponsored by the Presidential Strand Chair - Leslie Cooksy, University of Delaware Discussant - Donald Yarbrough, University of Iowa The Use of Evaluation Quality Assurance System in Metaevaluation at the United Nations Children's Fund (UNICEF) (The opinions expressed are the personal thinking of the presenter and do not necessarily reflect the policies or views of UNICEF) Marco Segone, United Nations Children's Fund Can Metaevaluations be Helpful to International NGOs? A Case Study From CARE International Jim Rugh, Independent Consultant The Role of Metaevaluation in Promoting Evaluation Quality at the International Labor Organization Daniela Schroeter, Anne Cullen, and Kelly Robertson, Western Michigan University; and Craig Russon, International Labor Organization Evaluation Unit The Use of the Program Evaluation Standards in Metaevaluation: Potential and Pitfalls Lori Wingate, Western Michigan University 283 - From Agent-Based Modeling to Cynefin: The ABC's of Systems Frameworks for Evaluation Multipaper to be held in Lone Star B Sponsored by the Systems in Evaluation TIG Chair and Discussant - Mary McEathron, University of Minnesota Using the Cynefin Framework in Evaluation Planning: A Case Study Heather Britt, Independent Consultant Agent Based Modeling (ABM) Simulation for Program Evaluation Stephen Magura, Western Michigan University; Rainer Hilscher, Altarum Institute; Theodore Belding, TechTeam Government Solutions; and Jonathan Morell, Vector Research Center Using Systems Thinking Concepts in Evaluation of Complex Programs William M Trochim, Wanda Casillas, and Margaret Johnson, Cornell University; and Jennifer Brown Urban, Montclair State University 284 - I See What You Mean: Applications of Visual Methods in Evaluation Think Tank to be held in Lone Star C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Presenter - Terry Uyeki, Humboldt State University Discussants - Jara Dean-Coffey, jdcPartnerships; and Terry Uyeki, Humboldt State University 285 - Contextual Issues in a Randomized Control Group Evaluation of a School-based Intervention: Fielding an Evidence-based Intervention to Reduce Youth Gun Violence in Chicago Panel to be held in Lone Star D Sponsored by the Non-profit and Foundations Evaluation TIG Chair - Wendy Fine, Youth Guidance Overcoming the Odds: Carrying Out a Large Scale Randomized Control Evaluation of a Promising Youth Violence Prevention Program in Chicago Roseanna Ander, University of Chicago The Evaluator‘s Context: Challenges to the Design and Implementation of an Experimental School-based Intervention Harold Pollack, University of Chicago The Organization‘s Context: Evaluation Design‘s Affect on Program Implementation, Ethics and Evaluation Utility Wendy Fine, Youth Guidance 286 - Estimating Rater Consistency: Which Method Is Appropriate? Demonstration to be held in Lone Star E Sponsored by the Quantitative Methods: Theory and Design TIG Robert Johnson, Min Zhu, Grant Morgan, and Vasanthi Rao, University of South Carolina 287 - Influencing Evaluation Policy and Evaluation Practice: A Progress Report From the American Evaluation Association's Evaluation Policy Task Force Panel to be held in Lone Star F Sponsored by the AEA Conference Committee Chair - Patrick Grasso, World Bank Discussant - Jennifer Greene, University of Illinois at Urbana-Champaign Introduction to the Evaluataion Policy Task Force Patrick Grasso, World Bank Activities and Plans for the Evaluation Policy Task Force George Grob, Center for Public Program Evaluation Evaluation 2010: Thursday, November 11, 1:40 PM – 3:10 PM Page 56 288 – Roundtables in Mission A The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG Rotation 1: Simplifying the Complex: Creating Transparent Evaluation in Multi-institutional Education Partnerships Dewayne Morgan, University System of Maryland; Susan Tucker, Evaluation & Development Associates; and Jennifer Frank, University System of Maryland Rotation 2: Evaluating Twenty-first Century Community Learning Centers: Reconciling Evaluation Needs and Constraints at Multiple Systemic Levels Elizabeth Whipple and Mildred Savidge, Research Works Inc 289 - Constructing Relevant Guidelines for Disability Program Evaluations Panel to be held in Mission B Sponsored by the Disabilities and Other Vulnerable Populations TIG Chair - Mary Moriarty, Picker Engineering Program, Smith College Challenges and Expectations in Evaluating the National Science Foundation (NSF) Funded Disability Education Programs Linda Thurston, National Science Foundation Evaluating Postsecondary Disability Programs: Answering Questions and Monitoring Outcomes Joan McGuire, University of Connecticut Ensuring Cultural Relevancy: Disability and Quality Evaluation Mary Moriarty, Smith College 290 - The Fight for Evaluation Quality: Perspectives From the Trenches Panel to be held in Bowie A Sponsored by the Independent Consulting TIG Chair - Carol Haden, Magnolia Consulting LLC Evaluation Quality and Local Context: When Anything Can Happen in the Trenches Stephanie Wilkerson, Magnolia Consulting LLC Evaluation Quality and Relationships: When Nurturing Makes a Difference in the Trenches Lisa Shannon, Magnolia Consulting LLC Evaluation Quality and Reporting: When Working Together Improves the Trenches Mary Styers, Magnolia Consulting LLC 291 - Advancing Multiethnic Program Evaluation Through Theory and Practice: An Examination of Culture, Cultural Context, and Culturally Responsive Evaluation Multipaper to be held in Bowie B Sponsored by the Multiethnic Issues in Evaluation TIG Chair - Pamela Frazier-Anderson, Lincoln University Conducting Evaluations in a Multiethnic Context: Lessons from a Hawaiian Experience Felix Blumhardt, The Evaluation Group A Thematic Discussion of the Relational and Ecological Dimensions of Cultural Context: Notes From Three Interconnected Research Studies Jill Anne Chouinard and J Bradley Cousins, University of Ottawa Cultural Competence Versus Cultural Responsiveness: Seeking True Evaluation Quality Tamara Bertrand Jones, Florida State University Participatory Outreach: Methods of Increasing Minority Participation in Agency Responsivenss to Community Racial Change Asma Ali, University of Illinois at Chicago 292 - Who Are Champions, What Are Their Impact and How Do You Know? Considerations for Advocates, Funders, and Evaluators Think Tank to be held in Bowie C Sponsored by the Advocacy and Policy Change TIG Steve Mumford and Sarah Stachowiak, Organizational Research Services; and Lance Potter, Bill & Melinda Gates Foundation 293 – Roundtable in Goliad Sponsored by the Health Evaluation TIG Measuring Communication Campaign Intermediate Outcomes: Tools and Techniques Michael Burke, RTI International 294 – Roundtables in San Jacinto The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the International & Cross-cultural Evaluation TIG Rotation 1: Reflection on an Instrument for Capturing School Conditions in Developing Countries Helene Jennings, ICF Macro Rotation 2: Assessing Principals' Needs for Professional Development Edith J Cisneros-Cohernour, University of Yucatan Roger Patron-Cortes, Universidad Autonoma de Campeche Evaluation 2010: Thursday, November 11, 1:40 PM – 3:10 PM Page 57 Thursday, 1:40 pm to 3:10 pm, continued 295 - Why Settle for Silos? Four Applications of Social Network Analysis for Building More Effective Organizational Networks and Alignment Around Outreach and New Initiatives Demonstration to be held in Travis A Sponsored by the Social Network Analysis TIG Tom Bartholomay, University of Minnesota 296 - Contribution of Technology to Evaluation Practice Multipaper to be held in Travis B Sponsored by the Integrating Technology Into Evaluation TIG Chair - Paul Lorton Jr, University of San Francisco Mapping Adolescent Substance Abuse Issues and Treatment in Pima County, AZ: A Geographic Information System (GIS) Spatial Analysis Strategy for Community Needs Assessment Judith Francis, Pima Prevention Partnership; and Matthew Rahr, University of Arizona Using Networked Technology for Quality Evaluation Colleen Manning and Rucha Londhe, Goodman Research Group Inc; and Mary Dussault, Harvard-Smithsonian Center for Astrophysics Going Online With School-based Evaluations Janet Lee, Nicole Gerardi, and Minerva Avila, University of California, Los Angeles Validating Evaluations With Spatial Analysis Kristina Mycek, State University of New York at Albany 297 - Introduction to Designing Needs Assessment Surveys Skill-building Workshop to be held in Travis C Sponsored by the Needs Assessment TIG James Altschuld, The Ohio State University; Yi-Fang Lee, National Chi Nan University; Hsin-Ling Hung, University of North Dakota; and Jeffry White, University of Louisiana, Lafayette 298 - Attending to Context and Situation to Improve Evaluation Process and Reporting Multipaper to be held in Travis D Sponsored by the AEA Conference Committee Chair - Judith Inazu, University of Hawaii at Manoa To Communicate or Not to Communicate: How Communication Within Organizations Affects Our Work as Evaluators Namrata Mahajan, Rebecca Eddy, and Hendrick Ruitman, Cobblestone Applied Research & Evaluation Inc Playing in the Intersection of Context and Validity Sheila A Arens and Andrea Beesley, Mid-Continent Research for Education and Learning 299 - Use of Fidelity Scores in Measuring Outcomes for Children Involved in the Child Welfare System Panel to be held in Independence Sponsored by the Human Services Evaluation TIG Chair - Madeleine Kimmich, Human Services Research Institute Integrating Child-level Fidelity Scores Into an Outcomes Analysis: An Evaluation of Family Team Meetings Erin Singer, Human Services Research Institute The Predictive Utility of a Child Level Measure of Fidelity: Its Relevance to the Understanding of Outcomes Associated With Enhanced Visitation Practices Linda Newton-Curtis, Human Services Research Institute Kinship Support Index: Do More Intensive Programmatic Efforts Result in Better Outcomes for Children? Kim Firth, Human Services Research institute 300 - Propensity Score Matching: Further Methodological Development MultiPaper to be held in Presidio A Sponsored by the Quantitative Methods: Theory and Design TIG Chair - Ning Rui, Research for Better Schools Discussant - Frederick Newman, Florida International University On the Bandwidth of Propensity Score Caliper Matching Wei Pan, University of Cincinnati Genetic Matching: A Better Matching Technique for Assessment of Treatment Effects? Ning Rui, Research for Better Schools; and Haiyan Bai, Universtiy of Central Florida Propensity Score Matching With Replacement or Not? Haiyan Bai, Universtiy of Central Florida 301 - Improving Medical and Prevention Services Through Continuous Evaluation and Organizational Learning Multipaper to be held in Presidio B Sponsored by the Organizational Learning and Evaluation Capacity Building TIG and the Health Evaluation TIG Chair - John Bosma, WestEd Discussant - Gayle Sulik, Texas Woman's University Forming a Strategic Alliance: The Use of Collaboration Theory to Evaluate and Improve Nurses‘ Safe Medication Administration in Massachusetts‘ Nursing Homes Teresa Anderson, University of Massachusetts; Rebecca Woodland, University of Massachusetts, Amherst; Michael Hutton, The Blue Foundation for a Healthy Florida; and Carol Silveira, Massachusetts Board of Registration in Nursing Arizona's Quest for Quality: Improving Prevention Services Through Evaluation and Capacity Building Holly Lewis and Aimee Sitzler, Arizona State University Evaluation 2010: Thursday, November 11, 1:40 PM – 3:10 PM Page 58 Evaluation Learning Cycle: Applying Evaluation Lessons to Multi-year Long-Term Care Training and Organizational Development Initiatives Marcia Mayfield, Malika Gujrati, and Ines Escandon, Paraprofessional Healthcare Institute (PHI) 302 - Outcome Assessment in Substance Abuse and Mental Health Multipaper to be held in Presidio C Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG Chair - Diana Seybolt, University of Maryland, Baltimore Importance of Substance Abuse Treatment Outcome Proxies Lawrence Greenfield, Lawrence Greenfield Consulting Douglas Fountain, Outpourings The Perfect Couple: Clinical Quality and Program OutcomesUsing Data to Improve Clinical Practices Cathie McLean, Pablo Olmos-Gallo, and Christopher McKinney, Mental Health Center of Denver 303 – Roundtables in Bonham A The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Non-profit and Foundations Evaluation TIG Rotation 1: Small Foundations With Big Learning Agendas: A Case of Using Analysis of Past Grant Making to Support Future Organizational Learning William Bickel, Jennifer Iriti, and Julie Meredith, University of Pittsburgh Rotation 2: Challenges in Developing Multi-level Logic Models Barbara Wauchope and Curt Grimm, University of New Hampshire 304 - Insights Into Foundation Evaluation Multipaper to be held in Bonham B Sponsored by the Non-profit and Foundations Evaluation TIG Chair - Ellie Buteau, Center for Effective Philanthropy The Assessment Challenge for Foundations: Understanding Impact Ellie Buteau and Andrea Brock, Center for Effective Philanthropy Benchmarking Foundation-level Evaluation: What are the Best Practices? Jonathan Sachs, Kaye Phillips, and Werner Muller-Clemm, Canadian Health Services Research Foundation Foundation-Level Evaluation Approaches: Lessons Learned About Quality in Practice Kaye Phillips and Werner Muller-Clemm, Canadian Health Services Research Foundation; Kathryn Graham, Alberta Innovates-Health Solutions; Jill Yegian, California HealthCare Foundation; and Jonathan Sachs, Canadian Health Services Research Foundation 305 - Current Topics in Educational Evaluation: An Eclectic Set of Noteworthy Projects Multipaper to be held in Bonham C Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - James S Sass, Research Support Services Using A Mixed Methods Design to Conduct an Evaluation of International Baccalaureate Programs in Texas Schools Jacqueline Stillisano, Hersh Waxman, Yuan-Hsuan Lee, Judy Hostrup, Beverly Alford, and Kayla Braziel Rollins, Texas A&M University Alignment and Synthesis: Efforts to Improve the Quality of Parent Engagement Evaluation in a Large Urban School District Wenhui Yuan, Fort Worth Independent School District; and Susan M Wolfe, Susan Wolfe and Associates LLC Profiles of Advocacy: Narrative Portrayals of School Superintendents‘ Educational Practice and Social Action Keith Trahan, Cynthia Tananis, and Cara Ciminillo, University of Pittsburgh 306 - Methods and Models for Evaluating PreKindergarten and School Readiness Programs Multipaper to be held in Bonham D Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Katie Dahlke, Learning Point Associates Discussant - James P Van Haneghan, University of South Alabama Maintaining Validity in School Readiness Evaluation: A Multidimensional Approach in Methodology Summerlynn Anderson, Walter R McDonald and Associates Inc; Gary Resnick, Harder+Company; Fred Molitor, Walter R McDonald and Associates Inc; Julie Field, First 5 Sacramento Getting Ready for School: Monitoring a User Productivity Kit (UPK) Pilot Program in an Urban Setting Rob Fischer, Lance Peterson, Nina Lalich, and Claudia Coulton, Case Western Reserve University Crossing Borders: Evaluation of a Bi-lingual, Bi-cultural and Binational Kindergarten Readiness Programs Sharon DeJoy, Tina Runkles, and Stephanie Hawkins, State University of New York College at Potsdam Evaluating the Longitudinal Impact of Early Childhood Professional Development Programs on K-3 Success Raymond Hart, Gary Bingham, and Nicole Patton-Terry, Georgia State University Evaluation 2010: Thursday, November 11, 1:40 PM – 3:10 PM Page 59 Thursday, 1:40 pm to 3:10 pm, continued 307 - Grappling With Uncertainty in Innovative and Complex Settings: Weaving Quality in Developmental Evaluation Panel to be held in Bonham E Sponsored by the Systems in Evaluation and the Indigenous Peoples in Evaluation TIGs Chair - Syd King, New Zealand Qualifications Authority Discussant - Michael Quinn Patton, Utilization-Focused Evaluaton Navigating Uncertainty: The Cross-site Evaluation of the Supporting Evidence-based Home Visiting Grantee Cluster Margaret Hargreaves, Diane Paulsell, and Kimberly Boller, Mathematica Policy Research; Deborah Daro, Chapin Hall; and Debra Strong, Heather Zaveri, Heather Koball, Patricia Del Grosso, and Russell Cole, Mathematica Policy Research Drawing on Deep Values to Ensure Evaluation Quality in Emergent and Uncertain Contexts Kate McKegg, The Knowledge Institute Talking Past Each Other: The Language of the Developmental Evaluator in Indigenous Contexts and Its Link to Quality Nan Wehipeihana, Research Evaluation Consultancy Limited What Does Quality Look Like in Developmental Evaluation in Indigenous Contexts Kataraina Pipi, Independent Consultant 308 - Tips From the Trenches: The Role of the Evaluator in Designing a Quality Evaluation Panel to be held in Texas A Sponsored by the Government Evaluation TIG Chair - Stanley Capela, HeartShare Human Services of New York Discussant - Amy Germuth, EvalWorks LLC Quality Perspectives in the Evaluation of a K-12 English Language Proficiency Program Stephan Henry, REASolutions LLC Real Time Peer Reviews: An Efficient Way to Ensure Evaluation Quality Rakesh Mohan, Idaho State Legislature Quality Evaluation Template: How to Develop a Utilization Focused Evaluation System Incorporating Quality Improvement and Quality Assurance Systems Stanley Capela, HeartShare Human Services of New York 309 - The Future of Knowledge Production and Dissemination in Evaluation Panel to be held in Texas B Sponsored by the AEA Conference Committee Chair - Sandra Mathison, University of British Columbia Discussant - Patricia Rogers, Royal Melbourne Institute of Technology Knowledge Production and Dissemination in Evaluation Thomas Schwandt, University of Illinois at UrbanaChampaign Knowledge Production and Dissemination in Evaluation Laura Leviton, Robert Wood Johnson Foundation Knowledge Production and Dissemination in Evaluation Sandra Mathison, University of British Columbia 310 - Using Mixed Methods to Expand Frameworks for Program Evaluation Multipaper to be held in Texas C Sponsored by the Mixed Methods Evaluation TIG Chair - Rita Fierro, Independant Consultant Discussant - Virginia Dick, University of Georgia Unearthing Hidden Contexts in Evaluation Work: Using Brooks 5-Paths Analysis Pauline Brooks, Independent Consultant A Multi-method Approach for Assessing Fidelity to an Evidence-based Child Neglect Prevention Program Jill Filene, James Bell Associates; Lauren Kass, James Bell Associates; and Elliott Smith, Cornell University Compliance is Improving, Now What? Using the Guskey Model in a Mixed Method Evaluation to Measure the Impact and Effectiveness of a National Technical Assistance Center Paula Kohler and June Gothberg, Western Michigan University 311 - Third Generation Research Knowledge Tracking: Citation Analyses Demonstration to be held in Texas D Sponsored by the Research, Technology, and Development Evaluation TIG Alan Porter and Stephen Carley, Georgia Institute of Technology 312 - The Cycle of Evidence-based Policy and Practice: Synthesis, Translation, and Evaluation Capacity Building Panel to be held in Texas E Sponsored by the Evaluation Use TIG and the Organizational Learning and Evaluation Capacity Building TIG and the Alcohol, Drug Abuse, and Mental Health TIG Chair - Susan Labin, Independent Consultant Importance and Usage of Synthesis in Public Policy: Implications for Evaluation and Performance Measurement Joseph Wholey, University of Southern California Research Synthesis: The Core Methodology in Evidence-based Reviews Susan Labin, Independent Consultant Evaluation 2010: Thursday, November 11, 1:40 PM – 3:10 PM Page 60 Developing a Prevention Synthesis and Translation System to Promote Science-based Approaches to Teen Pregnancy, HIV and Sexually-transmitted Infections Prevention Kelly Lewis, Georgia State University; Catherine Lesesne, Centers for Disease Control and Prevention; Abraham Wandersman, University of South Carolina; S Christine Zahniser, Global Evaluation and Applied Research Solutions Inc; Mary Martha Wilson, Healthy Teen Network; Gina Desiderio, Healthy Teen Network; Diane C Green, Centers for Disease Control and Prevention Service to Science: The Role of Evaluation Capacity Building in Evidence-based Practice Pamela Imm, University of South Carolina 313 - Change is a Process, Not An Outcome: Implication for Evolving Federal Evaluation Policy Think Tank to be held in Texas F Sponsored by the Evaluation Policy TIG Presenter - Dianna L Newman, State University of New York at Albany Discussant - Dianna L Newman, State University of New York at Albany; and Anna Lobosco, New York State Developmental Disabilities Planning Council 314 - Quality in Evaluation: How Do We Know It When We See It in Qualitative Evaluations? Panel to be held in Crockett A Sponsored by the Qualitative Methods TIG Chair - Leslie Goodyear, National Science Foundation Presenters - Leslie Goodyear, National Science Foundation; Jennifer Jewiss, University of Vermont; Janet Usinger, University of Nevada, Reno; and Eric Barela, Partners in School Innovation 315 - Strategies for Preparing Quality Evaluation Practitioners Multipaper to be held in Crockett B Sponsored by the Teaching of Evaluation TIG Chair - Gary Skolits, University of Tennessee, Knoxville Teaching Program Evaluation with Quality in Mind: Challenges Faced and Lessons Learned in Preparing Next Generation Evaluators Sheila Kohn, University of Rochester; and Kankana Mukhopadhyay, University of Rochester Using Evaluation Activities to Teach Our Students About Evaluator Roles Gary Skolits and Jennifer Morrow, University of Tennessee, Knoxville; and Erin Burr, Oak Ridge Institute for Science and Education A Capacity Building Grant in Interdisciplinary Evaluation: A Graduate Program With Focus on Assessment for Learning Research Steven Ziebarth, Western Michigan University 316 - Evaluating Support to Poverty and Gender in Cross Country Aid Programs Panel to be held in Crockett C Sponsored by the International & Cross-cultural Evaluation TIG Chair - Cheryl Gray, World Bank Evaluating the Effects of Policy Reforms on the Poor Through Analytic Work: Effectiveness of World Bank Support to Poverty and Social Impact Analyses Soniya Carvalho, World Bank Assessing Gender Dimensions of Aid Programs at the World Bank Gita Gopal, World Bank Assessing the Poverty and Human Development Outcomes of Aid Through World Bank Supported Lending Programs Anjali Kumar, World Bank 317 - Towards an Understanding of the Role of the Local Evaluator in Federally Funded Demonstration Projects: The Perspectives of Federal Policymakers, Community-based Organizations, and Evaluators MultiPaper to be held in Crockett D Sponsored by the Government Evaluation TIG Chair - Soundaram Ramaswami, Kean University The Demonstration Project and Expectations for Evaluation: The Policymaker‘s Perspective Alicia Richmond-Scott, United States Department of Health and Human Services Engaging in a Demonstration Project From the Nonprofit Agency‘s Perspective: Weaving a Relationship Between Program and Evaluation Nanci Coppola, Program Reach Inc; and Eunyoung Kim, Seton Hall University Understanding Role Orientations: An Examination of the Evaluators‘ Role in Demonstration Project Elaine Walker, Martin Finkelstein, and Kevin Iglesias, Seton Hall University 318 - Gender and Human Rights Evaluation Panel to be held in Seguin B Sponsored by the Feminist Issues in Evaluation TIG Chair - Divya Bheda, University of Oregon Discussant - Donna Podems, ICF Macro International; and Divya Bheda, University of Oregon United Nations Development Fund for Women (UNIFEM) and United Nations Evaluation Group (UNEG): Evaluation in a Human Rights Framework Belen Sanz, and Inga Sniukaite, United Nations Development Fund for Women Transformative Lens Applied to Gender Focused Evaluations Donna Mertens, Gallaudet University Human Rights Enhancement From a Grassroots Community Change Agent Denice Cassaro, Cornell University Evaluation 2010: Thursday, November 11, 1:40 PM – 3:10 PM Page 61 Thursday, 1:40 pm to 3:10 pm, continued 319 - Reflections From Applying a Complexity Lens to Monitoring and Evaluation Panel to be held in Republic A Sponsored by the International & Cross-cultural Evaluation TIG Chair - Tricia Wind, International Development Research Centre The Challenges of Monitoring and Evaluating Development Research in Complex Systems Tricia Wind, International Development Research Centre The Specific Systemic and Complexity Challenges for the Consortio por la Salud, Ambiente y Desarrollo (ECOSAD) Action Research Project José Valle, Ruth Arroyo, Anita Lujan, Walter Varillas, Magaly Oviedo, and Karim Castro, Consorcio por la Salud, Ambiente y Desarrollo (ECOSAD) The Strengths and Weaknesses of the Monitoring System Adapted by ECOSAD to Meet the Special Challenges it Faces Ricardo Wilson-Grau, Ricardo Wilson-Grau Consulting 320 - Improving School-Based Health Through Campus Centers, Nursing, and Effective Interventions Multipaper to be held in Republic B Sponsored by the Health Evaluation TIG Chair - Kim van der Woerd, Reciprocal Consulting Factors Influencing Grantee Performance on Youth Outcomes Targeted by the Safe Schools/Healthy Students (SS/HS) Initiative: Results From an Exploratory Meta-regression Jim Derzon, Bruce Ellis, Sharon Xiong, Battelle Memorial Institute; Danyelle Mannix, United States Department of Health and Human Services; and Julia Rollison, MANILA Consulting Group Inc Evaluation of a Quitline-based Free Nicotine Replacement Therapies (NRT) Program for College Students: Is Campus Media Enough to Increase Quitline Utilization? Joseph Lee, University of North Carolina at Chapel-Hill; and Kathryn Kramer, Anna McCullough, Leah Ranney, and Adam Goldstein, University of North Carolina; Barbara Moeykens, Nidu Menon, Tom Brown, North Carolina Health and Wellness Trust Fund; Caroline Mage, University of North Carolina; and Mark Ezzell, North Carolina Health and Wellness Trust Fund Evaluation of School Nursing in Underserved Schools: Truth, Beauty, and Justice in the Evaluation of the San Jose Unified School District (SJUSD) Nurse Demonstration Project Eunice Rodriguez, Stanford University; Diana Austria, Stanford University; Melinda Landau, San Jose Unified School District; Sue Lapp, School Health Clinics of Santa Clara County Candace Roney and JoAnna Caywood, Lucile Packard Foundation for Children's Health The Impact of School Based Health Centers (SBHCs) on Access to and Use of Health Services in New Orleans Lisanne Brown and Marsha Broussard, Louisiana Public Health Institute; Paul Hutchinson and Nathalie Ferrell, Tulane University; and Sarah Kohler Chrestman, Louisiana Public Health Institute 321 - Five Partners, One Evaluation: A Cohesive Evaluation of the Action Communities for Health, Innovation, Environment Change (ACHIEVE) Healthy Communities Initiative Panel to be held in Republic C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Chair - Andrea Lee, YMCA of the USA Young Men's Christian Association (YMCA) of the United States of American (USA): Bringing Community Connections to the ACHIEVE Partnership Andrea Lee, YMCA of the USA National Recreation and Parks Association (NRPA): Solving Chronic Disease Through Play and Space Melanie Chansky, National Recreation and Parks Association National Association of County and City Health Officials: Bringing City and County Health Department Expertise to ACHIEVE Sandra Silva, Altarum Institute National Association of Chronic Disease Directors: New Approaches and Partnerships to Fight Chronic Disease Ann Ussery-Hall, National Association of Chronic Disease Directors Evaluation 2010: Thursday, November 11, 1:40 PM – 3:10 PM Page 62 Notes: Evaluation 2010: Thursday, November 11, 1:40 PM – 3:10 PM Page 63 Summary of Sessions for Thursday, November 11, 3:35 PM to 4:20 PM No Primary Sponsor Session Session Title Room 322 Presidential Strand Panel Truth, Beauty, and Justice: A Conversation With Plenary Speakers Lone Star A 323 Systems in Evaluation TIG Expert Lecture Developmental Evaluation for Complex Systems: Quality as Speed and Adaptability Lone Star B 324 Collaborative, Participatory & Empowerment Think Tank Exploring the Multiple Roles of Collaborative, Participatory, and Empowerment Evaluators Lone Star C 325 Non-profit and Foundations Evaluation TIG Multipaper Evaluation and Nonprofits: Learning From Experience Lone Star D 326 Quantitative Methods: Theory and Design TIG MultiPaper Bayesian Mixture Modeling Versus Traditional Meta-analysis: Examining the Treatment Advantage Research… Lone Star E 327 Cluster, Multi-site & Multi-level Evaluation TIG Panel Evaluating a Multi-site Twenty-first Century Learning Program: Strategies and Results Lone Star F 328 Evaluation Use TIG Roundtable What Role Should the Evaluator Take When a Project Is Off-Track? Mission A 329 Disabilities and Other Vulnerable Populations Skill-building Quality Evaluation Includes Everyone! Using Universal Design to Make Your Evaluation More Accessible Mission B 330 Independent Consulting TIG Demonstration Marketing the Online You: Developing and Maintaining a Professional Online Presence Bowie A 331 Multiethnic Issues in Evaluation TIG Multipaper Overcoming Specific Challenges to Service Delivery Within Hispanic-American Communities Bowie B 332 Advocacy and Policy Change TIG Panel Advocacy Capacity Nuance: Helpful, or Too Much? Considering the Cases of Assessing Coalitions Versus Networks… Bowie C 333 Social Work TIG Roundtable Enhancing Evaluation Quality in a Developing Context: A South African Case Study Goliad 334 Disaster and Emergency Management Eval Roundtable Being on Target: Evaluation Techniques for Disaster Relief Agencies San Jacinto 335 Assessment in Higher Education TIG Panel Using Business Frameworks to Evaluate Program Impact on Student Learning Travis A 336 Integrating Technology Into Evaluation TIG Demonstration … The Benefits, Challenges, and Logistics of Using Audience Response System ("Clickers") as an Evaluation Tool… Travis B 337 Org Learning & Evaluation Capacity Bldg TIG Demonstration CES‘s Professional Designation Program - How Our Members Are Applying to be Designated as a Credentialed Evaluator Travis C 338 Health Evaluation TIG Demonstration Environmental Scans Using State Legislative Databases for Health Policy Research Travis D Including Sexual Orientation Information in an Evaluation: When, Why, and How? Independence 339 Lesbian, Gay, Bisexual, Transgender Issues TIG MultiPaper 340 Distance Ed. & Other Educational Technologies Business Meeting Distance Education and Other Educational Technologies TIG Business Meeting Presidio A 341 AEA Conference Committee Think Tank The United States Government Accountability Office's (GAO) New Yellow Book: What's in It for Evaluators? Presidio B 342 College Access Programs TIG Multipaper Science, Technology, Engineering, and Mathematics (STEM) Recruitment Programs: Evaluation of Effectiveness Presidio C 343 Research, Technology, and Development Eval Roundtable Methodological Issues in Evaluating Potentially Transformative Research Bonham A 344 Non-profit and Foundations Evaluation TIG Multipaper Evaluation: Understanding the Context and Managing Tensions Bonham B 345 Pre-K - 12 Educational Evaluation TIG MultiPaper Concordances: Development and Appropriate Uses Bonham C 346 Pre-K - 12 Educational Evaluation TIG Multipaper Building Evaluation Capacity Among School Leaders Bonham D 347 Environmental Program Evaluation TIG Demonstration Toolkit for Evaluating Impacts of Public Participation in Scientific Research Bonham E 348 Government Evaluation TIG MultiPaper Strategies for Evaluation Quality in Government Texas A 349 Qualitative Methods TIG Demonstration Techniques and Tools for Reporting and Communicating Evaluation Findings Using NVivo Texas B 350 Costs, Effectiveness, Benefits, and Economics Skill-building New Cost Tools for The Evaluator‘s Toolkit Texas C 352 Evaluation Use TIG Panel Evaluating Program Interventions in a Rapidly Changing World: Exploring the Potential of Mid-term Reviews… Texas E 353 Research on Evaluation TIG Business Meeting Research on Evaluation TIG Business Meeting Evaluation 2010: Thursday, November 11, 3:35 PM – 4:20 PM Texas F Page 64 Summary of Sessions for Thursday, November 11, 3:35 PM to 4:20 PM, Continued No Primary Sponsor Session Session Title Room 354 Extension Education Evaluation TIG Think Tank Thinking Again About Concept Mapping Crockett A 355 Business and Industry TIG Multipaper Behavioral and Systematic Causal Influences in Health and Safety Crockett B 356 AEA Conference Committee MultiPaper Differing Perspectives of Quality Throughout an Evaluation Crockett C 357 Crime and Justice TIG Business Crime and Justice TIG Business Meeting and Paper Presentations Crockett D 358 Graduate Student and New Evaluator TIG Business Meeting Graduate Student and New Evaluators TIG Business Meeting Seguin B 359 International and Cross-cultural Evaluation TIG Expert Lecture Julia Child and Richard Feynman: An Oblique Approach to Evaluation Quality Republic A 360 Health Evaluation TIG Panel Improving the Design, Methods, and Data Quality of a Public Health Outcome Monitoring Project Republic B 361 Theories of Evaluation TIG Business Meeting Theories of Evaluation TIG Business Meeting Evaluation 2010: Thursday, November 11, 3:35 PM – 4:20 PM Republic C Page 65 Thursday, 3:35 pm to 4:20 pm 322 - Truth, Beauty, and Justice: A Conversation With Plenary Speakers Panel to be held in Lone Star A Sponsored by the Presidential Strand Chair - Valerie J Caracelli, United States Government Accountability Office Chair - Rodney Hopson, Duquesne University Discussant - James Earl Davis, Temple University Truth, Beauty, and Justice: A Conversation With Plenary Speakers Crispin Sartwell, Dickinson College; and Psyche WilliamsForson, University of Maryland 323 - Developmental Evaluation for Complex Systems: Quality as Speed and Adaptability Expert Lecture to be held in Lone Star B Sponsored by the Systems in Evaluation TIG Michael Quinn Patton, Utilization-Focused Evaluation 324 - Exploring the Multiple Roles of Collaborative, Participatory, and Empowerment Evaluators Think Tank to be held in Lone Star C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Presenter - David Fetterman, Fetterman & Associates Discussants - Abraham Wandersman, University of South Carolina; Liliana Rodriguez-Campos, University of South Florida; Lyn Shulha, Queen's University at Kingston; and Rita O'Sullivan, University of North Carolina at Chapel-Hill 325 - Evaluation and Nonprofits: Learning From Experience Multipaper to be held in Lone Star D Sponsored by the Non-profit and Foundations Evaluation TIG Chair - Charles Gasper, Missouri Foundation for Health Outcome Measurement and Nonprofit Relational Work Lehn Benjamin, George Mason University Enriching the Quality of Consultation and Research With Small Community-based Nonprofit Organizations: Ten Insights and Understandings From the Work of a University-based Consulting Center Leah Neubauer, Douglas Cellar, and Gary Harper, DePaul University 326 - Bayesian Mixture Modeling Versus Traditional Meta-analysis: Examining the Treatment Advantage Research Using Three Meta-analytic Approaches MultiPaper to be held in Lone Star E Sponsored by the Quantitative Methods: Theory and Design TIG Chair - Karen Larwin, Youngstown State University Bayesian Mixture Modeling: Also Known as Bayesian Metaanalysis James Michael Menke, University of Arizona Traditional Meta-Analytic Approach for Comparative Effectiveness Research (CER) Karen Larwin, Youngstown State University 327 - Evaluating a Multi-site Twenty-first Century Learning Program: Strategies and Results Panel to be held in Lone Star F Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG Chair - Mary Nistler, Learning Point Associates Order From Chaos: Building a Framework for the Evaluation of a Multi-site School Reform Initiative Mary Nistler and Manolya Tanyu, Learning Point Associates Strategies for Evaluating Online Communities of Practice Jonathan Margolin, Learning Point Associates 328 – Roundtable in Mission A Sponsored by the Evaluation Use TIG What Role Should the Evaluator Take When a Project Is OffTrack? Robert J Ruhf and Mary Anne Sydlik, Western Michigan University 329 - Quality Evaluation Includes Everyone! Using Universal Design to Make Your Evaluation More Accessible Skill-building Workshop to be held in Mission B Sponsored by the Disabilities and Other Vulnerable Populations and the Graduate Student and New Evaluator TIGs Jennifer Sulewski, University of Massachusetts, Boston; Richard Petty, Independent Living Research Utilization; and June Gothberg, Western Michigan University 330 - Marketing the Online You: Developing and Maintaining a Professional Online Presence Demonstration to be held in Bowie A Sponsored by the Independent Consulting TIG Shelly Mahon, University of Wisconsin, Madison Evaluation 2010: Thursday, November 11, 3:35 PM – 4:20 PM Page 66 331 - Overcoming Specific Challenges to Service Delivery Within Hispanic-American Communities 335 - Using Business Frameworks to Evaluate Program Impact on Student Learning Multipaper to be held in Bowie B Sponsored by the Multiethnic Issues in Evaluation TIG Chair - Leona Johnson, Hampton University Different Strokes for Different Folks: Designing a Culturally Grounded Implementation Evaluation of Grantees Serving a Diverse Minority Luis R Torres, University of Houston; Karen Gardiner, The Lewin Group; Luis H Zayas, Washington University in St Louis; and Allison Hyra, Cara Kundrat, and Whitney Engstrom, The Lewin Group Issues in Evaluating Service Delivery to Migrant Farm Workers With Disabilities Karen Cinnamond and Joanne Farley, Human Development Institute Panel to be held in Travis A Sponsored by the Assessment in Higher Education TIG Chair - Norena Norton Badway, San Francisco State University Using Business Frameworks to Evaluate Program Impact on Student Learning Norena Norton Badway, San Francisco State University Challenges in Data Collection Using Kirkpatrick's Model Rachel Rich, University of the Pacific 332 - Advocacy Capacity Nuance: Helpful, or Too Much? Considering the Cases of Assessing Coalitions Versus Networks and Grassroots Mobilization Versus Community Organizing Panel to be held in Bowie C Sponsored by the Advocacy and Policy Change TIG Chair and Discussant - Astrid Hendricks, California Endowment You Say Network, I Say Coalition: What is the Difference and Why Should Evaluators Care? Jared Raynor, TCC Group You Say Power, I Say Influence: How Helpful Is It to Link or Separate Community Organizing and Advocacy Evaluation Approaches? Susan Hoechstetter, Alliance for Justice 333 – Rounddtable in Goliad Sponsored by the Social Work TIG Enhancing Evaluation Quality in a Developing Context: A South African Case Study Willem Roestenburg, University of Johannesburg; and Emmerentie Oliphant, Stephen F Austin State University 334 – Roundtable in San Jacinto Sponsored by the Disaster and Emergency Management Evaluation TIG Being on Target: Evaluation Techniques for Disaster Relief Agencies LaJuana Hector, Texas A&M University 336 - From Game Shows, to Universities, to Cooperative Extension: The Benefits, Challenges, and Logistics of Using an Audience Response System ("Clickers") as an Evaluation Tool in Extension Programs Demonstration to be held in Travis B Sponsored by the Integrating Technology Into Evaluation TIG Michelle Currie, Cornell University 337 - Canadian Evaluation Society's Professional Designation Program - How Our Members Are Applying to be Designated as a Credentialed Evaluator Demonstration to be held in Travis C Sponsored by the Organizational Learning and Evaluation Capacity Building TIG Presenters - Keiko Kuji-Shikatani, Ontario Ministry of Education; Christine Frank, Christine Frank & Associates; and Martha McGuire, Cathexis Consulting Discussant - Jean A King, University of Minnesota Presenters - Keiko Kuji-Shikatani, Ontario Ministry of Education 338 - Environmental Scans Using State Legislative Databases for Health Policy Research Demonstration to be held in Travis D Sponsored by the Health Evaluation TIG Sasigant O'Neil and Mindy Lipson, Mathematica Policy Research 339 - Including Sexual Orientation Information in an Evaluation: When, Why, and How? MultiPaper to be held in Independence Sponsored by the Lesbian, Gay, Bisexual, and Transgender Issues TIG Chair - Joe E Heimlich, Ohio State University Gay and Lesbian Visitors in Museum Evaluation Joe E Heimlich, Ohio State University Measuring Sexual Orientation in the Arizona Health Survey John T Daws, University of Arizona c Evaluation 2010: Thursday, November 11, 3:35 PM – 4:20 PM Page 67 Thursday, 3:35 pm to 4:20 pm, continued 340 - Distance Education and Other Educational Technologies TIG Business Meeting Business Meeting to be held in Presidio A Sponsored by the Distance Education and Other Educational Technologies TIG TIG Leader - Talbot Bielefeldt, International Society for Technology in Education 341 - The United States Government Accountability Office's (GAO) New Yellow Book: What's in It for Evaluators? Think Tank to be held in Crockett D Sponsored by the AEA Conference Committee Michael Hendricks, Independent Consultant; and Rakesh Mohan, Idaho State Legislature 342 - Science, Technology, Engineering, and Mathematics (STEM) Recruitment Programs: Evaluation of Effectiveness Multipaper to be held in Presidio C Sponsored by the College Access Programs TIG Chair - Kurt Burkum, ACT Measurable Indicators of Effectiveness for National Science Foundation Advanced Technological Education Centers/ Projects Kelly Robertson and Stephen Magura, Western Michigan University Beyond the Program: Evaluating the Institutional Impact of Initiatives to Increase the Participation of Underrepresented Minority College Students in Biomedical and Behavioral Science Jack Mills, Independent Consultant; and Maria Elena Zavala, California State University, Northridge 343 – Roundtable in Bonham A Sponsored by the Research, Technology, and Development Evaluation TIG Methodological Issues in Evaluating Potentially Transformative Research Mary Beth Hughes, Bhavya Lal, and Asha Balakrishnan, Science and Technology Policy Institute 344 - Evaluation: Understanding the Context and Managing Tensions Multipaper to be held in Bonham B Sponsored by the Non-profit and Foundations Evaluation TIG Chair - David Campbell, University of California, Davis In Praise of Going Local: The Promise of Workarounds as Evaluative Indicators David Campbell, University of California, Davis Strengths and Limitations of Nonprofit Evaluations in Times of Organizational Change: The Case of a Volunteer Service and a Disability Advocacy Organization Evaluating Their Programs Concurrently With the Revision of Their Strategic Plan Michele Tarsilla, Western Michigan University 345 - Concordances: Development and Appropriate Uses MultiPaper to be held in Bonham C Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Rochelle Michel, Educational Testing Service The Concordance Development Process Rochelle Michel, Educational Testing Service Proper Use of Concordances Michael Walker, Educational Testing Service 346 - Building Evaluation Capacity Among School Leaders Multipaper to be held in Bonham D Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Phyllis Clay, Albuquerque Public Schools Discussant - Sheryl Gowen, Georgie State University The Role of Evaluation in Educational Reform: What Evaluation Skills Should Be Required of School Leaders? Tara Shepperson, Eastern Kentucky University Evaluation Quality and Program Evaluation Skills for School Leaders: An Analysis of School Improvement Plans Tamara M Walser, University of North Carolina at Wilmington 347 - Toolkit for Evaluating Impacts of Public Participation in Scientific Research Demonstration to be held in Bonham E Sponsored by the Environmental Program Evaluation TIG Tina Phillips and Richard Bonney, Cornell Univeristy 348 - Strategies for Evaluation Quality in Government MultiPaper to be held in Texas A Sponsored by the Government Evaluation TIG and the Crime and Justice TIG Chair - Margaret Braun, Oregon Department of Corrections Approaching Multi-site Evaluations in Government: A Process Evaluation of Drug Court and Treatment as Usual Shannon Myrick, Oregon Youth Authority; and Margaret Braun, Oregon Department of Corrections Implementing a Randomized Evaluation Design: Toward a Higher Level of Evaluation Quality Margaret Braun, Oregon Department of Corrections; Shannon Myrick, Oregon Youth Authority; and Kelly Officer, Oregon Criminal Justice Commission Evaluation 2010: Thursday, November 11, 3:35 PM – 4:20 PM Page 68 349 - Techniques and Tools for Reporting and Communicating Evaluation Findings Using NVivo 356 - Differing Perspectives of Quality Throughout an Evaluation Demonstration to be held in Texas B Sponsored by the Qualitative Methods TIG Kari Greene, Oregon Public Health Division MultiPaper to be held in Crockett C Sponsored by the AEA Conference Committee Chair - Andrew Lejeune, University of Alberta Examining Evaluators‘ and Stakeholders‘ Perspectives of Quality Stanley Varnhagen, Jason Daniels, Andrew Lejeune, and Cheryl Poth, University of Alberta How Perspectives of Quality Can Change as Evaluations Evolve Jason Daniels, Stanley Varnhagen, Andrew Lejeune, and Cheryl Poth, University of Alberta 350 - New Cost Tools for The Evaluator‘s Toolkit Skill-building Workshop to be held in Texas C Sponsored by the Costs, Effectiveness, Benefits, and Economics TIG Nadini Persaud, University of the West Indies 352 - Evaluating Program Interventions in a Rapidly Changing World: Exploring the Potential of Mid-term Reviews, Real Time and Prospective Evaluation Panel to be held in Texas E Sponsored by the Evaluation Use TIG Chair - Marvin Taylor-Dormond, World Bank Discussant - Patrick Grasso, World Bank Evaluating Program Interventions in a Rapidly Changing World: Exploring the Potential of Mid-term Reviews Chris Olson, European Bank for Reconstruction and Development Evaluating Program Interventions in a Rapidly Changing World: Exploring the Potential Real Time and Prospective Evaluation Stoyan Tenev, World Bank 353 - Research on Evaluation TIG Business Meeting Business Meeting to be held in Texas F Sponsored by the Research on Evaluation TIG TIG Leaders - Christina Christie, University of California, Los Angeles; and Tarek Azzam, Claremont Graduate University 354 - Thinking Again About Concept Mapping Think Tank to be held in Crockett A Sponsored by the Extension Education Evaluation TIG Benjamin Silliman, North Carolina State University 357 - Crime and Justice TIG Business Meeting and Paper Presentations Business Meeting to be held in Crockett D Sponsored by the Crime and Justice TIG TIG Leader - Roger Przybylski, RKC Group Drug Court Evaluation on a Shoestring Budget Roger Przybylski, RKC Group Lessons Learned Evaluating an International Domestic Violence Program Cecilia Hegamin-Younger, TUI University; and Rohan Jeremiah, St George's University 358 - Graduate Student and New Evaluators TIG Business Meeting Business Meeting to be held in Seguin B Sponsored by the Graduate Student and New Evaluator TIG TIG Leaders - Gargi Bhattacharya, Southern Illinois University Carbondale; Nora Gannon, University of Illinois at Urbana-Champaign; and Jason Burkhardt, Western Michigan University 359 - Julia Child and Richard Feynman: An Oblique Approach to Evaluation Quality Expert Lecture to be held in Republic A Sponsored by the International & Cross-cultural Evaluation TIG Alice Willard, International Relief & Development 355 - Behavioral and Systematic Causal Influences in Health and Safety Multipaper to be held in Crockett B Sponsored by the Business and Industry TIG Chair - Thomas Ward, United States Army Evaluation of Health and Safety Incidents: The Search for Systemic Causes and Solutions Katherine King and Judith Daltuva, University of Michigan Organizational Assessment for Finding the Right Mode of Human-Robot Interaction Se Jin Heo and Jim Brown, University of Minnesota Did you know? AEA has over 6500 members, up 14% from last year at this time. Evaluation 2010: Thursday, November 11, 3:35 PM – 4:20 PM Page 69 Thursday, 3:35 pm to 4:20 pm, continued 360 - Improving the Design, Methods, and Data Quality of a Public Health Outcome Panel to be held in Republic B Sponsored by the Health Evaluation TIG Chair and Discussant - Gary Uhl, Centers for Disease Control and Prevention (CDC) The Community-based Organizations Behavioral Outcomes Project: Identifying Challenges and Lessons Learned to Improve Evaluation Design, Methods, and Data Quality Andrea Moore and Elizabeth Kalayil, MANILA Consulting Group Inc; and Tobey Sapiano, Holly Fisher, Alpa Patel-Larson, and Gary Uhl, Centers for Disease Control and Prevention The Application of Lessons Learned to the Design, Methods and Data Quality of The Community-based Organizations Outcome Monitoring Project Tobey Sapiano and Gary Uhl, Centers for Disease Control and Prevention; Andrea Moore, Elizabeth Kalayil, and Adanze Eke, MANILA Consulting Group Inc; Holly Fisher, and Tanisha Grimes, Centers for Disease Control and Prevention; Tamika Hoyte, MANILA Consulting Group Inc; Alpa Patel-Larson, Centers for Disease Control and Prevention; Ekaterine Shapatava, Northrop Grumman Corporation 361 - Theories of Evaluation TIG Business Meeting Business Meeting to be held in Republic C Sponsored by the Theories of Evaluation TIG TIG Leaders - James Griffith, Claremont Graduate University; and Bianca Montrosse, Western Carolina University Evaluation 2010: Thursday, November 11, 3:35 PM – 4:20 PM Page 70 Notes: Evaluation 2010: Thursday, November 11, 3:35 PM – 4:20 PM Page 71 Summary of Sessions for Thursday, November 11, 4:30 PM to 6:00 PM No Primary Sponsor Session Session Title Room 362 Presidential Strand Skill-building Using the Program Evaluation Standards, Third Edition, to Define and Enhance Evaluation Quality Lone Star A 363 Systems in Evaluation TIG Business Meeting Systems in Evaluation TIG Business Meeting and Presentation: Meet and Greet With Systems in Evaluation Authors Lone Star B 364 Collaborative, Participatory & Empowerment Skill-building Lone Star C 365 Non-profit and Foundations Evaluation TIG Business Meeting Non-profits & Foundations Evaluation TIG Business Meeting Lone Star D 366 Quantitative Methods: Theory and Design TIG Demonstration Lone Star E The Biggest Winners: Empowerment Evaluation Exercises to Strengthen Primary Prevention Capacity Fundamentals of Power Analysis and Sample Size Determination 367 Cluster, Multi-site & Multi-level Evaluation TIG Business Meeting TIG Business Meeting and Demonstration: A Mixed Methods Approach to Measurement for Multi-site Evaluation Lone Star F 368 Disabilities and Other Vulnerable Populations Roundtable Rotation I: Special Populations: Strategies for Collecting Data, Giving Voice Rotation II: Toward Universal Design for Evaluation: Continuing the Conversation Mission A 369 Evaluation Policy TIG Multipaper Historical Shifts in Evaluation Policy and Evaluation Practice: What We've Learned About Quality Evaluation Mission B 370 Independent Consulting TIG Business Meeting Independent Consulting TIG Business Meeting Bowie A 371 Multiethnic Issues in Evaluation TIG Panel Bowie B 372 Indigenous Peoples in Evaluation TIG TIG Business Meeting Indigenous Peoples in Evaluation TIG TIG Business Meeting Bowie C 373 Alcohol, Drug Abuse, and Mental Health TIG Roundtable Rotation I: Designing for Change: The Experience of the Quitline Iowa Evaluation Rotation II: Adapting the Strategic Prevention Framework Model for Use in Suicide Prevention… Goliad 374 Evaluating the Arts and Culture TIG Roundtable Rotation I: The Beauty of Internal Evaluation in the Arts: Using Metaphors and Symbols to Develop the Evaluation Capacity… Rotation II: Evaluating Innovation and Capacity Building in Arts Organizations: Challenges and Lessons Learned… San Jacinto 375 Assessment in Higher Education TIG Multipaper Evaluation Without Borders: Lessons From Other Countries Travis A 376 Evaluation Managers and Supervisors TIG Business Meeting TIG Business Meeting and Panel: Reflections on Evaluation Management Expertise and Competencies… Travis B 377 Needs Assessment TIG Panel Face to Face With the Authors of the Needs Assessment Kit: Challenging Questions (With a Twist)… Travis C 378 Health Evaluation TIG MultiPaper Health Indicator Systems for Evaluation of Local, State, and National Chronic Disease Prevention and Control Initiatives Travis D 379 Human Services Evaluation TIG Panel Quality by Design: Statewide Human Services Workforce Evaluation Using an Integrated Framework Independence 380 Quantitative Methods: Theory and Design TIG Multipaper Assessing Change Over Time Presidio A 381 Org Learning & Evaluation Capacity Bldg TIG Panel A Systems Approach to Building and Assessing Evaluation Plan Quality Presidio B 382 AEA Conference Committee Demonstration Data for All: Democratizing Data Without Compromising Quality Presidio C 383 Collaborative, Participatory & Empowerment Roundtable Rotation I: Evaluation Goes to College: The Collaborative Evaluation of a Graduate Program Rotation II: Working Together to Design Effective Evaluation Tools Bonham A 385 Pre-K - 12 Educational Evaluation TIG Multipaper Education Evaluation: Connecting Professional Development to Changes in Classroom Practice Bonham C 386 Pre-K - 12 Educational Evaluation TIG Multipaper Addressing Schools as Organizations in Educational Evaluation Bonham D 387 Research, Technology, and Development Panel Evaluating the Science of Discovery in Complex Health Systems: Challenges and Opportunities Bonham E Evaluation Quality From a Federal Perspective Evaluation 2010: Thursday, November 11, 4:30 PM – 6:00 PM Page 72 Summary of Sessions for Thursday, November 11, 4:30 PM to 6:00 PM, Continued No Primary Sponsor Session Session Title Room 388 Government Evaluation TIG Business TIG Business Meeting and Panel: Happy Anniversary to Us! Celebrating Twenty Years of Government Evaluation Texas A 389 Theories of Evaluation TIG MultiPaper Using Logic Models to Facilitate Comparisons of Evaluation Theory Texas B 390 Mixed Methods Evaluation TIG Multipaper Examining the Mixing in Mixed Methods Evaluation Texas C 391 Research, Technology, and Development Panel Linking Professional Associations to Advance the Study of Science and Innovation Policy Texas D 392 Evaluation Use TIG Multipaper Case Studies in Evaluation Use Texas E 393 Research on Evaluation TIG Multipaper Research on Evaluation Standards and Methods Texas F 394 Extension Education Evaluation TIG Multipaper Evaluation Methodology Crockett A 395 Business and Industry TIG Demonstration Process Lessons for Applied Research and Evaluation from Capital Projects Crockett B 396 International and Cross-cultural Evaluation TIG Demonstration Improving the Quality of Peacebuilding Evaluation Crockett C 397 Disaster and Emergency Management Eval Panel Haiti: Challenges in Emergency Response and Recovery Bring Challenges (and Innovation) in Evaluation Crockett D 398 Graduate Student and New Evaluator TIG Multipaper Student Centered Issues in Evaluation Seguin B Impact Evaluation at the Millennium Challenge Corporation (MCC): Theory, Application, and Complications Republic A 399 International and Cross-cultural Evaluation TIG Panel 400 Health Evaluation TIG Business Meeting TIG Business Meeting and Presentation: Bridging the Evidence Gap in Obesity Prevention – A Framework to Inform… Republic B 401 Collaborative, Participatory & Empowerment Panel Republic C Building Capacity for Youth Participatory Evaluation Evaluation 2010: Thursday, November 11, 4:30 PM – 6:00 PM Page 73 Thursday, 4:30 pm to 6:00 pm 362 - Using the Program Evaluation Standards, Third Edition, to Define and Enhance Evaluation Quality Skill-building Workshop to be held in Lone Star A Sponsored by the Presidential Strand Donald Yarbrough, University of Iowa; Lyn Shulha, Queen's University at Kingston; Rodney Hopson, Duquesne University; Flora Caruthers, Florida Legislature 363 - Systems in Evaluation TIG Business Meeting and Presentation: Meet and Greet With Systems in Evaluation Authors Business Meeting to be held in Lone Star B Sponsored by the Systems in Evaluation TIG TIG Leaders - Janice Noga, Pathfinder Evaluation and Consulting; Margaret Hargreaves, Mathematica Policy Research; and Mary McEathron, University of Minnesota Presenter - Janice Noga, Pathfinder Evaluation and Consulting 364 - The Biggest Winners: Empowerment Evaluation Exercises to Strengthen Primary Prevention Capacity Skill-building Workshop to be held in Lone Star C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Sandra Ortega, Ohio DELTA and Rape Prevention Education; Rebecca Cline, The Ohio Domestic Violence Network; and Amy Bush Stevens, Owl Creek Consulting 365 - Non-profits & Foundations Evaluation TIG Business Meeting Business Meeting to be held in Lone Star D Sponsored by the Non-profit and Foundations Evaluation TIG TIG Leaders - Lester Baxter, Pew Charitable Trusts; Charles Gasper, Missouri Foundation for Health; Joanne Carman, University of North Carolina at Charlotte; and Helen Davis Picher, William Penn Foundation 366 - Fundamentals of Power Analysis and Sample Size Determination Demonstration to be held in Lone Star E Sponsored by the Quantitative Methods: Theory and Design TIG Steven Pierce, Michigan State University 367 - Cluster, Multi-site, and Multi-level TIG Business Meeting and Demonstration: A Mixed Methods Approach to Measurement for Multi-site Evaluation Business Meeting to be held in Lone Star F Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG TIG Leaders - Rene Lavinghouze, Centers for Disease Control and Prevention; and Martha Ann Carey, Maverick Solutions Presenters - Fred Springer, Wendi Siebold, and Carrie Petrucci, Evaluation, Management & Training Associates Inc 368 – Roundtables in Mission A The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Disabilities and Other Vulnerable Populations TIG Rotation 1: Toward Universal Design for Evaluation: Continuing the Conversation Jennifer Sulewski, University of Massachusetts, Boston Rotation 2: Special Populations: Strategies for Collecting Data, Giving Voice Sheila A Arens and Andrea Beesley, Mid-Continent Research for Education and Learning 369 - Historical Shifts in Evaluation Policy abnd Evaluation Practice: What We've Learned About Quality Evaluation Multipaper to be held in Mission B Sponsored by the Evaluation Policy TIG Chair - Ruth Anne Gigliotti, Synthesis Professional Services Inc. Discussant - Catherine Callow-Heusser, EndVision Research and Evaluation LLC The Interface Between Evaluation Policy, Quality Evaluation, and Mission/Service Alignment: A Comparative Analysis of Human Service Organizations Kristin Kaylor Richardson, Western Michigan University The Interplay of Evaluation Requirements and Political, Economic, and Technological Developments: A Historical Study of the Elementary and Secondary Education Act From 1965 to 2005 Maxine Gilling, Western Michigan University Importing Randomized Evaluations From Medicine to Education and International Development: Pitfalls, Policy Implications, and Recommendations Rahel Kahlert, University of Texas, Austin Evaluation 2010: Thursday, November 11, 4:30 PM – 6:00 PM Page 74 370 - Independent Consulting TIG Business Meeting 374 – Roundtables in San Jacinto Business Meeting to be held in Bowie A Sponsored by the Independent Consulting TIG TIG Leaders - Frederic Glantz, Kokopelli Associates LLC; Rita Fierro, Independant Consultant; and Michelle Baron, The Evaluation Baron LLC The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes 371 - Evaluation Quality From a Federal Perspective Panel to be held in Bowie B Sponsored by the Multiethnic Issues in Evaluation TIG Chair - Elmima Johnson, National Science Foundation Evaluation for Science, Technology, Engineering and Math Education (STEM) Education Research and Development Bernice Anderson, National Science Foundation National Science Foundation Committee of Visitors: Evalaution by Experts Fay Korsmo and Connie Kubo Della-Piana, National Science Foundation Evaluation Quality: Threats and Solutions Clemencia Cosentino de Cohen, Urban Institute Comparing Quality Standards in Audit and Evaluation Valerie J Caracelli, United States Government Accountability Office Assessment of Federal Contractor Evaluation Services Elmima Johnson, National Science Foundation 372 - Indigenous Peoples in Evaluation TIG Business Meeting Business Meeting to be held in Bowie C Sponsored by the Indigenous Peoples in Evaluation TIG TIG Leaders - Katherine A Tibbetts, Kamehameha Schools; Kalyani Rai, University of Wisconsin, Milwakee; and Joan LaFrance, Mekinak Consulting 373 – Roundtables in Goliad The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG Rotation 1: Designing for Change: The Experience of the Quitline Iowa Evaluation Disa Cornish and Gene Lutz, University of Nothern Iowa Rotation 2: Adapting the Strategic Prevention Framework Model for Use in Suicide Prevention and Other Abbreviated Funding Cycles Benefiting From Grantee, Stakeholder, Evaluator Collaboration Trena Anastasia and Trish Worley, University of Wyoming Sponsored by the Evaluating the Arts and Culture TIG Rotation 1: Evaluating Innovation and Capacity Building in Arts Organizations: Challenges and Lessons Learned in Capturing the Complexity Mary Piontek, EmcArts Inc Rotation 2: The Beauty of Internal Evaluation in the Arts: Using Metaphors and Symbols to Develop the Evaluation Capacity of the Board and Staff Kathleen Norris, Plymouth State University 375 - Evaluation Without Borders: Lessons From Other Countries Multipaper to be held in Travis A Sponsored by the Assessment in Higher Education TIG Chair - George Reinhart, University of Maryland Quality and University Didactic: The Students‘ Perspectives Cues for Evaluation Serafina Pastore, University of Bari Conducting Meta-evaluation for Receiving Valid Information in Student's Assessment of the Base of Competence‘s Victor Zvonnikov and Marina Chelyshkova, State University of Management Lessons Learned From an Improvement of Student Evaluations of Faculty Yi-Hsing Chung and Yi-Fang Lee and Shiuh-Sheng Yu, National Chi Nan University 376 - Evaluation Managers and Supervisors TIG Business Meeting and Panel: Reflections on Evaluation Management Expertise and Competencies From Two Perspectives Business Meeting to be held in Travis B Sponsored by the Evaluation Managers and Supervisors TIG TIG Leaders - Ann Maxwell, United States Department of Health and Human Services; Sue Hewitt, Health District of Northern Larimer County; and Laura Feldman, University of Wyoming Chair - Thomas Horwood, ICF International Reflections on Evaluation Management Expertise and Competencies From the Perspective of Public Agency Jennifer Broussard, Texas Education Agency Reflections on Evaluation Management Expertise and Competencies From the Perspective of a Consultant Thomas Horwood, ICF International Evaluation 2010: Thursday, November 11, 4:30 PM – 6:00 PM Page 75 Thursday, 4:30 pm to 6:00 pm, continued 377 - Face to Face With the Authors of the Needs Assessment Kit: Challenging Questions (With a Twist) and Hopefully Meaningful Answers Panel to be held in Travis C Sponsored by the Needs Assessment TIG Chair - James Altschuld, The Ohio State University Discussant - Hsin-Ling Hung, University of North Dakota A Quick Overview of the Kit James Altschuld, The Ohio State University Pesky Analysis and Prioritization in Needs Assessment Jeffry White, University of Louisiana, Lafayette Where the Rubber Meets the Road: Taking Action for Change Laurie Stevahn, Seattle University; and Jean A King, University of Minnesota 378 - Health Indicator Systems for Evaluation of Local, State, and National Chronic Disease Prevention and Control Initiatives MultiPaper to be held in Travis D Sponsored by the Health Evaluation TIG Chair - Todd Rogers, Public Health Institute The First Illusion of Tobacco: Monitoring and Countering Tobacco Industry Influence Through the Application of Evaluation Indicators Erika Fulmer, Centers for Disease Control and Prevention; Todd Rogers, Public Health Institute; and Martha Engstrom, Shanta Dube, and Steven Babb, Centers for Disease Control and Prevention Using a Modified Community of Practice Approach to Operationalize Indicators for Heart Disease and Stroke Prevention Hilary Wall, Centers for Disease Control and Prevention; Todd Rogers, Public Health Institute; and Susan Ladd, Centers for Disease Control and Prevention Development and Implementation of Community Strategies and Measurements to Prevent Obesity Rosanne Farris, Laura Kettel Khan, and Jan Jernigan, Centers for Disease Control and Prevention 379 - Quality by Design: Statewide Human Services Workforce Evaluation Using an Integrated Framework Panel to be held in Independence Sponsored by the Human Services Evaluation TIG Chair - Chris Mathias, California Social Work Education Center Discussant - Todd Franke, University of California, Los Angeles Evaluating a Statewide Public Child Welfare Education Program Susan Jacquet and Elizabeth Gilman, California Social Work Education Center Statewide Evaluation of In-service Training Barrett Johnson, Leslie Zeitler, and Chris Lee, California Social Work Education Center Evaluation of the Mental Health Educational Stipend Program Gwen Foster and Sevaughn Banks, California Social Work Education Center Integration Framework Sherrill Clark and Amy Benton, California Social Work Education Center 380 - Assessing Change Over Time Multipaper to be held in Presidio A Sponsored by the Quantitative Methods: Theory and Design TIG Chair - Wendy Garrard, University of Michigan Event History Analysis: Modeling Occurrences of Events Over Time Blair Stephenson, Christine Starr, and Melissa SchaumNguyen, Los Alamos National Laboratory The Use of Piecewise Growth Models to Estimate a Staggered Interrupted Time Series Keith Zvoch and Joseph Stevens, University of Oregon; and Drew Braun, Bethel School District The Z-Kids: What Happens to Individual Clients Over Time? Outcomes With Clinical, Program, and Evaluation Salience Richard Wood and Judith Francis, Pima Prevention Partnership 381 - A Systems Approach to Building and Assessing Evaluation Plan Quality Panel to be held in Presidio B Sponsored by the Organizational Learning and Evaluation Capacity Building TIG and the Systems in Evaluation TIG Chair - Jennifer Urban, Montclair State University Discussant - William M Trochim, Cornell University The Systems Evaluation Protocol and Evaluation Plan Quality: Introduction and Definition Monica Hargraves and Margaret Johnson, Cornell University Capturing Quality: Rubrics for Logic Models, and Evaluation Plans Margaret Johnson and Wanda Casillas, Cornell University Inquiry in Evaluation: Connecting Capacity Building to Education Research Jane Earle and Thomas Archibald, Cornell University Early Indications of Process Use Outcomes Associated With Evaluation Planning Through the Systems Evaluation Protocol Thomas Archibald, Jane Earle, and Monica Hargraves, Cornell University Evaluation 2010: Thursday, November 11, 4:30 PM – 6:00 PM Page 76 382 - Data for All: Democratizing Data Without Compromising Quality 386 - Addressing Schools as Organizations in Educational Evaluation Demonstration to be held in Presidio C Sponsored by the AEA Conference Committee Presenters - Sarah Kohler Chrestman and Lisanne Brown, Louisiana Public Health Institute Multipaper to be held in Bonham D Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Diane Binder, The Findings Group LLC Discussant - Chad Green, Loudoun County Public Schools Documenting Patterns in Teacher‘s Relationships: Their Impact on K-12 Education Kathy Gullie, State University of New York at Albany The Use of School Climate Data for School Improvement Sarah Gareau, South Carolina Educational Policy Center; Diane Monrad and John May, University of South Carolina; Karen Price and Diana Mindrila, South Carolina Educational Policy Center; and Tomonori Ishikawa, University of South Carolina From Monitoring to Evaluation and Back Again: Implications for Organizational Leadership, Budget, and Success Lisa Schmitt, Karen Cornetto, and Lindsay Lamb, Austin Independent School District The Utility of Situation Models for Capturing the Present State of School-wide Initiatives Chad Green, Loudoun County Public Schools 383 – Roundtables in Bonham A The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Rotation 1: Evaluation Goes to College: The Collaborative Evaluation of a Graduate Program Seriashia Chatters, EunKyeng Baek, Thanh Pham, and Yvonne Hunter, University of South Florida Rotation 2: Working Together to Design Effective Evaluation Tools Rebeca Diaz, WestEd 385 - Education Evaluation: Connecting Professional Development to Changes in Classroom Practice Multipaper to be held in Bonham C Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Bianca Montrosse, Western Carolina University Discussant - Susan Connors, University of Colorado, Denver Applying Guskey‘s Model for Evaluating Professional Development to a Math and Science Partnership Program: Successes and Challenges in Collecting Data Across Schools and Grade Levels Carol Haden, Magnolia Consulting LLC; and Jane Kirkley, Northern Arizona University Using the Transtheoretical Model of Readiness for Change to Evaluate the True Impact of Evidence-based Professional Development in the K-12 Setting Christa Smith and Katherine Sprott, Kansas State University Determining the Validity of Teacher Self-Reports as a CostEffective Strategy to Evaluate Teacher Performance Kasey McCracken, Oregon Health & Science University; Gina Magharious, David Heil & Associates Inc; and Joe Sciulli, National Science Teachers Association Qualitative Analysis of Changes in Teachers' Knowledge, Beliefs and Classroom Practices Based on Three Years of Professional Development Carol Baldassari, Sabra Lee, and Rosalie Torres, Torres Consulting Group 387 - Evaluating the Science of Discovery in Complex Health Systems: Challenges and Opportunities Panel to be held in Bonham E Sponsored by the Research, Technology, and Development Evaluation TIG Chair and Discussant - Alison Buchan, University of British Columbia An Evaluation Framework for Advancing the Science of Evaluating Team Science: The Research on Academic Research Initiative (RoAR) Cameron Norman, University of Toronto; Timothy Huerta, Texas Tech University; Sharon Mortimer and Allan Best, Michael Smith Foundation for Health Research; and Alison Buchan, University of British Columbia Advancing the Science of Evaluating Team Science: Psychosocial Factors and Related Outcomes From the RoAR Initiative Cameron Norman, University of Toronto; Timothy Huerta, Texas Tech University; Sharon Mortimer, Michael Smith Foundation for Health Research; and Alison Buchan, University of British Columbia Advancing the Science of Evaluating Team Science: Social Network Outcomes From the RoAR Initiative Timothy Huerta, Texas Tech University; Cameron Norman, University of Toronto; Sharon Mortimer, Michael Smith Foundation for Health Research; and Alison Buchan, University of British Columbia Advancing the Science of Evaluating Team Science: Scientometric-related Outcomes From the RoAR Initiative Sharon Mortimer, Michael Smith Foundation for Health Research; Timothy Huerta, Texas Tech University; and Bianca Cervantes and Alison Buchan, University of British Columbia Evaluation 2010: Thursday, November 11, 4:30 PM – 6:00 PM Page 77 Thursday, 4:30 pm to 6:00 pm, continued 388 - Government Evaluation TIG Business Meeting and Panel: Happy Anniversary to Us! Celebrating Twenty Years of Government Evaluation Business Meeting to be held in Texas A Sponsored by the Government Evaluation TIG TIG Leaders - Stanley Capela, HeartShare Human Services of New York; David J Bernstein, Westat; and Sam Held, Oak Ridge Institute for Science and Education Chair - Stanley Capela, HeartShare Human Services of New York Panel Discussion: How Has Government Evaluation Changed in the Last Twenty Years? David J Bernstein, Westat; Maria Whitsett, Moak, Casey and Associates; Rakesh Mohan, Idaho State Legislature; Stanley Capela, HeartShare Human Services of New York Keynote Address: How Has Evaluation Changed in the Last 20 to 50 Years? Joseph Wholey, University of Southern California 389 - Using Logic Models to Facilitate Comparisons of Evaluation Theory MultiPaper to be held in Texas B Sponsored by the Theories of Evaluation TIG Chair - Marv Alkin, University of California, Los Angeles Discussant - Robin Lin Miller, Michigan State University Visual Representations of Evaluation Theories Tanner LeBaron Wallace, University of Pittsburgh; and Mark Hansen, University of California, Los Angeles Visualizing Context Through Theory Decomposition Anne Vo, University of California, Los Angeles Comparing Evaluation Activities Across Multiple Theories of Practice Lisa Dillman, University of California, Los Angeles Comparing the Intended Consequences of Various Theories of Evaluation Rebecca JC Luskin, University of California, Los Angeles The Utility of Visual Representations of Evaluation Theories Timothy Ho, University of California, Los Angeles 390 - Examining the Mixing in Mixed Methods Evaluation Multipaper to be held in Texas C Sponsored by the Mixed Methods Evaluation TIG Chair - Jori Hall, University of Georgia Discussant - Mika Yamashita, Academy for Educational Development Improving Public Awareness Campaign Evaluation Using Mixed Methods Design Mary Kay Falconer, Ounce of Prevention Fund of Florida; W Douglas Evans, George Washington University What‘s the Right Mix? Lessons Learned Using A Mixed Methods Evaluation Approach Nicole Leacock, Virginia Houmes, Nancy Mueller, and Gina Banks, Washington University in St Louis; Amy Stringer-Hessel, Missouri Foundation for Health; and Cheryl Kelly, Saint Louis University Triangulation in Evaluation Practice Hongling Sun, Nora Gannon, and Jennifer Greene, University of Illinois at Urbana-Champaign 391 - Linking Professional Associations to Advance the Study of Science and Innovation Policy Panel to be held in Texas D Sponsored by the Research, Technology, and Development Evaluation TIG Chair - Susan Cozzens, Georgia Institute of Technology View From the Atlanta Science and Technology Policy (S&T) Conference and Others Susan Cozzens, Georgia Institute of Technology View From the American Evaluation Association's Research, Technology and Development Evaluation TIG Gretchen Jordan, Sandia National Laboratories View From the Association for Public Policy Analysis and Management Julia Melkers, Georgia Institute of Technology View From the Academy of Management Gordon Kingsley, Georgia Institute of Technology 392 - Case Studies in Evaluation Use Multipaper to be held in Texas E Sponsored by the Evaluation Use TIG Chair - Jennifer Iriti, University of Pittsburgh Process Evaluation for Program Improvement: Lessons From the Interns for Indiana Program Omolola A Adedokun, Loran Carleton Parker, and Wilella Burgess, Purdue University Ensuring Program Quality: Lessons Learned From Implementation Evaluation of the Kentucky Alternative Certification in Special Education (KACSE) Program Imelda Castañeda-Emenaker, University of Cincinnati; and Norma Wheat, Campbellsville University Evaluation Synergy: A Multi-purpose Evaluation Design for Fundraising, Applied Learning, and Community Service Nancy Rogers, Jennifer Williams, and Brian Powell, University of Cincinnati The Use of Evaluation in Agricultural Policy Making: The Case of Mexico Alfredo Gonzalez Cambero and Salomon Salcedo Baca, Food and Agriculture Organization of the United Nations Evaluation 2010: Thursday, November 11, 4:30 PM – 6:00 PM Page 78 393 - Research on Evaluation Standards and Methods Multipaper to be held in Texas F Sponsored by the Research on Evaluation TIG Chair - Matthew Galen, Claremont Graduate University Social Science Standards and Ethics: Development, Comparative Analysis, and Issues for Evaluation Linda Mabry, Washington State University, Vancouver Insight Into Evaluation Practice: Results of a Content Analysis of Designs and Methods Used in Evaluation Studies Published in North American Evaluation Focused Journals Christina Christie, University of California, Los Angeles; and Dreolin Fleischer, Claremont Graduate University The Dependability of Campbell Collaboration, Cochrane Collaboration, and What Works Clearinghouse Reviews Chris Coryn, Michele Tarsilla, and Kristin Hobson, Western Michigan University Can Systematic Measurement of an Evaluations‘ Goodness of Fit and Its Influence Determine Quality? Janet Clinton, University of Auckland 394 - Evaluation Methodology Multipaper to be held in Crockett A Sponsored by the Extension Education Evaluation TIG Chair - Paul Pope, Texas A&M University Developing Surveys for Low-Literate Adults Receiving Extension Education Classes Karen Franck, University of Tennessee, Knoxville Optimizing Conditions for Success: An Extension Case Study in Cross-program Surveys Gwen Willems, University of Minnesota Creating a Cost-Benefits Analysis Calculator for Extension Nutrition Education Programs Karen Franck and Joseph Donaldson, University of Tennessee Utilizing the Delphi Method to Identify Competencies and Training to Help Reduce Turnover Among County Extension Faculty Presenters - Diane Craig, University of Florida 397 - Haiti: Challenges in Emergency Response and Recovery Bring Challenges (and Innovation) in Evaluation Panel to be held in Crockett D Sponsored by the Disaster and Emergency Management Evaluation TIG Chair - Amy Gaver, American Red Cross Six Weeks After Haiti Disaster: The Challenge of Leading a Multi-donor Emergency Recovery Needs Assessment Michael Zeleke, American Red Cross Innovation in Collecting and Analyzing Geographic Information: Immediate Contributions to Recovery Efforts and Potential Contributions to Monitoring and Evaluation of Results in Haiti Dale Hill, American Red Cross Haiti: From Response to Recovery: Determining Sectoral Priorities and Beginning the Monitoring Process Dale Hill and Michael Zeleke, American Red Cross Recovery Program Monitoring and Evaluation Design: Challenge of an Impacted Population on the Move in Haiti Christine Connor, American Red Cross 398 - Student Centered Issues in Evaluation Multipaper to be held in Seguin B Sponsored by the Graduate Student and New Evaluator TIG Chair - Thelma Woodard, University of Tennessee, Knoxville Guidelines for Conducting a High-Quality Mixed Methods Dissertation Rebecca Glover-Kudon, University of Georgia Assessing the Needs of Students in an Evaluation: Statistics and Measurement Doctoral Program - Results and Lessons Learned Susanne Kaesbauer and Thelma Woodard, University of Tennessee, Knoxville Evaluation Quality: A Model for Reflecting on Evaluation for Evaluation Students Thelma Woodard, University of Tennessee, Knoxville; Andrea Souflee, United Way of Dallas 395 - Process Lessons for Applied Research and Evaluation from Capital Projects Demonstration to be held in Crockett B Sponsored by the Business and Industry TIG Kate Rohrbaugh, Independent Project Analysis 396 - Improving the Quality of Peacebuilding Evaluation Did you know? The President sets the Conference Theme each year. This year‘s Presidential Strand Theme is Evaluation Quality, chosen by 2010 AEA President Leslie Cooksy. Demonstration to be held in Crockett C Sponsored by the International & Cross-cultural Evaluation TIG Cheyanne Scharbatke-Church, Besa Consulting Evaluation 2010: Thursday, November 11, 4:30 PM – 6:00 PM Page 79 Thursday, 4:30 pm to 6:00 pm, continued 399 - Impact Evaluation at the Millennium Challenge Corporation (MCC): Theory, Application, and Complications Panel to be held in Republic A Sponsored by the International & Cross-cultural Evaluation TIG Chair - Marc Shapiro, Millennium Challenge Corporation Discussant - Jack Molyneaux, Millennium Challenge Corporation MCC Project Evaluations: To Err Is Human Jack Molyneaux, Millennium Challenge Corporation On the Rights Path to Evaluating a Property Rights Project Marc Shapiro, Millennium Challenge Corporation A Scholarly Assessment of the Impact of Scholarships Rebecca Tunstall, Millennium Challenge Corporation An Agricultural Evaluation Standing Out, If Not Outstanding, in the Field Mamuka Shatirishvili, Millennium Challenge AccountGeorgia; and Marc Shapiro, Millennium Challenge Corporation Participatory Evaluation With Youth: Education, Training, and Capacity Building for Change Katie Richards-Schuster and Berry Checkoway, University of Michigan Enhancing Program Quality Through Engaging Youth in Evaluation Jane Powers, Cornell University; and Shep Zeldin, University of Wisconsin, Madison 400 - Health Evaluation TIG Business Meeting and Presentation: Bridging the Evidence Gap in Obesity Prevention - A Framework to Inform Decision Making Business Meeting to be held in Republic B Sponsored by the Health Evaluation TIG TIG Leaders - Robert LaChausse, California State University, San Bernardino; Jenica Huddleston, University of California, Berkeley; Debora Goldberg, Virginia Commonwealth University Chair - Laura Leviton, Robert Wood Johnson Foundation Presenter - Christina Economos, Tufts University Discussants - Jennifer Greene, University of Illinois at Urbana-Champaign; and Madhabi Chatterji, Columbia University 401 - Building Capacity for Youth Participatory Evaluation Panel to be held in Republic C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Chair - Jane Powers, Cornell University Discussant - Shep Zeldin, University of Wisconsin, Madison Putting Evaluation Into the Hands of Children and Youth: Are We Ready? Kim Sabo Flores, Evaluation Access and ActKnowledge Personal and Contextual Relationships That Affect Youth Participatory Evaluation David White, Oregon State University Evaluation 2010: Thursday, November 11, 4:30 PM – 6:00 PM Page 80 Summary of Sessions for Thursday, November 11, 6:10 PM to 7:00 PM No Primary Sponsor Session Session Title Room 404 Collaborative, Participatory & Empowerment Business Meeting Collaborative, Participatory, and Empowerment TIG Business Meeting Lone Star C 409 Social Work TIG Business Meeting Social Work TIG Business Meeting and Presentation: Evaluation in Social Work Education Practice Mission B 410 Social Network Analysis TIG Business Meeting Social Network Analysis TIG Business Meeting Bowie A 411 Multiethnic Issues in Evaluation TIG Business Meeting Multiethnic Issues in Evaluation TIG Business Meeting Bowie B 413 Advocacy and Policy Change TIG Business Meeting Advocacy and Policy Change TIG Business Meeting Goliad 415 Assessment in Higher Education TIG Business Meeting Assessment in Higher Education TIG Business Meeting Travis A 416 Integrating Technology Into Evaluation TIG Business Meeting Integrating Technology Into Evaluation TIG Business Meeting Travis B 417 Needs Assessment TIG Business Meeting Needs Assessment TIG Business Meeting Travis C 418 Evaluating the Arts and Culture TIG Business Meeting Evaluating the Arts and Culture TIG Business Meeting Travis D 419 Human Services Evaluation TIG Business Meeting Human Services Evaluation TIG Business Meeting Independence 420 Lesbian, Gay, Bisexual, Transgender Issues TIG Business Meeting Lesbian, Gay, Bisexual and Transgender Issues TIG Business Meeting Presidio A 424 College Access Programs TIG Business Meeting College Access Programs TIG Business Meeting Bonham B 427 Environmental Program Evaluation TIG Business Meeting Environmental Program Evaluation TIG Business Meeting Bonham E 429 Qualitative Methods TIG Business Meeting Qualitative Methods TIG Business Meeting Texas B 430 Costs, Effectiveness, Benefits, and Economics Business Meeting Costs, Effectiveness, Benefits, and Economics TIG Business Meeting Texas C 431 Research, Technology, and Development Business Meeting Research, Technology and Development Evaluation TIG Business Meeting Texas D 433 Evaluation Policy TIG Business Meeting TIG Business Meeting and Presentation: Evaluation Policy - Where Might We Want To Go, & How Might We Get There? Texas F 434 Extension Education Evaluation TIG Business Meeting Extension Education Evaluation TIG Business Meeting Crockett A 435 Teaching of Evaluation TIG Business Meeting TIG Business Meeting and Presentations: Critical Concepts for Introductory Evaluation Courses: Perspectives… Crockett B 436 Business and Industry TIG Business Meeting Business and Industry TIG Business Meeting Crockett C 437 Disaster and Emergency Management Eval Business Meeting TIG Business Meeting and Discussion – Lessons From the Tsunami Recover in the Indian Ocean and Earthquake… Crockett D 439 International and Cross-cultural Evaluation TIG Business Meeting International and Cross-cultural TIG Business Meeting Evaluation 2010: Thursday, November 11, 6:10 PM – 7:00 PM Republic A Page 81 Thursday, 6:10 pm to 7:00 pm 404 - Collaborative, Participatory, and Empowerment TIG Business Meeting Business Meeting to be held in Lone Star C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG TIG Leaders - David Fetterman, Fetterman & Associates; and Liliana Rodriguez-Campos, University of South Florida 409 - Social Work TIG Business Meeting and Presentation: Evaluation in Social Work Education Practice Business Meeting to be held in Mission B Sponsored by the Social Work TIG TIG Leaders - Donna Parrish, Clark Atlanta University; Tracy C Wharton, University of Michigan; Karen Anderson, Clark Atlanta University; and Aisha Tucker Brown, Northrop Grumman Corporation Presenter - Kathleen Bolland, University of Alabama 410 - Social Network Analysis TIG Business Meeting Business Meeting to be held in Bowie A Sponsored by the Social Network Analysis TIG TIG Leaders - Maryann Durland, Durland Consulting; and Stacey Friedman, Foundation for Advancement of International Medical Education & Research 411 - Multiethnic Issues in Evaluation TIG Business Meeting Business Meeting to be held in Bowie B Sponsored by the Multiethnic Issues in Evaluation TIG TIG Leaders - Tamara Bertrand Jones, Florida State University; Leona Johnson, Hampton University; Stella L Hargett, Morgan State University; and Pamela FrazierAnderson, Lincoln University 413 - Advocacy and Policy Change TIG Business Meeting Business Meeting to be held in Goliad Sponsored by the Advocacy and Policy Change TIG TIG Leaders - Ehren Reed, Innovation Network; Jacqueline WIlliams Kaye, Atlantic Philanthropies; Annette Gardner, University of California, San Francisco; and James Riedel, Girl Scouts of the United States of America 415 - Assessment in Higher Education TIG Business Meeting Business Meeting to be held in Travis A Sponsored by the Assessment in Higher Education TIG TIG Leaders - Rhoda Risner, United States Army; Audrey Rorrer, University of North Carolina at Charlotte; and George Reinhart, University of Maryland 416 - Integrating Technology Into Evaluation TIG Business Meeting Business Meeting to be held in Travis B Sponsored by the Integrating Technology Into Evaluation TIG TIG Leaders - Margaret Lubke, Utah State University; and Nathan Balasubramanian, Centennial Board of Cooperative Educational Services 417 - Needs Assessment TIG Business Meeting Business Meeting to be held in Travis C Sponsored by the Needs Assessment TIG TIG Leaders - Hsin-Ling Hung, University of North Dakota; Janet Matulis, Cincinnati Children's Hospital Medical Center; and Ann Del Vecchio, Alpha Assessment Associates 418 - Evaluating the Arts and Culture TIG Business Meeting Business Meeting to be held in Travis D Sponsored by the Evaluating the Arts and Culture TIG TIG Leaders - Katie Steedly, Steedly Consulting; and Ching Ching Yap, Savannah College of Art and Design 419 - Human Services Evaluation TIG Business Meeting Business Meeting to be held in Independence Sponsored by the Human Services Evaluation TIG TIG Leaders - Tania Rempert, University of Illinois at Urbana-Champaign; Todd Franke, University of California, Los Angeles; Vajeera Dorabawila, New York State Office of Children and Family Services; and Barry Cohen, Rainbow Research Inc 420 - Lesbian, Gay, Bisexual and Transgender Issues TIG Business Meeting Business Meeting to be held in Presidio A Sponsored by the Lesbian, Gay, Bisexual, and Transgender Issues TIG TIG Leaders - Kari Greene, Oregon Public Health Division; John T Daws, University of Arizona; Joe E Heimlich, Ohio State University; and Kathleen McKay, Connecticut Children's Medical Center Evaluation 2010: Thursday, November 11, 6:10 PM – 7:00 PM Page 82 424 - College Access Programs TIG Business Meeting 434 - Extension Education Evaluation TIG Business Meeting Business Meeting to be held in Bonham B Sponsored by the College Access Programs TIG TIG Leaders - Rita O'Sullivan, University of North Carolina at Chapel-Hill; and Kurt Burkum, ACT Business Meeting to be held in Crockett A Sponsored by the Extension Education Evaluation TIG TIG Leaders - Lisa Townson, University of New Hampshire; and Joseph Donaldson, University of Tennessee 427 - Environmental Program Evaluation TIG Business Meeting 435 - Teaching of Evaluation TIG Business Meeting and Presentations: Critical Concepts for Introductory Evaluation Courses: Multiple Perspectives – Part 1 Business Meeting to be held in Bonham E Sponsored by the Environmental Program Evaluation TIG TIG Leaders - Annelise Carleton-Hug, Trillium Associates; Kara Crohn, Research Into Action; and Mary McEathron, University of Minnesota 429 - Qualitative Methods TIG Business Meeting Business Meeting to be held in Texas B Sponsored by the Qualitative Methods TIG TIG Leaders - Jennifer Jewiss, University of Vermont; Leslie Goodyear, National Science Foundation; Janet Usinger, University of Nevada, Reno; and Eric Barela, Partners in School Innovation 430 - Costs, Effectiveness, Benefits, and Economics TIG Business Meeting Business Meeting to be held in Texas C Sponsored by the Costs, Effectiveness, Benefits, and Economics TIG TIG Leaders - Ron Visscher, Aquinas College; and Nadini Persaud, University of the West Indies 431 - Research, Technology and Development Evaluation TIG Business Meeting Business Meeting to be held in Texas D Sponsored by the Research, Technology, and Development Evaluation TIG TIG Leaders - Cheryl Oros, Oros Consulting LLC; Brian Zuckerman, Science and Technology Policy Institute; George Teather, George Teather and Associates; and Juan Rogers, School of Public Policy Georgia Institute of Technology 433 - Evaluation Policy TIG Business Meeting and Presentation: Evaluation Policy - Where Might We Want To Go, and How Might We Get There? Business Meeting to be held in Texas F Sponsored by the Evaluation Policy TIG TIG Leaders - Lisa Rajigah, International Initiative for Impact Evaluation (3ie); and Kristin Kaylor Richardson, Western Michigan University Chair - Lisa Rajigah,3ie Presenters - Melvin Mark, Pennsylvania State University Business Meeting to be held in Crockett B Sponsored by the Teaching of Evaluation TIG TIG Leaders - Linda Schrader, Florida State University; and Neva Nahan, Wayne State University Presenters - Katye Perry, Oklahoma State University; Randy Davies, Brigham Young University; Jose Maria Diaz Puente, Polytechnic University of Madrid; Cheryl Meyer, Wright State University; Theresa Pesl Murphrey, Texas A&M University; Antoinette Stoter, University of Iowa; Bonnie Stabile, George Mason University; Kim Nimon, University of North Texas; and Tara Shepperson, Eastern Kentucky University 436 - Business and Industry TIG Business Meeting Business Meeting to be held in Crockett C Sponsored by the Business and Industry TIG TIG Leaders - Eric Abdullateef, Directed Study Services; Thomas Ward, United States Army; Tala Davidson, Western Michigan University; and Jennifer Martineau, Center for Creative Leadership 437 - Disaster and Emergency Management Evaluation TIG Business Meeting and Discussion – Lessons From the Tsunami Recovery in the Indian Ocean and Earthquake Recovery in Haiti Business Meeting to be held in Crockett D Sponsored by the Disaster and Emergency Management Evaluation TIG TIG Leaders - Scott Aminov, Food For The Hungry; Karen Pendleton, University of South Carolina; Patricia Bolton, Battelle Memorial Institute; and Brandi Gilbert, University of Colorado, Boulder Presenter - Robert Ondrusek, International Federation of Red Cross and Red Crescent Societies 439 - International and Cross-cultural TIG Business Meeting Business Meeting to be held in Republic A Sponsored by the International & Cross-cultural Evaluation TIG TIG Leaders - Tessie Catsambas, EnCompass LLC; Mary Crave, University of Wisconsin; Paula Bilinsky, United States Department of State Evaluation 2010: Thursday, November 11, 6:10 PM – 7:00 PM Page 83 Notes: Evaluation 2010: Thursday, November 11, 6:10 PM – 7:00 PM Page 84 Friday, November 12, 2010: Overview of Schedule 7:00 am to 6:30 pm Registration Desk Open 7:00 am to 7:50 am TIG Business Meetings 8:00 am to 8:45 am Plenary Session 9:15 am to 10:45 am Concurrent Conference Sessions 10:55 am to 11:40 am Concurrent Conference Sessions 11:50 am to 1:30 pm Awards Luncheon 1:40 pm to 3:10 pm Concurrent Conference Sessions 3:35 pm to 4:20 pm Concurrent Conference Sessions 4:30 pm to 6:00 pm Concurrent Conference Sessions 6:30 pm to 8:00 pm Reception and Silent Auction My Schedule and Notes Evaluation 2010: Friday, November 12, Overview Page 85 Summary of Sessions for Friday, November 12, 7:00 AM to 7:50 AM No Primary Sponsor Session Session Title 495 Disabilities and Other Vulnerable Populations Business Meeting TIG Business Meeting and Presentation: Disability-related Funding Opportunities at the NSF - What Evaluators Have… Mission B 496 Pre-K - 12 Educational Evaluation TIG Business Meeting PreK-12 Educational Evaluation TIG Business Meeting Bonham C 497 Mixed Methods Evaluation TIG Business Meeting Mixed Methods TIG Business Meeting Crockett A 498 Evaluation Use TIG Business Meeting TIG Business Meeting and Presentation: Recapturing the "Golden Age" of Research on Evaluation Use Seguin B Evaluation 2010: Friday, November 12, 7:00 AM – 7:50 AM Room Page 86 Friday, 7:00 am to 7:50 am Friday, 8:00 am to 8:45 am 495 - Disabilities and Other Vulnerable Populations TIG Business Meeting and Presentation: Disabilityrelated Funding Opportunities at the National Science 500 – AEA Presidential Address - Evaluation Quality: The Good, the Bad, the Beautiful, and the Ugly Foundation - What Evaluators Have to Offer Plenary to be held in Texas A Sponsored by the Presidential Strand Chair - Debra Rog, Westat Presenter - Leslie Cooksy, University of Delaware Business Meeting to be held in Mission B Sponsored by the Disabilities and Other Vulnerable Populations TIG TIG Leaders - June Gothberg, Western Michigan University; Jennifer Sulewski, University of Massachusetts, Boston; and Patricia Mueller, Evergreen Educational Consulting LLC Presenters - Linda Thurston, National Science Foundation Friday, 8:45 am to 9:15 am – Coffee Break! 496 - PreK-12 Educational Evaluation TIG Business Meeting Business Meeting to be held in Bonham C Sponsored by the Pre-K - 12 Educational Evaluation TIG TIG Leaders - Anane Olatunji, Fairfax County Public Schools; Antionette Stroter, University of Iowa; Tom McKlin, The Findings Group LLC; and Chad Green, Loudoun County Public Schools 497 - Mixed Methods TIG Business Meeting Business Meeting to be held in Crockett A Sponsored by the Mixed Methods Evaluation TIG TIG Leaders - Donna Mertens, Gallaudet University; and Mika Yamashita, Academy for Educational Development 498 - Evaluation Use TIG Business Meeting and Presentation: Recapturing the "Golden Age" of Research on Evaluation Use Business Meeting to be held in Seguin B Sponsored by the Evaluation Use TIG TIG Leaders - J Bradley Cousins, University of Ottawa; and Susan Tucker, Evaluation & Development Associates Discussants - Christina Christie, University of California, Los Angeles; Melvin Mark, Pennsylvania State University Presenter - J Bradley Cousins, University of Ottawa Notes: Evaluation 2010: Friday, November 12, 7:00 AM – 7:50 AM, 8:00 AM – 8:45 AM Page 87 Summary of Sessions for Friday, November 12, 9:15 AM to 10:45 AM No Primary Sponsor Session Session Title Room 502 Presidential Strand Panel Equity and Quality in Evaluation: Ideas and Illustrations From the Field Lone Star A 503 Systems in Evaluation TIG Think Tank Model Forms, Program Theory, and Unexpected Behavior: What Are the Implications for Program Implementation… Lone Star B 504 Collaborative, Participatory & Empowerment Demonstration Youth Led Evaluation in Action: Stomping Out the Stigma of Mental Illness Lone Star C 505 Non-profit and Foundations Evaluation TIG Panel Strategic Learning: An Embedded Approach for Evaluating Complex Change Lone Star D 506 Quantitative Methods: Theory and Design TIG Panel Promoting Quality Impact Studies: Constructive, Context-Appropriate Policies for Strengthening Research Designs… Lone Star E 507 AEA Conference Committee Think Tank The American Evaluation Association and Its Local Affiliates: Shaping Our Future Together Lone Star F 508 Human Services Evaluation TIG Roundtable Making Decisions About Program Continuation: A Step-by-Step Process Mission A 509 Evaluation Policy TIG Panel How Evaluation Policies Affect Evaluation Quality in a Texas Public School District Mission B 510 Independent Consulting TIG Think Tank Enhancing the Quality of Evaluation Design, Data Collection, and Reports Through Peer Review Bowie A 511 Multiethnic Issues in Evaluation TIG Multipaper Utilizing Evaluation Methods to Provide Quality Health Care Services to Underserved Populations Bowie B 512 Internal Evaluation TIG Multipaper Improving Quality of Programs and Evaluation: Examples From the Field Bowie C 513 Advocacy and Policy Change TIG Roundtable Rotation I: Big Money, More Scrutiny: How to Forge Evaluator-Early Childhood Education Program Partnerships… Rotation II: A Study on the Indicator of High Quality Papers: The Case of Casualty Actuarial Society (CAS) Goliad 514 International and Cross-cultural Evaluation TIG Roundtable Rotation I: Exploring Evaluation Quality in International Development Evaluation: An Examination of How International… Rotation II: Practices for Working With and Building Capacity of Local Evaluation Consultants in International Development San Jacinto 515 Assessment in Higher Education TIG Beyond the Classroom: Assessment in Non-Traditional Settings Travis A 517 Lesbian, Gay, Bisexual, Transgender Issues TIG MultiPaper Evaluation of Efforts to Create Safer Environments for Lesbian, Gay, Bisexual, and Transgender (LGBT) Youth Travis C 518 Evaluating the Arts and Culture TIG Multipaper Ecologies of Collaboration in the Arts Travis D 519 Human Services Evaluation TIG Multipaper Challenges and Solutions in Implementing and Conducting Quality Evaluations on Children, Youth, and Families Independence 520 Systems in Evaluation TIG Demonstration Does Sensemaker Make Sense? Evaluating Development Initiatives Through Narrative Capture and Tagging in Kenya… Presidio A 521 Org Learning & Evaluation Capacity Bldg TIG Panel Evaluation Capacity Building (ECB) Models, Measures, and Outcomes: Taking Stock to Forge Ahead Presidio B 522 Alcohol, Drug Abuse, and Mental Health TIG Multipaper Evaluating National Substance Abuse Prevention Programs Presidio C 523 Theories of Evaluation TIG Roundtable Towards Translational Process Evaluation: Implementation, Fidelity, Integration, and Sustainability Bonham A 524 Non-profit and Foundations Evaluation TIG Think Tank Aligning Priorities of Diverse Stakeholders Using Collaborative Evaluation Planning Bonham B 525 Pre-K - 12 Educational Evaluation TIG Multipaper Evaluating Science, Technology, Engineering, and Mathematics (STEM) Initiatives in K-12 Education Bonham C 526 Pre-K - 12 Educational Evaluation TIG Panel Evaluating Literacy Curricula for Adolescents: Results From Three Years of Striving Readers Bonham D 527 Research, Technology, and Development Panel Challenges and Best Practices in Benefit Cost Studies of Research and Technology Programs Bonham E 528 Government Evaluation TIG Skill-building The Weakest Link: Does Good Evaluation Lead to Good Decisions? How to Assess Your Organization Texas A Multipaper Evaluation 2010: Friday, November 12, 9:15 AM – 10:45 AM Page 88 Summary of Sessions for Friday, November 12, 9:15 AM to 10:45 AM, Continued No Primary Sponsor Session Session Title Room 529 Evaluation Managers and Supervisors TIG Skill-building Taking Control of Your Evaluation Career Texas B 530 Mixed Methods Evaluation TIG MultiPaper Ensuring High-Quality Data Processes in Evaluation: Examples From Qualitative, Quantitative and Mixed Methods Work Texas C 531 Research, Technology, and Development MultiPaper Recent Developments in Research and Development Evaluation: The Academic Side Texas D 532 Evaluation Use TIG Multipaper Clients Speak Out About Evaluation Texas E 533 College Access Programs TIG Panel The GEAR UP Experience: Exploring the Promise of Multi-site Evaluation Texas F 534 Extension Education Evaluation TIG Multipaper Evaluation and Program Quality Crockett A 535 Teaching of Evaluation TIG Multipaper Teaching About Specific Aspects of Evaluation Crockett B 536 International and Cross-cultural Evaluation TIG Panel Evaluation Within Contested Spaces Crockett C 537 Government Evaluation TIG Panel Assessing the Health of and Improving the Evaluation Function Across the Government of Canada Through the Management… Crockett D 538 Qualitative Methods TIG Demonstration Assessing the Quality of Research Instruments Using Cognitive Lab Methodology: A Practical Discussion and Lessons… Seguin B 539 International and Cross-cultural Evaluation TIG Panel Complementary Approaches to Evaluating Social Safety Nets at the World Bank Republic A 540 Health Evaluation TIG Skill-building Tools for Aligning National-Level and Local-Level Evaluations: Helping Grantees Evaluate Their Public Health Interventions Republic B 541 Collaborative, Participatory & Empowerment Multipaper Engaging Participants in the Evaluation Process: A Participatory Approach Republic C Evaluation 2010: Friday, November 12, 9:15 AM – 10:45 AM Page 89 Friday, 9:15 am to 10:45 am 502 - Equity and Quality in Evaluation: Ideas and Illustrations From the Field Panel to be held in Lone Star A Sponsored by the Presidential Strand and the Research on Evaluation TIG Chair - Jennifer Greene, University of Illinois at Urbana-Champaign Discussant - Valerie Williams, The Globe Program What is Equity in Educational Evaluation and How Does It Matter in Evaluation Quality? Jennifer Greene, University of Illinois at Urbana-Champaign Educative and Values-Engaged Evaluation Approach (EVEN) We Can Use Values Jeremiah Johnson and Maria Jimenez, University of Illinois at Urbana-Champaign Forewarned Is Forearmed: A Tale of Two EVEN Evaluations Jeehae Ahn and Ayesha Boyce, University of Illinois at Urbana-Champaign 503 - Model Forms, Program Theory, And Unexpected Behavior: What Are the Implications For Program Implementation and Evaluation? Think Tank to be held in Lone Star B Sponsored by the Systems in Evaluation TIG Presenter - Jonathan Morell, Vector Research Center Discussants - Jonathan Morell, Vector Research Center; and Sanjeev Sridharan, University of Toronto 504 - Youth Led Evaluation in Action: Stomping Out the Stigma of Mental Illness Demonstration to be held in Lone Star C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Cheri Hoffman, Centerstone Research Institute; James Martin, Mule Town Family Network 505 - Strategic Learning: An Embedded Approach for Evaluating Complex Change Panel to be held in Lone Star D Sponsored by the Non-profit and Foundations Evaluation TIG Chair and Discussant - Gale Berkowitz, David and Lucile Packard Foundation The Packard Foundation: Strategic Learning and Systems Change Julia Coffman, Center for Evaluation Innovation The Colorado Trust: Strategic Learning and Advocacy Ehren Reed, Innovation Network The California Endowment: Strategic Learning and Multicultural Interventions Hanh Cao Yu, Social Policy Research Associates 506 - Promoting Quality Impact Studies: Constructive, Context-Appropriate Policies for Strengthening Research Designs for Impact Evaluations Panel to be held in Lone Star E Sponsored by the Quantitative Methods: Theory and Design TIG Chair - George Julnes, University of Baltimore What's in an Evaluation Design? Matching the Policy Questions to the Program and Evaluation Context Before Making Methodological Choices Eleanor Chelimsky, Independant Consultant A Variety of Rigorous Methods Can Help Identify Effective Interventions Stephanie Shipman, United States Government Accountability Office Mixed-methods Evaluation Design for a Complex, Evolving Systems Initiative Debra Rog, Westat Designing for Success With Impact Evaluations: Dimensions of Quality for Evidence to Be Actionable George Julnes, University of Baltimore 507 - The American Evaluation Association and Its Local Affiliates: Shaping Our Future Together Think Tank to be held in Lone Star F Sponsored by the AEA Conference Committee Presenter - Rachel Hickson, Montgomery County Public Schools Discussants - Michael Hendricks, Independent Consultant; Beverly A Parsons, InSites; and Stewart Donaldson, Claremont Graduate University 508 – Roundtable in Mission A Sponsored by the Human Services Evaluation TIG Making Decisions About Program Continuation: A Step-by-Step Process Carla Clasen, Betty Yung, Carl Brun, Katherine Cauley, and Cheryl Meyer, Wright State University 509 - How Evaluation Policies Affect Evaluation Quality in a Texas Public School District Panel to be held in Mission B Sponsored by the Evaluation Policy TIG Chair - Karen Looby, Austin Independent School District Discussant - Whitsett Maria, Moak, Casey & Associates Setting Evaluation Priorities in a Public School District: Who Decides What Gets Evaluated? Karen Looby, Austin Independent School District Policy Influences on the Evaluation of a Teacher Incentive Pay Program and Program Decision Making Lisa Schmitt, Austin Independent School District Addressing Challenges Associated With the Mandated Evaluation of Projects Funded by Federal Stimulus Dollars Martha Doolittle, Austin Independent School District Evaluation 2010: Friday, November 12, 9:15 AM – 10:45 AM Page 90 Creating a Partnership: How a School District Helps Community Based Service Providers Evaluate Their Programs Cinda Christian, Austin Independent School District 510 - Enhancing the Quality of Evaluation Design, Data Collection, and Reports Through Peer Review Think Tank to be held in Bowie A Sponsored by the Independent Consulting TIG Presenter - Sally Bond, The Program Evaluation Group LLC Discussants - Sally Bond, The Program Evaluation Group LLC; and Courtney Malloy, Vital Research LLC 511 - Utilizing Evaluation Methods to Provide Quality Health Care Services to Underserved Populations Multipaper to be held in Bowie B Sponsored by the Multiethnic Issues in Evaluation TIG Chair - Kevin E Favor, Lincoln University Implementation Evaluation of HIV/AIDS Non-government Organization's (NGOs) Legal Assistance Services in Brazil Paula Vita Decotelli, Marly Cruz, and Miriam Ventura, National School of Public Health (ENSP/Fiocruz) Evaluation of an Entertainment-Education Intervention Targeting the Latino Spanish Speaking Community of Colorado: Challenges and Accomplishments Mariana Enriquez-Olmos, Independent Consultant; and Cristina Bejarano, Independent Consultant A Culturally Responsive Process: Using Sociocultural Theory as a Guide to Program Development and Evaluation Dominica McBride, Center for African American Health Out of the Crossfire: Evaluating Fundraising Materials for a Hospital-based Violence Intervention Program Serving Stigmatized Populations Jennifer Williams, Nancy Rogers, and Brian Powell, University of Cincinnati 512 - Improving Quality of Programs and Evaluation: Examples From the Field Multipaper to be held in Bowie C Sponsored by the Internal Evaluation TIG Chair - Lennise Baptiste, Kent State University Discussant - Wendy DuBow, National Center for Women and Information Technology The Impact of Participant Feedback on Program Outcomes: A Program Evaluation Consideration Candace Lacey, Barbara Packer-Muti, and Jennifer Reeves, Nova Southeastern University Using Appreciative Inquiry Focus Groups to Engage Members in Planning for the National Network of Libraries of Medicine Middle Atlantic Region Sue Hunter, New York University; and Cynthia Olney, National Network of Libraries of Medicine Meta-evaluation Quality in Brazil: A Mamdani Hierarchical Fuzzy Inference System Ana Carolina Letichevsky and Thereza Penna-Firme, Cesgranrio Foundation 513 – Roundtables in Goliad Sponsored by the Advocacy and Policy Change TIG and the Research, Technology, and Development Evaluation TIG Rotation 1: Big Money, More Scrutiny: How to Forge EvaluatorEarly Childhood Education Program Partnerships in Order to Produce Clear, Relevant, and Useful Data to Inform Policy and Practice Marijata Daniel-Echols, HighScope Educational Research Foundation Rotation 2: A Study on the Indicator of High Quality Papers: The Case of Chinese Academy of Sciences (CAS) Haijun Zheng, Zhongcheng Guan, Haiyang Hu, and Bing Shi, Chinese Academy of Sciences 514 – Roundtables in San Jacinto Sponsored by the International & Cross-cultural Evaluation TIG Rotation 1: Practices for Working With and Building Capacity of Local Evaluation Consultants in International Development Elizabeth Hutchinson, Land O'Lakes International Development; and Meredith Blair, Humanity United Rotation 2: Exploring Evaluation Quality in International Development Evaluation: An Examination of How International Development Organizations Issue and Contract Evaluations Anne Cullen, Daniela Schroeter, and Michele Tarsilla, Western Michigan University; Jim Rugh, Independent Consultant; and Kelly Robertson, Western Michigan University 515 - Beyond the Classroom: Assessment in NonTraditional Settings Multipaper to be held in Travis A Sponsored by the Assessment in Higher Education TIG Chair - Howard Mzumara, Indiana University-Purdue University Indianapolis A Look at the Efficacy of Guided Self-Placement for First-Year Writing Courses Howard Mzumara, Indiana University-Purdue University Indianapolis Creating the Global Student: Increasing Competency, Preparation, and Personal Growth of Students in a University International Certificate Program Yuanyuan Wang, Keith Trahan, and Cara Ciminillo, University of Pittsburgh Creating Valued Field Placement Feedback: Making the Forms Meaningful and Useful for Evaluators and Educators Julia Williams, University of Minnesota, Duluth Evaluation 2010: Friday, November 12, 9:15 AM – 10:45 AM Page 91 Friday, 9:15 am to 10:45 am, continued 517 - Evaluation of Efforts to Create Safer Environments for Lesbian, Gay, Bisexual, and Transgender (LGBT) Youth MultiPaper to be held in Travis C Sponsored by the Lesbian, Gay, Bisexual, and Transgender Issues TIG Chair - Joseph Kosciw, Gay, Lesbian & Straight Education Network An Evaluation of a National Leadership Development Program for LGBT Youth and Their Allies Elizabeth Diaz, Gay, Lesbian & Straight Education Network Evaluation of a District-wide Training Program to Create Safer Schools for Lesbian, Gay, Bisexual, Transgender, and Questioning Youth Emily Greytak, Gay, Lesbian & Straight Education Network Effectiveness of a Public Communication Campaign About Homophobic Language Joseph Kosciw, Gay, Lesbian & Straight Education Network; and Sheri Klein, AdCouncil 518 - Ecologies of Collaboration in the Arts Multipaper to be held in Travis D Sponsored by the Evaluating the Arts and Culture TIG Chair - Min Zhu, University of South Carolina Discussant - Katie Steedly, Steedly Consulting Documenting Collabroation as a Process in an Art and Design Context Ching Ching Yap, Tara Pearsall, and Mary Taylor, Savannah College of Art and Design Evaluating Collaboration in Design Teams: A Multi Method Approach Robyn Richardson, Dustin Larimer, and Yushi Wang, Savannah College of Art and Design Youth Education in the Arts: New Collaboration Model for Funders, Arts Organizations, and Evaluators Lora Warner, University of Wisconsin, Green Bay 519 - Challenges and Solutions in Implementing and Conducting Quality Evaluations on Children, Youth, and Families Multipaper to be held in Independence Sponsored by the Human Services Evaluation TIG Chair - Margaret Polinsky, Parents Anonymous Inc Field Study Evaluation of a Comprehensive Sexual Abstinence Program: Methodology Challenges, Approaches, and Implications Virginia Dick, Ann Peisher, and Amy Laura Arnold, University Of Georgia; and Robetta McKenzie, and Katrina Davidson, Augusta Partnership for Children Inc; and Don Bower, University of Georgia From Champions to Change: The Role of Quality Evaluation in Implementing a Child Welfare System Change Initiative Margaret Richardson and James Henry, Western Michigan University Developing a Shared Understanding of Evaluation Quality: The Case of a Sexual Abuse Prevention Program Beth Johnson, EMJ Associates; and Stephen Leaver, Imagination Theater 520 - Does Sensemaker Make Sense? Evaluating Development Initiatives Through Narrative Capture and Tagging in Kenya and Latin America Demonstration to be held in Presidio A Sponsored by the Systems in Evaluation TIG and the Qualitative Methods TIG John Hecklinger, GlobalGiving Foundation; and Irene Guijt, Learning by Design 521 - Evaluation Capacity Building (ECB) Models, Measures, and Outcomes: Taking Stock to Forge Ahead Panel to be held in Presidio B Sponsored by the Organizational Learning and Evaluation Capacity Building TIG Chair - Tina Taylor-Ritzler, Dominican University Discussant - Hallie Preskill, FSG Social Impact Advisors Research Synthesis of ECB Literature: An Evidence-based Review Susan Labin, Independent Consultant; and Jennifer Duffy and Abraham Wandersman, University of South Carolina Results and Implications of a Mixed-methods ECB Model Validation Study Tina Taylor-Ritzler, Dominican University; Yolanda SuarezBalcazar, University of Illinois at Chicago; and Edurne GarcíaIriarte, Trinity College Dublin Using Qualitative Methods to Further Specify Contextual and Cultural Elements of ECB Processes Yolanda Suarez-Balcazar, University of Illinois at Chicago; and Tina Taylor-Ritzler, Dominican University 522 - Evaluating National Substance Abuse Prevention Programs Multipaper to be held in Presidio C Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG Chair - Trena Anastasia, University of Wyoming Effects of the Strategic Prevention Framework State Incentives Grant (SPFSIG) on State Prevention Infrastructure in Twenty-six States Robert Orwin, Westat; Alan Stein-Seroussi and Jessica Edwards, Pacific Institute for Research and Evaluation (PIRE); and Ann Landy, Westat Evaluating Large Scale Technical Assistance Centers: The Case of the Center for Substance Abuse Prevention's Centers for the Application of Prevention Technologies Tom James, University of Oklahoma; and Wayne Harding, Social Science Research and Evaluation Evaluation 2010: Friday, November 12, 9:15 AM – 10:45 AM Page 92 Implementing An Evidence-based Prevention Program Nationally Using A Multi-tier Approach: Helping Youth Stay on Track Melissa Rivera and Scott Steger, National Center for Prevention and Research Solutions 523 – Roundtable in Bonham A Sponsored by the Theories of Evaluation TIG and the Health Evaluation TIG Towards Translational Process Evaluation: Implementation, Fidelity, Integration, and Sustainability Oliver Massey, university of South Florida 524 - Aligning Priorities of Diverse Stakeholders Using Collaborative Evaluation Think Tank to be held in Bonham B Sponsored by the Non-profit and Foundations Evaluation TIG Presenter - Randi Nelson, JVA Consulting LLC Discussants - Nancy Zuercher and Julia Alvarez, JVA Consulting LLC 525 - Evaluating Science, Technology, Engineering, and Mathematics (STEM) Initiatives in K-12 Education Multipaper to be held in Bonham C Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - James P Van Haneghan, University of South Alabama Discussant - Tom McKlin, The Findings Group LLC Planning Evaluations for Discovery Research K-12 (DR K-12) Design Projects Kathleen Haynie, Haynie Research and Evaluation Evaluation Methodology and Results of the Building Science Teaching Capacity Project Robert Owens and Mike Trevisan, Washington State University Longitudinal Evaluation of Project Lead The Way in Iowa: Using Interdisciplinary Collaboration as a Method of Quality Melissa Chapman and David Rethwisch, University of Iowa; Tom Schenk Jr, Iowa Department of Education; and Frankie Laanan, Soko Starobin, and 'Leaf' Yi Zang, Iowa State University Measuring Change in Middle Schools Girls‘ Knowledge and Perceptions of Science, Technology, Engineering and Math (STEM) Related to Intervention: Implications for School Reform Carol Nixon, Edvantia Inc 526 - Evaluating Literacy Curricula for Adolescents: Results From Three Years of Striving Readers Panel to be held in Bonham D Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Stefanie Schmidt, United States Department of Education Discussant - David Francis, University of Houston Striving Readers: Results From Ohio William Loadman, Ohio State University Striving Readers: Results From Newark Jennifer Hamilton and Matthew Carr, Westat Striving Readers: Results From the Mid-South Debra Coffey, Research for Better Schools Striving Readers: Results From Portland Bonnie Faddis and Margaret Beam, RMC Research Corporation Results from Springfield/Chicopee Kimberly Sprague, Brown University 527 - Challenges and Best Practices in Benefit Cost Studies of Research and Technology Programs Panel to be held in Bonham E Sponsored by the Research, Technology, and Development Evaluation TIG Chair - Rosalie Ruegg, TIA Consulting Inc A Case Study: A Benefit-cost Analysis of Department of Education's Investment in Solar Photovoltaic Energy Systems Alan O'Connor, Ross J Loomis, and Fern M Braun, RTI International View From Studies Done by the Advanced Technology Program Rosalie Ruegg, TIA Consulting Inc Perspectives From Europe Isabelle Collins, Technopolis View of the Chairman of the Expert Review Panel Irwin Feller, Pennsylvania State University 528 - The Weakest Link: Does Good Evaluation Lead to Good Decisions? How to Assess Your Organization Skill-building Workshop to be held in Texas A Sponsored by the Government Evaluation TIG Thea C Bruhn, United States Department of State 529 - Taking Control of Your Evaluation Career Skill-building Workshop to be held in Texas B Sponsored by the Evaluation Managers and Supervisors TIG George Grob, Center for Public Program Evaluation; and Ann Maxwell, United States Department of Health and Human Services Evaluation 2010: Friday, November 12, 9:15 AM – 10:45 AM Page 93 Friday, 9:15 am to 10:45 am, continued 530 - Ensuring High-Quality Data Processes in Evaluation: Examples From Qualitative, Quantitative and Mixed Methods Work MultiPaper to be held in Texas C Sponsored by the Mixed Methods Evaluation TIG Chair - Lorena Ortiz, Berkeley Policy Associates Quality Control Methods With Quantitative Data in a Randomized Control Trial Study for a Teacher Professional Development Evaluation Lorena Ortiz, Berkeley Policy Associates Qualitative Data Management, Analysis and Synthesis: Lessons From a Team-based Process Using Multiple Qualitative Data Sources Tommy Smith, Berkeley Policy Associates 531 - Recent Developments in Research and Development Evaluation: The Academic Side MultiPaper to be held in Texas D Sponsored by the Research, Technology, and Development Evaluation TIG Chair and Discussant- Juan Rogers, School of Public Policy Georgia Institute of Technology Science Overlay Maps: A New Research Evaluation Tool Alan Porter, Georgia Institute of Technology; and Ismael Rafols, University of Sussex Tracking Knowledge and Collaborative Development in Research and Development: Combining Social Network and Bibliometric Analysis in the Evaluation of Research Centers Julia Melkers and Jan Youtie, Georgie Institute of Technology Bibliometric Analysis as a Methodology for Research Evaluation and Mapping of Science Anthony van Raan and Thed van Leeuwen, University of Leiden 532 - Clients Speak Out About Evaluation Multipaper to be held in Texas E Sponsored by the Evaluation Use TIG Chair - Susan Tucker, Evaluation & Development Associates Discussant - Lyn Shulha, Queen's University at Kingston Exploring Evaluation Use: Multiple Representations of Evaluation Findings Michelle Searle, Christine Doe, and Lyn Shulha, Queen's University at Kingston; and Susan Elgie, Independant Consultant Enhancing Evaluation Quality Through Client-Centered Reporting Micheline Magnotta, 3D Group Measuring Evaluation Use and Influence Among Project Directors of State Gaining Early Awareness and Readiness for Undergraduate Programs Grants Erin Burr, Oak Ridge Institute for Science and Education; and Jennifer Morrow and Gary Skolits, University of Tennessee Chilean Evaluated Teachers Give Their Opinions About the National Teacher Evaluation System Dante Cisterna-Alburquerque, Michigan State University 533 - The Gaining Early Awareness and Readiness for Undergraduate Programs (GEAR UP) Experience: Exploring the Promise of Multi-site Evaluation Panel to be held in Texas F Sponsored by the College Access Programs TIG Chair - Yvette Lamb, Academy for Educational Development Discussant - Melissa Panagides-Busch, Academy for Educational Development Overview of the GEAR UP Multi-site Evaluation Yvette Lamb, Academy for Educational Development GEAR UP Programs: Similarities and Differences Across Sites David Jochelson, Susanna Kung, and Arati Singh, Academy for Educational Development Designs for Cluster and Multi-site Evaluation for GEAR UP Program Mika Yamashita, Academy for Educational Development 534 - Evaluation and Program Quality Multipaper to be held in Crockett A Sponsored by the Extension Education Evaluation TIG Chair - Lisa Townsend, University of New Hampshire Organizational Impacts of Extension State Systems on Evaluation Practice in the Field Alexa J Lamm, Glenn D Israel, and Tracy Irani, University of Florida Applying Extension Methodology in an African Education and Food Security Program: Lessons Learned About Maintaining Quality From a Distance Mary Crave, University of Wisconsin Assessing Youth Program Quality in 4-H Club Settings: Outcomes from Four Arizona Counties Amy Schaller, Christine Bracamonte-Wiggs, and Lynne Borden, University of Arizona A Systems Perspective on the Challenges in Finding Measures for High-Quality Evaluation Monica Hargraves, Cornell University 535 - Teaching About Specific Aspects of Evaluation Multipaper to be held in Crockett B Sponsored by the Teaching of Evaluation TIG Chair - John Stevenson, University of Rhode Island Teaching Qual Inside a Quant World John Stevenson, University of Rhode island Integrating Social Justice Into Evaluation Teaching: Opportunities and Strategies Veronica Thomas, Howard University; and Anna Madison, University of Massachusetts, Boston Developing Evaluation Reports That Are Useful, User-Friendly, and Used Tamara M Walser, University of North Carolina at Wilmington Evaluation 2010: Friday, November 12, 9:15 AM – 10:45 AM Page 94 536 - Evaluation Within Contested Spaces Panel to be held in Crockett C Sponsored by the International & Cross-cultural Evaluation TIG Chair - Ross VeLure Roholt, University of Minnesota Doing Evaluation and Being an Evaluator in Violently Contested Spaces Michael Baizerman, University of Minnesota Crafting High Quality Evaluations in Contested Spaces: Lessons From the Field Barry Cohen, Rainbow Research Inc Show Me Your Impact: Evaluating Transitional Justice in Contested Spaces Colleen Duggan, International Development Research Centre Being Practical, Being Safe: Doing Evaluations in Contested Spaces Ross VeLure Roholt, University of Minnesota 537 - Assessing the Health of and Improving the Evaluation Function Across the Government of Canada Through the Management Accountability Framework (MAF) Panel to be held in Crockett D Sponsored by the Government Evaluation TIG Chair - Anne Routhier, Treasury Board of Canada Overview of the Government of Canada‘s MAF's Area of Management 6 (AoM6) (Quality and Use of Evaluation) and Its Use in Assessing the Health of the Evaluation Function Anne Routhier and Brian Moo Sang, Treasury Board of Canada Department of Canadian Heritage‘s Experience in MAF to Inform Continuous Improvement of the Evaluation Paule-Anny Pierre, Department of Canadian Heritage Building Evaluation Excellence at Indian and Northern Affairs Canada: Using the the MAF as a Roadmap Tamara Candido and Judith Moe, Indian and Northern Affairs Canada Use of the MAF at Industry Canada in Improving the Evaluation Function Kim Bachmann and Beate Schiffer-Graham, Industry Canada 538 - Assessing the Quality of Research Instruments Using Cognitive Lab Methodology: A Practical Discussion and Lessons Learned Demonstration to be held in Seguin B Sponsored by the Qualitative Methods TIG Presenters - Joanna Gilmore, Heather Bennett, and Karen Price, University of South Carolina 539 - Complementary Approaches to Evaluating Social Safety Nets at the World Bank Sponsored by the International & Cross-cultural Evaluation TIG Chair - Cheryl Gray, World Bank Evaluation Questions and Approaches Jennie Litvack, World Bank Country Case Studies – The Case of Jamaica Victoria Monchuk, World Bank Impact Evaluation for Assessing Sustainability of Program Effects – The Case of Colombia Javier Baez, World Bank 540 - Tools for Aligning National-Level and LocalLevel Evaluations: Helping Grantees Evaluate Their Public Health Interventions Skill-building Workshop to be held in Republic B Sponsored by the Health Evaluation TIG Shyanika Rose, Joanne Abed, Carlyn Orians, and Linda Winges, Battelle Memorial Institute 541 - Engaging Participants in the Evaluation Process: A Participatory Approach Multipaper to be held in Republic C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Chair - Seriashia Chatters, University of South Florida Evaluating a Community Partnership Using a Community-based Participatory Approach: The Men‘s Health League Partnership in Cambridge, Massachusetts Omonyele Adjognon, Shalini Tendulkar, and Elisa Friedman, Institute for Community Health; Claude- Alix Jacob, Marsha Lazar, and Albert Pless Jr, Cambridge Public Health Department; and Barbara Kibler, Margaret Fuller Neighborhood House To Tell or Not to Tell: Strategies of Breaking Through the Walls and Gaining the Trust of Evaluation Participants Bellarmine Ezumah, Howard University Utilizing Participatory Processes in Program Design and Implementation Sets the Framework for a More Streamlined Evaluation Process Especially for Participatory Evaluations Carlene Baugh and Scott Yetter, CHF International Assessing a Model to Support Community-Driven Research Initiatives: The Atlanta Clinical and Translational Science Institute‘s Community Engagement and Research Mini-grant Program Tabia Henry Akintobi, Morehouse School of Medicine; Lewis Autor, Rock of Escape; Jacqueline Brown, Empowerment Resource Center for Women Inc; Joyce Essien, Emory University; Katherine Erwin and Daniel Blumenthal, Morehouse School of Medicine; and Michelle C Kegler and Winifred W Thompson, Emory University Utilizing Participatory Action Research Framework to Prevent HIV Infection Among Youth Living in Public Housing Meelee Kim and Peter Kreiner, Brandeis University; Suzanne Boucher, Wayside Youth and Family Support Network Panel to be held in Republic A Evaluation 2010: Friday, November 12, 9:15 AM – 10:45 AM Page 95 Summary of Sessions for Friday, November 12, 10:55 AM to 11:40 AM No Primary Sponsor Session Session Title Room 542 Presidential Strand Expert Lecture President Obama's Evaluation Policies Lone Star A 543 Program Theory and Theory-driven Evaluation Multipaper Examples From the Field: Using Mixed Methodological Frameworks in Theory-Driven Evaluations Lone Star B 544 Collaborative, Participatory & Empowerment Think Tank Youth Participatory Evaluation: Entering the Age of the Internet Lone Star C 545 Non-profit and Foundations Evaluation TIG Panel Funder‘s Use of Network Analysis to Build Intentional Collaboration Lone Star D 546 Quantitative Methods: Theory and Design TIG Demonstration Using Latent Class Analysis to Target and Tailor Programs to Specific Populations Lone Star E 547 Cluster, Multi-site & Multi-level Evaluation TIG Multipaper Multi-method Approaches Lone Star F 548 Evaluation Managers and Supervisors TIG Roundtable Controlling Quality Within Museums: Coordinating Internal Evaluation Departments Mission A 550 Systems in Evaluation TIG Panel The Adaptive Action Cycle: Bridging the Gap Between Lessons Learned and Lessons Applied Bowie A 551 Multiethnic Issues in Evaluation TIG Multipaper Using Evaluation to Enhance Program Participation With Underrepresented Groups in STEM Fields Bowie B 552 Advocacy and Policy Change TIG Panel How Does Evidence Influence Policy Change? Examining Two Complementary Approaches With Two Complementary Evals Bowie C 553 Feminist Issues in Evaluation TIG Roundtable Incorporating Gender into Mainstream Projects Goliad 554 Research on Evaluation TIG Roundtable Utilizing Metaevaluation to Validate Evaluation Quality: Study of a Grant-Funded Graduate Program for Minority Group… San Jacinto 556 Costs, Effectiveness, Benefits, and Economics Panel Using Cost --> Procedure --> Process --> Outcome Analysis (CPPOA) Data to Improve Substance Abuse Prevention… Travis B 557 Org Learning & Evaluation Capacity Bldg TIG Multipaper Communication: At What Level Does It Help or Hinder Evaluation Capacity? Travis C 558 Health Evaluation TIG Expert Lecture Is Quality Improvement In Healthcare Cost-Effective? Travis D 559 Lesbian, Gay, Bisexual, Transgender Issues TIG Multipaper None of the Above: Expanding Binary Categorizations Independence 560 Distance Ed & Other Educational Technologies Multipaper Technology and Student Outcomes: Mathematics, Language Arts, and Big-District Diversity Presidio A 561 Org Learning & Evaluation Capacity Bldg TIG Demonstration Herding Cats: Improving the Quality and Quantity of Decentralized Evaluation in a Global Organization Through Capacity Bldg Presidio B 562 Alcohol, Drug Abuse, and Mental Health TIG Business Meeting Alcohol, Drug Abuse and Mental Health TIG Business Meeting Presidio C 563 Business and Industry TIG Roundtable Assessing Board Performance: Challenges and Constraints Bonham A 564 Non-profit and Foundations Evaluation TIG Panel Low-cost, High-Quality Assessments for Nonprofit Adolescent Pregnancy Prevention Program Planning Bonham B 565 Pre-K - 12 Educational Evaluation TIG Expert Lecture Is Working Together Worth It? The Process and Findings of a Longitudinal Evaluation of a Districtwide Professional… Bonham C 566 Pre-K - 12 Educational Evaluation TIG Multipaper Evaluating Education Programs for English Language Learners Bonham D 567 Research, Technology, and Development Multipaper From Research to Commercialization: Impact Evaluation of Portfolios of Research Bonham E 569 Research, Technology, and Development Multipaper Evaluating Government Research and Technology Policies: Traditional and Emerging Methods Texas D 570 Evaluation Use TIG Panel Joint Evaluation of Private Sector Development Projects: Benefits and Challenges Texas E 571 Graduate Student and New Evaluator TIG Demonstration Using R for Statistical Analysis Texas F Evaluation 2010: Friday, November 12, 10:55 AM – 11:40 AM Page 96 Summary of Sessions for Friday, November 12, 10:55 AM to 11:40 AM, Continued No Primary Sponsor Session Session Title Room 572 AEA Conference Committee Panel The American Evaluation Association's Journal Editors Discuss Publishing in AEA's Journals Crockett A 573 Business and Industry TIG Demonstration How to Use Evaluation to Achieve Human Resources (HR) System Alignment Crockett B 574 Indigenous Peoples in Evaluation TIG Multipaper Translating Evaluation to Enhance Its Meaning and Use: Examples From Two Indigenous Communities - Urban US and Rural… Crockett C 576 Qualitative Methods TIG Multipaper Using Qualitative Methods in Evaluations With Limited Resources Seguin B 577 International and Cross-cultural Evaluation TIG Demonstration Peace Corps‘ Volunteer Reporting Tool: Increasing the Capacity for Evidence-based Decision-Making at Multiple Levels… Republic A 578 Health Evaluation TIG Demonstration Online Visual System for Strategic Planning and Performance Monitoring: iProgress √ Check Republic B 579 Theories of Evaluation TIG Multipaper The Basis for Good Judgment in Evaluation Republic C Evaluation 2010: Friday, November 12, 10:55 AM – 11:40 AM Page 97 Friday, 10:55 am to 11:40 am 542 - President Obama's Evaluation Policies Expert Lecture to be held in Lone Star A Sponsored by the Presidential Strand, and the Government Evaluation and the Evaluation Policy TIGs Chair - Jennifer Greene, University of Illinois at Urbana-Champaign Discussants - Patrick Grasso, World Bank; and George Grob, Center for Public Program Evaluation Presenters - Stephanie Shipman, United States Government Accountability Office; and Katherine Dawes, United States Environmental Protection Agency 543 - Examples From the Field: Using Mixed Methodological Frameworks in Theory-Driven Evaluations Multipaper to be held in Lone Star B Sponsored by the Program Theory and Theory-driven Evaluation TIG Chair - Katrina Bledsoe, Walter R McDonald and Associates Inc The Mix of Methods: Towards a Framework to Anticipate Validity Threats When Evaluating Agricultural Value Chain Development Interventions Giel Ton and Marieke De Ruijter De Wildt, LEI Wageningen UR Team Process Factors in the Evaluation of a Community-Teambased Entrepreneurial Development Initiative Laurie Van Egeren, Meenal Rana, Diane Doberneck, and Miles McNall, Michigan State University 544 - Youth Participatory Evaluation: Entering the Age of the Internet Think Tank to be held in Lone Star C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Presenter - Robert Shumer, University of Minnesota Discussants - Robert Shumer, University of Minnesota; and Kim Sabo Flores, Evaluation Access and ActKnowledge 545 - Funder‘s Use of Network Analysis to Build Intentional Collaboration Panel to be held in Lone Star D Sponsored by the Non-profit and Foundations Evaluation TIG Chair - David J Dobrowski, First 5 Monterey Funder‘s Perspective on Practical Use of Network Analysis Findings With Funded Agencies David J Dobrowski, First 5 Monterey Evaluator‘s Perspective on Practical Use of Network Analysis Findings With Funded Agencies Raul Martinez, Harder+Company 546 - Using Latent Class Analysis to Target and Tailor Programs to Specific Populations Demonstration to be held in Lone Star E Sponsored by the Quantitative Methods: Theory and Design TIG Humphrey Costello and Reese Jenniges, University of Wyoming 547 - Multi-method Approaches Multipaper to be held in Lone Star F Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG Chair - John Hitchcock, Ohio University A Mixed Methods Approach to Measurement for Multi-site Evaluation Carlos Bravo and Fred Springer, Evaluation, Management & Training Associates Inc Using Mixed Methods to Examine and Interpret the Impact of a National Science Foundation (NSF) Geosciences MultiInstitution, Multi-site Teacher Professional Development Program Susan Henderson and Dan Mello, WestEd 548 – Roundtable in Mission A Sponsored by the Evaluation Managers and Supervisors TIG Controlling Quality Within Museums: Coordinating Internal Evaluation Departments Sarah Cohn, Science Museum of Minnesota; and Anna Lindgren-Streicher, Museum of Science, Boston 550 - The Adaptive Action Cycle: Bridging the Gap Between Lessons Learned and Lessons Applied Panel to be held in Bowie A Sponsored by the Systems in Evaluation TIG and the Human Services Evaluation TIG Chair and Discussant - Mallary Tytel, Healthy Workplaces A Case Study on Adaptive Action in Education Royce Holladay, Human Systems Dynamics Institute Translating Lessons Learned Into Lessons Applied Mallary Tytel, Healthy Workplaces 551 - Using Evaluation to Enhance Program Participation With Underrepresented Groups in Science, Technology, Engineering and Mathematics (STEM) Fields Multipaper to be held in Bowie B Sponsored by the Multiethnic Issues in Evaluation TIG Chair - Tamara Bertrand Jones, Florida State University Experiences of a Culturally Responsive Evaluator in Analyzing Scientific Self-Efficacy and Scientific Research Proficiency as Benefits of Summer Research Participation for Underrepresented Minorities Frances Carter, University of Maryland, Baltimore County Evaluation 2010: Friday, November 12, 10:55 AM – 11:40 AM Page 98 Enhancing Minority Representation in the Sciences: Results From the Evaluation of the Minority Opportunities in Research (MORE) Programs at Three Universities Simeon Slovacek and Jonathan Whittinghill, California State University, Los Angeles 552 - How Does Evidence Influence Policy Change? Examining Two Complementary Approaches With Two Complementary Evaluations Panel to be held in Bowie C Sponsored by the Advocacy and Policy Change TIG Chair - Carlisle Levine, CARE Discussants - Ehren Reed and Veena Pankaj, Innovation Network Using Complementary Evaluations to Assess Policy Change and Build Internal Advocacy Monitoring Capacity Carlisle Levine, CARE Defining and Evaluating Change Agents/Champions: An Evaluator‘s Perspective Lisa Molinaro and David Devlin-Foltz, Aspen Institute 553 – Roundtable in Goliad Sponsored by the Feminist Issues in Evaluation TIG Incorporating Gender into Mainstream Projects Judith Russell, Independent Consultant; Sathi Dasgupta, SONA Consulting Inc; Ronda Schlagen, Independent Consultant; Jim Rugh, Independent Consultant 554 – Roundtable in San Jacinto Sponsored by the Research on Evaluation TIG Utilizing Metaevaluation to Validate Evaluation Quality: Study of a Grant-Funded Graduate Program for Minority Group Students in Science, Technology, Engineering, and Mathematics (STEM) Angela Watson and Katye Perry, Oklahoma State University 556 - Using Cost --> Procedure --> Process --> Outcome Analysis (CPPOA) Data to Improve Substance Abuse Prevention Programs and Portfolios Panel to be held in Travis B Sponsored by the Costs, Effectiveness, Benefits, and Economics TIG Chair - Michael Langer, State of Washington Discussant - Beverlie Fallik, United States Department of Health and Human Services CPPOA of a Fourth Grade Intervention for Preventing Use of Alcohol, Tobacco, and Other Drugs Brian Yates, American University Secure CPPO Data Sharing Techniques that Efficiently Support Analysis of Substance Abuse Prevention Policies and Portfolios Ron Visscher, Aquinas College 557 - Communication: At What Level Does It Help or Hinder Evaluation Capacity? Multipaper to be held in Travis C Sponsored by the Organizational Learning and Evaluation Capacity Building TIG Chair - Eric Barela, Partners in School Innovation Discussant - Susan Parker, Clear Thinking Communications Communicating Versus Real Work? The Communication Burden on Volunteer Board Members of Growing Evaluation Organizations Williams Benita, Feedback Research & Analytics When a Program Evaluation Goes to a Small Town: Unique Opportunities in Communication, Accessibility, and Decisionmaking Ann G Bessell, Valerntina I Kloosterman, and Sabrina F Sembiante, University of Miami 558 - Is Quality Improvement In Healthcare CostEffective? Expert Lecture to be held in Travis D Sponsored by the Health Evaluation TIG Chair - Mary Gutmann, EnCompass LLC Edward Broughton, University Research Company LLC 559 - None of the Above: Expanding Binary Categorizations Multipaper to be held in Independence Sponsored by the Lesbian, Gay, Bisexual, and Transgender Issues TIG Chair and Discussant- John T Daws, University of Arizona Beyond the Binary: Expanding Our Categories of Gender Identity and Sexual Orientation Linda Drach and Kari Greene, Oregon Public Health Division Queering/ Querying Evaluation: Moving Beyond Political Correctness and the Binary State of Mind Denice Cassaro, Cornell University 560 - Technology and Student Outcomes: Mathematics, Language Arts, and Big-District Diversity Multipaper to be held in Presidio A Sponsored by the Distance Education and Other Educational Technologies TIG Chair - Talbot Bielefeldt, International Society for Technology in Education Classroom Network Technology as a Support for Systemic Mathematics Reform: Examining the Effects of Texas Instruments' MathForward Program on Student Achievement in a Large, Diverse District Corinne Singleton and William R Penuel, SRI International Effects of Fast ForWord Language Computer-based Training Program on Student Performance in a Large Central Florida School District Yakup Bilgili, Polk County Public Schools Evaluation 2010: Friday, November 12, 10:55 AM – 11:40 AM Page 99 Friday, 10:55 am to 11:40 am, continued 561 - Herding Cats: Improving the Quality and Quantity of Decentralized Evaluation in a Global Organization Through Capacity Building Demonstration to be held in Presidio B Sponsored by the Organizational Learning and Evaluation Capacity Building TIG Thea C Bruhn, United States Department of State 562 - Alcohol, Drug Abuse and Mental Health TIG Business Meeting Business Meeting to be held in Presidio C Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG TIG Leaders - Marge Cawley, National Development and Research Institutes (NDRI); and Diana Seybolt, University of Maryland, Baltimore 563 – Roundtable in Bonham A Sponsored by the Business and Industry TIG Assessing Board Performance: Challenges and Constraints Zita Unger, Evaluation Solutions Pty Ltd 564 - Low-cost, High-Quality Assessments for Nonprofit Adolescent Pregnancy Prevention Program Planning Panel to be held in Bonham B Sponsored by the Non-profit and Foundations Evaluation TIG Chair - Shannon Flynn, South Carolina Campaign to Prevent Teen Pregnancy Bread, Milk, Condoms: Using Low-cost Strategies to Assess Youth Experiences with Condom Purchasing in Two Communities Shannon Flynn, Sarah Kershner, and Dana Becker, South Carolina Campaign to Prevent Teen Pregnancy Older Youth Pregnancy Prevention: Using Low-cost Methods to Assess Sexual Health Services in Institutions of Higher Learning and Identify Outreach Opportunities Sarah Kershner, Shannon Flynn, and Mary Prince, South Carolina Campaign to Prevent Teen Pregnancy 565 - Is Working Together Worth It? The Process and Findings of a Longitudinal Evaluation of a Districtwide Professional Learning Community Initiative 566 - Evaluating Education Programs for English Language Learners Multipaper to be held in Bonham D Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Courtney Brown, Indiana University Discussant - Julie Sugarman, Center for Applied Linguistics Multi-dimensional Evaluation of School-wide Intervention for English Language Learners Ginger Gossman, Austin Independent School District Comparative Effectiveness of the Rosetta Stone Dynamic Immersion Program: A Report of a Randomized Experiment Sara Atienza, Sandy Philipose, Xiaohui Zheng, and Denis Newman, Empirical Education Inc 567 - From Research to Commercialization: Impact Evaluation of Portfolios of Research Multipaper to be held in Bonham E Sponsored by the Research, Technology, and Development Evaluation TIG Chair - Israel Lederhendler, National Institutes of Health Tracing From Applied Research Programs to Downstream Applications: Approach and Findings Rosalie Ruegg, TIA Consulting Inc; and Patrick Thomas, 1790 Analytics LLC Evaluating Ohio's Portfolio of Technology Programs David Cheney, Jennifer Ozawa, and Chris Ordowich, SRI International 569 - Evaluating Government Research and Technology Policies: Traditional and Emerging Methods Multipaper to be held in Texas D Sponsored by the Research, Technology, and Development Evaluation TIG Chair - Cheryl Oros, Oros Consulting LLC Quality Evaluations of Government Policies in Research Science and Technology Sector Yelena Thomas, Ministry of Research Science and Technology Applications of Agent-based Simulations in Evaluating Science and Technology Policies Branco Ponomariov, University of Texas, San Antonio; and Craig Boardman, Ohio State University Expert Lecture to be held in Bonham C Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Rebecca Woodland, University of Massachusetts, Amherst Discussant - Mark Zito, East Hartford Public School District Presenter - Rebecca Woodland, University of Massachusetts, Amherst Evaluation 2010: Friday, November 12, 10:55 AM – 11:40 AM Page 100 570 - Joint Evaluation of Private Sector Development Projects: Benefits and Challenges Panel to be held in Texas E Sponsored by the Evaluation Use TIG and the Organizational Learning and Evaluation Capacity Building TIG Chair - Ade Freeman, World Bank Discussant - Cheryl Gray, World Bank Joint Evaluation of Private Sector Development Projects: Methodological Issues Chris Olson, European Bank for Reconstruction and Development Joint Evaluation of Private Sector Development Projects: Practical Applications and Lessons Stephen Pirozzi, World Bank 571 - Using R for Statistical Analysis Demonstration to be held in Texas F Sponsored by the Graduate Student and New Evaluator TIG Kristen Cici, University of Minnesota 572 - The American Evaluation Association's Journal Editors Discuss Publishing in AEA‘s Journals Panel to be held in Crockett A Sponsored by the AEA Conference Committee Chair - Thomas Schwandt, University of Illinois at UrbanaChampaign Publishing in the American Journal of Evaluation Thomas Schwandt, University of Illinois at UrbanaChampaign Publishing in New Directions for Evaluation Sandra Mathison, University of British Columbia 573 - How to Use Evaluation to Achieve Human Resources (HR) System Alignment Demonstration to be held in Crockett B Sponsored by the Business and Industry TIG Stephanie Fuentes, Inventivo Design LLC 574 - Translating Evaluation to Enhance Its Meaning and Use: Examples From Two Indigenous Communities - Urban United States of America and Rural Uganda Multipaper to be held in Crockett C Sponsored by the Indigenous Peoples in Evaluation TIG Chair and Discussant - Joan LaFrance, Mekinak Consulting Indigenous Approaches to Evaluation in Urban Settings: Theory Into Practice Julie Nielsen, NorthPoint Health and Wellness Center Inc The Place-Value of Indigenous Knowledge in a Promoting the Use of Evaluation Findings: A Case Study on Using Qualitative Measures to Assess the (Potential) Impact of Public Works Programmes on the Lives of the Poor and the Vulnerable in a Post-conflict Environment Simon Kisira, Evaluation Resource Group 576 - Using Qualitative Methods in Evaluations With Limited Resources Multipaper to be held in Seguin B Sponsored by the Qualitative Methods TIG Chair and Discussant - Jennifer Jewiss, University of Vermont Surveys: A Tool for Building a Case Study? Natalya Gnedko, Chicago Public Schools; and Denise Roseland, University of Minnesota Are Surveys Enough? A Case Study in Employing User Tests and Focus Groups to Improve Website Evaluation Michael Porter, Dawn Aguero, and Aimee Reist, College Center for Library Automation 577 - Peace Corps‘ Volunteer Reporting Tool: Increasing the Capacity for Evidence-based DecisionMaking at Multiple Levels of the Peace Corps Demonstration to be held in Republic A Sponsored by the International & Cross-cultural Evaluation TIG Eleanor Shirley, Peace Corps 578 - Online Visual System for Strategic Planning and Performance Monitoring: Demonstration to be held in Republic B Sponsored by the Health Evaluation TIG Jianglan White and Alex Cowell, Georgia Department of Community Health 579 - The Basis for Good Judgment in Evaluation Multipaper to be held in Republic C Sponsored by the Theories of Evaluation and the Research on Evaluation TIGs Chair - Bianca Montrosse, Western Carolina University Ensuring Quality in Evaluation by Generating Credible Judgment Marthe Hurteau, Sylvain Houle, Pascal NDinga, Michael Schleifer, Véronique Lemieux, and Marie-Pier Marchand, University of Quebec at Montreal The Goal Standard, and Knowing Enough for Quality Evaluation James Griffith, Claremont Graduate University Evaluation 2010: Friday, November 12, 10:55 AM – 11:40 AM Page 101 Summary of Sessions for Friday, November 12, 1:40 PM to 3:10 PM No Primary Sponsor Session Session Title 582 Presidential Strand Think Tank In the Multi-level Systemic Evaluation Universe, Whose Responsibility is Quality? A Discussion Among Respected Colleagues Lone Star A 583 Systems in Evaluation TIG Skill-building Fitting the Key to the Lock: Matching Systems Methods To Evaluation Questions Lone Star B 584 Collaborative, Participatory & Empowerment Think Tank Youth Participatory Evaluation: Where Are We and Where Do We Go From Here? Lone Star C 585 Non-profit and Foundations Evaluation TIG Panel Helping Nonprofit Agencies Move From Measuring Outcomes to Managing Them: A Budding Success Story… Lone Star D 586 Quantitative Methods: Theory and Design TIG Panel Enhancing the Quality of Evaluations by Rational Planning Lone Star E 587 AEA Conference Committee Think Tank AEA and Public Engagement: How Can AEA‘s Role in Public Engagement Contribute to Evaluation Quality? Lone Star F 588 Evaluation Managers and Supervisors TIG Roundtable Rotation I: Directors of Research Ensuring Quality in Practice Rotation II: Managing Evaluation: Continuing the Conversation Mission A 589 Evaluation Policy TIG Multipaper Evaluation Management Policies: Examining Requirements of Quality Evaluation Mission B 590 Independent Consulting TIG Panel Integrating Management Consulting Competencies into the Evaluation Process Bowie A 591 Multiethnic Issues in Evaluation TIG Panel The Evolution and Revolution of Culturally Responsive Evaluation Bowie B 592 Advocacy and Policy Change TIG Multipaper Health Matters: Evaluating Advocacy and Policy Change Bowie C 593 Teaching of Evaluation TIG Roundtable Rotation I: The Essentials of a Quality Evaluation Capstone Project, Practicum or Internship: Students‘ Perspectives Rotation II: An Evaluation Seminar: How our Students Gain Practical Experience in Evaluation and Research Methodology Goliad 594 Assessment in Higher Education TIG Roundtable Rotation I: Conceptualizing the Quality of Assessment Rotation II: Perspectives on Collaboration in Practice: Expanding the Role and Culture of Assessment in Academic Affairs… San Jacinto 595 Social Network Analysis TIG Multipaper Social Network Analysis Across Disciplines and Purposes Travis A 596 Integrating Technology Into Evaluation Demonstration Multimedia Advances in Evaluation: The Use of Skype, Elluminate, and Virtual World Technologies in Conducting Focus… Travis B 597 Systems in Evaluation TIG Multipaper Real World Applications of System Concepts in Evaluation Travis C 598 Evaluating the Arts and Culture TIG Multipaper Implication of Evaluation Approaches on Arts Organization Policies Travis D 599 Human Services Evaluation TIG Multipaper Interesting Evaluations in Social Services and Welfare Independence 600 Quantitative Methods: Theory and Design TIG Multipaper Structural Equation Modeling Solutions for Evaluators Presidio A 601 Org Learning & Evaluation Capacity Bldg TIG Demonstration Improving the Quality of Analysis, Interpretation, and Reporting of Program Outcomes Through a Measurement, Evaluation… Presidio B 602 Alcohol, Drug Abuse, and Mental Health TIG Panel Assessing Implementation Fidelity of Substance Abuse Prevention Environmental Change Strategies: Lessons Learned… Presidio C 603 Collaborative, Participatory & Empowerment Roundtable Rotation I: Slipping and Sliding Like a Weasel on the Run: Empowerment Evaluation and the Hawthorne Effect Rotation II: Innovations in Youth Empowerment Evaluation Bonham A 604 Non-profit and Foundations Evaluation TIG Panel Improving Evaluation in the Real World of Nonprofits and Foundations Bonham B 605 Pre-K - 12 Educational Evaluation TIG Think Tank Teacher Effectiveness and Teacher Quality: What's the Difference? Bonham C 606 Pre-K - 12 Educational Evaluation TIG Multipaper Fidelity of Program Implementation in Educational Evaluations Bonham D Evaluation 2010: Friday, November 12, 1:40 PM – 3:10 PM Room Page 102 Summary of Sessions for Friday, November 12, 1:40 PM to 3:10 PM, Continued No Primary Sponsor Session Session Title Room 607 Environmental Program Evaluation TIG Multipaper Key Issues in Evaluating Industrial and Commercial Energy Efficiency Programs and Technologies Bonham E 609 Research, Technology, and Development MultiPaper Report on a Test of a General Method for Quick Evaluation of Medical Research by Morbidity Texas D 610 Evaluation Use TIG Think Tank Taking a Good, Long Look In the Mirror: How Can We Hold Ourselves Accountable for Quality Recommendations? Texas E 611 Research on Evaluation TIG Panel Snapshots of Exemplary Evaluations Texas F 612 Extension Education Evaluation TIG Multipaper Extension Educators and Evaluation Crockett A 613 Business and Industry TIG Multipaper Evaluating Effectiveness in Recruitment, Mentoring, and Human Resources' Functions Crockett B 614 International and Cross-cultural Evaluation TIG MultiPaper Impact of Social and Economic Development Interventions: Presentation of Synthetic Reviews of Education, Early Childhood.. Crockett C 615 Government Evaluation TIG Panel Perspectives on Conducting Quality Evaluations at Various Levels of Government Crockett D 616 Qualitative Methods TIG Multipaper Reaching for the Pot of Gold: Tested Techniques for Enhancing Evaluation Quality With Trustworthiness and Authenticity Seguin B 617 International and Cross-cultural Evaluation TIG Panel Building Capacity to Monitor and Evaluate Development Policies, Programs, and Projects: Everyone Wants to do It, but… Republic A 618 Health Evaluation TIG Multipaper Examining Heart Disease and Stroke: Sharing Lessons to Improve Evaluation Quality Republic B 619 Collaborative, Participatory & Empowerment MultiPaper Preliminary Results of Prevention Capacity Building in Science-based Teen Pregnancy, HIV, and STI Prevention Republic C Evaluation 2010: Friday, November 12, 1:40 PM – 3:10 PM Page 103 Friday, 11:50 am to 1:30 pm 580 - American Evaluation Association Awards Luncheon Luncheon to be held in Texas A Hosts - Katherine McKnight, Pearson Corporation; Tarek Azzam, Claremont Graduate University; Leslie Cooksy, University of Delaware Friday, 1:40 pm to 3:10 pm 582 - In the Multi-level Systemic Evaluation Universe, Whose Responsibility is Quality? A Discussion Among Respected Colleagues Think Tank to be held in Lone Star A Sponsored by the Presidential Strand and the Cluster, Multi-site and Multi-level Evaluation TIG Presenter - Kathleen Toms, Research Works Inc Discussants - Sandra Mathison, University of British Columbia; Michael Morris, University of New Haven; Linda E Lee, Proactive Information Services Inc; and Josue De La Rosa, Research Works Inc 583 - Fitting the Key to the Lock: Matching Systems Methods To Evaluation Questions Skill-building Workshop to be held in Lone Star B Sponsored by the Systems in Evaluation TIG Bob Williams, Independent Consultnat 584 - Youth Participatory Evaluation: Where Are We and Where Do We Go From Here? Think Tank to be held in Lone Star C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Presenter - Kim Sabo Flores, Evaluation Access and ActKnowledge Discussants - Jane Powers, Cornell Univeristy; and Katie Richards-Schuster, University of Michigan 585 - Helping Nonprofit Agencies Move From Measuring Outcomes to Managing Them: A Budding Success Story From the United Way of Greater Houston The Exciting Shift From Outcomes Measurement to Outcomes Management: The National, Cross-sectoral Perspective Michael Hendricks, Independent Consultant The United Way of Greater Houston‘s Journey With Outcomes Measurement and Management Amy Corron, United Way of Greater Houston Facilitating the Journey: Making Sense of Outcomes Measurement and Management With Agency Partners Najah Callander, United Way of Greater Houston Helping Similar Agencies Manage Common Outcomes: The Agency Perspective Abeer Monem, Fort Bend County Women's Center Inc 586 - Enhancing the Quality of Evaluations by Rational Planning Panel to be held in Lone Star E Sponsored by the Quantitative Methods: Theory and Design TIG Chair - Frederic Malter, University of Arizona Building Evaluations on Theories and Models Michele Walsh and Lee Sechrest, University of Arizona Design and Methods in the Planning Stage of Evaluation Katherine McKnight, Pearson Corportation What Happens When Measurement Planning Fails Patricia Herman and Mei-kuang Chen, University of Arizona Data Analysis: Forethought, Not Afterthought Patrick McKnight, George Mason University 587 - AEA and Public Engagement: How Can the American Evaluation Association‘s Role in Public Engagement Contribute to Evaluation Quality? Think Tank to be held in Lone Star F Sponsored by the AEA Conference Committee Presenter - Thomaz Chianca, COMEA Evaluation Ltd Discussants - Nicki King, University of California, Davis; and Jim Rugh, Independent Consultant 588 – Roundtables in Mission A The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Evaluation Managers and Supervisors TIG Rotation 1: Managing Evaluation: Continuing the Conversation Donald Compton, Centers for Disease Control and Prevention; Michael Baizerman, University of Minnesota; and Michael Schooley, Centers for Disease Control and Prevention Rotation 2: Directors of Research Ensuring Quality in Practice Colleen Manning, Goodman Research Group Inc Panel to be held in Lone Star D Sponsored by the Non-profit and Foundations Evaluation TIG Chair - Michael Hendricks, Independent Consultant Evaluation 2010: Friday, November 12, 11:50 AM – 1:30 PM, 1:40 PM – 3:10 PM Page 104 589 - Evaluation Management Policies: Examining Requirements of Quality Evaluation Multipaper to be held in Mission B Sponsored by the Evaluation Policy TIG Chair - Lisa Rajigah, International Initiative for Impact Evaluation (3ie) Discussant - Gary Miron, Western Michgian University; and Leslie Fierro, SciMetrika Sustaining School Reform: A Guide to Support Evaluation Policy Louis Cicchinelli and Zoe Barley, Mid-continent Research for Education and Learning Effective Policy in Saudi Arabia's Gifted Organizations Fayez Shafloot, Western Michigan University Blueprint for Quality Evaluation and Quality Services in Human Service Organizations: Why Evaluation Policy Matters Kristin Kaylor Richardson, Western Michigan University Evaluation Policy Inventory Margaret Johnson and William M Trochim, Cornell University Exploring Dueling Federal Funder Preferences and Program Evaluation Needs: Challenges With Conflicting Interests and Evaluator Roles Holly Downs, University of Illinois at Urbana-Champaign 590 - Integrating Management Consulting Competencies into the Evaluation Process Panel to be held in Bowie A Sponsored by the Independent Consulting TIG Chair - Pamela Davidson, University of California, Los Angeles The Evaluator as a Consultant to Management Anthony Raia, University of California, Los Angeles The Consultative Process and the Management of Change Kurt Motamedi, Pepperdine University Consulting Competencies to Expand the Evaluator‘s Role Pamela Davidson, University of California, Los Angeles Looking Within: Expressing Program Stories With Cultural Metaphors Joan LaFrance, Mekinak Consulting Tensions Between What Is Knowable From the Outside and What is Knowable From the Inside Kataraina Pipi, Independent Consultant Responsible Responsiveness in Evaluation: To Whom and to What? Jennifer Greene, Jeehae Ahn, and Ayesha Boyce, University of Illinois at Urbana-Champaign 592 - Health Matters: Evaluating Advocacy and Policy Change Multipaper to be held in Bowie C Sponsored by the Advocacy and Policy Change and the Health Evaluation TIGs Chair - Astrid Hendricks, California Endowment Using Case Studies to Assess Longer: Term Outcomes of Expanded Advocacy Capacity Annette Gardner and Claire Brindis, University of California, San Francisco; Lori Nascimento, California Endowment; and Sara Geierstanger, University of California, San Francisco Employing a Systems Change Framework to Evaluate Health and Education Policy Advocacy in California Mary Kreger, Claire Brindis, Abigial Arons, Gaylen Mohre, Elodia Villasenor, and Katherine Sargent, University of California, San Francisco Sara Truebridge and Bonnie Benard, WestEd; and Mona Jhawar, California Endowment Tracking and Assessing State Policies Related to Food and Active Living Martha Quinn and Carpenter Laurie, University of Michigan Conducting Research to Advance Smoke-Free Air Legislation in Louisiana Jenna Klink, Nikki Lawhorn, and Lisanne Brown, Louisiana Public Health Institute 591 - The Evolution and Revolution of Culturally Responsive Evaluation 593 – Roundtables in Goliad Panel to be held in Bowie B Sponsored by the Multiethnic Issues in Evaluation TIG Chair - Fiona Cram, Katoa Ltd Discussants - Karen E Kirkhart, Syracuse University; and Nan Wehipeihana, Research Evaluation Consultancy Limited Looking Back to Move Forward: The Visual Transition of the African American Culturally Responsive Evaluation System (ACESAS) Logic Model to Enhance Culturally Responsive Evaluation in African American Communities Pamela Frazier-Anderson, Lincoln University; Stafford Hood, University of Illinois at Urbana-Champaign; and Rodney Hopson, Duquesne University Sponsored by the Teaching of Evaluation TIG Rotation 1: The Essentials of a Quality Evaluation Capstone Project, Practicum or Internship: Students‘ Perspective Aubrey W Perry, Portland State University; Robert Tornberg, University of Minnesota; and Veronica Smith, data2insight Rotation 2: An Evaluation Seminar: How Our Students Gain Practical Experience in Evaluation and Research Methodology Jennifer Morrow, Gary Skolits, Thelma Woodard, and Susanne Kaesbauer, University of Tennessee, Knoxville The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Evaluation 2010: Friday, November 12, 1:40 PM – 3:10 PM Page 105 Friday, 1:40 pm to 3:10 pm, continued 594 – Roundtables in San Jacinto The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Assessment in Higher Education TIG Rotation 1: Conceptualizing the Quality of Assessment Steve Culver and Ray Van Dyke, Virginia Tech Rotation 2: Perspectives on Collaboration in Practice: Expanding the Role and Culture of Assessment in Academic Affairs and Student Services in Higher Education Ge Chen, Glen E Baumgart, and R Joseph Rodriguez, University of Texas, Austin 595 - Social Network Analysis Across Disciplines and Purposes Multipaper to be held in Travis A Sponsored by the Social Network Analysis TIG Chair and Discussant - Maryann Durland, Durland Consulting Use of Longitudinal Social Network Analysis: Examining Changes in Networks Among Emerging Leaders in the Ladder to Leadership Program Kimberly Fredericks, The Sage Colleges; Julia JacksonNewsom, University of North Carolina at Greensboro; Heather Champion and Tracy Enright Patterson, Center for Creative Leadership Making Meaning: Participatory Social Network Analysis Susan Connors, Marc Brodersen, Kathryn Nearing, and Bonnie Walters, University of Colorado, Denver Bridges and Barriers to Nurturing Interdisciplinary Research: Evaluating the Social Networks of Integrative Graduate Education and Research Trainees and Their Comparative Peers Over Time Megan Haller and Eric Welch, University of Illinois at Chicago Applying Social Network Analysis to Understand How YouthServing Agencies Collaborate to Connect Youth at Risk of Suicide to Services Anupa Fabian, Elana Light, Christine Walrath-Greene, Robert L Stephens, and Michael S Rodi, ICF Macro A Social Network Perspective for Evaluating Transnational Policy Diffusion: The Case of the Hyogo Framework for Action (HFA) Aileen Lapitan, University of North Carolina at Charlotte 596 - Multimedia Advances in Evaluation: The Use of Skype, Elluminate, and Virtual World Technologies in Conducting Focus Group Interviews Demonstration to be held in Travis B Sponsored by the Integrating Technology Into Evaluation TIG Corliss Brown, Lauren Kendall, Taniya Reaves, Jessica Milton, and Johnavae Campbell, University of North Carolina at Chapel-Hill 597 - Real World Applications of System Concepts in Evaluation Multipaper to be held in Travis C Sponsored by the Systems in Evaluation TIG Chair and Discussant - Janice Noga, Pathfinder Evaluation and Consulting Using Systems Concepts to Evaluate the iPlant Collaborative: Quality, Implications, and Benefits Barbara Heath and Claire Stuebe, East Main Educational Consulting The iPlant Collaborative: Using Case Study Methodology in a Systems-based Framework Claire Stuebe and Barbara Heath, East Main Educational Consulting Evaluating the Tennessee Lives Count Juvenile Justice Suicide Prevention Project: Strategies for Incorporating System Level Data in Evaluations of Complex Public Health Prevention Programs Jennifer Lockman, Heather Wilson, and Kathryn A Bowen, Centerstone Research Institute 598 - Implication of Evaluation Approaches on Arts Organization Policies Multipaper to be held in Travis D Sponsored by the Evaluating the Arts and Culture TIG Chair - Ching Ching Yap, Savannah College of Art and Design Discussant - Don Glass, VSA Mission Conceived Versus Mission Achieved Paul Lorton Jr, University of San Francisco Some Children Left Behind: Policy Implications for Children‘s Museums Providing Educational Services to Minority Youth and Children With Special Needs Deborah A Chapin, Excelsior College; Anna Lobosco, New York State Developmental Disabilities Planning Council; and Dianna L Newman, State University of New York at Albany 599 - Interesting Evaluations in Social Services and Welfare Multipaper to be held in Independence Sponsored by the Human Services Evaluation TIG Chair - Lois Thiessen-Love, Uhlich Children's Advantage Network Come Together Now: Measuring the Level of Collaboration Yvonne Kellar-Guenther and William Betts, University of Colorado, Denver The Use of Time Series Design and Intervention Analysis in Evaluating Welfare Policy Elizabeth Hayden, Northeastern University Evaluation 2010: Friday, November 12, 1:40 PM – 3:10 PM Page 106 600 - Structural Equation Modeling Solutions for Evaluators Multipaper to be held in Presidio A Sponsored by the Quantitative Methods: Theory and Design TIG Chair - Frederick Newman, Florida International Unversity Modeling Reciprocal Relationships Among Program Outcomes Omolola A Adedokun and Timothy J Owens, Purdue University Interpreting Differences in Covariance Structures Among Clinical and Demographic Subgroups for a Model Describing Perceived Barriers to Seeking Help for Abused Elder Women Frederick Newman, Laura Seff, and Richard Bealaurier, Florida International Unversity A Quantile Regression Analysis of Incarcerated Youth‘s Reading Achievement: Compare and Contrast the Ordinary Least Square Regression and Quantile Regression Weijia Ren, Ann O'Connell, William Loadman, and Raeal Moore, The Ohio State University Evaluating Potential Impact of Intervention in Community Settings When No Comparison Data is Available: Mixture Latent Growth Modeling for Exploring Differential Change in Female Condom Use Maryann Abbott, Emil Coman, and Peg Weeks, Institute for Community Research 601 - Improving the Quality of Analysis, Interpretation, and Reporting of Program Outcomes Through a Measurement, Evaluation, and Statistics Training Course Demonstration to be held in Presidio B Sponsored by the Organizational Learning and Evaluation Capacity Building TIG Yvonne Watson, United States Environmental Protection Agency; Tracy Dyke Redmond, Industrial Economics Inc; and Terell Lasane, United States Environmental Protection Agency 602 - Assessing Implementation Fidelity of Substance Abuse Prevention Environmental Change Strategies: Lessons Learned From the Substance Abuse and Mental Health Services Administration (SAMHSA), Center for Substance Abuse Prevention (CSAP), Strategic Prevention Framework State Incentive Grant (SPFSIG), and National Cross-site Evaluation Panel to be held in Presidio C Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG Chair - Kristi Pettibone, National Institute of Environmental Health Sciences A Process for Assessing Implementaion Fidelity for Substance Abuse Prevention Environmental Change Strategies Ann Landy and Elisabeth Cook, Westat Exploring the Relationship Between Implementation Fidelity and Process and Outcome Data to Evaluate the Effectiveness of Environmental Change Strategies Kristi Pettibone, National Institute of Environmental Health Sciences Adaptation of the Strategic Prevention Framework State Incentive Grant (SPF SIG) Implementation Fidelity Assessment User's Guide in Texas Adrian Reyes, Behavioral Assessment Inc 603 – Roundtables in Bonham A The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Rotation 1: Innovations in Youth Empowerment Evaluation Kimberly Kay Lopez, Independent Consultant Rotation 2: Slipping and Sliding Like a Weasel on the Run: Empowerment Evaluation and the Hawthorne Effect Michael Matteson, University of Wollongong 604 - Improving Evaluation in the Real World of Nonprofits and Foundations Panel to be held in Bonham B Sponsored by the Non-profit and Foundations Evaluation TIG Chair - Pamela Imm, University of South Carolina Discussant - Abraham Wandersman, University of South Carolina Intregrating Evaluation Into the Grantmaking Agenda Pamela Imm, University of South Carolina Why and How Should Foundations Engage Skilled, Experienced Program Evaluators in Their Grantmaking? Jan Yost, Health Foundation of Central Massachusetts How Can Foundations Attract and Retain Skilled, Experienced Program Evaluators for Local Projects? Emily Rothman, Boston University 605 - Teacher Effectiveness and Teacher Quality: What's the Difference? Think Tank to be held in Bonham C Sponsored by the Pre-K - 12 Educational Evaluation TIG Presenter - Nathan Balasubramanian, Centennial Board of Cooperative Educational Services Discussants - Nathan Balasubramanian, Centennial Board of Cooperative Educational Services; Joy Perry, Fort Morgan School District; and Roxie Bracken, Keenesburg School District Evaluation 2010: Friday, November 12, 1:40 PM – 3:10 PM Page 107 Friday, 1:40 pm to 3:10 pm, continued 606 - Fidelity of Program Implementation in Educational Evaluations Multipaper to be held in Bonham D Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Javan Ridge, Colorado Springs School District 11 Discussant - Stacey Merola, ICF International Measuring the Fidelity of Implementation of Response to Intervention for Behavior (Positive Behavior Support) Across All Three Tiers of Support Karen Childs, Florida Positive Behavior Support A Practical Approach to Managing Issues in Implementation Fidelity in K–12 Programs Hendrick Ruitman, Rebecca Eddy, and Namrata Mahajan, Cobblestone Applied Research & Evaluation Inc A Study of the Relationship Between Fidelity of Program Implementation and Achievement Outcomes Sarah Gareau, Heather Bennett, Diane Monrad, Tammiee Dickenson, and Tomonori Ishikawa, University of South Carolina Using an Innovation Configuration Map to Empirically Establish Implementation Fidelity of an Intervention to Improve Achievement of Struggling Adolescent Readers Jill Feldman and Ning Rui, Research for Better Schools 607 - Key Issues in Evaluating Industrial and Commercial Energy Efficiency Programs and Technologies Multipaper to be held in Bonham E Sponsored by the Environmental Program Evaluation TIG and the Business and Industry TIG Chair - Mary Sutter, Opinion Dynamics Corporation Evaluation Results Help Programs Cool Off! Lark Lee and Laura Schauer, PA Consulting Group Evaluation of Progress to Develop and Evaluate Sustainable Federal Facilities Dale Pahl, Dan Amon, Bill Ridge, Andy Miller, and Bob Thompson, United States Environmental Protection Agency Why Market Evaluations Matter! Significantly Improving Energy Program Outcomes With Market Intelligence in the Large Commercial Building Sector John Reed, Innovologie LLC When Designing a High Quality Evaluation Involves Complex and Evolving Program Issues: Strategies From an Evaluation of an Industrial Process Energy Efficiency Program Kara Crohn and Marjorie McCrae, Research Into Action 609 - Report on a Test of a General Method for Quick Evaluation of Medical Research by Morbidity MultiPaper to be held in Texas D Sponsored by the Research, Technology, and Development Evaluation TIG and the Health Evaluation TIG Chair - Jerald Hage, University of Maryland A Method for Quick Evaluation of Medical Research Jerald Hage, University of Maryland A Quick Evaluation of Alzheimer‘s Disease Research Amber Nelson, University of Maryland A Quick Evaluation of Breast Cancer Research J Alice Nixon, University of Maryland A Quick Evaluation of Colorectal Cancer Research Joseph Waggle, University of Maryland 610 - Taking a Good, Long Look In the Mirror: How Can We Hold Ourselves Accountable for Quality Recommendations? Think Tank to be held in Texas E Sponsored by the Evaluation Use and the Organizational Learning and Evaluation Capacity Building TIGs Presenter - Jennifer Iriti, University of Pittsburgh Discussants - Jennifer Iriti, University of Pittsburgh Kari Nelsestuen, Education Northwest 611 - Snapshots of Exemplary Evaluations Panel to be held in Texas F Sponsored by the Research on Evaluation TIG Chair - Paul Brandon, University of Hawaii Discussant - Paul Brandon, University of Hawaii Informing Policy in a Cultural Crossfire: The Title V Abstinence Education Evaluation Christopher Trenholm and Barbara Devaney, Mathematica Policy Research Exemplariness as Engaging and Value-added Evaluation Melanie Hwalek, SPEC Associates Curbing Home Health Care Costs While Improving Quality of Care George Grob, Center for Public Program Evaluation Exemplary Evaluations: Characteristics, Conditions, and Considerations Nick Smith and Leigh M Tolley, Syracuse University Did you know? AEA365 is a service that sends a tipa-day by and for evaluators right to your email. Want to subscribe? Go to eval.org and you‘ll find subscriptions options on the left-hand column. Evaluation 2010: Friday, November 12, 1:40 PM – 3:10 PM Page 108 612 - Extension Educators and Evaluation Multipaper to be held in Crockett A Sponsored by the Extension Education Evaluation TIG Chair - Karen Ballard, University of Arkansas Beyond reporting: Do Extension Educators Use the Results of Evaluations? Sarah Baughman and Heather Boyd, Virginia Polytechnic Institute and State University; and Nancy Franz, Virginia Tech Program Evaluation Competencies of Extension Educators: Implications for Professional Development Megan McClure, Texas A&M University; and Nick Fuhrman and Chris Morgan, University of Georgia Online Learning Circles: Building Evaluation Capacity Out of Thin Air Benjamin Silliman, North Carolina State University 613 - Evaluating Effectiveness in Recruitment, Mentoring, and Human Resources' Functions Multipaper to be held in Crockett B Sponsored by the Business and Industry TIG Chair - Ray Haynes, Indiana University Ascertaining the Comparative Yields of Alternate Methods of Employment Recruitment: A Management Application of Empirical Assessment Techniques Ann Breihan, College of Notre Dame of Maryland Developmental Network Mentoring: A Logic Model Approach to Evaluating This Form of Organizational Mentoring Ray Haynes, Indiana University; and Rajashi Ghosh, Drexel University An Historical Study of Effectiveness of Taiwanese Companies' Human Resources (HR) Functions in China Chien Yu, National Taiwan Normal University 614 - Impact of Social and Economic Development Interventions: Presentation of Synthetic Reviews of Education, Early Childhood Development and Agricultural Extension Programs in Developing Countries MultiPaper to be held in Crockett C Sponsored by the International & Cross-cultural Evaluation TIG Chair - Marie Gaarder, International Initiative for Impact Evaluation (3ie) The Impact of Agricultural Extension Services Hugh Waddington, Birte Snilstveit, and Howard White, International Initiative for Impact Evaluation (3ie); and Jock Anderson, World Bank The Effects of K-12 School Enrollment Policies in Developing Countries Anthony Petrosino and Claire Morgan, WestEd; and Robert F Boruch, University of Pennsylvania The Impact of Daycare Programs on Child Health, Nutrition and Development in Developing Countries Paola Gadsden, Instituto Nacional de Salud Publica 615 - Perspectives on Conducting Quality Evaluations at Various Levels of Government Panel to be held in Crockett D Sponsored by the Government Evaluation TIG Chair - Rakesh Mohan, Idaho State Legislature Discussant - Kathryn Newcomer, George Washington University Quality Standards in International Development Evaluation Patrick Grasso, World Bank A Pragmatic Approach to Ensuring Quality in County Government Evaluation David J Bernstein, Westat Rigorous Evaluation and City Government: Examples From New York City's Center for Economic Opportunity Kathryn Henderson, Debra Rog, and Jennifer Hamilton, Westat 616 - Reaching for the Pot of Gold: Tested Techniques for Enhancing Evaluation Quality With Trustworthiness and Authenticity Multipaper to be held in Seguin B Sponsored by the Qualitative Methods TIG Chair and Discussant - Eric Barela, Partners in School Innovation Lessons Learned From Planning and Conducting Site Visits Mika Yamashita, Academy for Educational Development A Recipe for Success: Lessons Learned for Using Qualitative Methods Across Project Teams Nicole Leacock, Stephanie Herbers, Nancy Mueller, Virginia Houmes, Lana Wald, and Eric Ndichu, Washington University in St Louis Applications of Credibility Techniques to Promote Trustworthiness of Findings in a Qualitative Program Evaluation: A Demonstration John Hitchcock, Jerry Johnson, and Bonnie Prince, Ohio University Did you know? AEA‘s members have free electronic access from the AEA website to over 20 years of articles from the American Journal of Evaluation, New Directions for Evaluation, Evaluation Review, and Evaluation in the Health Professions. Evaluation 2010: Friday, November 12, 1:40 PM – 3:10 PM Page 109 Friday, 1:40 pm to 3:10 pm, continued 617 - Building Capacity to Monitor and Evaluate Development Policies, Programs, and Projects: Everyone Wants to do It, but How Should It Be Done to Ensure High Quality? Panel to be held in Republic A Sponsored by the International & Cross-cultural Evaluation TIG Chair - Linda Morra Imas, World Bank Evaluation Capacity Building: Lessons Learned From the Field in Botswana Robert Lahey, REL Solutions Inc Evaluation Capacity Building in the International Context: View From the Academy Robert Shepherd, and Susan Phillips, Carleton University Building Capacity in Development Evaluation: The International Program in Development Evaluation Training Linda Morra Imas, World Bank Regional Centers for Evaluation Capacity Development Nidhi Khattri, World Bank 618 - Examining Heart Disease and Stroke: Sharing Lessons to Improve Evaluation Multipaper to be held in Republic B Sponsored by the Health Evaluation TIG Chair - Cindy Wong, Bradeis University Evaluating a Statewide Health System Improvement Effort: Reducing Time to Treatment for Heart Attack and Stroke Patients Megan Mikkelsen, Washington State Department of Health Assuring Quality in the Design of a Multi-state Surveillance Evaluation Monica Oliver and Rachel Barron-Simpson, Centers for Disease Control and Prevention Outcome Measurement in Health Evaluation: Evaluation of the Heart & Stroke Foundation of Ontario‘s (HSFO) Hypertension Management Initiative (HMI) Shirley Von Sychowski, Heart and Stroke Foundation of Ontario Evaluation at the Community Level: The Importance of Quality Aisha Tucker Brown and Alberta Mirambeau, Centers for Disease Control and Prevention 619 - Preliminary Results of Prevention Capacity Building in Science-based Teen Pregnancy, HIV, and STI (Sexually Transmitted Infections) Prevention MultiPaper to be held in Republic C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Chair - Duane House, Centers for Disease Control and Prevention Discussant - Thomas Chapel, Centers for Disease Control and Prevention Capacity Change Over Time: Is Prevention Capacity and Capacity Utilization Changing Across Local Partners? Duane House and Catherine Lesesne, Centers for Disease Control and Prevention Understanding Changes in Capacity to Use Science-based Approaches Over Time Jennifer Duffy, Mary Prince, Erin Johnson, Chris Rollison, and Forrest Alton, South Carolina Campaign to Prevent Teen Pregnancy Telling the Massachusetts Alliance Story: A Community Case Study on Local Capacity Building Jessica Waggett, Omonyele Adjognon, and Elisa Friedman, Institute for Community Health; and Erica Fletcher and Consuela Greene, Massachusetts Alliance on Teen Pregnancy Measuring and Understanding Promoting Science-Based Approaches (PSBA) Local Capacity Building Afsaneh Rahimian, LaJuana Johnson, Kirsten Harris-Tally, John Perkins, Jeana Johnson, and April Pace, Center for Health Training Resource Group Evaluation 2010: Friday, November 12, 1:40 PM – 3:10 PM Page 110 Notes: Evaluation 2010: Friday, November 12, 1:40 PM – 3:10 PM Page 111 Summary of Sessions for Friday, November 12, 3:35 PM to 4:20 PM No Primary Sponsor Session Session Title Room 622 Presidential Strand Think Tank Exploring the Intersection of Beauty and Quality With the Student Travel Award Winners Lone Star A 623 Program Theory and Theory-driven Evaluation Multipaper Using Quantitative Analyses in the Development and Testing of Theories of Change Lone Star B 624 Collaborative, Participatory & Empowerment Expert Lecture Rights-based Evaluation and Active Citizenship in Development Contexts Lone Star C 625 Non-profit and Foundations Evaluation TIG Panel Communities of Practice (CoP) as a Foundation Strategy Lone Star D 626 Quantitative Methods: Theory and Design TIG Demonstration Using Regression Discontinuity Designs for Program Evaluation Lone Star E 627 Cluster, Multi-site & Multi-level Evaluation TIG Multipaper Exemplars of School Evaluations Lone Star F 628 Lesbian, Gay, Bisexual, Transgender Issues TIG Roundtable Improving the Quality of Evaluations That Include LGBT: Tools for the Evaluator? Mission A 629 Social Work TIG Multipaper Program Fidelity and Development in Social Work Mission B 630 Systems in Evaluation TIG MultiPaper The Role of Collaboratives in Promoting Community and Systems Changes Bowie A 631 Multiethnic Issues in Evaluation TIG Demonstration How Well Are We Addressing Asthma Disparities? Demonstration of a New Evaluation Toolkit Bowie B 632 AEA Conference Committee Panel High Flexibility and Low Fidelity: The Challenges of Evaluating Highly Adaptable Programs Bowie C 633 Government Evaluation TIG Roundtable Celebrating Government Evaluation: Forging Links Among Research, Policy Decisions, and Evaluation to Protect Air Quality Goliad 634 Evaluating the Arts and Culture TIG Roundtable The Evolution of Integrating Arts-based Inquiry in Evaluation San Jacinto 635 Assessment in Higher Education TIG Expert Lecture Compared to What? Reconsidering Assessment in Higher Education Travis A 636 Integrating Technology Into Evaluation TIG Panel Using New Technologies to Support Evaluation Quality and Organizational Learning Travis B 637 Org Learning & Evaluation Capacity Bldg TIG Demonstration Creating Statewide Guidelines for Twenty First Century Community Learning Centers' Local Evaluation Travis C 638 Health Evaluation TIG Demonstration Is Your Program Sustainable? A Practical Tool for Evaluating Sustainability Travis D 639 Lesbian, Gay, Bisexual, Transgender Issues TIG Panel Nerd Activism: Using Data as the Vehicle for Community Mobilization Independence 640 Distance Ed. & Other Educational Technologies Think Tank Digital Media and Learning for Youth: What Do They Know, When Do They Know It, How Do We Evaluate It? Presidio A 641 Org Learning & Evaluation Capacity Bldg TIG Multipaper Engaging Practitioners in the Medical Field to Build Evaluation Capacity Presidio B 642 Alcohol, Drug Abuse, and Mental Health TIG Demonstration Building a Flexible, Web-based Analysis Tool to Examine Person Level Changes Over Time in a Mental Health Outcomes… Presidio C 643 Pre-K - 12 Educational Evaluation TIG Roundtable The Cost of Delayed Start: Effect of Early Algebra on End of High School, Transition to College, and End-of-College STEM… Bonham A 645 Pre-K - 12 Educational Evaluation TIG Multipaper Meta-reviews in Rural Education and Reading Interventions Bonham C 646 Pre-K - 12 Educational Evaluation TIG MultiPaper Applying Evaluation to Improve Learning Outcomes: Scaling Up From Small Schools to a Million Students Bonham D 647 Environmental Program Evaluation TIG Multipaper Improving the Quality of Habitat and Biodiversity Conservation Program Evaluations Using Methodological and Budgetary… Bonham E 649 Research, Technology, and Development Demonstration Assessing Faculty Productivity and Institutional Research Performance: Using Publication and Citation Key Performance… Texas D Evaluation 2010: Friday, November 12, 3:35 PM – 4:20 PM Page 112 Summary of Sessions for Friday, November 12, 3:35 PM to 4:20 PM, Continued No Primary Sponsor Session Session Title Room 650 Evaluation Use TIG Demonstration Moving Beyond the Weighty Tome: New Approaches to Reporting Evaluation Findings Texas E 651 Evaluation Policy TIG Expert Lecture Introduction to Evaluation and Public Policy Texas F 652 Extension Education Evaluation TIG Demonstration Program Evaluation Network: Capacity and Creativity for Multi-Site Program Evaluation Crockett A 653 Business and Industry TIG Expert Lecture Small Business Sustainability: A Systems Approach to Triple Bottom Line Success Crockett B 654 Indigenous Peoples in Evaluation TIG Multipaper Understanding Indigenous Higher Education Expenses: Innovative Evaluations From New Zealand and Hawaii Crockett C 655 Government Evaluation TIG Expert Lecture A Theory Driven Multi-year Strategic Evaluation Plan for a Multi-program Government Agency Crockett D 656 Graduate Student and New Evaluator TIG Multipaper Advancing the Field of Evaluation Seguin B 657 International and Cross-cultural Evaluation TIG Multipaper Evaluation Capacity Building in International Contexts Republic A 658 Health Evaluation TIG Multipaper Health Care Delivery, Effectiveness, and Reform: Where to Go From Here? Republic B 659 Business and Industry TIG Multipaper Risk and Tension in Private Sector Development Project Evaluation Republic C Evaluation 2010: Friday, November 12, 3:35 PM – 4:20 PM Page 113 Friday, 3:35 pm to 4:20 pm 622 - Exploring the Intersection of Beauty and Quality With the Student Travel Award Winners Think Tank to be held in Lone Star A Sponsored by the Presidential Strand Chair - Leslie Cooksy, University of Delaware Presenters - Jeehae Ahn, University of Illinois at Urbana-Champaign; Stephanie Coleman, University of Missouri; Brandi Gilbert, University of Colorado, Boulder; Douglas Grane, University of Iowa; and Han-yun Tseng, Washington State University 623 - Using Quantitative Analyses in the Development and Testing of Theories of Change Multipaper to be held in Lone Star B Sponsored by the Program Theory and Theory-driven Evaluation TIG Chair - John Gargani, Gargani + Company Assessing a Theory of Change for the Choice to Be Sexually Abstinent: Testing a Conceptual Model of Behavior Choices Among Adolescents Amy Laura Arnold, Virginia Dick, Ann Peisher, University of Georgia; Robetta McKenzie, Katrina Aaron, Augusta Partnership for Children Inc; and Don Bower, University of Georgia Quantitative Content Analysis for Developing a Competitive Grant‘s Program Theory From its Request Applications Elena Polush and Carl Roberts, Iowa State University 624 - Rights-based Evaluation and Active Citizenship in Development Contexts Expert Lecture to be held in Lone Star C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Chair - Robert Stake, University of Illinois at UrbanaChampaign Saville Kushner, University of the West of England 625 - Communities of Practice (CoP) as a Foundation Strategy Panel to be held in Lone Star D Sponsored by the Non-profit and Foundations Evaluation TIG Chair - Tania Jarosewich, Censeo Group Discussant - Nushina Mir, Lumina Foundation for Education Framework for Analyzing CoP in Foundation-led Initiatives Tania Jarosewich, Censeo Group Assessing the Value of a Learning Community Strategy: An Evaluation Framework Informed by Realistic Evaluation and Systems Thinking Ruth Mohr, SPEC Associates 626 - Using Regression Discontinuity Designs for Program Evaluation Demonstration to be held in Lone Star E Sponsored by the Quantitative Methods: Theory and Design TIG Joseph Stevens and Keith Zvoch, University of Oregon; and Drew Braun, Bethel School District 627 - Exemplars of School Evaluations Multipaper to be held in Lone Star F Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG Chair - Rene Lavinghouze, Centers for Disease Control and Prevention Correlates of Perceived Effectiveness of the Safe Schools and Healthy Students Initiative Bruce Ellis, Ping Yu, and Aaron Alford, Battelle Memorial Institute; Danyelle Mannix, United States Department of Health and Human Services; and Sharon Xiong, Battelle Memorial Institute County-level Versus State-level Results: Is It Worth the Effort? Susan Saka, University of Hawaii, Manoa 628 – Roundtable in Mission A Sponsored by the Lesbian, Gay, Bisexual, and Transgender Issues TIG Improving the Quality of Evaluations That Include Lesbian, Gay, Bisexual and Transgender People (LGBT): Tools for the Evaluator? Kathleen McKay, Connecticut Children's Medical Center; Joe E Heimlich, Ohio State University; and John T Daws, University of Arizona 629 - Program Fidelity and Development in Social Work Multipaper to be held in Mission B Sponsored by the Social Work TIG Chair - Sarita Davis, Georgia State University Evaluating the Renewal and Evolution of a Behavioral Intervention Modality David Wright and Darryl Jinkerson, Abilene Christian University The Development and Standardization of a Parent Partner Fidelity Tool for Use in Wraparound Program Evaluation Margaret Polinsky, Parents Anonymous Inc 630 - The Role of Collaboratives in Promoting Community and Systems Changes MultiPaper to be held in Bowie A Sponsored by the Systems in Evaluation TIG Chair - Evelyn Yang, Community Anti-Drug Coalitions of America Evaluation 2010: Friday, November 12, 3:35 PM – 4:20 PM Page 114 Evaluation of a Model to Build Effective Community Coalition Change Agents for Substance Abuse Prevention Evelyn Yang, Community Anti-Drug Coalitions of America; Pennie Foster-Fishman and Erin Watson, Michigan State University; and Jane Callahan, Community Anti-Drug Coalitions of America Building an Effective Early Childhood System: Evaluating the Role of Early Childhood Collaboratives and Parent Coalitions Pennie Foster-Fishman, Michigan State University; Joan M Blough, Great Start Early Childhood Investment Corporation; and Charles Collins, Jennifer Mortensen, Hope Gerde, and Jennifer Watling Neal, Michigan State University 636 - Using New Technologies to Support Evaluation Quality and Organizational Learning 631 - How Well Are We Addressing Asthma Disparities? Demonstration of a New Evaluation Toolkit 637 - Creating Statewide Guidelines for Twenty First Century Community Learning Centers' Local Evaluation Demonstration to be held in Bowie B Sponsored by the Multiethnic Issues in Evaluation TIG Robin Shrestha-Kuwahara and Maureen Wilce, Centers for Disease Control and Prevention 632 - High Flexibility and Low Fidelity: The Challenges of Evaluating Highly Adaptable Programs Panel to be held in Travis B Sponsored by the Integrating Technology Into Evaluation TIG Chair - Lynn McCoy, Pact Inc Discussant - John Talieri, Pact Inc Challenges and Lessons in Conducting Quality Evaluation of the Short Message Service (SMS) Technology Maeve B de Mello, Pact Inc Integrating Technology to Maximize Evaluation Quality and Organizational Learning Mary Ngugi, Pact Inc Demonstration to be held in Travis C Sponsored by the Organizational Learning and Evaluation Capacity Building TIG Wendy Tackett, iEval; and Laurie VanEgeren, Michigan State University Panel to be held in Bowie C Sponsored by the AEA Conference Committee Chair - Ann House, SRI International Discussant - Leslie Goodyear, National Science Foundation Focusing on Quality: Designing Research for an Adaptable Program Ann House, SRI International Finding the Core: Evaluating a Distributed Program Sophia Mansori, Education Development Center 638 - Is Your Program Sustainable? A Practical Tool for Evaluating Sustainability 633 – Roundtable in Goliad Panel to be held in Independence Sponsored by the Lesbian, Gay, Bisexual, and Transgender Issues TIG Chair - Kari Greene, Oregon Public Health Division Developing a Community Needs Assessment by Consensus: Why is Our Evaluator Tearing Her Hair Out? Linda Drach, Oregon Public Health Division Coalitions Built Through Data: How a Survey Engaged a Community Kari Greene, Oregon Public Health Division Sponsored by the Government Evaluation TIG Celebrating Government Evaluation: Forging Links Among Research, Policy Decisions, and Evaluation to Protect Our Nation's Air Quality Dale Pahl, United States Environmental Protection Agency 634 – Roundtable in San Jacinto Sponsored by the Evaluating the Arts and Culture TIG The Evolution of Integrating Arts-based Inquiry in Evaluation April Munson, Kennesaw State University 635 - Compared to What? Reconsidering Assessment in Higher Education Expert Lecture to be held in Travis A Sponsored by the Assessment in Higher Education TIG Gary Brown, Washington State University Demonstration to be held in Travis D Sponsored by the Health Evaluation TIG Nancy Mueller, Stephanie Herbers, and Sarah Schell, Washington University in St Louis 639 - Nerd Activism: Using Data as the Vehicle for Community Mobilization 640 - Digital Media and Learning for Youth: What Do They Know, When Do They Know It, How Do We Evaluate It? Think Tank to be held in Presidio A Sponsored by the Distance Education and Other Educational Technologies TIG Kristin Bass, Rockman et al Discussant s - Elizabeth Bandy, Brianna Scott, and Jennifer Borland, Rockman et al Evaluation 2010: Friday, November 12, 3:35 PM – 4:20 PM Page 115 Friday, 3:35 pm to 4:20 pm, continued 641 - Engaging Practitioners in the Medical Field to Build Evaluation Capacity Multipaper to be held in Presidio B Sponsored by the Organizational Learning and Evaluation Capacity Building TIG Chair - Cynthia Tananis, University of Pittsburgh Evaluation Capacity Building Writ Large Marla Steinberg and Diane Finegood, The CAPTURE Project Context and Considerations of Evaluating a Health Professional Capacity-Building Program in Vietnam Katherine Williams, Meiwita Budiharsana, Quoc Mai Tung, and John Townsend, Population Council 642 - Building a Flexible, Web-based Analysis Tool to Examine Person Level Changes Over Time in a Mental Health Outcomes Measurement System Demonstration to be held in Presidio C Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG Tim Santoni and Qiang Qian, University of Maryland 643 – Roundtable in Bonham A Sponsored by the Pre-K - 12 Educational Evaluation TIG The Cost of Delayed Start: Effect of Early Algebra on End of High School, Transition to College, and End-of-College Science, Technology, Engineering, and Mathematics (STEM) Participation Xiaoxia Newton, Rosario Rivero, and Anthony Kim, University of California, Berkeley Chair - Michael Furlong, University of California, Santa Barbara Improving Individual Student Performance in Schools in United States Schools Through Response to Intervention (RTI) Framework Matthew Quirk, University of California, Santa Barbara Evaluation as a Tool to Ensure Performance of 1,000,000 Students in India: Lessons Learned and Road Ahead Prashant Rajvaidya, Mosaic Network Inc 647 - Improving the Quality of Habitat and Biodiversity Conservation Program Evaluations Using Methodological and Budgetary Techniques Multipaper to be held in Bonham E Sponsored by the Environmental Program Evaluation TIG Chair - Gitanjali Shrestha, Washington State University Improving Impact Evaluations of Biodiversity Conservations Projects Clemencia Vela, Independent Consultant A Mixed Methods Approach to Evaluating Multi-site Habitat Protection Programs Mark Braza and Michael Krafve, United States Government Accountability Office 649 - Assessing Faculty Productivity and Institutional Research Performance: Using Publication and Citation Key Performance Indicators Demonstration to be held in Texas D Sponsored by the Research, Technology, and Development Evaluation TIG Ann Kushmerick, Thomson Reuters 645 - Meta-reviews in Rural Education and Reading Interventions 650 - Moving Beyond the Weighty Tome: New Approaches to Reporting Evaluation Findings Multipaper to be held in Bonham C Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Meltem Alemdar, Georgia Institute of Technology An Evaluation of the Quality of Rural Education Research: 2006 to Present Zoe Barley and Louis Cicchinelli, Mid-continent Research for Education and Learning Reviewing Systematic Reviews: Meta-analysis of What Works Clearinghouse Computer-Assisted Reading Interventions Andrei Streke and Tsze Chan, American Institutes for Research 651 - Introduction to Evaluation and Public Policy 646 - Applying Evaluation to Improve Learning Outcomes: Scaling Up From Small Schools to a Million Students Demonstration to be held in Texas E Sponsored by the Evaluation Use TIG and the Integrating Technology Into Evaluation TIG Eric Graig, Usable Knowledge LLC Expert Lecture to be held in Texas F Sponsored by the Evaluation Policy and the Government Evaluation TIGs Chair - Stephanie Shipman, United States Government Accountability Office Presenter - George Grob, Center for Public Program Evaluation MultiPaper to be held in Bonham D Sponsored by the Pre-K - 12 Educational Evaluation TIG Evaluation 2010: Friday, November 12, 3:35 PM – 4:20 PM Page 116 652 - Program Evaluation Network: Capacity and Creativity for Multi-Site Program Evaluation 657 - Evaluation Capacity Building in International Contexts Demonstration to be held in Crockett A Sponsored by the Extension Education Evaluation TIG Joseph Donaldson, University of Tennessee Multipaper to be held in Republic A Sponsored by the International & Cross-cultural Evaluation TIG Chair - Nicole Lewis, University of Kentucky Capacity Building in Monitoring and Evaluation: A Real Challenge for Afghan Ministry of Education, International Donors, and Evaluation Community Mohammad Javad and Sharon Rallis, University of Massachusetts, Amherst Practical Roles for Evaluation Partners: Challenges to and Opportunities for Evaluation Quality When Evaluation Responsibilities are Shared With Clients Patty Hill, EnCompass LLC 653 - Small Business Sustainability: A Systems Approach to Triple Bottom Line Success Expert Lecture to be held in Crockett B Sponsored by the Business and Industry TIG Mallary Tytel, Healthy Workplaces 654 - Understanding Indigenous Higher Education Expenses: Innovative Evaluations From New Zealand and Hawaii Multipaper to be held in Crockett C Sponsored by the Indigenous Peoples in Evaluation TIG Chair and Discussant - Katherine A Tibbetts, Kamehameha Schools E Tu Kahikatea, Stand Tall Kahikatea: Evaluation of One of the World's Largest Indigenous-Led Tertiary Education Providers, Te Wânanga o Aotearoa Andrea Knox, Counterbalance Research and Evaluation; Shaun Akroyd, Akroyd Research and Evaluation; Fraser Sloane, Sloane Walker Ltd; and Chantalle Ngapo, Te Wananga o Aotearoa Relevance, Relationship, and Reciprocity: Evaluating the Role of Non-Academic Factors in Improving Native Hawaiian Students‘ College Retention Anna Ah Sam, University of Hawaii, Manoa 655 - A Theory Driven Multi-year Strategic Evaluation Plan for a Multi-program Government Agency Expert Lecture to be held in Crockett D Sponsored by the Government Evaluation TIG Chair - Gretchen Jordan, Sandia National Laboratories Presenters - John Reed, Innovologie LLC 656 - Advancing the Field of Evaluation Multipaper to be held in Seguin B Sponsored by the Graduate Student and New Evaluator TIG Chair - A Rae Clementz, University of Illinois at UrbanaChampaign Metaphors, Models, and Analogies as the Tools for Constructing Understandings in an Evaluation A Rae Clementz, University of Illinois at UrbanaChampaign Moving From Outputs to Outcomes and Impact: Accountability and Evaluation Quality Korinne Chiu and Kelly Graves, University of North Carolina at Greensboro 658 - Health Care Delivery, Effectiveness, and Reform: Where to Go From Here? Multipaper to be held in Republic B Sponsored by the Health Evaluation TIG Chair - Michael Harnar, Claremont Graduate University Evaluating Health Insurance Outreach and Enrollment Efforts Associated With Massachusetts Health Care Reform Linda Cabral, Christine Clements, Michael Tutty, Ellen Bhang, and Kathy Muhr, University of Massachusetts Changing Nature of Healthcare Performance Measurement David Mohr, Katerine Osatuke, and Thomas Brassell, United States Department of Veterans Affairs 659 - Risk and Tension in Private Sector Development Project Evaluation Multipaper to be held in Republic C Sponsored by the Business and Industry TIG Chair - Zita Unger, Evaluation Solutions Pty Ltd The Whole is Greater Than the Sum of Parts: Program Evaluation of the Chad Cameroon Petroleum Development and Pipeline Program Cherian Samuel, International Finance Corporation Adjusting Development Outcomes by Riskiness of Private Sector Investment Projects: Risk-Adjusted Expected Development Outcome Hiroyuki Hatashima, International Finance Corporation Evaluation 2010: Friday, November 12, 3:35 PM – 4:20 PM Page 117 Summary of Sessions for Friday, November 12, 4:30 PM to 6:00 PM No Primary Sponsor Session Session Title Room 662 Presidential Strand Panel Evaluation Anthropology Praxis Today: Building the Future Lone Star A 663 Systems in Evaluation TIG Panel Systems Perspectives on Using Logic Models to Improve Evaluation Quality Lone Star B 664 Collaborative, Participatory & Empowerment Demonstration The Evaluative Journey: Implementing Evaluation Activities That Faciliate Ongoing Decision Making Lone Star C 665 Non-profit and Foundations Evaluation TIG Panel Multiple Sites, Multiple Layers, Multiple Players: Lessons From the Field on Keeping Quality High and Frustration Low Lone Star D 666 Quantitative Methods: Theory and Design TIG Panel The Case for Brief(er) Measures Lone Star E 667 Cluster, Multi-site & Multi-level Evaluation TIG Skill-building Evaluation 201: Evaluation Skills Needed After Coursework Lone Star F 668 Mixed Methods Evaluation TIG Roundtable Rotation I: Examining Collaboration in an Evaluation of a Large Scale Civic Education Program Rotation II: Using Mixed Methods to Evaluate a School Based Civic Engagement Initiative Mission A 669 Disabilities and Other Vulnerable Populations MultiPaper Evaluating Community Capacity Building as a Prevention Strategy Mission B 670 Independent Consulting TIG MultiPaper Evaluation Opportunities Within a National Science Foundation (NSF) Program Bowie A 671 Multiethnic Issues in Evaluation TIG MultiPaper Practicing Culturally Responsive Evaluation: Graduate Education Diveristy Intership (GEDI) Program Intern Reflections… Bowie B 672 Crime and Justice TIG Multipaper Evaluations of Court and Corrections Programs Bowie C 673 Graduate Student and New Evaluator TIG Roundtable Rotation I: My First Year as an Internal Evaluator: What I Didn't Know That I Didn't Know Rotation II: Evaluator/Practitioner Collaborations Goliad 674 Assessment in Higher Education TIG Roundtable Rotation I: Accreditation as a Pathway to Build Community and Generate Renewal Rotation II: Using Evaluation to Help Transform Departments in the Challenging Economic Environment of Higher Education San Jacinto 675 Social Network Analysis TIG Demonstration How to Cast Your Net: Network Analysis Techniques in Public Health Evaluation Travis A 676 Costs, Effectiveness, Benefits, and Economics Multipaper Methodological Considerations: Choosing an Appropriate Cost Analysis Methodology for the Evaluation Travis B 677 Evaluation Use TIG Panel From Compliance to Reliance: Critical Moments in Integrating Evaluation Into an Organization‘s Work Travis C 678 Health Evaluation TIG Multipaper Working Together and Getting the Message Heard in Teen Pregnancy Prevention Programs Travis D 679 Human Services Evaluation TIG Think Tank Beyond Fidelity: Evaluating the Implementation of Evidence-based Practices Independence 680 Quantitative Methods: Theory and Design TIG Demonstration Basic Change: Examining a Simple Design From Multiple Approaches Presidio A 681 Org Learning & Evaluation Capacity Bldg TIG Demonstration Using the Comprehensive Organizational Assessment Tool to Diagnose and Evaluate Organizational Capacity Presidio B 682 Alcohol, Drug Abuse, and Mental Health TIG Panel National Evaluation of the Addiction Technology Transfer Center Network (ATTC): Findings and Observations… Presidio C 683 Pre-K - 12 Educational Evaluation TIG Roundtable Rotation I: Evaluating K-12 Professional Development: Implementation of the Sheltered Instruction Observation… Rotation II: School Climate: A Comprehensive Data Collection and School Improvement System Bonham A 684 Non-profit and Foundations Evaluation TIG Multipaper Making Sense of the Relationships Between Nonprofits, Funders, and Evaluation Bonham B 685 Pre-K - 12 Educational Evaluation TIG Multipaper Current Issues in Evaluating High School Programs Bonham C Evaluation 2010: Friday, November 12, 4:30 PM – 6:00 PM Page 118 Summary of Sessions for Friday, November 12, 4:30 PM to 6:00 PM, Continued No Primary Sponsor Session Session Title Room 686 Pre-K - 12 Educational Evaluation TIG MultiPaper Improving Evaluation Quality: A Focus on Better Measures of Implementation Bonham D 687 Environmental Program Evaluation TIG Panel The Environmental Evaluators Network: Quality in an Era of Results-based Performance Bonham E 689 Research, Technology, and Development Think Tank Your Input, Please: Research, Technology and Development (RTD) Topical Interest Group (TIG) Draft User‘s Guide… Texas D 690 Evaluation Use TIG Panel Strategy as Evaluand: Quality and Utilization Issues in Evaluating Strategy Texas E 691 Research on Evaluation TIG Multipaper Research on Data Collection Approaches Texas F 692 Extension Education Evaluation TIG MultiPaper Building Capacity for the 4-H Science, Engineering, and Technology Initiative to Get to Outcomes Crockett A 693 Teaching of Evaluation TIG Multipaper Teaching Through an Interdisciplinary Focus Crockett B 694 International and Cross-cultural Evaluation TIG Skill-building Data Collection Instruments for Quality Evaluation Crockett C 695 Government Evaluation TIG Multipaper Collaboration in Government-Sponsored Evaluations Crockett D 696 Feminist Issues in Evaluation TIG Multipaper Theorectical Issues in Feminist Evaluation Seguin B 697 International and Cross-cultural Evaluation TIG Multipaper Export and Translation: Evaluating the Sharing of People, Programs, and Instruments Across Borders Republic A 698 Health Evaluation TIG Multipaper Improving Evaluations of Nutrition, Physical Activity, & Obesity Programs Through Schools, Providers, and Statewide Efforts Republic B 699 Collaborative, Participatory & Empowerment Panel Technical Assistance in Action: How Does the Practice Look? Republic C Evaluation 2010: Friday, November 12, 4:30 PM – 6:00 PM Page 119 Friday, 4:30 pm to 6:00 pm 662 - Evaluation Anthropology Praxis Today: Building the Future Panel to be held in Lone Star A Sponsored by the Presidential Strand Chair - Jacqueline Copeland-Carson, Copeland Carson & Associates Discussants - David Fetterman, Fetterman & Associates; and Rodney Hopson, Duquesne University Ethnography and Mental Health Consumers Charity Goodman, United States Department of Health and Human Services What Evaluation Anthropologists Bring to the Party: A Systems Approach to Context Michael D Lieber and Eve Pinsker, University of Illinois at Chicago Making Evaluation Real: Incorporating Praxis Into Graduate Study of Evaluation Anthropology Mary Odell Butler, University of Maryland 663 - Systems Perspectives on Using Logic Models to Improve Evaluation Quality Panel to be held in Lone Star B Sponsored by the Systems in Evaluation TIG and the Program Theory and Theory-driven Evaluation TIG Chair - Patricia Rogers, Royal Melbourne Institute of Technology A Systems Perspective on Evaluation Quality and Logic Models Bob Williams, Independent Consultant Representing Simple, Complicated and Complex Aspects in Logic Models for Evaluation Quality Patricia Rogers, Royal Melbourne Institute of Technology Changing Institutional Approaches to Using Logic Models Richard Hummelbrunner, OEAR Regional Development Consultants 664 - The Evaluative Journey: Implementing Evaluation Activities That Faciliate Ongoing Decision Making Demonstration to be held in Lone Star C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Paul St Roseman, DataUse Consulting Group 665 - Multiple Sites, Multiple Layers, Multiple Players: Lessons From the Field on Keeping Quality High and Frustration Low Panel to be held in Lone Star D Sponsored by the Non-profit and Foundations Evaluation TIG Chair - Jacqueline WIlliams Kaye, Atlantic Philanthropies Leveraging the Opportunity in Having Multiple Evaluation Teams Jacqueline Williams Kaye, Atlantic Philanthropies; Steven LaFrance, Learning for Action Group; Stephen Baker, Chapin Hall; and Malu Gonzalez, University of Texas, El Paso Aligning Interests, Needs and Methods: Managing Cross-site Evaluation Meridith Polin, Public/Private Ventures Evaluator Capacity and Evaluation Quality in a Multi-site National Initiative Scott Hebert, Sustained Impact; and Thomas Kelly, Annie E Casey Foundation 666 - The Case for Brief(er) Measures Panel to be held in Lone Star E Sponsored by the Quantitative Methods: Theory and Design TIG Chair - Lee Sechrest, University of Arizona Single Item Measures Lee Sechrest, University of Arizona Very Brief Scales: Carved Out Scales Patrick McKnight, George Mason University Abbreviated Omnibus Measures Mei-kuang Chen, University of Arizona 667 - Evaluation 201: Evaluation Skills Needed After Coursework Skill-building Workshop to be held in Lone Star F Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG Martha Ann Carey, Maverick Solutions; and Molly Engle, Oregon State University 668 – Roundtables in Mission A The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Mixed Methods Evaluation TIG and the Collaborative, Participatory & Empowerment Evaluation TIG Rotation 1: Examining Collaboration in an Evaluation of a Large Scale Civic Education Program Liliana Rodriguez-Campos, Connie Walker-Egea, and Michael Berson, University of South Florida Rotation 2: Using Mixed Methods to Evaluate a School Based Civic Engagement Initiative Michael Berson, Liliana Rodriguez-Campos, and Aarti P Bellara, University of South Florida 669 - Evaluating Community Capacity Building as a Prevention Strategy MultiPaper to be held in Mission B Sponsored by the Disabilities and Other Vulnerable Populations TIG Chair - Laura Leviton, Robert Wood Johnson Foundation Evaluation 2010: Friday, November 12, 4:30 PM – 6:00 PM Page 120 Community Capacity and Evaluation Carter Roeber and Niel Tashima, LTG Associates Inc Building Community Capacity in Immigrant Faith-based Communities: How Can We Tell? Mimi Kim, Korean Community Center of East Bay Intimate Partner Violence Prevention at the Community Level: Turning Practice Into Evidence Alberto Bouroncle and Cathleen Crain, LTG Associates Inc 670 - Evaluation Opportunities Within a National Science Foundation (NSF) Program MultiPaper to be held in Bowie A Sponsored by the Independent Consulting TIG Chair - Arlen Gullickson, Western Michigan University Discussant - Peter Saflund, The Saflund Institute Wanted: Evaluators! Lori Wingate, Western Michigan University Ten-year Trends in Evaluation Practice in an NSF Program Stephanie Evergreen and Carl Westine, Western Michigan University Evaluating in the Community College Context Peggie Weeks, Western Michigan University; and Peter Saflund, The Saflund Institute Evaluation Challenges and Innovations in NSF-Funded Advanced Technological Education Centers Amy Gullickson, Western Michigan University 671 - Practicing Culturally Responsive Evaluation: Graduate Education Diveristy Intership (GEDI) Program Intern Reflections on the Role of Competence, Context, and Cultural Perceptions MultiPaper to be held in Bowie B Sponsored by the Multiethnic Issues in Evaluation TIG Chair - Rita O'Sullivan, University of North Carolina at Chapel-Hill Discussant - Michelle Jay, University of South Carolina Being Culturally Responsive in the Digital World Larry Daffin, New York University Strategies for Developing a Culturally Responsive Logic Model Lisa Aponte-Soto, University of Illinois at Chicago Considering Culture in the Development, Implementation, and Interpretation of Focus Groups With Homeless Families Jessica Johnson, Virginia Commonwealth University Examining the Sustainability of Campus Suicide Prevention Programs Through a Cultural Lens Karen Anderson, Clark Atlanta University An Intern‘s Perspective: Fostering Culturally Responsive Evaluators of Color Through The Academic Pipeline Soria E Colomer, University of Georgia 672 - Evaluations of Court and Corrections Programs Multipaper to be held in Bowie C Sponsored by the Crime and Justice TIG Chair - Roger Przybylski, RKC Group An Innovative and Efficient Propensity Score Methodology for Evaluating OVI Courts Robert Seufert and Kaitlin Kubilius, Miami University Evaluation of Family Strengthening Services to Incarcerated Fathers and Their Partners Christine Lindquist, Anupa Bir, Tasseli McKay, and Hope Smiley-McDonald, RTI International Implementation Evaluation of a Reading Intervention Program for Incarcerated Youth Deborah Kwon, Raeal Moore, and William Loadman, The Ohio State University Using Logistic Regression to Predict Incarcerated Youth‘s Reading Proficiency Jing Zhao, William Loadman, Raeal Moore, Weijia Ren, Deborah Kwon, and Charles Okonkwo, The Ohio State University 673 – Roundtables in Goliad Roundtable to be held in Goliad The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Graduate Student and New Evaluator and the Collaborative, Participatory & Empowerment Evaluation TIGs Rotation 1: My First Year as an Internal Evaluator: What I Didn't Know That I Didn't Know Pamela Bishop, University of Tennessee, Knoxville Rotation 2: Evaluator/Practitioner Collaborations Angela Moore and Winnie Reed, National Institute of Justice; Carolyn Block, Illinois Criminal Justice Information Authority; and Deshonna Collier-Goubil, National Institute of Justice 674 – Roundtables in San Jacinto Roundtable to be held in San Jacinto The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Assessment in Higher Education TIG Rotation 1: Accreditation as a Pathway to Build Community and Generate Renewal Lorna Escoffery, Escoffery Consulting Collaborative Inc Rotation 2: Using Evaluation to Help Transform Departments in the Challenging Economic Environment of Higher Education Sabra Lee, Lesley University; and Ellen Iverson, Carleton College Evaluation 2010: Friday, November 12, 4:30 PM – 6:00 PM Page 121 Friday, 4:30 pm to 6:00 pm, continued 675 - How to Cast Your Net: Network Analysis Techniques in Public Health Evaluation Demonstration to be held in Travis A Sponsored by the Social Network Analysis TIG Lana Wald, Bobbi Carothers, and Douglas Luke, Washington University in St Louis; and Jenine Harris, Saint Louis University 676 - Methodological Considerations: Choosing an Appropriate Cost Analysis Methodology for the Evaluation Multipaper to be held in Travis B Sponsored by the Costs, Effectiveness, Benefits, and Economics TIG Chair - Nadini Persaud, University of the West Indies Sacrifices Must Be Made: Methodological Choices on a Shoestring Cost-Benefit Analysis Budget Jeffrey Prottas and Melanie Gaiser, Brandeis University Getting to Impact for a Know Thyself Leader Development Program Stacey Farber, Scott Steel, Daniel McLinden, Britteny Howell, and Janet Matulis, Cincinnati Children's Hospital Medical Center Economic Analyses in Program Evaluation: First Approximations When Economists are Late on the Scene Mustafa Karakus, Westat 677 - From Compliance to Reliance: Critical Moments in Integrating Evaluation Into an Organization‘s Work Panel to be held in Travis C Sponsored by the Evaluation Use TIG and the Organizational Learning and Evaluation Capacity Building TIG Chair - Jennifer Iriti, University of Pittsburgh Evaluator Perspective Jennifer Iriti, University of Pittsburgh; and Catherine A Nelson, Independent Consultant Organization Leader Perspective Mary Hicks, Boundless Readers Program Implementer Perspective Nancy Plaskett, Chicago Children's Museum Program Funder Perspective Regina Dixon-Reeves, Lloyd A Fry Foundation 678 - Working Together and Getting the Message Heard in Teen Pregnancy Prevention Programs Multipaper to be held in Travis D Sponsored by the Health Evaluation TIG Chair - Robert LaChausse, California State University, San Bernardino Reactance to Sexual Abstinence Education: A Method of Assessment Ann Peisher, Amy Laura Arnold, Marcus Coleman, and Virginia Dick, University of Georgia; Robetta McKenzie, Augusta Partnership for Children Inc; Don Bower, University of Georgia; and Katrina Aaron, Augusta Partnership for Children Inc Effectiveness and Utilization of a Parent Education Curriculum: A Two-Level Evaluation of Educators and Parents Sheetal Malhotra, Medical Institute for Sexual Health; Diane Santa Maria, University of Texas; Melissa Steiner, Medical Institute for Sexual Health Evaluating Healthy Girls: Working With Community Organizations to Design a City-wide Teen Pregnancy Prevention Evaluation Jessica Rice and Melissa Lemke, University of Wisconsin; and Nicole Angresano and Julie Rothwell, United Way of Greater Milwaukee Labor Pains: The Challenges of Developing an Evaluation Instrument for a City-wide Teen Pregnancy Prevention Evaluation Jessica Rice and Melissa Lemke, University of Wisconsin; and Nicole Angresano and Julie Rothwell, United Way of Greater Milwaukee 679 - Beyond Fidelity: Evaluating the Implementation of Evidence-based Practices Think Tank to be held in Independence Sponsored by the Human Services Evaluation TIG Miles McNall, Michigan State University 680 - Basic Change: Examining a Simple Design From Multiple Approaches Demonstration to be held in Presidio A Sponsored by the Quantitative Methods: Theory and Design TIG Julius Najab, George Mason University; Caroline Wiley, University of Arizona; Simone Erchov, George Mason University 681 - Using the Comprehensive Organizational Assessment Tool to Diagnose and Evaluate Organizational Capacity Demonstration to be held in Presidio B Sponsored by the Organizational Learning and Evaluation Capacity Building TIG Ashley Kasprzak and Randi Nelson, JVA Consulting LLC Evaluation 2010: Friday, November 12, 4:30 PM – 6:00 PM Page 122 682 - National Evaluation of the Addiction Technology Transfer Center Network (ATTC): Findings and Observations From a Contextually Rich, Mixed Method Evaluation Study Panel to be held in Presidio C Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG Chair - Roy Gabriel, RMC Research Corporation Substance Abuse and Mental Health Services Administration (SAMHSA), Center for Substance Abuse Treatment (CSAT) Overview of the ATTC Network and the Importance of Evaluation Deepa Avula, United States Department of Health and Human Services Planning and Partnering Study: Overview and Key Findings Margaret Gwaltney and Cori Sheedy, Abt Associates Inc Customer Satisfaction and Benefit Study: Overview and Key Findings Andrea Muse, Megan Cummings, Cliff Chamberlin, and Richard Finkbiner, MANILA Consulting Group Inc Change in Practice Study: Overview and Key Findings Jeffrey Knudsen, RMC Research Corporation Key Findings, Decisions and Challenges Accompanying the National ATTC Evaluation Roy Gabriel, RMC Research Corporation 683 – Roundtables in Bonham A Sponsored by the Pre-K - 12 Educational Evaluation TIG Rotation 1: Evaluating K-12 Professional Development: Implementation of the Sheltered Instruction Observation Protocol (SIOP) Model Michelle Bakerson, Indiana University South Bend Rotation 2: School Climate: A Comprehensive Data Collection and School Improvement System Barbara Dietsch, Sandy Sobolew-Shubin, Rebeca Cerna, and Greg Austin, WestEd 684 - Making Sense of the Relationships Between Nonprofits, Funders, and Evaluation Multipaper to be held in Bonham B Sponsored by the Non-profit and Foundations Evaluation TIG Chair - Salvatore Alaimo, Grand Valley State University The Relationship Between Evaluation Quality and Use: A Foundation‘s Perspective Rosanna Tran, California HealthCare Foundation Theory Usage in Nonprofit and Foundation Evaluation: Theorists, Funders and Recipient Perspectives Anne Hewitt, Seton Hall University; and Charles Gasper, Missouri Foundation for Health The Role of the Funder in Evaluation Capacity Building for Nonprofit Human Services Organizations Salvatore Alaimo, Grand Valley State University Fostering and Measuring Nonprofit Networks to Inform Grantmaking Decisions Patricia Zerounian, Monterey County Health Department; Janet Shing and Jeff Bryant, Community Foundation for Monterey County; and Krista Hanni, Monterey County Health Department 685 - Current Issues in Evaluating High School Programs Multipaper to be held in Bonham C Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Manolya Tanyu, Learning Point Associates Discussant - Eric Barela, Partners in School Innovation Increasing the Volume of Student Voice: Perceptions of Personalization in High Poverty/Minority Schools Sabrina F Sembiante, Ann G Bessell, and Cathleen Armstead, University of Miami The Evaluation of a Model for Alternative Education Jessaca Spybrook, Margaret Richardson, and James Henry, Western Michigan University Cognitive Labs to Evaluate Test Items for Use on an Alternate Assessments Based on Modified Academic Achievement Standards (AA-MAS) Tammiee Dickenson, Karen Price, Heather Bennett, and Joanna Gilmore, University of South Carolina Assessing the Effectiveness of a School Connectedness Scale for Evaluation Jill Lohmeier, University of Massachusetts, Lowell; and Steven Lee, University of Kansas 686 - Improving Evaluation Quality: A Focus on Better Measures of Implementation MultiPaper to be held in Bonham D Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Helene Jennings, ICF Macro Measuring the Quality of Implementation of Online Learning Games in Instruction Shani Reid, ICF Macro Studying Implementation Fidelity Using Qualitative Methods in a Study of READ 180 Emily Rosenthal, Berkeley Policy Associates; Savitha Moorthy, SRI International; and Hannah Betesh, Berkeley Policy Associates Assessing the Quality of Collaboration Among Community Partners Allan Porowski and Dan Cantillon, ICF International Evaluation 2010: Friday, November 12, 4:30 PM – 6:00 PM Page 123 Friday, 4:30 pm to 6:00 pm, continued 687 - The Environmental Evaluators Network: Quality in an Era of Results-based Performance Panel to be held in Bonham E Sponsored by the Environmental Program Evaluation TIG Chair - Matt Keene, United States Environmental Protection Agency Discussant - Kathryn Newcomer, George Washington University The Environmental Evaluators Network and Improving the Quality of Evaluation at the United States Environmental Protection Agency (EPA) Matt Keene and Katherine Dawes, United States Environmental Protection Agency Lessons Learned From the First Five Years of the Environmental Evaluators Network Matt Birnbaum, National Fish and Wildlife Foundation In Search of Quality and a Commitment to Evaluation: The Environmental Evaluators Network and the National Oceanic and Atmospheric Administration (NOAA) Kate Barba, Cassandra Barnes, and Ginger Hinchcliff, National Oceanic and Atmospheric Administration 689 - Your Input, Please: Research, Technology and Development (RTD) Topical Interest Group (TIG) Draft User‘s Guide to Conducting Research and Development Evaluation Think Tank to be held in Texas D Sponsored by the Research, Technology, and Development Evaluation TIG Presenter - Gretchen Jordan, Sandia National Laboratories Discussant - Brian Zuckerman, Science and Technology Policy Institute; Cheryl Oros, Oros Consulting LLC; Juan Rogers, School of Public Policy Georgia Institute of Technology; and George Teather, George Teather and Associates 690 - Strategy as Evaluand: Quality and Utilization Issues in Evaluating Strategy Panel to be held in Texas E Sponsored by the Evaluation Use, and the Organizational Learning and Evaluation Capacity Building, and the Nonprofit and Foundations Evaluation TIGs Chair - Michael Quinn Patton, Utilization-Focused Evaluation Evaluating Strategy: Issues in Treating Strategy as the Evaluand Michael Quinn Patton, Utilization-Focused Evaluation Strategy Evaluation Case Example: A Retrospective Strategy Evaluation of a 20-year Philanthropic Grant Program Patricia Patrizi, Patrizi & Associates Experience From the International Development Research Centre in Doing and Using Strategic Evaluation Tricia Wind, International Development Research Centre An Experiment in Evaluating Strategy: The WK Kellogg Foundation‘s Devolution Initiative Kay Sherwood, Independent Consultant 691 - Research on Data Collection Approaches Multipaper to be held in Texas F Sponsored by the Research on Evaluation TIG Chair - Leslie Fierro, SciMetrika On the Other Side of Recruitment: Participant Perceptions of Risk During Disclosure for Biomedical Research Jonathan Rubright, Pamela Sankar, and Jason Karlawish, University of Pennsylvania Inclusion of People with Disabilities in Evaluation Practice Miriam Jacobson, Claremont Graduate University Using Norm-based Appeals to Increase Response-Rate in Evaluation Research: A Field Experiment Anne Heberger, National Academy of Sciences; and Shalini Misra and Daniel Stokols, University of California, Irvine 692 - Building Capacity for the 4-H Science, Engineering, and Technology Initiative to Get to Outcomes MultiPaper to be held in Crockett A Sponsored by the Extension Education Evaluation TIG Chair - Suzanne Le Menestrel, United States Department of Agriculture Discussant - Martin Smith, University of California, Davis The Power of Process Evaluation in Science, Engineering, and Technology Programs Melissa Cater, Louisiana State University What Have We Learned? Results From the Process Evaluation of the 4-H Science, Engineering, and Technology Initiative Suzanne Le Menestrel, United States Department of Agriculture; Jill Walahoski, University of Nebraska, Lincoln; and Monica Mielke, Policy Studies Associates Measuring Science Processing Skills in Middle School Youth: The Science Process Skill Inventory (SPSI) Mary Arnold, Oregon State University Evaluation 2010: Friday, November 12, 4:30 PM – 6:00 PM Page 124 693 - Teaching Through an Interdisciplinary Focus 696 - Theorectical Issues in Feminist Evaluation Multipaper to be held in Crockett B Sponsored by the Teaching of Evaluation TIG Chair - Linda Schrader, Florida State University Discussant - Jean A King, University of Minnesota Study of the Process and Effects of the Evaluation Fellows Program Jean A King, Robert Tornberg, and Jeanne Zimmer, University of Minnesota Evaluation Training: Characteristics and Context in Educational Administration Programs Tara Shepperson, Eastern Kentucky University Finding Solutions: How Small Non-governmental Organization's (NGOs) Can Partner With Universities to Overcome Evaluation Challenges Tim Heaton, Kendal Blust, and Matt Cox, Brigham Young University Multipaper to be held in Seguin B Sponsored by the Feminist Issues in Evaluation TIG Chair - Kathryn A Bowen, Centerstone Research Institute Discussant - Michael Bamberger, Independent Consultant The Role of Black Feminist Theory in Feminist Evaluation Sarita Davis, Georgia State University Standpoint Theory(ies): A Pathway to Incorporating Social Justice Into the Evaluation Process Denice Cassaro, Cornell University; and Divya Bheda, University of Oregon The Believer‘s Calling from a Gender Perspective: Evaluating Presbyterian Church (United States of America) Participation in the United Nations Commission on the Status of Women Fifty-Fourth Annual Conference Cathryn Surgenor, New York Theological Seminary 694 - Data Collection Instruments for Quality Evaluation 697 - Export and Translation: Evaluating the Sharing of People, Programs, and Instruments Across Borders Skill-building Workshop to be held in Crockett C Sponsored by the International & Cross-cultural Evaluation TIG Chung Lai and Mamadou Sidibe, International Relief & Development 695 - Collaboration in Government-Sponsored Evaluations Multipaper to be held in Crockett D Sponsored by the Government Evaluation TIG and the Collaborative, Participatory & Empowerment Evaluation TIG Chair - Maria Whitsett, Moak, Casey and Associates Some Evidence on Challenges in Government/Stakeholder Partnerships: A Case Study of the Voluntary Sector Initiative (VSI) and Networks Caroline DeWitt, Human Resources and Skills Development Assessing More Than Mortar and Bricks: Combining Research, Theory, Politics, and Chaos in a HOPE VI Community Revitalization Program Evaluation Andrew Scott Ziner, Atlantic Social Research Corporation; and Ross Koppel, University of Pennsylvania An Assessment of the Impact of Proactive Community Partnerships on Census Quality Edward Kissam, JBS International Inc; Jesus MartínezSaldaña, Independent Consultant; Anna Garcia, Independent Consultant; and JoAnn Intili, JBS International Inc The Effects of Qualitative Feedback on Mid-Managers‘ Improvement on Performance Behaviors in the Veterans Health Administration Thomas Brassell, Boris Yanovsky, Katerine Osatuke, and Sue R Dyrenforth, United States Department of Veterans Affairs Multipaper to be held in Republic A Sponsored by the International & Cross-cultural Evaluation TIG Chair - Mary Crave, University of Wisconsin Evaluating the Effectiveness of Short Term Humanitarian Trips to Another Country Christi Delgatty, Texas State University Complexities of the Transition Framework: A Case Study of a Civic Education Export Natalia Glebova, University of Massachusetts, Amherst The Effect of Translation on Evaluation Instruments: Multiple Group Confirmatory Factor Analysis (MGCFA) and Multiple Indicators, Multiple Causes (MIMIC) Models Outcomes Fatma Ayyad and Brooks Applegate, Western Michigan University Did you know? AEA has 45 Topical Interest Groups (TIGs) that span the breadth and depth of the field. Each convenes a review team to review session proposals and then sponsors a strand of sessions within the conference program. Evaluation 2010: Friday, November 12, 4:30 PM – 6:00 PM Page 125 Friday, 4:30 pm to 6:00 pm, continued 698 - Improving Evaluations of Nutrition, Physical Activity, and Obesity Programs Through Schools, Providers, and Statewide Efforts Multipaper to be held in Republic B Sponsored by the Health Evaluation TIG Chair - Jenica Huddleston, University of California, Berkeley Early Indicators of Success With the Use of the Electronic Medical Record (EMR) for Implementation of Expert Committee Recommendations on Childhood Overweight in Delaware Gregory Benjamin, Vonna Drayton, Denise Hughes, and Jia Zhao, Nemours Health and Prevention Services A National Strategy to Enhance Quality State Evaluations: The Case of the Division of Nutrition, Physical Activity and Obesity Donald Compton, Centers for Disease Control and Prevention; Michael Baizerman, University of Minnesota; and Rosanne Farris, Centers for Disease Control and Prevention 2009 Delaware Child Care Provider Survey: Exploring the Relationship Between Awareness, Policies, and Practices and Behaviors Tiho Enev, and Alex Camacho, Nemours Health and Prevention Services Mixed Method Evaluation of a Multi-district Physical Education Curriculum Intervention Randy Knuth, Knuth Research Inc; and Bob Lutz, Gonzaga University Measuring Technical Assistance Influence Using Project Activity Networks Peter Kreiner, Brandeis University Effectiveness of the Getting to Outcomes (GTO) Technical Assistance Model to Reduce Underage Drinking Pamela Imm and Annie Wright, University of South Carolina; and Matthew Chinman, RAND Corporation Friday, 6:30 pm to 8:00 pm Evening Reception and Silent Auction Special event to be held in the Texas Ballroom Admission to the Reception and Silent Auction is included in the conference registration. All attendees are encouraged to attend, to bid on the many donated items from around the world, and to build your professional network in this social setting. Proceeds from the silent auction go to fund travel awards for evaluators from developing countries. 699 - Technical Assistance in Action: How Does the Practice Look? Panel to be held in Republic C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Chair - Pamela Imm, University of South Carolina Literature Review on Proactive Technical Assistance Systems in Community Settings Jason Katz and Abraham Wandersman, University of South Carolina Notes From the Field: Lessons Learned From Using a Participatory Approach to Evaluation Jessica Waggett, Emily Chiasson, Elisa Friedman, and Karen Hacker, Institute for Community Health Helping Practitioners Use Data for Planning and Evaluation Jane Powers, Cornell University Training and Technical Assistance to Build Capacity of Mental Health in Laos Paul Florin, University of Rhode Island Evaluation 2010: Friday, November 12, 4:30 PM – 6:00 PM, 6:30 PM – 8:00 PM Page 126 Saturday, November 13, 2010: Overview of Schedule 7:00 am to 5:00 pm Registration Desk Open 8:00 am to 9:30 am Concurrent Conference Sessions 10:00 am to 10:45 am Concurrent Conference Sessions 10:55 am to 12:25 pm Concurrent Conference Sessions 12:35 pm to 1:30 pm Lunch Break and TIG Meeting 1:40 pm to 2:25 pm Concurrent Conference Sessions 2:50 pm to 4:20 pm Concurrent Conference Sessions 4:30 pm to 5:30 pm Closing Plenary My Schedule and Notes: Evaluation 2010: Saturday, November 13, Overview Page 127 Summary of Sessions for Saturday, November 13, 8:00 AM to 9:30 AM No Primary Sponsor Session Session Title Room 702 Presidential Strand Panel Design Thinking: The Art of Evaluation Lone Star A 703 Program Theory and Theory-driven Evaluation Panel Theory of Change Online: Implications for Participatory Planning and Evaluation Using Technology Lone Star B 704 Collaborative, Participatory & Empowerment MultiPaper Training in Evaluation: Formal and Informal Capacity Building Lone Star C 705 Non-profit and Foundations Evaluation TIG Demonstration Foundation Effectiveness: Aligning Impact Strategy and Evaluation Lone Star D 706 Quantitative Methods: Theory and Design TIG Demonstration Applications of Multiple Regression for Evaluators Lone Star E 707 Cluster, Multi-site & Multi-level Evaluation TIG Panel The Process of Evaluating Supporting Partnerships to Assure Ready Kids (SPARK) and Ready Kids Follow-Up (RKF)… Lone Star F 708 Human Services Evaluation TIG Roundtable Rotation I: Measuring Success: Applying Short-Term Indicators to Measure Long-Term Success in Human Capital… Rotation II: How to Maintain Evaluation Quality in a Changing Environment: The Importance of Mixed Methods Mission A 709 Evaluation Policy TIG Panel From Deliverables to Strategies: Experience of Implementing a National Evaluation Policy via Statewide Asthma Programs Mission B 710 Systems in Evaluation TIG MultiPaper Framework for Orchestrating Systems Transformation: Theory and Practice for Promoting Dynamic Systems Change Bowie A 711 Advocacy and Policy Change TIG Multipaper Where Theory Meets Practice in Assessing Advocacy and Policy Change Bowie C 712 International and Cross-cultural Evaluation TIG Roundtable Rotation I: Improving Methods of Inquiry in Evaluation Practice: Issues and Recommendations to Incorporate Diverse… Roundtable II: Investing in Long Term Capacity Building Initiatives for African-based Graduates and Professionals… Goliad 713 Internal Evaluation TIG Roundtable Rotation I: Internal Evaluation: How to Keep the Fox Out of the Hen House Rountable Rotation II: The Internal Evaluator's Dual Role as Project Manager and Evaluator: Lessons Learned… San Jacinto 714 Assessment in Higher Education TIG Skill-building Leading Change Through Assessment Travis A 715 Integrating Technology Into Evaluation TIG Demonstration Fewer Errors and Faster Results: How to Automate Production of Tables and Reports with Software You Already Own Travis B 716 Multiethnic Issues in Evaluation TIG Think Tank Evaluating Social Change Programs: How Does a Culturally Responsive Approach Apply? Travis C 717 Health Evaluation TIG Panel Moving Towards Improving the Quality of Our Evaluations: Approaches and Lessons Learned From Comprehensive Cancer… Travis D 718 Human Services Evaluation TIG Panel Using Geographic Information Systems (GIS) to Enhance the Quality and Validity of Evaluations in Human Services Independence 719 Quantitative Methods: Theory and Design TIG MultiPaper A Practical Comparison of Longitudinal Data Analysis Methods Presidio A 720 Org Learning & Evaluation Capacity Bldg TIG Panel Measuring Evaluation Capacity to Enhance Quality of ECB Activities in Federal Pubilc Health and Systemic Change Programs Presidio B 721 Alcohol, Drug Abuse, and Mental Health TIG Panel Taking Stock of the Quality of Evaluation Research on School-Based Prevention Programs Presidio C 722 Collaborative, Participatory & Empowerment Roundtable Rotation I: Wearing Different Hats: The Multiple Roles of an Evaluator Rotation II: Valuing Stakeholders: Collaborative Evaluation of Professional Development Needs Bonham A 723 Non-profit and Foundations Evaluation TIG Panel Beauty is in the Eye of the Beholder: Rationalizing Evaluation Needs Amongst Foundation Boards, Staff, and the Nonprofits… Bonham B 724 Pre-K - 12 Educational Evaluation TIG Skill-building Systems and Logic Models as Complementary Tools for Educational Evaluation Evaluation 2010: Saturday, November 13, 8:00 AM – 9:30 AM Bonham C Page 128 Summary of Sessions for Saturday, November 13, 8:00 AM to 9:30 AM, Continued No Primary Sponsor Session Session Title Room 725 Pre-K - 12 Educational Evaluation TIG Panel Classroom Observations: Lessons Learned About Five Protocols From Five Multi-site Education Evaluations Bonham D 726 Research, Technology, and Development Panel Interim Evaluation: The Quality of Research and the Quality of Evaluation - Case Study of the FP7 Interim Evaluation Bonham E 727 Government Evaluation TIG Panel Use of Evaluation: Overcoming the Challenges Texas A 729 Mixed Methods Evaluation TIG MultiPaper A Mixed Methods Assessment of the Impact of Three Dropout Prevention Strategies on Student Academic Achievement… Texas C 730 Research, Technology, and Development Panel Metrics for the National Institute of Environmental Health Science (NIEHS): Measuring Outcomes to Advance Partnerships… Texas D 731 Evaluation Use TIG Demonstration Strategies for Developing Evaluation Capacity in Educational Partnerships Texas E 732 Research on Evaluation TIG Multipaper Studies of Evaluation Practice Across Multiple Contexts Texas F 733 Extension Education Evaluation TIG Demonstration Mapping Extension‘s Networks: Using Social Network Analysis to Explore Extension Outreach Crockett A 734 Teaching of Evaluation TIG Demonstration Critical Concepts for Introductory Evaluation Courses: Multiple Perspectives – Part 2 Crockett B 735 International and Cross-cultural Evaluation TIG Panel The Role of Monitoring in Evaluation Quality Crockett C 736 Government Evaluation TIG Panel Infusing Evaluation Theory Into Practice in Government Safety Programs: Process Examples From the US Dept of Transport… Crockett D 737 Graduate Student and New Evaluator TIG Panel Emerging Evaluators and the Future of Culturally Responsive Evaluation Seguin B 738 International and Cross-cultural Evaluation TIG Multipaper Impact Evaluation and Beyond: Methodological and Cultural Considerations in Measuring What Works Republic A 739 Health Evaluation TIG MultiPaper National Evaluation of Team Science in the Interdisciplinary Research Consortium Program Republic B 740 Collaborative, Participatory & Empowerment Multipaper Collaborative Evaluations: Successes, Challenges, and Lessons Learned Republic C Evaluation 2010: Saturday, November 13, 8:00 AM – 9:30 AM Page 129 Saturday, 8:00 am to 9:30 am 702 - Design Thinking: The Art of Evaluation Panel to be held in Lone Star A Sponsored by the Presidential Strand and the Evaluating the Arts and Culture TIG Chair and Discussant - Ching Ching Yap, Savannah College of Art and Design Make the Familiar Strange, and Make the Strange Familiar Christine Miller, Savannah College of Art and Design The Breakthrough of Praxis Robert Fee, Savannah College of Art and Design Taking the First Step Towards Design Thinking David Ringholz, Savannah College of Art and Design 703 - Theory of Change Online: Implications for Participatory Planning and Evaluation Using Technology Panel to be held in Lone Star B Sponsored by the Program Theory and Theory-driven Evaluation TIG Chair and Discussant - Helene Clark, ActKnowledge Using Technology to Enable Constituency Feedback David Bonbright, Keystone Accountability Differences in Theory Development Before and After Using an Online Theory of Change Application Abra McAndrew, University of Arizona Using Theory of Change Online as Part of an Advocacy Approach to the Needs of Children Jodie Langs, West Coast Children's Clinic 704 - Training in Evaluation: Formal and Informal Capacity Building MultiPaper to be held in Lone Star C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Chair - Stewart Donaldson, Claremont Graduate University Innovative Approaches for Evaluation Education and Training: Examples From the Claremont Graduate University (CGU) Evaluation Programs John LaVelle and Stewart Donaldson, Claremont Graduate University Training in Informal Settings: From Workshops to Collaborative Web Pages (With a Focus on Facilitated Thinking Skills) Linda Delaney, LFD Consulting LLC; and David Fetterman, Fetterman & Associates Training For Outcomes (TFO): Using the Getting to Outcomes® Framework to Achieve Training Success Victoria Chien, University of South Carolina; and Abraham Wandersman, University of South Carolina Empowerment Evaluator: Critical Friend and Organizational Counselor and Advisor Jose Maria Diaz Puente, Polytechnic University of Madrid 705 - Foundation Effectiveness: Aligning Impact Strategy and Evaluation Demonstration to be held in Lone Star D Sponsored by the Non-profit and Foundations Evaluation TIG Dawn Martz, Foellinger Foundation Inc; and Mike Stone, Impact Strategies Inc 706 - Applications of Multiple Regression for Evaluators Demonstration to be held in Lone Star E Sponsored by the Quantitative Methods: Theory and Design TIG Dale Berger, Claremont Graduate University 707 - The Process of Evaluating Supporting Partnerships to Assure Ready Kids (SPARK) and Ready Kids Follow-Up (RKF): Embracing and Informing Truth, Beauty, and Justice Panel to be held in Lone Star F Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG Chair - York Susan, University of Hawaii, Manoa Discussant - Huilan Krenn, W K Kellogg Foundation Methodological Challenges to Initiative-level Evaluation Patrick Curtis, Walter R McDonald and Associates Inc A So-called ―Improved‖ Evaluation Method Viewed Through an Indigenous Lens Morris Lai, University of Hawaii, Manoa The Tension Between Difference and Commonality in Multi-site Initiative: What are the Challenges to Quality? Marah Moore, i2i Institute Inc Including Evaluation From the Start: How Ohio SPARK Used Evaluation for Program Planning and Program Expansion Peter Leahy, University of Akron 708 – Roundtables in Mission A The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Human Services Evaluation TIG and the Mixed Methods Evaluation TIG Rotation 1: Measuring Success: Applying Short-Term Indicators to Measure Long-Term Success in Human Capital Investment Programs Margaret McKenna, ConTEXT Rotation 2: How to Maintain Evaluation Quality in a Changing Environment: The Importance of Mixed Methods Michael Smith and Lisanne Brown, Louisiana Public Health Institute; and Elmore Rigamer, Catholic Charities of New Orleans Evaluation 2010: Saturday, November 13, 8:00 AM – 9:30 AM Page 130 709 - From Deliverables to Strategies: Experience of Implementing a National Evaluation Policy via Statewide Asthma Programs Panel to be held in Mission B Sponsored by the Evaluation Policy TIG Chair - Paul Garbe, Centers for Disease Control and Prevention Shaking It Up: A New Evaluation Policy for Strategic Evaluation Planning Leslie Fierro, SciMetrika Reality Check: Benefits and Limitations of Strategic Evaluation Planning in Practice Eric Armbrecht, Open Health LLC; Peggy Gaddy and Sherri Homan, Missouri Asthma Prevention and Control Program Supporting Internal Evaluation Policy: Development of Evaluation Technical Assistance Sub-team and Policy Implementation Materials Sarah Gill and Amanda Savage Brown, Cazador Providing Evaluation Technical Assistance: Are We Doing What We Expected and What Exactly Are We Doing? Sheri Disler, Centers for Disease Control and Prevention; and Amanda Savage Brown, Cazador 710 - Framework for Orchestrating Systems Transformation: Theory and Practice for Promoting Dynamic Systems Change MultiPaper to be held in Bowie A Sponsored by the Systems in Evaluation TIG Chair - Pennie Foster-Fishman, Michigan State University An Overview of the Framework for Orchestrating Systems Transformation Pennie Foster-Fishman and Erin Watson, Michigan State University Using the Framework for Orchestrating Systems Transformation for Systemic Action Learning and Strategic Change Processes Erin Watson and Pennie Foster-Fishman, Michigan State University Factors Affecting a Neighborhood Small Grants Program: Application of the Framework for Orchestrating Systems Transformation Jennifer Mortensen, Pennie Foster-Fishman, and Miles McNall, Michigan State University Considering Resident Engagement as a Systems Change Process Charles Collins, Pennie Foster-Fishman, Steven Pierce, Michigan State University 711 - Where Theory Meets Practice in Assessing Advocacy and Policy Change Multipaper to be held in Bowie C Sponsored by the Advocacy and Policy Change TIG Chair - Ehren Reed, Innovation Network How Do You Know You Are Making a Difference? A Collaborative Study With Social Justice Advocacy Organizations in Canada Bessa Whitmore, Carleton University; and Maureen Wilson, and Avery Calhoun, University of Calgary Hard Evidence for Hard Times: A Policy Analysis of the Rise of Evidence-based Practice in Evaluation of Home Visiting Programs Using Kingdon‘s Multiple Streams Model Stephen Edward McMillin, University of Chicago The Politics and Ethics of Advocacy Evaluation Denise L Baer, Johns Hopkins University 712 – Roundtables in Goliad The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the International & Cross-cultural Evaluation TIG Rotation 1: Investing in Long Term Capacity Building Initiatives for African-based Graduates and Professionals Involved or Interested in the Monitoring and Evaluating (M&E) of Development, Business and Education Maureen Wang'ati, Measure Africa Rotation 2: Improving Methods of Inquiry in Evaluation Practice: Issues and Recommendations to Incorporate Diverse Views and Perspectives in International and Domestic Program Evaluation Nicole Jackson, University of California, Berkeley 713 – Roundtables in San Jacinto The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Internal Evaluation TIG Rotation 1: The Internal Evaluator's Dual Role as Project Manager and Evaluator: Lessons in Maintaining Evaluation Quality Tamika Howell, Brian Mundy, and William Campbell, Institute for Community Living Inc Rotation 2: Internal Evaluation: How to Keep the Fox Out of the Hen House Jane Nell Luster, Louisiana State University 714 - Leading Change Through Assessment Skill-building Workshop to be held in Travis A Sponsored by the Assessment in Higher Education TIG Patrice Lancey and Divya Bhati, University of Central Florida Evaluation 2010: Saturday, November 13, 8:00 AM – 9:30 AM Page 131 Demonstration to be held in Travis B Sponsored by the Integrating Technology Into Evaluation TIG Humphrey Costello, Eric Canen, and Reese Jenniges, University of Wyoming Using GIS to Locate and Evaluate Affordable, Safe, and Effective Housing for Emancipated Youth Leaving Foster Care: Project LEASE Catherine Batsche, University of South Florida Using GIS to Locate a Community Mental Health Center: A Case Illustration Roger Boothroyd, University of South Florida A GIS Model to Reduce Risk Factors for Pregnant and Parenting Mothers Robert Lucio, University of South Florida 716 - Evaluating Social Change Programs: How Does a Culturally Responsive Approach Apply? 719 - A Practical Comparison of Longitudinal Data Analysis Methods Saturday, 8:00 am to 9:30 am, continued 715 - Fewer Errors and Faster Results: How to Automate Production of Tables and Reports with Software You Already Own Think Tank to be held in Travis C Sponsored by the Multiethnic Issues in Evaluation TIG Presenter - Deloris Vaughn, Innovation Network Discussant s- Laura Ostenso and Melisa March, Innovation Network 717 - Moving Towards Improving the Quality of Our Evaluations: Approaches and Lessons Learned From Comprehensive Cancer Control at the Centers for Disease Control and Prevention (CDC) Panel to be held in Travis D Sponsored by the Health Evaluation TIG Chair - Debra Holden, Research Triangle Institute International Discussant - Phyllis Rochester, CDC Performance Measures for the National Comprehensive Cancer Control Program (NCCCP): Current State and Future Directions Julie Townsend, Chrisandra Stockmyer, Angela Moore, and Phyllis Rochester, CDC Comprehensive Cancer Control Evaluation Toolkit: A Resource to Improve the Quality of Evaluation Plans Angela Moore, CDC; LaShawn Curtis and Cindy Soloe, RTI International; and Phyllis Rochester, CDC The Development of a Menu of Outcomes Database (MOD): A Practical Evaluation Tool to Assist State, Tribal and Territorial Comprehensive Cancer Control Programs Brenda Stone-Wiggins, RTI International; Phyllis Rochester, Chrisandra Stockmyer, and Angela Moore, CDC; and Janice Tzeng, Nathan Mann, and Debra Holden, RTI International 718 - Using Geographic Information Systems (GIS) to Enhance the Quality and Validity of Evaluations in Human Services Panel to be held in Independence Sponsored by the Human Services Evaluation TIG Chair - Catherine Batsche, University of South Florida MultiPaper to be held in Presidio A Sponsored by the Quantitative Methods: Theory and Design TIG Chair - Mende Davis, University of Arizona Traditional Approaches for Longitudinal Data Mende Davis and William Becker, University of Arizona Newer Approaches for Longitudinal Data: General Linear Models and Mixed Models Sally Olderbak and William Becker, University of Arizona Tying It All together Sally Olderbak, Mei-kuang Chen, Aurelio Jose Figueredo, and Mende Davis, University of Arizona 720 - Measuring Evaluation Capacity to Enhance Quality of Evaluation Capacity Building (ECB) Activities in Federal Public Health and Systemic Change Programs Panel to be held in Presidio B Sponsored by the Organizational Learning and Evaluation Capacity Building TIG and the Health Evaluation TIG Chair - Maureen Wilce, Centers for Disease Control and Prevention Discussant - Hallie Preskill, FSG Social Impact Advisors Measuring Evaluation Capacity: Development of a Tool Carlyn Orians, Battelle Memorial Institute Building Evaluation Capacity for Asthma Control Programs: Assessing What You Don‘t Know Kari Cruz and Maureen Wilce, Centers for Disease Control and Prevention Building Evaluation Capacity for State Oral Health Programs: Using Data to Plan and Focus Initiatives Cassandra Martin, Centers for Disease Control and Prevention Targeting Evaluation Capacity Building (ECB) Needs in State and Tribal Child Welfare Systemic Change Projects Julie Morales, University of Denver Evaluation 2010: Saturday, November 13, 8:00 AM – 9:30 AM Page 132 721 - Taking Stock of the Quality of Evaluation Research on School-Based Prevention Programs 724 - Systems and Logic Models as Complementary Tools for Educational Evaluation Panel to be held in Presidio C Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG Chair - Scott Crosse, Westat The Methodological Quality of Evaluation Research on Schoolbased Prevention Programs: Where Are We Now? Carol Hagen, Scott Crosse, and Michele Harmon, Westat; and Samantha Leaf and Rebekah Hersch, ISA Associates Main Effects and Moderating Influences Among ‗Effective‘ School-based Programs Aaron Alford and Jim Derzon, Battelle Memorial Institute Breadth and Depth of Evidence: Documenting Program Effectiveness Across a Range of Behavioral Outcomes Jim Derzon and Aaron Alford, Battelle Memorial Institute Skill-building Workshop to be held in Bonham C Sponsored by the Pre-K - 12 Educational Evaluation TIG Janice Noga, Pathfinder Evaluation and Consulting 722 – Roundtables in Bonham A Roundtable to be held in Bonham A The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Rotation 1: Valuing Stakeholders: Collaborative Evaluation of Professional Development Needs Wendy Bradshaw and Jeremy Lake, University of South Florida Rotation 2: Wearing Different Hats: The Multiple Roles of an Evaluator Jeremy Lake and Wendy Bradshaw, University of South Florida 723 - Beauty is in the Eye of the Beholder: Rationalizing Evaluation Needs Amongst Foundation Boards, Staff, and the Nonprofits They Fund Panel to be held in Bonham B Sponsored by the Non-profit and Foundations Evaluation TIG Chair - Charles Gasper, Missouri Foundation for Health The Director of Evaluation: Part Negotiator, Part Salesman, Part Educator, Part Evaluator, and 100% Facilitator Charles Gasper, Missouri Foundation for Health The Vice President for Program: Looking for Impact, But Also Looking to Learn Lessons That Can Be Applied to Other Initiatives Martha Gragg, Missouri Foundation for Health The Director of a Foundation: Strongly Interested in Knowing If the Funding Has Made an Impact, but Open to Learning More From Evaluations George Gruendel, Missouri Foundation for Health The Contractor in the Middle: Balancing the Needs of Different Organizations to Meet the Needs of All the Primary Stakeholders Carol Brownson, Washington University in St Louis 725 - Classroom Observations: Lessons Learned About Five Protocols From Five Multi-site Education Evaluations Panel to be held in Bonham D Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Elizabeth Autio, Education Northwest Using the Classroom Assessment Scoring System (CLASS) to Measure Classroom Organization, Interactions, and Support Jason Greenberg Motamedi, Education Northwest Looking at Literacy With the Early Language and Literacy Classroom Observation Tool (ELLCO) and the Sheltered Instruction Observation Protocol (SIOP) Elizabeth Autio, Education Northwest Development of an Observation Protocol for a Reading Intervention Caitlin Scott, Education Northwest Development of an Observation Protocol for Adolescent Literacy Interventions Kari Nelsestuen, Education Northwest 726 - Interim Evaluation: The Quality of Research and the Quality of Evaluation - Case Study of the FP7 Interim Evaluation Panel to be held in Bonham E Sponsored by the Research, Technology, and Development Evaluation TIG Chair - Neville Reeve, European Commission Case Study of the FP7 Interim Evaluation: Notions of Quality in Evaluation Design Neville Reeve, European Commission Evaluation Quality and Long-term Impact Peter Fisch, European Commission The Use of Independent Experts to Verify Quality and Strengthen Evaluation Process Wolfgang Polt, Joanneum Research The Role of Stakeholders on the Quality of Evaluation Design, Implementation and Impact Iain Begg, London School of Economics Evaluation 2010: Saturday, November 13, 8:00 AM – 9:30 AM Page 133 Saturday, 8:00 am to 9:30 am, continued 727 - Use of Evaluation: Overcoming the Challenges Panel to be held in Texas A Sponsored by the Government Evaluation TIG Chair - Joseph Wholey, University of Southern California Discussant - George Grob, Center for Public Program Evaluation The Challenge of Producing Credible Evaluations Kathryn Newcomer, George Washington University The Challenge of Producing Useful Evaluations Harry Hatry, Urban Institute Contracting for Credible, Useful Evaluations James Bell, James Bell Associates 729 - A Mixed Methods Assessment of the Impact of Three Dropout Prevention Strategies on Student Academic Achievement in Grades 6th through12th in Texas MultiPaper to be held in Texas C Sponsored by the Mixed Methods Evaluation TIG Chair - Thomas Horwood, ICF International Discussant - Candace Macken, Texas Education Agency An Evaluation of the Intensive Summer Program (ISP) in Texas Schools Rosemarie O'Conner and Aikaterini Passa, ICF International An Evaluation of the Collaborative Dropout Reduction Program in Texas Schools Allan Porowski and Sarah Decker, ICF International An Evaluation of the Impact of Teacher Mathematics Instructional Coaches Training on Teachers and Schools Stacey Merola and Aikaterini Passa, ICF International 730 - Metrics for the National Institute of Environmental Health Science (NIEHS): Measuring Outcomes to Advance Partnerships for Environmental Public Health Panel to be held in Texas D Sponsored by the Research, Technology, and Development Evaluation TIG Chair - Christie Drew, National Institute of Environmental Health Sciences Discussant - Gretchen Jordan, Sandia National Laboratories Metrics and Examples for Evaluating Education and Training Evaluation in Environmental Public Health Programs Helena L Davis, Beth Anderson, Sharon Beard, Caroline Dilworth, Christie Drew, and Liam O'Fallon, National Institute of Environmental Health Sciences; and Ashley Brenner, Cara O'Donnell, Sarah Ryker, Stephanie Shipp, and Susannah T Howieson, Science and Technology Policy Institute Evaluating Partnerships in Environmental Health Programs Ashley Brenner, and Cara O'Donnell, Science and Technology Policy Institute; Beth Anderson, Sharon Beard, Helena L Davis, Caroline Dilworth, Christie Drew, and Liam O'Fallon, National Institute of Environmental Health Sciences; and Sarah Ryker, Stephanie Shipp, and Susannah T Howieson, Science and Technology Policy Institute Partnerships and Training: The United Steelworkers Health and Safety Department Worker Training and Education Program Thomas McQuiston, United Steelworkers Health and Safety Department Environmental Health and the Navajo Nation: Products, Dissemination, and Partnerships Johnnye Lewis, University of New Mexico 731 - Strategies for Developing Evaluation Capacity in Educational Partnerships Demonstration to be held in Texas E Sponsored by the Evaluation Use, and the Pre-K - 12 Educational Evaluation, and the Indigenous Peoples in Evaluation TIGs Ed McLain, University of Alaska, Anchorage; and Susan Tucker, Evaluation & Development Associates 732 - Studies of Evaluation Practice Across Multiple Contexts Multipaper to be held in Texas F Sponsored by the Research on Evaluation TIG Chair - Deborah Grodzicki, University of California, Los Angeles An Examination of the State and Quality of Monitoring and Tracking (M&T) for Contemporary Program Evaluation Antionette Stroter and Douglas Grane, University of Iowa Inquiry on the State of Evaluation Practice, Experience, and Use in Kenya Douglas Grane, University of Iowa; and Karen Odhiambo, University of Nairobi The Role of Program Evaluation in Improving and Sustaining State-Supported School Counseling Programs: A Cross Case Analysis of Best Practices Ian Martin, University of San Diego 733 - Mapping Extension‘s Networks: Using Social Network Analysis to Explore Extension Outreach Demonstration to be held in Crockett A Sponsored by the Extension Education Evaluation TIG Scott Chazdon, Tom Bartholomay, Mary Marczak, and Kate Walker, University of Minnesota Evaluation 2010: Saturday, November 13, 8:00 AM – 9:30 AM Page 134 734 - Critical Concepts for Introductory Evaluation Courses: Multiple Perspectives – Part 2 737 - Emerging Evaluators and the Future of Culturally Responsive Evaluation Demonstration to be held in Crockett B Sponsored by the Teaching of Evaluation TIG Katye Perry, Oklahoma State University; David Diehl, University of Florida; Maura Harrington, Center for Nonprofit Management; Kathleen Bolland, University of Alabama; Shana Pribesh, Old Dominion University; Faye Belgrave, Virginia Commonwealth University; John Stevenson, University of Rhode Island; Kathleen Norris, Plymouth State University; Melissa Chapman, University of Iowa; David Nevo, Tel Aviv University; Anne Hewitt, Seton Hall University; and Arthur Hernandez, Texas A&M University Panel to be held in Seguin B Sponsored by the Graduate Student and New Evaluator TIG Chair - Helga Stokes, Duquesne University Discussant - Daniel McDonald, University of Arizona; Karol K Harris, University of Texas, Austin; Michelle Jay, University of South Carolina; and Ricardo Millett, Ricardo Millett and Associates Teaching a New Dog Old Tricks: Incorporating Evaluation Skills Into Academic and Work Settings Natalie Alizaga, Amherst H Wilder Foundation; Monica Getahun, OMG Center for Collaborative Learning; Denise Herrera, Decision Information Resources Inc; and Afabwaje Jatau, National Cancer Institute Culturally Responsive Evaluation: Engaging Community Members and Stakeholders Toward Meaningful Policy and Systems Change Monica Getahun, OMG Center for Collaborative Learning Mentoring Novice Evaluators Throughout the Evaluation Process: An Investment Worth Making Denise Herrera, Decision Information Resources Inc An Inconvenience or a Necessity?: The Role of Culturally Responsive Evaluation in Agencies When Resources May Be Limited Afabwaje Jatau, National Cancer Institute 735 - The Role of Monitoring in Evaluation Quality Panel to be held in Crockett C Sponsored by the International & Cross-cultural Evaluation TIG Chair - Chung Lai, International Relief & Development Data Collection Instruments for Quality Evaluation Chung Lai, International Relief & Development Monitoring Tools and Systems: Contributing to Better Information for Program Teams and Evaluators Maurya West Meiers, World Bank Monitoring: An Evaluator‘s Friend or Foe Cheyanne Scharbatke-Church, Besa Consulting 736 - Infusing Evaluation Theory Into Practice in Government Safety Programs: Process Examples From the United States Department of Transportation Panel to be held in Crockett D Sponsored by the Government Evaluation TIG Chair - Michael Quinn Patton, Utilization-Focused Evaluation Discussant - Joyce Ranney, Volpe National Transportation Systems Center Planning for Quality: Creating an Evaluation-Focused Safety Council for the United States Department of Transportation Michael Coplen, United States Department of Transportation; and Stephen Popkin, Volpe National Transportation Systems Center Promoting Positive Utilization of Risk Analysis Findings Juna Snow, Innovated Consulting; Deborah Bonnet, Fulcrum Corporation From Research to Practice: The Utility of Evaluation With International Fatigue Management Conference in Transportation Michael Coplen, United States Department of Transportation; and Stephen Popkin, Volpe National Transportation Systems Center 738 - Impact Evaluation and Beyond: Methodological and Cultural Considerations in Measuring What Works Multipaper to be held in Republic A Sponsored by the International & Cross-cultural Evaluation TIG Chair - Tessie Catsambas, EnCompass LLC Assessing the Relevance of International Development and Humanitarian Response Projects at Aggregate Levels: A Key Consideration in Achieving Equality of Wellbeing Outcomes and Just Resource Allocation - An Example of Summary Child Wellbeing Outcome Reporting From World Vision International Nathan Morrow, World Vision International; and Nancy Mock, Tulane University Taking the Long View in Evaluating International Development Assistance R Gregory Michaels and Alphonse Bigirimana, Chemonics International Using Rubrics Methodology in Impact Evaluations of Complex Social Programs: The Case of the Maria Cecilia Souto Vidigal Foundation‘s Early Childhood Development Program Thomaz Chianca, COMEA Evaluation Ltd; and Marino Eduardo, Independent Consultant Quality is More Than Rigor: A Political and a Scientific Perspective for Impact Evaluation in Development Rahel Kahlert, University of Texas, Austin Evaluation 2010: Saturday, November 13, 8:00 AM – 9:30 AM Page 135 Saturday, 8:00 am to 9:30 am, continued Saturday, 9:30 am to 10:00 am – Coffee Break! 739 - National Evaluation of Team Science in the Interdisciplinary Research Consortium Program MultiPaper to be held in Republic B Sponsored by the Health Evaluation TIG Chair - Sue Hamann, National Institutes of Health Why Evaluating Team Science is Important: Perspectives of the National Institutes of Health (NIH) Sue Hamann, National Institutes of Health The Use of an Expert Panel to Advance the Evaluation of Team Science Alina Martinez, Abt Associates Inc The Utility of Social Network Analysis in the Evaluation of Team Science Irina Agoulnik, Brigham and Women's Hospital Comprehensive Mixed Methods for Evaluating Team Science: Searching for "Truth" Versus ―Truthiness‖ Jacob Tebes, Yale University 740 - Collaborative Evaluations: Successes, Challenges, and Lessons Learned Multipaper to be held in Republic C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Chair - Anne Cullen, Western Michigan University Enhancing Evaluation Stakeholder Responsiveness Through Collaborative Development of Data Karen Kortecamp, George Washington University Reflecting on Practice in Evaluating Culturally Competent Teaching Strategies Corina Owens, Michael Berson, and Liliana RodriguezCampos, University of South Florida Summative Evaluation for Marketing of Science Teachers and Induction (MOSTI): An Eclectic Evaluation Approach to the Improvement of Science Teacher Recruitment, Induction, and Retention Bryce Pride, Merlande Petit-Bois, Robert Potter, and John Ferron, University of South Florida Evaluation Capacity Building in Health Disparities Research: Achieving Empowerment Using the Model for Collaborative Evaluations (MCE) LaShonda Coulbertson and Desiree Rivers, Center for Equal Health Evaluation 2010: Saturday, November 13, 8:00 AM – 9:30 AM Page 136 Notes: Evaluation 2010: Saturday, November 13, 8:00 AM – 9:30 AM Page 137 Summary of Sessions for Saturday, November 13, 10:00 AM to 10:45 AM No Primary Sponsor Session Session Title Room 742 Presidential Strand & Program Theory-Driven Business TIG Business Meeting and Panel: Improving Evaluation Quality by Improving Program Quality: A Theory-based… Lone Star A 743 Systems in Evaluation TIG Demonstration Expanding Evaluation‘s Utility and Quality Through System-Oriented Data Synthesis Lone Star B 744 Collaborative, Participatory & Empowerment Panel Racial and Ethnic Approaches to Community Health Across the United States (REACH US) Programs: Creating… Lone Star C 745 Non-profit and Foundations Evaluation TIG Panel Evaluation in Foundations: The State of the Art Lone Star D 746 Quantitative Methods: Theory and Design TIG Expert Lecture Ten Steps to Making Evaluations Matter: Designing Evaluations to Exert Influence Lone Star E 747 Cluster, Multi-site & Multi-level Evaluation TIG Panel Partner Roles in a Multi-site Evaluation: The Viewpoints and Experiences of the Cross-site Evaluator and the State Program… Lone Star F 748 Independent Consulting TIG Roundtable Translating Findings Into Client Action Mission A 749 Disabilities and Other Vulnerable Populations Multipaper Evaluation of Interventions and Assessments of Individuals With Disabilities Mission B 750 Independent Consulting TIG Skill-building Evaluations of Community Nonprofits and New Organizations or Developing Programs: Lessons From the Field Bowie A 751 Advocacy and Policy Change TIG Panel Slow Down, You Move too Fast: Calibrating Evaluator Engagement to the Pace of Campaigners and Advocates… Bowie C 752 Distance Ed. & Other Educational Technologies Roundtable Increasing Access Through Openness? Evaluating Open Educational Resources (OER) in Himalayan Community Technology… Goliad 753 Evaluation Use TIG Roundtable Use, Ethics, and Not Giving Clients What They Ask For San Jacinto 754 Assessment in Higher Education TIG Multipaper The Impact of Exogenous Factors in Classroom Evaluation Travis A 755 Integrating Technology Into Evaluation TIG Demonstration Data Dashboard Design for Quality Monitoring and Decision Making Travis B 756 Org Learning & Evaluation Capacity Bldg TIG Think Tank Strengthening the Learning Culture Within Organizations and Projects Travis C 757 Org Learning & Evaluation Capacity Bldg TIG Multipaper Building Capacity in Community-Level Organizations Travis D 758 Assessment in Higher Education TIG Multipaper Evaluation in Medical Education Independence 759 Independent Consulting TIG Demonstration Guidelines for Independent Consultants/Evaluators Working With Universities: Complying With Federal Funding Source… Presidio A 760 Org Learning & Evaluation Capacity Bldg TIG Panel Evaluation Capacity Building Through State Affiliates Presidio B 761 Alcohol, Drug Abuse, and Mental Health TIG MultiPaper Evaluation Capacity in School Mental Health: Lessons From School Counseling Presidio C 762 Non-profit and Foundations Evaluation TIG Roundtable Using Site Visits to Improve Programs Bonham A 763 College Access Programs TIG Multipaper Control Groups and Cost Analysis: Innovative Approaches to College Access Program Evaluation Bonham B 764 Pre-K - 12 Educational Evaluation TIG MultiPaper Promoting Truth and Justice: Evaluation‘s Role in Teacher Education Programs for Candidates From Underrepresented… Bonham C 765 Pre-K - 12 Educational Evaluation TIG Think Tank Evaluating Twenty-first Century Skills Bonham D 766 Research, Technology, and Development Multipaper Systems of Evaluation for Diverse National Portfolios of Research: Lessons From Russia and Finland Bonham E Evaluation 2010: Saturday, November 13, 10:00 AM – 10:45 AM Page 138 Summary of Sessions for Saturday, November 13, 10:00 AM to 10:45 AM, Continued No Primary Sponsor Session Session Title Room 767 Government Evaluation TIG Panel Demonstrating Results for Federally Funded Programs Texas A 768 Qualitative Methods TIG Multipaper Where Do Values Enter Into Evaluations? Texas B 769 AEA Conference Committee Panel How to Get People to Read Your Research And Take Action on It Texas C 770 Research, Technology, and Development Multipaper Evaluating Contributions to Knowledge Translation for New Technologies or Medical Treatments Texas D 771 Evaluation Use TIG Demonstration Effectively Communicating Evaluation Results: Creative, Innovative, and Technological Ways to Share Evaluation Findings Texas E 772 Evaluation Policy TIG Expert Lecture Quality Evaluation: Drivers and Objectives of the Renewed Canadian Federal Policy on Evaluation Texas F 773 Extension Education Evaluation TIG MultiPaper Supporting Evaluation Capacity Building Within the Cooperative Extension System to Impact the Lives of Children, Youth… Crockett A 774 Business and Industry TIG Think Tank Leading the Horse to Water, Part II: Winning the Front-end Needs Assessment Tug-of-War in a Knowledge Management… Crockett B 775 Social Network Analysis TIG Expert Lecture Longitudinal Social Network Analysis: An Understanding of This Dynamic Network Approach Crockett C 776 Government Evaluation TIG MultiPaper Evaluation Challenges in Designing and Implementing a Program Evaluation: The Experience of the CDC Colorectral Cancer… Crockett D 777 Qualitative Methods TIG Multipaper Exploring the Role of Software in Qualitative Analysis Seguin B 778 International and Cross-cultural Evaluation TIG Demonstration Simulation Model of Evaluation Biases Under Post Conflict Zones Republic A 779 Health Evaluation TIG Multipaper Healthy Aging and Health Screenings: Lessons Learned Through Participatory Evaluations Republic B 780 Theories of Evaluation TIG Multipaper Contextual Influences on the Evaluator, the Evaluation, and the Evaluation Design Republic C Evaluation 2010: Saturday, November 13, 10:00 AM – 10:45 AM Page 139 Saturday, 10:00 am to 10:45 am 742 - Program Theory and Theory-driven Evaluation TIG Business Meeting and Panel: Improving Evaluation Quality by Improving Program Quality: A Theory-based/Theory-driven Perspective Business Meeting to be held in Lone Star A Sponsored by the Presidential Strand and the Program Theory and Theory-driven Evaluation TIG TIG Leaders - John Gargani, Gargani + Company; and Katrina Bledsoe, Walter R McDonald and Associates Inc Chair - Katrina Bledsoe, Walter R McDonald and Associates Inc Discussants - Michael Scriven, Claremont Graduate University; David Fetterman, Fetterman & Associates; and Charles Gasper, Missouri Foundation for Health The Relationship Between Program Design and Evaluation Design Stewart Donaldson, Claremont Graduate University The Expanding Profession: Program Evaluators as Program Designers John Gargani, Gargani + Company 743 - Expanding Evaluation‘s Utility and Quality Through System-Oriented Data Synthesis Demonstration to be held in Lone Star B Sponsored by the Systems in Evaluation TIG Beverly A Parsons and Pat Jessup, InSites 744 - Racial and Ethnic Approaches to Community Health Across the United States (REACH US) Programs: Creating and Evaluating Communitybased Coalitions Panel to be held in Lone Star C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Chair - Ada Wilkinson-Lee, University of Arizona Discussant - Mari Wilhelm, University of Arizona Pima County Cervical Cancer Prevention Partnership (PCCCPP): Evaluation of a Community-based Coalition Addressing Cervical Cancer Among Mexican American Women Ada Wilkinson-Lee, Martha Moore-Monroy, Francisco Garcia, and Mari Wilhelm, University of Arizona Evaluation of a Community-Academic Partnership Using a Mixed-methods Approach: B Free CEED: National Center of Excellence in the Elimination of Hepatitis B Disparities Nancy VanDevanter, New York University; Shao-Chee Sim, Charles B Wang Community Health Center; and Simona Kwon, New York University 745 - Evaluation in Foundations: The State of the Art Panel to be held in Lone Star D Sponsored by the Non-profit and Foundations Evaluation TIG Chair - Richard McGahey, Ford Foundation Discussants - Lester Baxter, Pew Charitable Trusts; and Mayur Patel, John S and James L Knight Foundation Evaluation Practice at Major United States Foundations: Report on a Benchmark Survey and Analysis Patricia Patrizi, The Evaluation Roundtable Performance Measurement at Foundations and Nonprofits: Tools, Techniques, and Effective Practice Elizabeth Boris, Urban Institute 746 - Ten Steps to Making Evaluations Matter: Designing Evaluations to Exert Influence Expert Lecture to be held in Lone Star E Sponsored by the Quantitative Methods: Theory and Design TIG Chair - Melvin Mark, Pennsylvania State University Presenter - Sanjeev Sridharan, University of Toronto 747 - Partner Roles in a Multi-site Evaluation: The Viewpoints and Experiences of the Cross-site Evaluator and the State Program Coordinator Panel to be held in Lone Star F Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG Chair - Kristin Everett, Western Michigan University Evaluating a Statewide, Multi-site Program: The External Evaluator‘s Role Kristin Everett, Western Michigan University Evaluating a Statewide, Multi-site Program: The Program Coordinator‘s Role Donna Hamilton, Michigan Department of Education 748 – Roundtable in Mission A Sponsored by the Independent Consulting TIG Translating Findings Into Client Action Judith Russell, Independent Consultant 749 - Evaluation of Interventions and Assessments of Individuals With Disabilities Multipaper to be held in Mission B Sponsored by the Disabilities and Other Vulnerable Populations and the Pre-K - 12 Educational Evaluation TIGs Chair - Julia Shaftel, University of Kansas One State‘s Experience Implementing Links for Academic Learning Julia Shaftel, University of Kansas Using a Logic Model to Evaluate the Implementation and Effectiveness of a Complex Intervention Celine Mercier, University of Montreal; Diane Morin, University of Quebec at Montreal; Virgine Cobigo, Queen's University at Kingston; and Astrid Brouselle, University of Sherbrooke Evaluation 2010: Saturday, November 13, 10:00 AM – 10:45 AM Page 140 750 - Evaluations of Community Nonprofits and New Organizations or Developing Programs: Lessons From the Field Skill-building Workshop to be held in Bowie A Sponsored by the Independent Consulting TIG and the Nonprofit and Foundations Evaluation TIG Gary Miron, and Kathryn Wilson, and Michael Kiella, Western Michigan University 751 - Slow Down, You Move too Fast: Calibrating Evaluator Engagement to the Pace of Campaigners and Advocates when Developing Theories of Change Panel to be held in Bowie C Sponsored by the Advocacy and Policy Change TIG Chair - Mary Sue Smiaroski, Oxfam International Strategic Intuition and Theory of Change: Connecting the Dots for Stakeholders Laura Roper, Brandeis University Developing, Testing, and Building Data Systems Around Theory of Change: A Year in the Life of an Embedded Monitoring, Evaluation and Learning Staffer Gabrielle Watson, Oxfam America 752 – Roundtable in Goliad Sponsored by the Distance Education and Other Educational Technologies TIG Increasing Access Through Openness? Evaluating Open Educational Resources (OER) in Himalayan Community Technology Centres Tiffany Ivins, David D Williams, Randy Davies, and Shrutee Shrestha, Brigham Young University 753 – Roundtable in San Jacinto Sponsored by the Evaluation Use TIG Use, Ethics, and Not Giving Clients What They Ask For Rachael Lawrence and Sharon Rallis, University of Massachusetts, Amherst Did you know? AEA is piloting a coffee-break demonstration series consisting of 20-minute webinars. These are recorded and available to members, free of charge, on the AEA website. 754 - The Impact of Exogenous Factors in Classroom Evaluation Multipaper to be held in Travis A Sponsored by the Assessment in Higher Education TIG Chair - Susan Rogers, State University of New York at Albany Discussant - Rhoda Risner, United States Army 10% for Attendance & Participation: Evaluating Assessment Practices in Undergraduate Courses Susan Rogers and Kristina Mycek, State University of New York at Albany Tables and Chairs: The Effects of Classroom Design on Students and Instructors in Higher Educational Settings Martin Wikoff, Krueger International; and Susan Rogers, State University of New York at Albany 755 - Data Dashboard Design for Quality Monitoring and Decision Making Demonstration to be held in Travis B Sponsored by the Integrating Technology Into Evaluation TIG Presenters - Veronica Smith, data2insight; and Tarek Azzam, Claremont Graduate University 756 - Strengthening the Learning Culture Within Organizations and Projects Think Tank to be held in Travis C Sponsored by the Organizational Learning and Evaluation Capacity Building TIG Presenters - David Scheie, Touchstone Center for Collaborative Inquiry; and Nan Kari, Touchstone Center for Collaborative Inquiry Discussants - Jessica Shao, Independent Consultant; Scott Hebert, Sustained Impact; and Ross Velure Roholt, University of Minnesota 757 - Building Capacity in Community-Level Organizations Multipaper to be held in Travis D Sponsored by the Organizational Learning and Evaluation Capacity Building TIG Chair - Debbie Zorn, University of Cincinnati Discussant - Rebecca Woodland, University of Massachusetts, Amherst Capacity Building: Grass Roots Agencies – Grass Roots Funding John Kelley, Villanova University Monitoring and Evaluation (M&E) for Me! Building the Monitoring and Evaluation Capacity of Community-based HIV/AIDS Programs in Thailand Anne Coghlan, Tatcha Apichaisiri, Supol Singhapoon, and David Dobrowlski, Pact Inc Evaluation 2010: Saturday, November 13, 10:00 AM – 10:45 AM Page 141 Saturday, 10:00 am to 10:45 am, continued 758 - Evaluation in Medical Education Multipaper to be held in Independence Sponsored by the Assessment in Higher Education TIG Chair - Chris Lovato, University of British Columbia Discussant - Linda Lynch, United States Army Using Evaluation to Inform Curriculum Renewal: A Case Example From Medical Education Chris Lovato, Linda Peterson, and Helen Hsu, University of British Columbia Tracking Long-Term Outcomes in Medical Undergraduate Education: Evaluating Readiness for Residency Training Helen Hsu, University of British Columbia; Terri BullerTaylor, Independent Consultant; and Holly Buhler and Chris Lovato, University of British Columbia 759 - Guidelines for IndependentConsultants/ Evaluators Working With Universities: Complying With Federal Funding Source Requirements, Budgets, Contracts, and Other Unique Issues Demonstration to be held in Presidio A Sponsored by the Independent Consulting and the Government Evaluation TIGs Mary Anne Sydlik, Western Michigan University 760 - Evaluation Capacity Building Through State Affiliates Panel to be held in Presidio B Sponsored by the Organizational Learning and Evaluation Capacity Building TIG Chair - Robert Shumer, University of Minnesota Developing a Statewide Evaluation System Robert Shumer, University of Minnesota Creating An Evaluation System for Civic Engagement Julie Plaut, Minnesota Campus Compact 761 - Evaluation Capacity in School Mental Health: Lessons From School Counseling MultiPaper to be held in Presidio C Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG Chair - Melissa Maras, University of Missouri Discussant - Paul Flaspohler, Miami University Getting to Outcomes in School Counseling: Examining Statewide Practices to Support Evaluative Practice Melissa Maras, Stephanie Coleman, and Norm Gysbers, University of Missouri; Bragg Stanley, Missouri Department of Elementary and Secondary Education; and Keith Herman, University of Missouri Assessing Evaluation Capacity: The Development and Results of a Survey on School Counselors‘ Skills in Evaluative Practice Stephanie Coleman, Melissa Maras, and Bragg Stanley, Missouri Department of Elementary and Secondary Education; and Keith Herman and Norm Gysbers, University of Missouri 762 – Roundtable in Bonham A Sponsored by the Non-profit and Foundations Evaluation TIG Using Site Visits to Improve Programs Emily Hagstrom and Caroline Taggart, Ciurczak & Co Inc 763 - Control Groups and Cost Analysis: Innovative Approaches to College Access Program Evaluation Multipaper to be held in Bonham B Sponsored by the College Access Programs TIG Chair - Kurt Burkum, ACT The Impact of Gaining Early Awareness and Readiness for Undergraduate Programs (GEAR UP) on Student Academic Preparedness Kirsten L Rewey and Joseph Curiel, Action Consulting and Evaluation Team (ACET) Inc; Michael C Rodriguez, University of Minnesota; and Stella SiWan Zimmerman, Action Consulting and Evaluation Team (ACET) Inc Evaluation Quality From an Unexpected Combination: How Evaluation Management, a Participative Process, and Program Theory Enhanced the Development of a Cost Analysis Framework Kathryn Hill, Minnesota Office of Higher Education 764 - Promoting Truth and Justice: Evaluation‘s Role in Teacher Education Programs for Candidates From Underrepresented Populations MultiPaper to be held in Bonham C Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Morris Lai, University of Hawaii, Manoa Kukuluao (Building Enlightenment): Heeding the Guidance of Teachers in a Native Community Alice Kawakami, University of Hawaii, Manoa Demonstrating the Effectiveness of Alternative Routes for Teacher Certification in Washington State Patty Molloy, Evergreen Training & Evaluation; and Mea Moore, Professional Educator Standards Board 765 - Evaluating Twenty-first Century Skills Think Tank to be held in Bonham D Sponsored by the Pre-K - 12 Educational Evaluation TIG Presenter - Sophia Mansori, Education Development Center Discussant - Alyssa Na'im, Education Development Center Evaluation 2010: Saturday, November 13, 10:00 AM – 10:45 AM Page 142 766 - Systems of Evaluation for Diverse National Portfolios of Research: Lessons From Russia and Finland 770 - Evaluating Contributions to Knowledge Translation for New Technologies or Medical Treatments Multipaper to be held in Bonham E Sponsored by the Research, Technology, and Development Evaluation TIG Chair - Yelena Thomas, Ministry of Research Science and Technology Tekes Impact Goals, Logic Models and Evaluation of Socioeconomic Effects Jari Hyvarinen, Tekes - Finnish Funding Agency for Technology and Innovation Verifiable Evaluation System for Research Programme Igor Zatsman, Russian Academy of Sciences Multipaper to be held in Texas D Sponsored by the Research, Technology, and Development Evaluation TIG Chair - John Reed, Innovologie LLC Translating New Knowledge From Technology Based Research Projects: An Intervention Evaluation Study Vathsala Stone, State University of New York at Buffalo Evolving a High-Quality Evaluation System for the National Institutes of Health‘s (NIH) HIV/AIDS Clinical Trials Research Networks Scott Rosas, Concept Systems Inc; Jonathan Kagan, National Institutes of Health; Jeffrey Schouten, Fred Hutchinson Cancer Research Center; and William M Trochim, Cornell University 767 - Demonstrating Results for Federally Funded Programs Panel to be held in Texas A Sponsored by the Government Evaluation TIG Chair - Michelle Kobayashi, National Research Center Inc Whole Measures for Food Security: Qualitative Tools To Measure Work Jeanette Abi-Nader, Community Food Security Coalition Evaluation Taxonomy: Incorporating Diverse Grantees and Stakeholders Michelle Kobayashi, National Research Center Inc 768 - Where Do Values Enter Into Evaluations? Multipaper to be held in Texas B Sponsored by the Qualitative Methods TIG Chair and Discussant - Leslie Goodyear, National Science Foundation Slippery Evaluation: Context, Quality, Interpretation Serafina Pastore, University of Bari What Matters and What Does It Look Like?: Values Meet Practices in the Complex Context of an Educative, ValuesEngaged Evaluation of a Professional Development School Melissa Freeman, Jori Hall, Tracie Costantino, Soria E Colomer, and Isabelle Crowder, University of Georgia 769 - How to Get People to Read Your Research And Take Action on It Panel to be held in Texas C Sponsored by the AEA Conference Committee Chair - Susan Parker, Clear Thinking Communications Find the Gold in Your Evaluation Susan Parker, Clear Thinking Communications Online Strategies for Sharing Your Evaluations More Broadly Gabriela Fitz, Issue Lab 771 - Effectively Communicating Evaluation Results: Creative, Innovative, and Technological Ways to Share Evaluation Findings Demonstration to be held in Texas E Sponsored by the Evaluation Use TIG and the Integrating Technology Into Evaluation Tiffany Comer Cook, University of Wyoming 772 - Quality Evaluation: Drivers and Objectives of the Renewed Canadian Federal Policy on Evaluation Expert Lecture to be held in Texas F Sponsored by the Evaluation Policy TIG and the Government Evaluation TIG Anne Routhier, Treasury Board of Canada 773 - Supporting Evaluation Capacity Building Within the Cooperative Extension System to Impact the Lives of Children, Youth, and Families at Risk MultiPaper to be held in Crockett A Sponsored by the Extension Education Evaluation TIG Chair - Daniel McDonald, University of Arizona Discussant - Roger Rennekamp, Oregon State University Implementing an Evaluation Using Common Measures Across Multiple States With Individual Programs Daniel McDonald and Pamela B Payne, University of Arizona Evaluating Impact at the Systems-level: The Importance of Building Evaluation Capacity to Support the Needs of Children, Youth, and Families at Risk Christine Bracamonte-Wiggs and Lynne Borden, University of Arizona Evaluation 2010: Saturday, November 13, 10:00 AM – 10:45 AM Page 143 Saturday, 10:00 am to 10:45 am, continued 774 - Leading the Horse to Water, Part II: Winning the Front-end Needs Assessment Tug-of-War in a Knowledge Management Program Initiative Think Tank to be held in Crockett B Sponsored by the Business and Industry TIG Thomas Ward, United States Army 775 - Longitudinal Social Network Analysis: An Understanding of This Dynamic Network Approach Expert Lecture to be held in Crockett C Sponsored by the Social Network Analysis TIG Presenters - Kimberly Fredericks, The Sage Colleges 776 - Evaluation Challenges in Designing and Implementing a Program Evaluation: The Experience of the Centers for Disease Control and Prevention‘s (CDC) Colorectal Cancer Control Program and Prevention IS Care (PIC) MultiPaper to be held in Crockett D Sponsored by the Government Evaluation TIG Chair - Amy DeGroff, Centers for Disease Control and Prevention Planning an Impact Evaluation: The Experience of the CDC's Colorectal Cancer Control Program Amy DeGroff, CDC; Michelle Revels and Danielle Beauchesne, ICF Macro International; Djenaba Joseph, CDC; Anna Krivelyova, ICF Macro International; Janet Royalty, Florence Tangka, and Faye Wong, Centers for Disease Control and Prevention; and Susan Zaro, ICF Macro International Addressing the Evaluation Challenges of a Nationwide Campaign for Health Care Providers: CDC‘s Prevention IS Care H Pamela De La Cerda and Jami Fraze, Centers for Disease Control and Prevention 777 - Exploring the Role of Software in Qualitative Analysis Multipaper to be held in Seguin B Sponsored by the Qualitative Methods TIG Chair and Discussant - Janet Usinger, University of Nevada, Reno Promoting Emergent Qualitative Inquiry Within Structured Evaluation Practices Through NVivo Dan Kaczynski and Michelle Salmona, Central Michigan University Individual Versus NVivo Jenny May and Robert Petrulis, University of South Carolina 778 - Simulation Model of Evaluation Biases Under Post Conflict Zones Demonstration to be held in Republic A Sponsored by the International & Cross-cultural Evaluation TIG Mamadou Sidibe, International Relief & Development 779 - Healthy Aging and Health Screenings: Lessons Learned Through Participatory Evaluations Multipaper to be held in Republic B Sponsored by the Health Evaluation TIG Chair - Susan M Wolfe, Susan Wolfe and Associates LLC Discussant - Michael Harnar, Claremont Graduate University Improving the Practical Implementation of Effectiveness Trials in a Primary Care Setting Katarzyna Alderman, Battelle Memorial Institute; Margaret J Gunter, LCF Research; Judith Lee Smith, Centers for Disease Control and Prevention; Gary Chovnick, Linda Winges, and Susan Pearce, Battelle Memorial Institute; April Salisbury, LCF Research; Deirdre Shires, Henry Ford Health System; Danuta Kasprzyk and Daniel Montano, Battelle Memorial Institute; and Jennifer Elston Lafata, Virginia Commonwealth University Participatory Evaluation in a Program to Promote Well-Aging Among Persons With Intellectual and Developmental Disability Karen Widmer, Independent Consultant 780 - Contextual Influences on the Evaluator, the Evaluation, and the Evaluation Design Multipaper to be held in Republic C Sponsored by the Theories of Evaluation TIG Chair - James Griffith, Claremont Graduate University Experimental Evaluation: Dealing With Random Assignment of Individuals Within Units Andrea Beesley and Sheila A Arens, Mid-continent Research for Education and Learning Evaluation Influence Within Population Health Partnerships: A Conceptual Framework Sarah Appleton-Dyer, Janet Clinton, and Peter Carswell, University of Auckland Evaluation 2010: Saturday, November 13, 10:00 AM – 10:45 AM Page 144 Notes: Evaluation 2010: Saturday, November 13, 10:00 AM – 10:45 AM Page 145 Summary of Sessions for Saturday, November 13, 10:55 AM to 12:25 PM No Primary Sponsor Session Session Title Room 782 Presidential Strand Panel Mixed Methods Contributions to Evaluation Quality Lone Star A 783 AEA Conference Committee Skill-building Writing Effective Items for Survey Research and Evaluation Studies Lone Star B 784 Collaborative, Participatory & Empowerment Skill-building Collaborative Evaluations Lone Star C 785 Non-profit and Foundations Evaluation TIG Demonstration A Foundation-to-Foundation Partnership: What Went Right, What Took Time - A Look at the Robert Wood Johnson… Lone Star D 786 Quantitative Methods: Theory and Design TIG Demonstration Using Rasch Measurement to Strengthen Evaluation Designs and Outcomes Lone Star E 787 Cluster, Multi-site & Multi-level Evaluation TIG Panel Extended Learning: A Conversation Among Evaluators of the National Science Foundation (NSF) Extension Services Projects Lone Star F 788 Disabilities and Other Vulnerable Populations Roundtable Preparing Teacher Candidates for Parent Partnerships: An Evaluation of a Preservice Course in Teacher Education Mission A 789 Evaluation Policy TIG Multipaper Cross-National Evaluation Policies: Where We've Been, Where We're Going, and What We Need for Quality Evaluation Mission B 790 Systems in Evaluation TIG MultiPaper The Home Energy Audit: An Exercise in Complex Systems Thinking for Practitioners and Evaluators Alike Bowie A 791 Indigenous Peoples in Evaluation TIG Demonstration The REWA System of Transformative Evaluation: Founded on Pono (Truth), Ahua (Beauty) and Tika (Justice) - Evaluating… Bowie C 792 Teaching of Evaluation TIG Roundtable Rotation I: Who Do They Think We Are? Issues and Dilemmas Raised by Others' Perceptions of Evaluators and Evaluation Rotation II: Resources to Guide Non-evaluators in the Design of Educational Program Evaluations Goliad 793 Theories of Evaluation TIG Roundtable Rotation I: Evaluation in Late Victorian Literature Rotation II: Epistemological Distinctions and Values in the Evaluation Process: A Reflective Analysis on the Quality… San Jacinto 794 Evaluation Use TIG Think Tank Making Results Relevant: Designing Evaluations Stakeholders Will Value, Understand, and Use Travis A 795 Integrating Technology Into Evaluation TIG Demonstration An Integrated Web-based Assessment, Planning, and Evaluation System for Strengthening Families Programs… Travis B 796 Multiethnic Issues in Evaluation TIG Demonstration Construct Validity of Race and Its Impact on the Quality of Research and Evaluation Travis C 797 Health Evaluation TIG Multipaper Strategies and Tools to Evaluate the Comprehensive Picture of Health Policy Travis D 798 Human Services Evaluation TIG Multipaper Mixed Methods and Multiple Measures in Quality Human Services Evaluation: Lessons Learned Independence 799 Quantitative Methods: Theory and Design TIG Multipaper Application of Propensity Score Analysis in Assessing Outcomes Presidio A 800 Org Learning & Evaluation Capacity Bldg TIG MultiPaper A Radically Different Approach to Evaluator Competencies Presidio B 801 Alcohol, Drug Abuse, and Mental Health TIG Multipaper Use of Administrative Data for Management and Policy Making Presidio C 802 Pre-K - 12 Educational Evaluation TIG Roundtable Rotation I: Overcoming Data Quality Challenges to Evaluation of School-based Programs Rotation II: Standardizing Literacy Data Analyses and Reporting Across Multiple Instruments and Grades Bonham A 803 Non-profit and Foundations Evaluation TIG Multipaper Evaluating Family and Community Change Bonham B 804 Pre-K - 12 Educational Evaluation TIG Multipaper Practical Issues in Educational Measurement and Assessment Bonham C Evaluation 2010: Saturday, November 13, 10:55 AM – 12:25 PM Page 146 Summary of Sessions for Saturday, November 13, 10:55 AM to 12:25 PM No Primary Sponsor Session Session Title Room 805 Costs, Effectiveness, Benefits, and Economics Think Tank Quality Evaluation: Avoiding Hypocrisy by Formative Evaluation of Evaluation's Outcomes, Processes, and Costs Bonham D 807 Government Evaluation TIG MultiPaper Conceptualizing and Conducting Quality Peer Reviewed Portfolio Evaluations: Approaches & Lessons Learned From the CDC Texas A 808 Evaluation Managers and Supervisors TIG Demonstration Successfully Managing Evaluation Projects: Quality Solutions to Common Project Management Challenges Texas B 809 Mixed Methods Evaluation TIG Multipaper Using Mixed Methods to Evaluate Program Implementation and Inter-agency Collaboration Texas C 810 Research, Technology, and Development MultiPaper Evaluation of National Research and Development (R&D) Programs as a Tool for Increasing Efficiency of Public Finance Texas D 811 Evaluation Use TIG Multipaper Evaluators Thinking Evaluatively About Use: Tips for the Trade Texas E 812 Research on Evaluation Multipaper Research on Participatory Evaluation Texas F 813 Extension Education Evaluation TIG Skill-building Evaluating Advocacy Efforts in Cooperative Extension and Other Outreach Organizations Crockett A 814 Teaching of Evaluation TIG MultiPaper Experiencing Quality in Evaluation Training in Brazil and Ethiopia Crockett B 815 International and Cross-cultural Evaluation TIG Think Tank Quality and International Evaluation Crockett C 816 Disaster & Emergency Management Evaluation Multipaper Development and Selection of Frameworks and Constructs for Disaster Preparedness and Recovery Evaluation Crockett D 817 Graduate Student and New Evaluator TIG Panel Reflections of Emerging Professionals: The Culturally Responsive Path Ahead Seguin B 819 Health Evaluation TIG Panel Operational Research and Monitoring and Evaluation: Can We Forge a Partnership? Republic B 820 Collaborative, Participatory & Empowerment Multipaper Empowerment Evaluations: Insights, Reflections, and Implications Republic C Evaluation 2010: Saturday, November 13, 10:55 AM – 12:25 PM Page 147 Saturday, 10:55 am to 12:25 pm 782 - Mixed Methods Contributions to Evaluation Quality Panel to be held in Lone Star A Sponsored by the Presidential Strand Chair - Donna Mertens, Gallaudet University Discussant s - Melvin Mark, Pennsylvania State University; and Kataraina Pipi, Independent Consultant What is Quality Empirical Social Science From a Mixed Methods Perspective? Abbas Tashakkori, University of North Texas Bridging Quality in Mixed Methods Inquiry With Evaluation Theory and Practice Donna Mertens, Gallaudet University How Does the Mix of Methods Enhance Evaluation Quality in the Field? Jori Hall, University of Georgia; Jennifer Greene, University of Illinois at Urbana-Champaign 783 - Writing Effective Items for Survey Research and Evaluation Studies Skill-building Workshop to be held in Lone Star B Sponsored by the AEA Conference Committee Jason Siegel and Eusebio Alvaro, Claremont Graduate University 784 - Collaborative Evaluations Skill-building Workshop to be held in Lone Star C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Liliana Rodriguez-Campos, University of South Florida; and Rigoberto Rincones-Gomez, Maryland Distribution Council Inc 785 - A Foundation-to-Foundation Partnership: What Went Right, What Took Time - A Look at the Robert Wood Johnson Foundation and the Northwest Health Foundation Partnership- Partners Investing in Nursing‘s Future Demonstration to be held in Lone Star D Sponsored by the Non-profit and Foundations Evaluation TIG Ricardo Millett, Ricardo Millett and Associates; and Chantell Johnson, TCC Group 786 - Using Rasch Measurement to Strengthen Evaluation Designs and Outcomes Demonstration to be held in Lone Star E Sponsored by the Quantitative Methods: Theory and Design TIG Christine Fox and Svetlana Beltyukova, University of Toledo 787 - Extended Learning: A Conversation Among Evaluators of the National Science Foundation (NSF) Extension Services Projects Panel to be held in Lone Star F Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG Chair - Beverly Farr, MPR Associates Inc Can We Really Do It All? Yes... Within Reason Elizabeth Bachrach, Goodman Research Group Inc Use of Technology in Evaluation: How Does It Help and How Does It Hinder? Vicky Ragan, Evaluation and Research Associates Finding Common Ground: Is It possible? Beverly Farr, MPR Associates Inc Strategies for Guiding and Tracking Sustainability: Will It Last? Donna Brock, Evaluation Consulting Services Inc 788 – Roundtable in Mission A Sponsored by the Disabilities and Other Vulnerable Populations and the Mixed Methods Evaluation TIGs Preparing Teacher Candidates for Parent Partnerships: An Evaluation of a Preservice Course in Teacher Education Michael Wischnowski, Marie Cianca, Susan Hildenbrand, and Daniel Kelly, St John Fisher College 789 - Cross-National Evaluation Policies: Where We've Been, Where We're Going, and What We Need for Quality Evaluation Multipaper to be held in Mission B Sponsored by the Evaluation Policy TIG Chair - Marie Gaarder, International Initiative for Impact Evaluation (3ie) Discussant - Jim Rugh, Independent Consultant Strengthening Evaluation Policy in Saudi Arabia for Higher Evaluation Quality Mohammed Alyami, Western Michigan University Institutionalising Evaluation: By Decree or by Persuasion? Marie Gaarder, International Initiative for Impact Evaluation (3ie); and Bertha Briceno, World Bank Evaluation and the Shifting Meanings of Accountability in Education in Five Nations Christina Segerholm, MidSweden University; and Jenny Ozga, University of Edinburgh Evaluation 2010: Saturday, November 13, 10:55 AM – 12:25 PM Page 148 790 - The Home Energy Audit: An Exercise in Complex Systems Thinking for Practitioners and Evaluators Alike MultiPaper to be held in Bowie A Sponsored by the Systems in Evaluation and the Environmental Program Evaluation TIGs Chair - Daniel Folkman, University of Wisconsin, Milwakee A Small Contractor‘s Perspective: From Business Operations, to Customer Education, to Changing Rules and Regulations in the Home Improvement and Restoration Industry Juanita M Ellias, Rivercity Woodworking LLC From Assessing Building Performance to Setting Standards and Expectations for Professional Practice Among Home Energy Auditors and Consultants Keith Williams, Building Services and Consultant LLC An Emerging Model of Embedded Evaluation Practice in the Home Energy Conservation Industry Daniel Folkman, University of Wisconsin, Milwakee 791 - The REWA System of Transformative Evaluation: Founded on Pono (Truth), Ahua (Beauty) and Tika (Justice) - Evaluating Health and Well-being From Te Ao Maori/Indigenous World-view, Protocol, and Practice Demonstration to be held in Bowie C Sponsored by the Indigenous Peoples in Evaluation TIG Tania Wolfgramm and Wikuki Kingi, Pou Kapua Consulting 792 – Roundtables in Goliad The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Teaching of Evaluation TIG Rotation 1: Resources to Guide Non-evaluators in the Design of Educational Program Evaluations Rick Axelson and Susan Lenoch, University of Iowa Rotation 2: Who Do They Think We Are? Issues and Dilemmas Raised by Others' Perceptions of Evaluators and Evaluation Loretta Kelley, Kelley, Petterson and Associates; and Philip Henning, James Madison University 793 – Roundtables in San Jacinto The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Theories of Evaluation TIG and the Teaching of Evaluation TIG Rotation 1: Epistemological Distinctions and Values in the Evaluation Process: A Reflective Analysis on the Quality Standards of Truth, Beauty, and Justice Using Findings From an Actual Evaluation Study Sarah Wilkey, Zarrina Azizova, Zhanna Shatrova, and Katye Perry, Oklahoma State University Rotation 2: Evaluation in Late Victorian Literature David D Williams, Brigham Young University 794 - Making Results Relevant: Designing Evaluations Stakeholders Will Value, Understand, and Use Think Tank to be held in Travis A Sponsored by the Evaluation Use TIG Presenter - Anita Drever, University of Wyoming Discussants - Paul St Roseman, DataUse Consulting Group; and Javan Ridge, Colorado Springs School District 11 795 - An Integrated Web-based Assessment, Planning, and Evaluation System for Strengthening Families Programs Across the Nation Demonstration to be held in Travis B Sponsored by the Integrating Technology Into Evaluation TIG Lauren Pugh and Michael Bates, Mosaic Network Inc 796 - Construct Validity of Race and Its Impact on the Quality of Research and Evaluation Demonstration to be held in Travis C Sponsored by the Multiethnic Issues in Evaluation TIG Kelly Robertson and Diane Rogers, Western Michigan University 797 - Strategies and Tools to Evaluate the Comprehensive Picture of Health Policy Multipaper to be held in Travis D Sponsored by the Health Evaluation TIG Chair - Jenica Huddleston, University of California, Berkeley Issues in Evaluating Health Care Information Dissemination Programs Boris Volkov, University of North Dakota Assessing Health Policy Change Using an Online Survey Instrument Annette Gardner and Claire Brindis, University of California, San Francisco; Lori Nascimento, California Endowment; and Sara Geierstanger, University of California, San Francisco Evaluating the Impact of the Louisiana Campaign for TobaccoFree Living: The Importance of Comprehensive Evaluation Strategies Nikki Lawhorn, Lisanne Brown, and Jenna Klink, Louisiana Public Health Institute Evaluation 2010: Saturday, November 13, 10:55 AM – 12:25 PM Page 149 Saturday, 10:55 am to 12:25 pm, continued 798 - Mixed Methods and Multiple Measures in Quality Human Services Evaluation: Lessons Learned Multipaper to be held in Independence Sponsored by the Human Services Evaluation TIG Chair - Barry Cohen, Rainbow Research Inc Evaluating a Child Welfare Demonstration Program: Evolution, Considerations, and Lessons Learned Stella SiWan Zimmerman, Action Consulting and Evaluation Team (ACET) Inc; Heather Scholz, Wayside Housr; Kirsten L Rewey, Action Consulting and Evaluation Team (ACET) Inc; and Ellie Skelton, The Wayside House Inc A Multi-faceted Implementation Assessment: Comparing Ratings From Observers, Supervisors, Staff, and Clients to Examine Program Implementation Kristin Duppong Hurley and Nikki Wheaton, University of Nebraska, Lincoln Evaluating a Child Care Quality Rating and Improvement System: Lessons Learned Michel Lahti, Allyson Dean, and Sarah Rawlings, University of Southern Maine Synthesis of a Multi-component Five-Year National Evaluation: Results and Lessons Learned Allan Porowski, Aikaterini Passa, and Kelle Basta, ICF International; and Susan Siegel, Communities In Schools 799 - Application of Propensity Score Analysis in Assessing Outcomes Multipaper to be held in Presidio A Sponsored by the Quantitative Methods: Theory and Design TIG Chair - MH Clark, University of Central Florida Using Propensity Scores with Small Samples William Holmes, University of Massachusetts, Boston; and Lenore Olsen, Rhode Island College The Utility of Propensity Score Matching in the Context of Evaluation Corina Owens and Connie Walker-Egea, University of South Florida A Comparison of Genetic Matching and Propensity Score Matching Methods for Covariate Adjustment in a Reading Intervention Program Evaluation Ning Rui and Debra Coffey, Research for Better Schools 800 - A Radically Different Approach to Evaluator Competencies MultiPaper to be held in Presidio B Sponsored by the Organizational Learning and Evaluation Capacity Building TIG Chair - Jane Davidson, Real Evaluation Ltd Discussants - Michael Scriven, Claremont Graduate University; and Rodney Hopson, Duquesne University Privileging Culture and Cultural Competence in an Evaluator Competency Framework Nan Wehipeihana, Research Evaluation Consultancy Limited Defining the ‗Good‘ Evaluator – What‘s in, What‘s out? A Question of Whose Boundaries? Kate McKegg, Knowledge Institute Ltd Using Evaluator Competencies in Practice: Evaluative Quality Assurance in Tertiary Education in Aotearoa, New Zealand Syd King, New Zealand Qualifications Authority 801 - Use of Administrative Data for Management and Policy Making Multipaper to be held in Presidio C Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG Chair - Stephen Magura, Western Michigan University Workforce Challenges in Behavioral Healthcare: A Model Approach to Gathering Systematic Information About Staffing Problems Faced by State Agencies, Programs, and Staff John Hornik, Jenneth Carpenter, and Jeanine Hanna, Advocates of Human Potential; and David Wright and Lorrie Byrum, Oklahoma Department of Mental Health and Substance Abuse Services Community Data Collection Systems: Gaps and Recommendations John Carnevale, Carnevale Associates LLC; and Beverlie Fallik, United States Department of Health and Human Services 802 – Roundtables in Bonham A The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Pre-K - 12 Educational Evaluation TIG Rotation 1: Standardizing Literacy Data Analyses and Reporting Across Multiple Instruments and Grades Ashley Kurth and Gretchen Biesecker, City Year Inc Rotation 2: Overcoming Data Quality Challenges to Evaluation of School-based Programs Lisa Garbrecht, Shanelle Boyle, Tronie Rifkin, and Mona Desai, EVALCORP Evaluation 2010: Saturday, November 13, 10:55 AM – 12:25 PM Page 150 803 - Evaluating Family and Community Change Multipaper to be held in Bonham B Sponsored by the Non-profit and Foundations Evaluation TIG Chair - Joanne Carman, University of North Carolina at Charlotte Capturing Community-level Outcomes Through Responsive Evaluation: An Example of a New York City Settlement House Elizabeth Coker, Lenox Hill Neighborhood House Uniting for Community Change: Lessons from Charlotte, North Carolina Joanne Carman, University of North Carolina at Charlotte Getting to the Core: A Multi-site Mixed Methods Evaluation of Neighbor-to-Neighbor Helping, Also Known as Neighboring Brandee Menoher, Points of Light Institute; and Colleen Kassouf Mackey, Points of Light Institute An Evaluation of the Whole Child Website: Lessons Learned From a Low-Budget Community Focus Group Breanne Porter and Mercedes Nalls, Florida State University 804 - Practical Issues in Educational Measurement and Assessment Multipaper to be held in Bonham C Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Wendy DuBow, National Center for Women and Information Technology What Teachers Need in Terms of Results Versus What is Commonly Reported: Some Standard Deviations? Guido Gatti and Katya Petrochenkov, Gatti Evaluation Inc The Impact of Releasing Rubrics on Performance Assessment Scores Ashlee Lewis, Min Zhu, and Xiaofang Zhang, University of South Carolina The Instructional Impact of North Dakota State Accountability System: A Consequential Validity Study Xin Wang, Mid-continent Research for Education and Learning Defining Domains of Coaching Knowledge Using a Modified Delphi Process John Sutton, RMC Research Corporation; and Beth Burroughs and David Yopp, Montana State University 805 - Quality Evaluation: Avoiding Hypocrisy by Formative Evaluation of Evaluation's Outcomes, Processes, and Costs Think Tank to be held in Bonham D Sponsored by the Costs, Effectiveness, Benefits, and Economics TIG Presenter - Sarah Hornack, American University Discussant - Brian Yates and Jose Hermida, American University 807 - Conceptualizing and Conducting Quality Peer Reviewed Portfolio Evaluations: Approaches and Lessons Learned From the Centers for Disease Control and Prevention (CDC) MultiPaper to be held in Texas A Sponsored by the Government Evaluation TIG Chair and Discussant - Sue Lin Yee, Centers for Disease Control and Prevention Maximizing Quality in a Portfolio Review of the National Center for Injury Prevention and Control‘s (NCIPC) Core State Injury Program Elyse Levine, Academy for Educational Development; Sue Lin Yee, Centers for Disease Control and Prevention; Derek Inokuchi, Academy for Educational Development; and Angela Marr, Centers for Disease Control and Prevention Getting the Most From Expert Reviews of Public Health Programs: Barriers and Facilitators of Quality, Relevance, and Utility Esther Sumartojo and Tom Bartenfeld, Centers for Disease Control and Prevention External Program Reviews in the Office of Public Health Preparedness and Response at CDC Barbara Ellis, Centers for Disease Control and Prevention 808 - Successfully Managing Evaluation Projects: Quality Solutions to Common Project Management Challenges Demonstration to be held in Texas B Sponsored by the Evaluation Managers and Supervisors TIG Presenters - Kathy Brennan and Veena Pankaj, Innovation Network 809 - Using Mixed Methods to Evaluate Program Implementation and Inter-agency Collaboration Multipaper to be held in Texas C Sponsored by the Mixed Methods Evaluation TIG Chair - Sandra Bridwell, Cambridge College Discussant - Michele Tarsilla, Western Michigan University Systems Approach and Mixed Methods in Evaluation Within a Collaborative Context Jianglan White, Georgia Department of Community Health; and Dafna Kanny, Centers for Disease Control and Prevention Assessing Collaborative Functioning: Identification of Factors Associated With Longevity and Perceived Effectiveness Ann Peisher, Virginia Dick, and Amy Laura Arnold, University of Georgia; Robetta McKenzie and Katrina Aaron, Augusta Partnership for Children Inc; and Don Bower, University of Georgia Evaluation 2010: Saturday, November 13, 10:55 AM – 12:25 PM Page 151 Saturday, 10:55 am to 12:25 pm, continued 810 - Evaluation of National Research and Development (R&D) Programs as a Tool for Increasing Efficiency of Public Finance MultiPaper to be held in Texas D Sponsored by the Research, Technology, and Development Evaluation TIG Chair - Seung Jun Yoo, Korea Institute of Science & Technology Evaluation and Planning (KISTEP) Trends in the Performance Evaluation System of the National R&D Program in Korea Ho-Dong Lee, Rae-Young Kim, and Jae-Young Kim, Ministry of Strategy and Finance Ex-ante Evaluation of the Validity and Economic Impact of Nanotechnology Public R&D Program in Korea Yun Jong Kim, Korea Institute of Science & Technology Evaluation and Planning (KISTEP); Dae Hyun Jeong, Korea Zinc Inc; and Jiho Hwang, Korea Institute of Science & Technology Evaluation and Planning (KISTEP) Evaluation of Effectiveness for the Public Environmental R&D Program in Korea Heekweon Lee, Jungseok Hong, and Hyunjung Cho, Korea Institute of Science & Technology Evaluation and Planning (KISTEP); and Suho Bae, Sungkyunkwan University Evaluation of Horizontal Public R&D Programs: A Case Study in Korea Hwan Lee, Seung Jun Yoo, and Boojong Gill, Korea Institute of Science & Technology Evaluation and Planning (KISTEP) 811 - Evaluators Thinking Evaluatively About Use: Tips for the Trade Multipaper to be held in Texas E Sponsored by the Evaluation Use TIG Chair - Helene Jennings, ICF Macro Reframing the Goals of an Evaluation During Program Dissolution: What Can Evaluation Offer? Christine Doe, Michelle Searle, and Lyn Shulha, Queen's University at Kingston Using Evaluation Data for Secondary Independent Research: Lessons From Two Studies Kari Nelsestuen, Caitlin Scott, and Theresa Deussen, Education Northwest Evaluator Perceptions of Process Use Lennise Baptiste, Kent State University Federal Mandates and Guidelines and How This Impacts Program Evaluation Andrea Wood, Rashell Bowerman, Gary Miron, and Patricia Moore, Western Michigan University Emerging Concepts and Tools for Developing and Assessing Evaluation Capacity of Educational Networks and Partnerships: An Iterative Approach Ed McLain, University of Alaska, Anchorage; and Susan Tucker, Evaluation & Development Associates 812 - Research on Participatory Evaluation Multipaper to be held in Texas F Sponsored by the Research on Evaluation TIG Chair - Michael Szanyi, Claremont Graduate University An Overview of the Empirical Studies of Stakeholder Involvement in Program Evaluation Landry Fukunaga and Paul Brandon, University of Hawaii An Investigation of the Relationship Between Participatory Evaluation and Use of Evaluation in Three Multi-site Evaluations Denise Roseland, University of Minnesota Boldly Going Inward, Outward, and Forward: Studying (How to Study) the Intersection of Theory and Practice in Evaluation Jeehae Ahn, University of Illinois at Urbana-Champaign 813 - Evaluating Advocacy Efforts in Cooperative Extension and Other Outreach Organizations Skill-building Workshop to be held in Crockett A Sponsored by the Extension Education Evaluation TIG Allison Nichols, West Virginia University Extension; Teresa McCoy, University of Maryland; and Florita Montgomery, West Virginia University Extension 814 - Experiencing Quality in Evaluation Training in Brazil and Ethiopia MultiPaper to be held in Crockett B Sponsored by the Teaching of Evaluation TIG Chair - Marly Cruz, National School of Public Health (ENSP/Fiocruz) Resistance and Adoption: Challenges to Change Public Health Professionals in Evaluators in Situation Elizabeth Moreira dos Santos, Oswaldo Cruz Foundation (Fiocruz); Marly Cruz, Pedro Paulo Chrispim, and Ana Reis, National School of Public Health (ENSP/Fiocruz); and Ana Roberta Pascom, National Aids Program, Brazil Contributing to Increase Evaluative Practices in Public Health Institution in Brazil Eronildo Felisberto, Municipal Institute for Research and Planning; and Isabella Samico and Luciana Santos Dubeux, Instituto de Medicina Building Health Evaluation Capacity in Africa: A University Based Training Program in Ethiopia Wuleta Lemma, Tulane University; Yibeltal Kiflie and Woldemichael Kiflie, Jimma University; and Elizabeth Moreira dos Santos, Oswaldo Cruz Foundation (Fiocruz) Evaluation 2010: Saturday, November 13, 10:55 AM – 12:25 PM Page 152 815 - Quality and International Evaluation Think Tank to be held in Crockett C Sponsored by the International & Cross-cultural Evaluation TIG Presenters - Ross Conner, University of California, Irvine; and Alexey Kuzmin, Process Consulting Company Discussansts - Michael Bamberger, Independent Consultant; Tessie Catsambas, EnCompass LLC; Thomaz Chianca, COMEA Evaluation Ltd; and J Bradley Cousins, University of Ottawa 816 - Development and Selection of Frameworks and Constructs for Disaster Preparedness and Recovery Evaluation Multipaper to be held in Crockett D Sponsored by the Disaster and Emergency Management Evaluation TIG Chair - Scott Aminov, Food For The Hungry Discussant - Patricia Bolton, Battelle Memorial Institute Homeland Security: Evaluating With Management System Standards Sharon Caudle, Texas A&M University Tribal Disaster Preparedness Assessment: Assessing the Competency, Capacity, and Capability Needs of American Indian Nations Lisle Hites, University of Alabama at Birmingham; and Jessica Wakelee, University of Arizona 817 - Reflections of Emerging Professionals: The Culturally Responsive Path Ahead Panel to be held in Seguin B Sponsored by the Graduate Student and New Evaluator TIG Chair - Jill Jim, Independent Consultant Discussant - Pauline Brooks, Independent Consultant Seeing the Iceberg Under the Surface: Reflections on Developing as a Culturally Responsive Evaluator Katrina Ellis, University of Michigan Cultural Competence in Philanthropy: Reflections From an Emerging Professional Summer Jackson, Independent Consultant Perceptions and Education for Researchers to Work With American Indian Groups to Improve Quality Jill Jim, Independent Consultant I Have Needs Too: Culturally Responsive Evaluation Meeting the Needs of Nonprofits and Evaluators Domingo Moronta, St Barnabas Hospital Operational Research and HIV Prevention Jeffrey Herbst, Centers for Disease Control and Prevention Program Evaluation and HIV Prevention Dale Stratford, Centers for Disease Control and Prevention Program Evaluation and Operational Research: Is There a Difference - Does It Matter? Marlene Glassman, Centers for Disease Control and Prevention 820 - Empowerment Evaluations: Insights, Reflections, and Implications Multipaper to be held in Republic C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Chair - Candace Sibley, University of South Florida Engaging Youth in Program Evaluation: An Exploration of Current Practices Kristi Lekies, The Ohio State University Forecast: Applications, Innovations, and Contributions to Formative Evaluation Theory and Practice Abraham Wandersman, Jason Katz, and Sarah Griffin, University of South Carolina; Robert Goodman, Indiana University; and Dawn Wilson, University of South Carolina The Need for Social Theories of Power in Empowerment Evaluation Thomas Archibald, Cornell University Where is the Power in Empowerment Evaluation (EE): Locating Power and Understanding its Role Within EE Process Divya Bheda, University of Oregon Saturday, 12:35 pm to 1:30 pm 821 - Feminist Issues in Evaluation TIG Business Meeting Business Meeting to be held in Goliad Sponsored by the Feminist Issues in Evaluation TIG TIG Leaders - Kathryn A Bowen, Centerstone Research Institute Michael Bamberger, Independent Consultant Linda Thurston, National Science Foundation 819 - Operational Research and Monitoring and Evaluation: Can We Forge a Partnership? Panel to be held in Republic B Sponsored by the Health Evaluation TIG Chair - Thomas Chapel, Centers for Disease Control and Prevention Evaluation 2010: Saturday, November 13, 10:55 AM – 12:25 PM, 12:35 PM – 1:30 PM Page 153 Summary of Sessions for Saturday, November 13, 1:40 PM to 2:25 PM No Primary Sponsor Session Session Title Room 822 Presidential Strand Expert Lecture A Conversation With Ernest House Lone Star A 823 Program Theory and Theory-driven Evaluation Panel Culturally Responsive Theory-driven Evaluation: Understanding & Accurately Reflecting Cultural Contexts in Program Eval Lone Star B 824 Environmental Program Evaluation TIG Multipaper Estimating Climate Change and Its Use in Evaluation Lone Star C 825 Non-profit and Foundations Evaluation TIG Expert Lecture Evaluations Done Right: Paving the Way for Closing a Program Lone Star D 826 Quantitative Methods: Theory and Design TIG Multipaper A Closer Look at Non-Equivalent Designs in Evaluation Lone Star E 827 Cluster, Multi-site & Multi-level Evaluation TIG Multipaper Linking With Outcomes Lone Star F 828 Crime and Justice TIG Multipaper Dealing With Evaluation Challenges and Complexities in Policing and Prison Environments Mission A 829 AEA Conference Committee Multipaper Improving Survey Quality Mission B 830 Systems in Evaluation TIG Panel BUILD-ing an Institute for Child Success: The Statewide Systems Design for the South Carolina Institute for Child Success Bowie A 831 Advocacy and Policy Change TIG Multipaper The Role of Evaluation in Informing Local and State Policy Makers Bowie C 832 Qualitative Methods TIG Roundtable Use of Implementation Rubrics as Indicators of Evaluation Quality Goliad 833 Assessment in Higher Education TIG Roundtable Toward Improving the Evaluation Practice of Financial Education Programs: Key Issues and the Role of Formative Evaluation San Jacinto 834 Assessment in Higher Education TIG Demonstration Thinking About Thinking: Assessing Critical Thinking Instruction in Higher Education Travis A 835 Integrating Technology Into Evaluation TIG Skill-building Data Management: How Not to Lose Face Travis B 836 Org Learning & Evaluation Capacity Bldg TIG Panel Quick and Quality Level Three Evaluations for Corporate Staff Learning Travis C 837 Internal Evaluation TIG Multipaper Internal Evaluators: Contextual Considerations and Roles Travis D 838 Quantitative Methods: Theory and Design TIG Demonstration Replicating Experimental Impact Estimates Using a Regression Discontinuity Design Independence 839 Independent Consulting TIG Multipaper Overcoming the Limitations of the Educational Context to Increase Rigor Presidio A 840 Org Learning & Evaluation Capacity Bldg TIG Demonstration Using Logic Models to Build Evaluation Capacity at the Community Level: Enhancing Program Effectiveness by Building… Presidio B 841 Alcohol, Drug Abuse, and Mental Health TIG Multipaper Evaluating Mental Health Peer Support and Peer Specialist Programs Presidio C 842 Collaborative, Participatory & Empowerment Roundtable Negotiating Multiple Challenges While Maintaining Quality: Lessons From Urban:Rural Alaska Bonham A 843 College Access Programs TIG Multipaper Evaluation of Underrepresented Student College and Career Choice Programs Bonham B 844 Pre-K - 12 Educational Evaluation TIG Panel Fidelity Instruments and School Burden Bonham C 845 Pre-K - 12 Educational Evaluation TIG Multipaper Assessing the Use of Test Score Data to Inform Decisions About Student Achievement Bonham D 846 Environmental Program Evaluation TIG Multipaper Challenges and Recommendations From Evaluating Autobody Shop Environmental Compliance Programs Bonham E Evaluation 2010: Saturday, November 13, 1:40 PM – 2:25 PM Page 154 Summary of Sessions for Saturday, November 13, 1:40 PM to 2:25 PM, Continued No Primary Sponsor Session Session Title Room 847 Government Evaluation TIG Think Tank The Use of Program Progress Reports in Federal Government Program Evaluations Texas A 848 Assessment in Higher Education TIG Multipaper Evaluation in Community Colleges Texas B 849 Advocacy and Policy Change TIG Expert Lecture Establishing a Monitoring, Evaluation and Learning (MEL) System for Policy Reform: Lessons From Oxfam America‘s… Texas C 850 Research, Technology, and Development Multipaper Informing Portfolio Management Using Tracking Systems and Bibliometrics Texas D 851 Evaluation Use TIG MultiPaper Deeper Implementation of the Student Success Learning to Eighteen Strategy Through Developmental Evaluation Texas E 852 Research on Evaluation TIG Multipaper Research on Evaluator Competencies Texas F 853 Extension Education Evaluation TIG MultiPaper Using Observational Assessments to Measure and Improve Youth Program Quality Crockett A 854 Business and Industry TIG Expert Lecture The Thinking Corporation Crockett B 855 Social Network Analysis TIG Expert Lecture Reading Sociograms Crockett C 856 Government Evaluation TIG Multipaper Evaluating Government-Sponsored Education Programs Crockett D 857 Needs Assessment TIG Multipaper Designing Surveys for Use in Needs Assessments Seguin B 858 International and Cross-cultural Evaluation TIG MultiPaper Evaluating Peace Building and Conflict Prevention in Fragile States Republic A 859 Health Evaluation TIG Multipaper Successes and Lessons Learned From Evaluations of Long-Term HIV/AIDS Programs Republic B 860 Theories of Evaluation TIG MultiPaper Let Quality Guide Evaluation Quality: Recent Trends Implemented in the Middle East Republic C Evaluation 2010: Saturday, November 13, 1:40 PM – 2:25 PM Page 155 Saturday, 1:40 pm to 2:25 pm 822 - A Conversation With Ernest House Expert Lecture to be held in Lone Star A Sponsored by the Presidential Strand Chair - Leslie Cooksy, University of Delaware Presenter - Ernest House, University of Colorado 823 - Culturally Responsive Theory-driven Evaluation: Understanding and Accurately Reflecting Cultural Contexts in Program Evaluation Panel to be held in Lone Star B Sponsored by the Program Theory and Theory-driven Evaluation TIG Chair - Stewart Donaldson, Claremont Graduate University Discussant - Stafford Hood, University of Illinois at Urbana-Champaign; and Pauline Brooks, Independent Consultant Toward a Culturally Responsive Theory-driven Evaluation Science Stewart Donaldson, Claremont Graduate University Cultural Responsiveness in Theory-driven Evaluation: Increasing Accuracy in Theories of Change, Questions, and Methods in Community-based Settings Katrina Bledsoe, Walter R McDonald and Associates Inc 824 – Estimating Climate Change and Its Use in Evaluation Demonstration to be held in Lone Star C Sponsored by the Environmental Program Evaluation TIG Mende Davis and Owen Davis, University of Arizona 825 - Evaluations Done Right: Paving the Way for Closing a Program Expert Lecture to be held in Lone Star D Sponsored by the Non-profit and Foundations Evaluation TIG Lorna Escoffery, Escoffery Consulting Collaborative Inc 826 - A Closer Look at Non-Equivalent Designs in Evaluation Multipaper to be held in Lone Star E Sponsored by the Quantitative Methods: Theory and Design TIG Chair - George Julnes, University of Baltimore A New Strategy for Eliminating Selection Bias in Nonexperimental Evaluations Laura Peck, Arizona State University; and Furio Camillo and Ida D‘Attoma, University of Bologna The Truncation-by-Death Problem: What To Do in an Experimental Evaluation When the Outcome is Not Always Defined Sheena McConnell, Mathematica Policy Research; Elizabeth Stuart, Johns Hopkins University; and Barbara Devaney, Mathematica Policy Research 827 - Linking With Outcomes Multipaper to be held in Lone Star F Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG Chair - Yu Ping, Battelle Memorial Institute Using Large Scale Data Management Systems in the Evaluation of Multi-site Family Support Programs Pam Van Dyk, Evaluation Resources LLC; Bertha Gorham, Gorham Consulting; Linda Blanton, Cumberland County Partnership for Children; and Pat Hansen, The North Carolina Partnership for Children Assessing the Strength of Community Health Programming: A New Tool for Evaluators Amy A Sorg, Sarah C Shelton, Stephanie Herbers, Douglas Luke, and Bobbi Carothers, Washington University in St Louis 828 - Dealing With Evaluation Challenges and Complexities in Policing and Prison Environments Multipaper to be held in Mission A Sponsored by the Crime and Justice TIG Chair - Roger Przybylski, RKC Group How to Measure Police Performance: Handling of Methodological Challenges in a Complex Police Environment Morten Eikenes, Office of the Auditor General of Norway Getting Evaluation Findings Out of Prison: The Challenges of Doing Evaluation Work in a Total Institution Eric Graig, Usable Knowledge LLC 829 - Improving Survey Quality Multipaper to be held in Mission B Sponsored by the AEA Conference Committee Chair - Katherine Shaw, Westwood College Strategies for High Response Rates Among Hard-to-Reach Respondents: A Case Study From the Communities Empowering Youth National Evaluation Amy Minzner, Lindsay Fox and Christopher Mulvey, Abt Associates Inc Organizational Survey of Workplace Climate: Differences in Representation Across Response Modes David Mohr, Katerine Osatuke, Scott C Moore, Boris Yanovsky, and Thomas Brassell, United States Department of Veterans Affairs; and Mark Nagy, Xavier University Evaluation 2010: Saturday, November 13, 1:40 PM – 2:25 PM Page 156 830 - BUILD-ing an Institute for Child Success: The Statewide Systems Design for the South Carolina Institute for Child Success Panel to be held in Bowie A Sponsored by the Systems in Evaluation TIG and the Human Services Evaluation TIG Chair - Aimee Sickels, University of South Carolina Discussant - Julia Coffman, Center for Evaluation Innovation BUILD-ing The South Carolina Institute for Child Success Susan Shi, South Carolina Institute for Child Success; Laurie Rovin, United Way Of Greenville County; Desmond Kelly and Linda Brees, Greenville Hospital System; and Dennis Poole, University of South Carolina Looking Back, Thinking Forward: An Historical Analysis of a Child Wellness Initiative Via the BUILD Model Carl Maas and Leigh Hewlett, University of South Carolina 831 - The Role of Evaluation in Informing Local and State Policy Makers Multipaper to be held in Bowie C Sponsored by the Advocacy and Policy Change TIG Chair - Jared Raynor, TCC Group Must Policy-Makers Choose Between Putting Out Fires and Making Good Policy? Evaluator Observations From "The Belly of the Beast", also known as The Chicago Political Machine Amarachuku Enyia, University of Illinois at UrbanaChampaign Evidence of Impact: Informing Legislators to Improve Decisionmaking Sarah Bradford, Valerie York, Jan Middendorf, and Janice Cole, Kansas State University 832 – Roundtable in Goliad Sponsored by the Qualitative Methods TIG Use of Implementation Rubrics as Indicators of Evaluation Quality Elise Arruda Laorenza, Stephanie Feger, and Joye Whitney, Brown University 833 – Roundtable in San Jacinto Sponsored by the Assessment in Higher Education TIG Toward Improving the Evaluation Practice of Financial Education Programs: Key Issues and the Role of Formative Evaluation Nicole Jackson, University of California, Berkeley 834 - Thinking About Thinking: Assessing Critical Thinking Instruction in Higher Education Demonstration to be held in Travis A Sponsored by the Assessment in Higher Education TIG Linda Lynch, United States Army 835 - Data Management: How Not to Lose Face Skill-building Workshop to be held in Travis B Sponsored by the Integrating Technology Into Evaluation TIG Julien Kouame, Western Michigan University 836 - Quick and Quality Level Three Evaluations for Corporate Staff Learning Panel to be held in Travis C Sponsored by the Organizational Learning and Evaluation Capacity Building TIG Chair - Jaime Quizon, World Bank A Rigorous Evaluation of a Team Leadership Training Program in a Corporate Environment Jaime Quizon, World Bank A Quick and Quality Level 3 Evaluation of the Language and Culture Program in a Corporate Environment Valya Nikolova, World Bank 837 - Internal Evaluators: Contextual Considerations and Roles Multipaper to be held in Travis D Sponsored by the Internal Evaluation TIG Chair - Magdalena Rood, Third Coast R&D Inc Discussant - Joelle Greene, National Community Renaissance Making Sense of the Contemporary Roles of Internal Evaluators Boris Volkov, University of North Dakota Program Manager as Internal Evaluator: Challenges and Lessons Learned Anthony Kim, University of California, Berkeley 838 - Replicating Experimental Impact Estimates Using a Regression Discontinuity Design Demonstration to be held in Independence Sponsored by the Quantitative Methods: Theory and Design TIG Chair - Karen Larwin, Youngstown State University Presenters - Jillian Berk and Philip Gleason, and Alexandra Resch, Mathematica Policy Research 839 - Overcoming the Limitations of the Educational Context to Increase Rigor Multipaper to be held in Presidio A Sponsored by the Independent Consulting TIG Chair - Kathleen Haynie, Haynie Research and Evaluation Using an Interrupted Time Series Design to Evaluate the Impact of a Professional Development Program for Teachers Frederic Glantz, Kokopelli Associates LLC Collaborating With Clients to Develop Psychometric Parallel Teacher and Student Evaluation Kathryn Race, Race & Associates Ltd Evaluation 2010: Saturday, November 13, 1:40 PM – 2:25 PM Page 157 Saturday, 1:40 pm to 2:25 pm, continued 840 - Using Logic Models to Build Evaluation Capacity at the Community Level: Enhancing Program Effectiveness by Building Evaluation Skills Among Community Coalitions 844 - Fidelity Instruments and School Burden Demonstration to be held in Presidio B Sponsored by the Organizational Learning and Evaluation Capacity Building TIG Tiffany Comer Cook and Laura Feldman, University of Wyoming Panel to be held in Bonham C Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - David Merves, Evergreen Educational Consulting LLC Positive Behavior Intervention Support Model Overview and Instrumentation Patricia Mueller, Evergreen Educational Consulting LLC A Survey of Positive Behavior Intervention Support Schools: Using Fidelity Measures to Inform Decisions Brent Garrett, Pacific Institute for Research and Evaluation (PIRE) 841 - Evaluating Mental Health Peer Support and Peer Specialist Programs 845 - Assessing the Use of Test Score Data to Inform Decisions About Student Achievement Multipaper to be held in Presidio C Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG Chair - Gitanjali Shrestha, Washington State University Evaluation of Peer Support Programs: Implications for Utility and Accuracy Glenn Landers and Mei Zhou, Georgia State University Mixed Methods Evaluation of the Massachusetts Peer Specialist Training and Certification Program Heather Strother, Linda Cabral, Kathy Muhr, Laura Sefton, and Christine Clements, University of Massachusetts 842 – Roundtable in Bonham A Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Negotiating Multiple Challenges While Maintaining Quality: Lessons From Urban:Rural Alaska Rosyland Frazier and Alexandra Hill, University of Alaska, Anchorage 843 - Evaluation of Underrepresented Student College and Career Choice Programs Multipaper to be held in Bonham B Sponsored by the College Access Programs TIG Chair - Kurt Burkum, ACT Evaluation Strategies for Educational Career Pathway Programs: Targeting Underrepresented High-Performing Youth Sandra Eames and Fred Estrello, St Edward's University Evaluation of Summer Enrichment Programs as a Gateway for Low-Income Students to Experience and Choose College Mehmet Öztürk, Brian Garbarini, and Kerry Lawton, Arizona State University Multipaper to be held in Bonham D Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Tara Pearsall, Savannah College of Art and Design Discussant - Susan Henderson, WestEd Data Mining Electronically Linked Grade Three Standardized Assessment Scores From Kindergarten Assessments to Identify Performance Patterns Deborah Carran, Jacqueline Nunn, and Tamara Otto, Johns Hopkins university Using Student Test Scores to Evaluate Performance Steven Glazerman, and Liz Potamites, Mathematica Policy Research 846 - Challenges and Recommendations From Evaluating Autobody Shop Environmental Compliance Programs Multipaper to be held in Bonham E Sponsored by the Environmental Program Evaluation and the Business and Industry TIGs Chair - Dale Pahl, United States Environmental Protection Agency Use of Mixed Methods to Evaluate Three States' Environmental Results Programs (ERPs) John Heffelfinger and Scott Bowles, United States Environmental Protection Agency The Statistically Valid Pilot: Taking Advantage of Unique Opportunities to Design and Implement Rigorous Program Evaluations Tracy Dyke Redmond, Industrial Economics Inc; and Terell Lasane, United States Environmental Protection Agency 847 - The Use of Program Progress Reports in Federal Government Program Evaluations Think Tank to be held in Texas A Sponsored by the Government Evaluation TIG Rose Ann Renteria, Academy for Educational Development Evaluation 2010: Saturday, November 13, 1:40 PM – 2:25 PM Page 158 848 - Evaluation in Community Colleges Multipaper to be held in Texas B Sponsored by the Assessment in Higher Education TIG Chair - William Rickards, Alverno College Discussant - George Reinhart, University of Maryland Perspectives From the Field: Evaluation Approach of and Lessons Learned From an Evaluation of a Community College Learning Community Charyl Staci Yarbrough and Bill Mabe, Rutgers University Institutional and Programmatic Self-Evaluation in Higher Education Development: Telling Their Own Stories in a Consortium of Two-Year Institutions William Rickards, Alverno College 849 - Establishing a Monitoring, Evaluation and Learning (MEL) System for Policy Reform: Lessons From Oxfam America‘s Advocacy on More Country Ownership of United States Foreign Aid Expert Lecture to be held in Texas C Sponsored by the Advocacy and Policy Change TIG Omar Ortez, Oxfam America 850 - Informing Portfolio Management Using Tracking Systems and Bibliometrics Multipaper to be held in Texas D Sponsored by the Research, Technology, and Development Evaluation TIG Chair - Juan Rogers, School of Public Policy Georgia Institute of Technology The Impact of the United States-China collaboration on China's Research Performance: Evidence From Nanotechnology Publication Li Tang, Georgia Institute of Technology The Benefits and Challenges of Participatory Tracking Systems for Monitoring Institutional Change Marc Brodersen, Kathryn Nearing, Susan Connors, and Bonnie Walters, University of Colorado, Denver 851 - Deeper Implementation of the Student Success Learning to Eighteen Strategy Through Developmental Evaluation MultiPaper to be held in Texas E Sponsored by the Evaluation Use, the Organizational Learning and Evaluation Capacity Building, and the Pre-K - 12 Educational Evaluation TIGs Chair - Michael Quinn Patton, Utilization-focused Evaluation The Use of Student Success Indicators in the Student Success Learning to 18 Strategy: The Ontario Experience David Euale, Ontario Ministry of Education Utilization of Developmental Evaluation to Inform the Student Success School Support Initiative Keiko Kuji-Shikatani, Ontario Ministry of Education 852 - Research on Evaluator Competencies Multipaper to be held in Texas F Sponsored by the Research on Evaluation TIG Chair and Discussant - John LaVelle, Claremont Graduate University The Search for Evaluator Competency Inventories Jeanette Gurrola, Claremont Graduate University Constructing a Measure for Evaluator Competencies: Exploratory and Confirmatory Factor Analyses Jie Zhang, Syracuse University 853 - Using Observational Assessments to Measure and Improve Youth Program Quality MultiPaper to be held in Crockett A Sponsored by the Extension Education Evaluation TIG Chair - Kate Walker, University of Minnesota Matching Method to Purpose: Using Standardized Observational Assessment to Enhance Point of Service Quality Tom Devaney, Weikart Center for Youth Program Quality Using Youth and Adult Volunteer Assessors to Take Quality Improvement to Scale Kate Walker and Deborah Moore, University of Minnesota 854 - The Thinking Corporation Expert Lecture to be held in Crockett B Sponsored by the Business and Industry TIG David Frood, Independent Consultant 855 - Reading Sociograms Expert Lecture to be held in Crockett C Sponsored by the Social Network Analysis TIG Maryann Durland, Durland Consulting 856 - Evaluating Government-Sponsored Education Programs Multipaper to be held in Crockett D Sponsored by the Government Evaluation TIG Chair - Nicole Vicinanza, JBS International Inc Improving Outcomes in Learning at the Defense Language Institute: How Program Evaluation is Contributing to the Increased Language Proficiency of Military Linguists Melody Wall, Defense Language Institute The National Aeronautics and Space Administration's (NASA) Informal Education Program Evaluation: The Role of Context in Evaluation Alyssa Rulf Fountain and Hilary Rhodes, Abt Associates Inc; and Abigail Jurist Levy, Education Development Center Evaluation 2010: Saturday, November 13, 1:40 PM – 2:25 PM Page 159 Saturday, 1:40 pm to 2:25 pm, continued 857 - Designing Surveys for Use in Needs Assessments Multipaper to be held in Seguin B Sponsored by the Needs Assessment TIG Chair - Lora Warner, University of Wisconsin, Green Bay Discussant - Ann Del Vecchio, Alpha Assessment Associates The Effects of Scale Forms on Perceived Needs: An Example From a Study of Identifying Essential Competencies for Program Evaluators Yi-Fang Lee, National Chi Nan University; and James Altschuld, The Ohio State University Using Online Surveys to Assess Information Needs of Healthcare Professionals in Low Resource Settings: How is Data Quality Ensured? Saori Ohkubo and Tara Sullivan, Johns Hopkins University Essential Competency Needs for Program Evaluators in Taiwan Yi-Fang Lee, National Chi Nan University; James Altschuld, The Ohio State University; and Lung-Sheng Steven Lee, National United University 860 - Let Quality Guide Evaluation Quality: Recent Trends Implemented in the Middle East MultiPaper to be held in Republic C Sponsored by the Theories of Evaluation TIG and the Assessment in Higher Education TIG Chair - Eqbal Darandari, National Commission on Academic Assessment and Accreditation Discussant - Tahira Hoke, Prince Sultan University An Eclectic Approach to Evaluation for Higher Education Institutions: Lessons Learned in Saudi Arabia Eqbal Darandari, National Commission on Academic Assessment and Accreditation; and Tahira Hoke, Prince Sultan University An Empirical Approach to Evaluation for Higher Education Institutions: Opportunities in Saudi Arabia Tahira Hoke, Prince Sultan University; and Eqbal Darandari, National Commission on Academic Assessment and Accreditation 858 - Evaluating Peace Building and Conflict Prevention in Fragile States MultiPaper to be held in Republic A Sponsored by the International & Cross-cultural Evaluation TIG Chair - Krishna Kumar, United States Department of State Building the Architecture for Assessing the Performance of Peace Building Tjip Walker, United States Agency for International Development Lessons From Evaluations of Conflict Prevention and Peacebuilding Programs in Fragile States Asbjorn Eidhammer, Noweigian Agency for International Cooperation 859 - Successess and Lessons Learned From Evaluations of Long-Term HIV/AIDS Programs Multipaper to be held in Republic B Sponsored by the Health Evaluation TIG Chair - Miles McNall, Michigan State University Using Scorecards to Increase Compliance Among Medical Care Providers Working in AIDS Care Jennifer Catrambone, Ruth M Rothstein CORE Center Evaluating the Value of Capacity Building in Enhancing Aid Effectiveness; Key Findings and Lessons From the Largest President‘s Emergency Plan for AIDS Relief (PEPFAR) Grants Management Program in Africa Rita Sonko-Najjemba and Lynn McCoy, Pact Inc Evaluation 2010: Saturday, November 13, 1:40 PM – 2:25 PM Page 160 Notes: Evaluation 2010: Saturday, November 13, 1:40 PM – 2:25 PM Page 161 Summary of Sessions for Saturday, November 13, 2:50 PM to 4:20 PM No Primary Sponsor Session Session Title Room 862 Presidential Strand Panel Tools for Improving the Quality of Evaluations: Four Examples From the Field Lone Star A 863 Systems in Evaluation TIG Think Tank Integrating Evaluation Into Everyday Organizational Practice: A Complex Systems Perspective Lone Star B 864 Collaborative, Participatory & Empowerment Panel Advances in Stakeholder Consultation for Evaluation Quality Lone Star C 866 Quantitative Methods: Theory and Design TIG Demonstration What Am I Supposed to Do With Three-Way Crosstabs? An Introduction to Log Linear Models Lone Star E 867 Cluster, Multi-site & Multi-level Evaluation TIG Panel Meeting Needs of Multiple Stakeholders in a High-Scrutiny Multi-site Evaluation: Evaluation of the Communities Putting… Lone Star F 868 Lesbian, Gay, Bisexual, Transgender Issues TIG Panel Building Evaluation Capacity in Nonprofit Organizations Serving Lesbian, Gay, Bisexual and Transgender (LGBT) and HIV+… Mission A 869 Disabilities and Other Vulnerable Populations MultiPaper Evaluating Special Education Personnel Development Initiatives in Three Predominately Rural States: Emphasis on Fidelity… Mission B 870 Independent Consulting TIG MultiPaper Ensuring Quality in Our Work: Techniques Used by Independent Consultants Bowie A 872 Graduate Student and New Evaluator TIG Roundtable Rotation I: The Mentor/Mentee Relationship: Perspectives and Suggestions for Maintaining Successful Relationships Rotation II: Evaluating a Rite of Passage Program as a Vehicle for Systemic Change in At-risk Female Youths Attitudes… Goliad 873 Extension Education Evaluation TIG Roundtable Rotation I: The Unfocused Focus Group: Evaluation Benefit or Bane? Rotation II: eXtension Evaluation Community of Practice (CoP) Grows Up San Jacinto 874 Assessment in Higher Education TIG Multipaper The Importance of Critical Thinking in Assessment in Higher Education Travis A 875 Collaborative, Participatory & Empowerment Think Tank Positionality Matters: Understanding Culture and Context From the Perspective of Key Stakeholders Travis B 876 Multiethnic Issues in Evaluation TIG MultiPaper Practicing Culturally Responsive Evaluation: Graduate Education Diversity Internship (GEDI) Program Intern Reflections… Travis C 877 Evaluating the Arts and Culture TIG Multipaper Translating Visitors' Experiences Through Evaluation Travis D 878 Human Services Evaluation TIG Panel Community-Derived Research Partnerships: Working Together to Improve Human Services Independence 879 Distance Ed. & Other Educational Technologies Multipaper Online Learning in Adult and Postsecondary Education: Theory and Practice Presidio A 880 Org Learning & Evaluation Capacity Bldg TIG Multipaper Increasing Evaluation Capacity Through Different Levels of Training and Support Presidio B 881 Alcohol, Drug Abuse, and Mental Health TIG MultiPaper Evaluating a National Medicaid Children's Mental Health Demonstration Grant Program Presidio C 882 Pre-K - 12 Educational Evaluation TIG Roundtable Adaptations to Evaluation Design: Two Examples of Ensuring Quality in Practice Bonham A 883 Non-profit and Foundations Evaluation TIG Demonstration 2010 Report: State of Evaluation Practice and Capacity in the Nonprofit Sector Bonham B 884 Pre-K - 12 Educational Evaluation TIG Multipaper Evaluating the State of Charter Schools and Public Schools of Choice Bonham C 885 Costs, Effectiveness, Benefits, and Economics Multipaper Case Studies and Cost Studies Bonham D 886 Research, Technology, and Development Improving Proposals and Programs by Improving Peer and Stakeholder Review Bonham E Multipaper Evaluation 2010: Saturday, November 13, 2:50 PM – 4:20 PM Page 162 Summary of Sessions for Saturday, November 13, 2:50 PM to 4:20 PM No Primary Sponsor Session Session Title Room 887 Government Evaluation TIG MultiPaper Straw, Bricks, Construction: Improving Quality of Education Data, Performance Measures, and Evaluation to Enhance… Texas A 888 Qualitative Methods TIG Demonstration Web Dialogues: A New Tool for Evaluators Texas B 889 Mixed Methods Evaluation TIG Multipaper Challenges and Promises for Using Mixed Methods: Lessons From Implementing Mixed Methods Evaluation Texas C 890 Research, Technology, and Development MultiPaper Evaluation System of Research, Technology, and Development to Induce Innovation: Strategy, Process, and Reflection Texas D 891 Evaluation Use TIG Panel Thinking Outside the Evaluation Report Box: Transforming Evaluation Results Into a Structural Change Grantmaking Toolkit Texas E 892 Graduate Student and New Evaluator TIG Skill-building How to Write an Evaluation Plan Texas F 893 AEA Conference Committee Skill-building Say Goodbye to Power Point and Hello to Gallery Walks! Crockett A 894 Teaching of Evaluation TIG Panel Expanding Our Knowledgebase: Current Research on Teaching Evaluation Crockett B 895 Social Network Analysis TIG Think Tank The Network of Network Funders: Evaluating Networks and Evaluating with a Network Lens Crockett C 896 Disaster & Emergency Management Evaluation Multipaper Impact Evaluation of Approaches to Affect Local Resiliency to Disasters, Enhanced Public Health Emergency Peer Networks… Crockett D 897 Feminist Issues in Evaluation TIG Feminist Evaluation and Gender-Specific Programs Seguin B 898 International and Cross-cultural Evaluation TIG Multipaper Case Studies in International Monitoring and Evaluation Republic A 899 Health Evaluation TIG MultiPaper Policy Evaluation and Public Health: Multifaceted Approaches and Examples From the Field Republic B 900 Collaborative, Participatory & Empowerment Multipaper Strengthening Schools and Youth Through the Use of Evaluation: Issues and Perspectives Republic C Multipaper Evaluation 2010: Saturday, November 13, 2:50 PM – 4:20 PM Page 163 Saturday, 2:50 pm to 4:20 pm 862 - Tools for Improving the Quality of Evaluations: Four Examples From the Field Panel to be held in Lone Star A Sponsored by the Presidential Strand and the Environmental Program Evaluation TIG Chair - Britta Johnson, United States Environmental Protection Agency Integrating Evaluation Into Program Design Matt Keene, United States Environmental Protection Agency Using Evaluability Assessment to Understand Data Limitations and Help Design an Appropriate Evaluation Michelle Mandolia, United States Environmental Protection Agency Using Expert/Peer Review to Improve the Quality of an Evaluation Methodology: Tribal General Assistance Program Case Study Yvonne Watson, United States Environmental Protection Agency; and Tracy Dyke Redmond, Industrial Economics Inc Using Expert/Peer Review to Improve the Quality of an Evaluation Methodology: Compliance Assistance Outcomes Case Study Terell Lasane, United States Environmental Protection Agency 863 - Integrating Evaluation Into Everyday Organizational Practice: A Complex Systems Perspective Think Tank to be held in Lone Star B Sponsored by the Systems in Evaluation TIG Presenter - Srik Gopalakrishnan, New Teacher Center Discussant - Royce Holladay, Human Systems Dynamics Institute 864 - Advances in Stakeholder Consultation for Evaluation Quality Panel to be held in Lone Star C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Chair and Discussant- Laura Leviton, Robert Wood Johnson Foundation Strategies for Involving Stakeholders in Developing Evaluation Questions Hallie Preskill, FSG Social Impact Advisors Mapping Stakeholder Views of Evaluation Questions and Plans William M Trochim, Cornell University A Nationwide Delphi Process to Set Priorities for Research and Evaluation to Prevent Obesity Among Latino Children Amelie Ramirez and Kipling Gallion, University of Texas Health Science Center at San Antonio 866 - What Am I Supposed to Do With Three-Way Crosstabs? An Introduction to Log Linear Models Demonstration to be held in Lone Star E Sponsored by the Quantitative Methods: Theory and Design TIG Eric Canen and Nanette Nelson, University of Wyoming 867 - Meeting Needs of Multiple Stakeholders in a High-Scrutiny Multi-site Evaluation: Evaluation of the Communities Putting Prevention to Work (CPPW) Initiative Panel to be held in Lone Star F Sponsored by the Cluster, Multi-site & Multi-level Evaluation TIG On Rowing in the Right Direction: Creating an Evaluation Design for the CPPW Initiative Thomas Chapel, Centers for Disease Control and Prevention Sense and Chaos in Multi-site Evaluations Rene Lavinghouze, Centers for Disease Control and Prevention Navigating the Complexities of Evaluating Quitlines: Design and Methodology Lei Zhang, Centers for Disease Control and Prevention The Role of Technical Assistance and Training in Ensuring Evaluation Quality in a Multi-site, Multi-level Evaluation Martha Engstrom, Centers for Disease Control and Prevention 868 - Building Evaluation Capacity in Nonprofit Organizations Serving Lesbian, Gay, Bisexual and Transgender (LGBT) and HIV+ Clients Panel to be held in Mission A Sponsored by the Lesbian, Gay, Bisexual, and Transgender Issues TIG Chair and Discussant- Anita Baker, Anita Baker Consulting Evaluative Thinking and Organizational Change at Latino Community Services Anita Baker, Anita Baker Consulting; and Erica Roggeveen, Yvette Bello, and Erica Roggeveen, Latino Community Services Learning From and About Evaluation at the Hartford Gay and Lesbian Health Collective Jamie Bassell and Linda Estabrook, Hartford Gay and Lesbian Health Collective Learning From and About Evaluation at AIDS Project Hartford Ed Paquette, AIDS Project Hartford Evaluation 2010: Saturday, November 13, 2:50 PM – 4:20 PM Page 164 869 - Evaluating Special Education Personnel Development Initiatives in Three Predominately Rural States: Emphasis on Fidelity of Implementation Measures MultiPaper to be held in Mission B Sponsored by the Disabilities and Other Vulnerable Populations and the Pre-K - 12 Educational Evaluation TIGs Chair - David Merves, Evergreen Educational Consulting LLC Discussant - Patricia Gonzalez, US Department of Education Measuring Fidelity of Implementation for Wisconsin‘s State Personnel Development Grant Activities James Frasier, University of Wisconsin, Madison Capturing Fidelity of Implementation in New Hampshire State Personnel Development Grant RESPONDS Patricia Mueller, Evergreen Educational Consulting LLC Measuring Fidelity of Implementation for New Mexico State Personnel Development Grant Carlos Romero, Apex Education Inc 870 - Ensuring Quality in Our Work: Techniques Used by Independent Consultants MultiPaper to be held in Bowie A Sponsored by the Independent Consulting TIG Chair - Susan M Wolfe, Susan Wolfe and Associates LLC Discussant - Michelle Baron, The Evaluation Baron LLC Avoiding Getting in Over Your Head Frederic Glantz, Kokopelli Associates LLC Using Customized Evaluation Checklists to Ensure Quality Michelle Baron, The Evaluation Baron LLC Keeping your Final Report in Sync With Your Research Gail V Barrington, Barrington Research Group Inc Evaluation Bartering: How to Give and Get Help From Your Buddies Deborah Levy, SuccessLinks LLC Double Checking and Documenting Your Work Susan M Wolfe, Susan Wolfe and Associates LLC Evaluation Post-mortems: Future Learning From Past Experiences Amy Germuth, EvalWorks LLC 872 – Roundtables in Goliad The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Graduate Student and New Evaluator TIG Rotation 1: The Mentor/Mentee Relationship: Perspectives and Suggestions for Maintaining Successful Relationships Jennifer Morrow, University of Tennessee, Knoxville; Margot Ackermann, Homeward; Erin Burr, Oak Ridge Institute for Science and Education; and Krystall Dunaway, Eastern Virginia Medical School Rotation 2: Evaluating a Rite of Passage Program as a Vehicle for Systemic Change in At-risk Female Youths Attitudes and Beliefs Kathryn Wilson and Mark Kirkpatrick, Western Michigan University 873 – Roundtables in San Jacinto The first rotation will use the first 45 minutes and the second rotation will use the remaining 45 minutes Sponsored by the Extension Education Evaluation TIG Rotation 1: The Unfocused Focus Group: Evaluation Benefit or Bane? Nancy Franz, Virginia Tech Rotation 2: eXtension Evaluation Community of Practice (CoP) Grows Up Michael Lambur, Virginia Tech; and Benjamin Silliman, North Carolina State University 874 - The Importance of Critical Thinking in Assessment in Higher Education Multipaper to be held in Travis A Sponsored by the Assessment in Higher Education TIG Chair - Leigh D'Amico, University of South Carolina Understanding Student Mastery of Higher Education Curriculum Standards Leigh D'Amico and Grant Morgan, University of South Carolina; Tammy Pawloski and Janis McWayne, Francis Marion University Is Critical Thinking the All-Purpose Outcome in Higher Education? John Stevenson, University of Rhode Island Science, Technology, Engineering, And Mathematics (STEM) Evaluations: Best Practices From a Multi-site, Multi-national Research Program Courtney Brown and Christina Russell, Indiana University Equity, Social Justice, and Quality in School Leadership Preparation: A Critical Self-Assessment to Build Criteria for Candidate Selection Aarti P Bellara, Zorka Karanxha, and Vonzell Agosto, University of South Florida 875 - Positionality Matters: Understanding Culture and Context From the Perspective of Key Stakeholders Think Tank to be held in Travis B Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Presenter - Alyssa Na'im, Education Development Center Discussants- Araceli Martinez Ortiz, Sustainable Future Inc; Shannan McNair, Oakland University; Carol Nixon, Edvantia Inc; David Reider, Education Design LLC Angelique Tucker Blackmon, Innovative Learning Concepts LLC; Pam Van Dyk, Evaluation Resources LLC; and Karen L Yanowitz, Arkansas State University Evaluation 2010: Saturday, November 13, 2:50 PM – 4:20 PM Page 165 Saturday, 2:50 pm to 4:20 pm, continued 876 - Practicing Culturally Responsive Evaluation: Graduate Education Diversity Internship (GEDI) Program Intern Reflections on the Role of Competence, Context, and Cultural Perceptions MultiPaper to be held in Travis C Sponsored by the Multiethnic Issues in Evaluation TIG Chair - Michelle Jay, University of South Carolina Discussant - Rita O'Sullivan, University of North Carolina at Chapel-Hill Designing a Culturally Responsive Evaluation Plan for the Race Matters Toolkit Frances Carter, University of Maryland, Baltimore County Challenges of Cultural Responsiveness in a Public-Private Partnership Identifying ‗Hotspots‘ of Poor Diabetes Care Using Geographic Information Systems (GIS) Tools Deborah Ling, University of California, Los Angeles Challenges in Promoting Culturally Responsive Evaluation Practices in Unresponsive Work Environments Johnavae Campbell, University of North Carolina at ChapelHill Formative Research on Mentoring African American and Latino/a Medical Students Toward a Career in HIV/AIDS Prevention Science Neva Pemberton, University of California, Los Angeles 877 - Translating Visitors' Experiences Through Evaluation Multipaper to be held in Travis D Sponsored by the Evaluating the Arts and Culture TIG Chair - Tara Pearsall, Savannah College of Art and Design Discussant - Kirsten Ellenbogen, Science Museum of Minnesota Visitors Within and Across Art Museums: Creating a Baseline for Comparison While Building Capacity Joe E Heimlich, Ohio State University Establishing a Framework for Evaluating Public Value at the Smithsonian's National Museum of Natural History Bill Watson, Smithsonian's National Museum of Natural History; Mary Ellen Munley, MEM and Associates; and Shari Werb, Smithsonian's National Museum of Natural History 878 - Community-Derived Research Partnerships: Working Together to Improve Human Services Panel to be held in Independence Sponsored by the Human Services Evaluation TIG Chair - Cynthia Flynn, University of South Carolina Discussant - Diana Tester, South Carolina Department of Social Services Establishing a Professional Development Consortium of Social Work Programs in South Carolina: Needs Assessment for Stakeholder Engagement Dana DeHart, University of South Carolina Connecting for Kids: Navigating Community Partnerships for Family-finding Services Suzanne Sutphin, University of South Carolina Family Group Conferencing for Children in Foster Care: Assessing the Effectiveness of a New Model for Engaging Families Cynthia Flynn, University of South Carolina 879 - Online Learning in Adult and Postsecondary Education: Theory and Practice Multipaper to be held in Presidio A Sponsored by the Distance Education & Other Educational Technologies TIG Chair - Talbot Bielefeldt, International Society for Technology in Education Pushing Buttons and Breaking Code: Evaluating Instructional Technology Pilots in Higher Education Joel Heikes, Stephanie Corliss, and Erin Reilly, University of Texas, Austin Real World, Real Use: The Impact of Integrating StudentCentered Learning in Adult Online Instruction in Mathematics and Science Jane A Rodd and Dianna L Newman, State University of New York at Albany; and Patricia J Lefor, Empire State College Evaluation of an Online Training Program for Informal Science Educators: The FETCH! With Ruff Ruffman Program Christine Paulsen and Christopher Bransfield, Concord Evaluation Group LLC 880 - Increasing Evaluation Capacity Through Different Levels of Training and Support Multipaper to be held in Presidio B Sponsored by the Organizational Learning and Evaluation Capacity Building TIG Chair and Discussant - Stanley Capela, HeartShare Human Services of New York Improving the Quality of Program Evaluation Reporting: A Capacity Building Event in California's Tobacco Control Programs Jeanette Treiber, University of California, Davis Am I My Brother's Keeper? Coaching Communities an Evaluation of Process and Outcome Gina Weisblat, Cleveland State University Evaluation Capacity Building in the Corporate Sector: Using eLearning and Traditional Methods to Increase Organizational Capacity Michele Graham, KPMG LLP; John Mattox, Knowledge Advisors; and Peter Sanacore, KPMG LLP Evaluation 2010: Saturday, November 13, 2:50 PM – 4:20 PM Page 166 881 - Evaluating a National Medicaid Children's Mental Health Demonstration Grant Program MultiPaper to be held in Presidio C Sponsored by the Alcohol, Drug Abuse, and Mental Health TIG Chair - Garrett Moran, Westat Overview of the Home and Community-based Services Demonstration Waiver Grant Program Oswaldo Urdapilleta, IMPAQ International Virginia's Approach: Transitioning Youth From Institutions to the Community Mendy Meeks and Karen Lawson, Virginia Department of Medical Assistance Services Maryland's Implementation Challenges and Evaluation Design Jennifer Mettrick and Wai-Ying Chow, University of Maryland Using Blended Methods and Prospective Meta-analytic Approach to Strengthen a Multisite Evaluation Garrett Moran, Debra Rog, and Joshua Noda, Westat 882 – Roundtable in Bonham A Sponsored by the Pre-K - 12 Educational Evaluation TIG Adaptations to Evaluation Design: Two Examples of Ensuring Quality in Practice Stephanie Feger and Elise Laorenza, Brown University 883 - 2010 Report: State of Evaluation Practice and Capacity in the Nonprofit Sector Demonstration to be held in Bonham B Sponsored by the Non-profit and Foundations Evaluation TIG Johanna Morariu, Myia Welsh, and Lily Zandniapour, Innovation Network 884 - Evaluating the State of Charter Schools and Public Schools of Choice Multipaper to be held in Bonham C Sponsored by the Pre-K - 12 Educational Evaluation TIG Chair - Juanita Lucas-McLean, Westat Discussant - Antionette Stroter, University of Iowa School Choice and its Impacts on Student Well-being and Academic Achievement in Post-Katrina New Orleans Paul Hutchinson, Tulane University; Lisanne Brown, Louisiana Public Health Institute; Nathalie Ferrell, Tulane University; and Marsha Broussard and Sarah Kohler Chrestman, Louisiana Public Health Institute National Evaluation of Knowledge Is Power Program (KIPP) Middle Schools: Impacts on Student Achievement Presenters - Brian Gill, Philip Gleason, Ira Nichols-Barrer, Bing-ru Teh, and Christina Tuttle, Mathematica Policy Research Lottery-based Estimates of Charter School Impacts and Factors Related to Impacts Christina Clark Tuttle, Philip Gleason, and Melissa Clark, Mathematica Policy Research The Art and Science of Picking Comparison Schools Agata Jose-Ivanina and Helene Jennings, ICF Macro 885 – Case Studies and Cost Studies Multipaper to be held in Bonham D Sponsored by the Costs, Effectiveness, Benefits, and Economics TIG Chair - Mustafa Karakus, Westat Always Late: Why Some Multilateral Development Bank Projects Delay so Much While Others do Not? Guy Blaise Nkamleu, African Development Bank Comprehensive Economic Evaluation of a Colorectal Cancer Screening Demonstration Program: A Multi-site, Multi-level Cost Analysis Maggie Cole Beebe and Sujha Subramanian, RTI International; Florence Tangka, Centers for Disease Control and Prevention; and Sonja Hoover, RTI International Exploring the Economics of Quality Improvement Education in Healthcare Daniel McLinden and Stacey Farber, Cincinnati Children's Hospital Medical Center Evaluating Directions Home: A Cost-Benefit Study of Supportive Housing for People Who Are Homeless in Fort Worth, Texas James Petrovich and Emily Spence-Almaguer, University of Texas, Arlington 886 - Improving Proposals and Programs by Improving Peer and Stakeholder Review Multipaper to be held in Bonham E Sponsored by the Research, Technology, and Development Evaluation TIG Chair - George Teather, George Teather and Associates Using Fishbone Analysis to Improve the Quality of Science and Technology Program Proposals Shan Shan Li and Ling-Chu Lee, National Applied Research Laboratories Improving the Professionalism of Peer Review Panel in Research and Development (R&D) Evaluation : The Korean Case Chan Goo Yi, Pukyong National University; Boojong Gill, Korea Institute of Science & Technology Evaluation and Planning (KISTEP) Interactive Heuristic Reviewing Mechanism: A New Method of Assessing Exploratory Pioneering Research Projects for National Nature Science Foundation of China (NSFC) Yue Wang, Xiaoxuan Li, and Jianzhong Zhou, Chinese Academy of Sciences; Yonghe Zheng, National Nature Science Foundation of China; and Guoxiang Xiong, Chinese Academy of Sciences Evaluation 2010: Saturday, November 13, 2:50 PM – 4:20 PM Page 167 Saturday, 2:50 pm to 4:20 pm, continued 887 - Straw, Bricks, Construction: Improving Quality of Education Data, Performance Measures, and Evaluation to Enhance Student Achievement, Reduce Gaps and Increase College Access and Retention MultiPaper to be held in Texas A Sponsored by the Government Evaluation TIG and the Pre-K - 12 Educational Evaluation TIG Chair - Stephanie Shipman, United States Government Accountability Office EDFacts Data Quality, Usability, and Limitations Marian Banfield and Margaret Cahalan, United States Department of Education High School Achievement Through Multiple Lenses: Data, Measures, Methods Margaret Cahalan, United States Department of Education Differentiating the Effects of Federal Programs: The American Competitiveness (ACG) and National Smart Grant (NSG) - From Other Federal, State, and Institutional Changes Sharon Stout, United States Department of Education 888 - Web Dialogues: A New Tool for Evaluators Demonstration to be held in Texas B Sponsored by the Qualitative Methods TIG Jerome Hipps and Laurie Maak, WestEd 889 - Challenges and Promises for Using Mixed Methods: Lessons From Implementing Mixed Methods Evaluation Multipaper to be held in Texas C Sponsored by the Mixed Methods Evaluation TIG Chair - James Riedel, Girl Scouts of the United States of America Discussant - Donna Mertens, Gallaudet University Mixed Method Evaluations Quality and Balance: A Case Study From New Zealand Public Sector Yelena Thomas, Ministry of Research Science and Technology Evaluating Migrant Education Programs: Quality and Inquiry Karen Vocke, Carl Westine, Brooks Applegate, and Ilse Schweitzer, Western Michigan University Evaluating a Narrative Intervention Model (NIM) based HIV/STI (Sexually Transmitted Infection) Prevention Intervention in Urban India Minakshi Tikoo and Stephen Schensul, University of Connecticut Using a Mixed Methodology to Evaluate an EntertainmentEducation Intervention Directed to the Spanish-Speaking Latino Community of Colorado Mariana Enriquez-Olmos and Cristina Bejarano, Independent Consultant 890 - Evaluation System of Research, Technology, and Development (RT&D) to Induce Innovation: Strategy, Process, and Reflection MultiPaper to be held in Texas D Sponsored by the Research, Technology, and Development Evaluation TIG Chair - Naoto Kobayashi, Waseda University On the Feedback of Evaluation Results to the Management of Advanced Industrial Science and Technology (AIST) Yoshiaki Tamanoue, Hidenori Endo, Shigeko Togashi, Shuichi Oka, Hiroyuki Suda, Kenta Ooi, and Kanji Ueda, National Institute of Advanced Industrial Science and Technology Summary and Prospect of Evaluation on Research-supportive and Administrative Departments in National Institute of AIST for Promoting Innovation Mariko Kamo, Susumu Yasuda, Hiroyuki Suda, Shigeko Togashi, Kenta Ooi, and Kanji Ueda, National Institute of Advanced Industrial Science and Technology Strategic RT&D in Nagasaki to Induce Local and Global Innovation Osamu Nakamura and Nariatsu Inada, Nagasaki Prefectural Government; and Naoto Kobayashi, Waseda University 891 - Thinking Outside the Evaluation Report Box: Transforming Evaluation Results Into a Structural Change Grantmaking Toolkit Panel to be held in Texas E Sponsored by the Evaluation Use TIG and the Non-profit and Foundations Evaluation TIG Chair - Steven LaFrance, Learning for Action Group Introducing the Common Vision Process Karen Zelermyer, Ellen Gurzinsky, and Robert Espinoza, Funders for LGBTQ Issues Sharing Best Practices for Facilitating a Formative Process Jara Dean-Coffey, jdcPartnerships Exploring an Integrated Evaluation Approach Steven LaFrance, Learning for Action Group Transforming Evaluation Results Into a Structural Change Grantmaking Toolkit JT Taylor, Learning for Action Group 892 - How to Write an Evaluation Plan Skill-building Workshop to be held in Texas F Sponsored by the Graduate Student and New Evaluator TIG LaTisha Marshall, Centers for Disease Control and Prevention Evaluation 2010: Saturday, November 13, 2:50 PM – 4:20 PM Page 168 893 - Say Goodbye to Power Point and Hello to Gallery Walks! Skill-building Workshop to be held in Crockett A Sponsored by the AEA Conference Committee Cassandra ONeill, Wholonomy Consulting; and Allison Titcomb, ALTA Consulting 894 - Expanding Our Knowledgebase: Current Research on Teaching Evaluation Panel to be held in Crockett B Sponsored by the Teaching of Evaluation TIG Chair - Christina Christie, University of California, Los Angeles A Descriptive Study of Evaluator Course Taking Patterns and Practice Christina Christie, University of California, Los Angeles; Leslie Fierro, SciMetrika; and Tarek Azzam, Claremont Graduate University Evaluation Coursework in Schools and Programs of Public Health Leslie Fierro, SciMetrika; and Christina Christie, University of California, Los Angeles Contexts and Teaching Evaluation: An Example From Educational Administration Programs Tara Shepperson, Eastern Kentucky University Informal Discussion as Socialization and Teaching Tools in Program Evaluation Anne Vo, University of California, Los Angeles 895 - The Network of Network Funders: Evaluating Networks and Evaluating with a Network Lens Think Tank to be held in Crockett C Sponsored by the Social Network Analysis TIG Presenter - Astrid Hendricks, California Endowment Discussants - Gale Berkowitz, David and Lucile Packard Foundation; Mayur Patel, John S and James L Knight Foundation; and Gigi Barsoum, California Endowment 896 - Impact Evaluation of Approaches to Affect Local Resiliency to Disasters, Enhanced Public Health Emergency Peer Networks, and First Responder Psychological Recovery Multipaper to be held in Crockett D Sponsored by the Disaster and Emergency Management Evaluation Chair - Karen Pendleton, University of South Carolina Evaluating Peer Networks Among New Local Health Officials: Assessing Relationships in Responding to Local Health Crises Following Leadership and Managerial Training Sue Ann Sarpy, Sarpy and Associates LLC; and Alicia Stachowski andSeth Kaplan, Geroge Mason University Disaster Resilience Evaluation: An example From Miami-Dade Faith and Community-based Organizations Michael Burke, Joe Eyerman, and Brian Burke, RTI International First Responder Immediate Psychological Trauma: How Are We Helping? A Meta-analysis Lynne Wighton, Vanderbilt University 897 - Feminist Evaluation and Gender-Specific Programs Multipaper to be held in Seguin B Sponsored by the Feminist Issues in Evaluation TIG Chair - Linda Thurston, National Science Foundation Discussant - Jan Middendorf, Kansas State University Feminist Evaluation: Practical Application in Nonpractical Situations Donna Podems, ICF Macro International Post Traumatic Stress Disorder (PTSD) and Co-occurring Mental Health and Substance Abuse Disorders: Does Gender Matter? Kathryn A Bowen, Centerstone Research Institute Meta-evaluations of HIV/AIDS Prevention Intervention Evaluations in Sub Saharan Africa With Specific Emphasis on Implications for Women and Girls Tererai Trent, Western Michigan University 898 - Case Studies in International Monitoring and Evaluation Multipaper to be held in Republic A Sponsored by the International & Cross-cultural Evaluation TIG Chair - Jim Rugh, Independent Consultant Using Collaborative and Systemic Approaches to Evaluate a Health Promotion Initiative Involving Canada and Brazil Eduardo Marino, Independent Consultant; Thomaz Chianca, COMEA Evaluation Ltd Horizontal Evaluation: An Institutional Learning and Knowledge Building Case From Africa Hubert Paulmer, Harry Cummings and Associates Inc; and Harry Cummings, University of Guelph Integration of a Safe Water and Hygiene Program With Routine Childhood Immunization Services: Design Strategies and Lessons Learned From a Mixed Method Evaluation of a One-Year Pilot Project at 18 Health Facilities in Nyanza Province, Kenya Karen Schlanger, University of Georgia; Tove Ryman and Margaret Watkins, Centers for Disease Control and Prevention; Brian Otieno and Cliff Ochieng, Safe Water and AIDS project Patricia Richards, University of Georgia The Influence of Cooperative Structure on Commitment and Member Satisfaction: A Case of the Murang‘a Nutribusiness Cooperative in Kenya Mary Marete, Joan Thomson, and Edgar Yoder, Pennsylvania State University Evaluation 2010: Saturday, November 13, 2:50 PM – 4:20 PM Page 169 Saturday, 2:50 pm to 4:20 pm, continued 899 - Policy Evaluation and Public Health: Multifaceted Approaches and Examples From the Field MultiPaper to be held in Republic B Sponsored by the Health Evaluation TIG Chair - Karen Debrot, Centers for Disease Control and Prevention The Role of Rigorous Policy Evaluation in Violence Prevention Jennifer Matjasko, Centers for Disease Control and Prevention Evaluating Smoke-free Policies: A Clear View Karen Debrot, Centers for Disease Control and Prevention Indicators for Tobacco Control Policy Evaluation Karen Debrot, Centers for Disease Control and Prevention Saturday, 4:30 pm to 5:30 pm 902 - Reflections on the Conference and Conference Theme by Recent Past AEA Presidents Plenary to be held in Texas A Sponsored by the Presidential Strand Chair - Leslie Cooksy, University of Delaware Discussant - Jennifer Greene, University of Illinois at UrbanaChampaign Presenters - Melvin Mark, Pennsylvania State University; Hallie Preskill, FSG Social Impact Advisors; Sharon Rallis, University of Massachusetts; Debra Rog, Westat; and William M Trochim, Cornell University 900 - Strengthening Schools and Youth Through the Use of Evaluation: Issues and Perspectives Multipaper to be held in Republic C Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG Chair - Liliana Rodriguez-Campos, University of South Florida Teacher Benefits of Collaborative Action Research: Results of a Quantitative Inquiry John A Ross, University of Toronto; and Catherine D Bruce, Trent University Youngsters Marked by Involvement in Crime Acting as the Evaluation Team Daniel Brandão, Fonte Institute Turning Points: Critical Incidents in the Formation of Academic Mentoring Relationships: An Evaluation of a University Learning Community Nancy Rogers and Tommy Chou, University of Cincinnati Process Evaluation of An Immersion-Learning Experience for Grades K-4 Youth Laurie Ruberg, Wheeling Jesuit University; Jackie Shia, Challenger Learning Center; Cassie Lightfritz, Center for Educational Technologies; and Annie Morgan, Challenger Learning Center Evaluation 2010: Saturday, November 13, 2:50 PM – 4:20 PM, 4:30 PM – 5:30 PM Page 170 Appendix A: Index of Presenters and Contributors In brackets after each presenter‘s name may be found the sessions in which she or he is presenting. AAAAAAAA Aaron, Katrina [623-678-809] Augusta Partnership for Children Inc; 706-721-4885; [email protected] Abbott, Maryann [600] Institute for Community Research; [email protected] Abdullateef, Eric [275-436] Directed Study Services; 202-399-0578; [email protected] Abed, Joanne [540] Battelle Memorial Institute; 703-761-7617; [email protected] Abel, Yvonne [227] Abt Associates Inc; 617-349-2451; [email protected] Abi-Nader, Jeanette [767] Community Food Security Coalition; 434-973-4435; [email protected] Abreu, Dolores [137] Laboratório de Avaliação de Situações Endêmicas Regionais; +55-21-2598-2444; [email protected] Achatz, Mary [207] Westat; 301-294-2837; [email protected] Ackermann, Margot [137-872] Homeward; 804-869-3746; [email protected] Adams, Adrienne [245] Michigan State University; 517-353-4568; [email protected] Adams, Jeffery [137] Massey University; +6493666136; [email protected] Adams, Sandra [263] William Penn Foundation; 215-988-1830; [email protected] Adedokun, Omolola A [392-600] Purdue University; 765-494-0726; [email protected] Adjognon, Omonyele [541-619] Institute for Community Health; 617-499-6617; [email protected] Affeldt, John [257] Public Advocates; 415-431-7430 x113; [email protected] Agosto, Vonzell [874] University of South Florida; 813-974-3422; [email protected] Agoulnik, Irina [739] Brigham and Women's Hospital; 617-525-4766; [email protected] Aguero, Dawn [576] College Center for Library Automation; 850-922-6044; [email protected] Ah Sam, Anna [654] University of Hawaii, Manoa; 808-956-9217; [email protected] Ahn, Jeehae [208-502-591-622-812] University of Illinois at Urbana-Champaign; 217-332-2799; [email protected] Ajose, Lande [217-257] BTW Informing Change; 510-665-6100; [email protected] Akbay, Lokman [137] University of South Florida; 704-501-6023; [email protected] Akroyd, Shaun [654] Akroyd Research and Evaluation; +64-27-568-5810; [email protected] Aladjem, Daniel [137] American Institutes for Research; 202-403-5386; [email protected] Alaimo, Salvatore [684] Grand Valley State University; 616-331-6582; [email protected] Alderman, Katarzyna [137-779] Battelle Memorial Institute; 206-528-3011; [email protected] Alemdar, Meltem [645] Georgia Institute of Technology; 404-518-2478; [email protected] Alford, Aaron [627-721] Battelle Memorial Institute; 703-248-2144; [email protected] Alford, Beverly [305] Texas A&M University; 932-758-1881; [email protected] Ali, Asma [291] University of Illinois at Chicago; 312-399-8881; [email protected] Alizaga, Natalie [737] Amherst H Wilder Foundation; 415-608-1462; [email protected] Alkhalaf, Arwa [137] University of British Columbia; 604-767-4074; [email protected] Alkin, Marv [389] University of California, Los Angeles; 310-825-4800; [email protected] Allen, Winston [137] Heartlands International; 202-361-7665; [email protected] Allsopp, Margaret [137] University of South Florida; 813-974-9412; [email protected] Alsobrook, Metta [256] University of Texas, Dallas; 972-883-5484; [email protected] Alton, Forrest [619] South Carolina Campaign to Prevent Teen Pregnancy; 803-771-7700; [email protected] Altschuld, James [117-297-377-857] The Ohio State University; 614-389-4585; [email protected] Alvarez, Julia [113-524] JVA Consulting LLC; 303-477-4896; [email protected] Alvaro, Eusebio [783] Claremont Graduate University; 520-360-3599; [email protected] Alyami, Mohammed [117-137-789] Western Michigan University; 201-660-0966; [email protected] Amaral, Eliana [256] Universidade Estadual de Campinas; +55-19-37889461; [email protected] Aminov, Scott [437-816] Food For The Hungry; +62 812 604 2314; [email protected] Ammann Howard, Kim [257] BTW Informing Change; 510-665-6100; [email protected] Amo, Courtney [268] National Research Council Canada; 613-990-1053; [email protected] Amon, Dan [607] United States Environmental Protection Agency; 202-564-7509; [email protected] Amwake, Lynn [137] University of North Carolina at Greensboro; 850-894-4075; [email protected] Anastasia, Trena [373-522] University of Wyoming; 307-766-6182; [email protected] Ander, Roseanna [285] University of Chicago; 312-325-2544; [email protected] Anders, Jessica [251] NeighborWorks America; 202-220-2316; [email protected] Anderson, Bernice [371] National Science Foundation; 703-292-5151; [email protected] Anderson, Beth [730] National Institute of Environmental Health Sciences; [email protected] Anderson, Jacquie [112] Community Catalyst; 617-275-2803; [email protected] Anderson, Jock [614] World Bank; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 171 Anderson, Karen [409-671] Clark Atlanta University; 843-465-0704; [email protected] Anderson, Mary Anne [137] ICF Macro International; 301-572-0824; [email protected] Anderson, Summerlynn [306] Walter R McDonald and Associates Inc; 916-239-4020 x239; [email protected] Anderson, Teresa [301] University of Massachusetts; 508-856-6520; [email protected] Anderson-Hamilton, Andrea [253] Anderson Hamilton Consulting; 917-294-5086; [email protected] Angresano, Nicole [678] United Way of Greater Milwaukee; 414-263-8115; [email protected] Apichaisiri, Tatcha [757] Pact Inc; +66 2 2313402; [email protected] Aponte-Soto, Lisa [671] University of Illinois at Chicago; 708-890-7942; [email protected] Applegate, Brooks [697-889] Western Michigan University; 269-387-5886; [email protected] Appleton-Dyer, Sarah [780] University of Auckland; +0064 9 373 7599 x84977; [email protected] Araya, Daniel [137] University of Illinois at Urbana-Champaign; 217-390-4244; [email protected] Archibald, Thomas [250-381-820] Cornell University; 607-255-0397; [email protected] Arens, Sheila A [126-298-368-780] Mid-Continent Research for Education and Learning; 303-632-5625; [email protected] Armbrecht, Eric [709] Open Health LLC; 314-446-6485; [email protected] Armstead, Cathleen [261-685] University of Miami; 305-284-5826; [email protected] Armstrong, Mary [222] University of South Florida; 813-974-4601; [email protected] Arnold, Amy Laura [519-623-678-809] University Of Georgia; 859-797-4210; [email protected] Arnold, Mary [692] Oregon State University; 541-737-1315; [email protected] Arons, Abigial [592] University of California, San Francisco; 415-476-3689; [email protected] Arroyo, Ruth [319] Consorcio por la Salud, Ambiente y Desarrollo (ECOSAD); [email protected] Arruda Laorenza, Elise [832] Brown University; 401-688-2053; [email protected] Atienza, Sara [566] Empirical Education Inc; 650-328-1734 x135; [email protected] Atkins, Kathleen [268] Education Review Office; 64-4-499-2489; [email protected] Atkinson, Donna [252] University of Northern British Columbia; 250-960-6719; [email protected] Austin, Greg [683] WestEd; 562-799-5155; [email protected] Austria, Diana [320] Stanford University; 281-761-4318; [email protected] Autio, Elizabeth [725] Education Northwest; 503-275-9593; [email protected] Autor, Lewis [541] Rock of Escape; 404-281-1858; [email protected] Avila, Minerva [296] University of California, Los Angeles; 310-206-6944; [email protected] Avula, Deepa [682] United States Department of Health and Human Services; 240-276-2961; [email protected] Awgu, Ezechukwu [137] Western Michigan University; 269-387-5895; [email protected] Axelson, Rick [255-792] University of Iowa; 319-384-4291; [email protected] Ayyad, Fatma [697] Western Michigan University; 269-267-2347; [email protected] Azizova, Zarrina [793] Oklahoma State University; 405-744-4715; [email protected] Azzam, Tarek [353-580-755-894] Claremont Graduate University; 909-374-5355; [email protected] BBBBBBBB Babb, Steven [378] Centers for Disease Control and Prevention; 770-488-1172; [email protected] Baccarini, Rachel [137] Ministry of Health of Brazil; 055-0613-306-7037; [email protected] Bachmann, Kim [537] Industry Canada; 613-941-1429; [email protected] Bachrach, Elizabeth [787] Goodman Research Group Inc; 248-432-7067; [email protected] Badran, Abdel-Kareem [137] National Center for Examinations & Educational Evaluation; 011-02012-803-0999; [email protected] Badway, Norena Norton [335] San Francisco State University; 209-601-7121; [email protected] Bae, Suho [810] Sungkyunkwan University; [email protected] Baek, EunKyeng [383] University of South Florida; 813-618-0213; [email protected] Baer, Denise L [264-711] Johns Hopkins University; 240-498-5409; [email protected] Baez, Javier [539] World Bank; 202-473-6568; [email protected] Bai, Haiyan [300] University of Central Florida; 407-823-1467; [email protected] Baizerman, Michael [536-588-698] University of Minnesota; 612-624-4912; [email protected] Baker, Anita [868] Anita Baker Consulting; 609-397-8722; [email protected] Baker, Kirk [271] National Institutes of Health; 301-451-7431; [email protected] Baker, Stephen [665] Chapin Hall; 773-256-5113; [email protected] Bakerson, Michelle [114-683] Indiana University South Bend; 269-362-1620; [email protected] Balakrishnan, Asha [343] Science and Technology Policy Institute; 202-419-5480; [email protected] Balasubramanian, Nathan [416-605] Centennial Board of Cooperative Educational Services; 720-936-5999; [email protected] Balcom, Lee [137] Western Michigan University; 269-655-4671; [email protected] Baldassari, Carol [385] Lesley University; 617-349-8664; [email protected] Ballard, Karen [612] University of Arkansas; 501-671-2218; [email protected] Balmer, Dorene [137] Columbia University; 212-305-3777; [email protected] Bamberger, Michael [236-696-815-821] Independent Consultant; 503-641-8633; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 172 Bandy, Elizabeth [640] Rockman et al; 415-544-0788; [email protected] Banfield, Marian [887] United States Department of Education; 202-401-7767; [email protected] Banks, Gina [390] Washington University in St Louis; 314-935-3648; [email protected] Banks, Sevaughn [379] California Social Work Education Center; 510-642-9272; [email protected] Baptiste, Lennise [137-512-811] Kent State University; 330-676-1832; [email protected] Barba, Kate [687] National Oceanic and Atmospheric Administration; 301-563-1182; [email protected] Bardack, Sarah [137] American Institutes for Research; 202-403-5827; [email protected] Barela, Eric [224-314-429-557-616-685] Partners in School Innovation; 415-824-6196 x103; [email protected] Barley, Zoe [589-645] Mid-continent Research for Education and Learning; 303-632-5611; [email protected] Barnes, Cassandra [687] National Oceanic and Atmospheric Administration; 301-734-1190; [email protected] Barnes, Gisoo [137] Centerstone Research Institute; 812-336-1156; [email protected] Baron, Michelle [121-370-870] The Evaluation Baron LLC; 801-830-1390; [email protected] Baronberg, Sabrina [227] New York City Department of Health and Mental Hygiene; 212-227-5242; [email protected] Barrie, Sallay [245] Michigan State University; 517-353-4568; [email protected] Barrington, Gail V [870] Barrington Research Group Inc; 403-289-2221; [email protected] Barron-Simpson, Rachel [618] Centers for Disease Control and Prevention; 770-488-4825; [email protected] Barsoum, Gigi [895] California Endowment; 800-449-4149; [email protected] Bartenfeld, Tom [807] Centers for Disease Control and Prevention; 404-498-6766; [email protected] Bartholomay, Tom [295-733] University of Minnesota; 612-626-2162; [email protected] Bartholomew, Jenni [117] Case Western Reserve University; 216-368-3424; [email protected] Bass, Kristin [640] Rockman et al; 415-544-0788; [email protected] Bassell, Jamie [868] Hartford Gay and Lesbian Health Collective; 860-278-4163; [email protected] Basta, Kelle [798] ICF International; 703-225-2264; [email protected] Bates, Leigh [120] New York State Office of Children and Family Services; 518-473-8736 Bates, Michael [795] Mosaic Network Inc; 805-886-8694; [email protected] Batsche, Catherine [718] University of South Florida; 813-974-7196; [email protected] Baugh, Carlene [541] CHF International; 301-587-4700; [email protected] Baughman, Sarah [612] Virginia Polytechnic Institute and State University; 540-231-9410; [email protected] Baumgart, Glen E [594] University of Texas, Austin; 512-232-2930; [email protected] Baxter, Lester [365-745] Pew Charitable Trusts; 215-575-4750; [email protected] Bayonas, Holli [137] University of North Carolina at Greensboro; 336-315-7438; [email protected] Bealaurier, Richard [600] Florida International Unversity; 786-333-0835; [email protected] Beam, Margaret [526] RMC Research Corporation; 503-223-8248; [email protected] Beard, Sharon [730] National Institute of Environmental Health Sciences; [email protected] Beauchesne, Danielle [776] ICF Macro International; [email protected] Becker, Dana [564] South Carolina Campaign to Prevent Teen Pregnancy; 803-771-7700 Becker, Heather [137] University of Texas, Austin; 512-471-9097; [email protected] Becker, William [719] University of Arizona; [email protected] Beckjord, Jennifer [137] Southern Illinois University Carbondale; 618-453-5371; [email protected] Beesley, Andrea [225-265-298-368-780] Mid-continent Research for Education and Learning; 303-632-5541; [email protected] Begg, Iain [726] London School of Economics Begum, Housne [137] University of Dhaka; +0088-02-9014925; [email protected] Bejarano, Cristina [511-889] Independent Consultant; 720-300-1248; [email protected] Belding, Theodore [283] TechTeam Government Solutions; 734-302-4667; [email protected] Belgrave, Faye [734] Virginia Commonwealth University; 804-827-3908; [email protected] Bell, James [727] James Bell Associates; 703-528-3230; [email protected] Bellara, Aarti P [668-874] University of South Florida; 813-558-8340; [email protected] Belle, Carolla [137] University of South Florida; 813-428-2686; [email protected] Bello, Yvette [868] Latino Community Services; 860-296-6400; [email protected] Beltyukova, Svetlana [786] University of Toledo; 419-882-4921; [email protected] Benard, Bonnie [592] WestEd; 510-302-4268; [email protected] Benita, Williams [557] Feedback Research & Analytics; +27 827729709; [email protected] Benjamin, Gregory [137-698] Nemours Health and Prevention Services; 302-444-9163; [email protected] Benjamin, Lehn [325] George Mason University; 703-993-8240; [email protected] Bennett, Deborah [137] Purdue University; 765-714-4054; [email protected] Bennett, Heather [114-538-606-685] University of South Carolina; 803-777-3384; [email protected] Bennett, Megan [121] Training Evaluation and Metrics; 215-286-5895; [email protected] Benton, Amy [379] California Social Work Education Center; 510-642-9272; [email protected] Benz, Jennifer [113] NORC at the University of Chicago; 781-639-0811; [email protected] Berg, Marlene [262] Institute for Community Research; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 173 Berger, Dale [246-706] Claremont Graduate University; 909-625-5783; [email protected] Bergum, Alison [107] University of Wisconsin; 608-263-2624; [email protected] Berk, Jillian [838] Mathematica Policy Research; [email protected] Berkel, Cady [130] Arizona State University; 480-491-1497; [email protected] Berkowitz, Gale [124-505-895] David and Lucile Packard Foundation; 650-948-7658; [email protected] Bernstein, David J [388-615] Westat; 301-738-3520; [email protected] Berry, Michelle [137] University of Nevada, Reno; 775-784-6265; [email protected] Berry, Tiffany [126-137-226] Claremont Graduate University; 909-607-1540; [email protected] Berson, Michael [668-740] University of South Florida; 813-974-7917; [email protected] Bertrand, Frédéric [231] Science-Metrix Corp; 514-495-6505; [email protected] Bertrand Jones, Tamara [111-291-411-551] Florida State University; 850-644-1331; [email protected] Bessell, Ann G [261-557-685] University of Miami; 305-284-5826; [email protected] Best, Allan [387] Michael Smith Foundation for Health Research; 778-279-6896; [email protected] Betesh, Hannah [686] Berkeley Policy Associates; 510-267-9680 x225; [email protected] Betts, William [599] University of Colorado, Denver; 303-315-1275; [email protected] Bhandari, Archna [271] National Institutes of Health; 301-451-7431; [email protected] Bhang, Ellen [658] University of Massachusetts; 508-856-8585; [email protected] Bhati, Divya [714] University of Central Florida; 407-882-0281; [email protected] Bhattacharya, Gargi [358] Southern Illinois University Carbondale; 618-453-3532; [email protected] Bheda, Divya [318-696-820] University of Oregon; 818-618-1831; [email protected] Bichelmeyer, Barbara [275] Indiana University; 8i2-856-8468; [email protected] Bickel, William [303] University of Pittsburgh; 412-624-7091; [email protected] Bielefeldt, Talbot [340-560-879] International Society for Technology in Education; 541-434-8937; [email protected] Bierring, Christina [276] United Nations Children's Fund; [email protected] Biesecker, Gretchen [137-802] City Year Inc; 617-927-2317; [email protected] Bigirimana, Alphonse [738] Chemonics International; 202-775-6972; [email protected] Bilgili, Yakup [137-560] Polk County Public Schools; 904-662-9448; [email protected] Bilinsky, Paula [439] United States Department of State; 301-434-4927; [email protected] Binder, Diane [386] The Findings Group LLC; 404-783-7820; [email protected] Bingham, Gary [306] Georgia State University; 404-413-8020; [email protected] Bir, Anupa [672] RTI International; 781-434-1708; [email protected] Birnbaum, Matt [687] National Fish and Wildlife Foundation; 202-595-2461; [email protected] Bisgard, Jennifer [268] Khulisa Management Services (Pty) Ltd; [email protected] Bishop, Pamela [248-673] University of Tennessee, Knoxville; 865-974-9348; [email protected] Black, Jason [137-248] University of Tennessee, Knoxville; 401-487-9256; [email protected] Blair, Meredith [514] Humanity United; 650-587-2015; [email protected] Blanton, Linda [827] Cumberland County Partnership for Children; 910-867-9700 x2230; [email protected] Blasinsky, Margaret [137] The Madrillon Group Inc; 703-821-1244; [email protected] Blazovich, Linda [137] St Catherine University; 651-690-6594; [email protected] Bledsoe, Katrina [229-242-543-742-823] Walter R McDonald and Associates Inc; 301-881-2590 x255; [email protected] Bleeker, Martha [126-226] Mathematica Policy Research; 609-275-2269; [email protected] Block, Carolyn [673] Illinois Criminal Justice Information Authority; [email protected] Blough, Joan M [630] Great Start Early Childhood Investment Corporation; 517-371-9000; [email protected] Blumenthal, Daniel [541] Morehouse School of Medicine; 404-752-1625; [email protected] Blumhardt, Felix [291] The Evaluation Group; 803-454-2012; [email protected] Blust, Kendal [693] Brigham Young University; 520-243-3038; [email protected] Boardman, Craig [569] Ohio State University; [email protected] Boeke, Melissa [137] Minnesota Institute of Public Health; 763-427-5310 x133; [email protected] Bohman, Thomas [137] University of Texas, Austin; 512-232-0605; [email protected] Bohni Nielsen, Steffen [121] Rambøll Management Consulting; +45-2948-8103; [email protected] Bolland, Kathleen [409-734] University of Alabama; 205-348-3926; [email protected] Boller, Kimberly [307] Mathematica Policy Research; 609-275-2341; [email protected] Bolton, Patricia [437-816] Battelle Memorial Institute; 206-528-3310; [email protected] Bolton-Gary, Cynthia [137] University of South Carolina, Beaufort; 843-208-8230; [email protected] Bonbright, David [703] Keystone Accountability; +44-773-403-7455; [email protected] Bond, Sally [510] The Program Evaluation Group LLC; 919-545-9200; [email protected] Bonnet, Deborah [235-736] Fulcrum Corporation; 703-876-9750 x209; [email protected] Bonney, Richard [267-347] Cornell Univeristy; 607-254-2442; [email protected] Booker, Cristina [227] Abt Associates Inc; 617-349-2681; [email protected] Boothroyd, Roger [262-718] University of South Florida; 813-974-1915; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 174 Borden, Lynne [534-773] University of Arizona; 520-621-1063; [email protected] Borenstein, Juliana [137] National School of Public Health (ENSP/Fiocruz); +55-21-2598-2444; [email protected] Borgman-Arboleda, Catherine [253] City University of New York (CUNY); 646-249-3027; [email protected] Boris, Elizabeth [745] Urban Institute; 202-261-5770; [email protected] Borland, Jennifer [640] Rockman et al; 812-333-8883; [email protected] Borman, Kathryn [137] University of South Florida; 813-974-9058 Boruch, Robert F [614] University of Pennsylvania; [email protected] Bosma, John [301] WestEd; 562-799-5122; [email protected] Boucher, Suzanne [541] Wayside Youth and Family Support Network; 617-926-3600 x309; [email protected] Bouroncle, Alberto [669] LTG Associates Inc; 301-270-0882; [email protected] Bowen, Kathryn A [597-696-821-897] Centerstone Research Institute; 615-460-4166; [email protected] Bower, Don [519-623-678-809] University of Georgia; 706-542-7566; [email protected] Bowerman, Rashell [811] Western Michigan University; 269-275-2981 Bowles, Scott [846] United States Environmental Protection Agency; 202-566-2208; [email protected] Boyce, Ayesha [137-208-502-591] University of Illinois at Urbana-Champaign; 602-614-6039; [email protected] Boyd, Heather [612] Virginia Polytechnic Institute and State University; 540-231-9423; [email protected] Boyle, Shanelle [222-802] EVALCORP; 949-466-9108; [email protected] Bracamonte-Wiggs, Christine [534-773] University of Arizona; 520-621-9756; [email protected] Bracken, Roxie [605] Keenesburg School District; 303-536-2006; [email protected] Bradford, Sarah [116-831] Kansas State University; 785-532-5930; [email protected] Bradley-Bull, Kristin [240] New Perspectives Consulting Group; 919-286-5995; [email protected] Bradshaw, Wendy [722] University of South Florida; 813-974-4509; [email protected] Brandão, Daniel [261-900] Fonte Institute; +551130321108; [email protected] Brandon, Paul [611-812] University of Hawaii; 808-956-4928; [email protected] Bransfield, Christopher [137-879] Concord Evaluation Group LLC; 978-369-3519; [email protected] Brassell, Thomas [658-695-829] United States Department of Veterans Affairs; 513-247-2251; [email protected] Braun, Drew [380-626] Bethel School District; 541-689-3280; [email protected] Braun, Fern M [527] RTI International; 919-541-7112; [email protected] Braun, Margaret [348] Oregon Department of Corrections; 503-945-9001; [email protected] Braverman, Marc [128] Oregon State University; 541-737-1021; [email protected] Bravo, Carlos [547] Evaluation, Management & Training Associates Inc; 916-983-6693; [email protected] Braza, Mark [647] United States Government Accountability Office; 202-512-7187; [email protected] Braziel Rollins, Kayla [226-305] Texas A&M University; 979-845-8363; [email protected] Breck, Andrew [118] ICF Macro; 646-695-8140; [email protected] Brees, Linda [830] Greenville Hospital System; 864-467-3333; [email protected] Breihan, Ann [613] College of Notre Dame of Maryland; 410-532-5554; [email protected] Bremner, Larry K [238-252] Proactive Information Services Inc; 204-292-7880; [email protected] Brennan, Kathy [808] Innovation Network; 202-728 0727 x101; [email protected] Brenner, Ashley [730] Science and Technology Policy Institute; 202-419-3722; [email protected] Brett, Belle [137] Brett Consulting Group; 617-628-2068; [email protected] Brewington, Dave [137] YMCA of the USA; 312-419-8288; [email protected] Briceno, Bertha [789] World Bank; 202-473-1000; [email protected] Bridwell, Sandra [809] Cambridge College; [email protected] Briggs, Ronetta [137] O Si Yo Communications; 972-741-5756; [email protected] Briggs, Susan [212] Independent Consultant; 503-288-0824; [email protected] Brindis, Claire [592-797] University of California, San Francisco; 415-476-5255; [email protected] Bristol, Hollace [223] Coconino County Education Services Agency; 928-679-8060; [email protected] Britt, Heather [283] Independent Consultant; +20-10-387-5228; [email protected] Britton, Edward [226] WestEd; 650-381-6416; [email protected] Brock, Andrea [304] Center for Effective Philanthropy; 617-492-0800 x231; [email protected] Brock, Donna [787] Evaluation Consulting Services Inc; 540-343-9977; [email protected] Brodersen, Marc [595-850] University of Colorado, Denver; 303-315-3617; [email protected] Brooks, Pauline [310-817-823] Independent Consultant; 323-821-5891; [email protected] Brough, Steffan [268] Education Review Office; [email protected] Broughton, Edward [558] University Research Company LLC; 917-204-0663; [email protected] Brouselle, Astrid [749] University of Sherbrooke; 450-466-5000 x3682; [email protected] Broussard, Jennifer [376] Texas Education Agency; 512-463-1241; [email protected] Broussard, Marsha [222-320-884] Louisiana Public Health Institute; 504-301-9800; [email protected] Brown, Adama [137] University of Texas, Austin; 232-4762; [email protected] Brown, Charles [137] Centerstone Research Institute; 615-463-6641; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 175 Brown, Corliss [596] University of North Carolina at Chapel-Hill; 919-843-7878; [email protected] Brown, Courtney [566-874] Indiana University; 812-330-1706; [email protected] Brown, Gary [635] Washington State University; 509-335-1352; [email protected] Brown, Jacqueline [541] Empowerment Resource Center for Women Inc; 770-234-9902; [email protected] Brown, Jim [355] University of Minnesota; 612-624-7754; [email protected] Brown, Kristin [137] Centers for Disease Control and Prevention; 770-488-6414; [email protected] Brown, Lisanne [222-320-382-592-708-797-884] Louisiana Public Health Institute; 504-301-9813; [email protected] Brown, Prudence [104] Independent Consultant; 212-662-2056; [email protected] Brown, Tom [320] NC Health and Wellness Trust Fund; 919-855-6887; [email protected] Brown Urban, Jennifer [283] Montclair State University; [email protected] Brownson, Carol [723] Washington University in St Louis; 314-286-1915; [email protected] Bruce, Catherine D [900] Trent University; 705-748-1011 x7500; [email protected] Bruckner, Monica [214] Carleton College; 507-222-7096; [email protected] Bruhn, Thea C [528-561] United States Department of State; 202-647-9897; [email protected] Brun, Carl [508] Wright State University; 937-775-2868; [email protected] Brunner, Wendy [279] Minnesota Department of Health; 651-201-5895; [email protected] Bryant, Jeff [684] Community Foundation for Monterey County; 831-375-9712; [email protected] Bryant, Max [137] Washington University in St Louis; 314-935-3734; [email protected] Buchan, Alison [387] University of British Columbia; 604-822-0763; [email protected] Budiharsana, Meiwita [641] Population Council; +844-3-7345821; [email protected] Bufford, Jennifer L [133] Marshfield Clinic; 715-221-8939; [email protected] Buhler, Holly [758] University of British Columbia; 604-875-4111 x66021; [email protected] Buller-Taylor, Terri [758] Independent Consultant; 604-241-9503; [email protected] Burch, Vanessa [256] University of Cape Town; +021-6714255; [email protected] Burden, Frances [137] Quill Research Associates; 202-412-0301; [email protected] Burdick, Williams [256] Foundation for Advancement of International Medical Education and Research; 215-823-2232; [email protected] Burgess, Wilella [392] Purdue University; 765-494-0668; [email protected] Burke, Brian [896] RTI International; 919-541-6851; [email protected] Burke, Michael [293-896] RTI International; 202-974-7805; [email protected] Burkhardt, Jason [137-358] Western Michigan University; 386-473-2207; [email protected] Burkum, Kurt [342-424-763-843] ACT; 319-341-2301; [email protected] Burley, Kim [137] Centers for Disease Control and Prevention; 770-488-6321; [email protected] Burr, Erin [315-532-872] Oak Ridge Institute for Science and Education; 757-567-9058; [email protected] Burroughs, Beth [804] Montana State University; 877-572-5032; [email protected] Bush Stevens, Amy [364] Owl Creek Consulting; 740-427-2802; [email protected] Buteau, Ellie [304] Center for Effective Philanthropy; 617-492-0800 x213; [email protected] Butler, Mary Odell [662] University of Maryland; 703-860-6564; [email protected] Byrum, Lorrie [801] Oklahoma Department of Mental Health and Substance Abuse Services; 405-522-6169; [email protected] CCCCCCCC Cabell, Stephanie [528-561] United States Department of State; 202-647-2557; [email protected] Cabin, William [137] Richard Stockton College; 201-445-9180; [email protected] Cabral, Linda [658-841] University of Massachusetts; 508-856-8423; [email protected] Cahalan, Margaret [887] United States Department of Education; 202-401-1679; [email protected] Cai, Xinsheng [137] American Institutes for Research; 202-403-6929; [email protected] Calhoun, Avery [711] University of Calgary; 780-492-2520; [email protected] Callahan, Jane [630] Community Anti-Drug Coalitions of America; 703-706-0560 x229; [email protected] Callander, Najah [585] United Way of Greater Houston; 713-685-2456; [email protected] Callow-Heusser, Catherine [369] EndVision Research and Evaluation LLC; 435-881-8811; [email protected] Camacho, Alex [698] Nemours Health and Prevention Services; 302-444-9187; [email protected] Camillo, Furio [826] University of Bologna; +39(051)2098251; [email protected] Campbell, David [231-344] Science-Metrix Corp; 800-299-8061; [email protected] Campbell, Johnavae [137-596-876] University of North Carolina at Chapel-Hill; 919-843-7878; [email protected] Campbell, Suellen [137] St Catherine University; 651-690-6586; [email protected] Campbell, William [713] Institute for Community Living Inc; 718-369-7226 x227; [email protected] Campos, Henry [256] Universidade Federal do Ceará; +55-85-33667452; [email protected] Candido, Tamara [537] Indian and Northern Affairs Canada; 613-947-9236; [email protected] Canen, Eric [715-866] University of Wyoming; 307-760-0307; [email protected] Cantillon, Dan [686] ICF International; 703-934-3000; [email protected] Cao Yu, Hanh [264] Social Policy Research Associates; 510-763-1499 x631; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 176 Capela, Stanley [308-388-880] HeartShare Human Services of New York; 718-422-4248; [email protected] Caracelli, Valerie J [228-322-371] United States Government Accountability Office; 202-512-9792; [email protected] Cardoso, Gisela [137] National School of Public Health (ENSP/Fiocruz); +55-21-3298-8582; [email protected] Carey, Martha Ann [367-667] Maverick Solutions; 626-710-2063; [email protected] Carillo, Nancy [234] Albuquerque Public Schools; 505-872-6804; [email protected] Carleton-Hug, Annelise [267-281-427] Trillium Associates; 724-963-5406; [email protected] Carley, Stephen [311] Georgia Institute of Technology; [email protected] Carman, Joanne [365-803] University of North Carolina at Charlotte; 704-687-4533; [email protected] Carnevale, John [801] Carnevale Associates LLC; 301-977-3600; [email protected] Carney, Jennifer [277] Abt Associates Inc; 301-634-1747; [email protected] Carothers, Bobbi [675-827] Washington University in St Louis; 314-935-3745; [email protected] Carouthers, Dewey [137] 180 Degree Change; [email protected] Carpenter, Jenneth [801] Advocates for Human Potential; 260-449-9423; [email protected] Carpenter, Laurie [137] University of Michigan; 734-615-7825; [email protected] Carr, Matthew [526] Westat; 301-610-5513; [email protected] Carran, Deborah [845] Johns Hopkins University; 410-516-9753; [email protected] Carrillo, Nancy [109-267] Albuquerque Public Schools; 505-934-0680; [email protected] Carswell, Peter [780] University of Auckland; +0064 9 373 7599; [email protected] Carter, Frances [551-876] University of Maryland, Baltimore County; 901-483-2186; [email protected] Caruthers, Flora [362] Florida Legislature; 850-487-9226; [email protected] Carvalho, Soniya [316] World Bank; 202-473-5705; [email protected] Cash, Timothy [273] University of Illinois at Urbana-Champaign; 217-333-5350; [email protected] Casillas, Wanda [283-381] Cornell University; 210-347-4914; [email protected] Cassaro, Denice [318-559-696] Cornell University; 607-256-0373; [email protected] Castañeda-Emenaker, Imelda [117-261-392] University of Cincinnati; 513-556-3816; [email protected] Castellow, Jennifer [280] University of South Carolina; 919-274-5265; [email protected] Castro, Karim [319] Consorcio por la Salud, Ambiente y Desarrollo (ECOSAD); + 51 1 332 5713 Cater, Melissa [692] Louisiana State University; 225-578-2903; [email protected] Catrambone, Jennifer [859] Ruth M Rothstein CORE Center; 312-572-4512; [email protected] Catsambas, Tessie [439-738-815] EnCompass LLC; 301-299-3266; [email protected] Caudle, Sharon [816] Texas A&M University; 979-845-1673; [email protected] Cauley, Katherine [508] Wright State University; 937-258-5546; [email protected] Caveny-Cox, Chris [137] North Carolina State University; 704-922-2126; [email protected] Cawley, Marge [562] National Development and Research Institutes (NDRI); 919-863-4600 x223; [email protected] Caywood, JoAnna [320] Lucile Packard Foundation for Children's Health; 650-724-1618; [email protected] Cecil, Heather [126] Center for Schools and Communities; 717-763-1611 x198; [email protected] Cellar, Douglas [325] DePaul University; 773-325-7887; [email protected] Cerna, Rebeca [683] WestEd; [email protected] Cervantes, Bianca [387] University of British Columbia; 604-822-2083; [email protected] Chacko, Thomas [256] PSG Institute of Medical Sciences and Research; +91-422-2570170; [email protected] Chakraborty, Bubli [137] Provincial Health Services Authority of Bristish Columbia; 604-219-2734; [email protected] Chamberlin, Cliff [682] MANILA Consulting Group Inc; 571-633-9797; [email protected] Champion, Heather [595] Center for Creative Leadership; 336-286-4230; [email protected] Chan, Tsze [645] American Institutes for Research; [email protected] Chang, Chin-Wen [137] National Applied Research Laboratories; 886-2-2882-4564; [email protected] Chansky, Melanie [321] National Recreation and Parks Association; 571-439-4812; [email protected] Chapel, Thomas [107-619-819-867] Centers for Disease Control and Prevention; 770-488-6467; [email protected] Chapin, Deborah A [598] Excelsior College; 518-463-8115; [email protected] Chapman, Melissa [133-265-525-734] University of Iowa; 319-360-0907; [email protected] Chappelle, Eileen [137] Centers for Disease Control and Prevention; 770-488-8144; [email protected] Charon, Rita [137] Columbia University; 212-305-4942; [email protected] Chatterji, Madhabi [400] Columbia University; [email protected] Chatters, Seriashia [383-541] University of South Florida; 813-732-5865; [email protected] Chavez, Margeaux [137] University of South Florida; 813-974-9412 Chavis, David M [264] Community Science; 301-519-0722; [email protected] Chazdon, Scott [733] University of Minnesota; 612-624-0982; [email protected] Checkoway, Berry [401] University of Michigan; 734-763-5960; [email protected] Chelimsky, Eleanor [100-102-506] Independent Consultant; [email protected] Chelyshkova, Marina [375] State University of Management; 499-784-6301; [email protected] Chen, Ge [594] University of Texas, Austin; 512-471-1205; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 177 Chen, Huey [243] Centers for Disease Control and Prevention; 770-488-3732; [email protected] Chen, Hui-Jung [137] National Taiwan Normal University; 886-2-7734-6817; [email protected] Chen, Lynn [137] University of Texas, Austin; 512-232-4761; [email protected] Chen, Mei-kuang [206-586-666-719] University of Arizona; 520-621-5463; [email protected] Cheney, David [567] SRI International; 703-247-8707; [email protected] Chi, Bernadette [125] University of California, Berkeley; 510-643-1294; [email protected] Chianca, Thomaz [587-738-815-898] COMEA Evaluation Ltd; +55 21 9880-3683; [email protected] Chiasson, Emily [699] Institute for Community Health; 617-499-6613; [email protected] Chien, Victoria [280-704] University of South Carolina; 517-927-9494; [email protected] Childs, Karen [606] Florida Positive Behavior Support; 813-974-7358; [email protected] Chinman, Matthew [699] RAND Corporation; 818-481-3909; [email protected] Chitiyo, George [137] Tennessee Technological University; 931-372-3676; [email protected] Chiu, Korinne [137-656] University of North Carolina at Greensboro; 305-905-0712; [email protected] Chiu, Mei-Hung [137] National Taiwan Normal University; 886-2-7734-6817; [email protected] Cho, Hyunjung [810] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); +82-2-589-2942; [email protected] Chou, Tommy [900] University of Cincinnati; 817-994-0426; [email protected] Chouinard, Jill Anne [252-291] University of Ottawa; 613-722-6384; [email protected] Chovnick, Gary [137-779] Battelle Memorial Institute; 206-528-3013; [email protected] Chow, Wai-Ying [881] University of Maryland; [email protected] Chrispim, Pedro Paulo [137-814] National School of Public Health (ENSP/Fiocruz); +55-21-25982861; [email protected] Christensen, Kristin [137] University of Texas, Austin; 512-232-0606; [email protected] Christian, Carole [271] National Institutes of Health; 301-451-7431; [email protected] Christian, Cinda [509] Austin Independent School District; 512-414-3461; [email protected] Christie, Christina [220-353-393-498-894] University of California, Los Angeles; 310-825-0432; [email protected] Chung, Yi-Hsing [375] National Chi Nan University; 886-49-2911-242; [email protected] Cianca, Marie [788] St John Fisher College; 585-899-3878; [email protected] Cicchinelli, Louis [589-645] Mid-continent Research for Education and Learning; 303-632-5518; [email protected] Cici, Kristen [137-571] University of Minnesota; 651-353-2085; [email protected] Ciminillo, Cara [134-223-305-515] University of Pittsburgh; 412-624-7240; [email protected] Cinnamond, Karen [331] Human Development Institute; 859-977-4050 x222; [email protected] Cisneros-Cohernour, Edith J [137-294] University of Yucatan; +52999-9224557; [email protected] Cisterna - Alburquerque, Dante [532] Michigan State University; 517-432-8388; [email protected] Clark, Heather [137] Texas A&M University; 979-845-6957; [email protected] Clark, Helene [703] ActKnowledge; 212-817-1906; [email protected] Clark, Melissa [884] Mathematica Policy Research; 609-799-3535; [email protected] Clark, MH [120-799] University of Central Florida; 618-453-3551; [email protected] Clark, Sherrill [379] California Social Work Education Center; 510-642-9272; [email protected] Clasen, Carla [508] Wright State University; 937-258-5543; [email protected] Clawson, Heather [137-259] ICF International; 703-225-2247; [email protected] Clay, Phyllis [234-346] Albuquerque Public Schools; 816-935-1532; [email protected] Clements, Christine [658-841] University of Massachusetts; 508-856-6521; [email protected] Clements, Paul [132] Western Michigan University; 269-387-5699; [email protected] Clementz, A Rae [656] University of Illinois at Urbana-Champaign; 217-615-4201; [email protected] Cline, Rebecca [364] The Ohio Domestic Violence Network; 1-800-934-9840; [email protected] Clinton, Janet [393-780] University of Auckland; 649 3737599; [email protected] Clinton-Sherrod, A Monique [137] RTI International; 828-293-3989; [email protected] Coats, Sue [245] Turning Point Inc; 586-463-4430 Cobigo, Virgine [749] Queen's University at Kingston; 613-533-6000 x77676; [email protected] Coburn, Jamie [137] Tennessee Technological University; 931-526-1870; [email protected] Coffey, Debra [526-799] Research for Better Schools; 215-568-6150; [email protected] Coffey, John [137] Claremont Graduate University; [email protected] Coffman, Julia [124-212-505-830] Center for Evaluation Innovation; 703-837-8358; [email protected] Coghlan, Anne [757] Pact Inc; +66 81 900 0220; [email protected] Cohen, Barry [419-536-798] Rainbow Research Inc; 612-824-0724 x202; [email protected] Cohen, Benjamin [126] Center for Schools and Communities; 717-763-1161 x159; [email protected] Cohen, Elaine [137] National Parkinson Foundation; 212-873-0739; [email protected] Cohen, Marcia [228] Development Services Group Inc; 301-951-0056; [email protected] Cohn, Sarah [548] Science Museum of Minnesota; 651-265-5972; [email protected] Coker, Elizabeth [803] Lenox Hill Neighborhood House; 212-744-5022; [email protected] Cole, Janice [831] Kansas State University; 795-532-5930; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 178 Cole, Russell [307] Mathematica Policy Research; 609-716-4549; [email protected] Cole Beebe, Maggie [885] RTI International; 781-434-1728; [email protected] Coleman, Marcus [678] University of Georgia; [email protected] Coleman, Stephanie [622-761] University of Missouri; 573-300-7615; [email protected] Collier-Goubil, Deshonna [673] National Institute of Justice; 707-980-3161; [email protected] Collins, Charles [137-630-710] Michigan State University; 530-321-0155; [email protected] Collins, Isabelle [527] Technopolis; [email protected] Collins, Krista [126-226] Claremont Graduate University; 858-922-6596; [email protected] Colombo, Marie [264] Skillman Foundation; 313-393-1151; [email protected] Colomer, Soria E [671-768] University of Georgia; 601-278-5820; [email protected] Colvin, Delta Q [137] Wichita State University; 316-978-3317; [email protected] Coman, Emil [137-262-600] Institute for Community Research; 860-278-2044 x257; [email protected] Comer Cook, Tiffany [771-840] University of Wyoming; 307-760-1911; [email protected] Compton, Donald [588-698] Centers for Disease Control and Prevention; 678-457-3155; [email protected] Conley, Dave [137] Museum of Science and Industry; [email protected] Conner, Ross [102-815] University of California, Irvine; 949-824-0563; [email protected] Connor, Christine [397] American Red Cross; 202-303-4567; [email protected] Connors, Susan [385-595-850] University of Colorado, Denver; 303-460-0275; [email protected] Cook, Elisabeth [602] Westat; 240-453-2917; [email protected] Cooksy, Leslie [100-282-322-500-580-622-822-902] University of Delaware; 302-831-6872; [email protected] Cooper, Andrew [212] Diana, Princess of Wales Memorial Fund; +44 0 20 7902 5521; [email protected] Cooper, Peter [224] Room to Read; 415-561-3331 x120; [email protected] Copeland-Carson, Jacqueline [662] Copeland Carson & Associates; 408-674-2563; [email protected] Coplen, Michael [235-736] United States Department of Transportation; 202-493-6346; [email protected] Coppola, Nanci [317] Program Reach Inc; 718-409-0800; [email protected] Corliss, Stephanie [879] University of Texas, Austin; 512-232-1506; [email protected] Corn, Jenifer [137] North Carolina State University; 919-513-8527; [email protected] Cornetto, Karen [386] Austin Independent School District; 512-414-3661; [email protected] Cornish, Disa [373] University of Northern Iowa; 319-273-7476; [email protected] Corron, Amy [585] United Way of Greater Houston; 713-685-2302; [email protected] Coryn, Chris [393] Western Michigan University; 269-387-5906; [email protected] Cosentino de Cohen, Clemencia [277-371] Urban Institute; 202-261-5409; [email protected] Costantino, Tracie [768] University of Georgia; 706-542-1640; [email protected] Costello, Humphrey [546-715] University of Wyoming; 307-399-8484; [email protected] Cotner, Bridget [137] University of South Florida; 813-974-7384; [email protected] Coulbertson, LaShonda [740] Center for Equal Health; 813-468-7165; [email protected] Coulbertson, LaShonda T [740] Center for Equal Health; 813-468-7165; [email protected] Coulter, Andrea [137] Southern Illinois University Carbondale; 618-453-5371; [email protected] Coulton, Claudia [306] Case Western Reserve University; 216-368-2708; [email protected] Cousins, J Bradley [137-236-291-498-815] University of Ottawa; 613-562-5800 x4036; [email protected] Coverdale, Bradley [137] University of Maryland; 330-464-2397; [email protected] Cowell, Alex [578] Georgia Department of Community Health; 404-463-2725; [email protected] Cox, Matt [693] Brigham Young University; 801-636-6698; [email protected] Cozzens, Susan [391] Georgia Institute of Technology; 404-385-0397; [email protected],edu Craig, Diane [394] University of Florida; 352-332-1587; [email protected] Crain, Cathleen [669] LTG Associates Inc; 301-270-0882; [email protected] Cram, Fiona [591] Katoa Ltd; +64-9-5502231; [email protected] Crave, Mary [238-439-534-697] University of Wisconsin; 608-262-6677; [email protected] Crawford, Jewel [137] Wholistic Stress Control Institute Inc; 404-755-0068 x3017; [email protected] Crohn, Kara [427-607] Research Into Action; 951-742-5619; [email protected] Crosse, Scott [721] Westat; 301-294-3979; [email protected] Crowder, Isabelle [768] University of Georgia; 706-546-9168; [email protected] Crusto, Cindy A [211-242] Yale University; 203-789-7645; [email protected] Cruz, Kari [720] Centers for Disease Control and Prevention; 770-488-0789; [email protected] Cruz, Marly [137-511-814] National School of Public Health (ENSP/Fiocruz); +55 21 25982861; [email protected] Cullen, Anne [265-282-514-740] Western Michigan University; 269-387-5918; [email protected] Cullen, Marica [203] Illinois State Board of Education; 217-557-7323; [email protected] Culver, Steve [594] Virginia Tech; 540-231-4581; [email protected] Cummings, Harry [898] University of Guelph; 519-823-1647; [email protected] Cummings, Megan [682] MANILA Consulting Group Inc; 571-633-9797; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 179 Cundiff, Nicole [130-137] University of Alaska, Fairbanks; 217-390-7741; [email protected] Curiel, Joseph [763] Action Consulting and Evaluation Team (ACET) Inc; 952-922-1811; [email protected] Currie, Michelle [336] Cornell University; 212-340-2949; [email protected] Curry Villeneuve, Jennifer [257] BTW Informing Change; 510-665-6100; [email protected] Curtis, LaShawn [717] RTI International; 770-407-4913; [email protected] Curtis, Patrick [707] Walter R McDonald and Associates Inc; 301-881-2590 x245; [email protected] DDDDDDDD D‘Attoma, Ida [826] University of Bologna; +39(051)264182; [email protected] Daffin, Larry [671] New York University; 832-453-8814; [email protected] Dahlke, Katie [306] Learning Point Associates; 630-649-6628; [email protected] Dai, Tao [254] Chinese Academy of Sciences; [email protected] Daltuva, Judith [355] University of Michigan; 734-936-0756; [email protected] D'Amante, Dannalea [137] City Year Inc; 617-927-2436; [email protected] D'Amico, Leigh [137-874] University of South Carolina; 704-919-1967; [email protected] Damle, Ranjana [109-234-244] Albuquerque Public Schools; 505-872-6801; [email protected] Daniel-Echols, Marijata [254-513] HighScope Educational Research Foundation; 734-485-2000 x275; [email protected] Daniels, Jason [356] University of Alberta; 780-492-6332; [email protected] Dannreuther, Maggie [244] Stennis Space Center; 228-688-2003; [email protected] Danter, Elizabeth [267] Institute for Learning Innovation; 410-956-5144; [email protected] Darandari, Eqbal [860] National Commission on Academic Assessment and Accreditation; 955-5-059-6785; [email protected] Daro, Deborah [307] Chapin Hall; 773-256-5127; [email protected] Dasgupta, Sathi [553] SONA Consulting Inc; 301-775-3380; [email protected] Davidson, Jane [229-800] Real Evaluation Ltd; +64-9-575-1982; [email protected] Davidson, Katrina [519] Augusta Partnership for Children Inc; 706-721-4885; [email protected] Davidson, Pamela [590] University of California, Los Angeles; 310-825-7188; [email protected] Davidson, Tala [436] Western Michigan University; 269-903-9680; [email protected] Davies, Randy [435-752] Brigham Young University; 801-422-5229; [email protected] Davis, Helena L [730] National Institute of Environmental Health Sciences; 919-316-4813; [email protected] Davis, James Earl [200-322] Temple University; [email protected] Davis, Mende [719-824] University of Arizona; 520-626-7820; [email protected] Davis, Owen [824] University of Arizona; 520-621-7953; [email protected] Davis, Sarita [629-696] Georgia State University; 404-413-5134; [email protected] Davis-White, Nicole [137] Family Resource Center of South Florida; 954-232-3766; [email protected] Dawes, Katherine [542-687] United States Environmental Protection Agency; 202-566-2189; [email protected] Dawkins, Nicola [118] ICF Macro; 404-592-2136; [email protected] Daws, John T [339-420-559-628] University of Arizona; 520-318-7259 x119; [email protected] de Alteriis, Martin [237] United States Government Accountability Office; 703-525-9153; [email protected] de Guzman, Anna [137-208] University of Denver; 303-871-4198; [email protected] De La Cerda, H Pamela [776] Centers for Disease Control and Prevention; 404-639-8920; [email protected] De La Rosa, Josue [582] Research Works Inc; 914-333-7946; [email protected] de Mello, Maeve B [636] Pact Inc; 202-466-5666; [email protected] De Ruijter De Wildt, Marieke [543] LEI Wageningen UR; +31-70-3358368; [email protected] Dean, Allyson [798] University of Southern Maine; 207-780-5833; [email protected] Dean-Coffey, Jara [284-891] jdcPartnerships; 415-482-7839 x2; [email protected] Debrot, Karen [899] Centers for Disease Control and Prevention; 770-488-1037; [email protected] Decker, Lauren [137] Edvance Research; 210-558-4148; [email protected] Decker, Sarah [137-729] ICF International; 703-225-2244; [email protected] Decotelli, Paula Vita [137-511-814] National School of Public Health (ENSP/Fiocruz); +55 21 88430548; [email protected] DeGroff, Amy [776] Centers for Disease Control and Prevention; 770-488-2415; [email protected] DeHart, Dana [878] University of South Carolina; 803-777-7867; [email protected] DeJoy, Sharon [306] State University of New York College at Potsdam; 315-267-3136; [email protected] Deke, John [265] Mathematica Policy Research; 609-275-2230; [email protected] Del Grosso, Patricia [307] Mathematica Policy Research; 609-275-2252; [email protected] Del Vecchio, Ann [417-857] Alpha Assessment Associates; 505-341-2263; [email protected] Delaney, Linda [704] LFD Consulting LLC; 870-225-1103; [email protected] Delgatty, Christi [697] Texas State University; 719-761-5145; [email protected] Deluhosh, Karen [137] Center for Health Training; 206-447-9538; [email protected] Derzon, Jim [320-721] Battelle Memorial Institute; 703-248-1640; [email protected] Desai, Mona [126-802] EVALCORP; 510-332-8242; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 180 Desiderio, Gina [312] Healthy Teen Network; 410-685-0410; [email protected] Destefano, Lizanne [225] University of Illinois at Urbana-Champaign; 217-333-9625; [email protected] Deussen, Theresa [811] Education Northwest; 503-275-9500; [email protected] Devaney, Barbara [611-826] Mathematica Policy Research; 609-275-2389; [email protected] Devaney, Tom [853] Weikart Center for Youth Program Quality; 734-961-6900; [email protected] Devlin-Foltz, David [552] Aspen Institute; 202-736-5812; [email protected] Dewey, Jennifer [244] James Bell Associates; 703-528-3230; [email protected] DeWitt, Caroline [695] Human Resources and Skills Development; 613-523-9533; [email protected] Diaz, Elizabeth [517] Gay, Lesbian & Straight Education Network; 646-388-8051; [email protected] Diaz, Marycruz [214] WestEd; 510-302-4220; [email protected] Diaz, Rebeca [383] WestEd; 510-302-4275; [email protected] Diaz Puente, Jose Maria [435-704] Polytechnic University of Madrid; +34-91-336-3986; [email protected] Dick, Virginia [137-230-244-310-519-623-678-809] University of Georgia; 706-542-6272; [email protected] Dickenson, Tammiee [225-606-685] University of South Carolina; 803-777-1246; [email protected] Dickinson, Pauline [137] Massey University; +6493666136; [email protected] Dickinson, Wendy [137] Ringling College of Art and Design; 941-323-1177; [email protected] Diehl, David [129-734] University of Florida; 352-273-3526; [email protected] Dietsch, Barbara [683] WestEd; 562-799-5126; [email protected] Dillman, Lisa [389] University of California, Los Angeles; 310-206-6944; [email protected] Dilworth, Caroline [730] National Institute of Environmental Health Sciences; [email protected] Diserens, Deborah [256] Foundation for Advancement of International Medical Education & Research; 215-823-2292; [email protected] Disler, Sheri [709] Centers for Disease Control and Prevention; 770-488-3713; [email protected] Dixon, L Beth [118] New York University; 212-998-5584; [email protected] Dixon, Maressa [137] University of South Florida; 813-974-9412; [email protected] Dixon-Reeves, Regina [677] Lloyd A Fry Foundation; 312-580-0310; [email protected] Doberneck, Diane [543] Michigan State University; 517-353-8977; [email protected] Dobrowlski, David [757] Pact Inc; +66 2 2313402; [email protected] Dobrowski, David J [545] First 5 Monterey; 831-886-7177; [email protected] Dobson, Noelle [212] Community Health Partnership; 503-227-5502; [email protected] Doe, Christine [532-811] Queen's University at Kingston; 613-484-0811; [email protected] Dokter, Erin [137] University of Arizona; 520-621-2440; [email protected] Dolfin, Sarah [226] Mathematica Policy Research; 609-275-2365; [email protected] Dollard, Norin [222] University of South Florida; 813-974-3761; [email protected] Domoff, Sarah [119] Bowling Green State University; 203-788-2510; [email protected] Donaldson, Joseph [274-394-434-652] University of Tennessee; 865-974-7245; [email protected] Donaldson, Stewart [507-704-742-823] Claremont Graduate University; 909-607-9001; [email protected] Donoff, Mike [261] University of Alberta; 780-492-1144; [email protected] Donovan, Kristen [126-222] EVALCORP; 949-271-6437; [email protected] Doolittle, Martha [509] Austin Independent School District; 512-414-3611; [email protected] Dorabawila, Vajeera [120-419] New York State Office of Children and Family Services; 518-402-7386; [email protected] Dorime-Williams, Marjorie [248] University of Illinois at Urbana-Champaign; 631-704-7491; [email protected] Dorman, Rebecca [224] Room to Read; 415-561-3331 x122; [email protected] Doucette, Ann [119-262] George Washington University; 202-994-8112; [email protected] Downey, Gilbert [203] Illinois State Board of Education; 217-780-0336; [email protected] Downs, Holly [208-589] University of Illinois at Urbana-Champaign; 217-372-5011; [email protected] Doyle, Elizabeth [112] Take Action Minnesota; 651-379-0745; [email protected] Drach, Linda [559-639] Oregon Public Health Division; 971-673-0591; [email protected] Drake, Mary [278] Jhpiego; 202-203-0923; [email protected] Drayton, Vonna [137-698] Nemours Health and Prevention Services; 302-444-9236; [email protected] Drever, Anita [120-794] University of Wyoming; 307-399-4238; [email protected] Drew, Christie [730] National Institute of Environmental Health Sciences; 919-544-9103; [email protected] Dube, Shanta [378] Centers for Disease Control and Prevention; 770-488-6287; [email protected] DuBow, Wendy [247-512-804] National Center for Women and Information Technology; 303-492-5462; [email protected] Duffy, Jennifer [521-619] University of South Carolina; 803-600-8550; [email protected] Duggan, Colleen [536] International Development Research Centre; 613-236-6163 x 2123; [email protected] Duignan, Paul [137] Parker Duignan Consulting; +64 4 9739729; [email protected] Dunavin, River [109-234] Albuquerque Public Schools; 505-872-6802; [email protected] Dunaway, Krystall [137-872] Eastern Virginia Medical School; 757-668-6451; [email protected] Dunet, Diane [137] Centers for Disease Control and Prevention; [email protected] Dunn, Cindi [137-220] Kansas State University; 785-532-5930; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 181 Dunn, Lillian L [118] New York City Department of Health and Mental Hygiene; 212-442-1849; [email protected] Duppong Hurley, Kristin [798] University of Nebraska, Lincoln; 402-472-5501; [email protected] Durland, John [137] Durland Consulting; 859-200-7946; [email protected] Durland, Maryann [137-410-595-855] Durland Consulting; 630-650-9944; [email protected] Dussault, Mary [296] Harvard-Smithsonian Center for Astrophysics; 617-496-7962; [email protected] Dyke Redmond, Tracy [601-846-862] Industrial Economics Inc; 617-354-0074 x193; [email protected] Dyrenforth, Sue R [237-695] United States Department of Veterans Affairs; 513-247-4680; [email protected] Dziadkowiec, Oliwier [137] Wichita State University; 316-978-3988; [email protected] EEEEEEEE Eames, Sandra [843] St Edward's University; 512-636-0530; [email protected] Earle, Jane [381] Cornell University; 607-255-0397; [email protected] Eblen, Matthew [271] National Institutes of Health; 301-443-5234; [email protected] Eckman, Karlyn [127] University of Minnesota; 651-308-7285; [email protected] Economos, Christina [400] Tufts University; [email protected] Eddy, Rebecca [298-606] Cobblestone Applied Research & Evaluation Inc; 714-981-0422; [email protected] Edelmann, Sid [352-570] World Bank; 202-458-4738; [email protected] Eduardo, Marino [738] Independent Consultant; +55 11 8371-9989; [email protected] Edwards, Alexa [137] University of North Carolina at Greensboro; 336-315-7436; [email protected] Edwards, Jessica [522] Pacific Institute for Research and Evaluation (PIRE); 909-265-2636; [email protected] Edwin, James [132] African Development Bank; +0021671102586; [email protected] Eidhammer, Asbjorn [858] Noweigian Agency for International Cooperation; +47 22 24 0367; [email protected] Eikenes, Morten [828] Office of the Auditor General of Norway; 472-224-1138; [email protected] Eke, Adanze [360] MANILA Consulting Group Inc; 404-639-0931; [email protected] Elgie, Susan [532] Independant Consultant; 416-531-9548; [email protected] Elkins, Catherine [132] RTI International; 919-541-8898; [email protected] Ellenbogen, Kirsten [877] Science Museum of Minnesota; 651-894-3373; [email protected] Ellias, Juanita M [790] Rivercity Woodworking LLC; 414-272-0437; [email protected] Ellis, Barbara [807] Centers for Disease Control and Prevention; 404-639-0637; [email protected] Ellis, Bruce [320-627] Battelle Memorial Institute; 703-875-2965; [email protected] Ellis, Katrina [817] University of Michigan; 734-845-6009; [email protected] Elston Lafata, Jennifer [137-779] Virginia Commonwealth University; 804-628-3293; [email protected] Endo, Hidenori [890] National Institute of Advanced Industrial Science and Technology; +81-29-862-6069; [email protected] Enev, Tiho [698] Nemours Health and Prevention Services; 302-444-9246; [email protected] Engle, Molly [274-667] Oregon State University; 541-737-4126; [email protected] Engstrom, Martha [378-867] Centers for Disease Control and Prevention; 770-488-5749; [email protected] Engstrom, Whitney [331] The Lewin Group; 703-269-5665; [email protected] Enright Patterson, Tracy [595] Center for Creative Leadership; 336-286-4418; [email protected] Enriquez-Olmos, Mariana [511-889] Independent Consultant; 303-755-4491; [email protected] Enyia, Amarachuku [831] University of Illinois at Urbana-Champaign; 217-721-0164; [email protected] Erchov, Simone [680] George Mason University; 703-993-8292; [email protected] Erwin, Katherine [541] Morehouse School of Medicine; 404-756-5278; [email protected] Escandon, Ines [301] Paraprofessional Healthcare Institute (PHI); 718-402-7766; [email protected] Escoffery, Lorna [674-825] Escoffery Consulting Collaborative Inc; 305-987-8975; [email protected] Espinoza, Robert [891] Funders for LGBTQ Issues; [email protected] Essien, Joyce [541] Emory University; 404-727-7835; [email protected] Estabrook, Linda [868] Hartford Gay and Lesbian Health Collective; 860-278-4163; [email protected] Estrello, Fred [843] St Edward's University; 512-636-0530; [email protected] Euale, David [851] Ontario Ministry of Education; 416-326-9369; [email protected] Eugene, Ngole Masango [137] Non-governmental Organization (NGO); +237-74-08-50-29; [email protected] Evan, Aimee [137] Quill Research Associates; 703-307-7559; [email protected] Evans, Donoria [137] Morehouse School of Medicine; 404-752-1187; [email protected] Evans, W Douglas [390] George Washington University; 202-994-3632; [email protected] Everett, Kristin [747] Western Michigan University; 269-387-3791; [email protected] Evergreen, Stephanie [232-670] Western Michigan University; 269-387-5920; [email protected] Eyerman, Joe [896] RTI International; 919-541-7139; [email protected] Ezumah, Bellarmine [541] Howard University; 347-351-1422; [email protected] Ezzell, Mark [320] North Carolina Health and Wellness Trust Fund; 919-606-7584; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 182 FFFFFFFF Fabian, Anupa [595] ICF Macro; 646-695-8178; [email protected] Faddis, Bonnie [526] RMC Research Corporation; 503-223-8248; [email protected] Falconer, Mary Kay [390] Ounce of Prevention Fund of Florida; 850-921-4494 x134; [email protected] Fallik, Beverlie [556-801] United States Department of Health and Human Services; 240-276-2438; [email protected] Farber, Stacey [137-216-676-885] Cincinnati Children's Hospital Medical Center; 513-803-0318; [email protected] Farley, Joanne [211-331] Human Development Institute; 859-257-4921 x80248; [email protected] Farr, Beverly [787] MPR Associates Inc; 510-849-4942; [email protected] Farr, Erin [219] Wright State University; 937-545-2084; [email protected] Farris, Kimberly [209] United States Army; 404-423-6799; [email protected] Farris, Rosanne [378-698] Centers for Disease Control and Prevention; 770-488-5007; [email protected] Favor, Kevin E [111-137-511] Lincoln University; 484-365-7587; [email protected] Fee, Robert [702] Savannah College of Art and Design; 912-525-6679; [email protected] Feger, Stephanie [832-882] Brown University; 401-274-9548; [email protected] Feldman, Jill [606] Research for Better Schools; 215-568-6150 x267; [email protected] Feldman, Laura [376-840] University of Wyoming; 307-399-1914; [email protected] Felisberto, Eronildo [814] Municipal Institute for Research and Planning; [email protected] Feller, Irwin [527] Pennsylvania State University; [email protected] Feng, Annie [137] National Institutes of Health; 301-402-2927; [email protected] Fernandez, Felix [259] ICF International; 703-225-2159; [email protected] Fernando, Sheara [280] University of South Carolina; 803-629-5578; [email protected] Ferrell, Nathalie [222-320-884] Tulane University; 504-988-6078; [email protected] Ferron, John [740] University of South Florida; 813-974-5361; [email protected] Fetterman, David [204-324-404-662-704-742] Fetterman & Associates; 650-269-5689; [email protected] Field, Julie [306] First 5 Sacramento; 916-876-6526; [email protected] Fierro, Leslie [279-589-691-709-894] SciMetrika; 909-987-4354; [email protected] Fierro, Rita [310-370] Independant Consultant; 215-893-0579; [email protected] Figueiredo, Cláudia [137-258] Institute for Learning Innovation; 410-956-5144; [email protected] Figueredo, Aurelio Jose [719] University of Arizona; 520-621-7444; [email protected] Filene, Jill [310] James Bell Associates; 954-659-8677; [email protected] Fine, David [137] Center for Health Training; 206-447-9538; [email protected] Fine, Wendy [285] Youth Guidance; 312-253-4900 x3920; [email protected] Finegood, Diane [641] The CAPTURE Project; 778-782-6706; [email protected] Finkbiner, Richard [682] MANILA Consulting Group Inc; 571-633-9797; [email protected] Finkelstein, Daniel [126-245] Mathematica Policy Research; 617-301-8996; [email protected] Finkelstein, Martin [137-317] Seton Hall University; 973-275-2056; [email protected] Finney, Pamela B [137] University of North Carolina at Greensboro; 336-315-7456; [email protected] Firth, Kim [299] Human Services Research institute; 503-924-3783 x-26; [email protected] Fisch, Peter [726] European Commission; +32-2-296-2137; [email protected] Fischer, Rob [117-306] Case Western Reserve University; 216-368-2711; [email protected] Fisher, Holly [360] Centers for Disease Control and Prevention; 404-639-1940; [email protected] Fitz, Gabriela [769] Issue Lab; 773-649-1790; [email protected] Fitzpatrick, Jody [102] University of Colorado, Denver; 303-315-2085; [email protected] Flaspohler, Paul [761] Miami University; 513-529-2469; [email protected] Fleischer, Dreolin [393] Claremont Graduate University; 617-680-2775; [email protected] Fleming, Lynette [267] Research, Evaluation & Development Services; 520-749-4909; [email protected] Fletcher, Erica [619] Massachusetts Alliance on Teen Pregnancy; 617-482-9122; [email protected] Flick, Arend [255] Norco College; 951-372-7028; [email protected] Florin, Paul [699] University of Rhode Island; 401-874-1000; [email protected] Fluellen, Anthony [137] Lincoln University; 610-717-8443; [email protected] Flynn, Cynthia [878] University of South Carolina; 803-777-1378; [email protected] Flynn, Shannon [564] South Carolina Campaign to Prevent Teen Pregnancy; 803-771-7700; [email protected] Folkman, Daniel [790] University of Wisconsin, Milwakee; 414-227-3285; [email protected] Fonseca, Claudia [137] Independent Consultant; 55-21-87602910; [email protected] Forneris, Susan [137] St Catherine University; 651-690-6674; [email protected] Foster, Gwen [379] California Social Work Education Center; 510-642-9272; [email protected] Foster-Fishman, Pennie [630-710] Michigan State University; 517-353-5015; [email protected] Fountain, Douglas [302] Outpourings; [email protected] Fowler, Ted [117] University of Cincinnati; 513-403-7443; [email protected] Fox, Christine [786] University of Toledo; 419-534-2578; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 183 Fox, Lindsay [829] Abt Associates Inc; 617-520-2516; [email protected] Francis, David [526] University of Houston; 713-743-8533; [email protected] Francis, Judith [296-380] Pima Prevention Partnership; 520-791-2771 x1425; [email protected] Franck, Karen [394] University of Tennessee, Knoxville; 865-974-7457; [email protected] Frank, Christine [337] Christine Frank & Associates; 705-835-3921; [email protected] Frank, Jennifer [288] University System of Maryland; 301-445-2795; [email protected] Franke, Todd [220-259-379-419] University of California, Los Angeles; 310-312-9202; [email protected] Franz, Nancy [274-612-873] Virginia Tech; 540-231-1634; [email protected] Fraser, John [267] Institute for Learning Innovation; 410-956-5144; [email protected] Frasier, James [869] University of Wisconsin, Madison; 608-265-4579; [email protected] Fraze, Jami [776] Centers for Disease Control and Prevention; [email protected] Frazier, Rosyland [842] University of Alaska, Anchorage; 907-786-5432; [email protected] Frazier-Anderson, Pamela [111-137-291-411-591] Lincoln University; 203-845-9111; [email protected] Fredericks, Kimberly [595-775] The Sage Colleges; 518-292-1782; [email protected] Freeman, Ade [570] World Bank; 202-473-9520; [email protected] Freeman, Melissa [768] University of Georgia; 706-542-3613; [email protected] French, Brian [137] Washington State University; 509-335-8584; [email protected] Friedman, Elisa [541-619-699] Institute for Community Health; 617-499-6678; [email protected] Friedman, Stacey [256-410] Foundation for Advancement of International Medical Education & Research; 215-823-2191; [email protected] Frierson, Henry [111] University of Florida; 352-846-0113; [email protected] Frood, David [854] Independent Consultant; +61412 296 463; [email protected] Fuentes, Stephanie [573] Inventivo Design LLC; 720-413-0600; [email protected] Fuhrman, Nick [612] University of Georgia; 706-542-8828; [email protected] Fukunaga, Landry [812] University of Hawaii; 808-956-9202; [email protected] Fulmer, Erika [378] Centers for Disease Control and Prevention; 770-488-5334; [email protected] Furlong, Michael [646] University of California, Santa Barbara; 805-453-4955; [email protected] GGGGGGGG Gaarder, Marie [614-789] International Initiative for Impact Evaluation (3ie); +91-11-26139494; [email protected] Gabriel, Roy [682] RMC Research Corporation; 503-223-8248; [email protected] Gaddy, Peggy [709] Missouri Asthma Prevention and Control Program; 573-522-2876; [email protected] Gadsden, Paola [614] Instituto Nacional de Salud Publica; [email protected] Gaiser, Melanie [676] Brandeis University; 603-682-2040; [email protected] Galen, Matthew [261-393] Claremont Graduate University; 646-354-8722; [email protected] Gallion, Kipling [864] University of Texas Health Science Center at San Antonio; 210-562-6500; [email protected] Gannon, Nora [358-390] University of Illinois at Urbana-Champaign; [email protected] Gao, Zhongcui [137] Nemours Health and Prevention Services; 302-444-9100; [email protected] Garbarini, Brian [843] Arizona State University; 602-496-1151; [email protected] Garbe, Paul [243-709] Centers for Disease Control and Prevention; 770-488-3727; [email protected] Garbrecht, Lisa [126-802] EVALCORP; 949-468-9849; [email protected] Garcia, Anna [695] Independent Consultant; 559-448-7792; [email protected] Garcia, Francisco [744] University of Arizona; 520-626-8539; [email protected] García-Iriarte, Edurne [521] Trinity College Dublin; 353-1-896-2200; [email protected] Gardiner, Karen [331] The Lewin Group; 703-269-5528; [email protected] Gardner, Annette [413-592-797] University of California, San Francisco; 415-514-1543; [email protected] Gareau, Sarah [386-606] South Carolina Educational Policy Center; 803-777-0424; [email protected] Gargani, John [623-742] Gargani + Company; 510-291-4226; [email protected] Garrard, Wendy [119-380] University of Michigan; 734-709-9512; [email protected] Garrett, Brent [844] Pacific Institute for Research and Evaluation (PIRE); 502-238-7329; [email protected] Gasper, Charles [325-365-684-723-742] Missouri Foundation for Health; 314-345-5581; [email protected] Gatti, Guido [804] Gatti Evaluation Inc; 412-371-9832; [email protected] Gaver, Amy [397] American Red Cross; 202-303-4548; [email protected] Geier, Susan [137] Purdue University; 765-532-9325; [email protected] Geierstanger, Sara [592-797] University of California, San Francisco; [email protected] Gemmer, Stephanie [219] Wright State University; 513-502-6215; [email protected] Geoghegan, Cristin [137] University of Illinois at Urbana-Champaign; 908-358-5658; [email protected] Georgis, Rebecca [261] University of Alberta; 780-492-1144; [email protected] Geraghty, Estella [116] University of California, Davis; 916-734-5265; [email protected] Gerardi, Nicole [123-296] University of California, Los Angeles; 310-767-6637; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 184 Gerde, Hope [630] Michigan State University; 517-355-0365; [email protected] Germuth, Amy [308-870] EvalWorks LLC; 919-401-5403; [email protected] Gervin, Derrick [209] The Evaluation Group; 678-681-6206; [email protected] Getahun, Monica [737] OMG Center for Collaborative Learning; 267-408-9816; [email protected] Gheen, Margaret [225] Montgomery County Public Schools; 202-276-0268; [email protected] Ghosh, Rajashi [613] Drexel University; 215-571-3664; [email protected] Gigliotti, Ruth Anne [369] Synthesis Professional Services Inc.; 301-698-2754; [email protected] Gilbert, Brandi [137-437-622] University of Colorado, Boulder; 410-615-7327; [email protected] Gilbert, Cindy [243] United States Government Accountability Office; 202-512-3000; [email protected] Giles, Rebecca [279] Utah Department of Health Asthma Program; 801-538-6259; [email protected] Gill, Boojong [810-886] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); +82-2-589-2214; [email protected] Gill, Brian [884] Mathematica Policy Research; 617-301-8962; [email protected] Gill, Sarah [279-709] Cazador; 770-488-0782; [email protected] Gilling, Maxine [369] Western Michigan University; 269-387-6861; [email protected] Gilman, Elizabeth [379] California Social Work Education Center; 510-642-9272; [email protected] Gilmore, Joanna [114-538-685] University of South Carolina; 803-777-9918; [email protected] Giuli, Charles [108] Pacific Resources for Education and Learning (PREL); 808-441-1349; [email protected] Glantz, Frederic [370-839-870] Kokopelli Associates LLC; 505-983-0785; [email protected] Glass, Don [598] VSA; 202-628-2800; [email protected] Glassman, Marlene [819] Centers for Disease Control and Prevention; 404-639-1998; [email protected] Glazerman, Steven [226-265-845] Mathematica Policy Research; 202-484-9220; [email protected] Gleason, Philip [838-884] Mathematica Policy Research; [email protected] Glebova, Natalia [697] University of Massachusetts, Amherst; 413-230-3492; [email protected] Glover-Kudon, Rebecca [398] University of Georgia; 706-542-4900; [email protected] Gmeiner, Kathleen [112] Universal Health Care Action Network of Ohio; 614-456-0060; [email protected] Gnadinger, Tracy [216] Cincinnati Children's Hospital Medical Center; 513-803-0798; [email protected] Gnedko, Natalya [576] Chicago Public Schools; 847-507-3588; [email protected] Goldberg, Debora [400] Virginia Commonwealth University; 703-356-8008; [email protected] Goldenkranz, Sarah [137] Center for Health Training; 206-447-9538; [email protected] Goldstein, Adam [320] University of North Carolina; 919-966-4090; [email protected] Gonzalez, Malu [665] University of Texas, El Paso; 915-747-8083; [email protected] Gonzalez, Maria Luisa [266] University of Texas, El Paso; 915-747-8045; [email protected] Gonzalez, Patricia [869] United States Department of Education; 202-245-7355; [email protected] Gonzalez Cambero, Alfredo [392] Food and Agriculture Organization of the United Nations; 434-384-7251; [email protected] Gonzalez-Ramos, Gladys [137] New York University; 212-260-8435; [email protected] Goodman, Charity [662] United States Department of Health and Human Services; 240-276-1959; [email protected] Goodman, Kenneth [118] ICF Macro; 404-592-2203; [email protected] Goodman, Robert [820] Indiana University; 812-855-1561; [email protected] Goodyear, Leslie [125-314-429-632-768] National Science Foundation; 703-292-5115; [email protected] Goolsby, Rhonda [226] Texas A&M University; 979-845-8363; [email protected] Gopal, Gita [316] World Bank; 202-473-6835; [email protected] Gopalakrishnan, Srik [863] New Teacher Center; 630-738-3030; [email protected] Gorham, Bertha [827] Gorham Consulting; 919-870-5808; [email protected] Gossman, Ginger [566] Austin Independent School District; 512-736-2957; [email protected] Gothberg, June [310-329-495] Western Michigan University; 269-387-2821; [email protected] Gowen, Sheryl [346] Georgie State University; 404-413-8030; [email protected] Gragg, Martha [723] Missouri Foundation for Health; 314-345-5530; [email protected] Graham, Kathryn [304] Alberta Innovates-Health Solutions; 780-423-5727; [email protected] Graham, Michele [880] KPMG LLP; 303-621-6835; [email protected] Graham, Phillip [137] RTI International; 919-485-7752; [email protected] Graig, Eric [650-828] Usable Knowledge LLC; 212-931-8540; [email protected] Grane, Douglas [622-732] University of Iowa; 319-325-8420; [email protected] Grant, Billie-Jo [137] University of Virginia; 805-550-9132; [email protected] Grasso, Patrick [287-352-542-615] World Bank; 202-258-2913; [email protected] Graves, Kelly [137-656] University of North Carolina at Greensboro; 336-217-9713; [email protected] Gravina, Virginia [278] University of the Republic; 598-2-3581603; [email protected] Gray, Cheryl [316-539-570] World Bank; 202-473-9188; [email protected] Greaney, Debra [203] Area V Learning Technology Center; 618-692-6200 x5011; [email protected] Greece, Jacey [227] Abt Associates Inc; 617-520-2809; [email protected] Green, Chad [386-496] Loudoun County Public Schools; 571-252-1486; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 185 Green, Diane C [312] Centers for Disease Control and Prevention; 770-488-6562; [email protected] Green, Sheridan [137] University of Denver; 303-871-3895; [email protected] Greenberg Motamedi, Jason [725] Education Northwest; 5032759500; [email protected] Greene, Consuela [619] Massachusetts Alliance on Teen Pregnancy; 617-482-9122; [email protected] Greene, Jennifer [287-390-400-502-542-591-782-902] University of Illinois at Urbana-Champaign; 217-333-8736; [email protected] Greene, Joelle [837] National Community Renaissance; 909-483-2444 x115; [email protected] Greene, Kari [349-420-559-639] Oregon Public Health Division; 971-673-0599; [email protected] Greene, Rose [116] Center for Human Services Research; 518-442-5774; [email protected] Greene, Ruth [137] Johnson C Smith University; 704-333-5068; [email protected] Greene-Dorsett, Tracey [251] National Rural Funders Collaborative; 803-447-2000; [email protected] Greenfield, Lawrence [302] Lawrence Greenfield Consulting; 240-687-2052; [email protected] Gregory, Katie [245] Michigan State University; 517-353-4568; [email protected] Greytak, Emily [517] Gay, Lesbian & Straight Education Network; 646-388- 8054; [email protected] Grider, Mary [226] Mathematica Policy Research; 202-484-4820; [email protected] Griffin, Paul [137] Pennsylvania State University; 814-865-7601; [email protected] Griffin, Sarah [820] University of South Carolina; 864-642-5620; [email protected] Griffith, James [229-361-579-780] Claremont Graduate University; 909-851-8491; [email protected] Grimes, Tanisha [360] Centers for Disease Control and Prevention; 404-639-8291; [email protected] Grimm, Curt [303] University of New Hampshire; 603-862-3788; [email protected] Grob, George [287-529-542-611-651-727] Center for Public Program Evaluation; 540-454-2888; [email protected] Grodzicki, Deborah [261-732] University of California, Los Angeles; 585-943-0433; [email protected] Gruendel, George [723] Missouri Foundation for Health; 573-729-7194; [email protected] Grunden, Leslie [137] Edvance Research; 210-561-8955; [email protected] Guan, Zhongcheng [513] Chinese Academy of Sciences; +861062550660; [email protected] Guijt, Irene [202-520] Learning by Design; 31-488-491880; iguijt@learningbydesign Gujrati, Malika [301] Paraprofessional Healthcare Institute (PHI); 718-402-7766; [email protected] Gullickson, Amy [272-670] Western Michigan University; 269-387-5895; [email protected] Gullickson, Arlen [137-670] Western Michigan University; 269-387-5895; [email protected] Gullie, Kathy [226-386] State University of New York at Albany; 518-442-5027; [email protected] Gunter, Margaret J [137-779] LCF Research; 505-938-9901; [email protected] Gurrola, Jeanette [852] Claremont Graduate University; 626-975-1335; [email protected] Gurzinsky, Ellen [891] Funders for LGBTQ Issues; 347-583-1811; [email protected] Gutmann, Mary [558] EnCompass LLC; 970-513-9685; [email protected] Gwaltney, Margaret [682] Abt Associates Inc; 301-634-1898; [email protected] Gysbers, Norm [761] University of Missouri; 573-882-6386; [email protected] HHHHHHHH Haak, Laurel [231] Discovery Logic; 240-912-1927; [email protected] Hacker, Karen [699] Institute for Community Health; 617-499-6613; [email protected] Haden, Carol [290-385] Magnolia Consulting LLC; 928-600-6641; [email protected] Hage, Jerald [609] University of Maryland; 301-405-6437; [email protected] Hagen, Carol [721] Westat; 301-294-3877; [email protected] Hagestuen, Ruth [137] National Parkinson Foundation; 305-606-9011; [email protected] Hagstrom, Emily [762] Ciurczak & Co Inc; 716-362-0627; [email protected] Hakobyan, Anna [224] Children's Investment Fund Foundation; [email protected] Hall, Bruce [137] University of South Florida; 813-974-3220; [email protected] Hall, Jori [230-390-768-782] University of Georgia; 706-542-1801; [email protected] Hall, Kara [137] National Institutes of Health; 301-594-9056; [email protected] Hall, Melanie [137] St Joseph's Children's Advocacy Center; 813-493-4546; [email protected] Hall, Tracey [249] Center for Applied Special Technology; 781-245-2212 x227; [email protected] Haller, Megan [595] University of Illinois at Chicago; 312-413-2189; [email protected] Hamakawa, Tomohiro [224] Children's Investment Fund Foundation; +919717774383; [email protected] Hamann, Sue [117-739] National Institutes of Health; 301-594-4849; [email protected] Hamilton, Donna [747] Michigan Department of Education; 517-241-4546; [email protected] Hamilton, Dustin [219] Wright State University; 937-830-7891; [email protected] Hamilton, Jennifer [526-615] Westat; 301-738-3628; [email protected] Hamlett, Kristin [137] Nurse Oncology Education Program; 512-467-2803; [email protected] Han Kim, Do [120] New York State Office of Children and Family Services; 518-402-7386 Hancock, Dawson [218] University of North Carolina at Charlotte; 704-687-8863; [email protected] Hanna, Jeanine [801] Advocates of Human Potential; 518-475-9146; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 186 Hanni, Krista [684] Monterey County Health Department; 831-755-4586; [email protected] Hansen, Mark [233-389] University of California, Los Angeles; 857-212-1691; [email protected] Hansen, Morten Balle [243] University of Southern Denmark; +45 6550 2218; [email protected] Hansen, Pat [827] The North Carolina Partnership for Children; 919-821-7999; [email protected] Harding, Wayne [522] Social Science Research and Evaluation; 781-273-4204; [email protected] Hargett, Stella L [411] Morgan State University; 443-885-3411; [email protected] Hargraves, Monica [250-381-534] Cornell University; 607-255-0341; [email protected] Hargreaves, Margaret [210-307-363] Mathematica Policy Research; 617-301-8994; [email protected] Harmon, Michele [721] Westat; 301-294-3814; [email protected] Harnar, Michael [658-779] Claremont Graduate University; 909-524-7800; [email protected] Harper, Gary [325] DePaul University; 773-325-2056; [email protected] Harrington, Maura [734] Center for Nonprofit Management; 213-346-3258; [email protected] Harris, Jenine [675] Saint Louis University; 314-977-8210; [email protected] Harris, Karol K [737] University of Texas, Austin; 512-494-0758; [email protected] Harrison, Shayne [248] University of Tennessee, Knoxville; 865-591-6999; [email protected] Harris-Tally, Kirsten [619] Center for Health Training Resource Group; 206-223-1186; [email protected] Hart, Matthew [260] University of South Florida; 813-766-3107; [email protected] Hart, Raymond [220-246-306] Georgia State University; 404-413-8264; [email protected] Hartje, Joyce [137] University of Nevada, Reno; 775-684-7237; [email protected] Hartry, Ardice [125] University of California, Berkeley; 510-942-6245; [email protected] Hatashima, Hiroyuki [659] International Finance Corporation; 202-473-5387; [email protected] Hatry, Harry [727] Urban Institute; 202-261-5521; [email protected] Hawkins, Stephanie [306] State University of New York College at Potsdam; 315-267-3136; [email protected] Hayden, Elizabeth [599] Northeastern University; 860-230-7428; [email protected] Haynes, Ray [275-613] Indiana University; 812-856-8151; [email protected] Haynie, Kathleen [525-839] Haynie Research and Evaluation; 609-466-2990; [email protected] He, Huihua [137] Shanghai Normal University; 86-21-66309252; [email protected] Heath, Barbara [597] East Main Educational Consulting; 910-784-9523; [email protected] Heath, Debra [234] Albuquerque Public Schools; 505-872-6803; [email protected] Heaton, Tim [693] Brigham Young University; 801-422-3280; [email protected] Hebbard, Claire [250-381] Cornell University; 607-255-3791; [email protected] Heberger, Anne [691] National Academy of Sciences; 949-943-2823; [email protected] Hebert, Scott [665-756] Sustained Impact; 410-223-2932; [email protected] Hecklinger, John [520] GlobalGiving Foundation; 202-232-5784; [email protected] Hector, LaJuana [334] Texas A&M University; 254-549-5747; [email protected] Heffelfinger, John [846] United States Environmental Protection Agency; 202-566-2192; [email protected] Hegamin-Younger, Cecilia [137-357] TUI University; 473-415-4815; [email protected] Hegedus, Andrea [212] Northrop Grumman Corporation; 734-717-1858; [email protected] Heikes, Joel [115-879] University of Texas, Austin; 512-475-8679; [email protected] Heimlich, Joe E [137-258-339-420-628-877] Ohio State University; 614-228-2674 x2425; [email protected] Heinecke, Walter [137] University of Virginia; 434-982-2864; [email protected] Held, Sam [237-272-388] Oak Ridge Institute for Science and Education; 865-576-8223; [email protected] Henderson, Kathryn [615] Westat; 301-610-4849; [email protected] Henderson, Stuart [116-230] University of California, Davis; 916-703-9220; [email protected] Henderson, Susan [547-845] WestEd; 781-481-1118; [email protected] Hendricks, Astrid [264-332-592-895] California Endowment; 213-928-8671; [email protected] Hendricks, Michael [341-507-585] Independent Consultant; 240-994-6087; [email protected] Hennessy, Kevin [228] United States Department of Health and Human Services; 240-276-2234; [email protected] Henning, Philip [792] James Madison University; 540-292-9374; [email protected] Henry, James [519-685] Western Michigan University; 269-387-3175; [email protected] Henry, Stephan [308] REASolutions LLC; 785-273-5619; [email protected] Henry Akintobi, Tabia [137-541] Morehouse School of Medicine; 404-755-1144; [email protected] Heo, Se Jin [355] University of Minnesota; 612-239-5452; [email protected] Herbers, Stephanie [137-616-638-827] Washington University in St Louis; 314-935-3721; [email protected] Herbst, Jeffrey [819] Centers for Disease Control and Prevention; 404-639-5386; [email protected] Herman, Jeanette [115] University of Texas, Austin; 512-471-3948; [email protected] Herman, Keith [761] University of Missouri; 573-884-2419; [email protected] Herman, Patricia [586] University of Arizona; 520-318-7259 x147; [email protected] Hermida, Jose [805] American University; 202-885-6404; [email protected] Hernandez, Arthur [213-734] Texas A&M University; 361-825-2661; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 187 Herrera, Denise [737] Decision Information Resources Inc; 512-791-9115; [email protected] Hersch, Rebekah [721] ISA Associates; 703-739-0880 x11; [email protected] Heschel, Jessica [219] Wright State University; 567-201-6768; [email protected] Hewitt, Anne [684-734] Seton Hall University; 908-782-0827; [email protected] Hewitt, Cheryl [227] Abt Associates Inc; 617-520-2724; [email protected] Hewitt, Sue [376] Health District of Northern Larimer County; 970-224-5209; [email protected] Hewlett, Leigh [830] University of South Carolina; 803-777-7000; [email protected] Hibbard, Susan [137] Florida Gulf Coast University; 941-465-9403; [email protected] Hicks, Dan [222] Ventura County Behavioral Health Department; 805-981-9577; [email protected] Hicks, Mary [677] Boundless Readers; 773-989-8582; [email protected] Hickson, Rachel [507] Montgomery County Public Schools; 301-279-3287; [email protected] Hildenbrand, Susan [788] St John Fisher College; 585-385-7297; [email protected] Hill, Alexandra [842] University of Alaska, Anchorage; 907-786-5436; [email protected] Hill, Dale [397] American Red Cross; 301-263-9316; [email protected] Hill, Kathryn [137-763] Minnesota Office of Higher Education; 763-464-8814; [email protected] Hill, Laura [137] Washington State University; 509-335-8478; [email protected] Hill, Patty [657] EnCompass LLC; 301-518-5120; [email protected] Hilscher, Rainer [283] Altarum Institute; 734-302-4798; [email protected] Hinchcliff, Ginger [687] National Oceanic and Atmospheric Administration; 843-740-1184; [email protected] Hipps, Jerome [888] WestEd; 510-302-4227; [email protected] Hitchcock, John [547-616] Ohio University; 740-597-1323; [email protected] Hites, Lisle [816] University of Alabama at Birmingham; 205-975-8980; [email protected] Ho, Timothy [137-389] University of California, Los Angeles; 626-252-6160; [email protected] Hobson, Jennifer [137] Washington University in St Louis; [email protected] Hobson, Kristin [393] Western Michigan University; [email protected] Hodge, Sheryl [137-220] Kansas State University; 785-532-7171; [email protected] Hoechstetter, Susan [332] Alliance for Justice; 202-822-6070; [email protected] Hoffman, Cheri [504] Centerstone Research Institute; 615-463-6256; [email protected] Hogle, Janice A [133] University of Wisconsin, Madison; 608-262-4313; [email protected] Hoke, Tahira [860] Prince Sultan University; 966-5-962-1764; [email protected] Holden, Debra [717] Research Triangle Institute International; 919-541-6491; [email protected] Holladay, Royce [550-863] Human Systems Dynamics Institute; 612-201-3781; [email protected] Holmes, William [799] University of Massachusetts, Boston; 781-784-9487; [email protected] Homan, Sherri [709] Missouri Asthma Prevention and Control Program; 573-522-2810; [email protected] Honeycutt, Todd [210] Mathematica Policy Research; 609-945-3397; [email protected] Hong, Jungseok [810] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); +52-2-589-2296; [email protected] Hong, Seung Won [248] University of Illinois at Urbana-Champaign; 217-819-8816; [email protected] Hood, Stafford [111-591-823] University of Illinois at Urbana-Champaign; 217-333-6510; [email protected] Hoover, Sonja [885] RTI International; 781-434-1722; [email protected] Hopson, Rodney [111-200-229-322-362-591-662-800] Duquesne University; 412-396-4034; [email protected] Hornack, Sarah [805] American University; 202-885-6404; [email protected] Horne, Christopher [245] University of Tennessee, Chattanooga; 423-425-1709; [email protected] Horne, Richard [131] United States Department of Labor; 202-693-4923; [email protected] Hornik, John [137-801] Advocates for Human Potential; 413-687-5246; [email protected] Horwood, Thomas [376-729] ICF International; 703-225-2276; [email protected] Hostrup, Judy [305] Texas A&M University; 979-845-8363; [email protected] Houle, Sylvain [579] University of Quebec at Montreal; 514-987-3000; [email protected] Houmes, Virginia [390-616] Washington University in St Louis; 314-935-3741; [email protected] House, Ann [137-632] SRI International; 650-859-2426; [email protected] House, Duane [137-619] Centers for Disease Control and Prevention; 770-488-6302; [email protected] House, Ernest [229-822] University of Colorado; 720-938-1826; [email protected] Housne, Begum [137] University of Dhaka; 008802-9014925; [email protected] Howell, Britteny [137-676] Cincinnati Children's Hospital Medical Center; 513-803-0189; [email protected] Howell, Tamika [713] Institute for Community Living Inc; 212-385-3030 x3234; [email protected] Howieson, Susannah T [730] Science and Technology Policy Institute; [email protected] Hoyte, Tamika [360] MANILA Consulting Group Inc; 404-639-6929; [email protected] Hsu, Helen [758] University of British Columbia; 604-875-4111 x68786; [email protected] Hu, Haiyang [513] Chinese Academy of Sciences; 861068597457; [email protected] Hubelbank, Jeanne [115-255] Independent Consultant; 978-443-3877; [email protected] Huddleston, Jenica [137-400-698-797] University of California, Berkeley; 925-202-3133; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 188 Huerta, Timothy [387] Texas Tech University; 213-793-1900; [email protected] Huff-Rousselle, Maggie [221] Social Sectors Development Strategies; 617-421-9644; [email protected] Hughes, Bob [249] Seattle University; 206-296-6168; [email protected] Hughes, Denise [698] Nemours Health and Prevention Services; 302-444-9100; [email protected] Hughes, Mary Beth [343] Science and Technology Policy Institute; 202-419-5487; [email protected] Hummelbrunner, Richard [269-663] OEAR Regional Development Consultants; +43 316 31 18 4815; [email protected] Humphries, Paul [261] University of Alberta; 780-492-1144; [email protected] Hung, Hsin-Ling [117-297-377-417] University of North Dakota; 513-556-7004; [email protected] Hunter, Sue [512] New York University; 212-263-4179; [email protected] Hunter, Yvonne [383] University of South Florida; 813-325-3871; [email protected] Hurteau, Marthe [579] University of Quebec at Montreal; 514-987-3000 X4702; [email protected] Hutchinson, Elizabeth [514] Land O'Lakes International Development; 651-494-5189; [email protected] Hutchinson, Kylie [137] Community Solutions Planning & Evaluation; 604-629-6872; [email protected] Hutchinson, Paul [222-320-884] Tulane University; 504-988-6078; [email protected] Hutton, Michael [301] The Blue Foundation for a Healthy Florida; 904-607-2659; [email protected] Hwalek, Melanie [611] SPEC Associates; 313-964-0500; [email protected] Hwang, Jiho [137-810] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); +82-2-589-2290; [email protected] Hyra, Allison [331] The Lewin Group; 703-269-5628; [email protected] Hyun Jeong, Dae [810] Korea Zinc Inc; [email protected] Hyvarinen, Jari [766] Tekes - Finnish Funding Agency for Technology and Innovation; 358-1060-55803; [email protected] IIIIIIII Ibanez-Carrasco, Francisco [137] Provincial Health Services Authority of Bristish Columbia; [email protected] Iglesias, Kevin [317] Seton Hall University; 973-761-9306; [email protected] Imm, Pamela [280-312-604-699] University of South Carolina; 803-808-2316; [email protected] Inada, Nariatsu [890] Nagasaki Prefectural Government; +81 95 895 2521; [email protected] Inazu, Judith [298] University of Hawaii at Manoa; 808-956-4584; [email protected] Infante, Alycia [113] NORC at the University of Chicago; 301-634-9371; [email protected] Inokuchi, Derek [807] Academy for Educational Development; 202-884-8652; [email protected] Intili, JoAnn [695] JBS International Inc; 510-482-9979; [email protected] Irani, Tracy [534] University of Florida; 352-392-0502; [email protected] Irie, Ellen [257] BTW Informing Change; 510-665-6100; [email protected] Iriti, Jennifer [303-392-610-677] University of Pittsburgh; 412-624-7092; [email protected] Isenberg, Eric [226] Mathematica Policy Research; 202-554-7540; [email protected] Ishikawa, Tomonori [386-606] University of South Carolina; 803-561-0769; [email protected] Israel, Glenn D [534] University of Florida; 352-392-0502; [email protected] Iverson, Ellen [214-272-674] Carleton College; 507-222-5749; [email protected] Ivins, Tiffany [752] Brigham Young University; 801-824-0153; [email protected] JJJJJJJJ Jackson, Ceasar [111] National Science Foundation; 703-292-4669; [email protected] Jackson, Melody [137] Wholistic Stress Control Institute Inc; 404-755-0068; [email protected] Jackson, Nicole [712-833] University of California, Berkeley; 415-586-2236; [email protected] Jackson, Summer [817] Independent Consultant; 773-633-6154; [email protected] Jackson-Newsom, Julia [595] University of North Carolina at Greensboro; 336-334-9866; [email protected] Jacob, Claude- Alix [541] Cambridge Public Health Department; 617-665-3810; [email protected] Jacobs, DeBran [137] Morehouse School of Medicine; 404-752-1916; [email protected] Jacobson, Miriam [691] Claremont Graduate University; 339-203-0418; [email protected] Jacquet, Susan [379] California Social Work Education Center; 510-642-9272; [email protected] James, Nakia [109] Western Michigan University; 269-544-0249; [email protected] James, Tom [522] University of Oklahoma; 405-360-7509; [email protected] James-Burdumy, Susanne [126-265] Mathematica Policy Research; 609-275-2248; [email protected] Jang, Kristy [137] University of British Columbia; 778-888-3177; [email protected] Jarosewich, Tania [203-625] Censeo Group; 440-788-2321; [email protected] Jatau, Afabwaje [737] National Cancer Institute; 614-406-5908; [email protected] Javad, Mohammad [657] University of Massachusetts, Amherst; 413-695-6692; [email protected] Jay, Michelle [111-671-737-876] University of South Carolina; 803-777-6519; [email protected] Jayaratne, Koralalage [137] North Carolina State University; 919-515-6079; [email protected] Jenniges, Reese [546-715] University of Wyoming; 307-299-3635; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 189 Jennings, Helene [294-686-811-884] ICF Macro; 301-572-0248; [email protected] Jeremiah, Rohan [137-357] St George's University; 473-439-2000; [email protected] Jernigan, Jan [227-378] Centers for Disease Control and Prevention; 770-488-5224; [email protected] Jessup, Pat [110-743] InSites; 734-761-5412; [email protected] Jewiss, Jennifer [127-314-429-576] University of Vermont; 802-656-2711; [email protected] Jhawar, Mona [592] California Endowment; 800-449-4149 x8674; [email protected] JIinnah-Ghelani, Haminda [137] University of Georgia; 706-254-0477; [email protected] Jim, Jill [817] Independent Consultant; 801-618-6712; [email protected] Jimenez, Maria [137-208-502] University of Illinois at Urbana-Champaign; 217-778-2537; [email protected] Jimenez, Tiffeny [137] Michigan State University; 517-775-3019; [email protected] Jinkerson, Darryl [275-629] Abilene Christian University; 325-674-2493; [email protected] Jinnah-Ghelani, Hamida [137] University of Georgia; 7062540477; [email protected] Jochelson, David [533] Academy for Educational Development; 202-884-8250; [email protected] Johnson, Amy [226] Mathematica Policy Research; 609-976-2714; [email protected] Johnson, Barrett [379] California Social Work Education Center; 510-642-9272; [email protected] Johnson, Beth [519] EMJ Associates; 630-879-7466; [email protected] Johnson, Britta [862] United States Environmental Protection Agency; 202-566-1465; [email protected] Johnson, Chantell [785] TCC Group; 312-266-1711; [email protected] Johnson, Elmima [111-371] National Science Foundation; 703-292-5137; [email protected] Johnson, Erin [619] South Carolina Campaign to Prevent Teen Pregnancy; 803-771-7700; [email protected] Johnson, Jeana [619] Center for Health Training Resource Group; 206-223-1186; [email protected] Johnson, Jeremiah [502] University of Illinois at Urbana-Champaign; 217-714-6774; [email protected] Johnson, Jerry [616] Ohio University; 740-818-6115; [email protected] Johnson, Jessica [671] Virginia Commonwealth University; 804-433-7390; [email protected] Johnson, LaJuana [619] Center for Health Training Resource Group; 206-223-1186; [email protected] Johnson, Leona [331-411] Hampton University; 703-727-5370; [email protected] Johnson, Margaret [283-381-589] Cornell Univeristy; 607-227-8315; [email protected] Johnson, Robert [286] University of South Carolina; 803-777-6585; [email protected] Johnson, Sarah [137] United States Office of Personnel Management; 202-904-3364; [email protected] Johnson, Tarita [137] Wholistic Stress Control Institute Inc; 404-755-0068; [email protected] Johnston, Andrea LK [103-252] Johnston Research Inc; 905-889-4430; [email protected] Johnston, Dennis [137] AVID Center; 858-380-4787; [email protected] Jones, Jenny [209-211-242] Virginia Commonwealth University; 804-828-0732; [email protected] Jordan, Alexandra [137] University of Colorado, Boulder; 323-252-1998; [email protected] Jordan, Gretchen [271-391-527-655-689-730] Sandia National Laboratories; 505-844-9075; [email protected] Jorgensen, Daniel [137] Texas A&M University; 361-825-3269; [email protected] Jose-Ivanina, Agata [884] ICF Macro; 301-572-0927; [email protected] Joseph, Djenaba [776] Centers for Disease Control and Prevention; [email protected] Jourdan, Linda [137] University of Wisconsin, Green Bay; 920-915-8579; [email protected] Jovaag, Amanda [107] University of Wisconsin; 608-265-4172; [email protected] Joy, Roy [137] Southern Illinois University Carbondale; 618-453-5371; [email protected] Juan, Shu-Ping [137] National Taipei University of Technology; +886-3-2118999; [email protected] Julnes, George [102-246-506-826] University of Baltimore; 410-837-6256; [email protected] Jun Yoo, Seung [810] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); +82-2-589-2861; [email protected] Jurist Levy, Abigail [856] Education Development Center; 617-618-2437; [email protected] Jwahar, Mona K [264] California Endowment; 800-449-4149; [email protected] KKKKKKKK Kabel, Christopher [212] Northwest Health Foundation; 971-230-1291; [email protected] Kaczynski, Dan [777] Central Michigan University; 989-317-0621; [email protected] Kaesbauer, Susanne [248-398-593] University of Tennessee, Knoxville; 757-515-7017; [email protected] Kagan, Jonathan [770] National Institutes of Health; 301-453-3733; [email protected] Kahlert, Rahel [369-738] University of Texas, Austin; 512-709-1017; [email protected] Kakooza, James [243] African Women in Agricultural Research and Development; +25420722 44400; [email protected] Kalayil, Elizabeth [360] MANILA Consulting Group Inc; 404-639-8049; [email protected] Kallemeyn, Leanne [213] Loyola University, Chicago; 847-549-1024; [email protected] Kaminsky, Alexis [244] Kaminsky Consulting; 505-270-8019; [email protected] Kamo, Mariko [890] National Institute of Advanced Industrial Science and Technology; +81 29 862 6096; [email protected] Kane, Cathleen [133] Cornell University; 646-962-8320; [email protected] Kanny, Dafna [809] Centers for Disease Control and Prevention; 770-488-5411; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 190 Kaplan, Marina [137] Nemours Health and Prevention Services; 302-444-9052; [email protected] Kaplan, Seth [896] Geroge Mason University; 703-993-8475; [email protected] Karakus, Mustafa [676-885] Westat; 301-294-2874; [email protected] Karanxha, Zorka [874] University of South Florida; 813-974-6040; [email protected] Kari, Nan [756] Touchstone Center for Collaborative Inquiry; 612-331-9342; [email protected] Karim, Nidal [245] Michigan State University; 517-614-0349; [email protected] Karlawish, Jason [691] University of Pennsylvania; 215-898-8997; [email protected] Karlsson Vestman, Ove [268] Malardalen University; +4616153456; [email protected] Kasprzak, Ashley [681] JVA Consulting LLC; 720-407-8378; [email protected] Kasprzyk, Danuta [137-779] Battelle Memorial Institute; 206-528-3106; [email protected] Kass, Lauren [310] James Bell Associates; 703-247-2635; [email protected] Kassouf Mackey, Colleen [803] Points of Light Institute; 440-476-8013; [email protected] Katz, Jason [280-699-820] University of South Carolina; 610-952-8943; [email protected] Kawakami, Alice [764] University of Hawaii, Manoa; 808-956-4245; [email protected] Kaye, Lara [116] Center for Human Services Research; 518-591-8615; [email protected] Kaylor Richardson, Kristin [369-433-589] Western Michigan University; 248-770-3430; [email protected] Kazi, Mansoor [122-209] State University of New York at Buffalo; 716-645-1257; [email protected] Keene, Matt [687-862] United States Environmental Protection Agency; 202-566-2240; [email protected] Keener, Dana [118] ICF Macro; 404-592-2206; [email protected] Kegler, Michelle C [541] Emory University; 404-712-9957; [email protected] Kellar-Guenther, Yvonne [599] University of Colorado, Denver; 303-829-0819; [email protected] Kelley, John [757] Villanova University; 610-519-4835; [email protected] Kelley, Loretta [792] Kelley, Petterson and Associates; 415-518-7960; [email protected] Kelley, Robin [137] National Minority AIDS Council; 202-483-6622 x360; [email protected] Kelly, Cheryl [390] Saint Louis University; 314-977-8117; [email protected] Kelly, Daniel [788] St John Fisher College; 585-899-3896; [email protected] Kelly, Desmond [830] Greenville Hospital System; 864-467-3333; [email protected] Kelly, Thomas [124-207-665-895] Annie E Casey Foundation; 410-223-2932; [email protected] Kendall, Lauren [137-596] University of North Carolina at Chapel-Hill; 919-843-7878; [email protected] Kershner, Sarah [564] South Carolina Campaign to Prevent Teen Pregnancy; 803-771-7700; [email protected] Kessler, Cheryl [137-258] Independent Consultant; 530-902-3785; [email protected] Ketema, Teserach [131] United States Department of Labor; 202-693-7908; [email protected] Kettel Khan, Laura [378] Centers for Disease Control and Prevention; 770-488-6018; [email protected] Khan, Fahad [137] Catholic Relief Services; +92-333-913-4910; [email protected] Khattri, Nidhi [617] World Bank; 202-473-5255; [email protected] Kibler, Barbara [541] Margaret Fuller Neighborhood House; 617-547-4680; [email protected] Kiella, Michael [750] Western Michigan University; 269-673-6963; [email protected] Kiflie, Woldemichael [814] Jimma University; [email protected] Kiflie, Yibeltal [814] Jimma University; [email protected] Kim, Anthony [643-837] University of California, Berkeley; 847-942-3704; [email protected] Kim, Eunyoung [317] Seton Hall University; 973-275-2156; [email protected] Kim, Jae-Young [810] Ministry of Strategy and Finance; +82 2 2150 5375; [email protected] Kim, Jung [112-245] Mathematica Policy Research; 609-936-3253; [email protected] Kim, Kellie [137] Quill Research Associates; kkim@qrc-llc-net Kim, Meelee [541] Brandeis University; 781-736-3978; [email protected] Kim, Mimi [669] Korean Community Center of East Bay; 510-593-5522; [email protected] Kim, Rae-Young [810] Ministry of Strategy and Finance; +82 2 2150 5375; [email protected] Kim, Yun Jong [810] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); +82-2-589-2802; [email protected] Kimball, Kristi [217-257] William and Flora Hewlett Foundation; 650-234-4500; [email protected] Kimmich, Madeleine [259-299] Human Services Research Institute; 503-924-3783 x12; [email protected] King, Jean A [137-247-337-377-693] University of Minnesota; 612-626-1614; [email protected] King, Katherine [355] University of Michigan; 734-764-3946; [email protected] King, Nicki [128-587] University of California, Davis; 530-752-3863; [email protected] King, Syd [307-800] New Zealand Qualifications Authority; +64-21-979-765; [email protected] Kingi, Wikuki [791] Pou Kapua Consulting; 6421-208-2140; [email protected] Kingsley, Gordon [391] Georgia Institute of Technology; 404-894-0454; [email protected] Kirk, Chris [137] Wichita State University; 316-978-3170; [email protected] Kirk, Colin [132] African Development Bank; +0021671102041; [email protected] Kirk, Roger [246] Baylor University; 254-710-2253; [email protected] Kirkendall, Randahl [214-272] Carleton College; 507-222-4368; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 191 Kirkhart, Karen E [242-591] Syracuse University; 315-443-5574; [email protected] Kirkley, Jane [385] Northern Arizona University; 928-523-7136; [email protected] Kirkpatrick, Mark [872] Western Michigan University; 269-657-6763; [email protected] Kisira, Simon [574] Evaluation Resource Group; +256 772 353 771; [email protected] Kissam, Edward [695] JBS International Inc; 650-533-0319; [email protected] Klayman, Doug [131] Social Dynamics LLC; 301-990-1105x110; [email protected] Klein, Sheri [517] AdCouncil; 212-984-1995; [email protected] Klink, Jenna [592-797] Louisiana Public Health Institute; 504-301-9829; [email protected] Kloosterman, Valerntina I [557] University of Miami; 305-284-3260; [email protected] Knapp-Philo, Joanne [225] National Head Start Family Literacy Center; 805-388-5634; [email protected] Knauth, Shaunti [137] National Louis University; 847-947-5187; [email protected] Knox, Andrea [654] Counterbalance Research and Evaluation; +64 21 1107996; [email protected] Knudsen, Jeffrey [682] RMC Research Corporation; 503-223-8248; [email protected] Knuth, Randy [698] Knuth Research Inc; 509-951-8278; [email protected] Koball, Heather [210-307] Mathematica Policy Research; 609-716-4542; [email protected] Kobayashi, Michelle [767] National Research Center Inc; 303-444-7863 x106; [email protected] Kobayashi, Naoto [890] Waseda University; +81-3-5286-1973; [email protected] Kohler, Paula [310] Western Michigan University; 269-387-8283; [email protected] Kohler Chrestman, Sarah [222-320-382-884] Louisiana Public Health Institute; 504-301-9800; [email protected] Kohn, Sheila [315] University of Rochester; 585-455-5228; [email protected] Koppel, Ross [695] University of Pennsylvania; 215-576-8221; [email protected] Korsmo, Fay [371] National Science Foundation; 703-292-8002; [email protected] Kortecamp, Karen [740] George Washington University; 202-994-1713; [email protected] Kosciw, Joseph [517] Gay, Lesbian & Straight Education Network; 646-388-8050; [email protected] Kotrcova, Jana [137] University of Saskatchewan; 306-880-7669; [email protected] Kouame, Julien [137-835] Western Michigan University; 404-441-0500; [email protected] Krafve, Michael [647] United States Government Accountability Office; 206-654-2822; [email protected] Kramer, Kathryn [320] University of North Carolina; 919-843-9751; [email protected] Kratt, Diane [137] Florida Gulf Coast University; 239-590-7780; [email protected] Kreger, Mary [592] University of California, San Francisco; 415-502-4544; [email protected] Kreiner, Peter [541-699] Brandeis University; 781-736-3945; [email protected] Krenn, Huilan [707] W K Kellogg Foundation; 269-969-2240; [email protected] Krivelyova, Anna [776] ICF Macro International; [email protected] Kroma, Margaret [243] African Women in Agricultural Research and Development; +25420722 44400; [email protected] Kubas-Meyer, Tanja [207] Independent Consultant; 401-263-1126; [email protected] Kubilius, Kaitlin [672] Miami University; 513-217-4308; [email protected] Kubo Della-Piana, Connie [371] National Science Foundation; 703-292-5309; [email protected] Kuji-Shikatani, Keiko [337-851] Ontario Ministry of Education; 416-327-9842; [email protected] Kulick, Rachel [253] City University of New York (CUNY); 617-501-3467; [email protected] Kullberg, Christian [268] Orebro University; +46735043081; [email protected] Kumar, Anjali [316] World Bank; 202-458-0004; [email protected] Kumar, Krishna [858] United States Department of State; 202-647-2822; [email protected] Kundrat, Cara [331] The Lewin Group; 703-269-5640; [email protected] Kung, Susanna [533] Academy for Educational Development; 212-367-4606; [email protected] Kurth, Ashley [802] City Year Inc; 857-753-9172; [email protected] Kushmerick, Ann [649] Thomson Reuters; 215-823-5351; [email protected] Kushner, Saville [624] University of the West of England; +44 1173284250; [email protected] Kuzmin, Alexey [276-815] Process Consulting Company; +7 903 729 8189; [email protected] Kwon, Deborah [137-672] The Ohio State University; 614-975-8325; [email protected] Kwon, Simona [744] New York University; 212-263-3026; [email protected] LLLLLLLL La France, Stephen [266] LFA Group; 415-392-2850; [email protected] Laanan, Frankie [525] Iowa State University; 515-294-7292; [email protected] Labin, Susan [230-312-521] Independent Consultant; 301-564-0764; [email protected] Lacey, Candace [256-512] Nova Southeastern University; 954-262-8575; [email protected] LaChausse, Robert [400-678] California State University, San Bernardino; 909-537-7229; [email protected] Ladd, Susan [378] Centers for Disease Control and Prevention; 770-488-5448; [email protected] Ladhmi Narayana, Undurthy [137] Regional Institute of Education; +91 755 2522044; [email protected] LaFrance, Joan [372-574-591] Mekinak Consulting; 206-706-6829; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 192 LaFrance, Steven [665-891] Learning for Action Group; 415-392-2858; [email protected] Lahey, Robert [617] REL Solutions Inc; 613-728-4272; [email protected] Lahti, Michel [798] University of Southern Maine; 207-232-2181; [email protected] Lai, Chung [694-735] International Relief & Development; 730-248-0161; [email protected] Lai, Emily [133] University of Iowa; 319-335-5904; [email protected] Lai, Morris [707-764] University of Hawaii, Manoa; 808-956-7900; [email protected] Lake, Jeremy [722] University of South Florida; 813-494-7619; [email protected] Lakshmi Narayana, Undurthy [137] Regional Institute of Education; +91 755 2522044; [email protected] Lal, Bhavya [343] Science and Technology Policy Institute; 202-419-3724; [email protected] Lalich, Nina [306] Case Western Reserve University; 216-368-3029; [email protected] Lam, Tony [137] University of Toronto; 416-978-0140; [email protected] Lamb, Lindsay [386] Austin Independent School District; 512-414-9567; [email protected] Lamb, Yvette [533] Academy for Educational Development; 202-464-3825; [email protected] Lambur, Michael [873] Virginia Tech; 540-231-8177; [email protected] Lamm, Alexa J [534] University of Florida; 352-392-0502 x238; [email protected] Lancey, Patrice [714] University of Central Florida; 407-882-0279; [email protected] Landau, Melinda [320] San Jose Unified School District; 408-535-6377; [email protected] Landers, Glenn [841] Georgia State University; 404-413-0294; [email protected] Landy, Ann [522-602] Westat; 301-251-2277; [email protected] Lanehart, Rheta [137] University of South Florida; 813-974-2138; [email protected] Langer, Michael [556] State of Washington; 360-725-3740; [email protected] Langs, Jodie [703] West Coast Children's Clinic; 510-452-7400; [email protected] Laorenza, Elise [882] Brown University; 401-274-9548; [email protected] Lapitan, Aileen [595] University of North Carolina at Charlotte; 806-559-9900; [email protected] Lapp, Sue [320] School Health Clinics of Santa Clara County; 408-284-2282; [email protected] Larimer, Dustin [518] Savannah College of Art and Design; 210-464-1971; [email protected] Larwin, Karen [246-326-838] Youngstown State University; 330-509-5266; [email protected] Lasane, Terell [601-846-862] United States Environmental Protection Agency; 202-566-0705; [email protected] Laster, Nastassia [137] Morehouse School of Medicine; 404-752-8671; [email protected] Lauer, Patricia [121] Rocky Mountain Center for Health Promotion and Education; 303-867-9105; [email protected] Laurie, Carpenter [592] University of Michigan; 734-615-7825; [email protected] LaVelle, John [233-704-852] Claremont Graduate University; 952-807-3777; [email protected] LaVelle, Katherine [226] Five Acres; 909-753-7775; [email protected] Laven, Daniel [127] National Park Service; 802-457-3368; [email protected] Lavinghouze, Rene [367-627-867] Centers for Disease Control and Prevention; 770-488-5905; [email protected] Lawhorn, Nikki [592-797] Louisiana Public Health Institute; 251-928-8534; [email protected] Lawrence, Rachael [753] University of Massachusetts, Amherst; 315-866-2378; [email protected] Lawrenz, Frances [137] University of Minnesota; 612-625-2046; [email protected] Lawson, Karen [881] Virginia Department of Medical Assistance Services; [email protected] Lawton, Kerry [843] Arizona State University; 602-496-1334; [email protected] Lazar, Marsha [541] Cambridge Public Health Department; 617-665-3655; [email protected] Le Menestrel, Suzanne [128-692] United States Department of Agriculture; 202-720-2297; [email protected] Leacock, Nicole [390-616] Washington University in St Louis; 314-935-3649; [email protected] Leaf, Samantha [721] ISA Associates; 703-739-0880 x16; [email protected] Leahy, Peter [707] University of Akron; 330-972-6871; [email protected] Leake, Robin [137] University of Denver; 303-871-6813; [email protected] Leal, Aline [137] National School of Public Health (ENSP/Fiocruz); 5521-32091416; [email protected] Leaver, Stephen [519] Imagination Theater; [email protected] Lederhendler, Israel [271-567] National Institutes of Health; 301-451-7431; [email protected] Lee, Andrea [137-321] YMCA of the USA; 312-419-8892; [email protected] Lee, Chris [379] California Social Work Education Center; 510-642-9272; [email protected] Lee, Heekweon [810] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); +82 2 589 2918; [email protected] Lee, Ho-Dong [810] Ministry of Finance and Strategy; +82 2 2150 5370; [email protected] Lee, Hwan [810] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); +82 2 589 2930; [email protected] Lee, Janet [123-296] University of California, Los Angeles; 310-625-4883; [email protected] Lee, Joseph [320] University of North Carolina at Chapel-Hill; 919-966-8948; [email protected] Lee, Lark [137-607] PA Consulting Group; 830-964-3409; [email protected] Lee, Linda E [238-582] Proactive Information Services Inc; 204-955-4489; [email protected] Lee, Ling-Chu [886] National Applied Research Laboratories; +886 2 2737 7072; [email protected] Lee, Lung-Sheng Steven [857] National United University; +886 37 381000; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 193 Lee, Sabra [385-674] Lesley University; 617-349-8450; [email protected] Lee, Steven [685] University of Kansas; 785-864-9701; [email protected] Lee, Yi-Fang [297-375-857] National Chi Nan University; +886 49 2910960 x2611; [email protected] Lee, Yoon Been [137] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); 82-2-589-2290; [email protected] Lee, Yuan-Hsuan [226-305] Texas A&M University; 979-862-7166; [email protected] Lee Smith, Judith [137-779] Centers for Disease Control and Prevention; 770-488-4864; [email protected] Lefor, Patricia J [879] Empire State College; 518-587-2100; [email protected] Lehman, Suzanne [137] St Catherine University; 651-690-6811; [email protected] Leight, Christine [259] ICF International; 703-225-2208; [email protected] Lejeune, Andrew [356] University of Alberta; 780-991-3876; [email protected] Lekies, Kristi [820] The Ohio State University; 614-688-3537; [email protected] Lemieux, Véronique [579] University of Quebec at Montreal; [email protected] Lemire, Sebastian [121] Rambøll Management Consulting; +45 2948 8188; [email protected] Lemke, Melissa [678] University of Wisconsin; 414-219-5113; [email protected] Lemma, Wuleta [814] Tulane University; [email protected] Lenoch, Susan [792] University of Iowa; 319-335-8907; [email protected] Lesesne, Catherine [137-312-619] Centers for Disease Control and Prevention; 770-488-6564; [email protected] Lessard, Laura [118] Emory University; 404-727-8093; [email protected] Letichevsky, Ana Carolina [137-512] Cesgranrio Foundation; +55 21 25547642; [email protected] Levine, Carlisle [552] CARE; 202-595-2824; [email protected] Levine, Cathy [112] The Universal Health Care Action Network of Ohio; 614-456-0060; [email protected] Levine, Elyse [807] Academy for Educational Development; 202-884-8913; [email protected] Leviton, Laura [100-118-309-400-669-864] Robert Wood Johnson Foundation; 609-627-5952; [email protected] Levy, Abigail [277] Education Development Center; 617-618-2437; [email protected] Levy, Deborah [870] SuccessLinks LLC; 202-256-4489; [email protected] Lewis, Ashlee [218-804] University of South Carolina; 843-283-7605; [email protected] Lewis, Deborah K [137] Ohio State University; 614-292-5089; [email protected] Lewis, Holly [301] Arizona State University; 602-496-1085; [email protected] Lewis, Johnnye [730] University of New Mexico; 505-991-3489; [email protected] Lewis, Kelly [312] Georgia State University; 404-413-6210; [email protected] Lewis, Nicole [657] University of Kentucky; 859-257-2628; [email protected] Lewis, Tavia [137] City Year Inc; 617-927-2376; [email protected] Lewis-Moss, Rhonda [137] Wichita State University; 316-978-3695; [email protected] Lezin, Nicole [118] Cole Communications Inc; 831-479-1786; [email protected] Li, Huaye [137] University of South Florida; 813-317-5496; [email protected] Li, Shan Shan [886] National Applied Research Laboratories; 886-2-2737-7007; [email protected] Li, Xiaoxuan [886] Chinese Academy of Sciences; 13911053629; [email protected] Lieber, Michael D [662] University of Illinois at Chicago; 773-463-2527; [email protected] Lifshitz, Chen [137] Branco Weiss Institute; 972-50-3109162; [email protected] Light, Elana [595] ICF Macro; 646-695-8150; [email protected] Lightfritz, Cassie [900] Center for Educational Technologies; 304-243-4417; [email protected] Lin, Cindy [254] HighScope Educational Research Foundation; 734-485-2000 x241; [email protected] Lindgren-Streicher, Anna [548] Museum of Science, Boston; 617-589-4231; [email protected] Lindquist, Christine [672] RTI International; 919-485-5706; [email protected] Ling, Deborah [876] University of California, Los Angeles; 310-880-1777; [email protected] Linick, Matthew [137-248] University of Illinois at Urbana-Champaign; 815-791-1982; [email protected] Lininger, Monica [265] Western Michigan University; 269-387-2703; [email protected] Lippin, Tobi [240] New Perspectives Consulting Group; 919-286-5995; [email protected] Lipson, Mindy [338] Mathematica Policy Research; 617-674-8360; [email protected] Litvack, Jennie [539] World Bank; 202-458-7245; [email protected] Liu, Che-Hao [137] National Normal University; 886-2-7734-1120; [email protected] Llorente, Carlin [137] SRI International; 650-859-2381; [email protected] Loadman, William [137-526-600-672] The Ohio State University; 614-292-8055; [email protected] Lobosco, Anna [313-598] New York Sates Developmental Disabilities Planning Council; 518-486-7505; [email protected] Lockman, Jennifer [597] Centerstone Research Institute; 615-460-4142; [email protected] Lodge, John [219] Wright State University; 734-904-1349; [email protected] Lohmeier, Jill [685] University of Massachusetts, Lowell; 978-934-4617; [email protected] Londhe, Rucha [296] Goodman Research Group Inc; 617-491-7033; [email protected] Longworth-Reed, Laricia [137-208] University of Denver; 303-871-4099; [email protected] Looby, Karen [509] Austin Independent School District; 512-414-0027; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 194 Loomis, Ross J [527] RTI International; 919-541-6930; [email protected] Lopez, Alexis [278] University of Los Andes, Colombia; +57 1 248 5725; [email protected] Lopez, Kimberly Kay [603] Independent Consultant; 713-320-7917; [email protected] Lorek, Edward [137] Eastern Virginia Medical School; 757-668-6434; [email protected] Lorton Jr, Paul [256-296-598] University of San Francisco; 415-422-6185; [email protected] Lovato, Chris [758] University of British Columbia; 604-875-4111 x66002; [email protected] Lubke, Margaret [116-416] Utah State University; 435-797-4546; [email protected] Lucas-McLean, Juanita [884] Westat; 301-294-2866; [email protected] Lucio, Robert [718] University of South Florida; 813-974-3099; [email protected] Ludwig, Rachel [122] Chautauqua Tapestry; 716-753-4513; [email protected] Lugo-Gil, Julieta [226-265] Mathematica Policy Research; 609-945-3356; [email protected] Lujan, Anita [319] Consorcio por la Salud, Ambiente y Desarrollo (ECOSAD); [email protected] Luke, Douglas [137-675-827] Washington University in St Louis; 314-935-3704; [email protected] Lundh, Patrik [137] SRI International; 650-859-3603; [email protected] Luskin, Rebecca JC [389] University of California, Los Angeles; 310-872-4638; [email protected] Luster, Jane Nell [713] Louisiana State University; 225-267-4024; [email protected] Lutz, Bob [698] Gonzaga University; [email protected] Lutz, Gene [373] University of Nothern Iowa; 319-273-2105; [email protected] Lynch, Linda [758-834] United States Army; 816-520-3873; [email protected] MMMMMMMM Maak, Laurie [888] WestEd; 510-520-4658; [email protected] Maas, Carl [830] University of South Carolina; 803-777-7000; [email protected] Mabe, Bill [848] Rutgers University; 732-932-4100 x6213; [email protected] Mabry, Linda [393] Washington State University, Vancouver; 360-546-9428; [email protected] Machado, Verônica [137] Independent Consultant; +55 2130799740; [email protected] Macken, Candace [729] Texas Education Agency; 512-463-7814; [email protected] Madison, Anna [535] University of Massachusetts, Boston; [email protected] Mage, Caroline [320] University of North Carolina; 919-966-3014; [email protected] Magharious, Gina [385] David Heil & Associates Inc; 503-245-2102; [email protected] Magnotta, Micheline [532] 3D Group; 510-463-0333 x204; [email protected] Magura, Stephen [120-137-283-342-801] Western Michigan University; 269-387-5895; [email protected] Mahajan, Namrata [298-606] Cobblestone Applied Research & Evaluation Inc; 562-412-0658; [email protected] Mahon, Shelly [330] University of Wisconsin, Madison; 608-770-1342; [email protected] Mahowski, Janet [218] University of South Florida; 727-244-3806; [email protected] Malhotra, Sheetal [678] Medical Institute for Sexual Health; 512-328-6268 x206; [email protected] Malloy, Courtney [510] Vital Research LLC; 323-951-1670; [email protected] Malter, Frederic [206-586] University of Arizona; 520-318-7259 x114; [email protected] Manai, Mohamed [132] African Development Bank; +0021671102416; [email protected] Mandolia, Michelle [862] United States Environmental Protection Agency; 202-566-2198; [email protected] Mann, Nathan [717] RTI International; [email protected] Manning, Colleen [296-588] Goodman Research Group Inc; 617-491-7033; [email protected] Mannix, Danyelle [320-627] United States Department of Health and Human Services; 240-276-1879; [email protected] Mansori, Sophia [632-765] Education Development Center; 617-618-2113; [email protected] Maples, Connie [122] ICF Macro; 404-321-3211 x2115; [email protected] Maras, Melissa [761] University of Missouri; 573-884-9733; [email protected] March, Melisa [716] Innovation Network; 202-728-0727 x102; [email protected] Marchand, Marie-Pier [579] University of Quebec at Montreal; [email protected] Marczak, Mary [733] University of Minnesota; 612-626-3968; [email protected] Marete, Mary [898] Pennsylvania State University; 301-917-7761; [email protected] Margolin, Jonathan [327] Learning Point Associates; 312-288-7632; [email protected] Maria, Whitsett [509] Moak, Casey & Associates; 512-485-7878; [email protected] Marino, Eduardo [898] Independent Consultant; +551183719989; [email protected] Mark, Melvin [273-433-498-746-782-902] Pennsylvania State University; 814-865-9515; [email protected] Marks, Victoria R [137] American Institutes for Research; 202-403-5170; [email protected] Marr, Angela [807] Centers for Disease Control and Prevention; 770-488-1428; [email protected] Marshall, LaTisha [892] Centers for Disease Control and Prevention; [email protected] Martin, Brad [222] Centerstone Research Institute; 615-460-4136; [email protected] Martin, Cassandra [720] Centers for Disease Control and Prevention; 770-488-5786; [email protected] Martin, Ian [732] University of San Diego; 619-260-7612; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 195 Martin, James [504] Mule Town Family Network; 931-446-9601; [email protected] Martinasek, Mary [137] University of South Florida; 813-493-4546; [email protected] Martineau, Jennifer [436] Center for Creative Leadership; 336-286-4419; [email protected] Martinez, Alina [277-739] Abt Associates Inc; 617-349-2312; [email protected] Martinez, Raul [545] Harder+Company; 415-522-5400; [email protected] Martinez Ortiz, Araceli [875] Sustainable Future Inc; 512-569-3622; [email protected] Martínez-Saldaña, Jesus [695] Independent Consultant; 559-307-7941; [email protected] Martz, Dawn [705] Foellinger Foundation Inc; 260-422-2900; [email protected] Masimore, Beth [231] Discovery Logic; 240-912-1975; [email protected] Massey, Oliver [523] University of South Florida; 813-974-6403; [email protected] Mathias, Chris [379] California Social Work Education Center; 510-642-7490; [email protected] Mathison, Sandra [137-309-572-582] University of British Columbia; 604-879-7386; [email protected] Matjasko, Jennifer [899] Centers for Disease Control and Prevention; 770-488-4267; [email protected] Matteson, Michael [603] University of Wollongong; [email protected] Mattox, John [880] Knowledge Advisors; 615-591-1032; [email protected] Matulis, Janet [216-417-676] Cincinnati Children's Hospital Medical Center; 513-803-1891; [email protected] Matzen, Nita [137] Appalachian State University; 828-262-6064; [email protected] Max, Jeffrey [265] Mathematica Policy Research; 202-484-4236; [email protected] Maxwell, Ann [376-529] United States Department of Health and Human Services; 312-353-9871; [email protected] May, Jenny [777] University of South Carolina; 803-777-8202; [email protected] May, John [386] University of South Carolina; 803-777-0316; [email protected] Mayfield, Marcia [301] Paraprofessional Healthcare Institute (PHI); 718-928-2074; [email protected] Maynard, Kathie [117] University of Cincinnati; 513-556-2023; [email protected] Mazurkiewicz, Grzegorz [137] Jagiellonian University; +48501268058; [email protected] McAndrew, Abra [703] University of Arizona; 520-626-4688; [email protected] McBride, Dominica [511] Center for African American Health; 480-430-9709; [email protected] McClure, Megan [612] Texas A&M University; 785-564-0949; [email protected] McConnell, Sheena [826] Mathematica Policy Research; 202-484-4518; [email protected] McCoy, Lynn [636-859] Pact Inc; 360-217-5012; [email protected] McCoy, Teresa [813] University of Maryland; 301-405-4153; [email protected] McCracken, Kasey [385] Oregon Health & Science University; 503-245-2102; [email protected] McCrae, Marjorie [607] Research Into Action; 503-287-9136; [email protected] McCrae, Tarsha [137] National Institutes of Health; 301-443-8972; [email protected] McCullough, Anna [320] University of North Carolina; 919-843-2746; [email protected] McDermott, Peter [224] Children's Investment Fund Foundation; [email protected] McDonald, Daniel [737-773] University of Arizona; 520-626-5161; [email protected] McEathron, Mary [127-283-363-427] University of Minnesota; 612-750-5276; [email protected] McGahey, Richard [745] Ford Foundation; 212-573-5398; [email protected] McGuire, Joan [289] University of Connecticut; 860-486-6201; [email protected] McGuire, Martha [337] Cathexis Consulting; 416-469-9954 x224; [email protected] McKay, Kathleen [260-420-628] Connecticut Children's Medical Center; 860-545-9423; [email protected] McKay, Tasseli [672] RTI International; 919-485-5747; [email protected] McKegg, Kate [307-800] The Knowledge Institute; +64-21-475-919; [email protected] McKenna, Margaret [708] ConTEXT; 206-935-6340; [email protected] McKenzie, Robetta [519-623-678-809] Augusta Partnership for Children Inc; 706-721-4885; [email protected] McKinney, Christopher [302] Mental Health Center of Denver; 303-504-6638; [email protected] McKlin, Tom [226-496-525] The Findings Group LLC; 404-788-4506; [email protected] McKnight, Katherine [206-580-586] Pearson Corporation; 703-389-5401; [email protected] McKnight, Patrick [246-586-666] George Mason University; 703-993-8292; [email protected] McLain, Ed [731-811] University of Alaska, Anchorage; 907-952-8940; [email protected] McLean, Cathie [302] Mental Health Center of Denver; 303-504-6578; [email protected] McLinden, Daniel [676-885] Cincinnati Children's Hospital Medical Center; 513-636-8933; [email protected] McMillin, Stephen Edward [711] University of Chicago; 773-329-0289; [email protected] McNair, Shannan [875] Oakland University; 248-320-5637; [email protected] McNall, Miles [260-543-679-710-859] Michigan State University; 517-432-0475; [email protected] McNeil, Keith [266] University of Texas, El Paso; 575-636-4721; [email protected] McQuiston, Thomas [240-730] Tony Mazzocchi Center for Health, Safety and Environment; 919-929-5878; [email protected] McRae, Marjorie [127] Research Into Action; 503-287-9136; [email protected] McWayne, Janis [874] Francis Marion University; 843-661-1467; [email protected] Means, Barbara [116] SRI International; 650-859-5001; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 196 Meeks, Mendy [881] Virginia Department of Medical Assistance Services; 804-225-4285; [email protected] Meli, Jane [137] University of North Carolina at Greensboro; 336-315-7406; [email protected] Melkers, Julia [391-531] Georgia Institute of Technology; 404-385-0456; [email protected] Mello, Dan [547] WestEd; 781-481-1158; [email protected] Menke, James Michael [206-326] University of Arizona; 520-621-5463; [email protected] Menkes, Susan [137-226] Claremont Graduate University; [email protected] Menoher, Brandee [803] Points of Light Institute; 404-641-7220; [email protected] Menon, Goutham [209-263] University of Texas, San Antonio; 210-458-2625; [email protected] Menon, Nidu [320] North Carolina Health and Wellness Trust Fund; 919-855-6880; [email protected] Mentzer, Gale [237] University of Toledo; 419-530-4910; [email protected] Mercier, Celine [749] University of Montreal; 514-364-2282 x2360; [email protected] Meredith, Julie [303] University of Pittsburgh; 412-624-7596; [email protected] Merola, Stacey [137-606-729] ICF International; 703-225-2315; [email protected] Mertens, Donna [318-497-782-889] Gallaudet University; 202-651-5545; [email protected] Merves, David [249-844-869] Evergreen Educational Consulting LLC; 802-434-5607; [email protected] Mettrick, Jennifer [881] University of Maryland; 410--706-4712; [email protected] Metzger, Isha W [280] University of South Carolina; 404-784-7659; [email protected] Meyer, Cheryl [219-435-508] Wright State University; 937-775-2886; [email protected] Meyers, Duncan [137-280] University of South Carolina; 803-414-1090; [email protected] Michaels, R Gregory [738] Chemonics International; 202-270-6761; [email protected] Michalchik, Vera [137] SRI International; 650-859-4176; [email protected] Michel, Rochelle [345] Educational Testing Service; 609-734-5726; [email protected] Middaugh, Ellen [125] University of California, Berkeley; 510-643-1984; [email protected] Middendorf, Jan [116-220-831-897] Kansas State University; 785-532-4716; [email protected] Mielke, Monica [692] Policy Studies Associates; 202-939-5320; [email protected] Mijanovich, Tod [273] New York University; [email protected] Mikkelsen, Megan [618] Washington State Department of Health; 360-236-3853; [email protected] Miller, Andy [607] United States Environmental Protection Agency; 919-541-2920; [email protected] Miller, Christine [702] Savannah College of Art and Design; 912-525-6433; [email protected] Miller, M David [262] University of Florida; 352-273-4306; [email protected] Miller, Patricia [137] Nemours Health and Prevention Services; 302-444-9067; [email protected] Miller, Robin Lin [260-389] Michigan State University; 517-432-3267; [email protected] Millett, Ricardo [737-785] Ricardo Millett and Associates; 773-752-9600; [email protected] Mills, Jack [342] Independent Consultant; 909-224-0412; [email protected] Milton, Jessica [596] University of North Carolina at Chapel Hill; [email protected] Mindrila, Diana [386] South Carolina Educational Policy Center; 803-777-7416 Minja-Trupin, Christine [133] Meharry Medical College; 615-327-6528; [email protected] Minzner, Amy [829] Abt Associates Inc; [email protected] Mir, Nushina [625] Lumina Foundation for Education; 317-951-5340; [email protected] Mirambeau, Alberta [618] Centers for Disease Control and Prevention; 770-488-8185; [email protected] Miron, Gary [589-750-811] Western Michgian University; 269-387-3883; [email protected] Misra, Shalini [691] University of California, Irvine; 949-331-5300; [email protected] Mitchell, Nora [127] National Park Service; 802-457-3368; [email protected] Mitchell-Herzfeld, Susan [120] New York State Office of Children and Family Services; 518-474-9486 Moberg, D Paul [133] University of Wisconsin, Madison; 608-263-1304; [email protected] Mock, Nancy [738] Tulane University; 504-899-8898; [email protected] Modarresi, Shahpar [225] Montgomery County Public Schools; 301-279-3579; [email protected] Moe, Judith [537] Indian and Northern Affairs Canada; 613-947-5023; [email protected] Moeykens, Barbara [320] NC Health and Wellness Trust Fund; 919-855-6881; [email protected] Mohan, Rakesh [308-341-388-615] Idaho State Legislature; 208-332-1470; [email protected] Mohr, David [658-829] United States Department of Veterans Affairs; 857-364-5679; [email protected] Mohr, Ruth [625] SPEC Associates; 734-662-5253; [email protected] Mohre, Gaylen [592] University of California, San Francisco; 415-476-3689; [email protected] Molinaro, Lisa [552] Aspen Institute; 202-736-5813; [email protected] Molitor, Fred [306] Walter R McDonald and Associates Inc; 916-239-4020 x246; [email protected] Mollette, Melinda [137] North Carolina State University; 919-986-9149; [email protected] Molloy, Patty [764] Evergreen Training & Evaluation; 206-780-3343; [email protected] Molyneaux, Jack [399] Millennium Challenge Corporation; 202-521-3600; [email protected] Monchuk, Victoria [539] World Bank; 202-458-0916; [email protected] Monem, Abeer [585] Fort Bend County Women's Center Inc; 281-342-0251; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 197 Monrad, Diane [386-606] University of South Carolina; 803-777-8244; [email protected] Montano, Daniel [137-779] Battelle Memorial Institute; 206-528-3105; [email protected] Montgomery, Florita [813] West Virginia University Extension; 304-293-8701; [email protected] Montrosse, Bianca [137-361-385-579] Western Carolina University; 843-267-0098; [email protected] Moo Sang, Brian [537] Treasury Board of Canada; 613-957-9653; [email protected] Moore, Andrea [360] MANILA Consulting Group Inc; 404-639-6262; [email protected] Moore, Angela [673-717] National Institute of Justice; 202-307-0145; [email protected] Moore, Deborah [853] University of Minnesota; 612-625-7813; [email protected] Moore, Marah [110-707] i2i Institute Inc; 575-758-7513; [email protected] Moore, Mea [764] Professional Educator Standards Board; 360-725-6276; [email protected] Moore, Patricia [811] Western Michigan University; 269-388-9494 x201; [email protected] Moore, Raeal [137-600-672] The Ohio State University; 614-247-6256; [email protected] Moore, Scott C [237-829] United States Department of Veterans Affairs; 513-247-4284; [email protected] Moore-Monroy, Martha [744] University of Arizona; 520-626-1709; [email protected] Moorthy, Savitha [278-686] SRI International; 650-859-5143; [email protected] Morahan, Page [256] Foundation for Advancement of International Medical Education and Research; 215-823-2240; [email protected] Morales, Julie [137-720] University of Denver; 303-871-4873; [email protected] Moran, Garrett [881] Westat; 301-294-3821; [email protected] Morariu, Johanna [205-883] Innovation Network; 202-728-0727 x103; [email protected] Moreau, Katherine [137-252] University of Ottawa; 613-260-2206; [email protected] Moreira dos Santos, Elizabeth [137-814] Oswaldo Cruz Foundation (Fiocruz); +55 21 25982861; [email protected] Morell, Jonathan [235-283-503] Vector Research Center; 734-646-8622; [email protected] Morgan, Annie [900] Challenger Learning Center; 304-243-1479; [email protected] Morgan, Chris [612] University of Georgia; 706-542-7102; [email protected] Morgan, Claire [614] WestEd; [email protected] Morgan, Dewayne [288] University System of Maryland; 301-445-2731; [email protected] Morgan, Grant [114-286-874] University of South Carolina; 803-576-6331; [email protected] Moriarty, Mary [289] Picker Engineering Program, Smith College; 413-585-6972; [email protected] Morin, Diane [749] University of Quebec at Montreal; 514-987-3000 x4924; [email protected] Moronta, Domingo [817] St Barnabas Hospital; 646-338-7600; [email protected] Morra Imas, Linda [617] World Bank; 202-247-7988; [email protected] Morris, Meghan [137] State University of New York at Albany; 518-442-5027; [email protected] Morris, Michael [582] University of New Haven; 203-932-7289; [email protected] Morrow, Jennifer [137-315-532-593-872] University of Tennessee, Knoxville; 865-974-6117; [email protected] Morrow, Nathan [738] World Vision International; 504-899-8898; [email protected] Morrow, Stephanie [235] Volpe National Transportation Systems Center; 617-494-2172; [email protected] Mortensen, Jennifer [137-630-710] Michigan State University; 224-715-3193; [email protected] Mortimer, Sharon [387] Michael Smith Foundation for Health Research; 604-714-2777; [email protected] Morzuch, Michaella [245] Mathematica Policy Research; 617-674-8352; [email protected] Moster, Kristina [137] Cincinnati Children's Hospital Medical Center; 513-803-0582; [email protected] Mostovoy, Cathie [126] Woodcraft Rangers; 213-249-9293; [email protected] Motamedi, Kurt [590] Pepperdine University; 310-568-5577; [email protected] Mowat, Marisa [137] St Joseph's Children's Advocacy Center; 813-493-4546; [email protected] Mueller, Nancy [390-616-638] Washington University in St Louis; 314-935-3710; [email protected] Mueller, Patricia [495-844-869] Evergreen Educational Consulting LLC; 802-434-5607; [email protected] Muhr, Kathy [658-841] University of Massachusetts; 508-856-3533; [email protected] Mukhopadhyay, Kankana [315] University of Rochester; 585-362-5666; [email protected] Muller-Clemm, Werner [304] Canadian Health Services Research Foundation; 613-728-2238 x214; [email protected] Mulvey, Christopher [829] Abt Associates Inc; 617-520-2822; [email protected] Mumford, Steve [292] Organizational Research Services; 206-728-0474 x224; [email protected] Mundy, Brian [713] Institute for Community Living Inc; 212-385-3030 x3236; [email protected] Munley, Mary Ellen [877] MEM and Associates; 708-660-9290; [email protected] Munson, April [634] Kennesaw State University; 770-423-6138; [email protected] Murphrey, Theresa [137] Texas A&M University; 979-458-2749; [email protected] Murphy, Kelly [126] Claremont Graduate University; 909-607-1540; [email protected] Murphy, Kevin [137] State University of New York at Albany; 518-442-5027; [email protected] Muse, Andrea [682] MANILA Consulting Group Inc; 571-633-9797; [email protected] Muthoni, Rachel [272] International Center for Tropical Agriculture; +256 754 44 77 86; [email protected] Mycek, Kristina [137-296-754] State University of New York at Albany; 585-313-8855; [email protected] Myhlhousen-Leak, Georgetta [137] University of Iowa; 641-672-2058; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 198 Myrick, Shannon [348] Oregon Youth Authority; 503-373-7387; [email protected] Mzumara, Howard [515] Indiana University-Purdue University Indianapolis; 317-278-2214; [email protected] NNNNNNNN Nagy, Mark [829] Xavier University; [email protected] Nahan, Neva [435] Wayne State University; 313-577-9918; [email protected] Naidoo, Indran [202] Office of the South African Public Service Commission; 27-12-352-1039; [email protected] Na'im, Alyssa [117-765-875] Education Development Center; 617- 618-2456; [email protected] Najab, Julius [680] George Mason University; 703-993-8292; [email protected] Nakamura, Osamu [890] Nagasaki Prefectural Government; +81 95 895 2520; [email protected] Nalls, Mercedes [803] Florida State University; 850-241-3183; [email protected] Nangle, Desiree [137] Claremont Graduate University; [email protected] Naoom, Sandra [280] National Implementation Research Network; 919-636-2035; [email protected] Nascimento, Lori [264-592-797] California Endowment; 213-928-8637; [email protected] Natenshon, Debra [205] The Center for What Works; 773-398-8858; [email protected] Ndichu, Eric [616] Washington University in St Louis; 314-935-4368; [email protected] NDinga, Pascal [579] University of Quebec at Montreal; 514-987-3000; [email protected] Nearing, Kathryn [595-850] University of Colorado, Denver; 303-315-4945; kathryn.nearing @ucdenver.edu Nelsestuen, Kari [610-725-811] Education Northwest; 503-275-9588; [email protected] Nelson, Amber [609] University of Maryland; 301-405-6417; [email protected] Nelson, Catherine A [677] Independent Consultant; 818-851-9771; [email protected] Nelson, Nanette [866] University of Wyoming; 307-399-0496; [email protected] Nelson, Randi [524-681] JVA Consulting LLC; 720-407-8406; [email protected] Neubauer, Leah [325] DePaul University; 773-325-4768; [email protected] Neupert, Shevaun [137] North Carolina State University; 919-513-8514; [email protected] Nevins, Kate [801] Human Services Research Institute; 617-876-0426 x2328; [email protected] Nevo, David [734] Tel Aviv University; [email protected] Newcomer, Kathryn [615-687-727] George Washington University; 202-994-3959; [email protected] Newman, Denis [566] Empirical Education Inc; 650-328-1734 x112; [email protected] Newman, Dianna L [137-313-598-879] State University of New York at Albany; 518-329-5027; [email protected] Newman, Frederick [106-300-600] Florida International University; 816-585-3882; [email protected] Newton, Xiaoxia [643] University of California, Berkeley; 510-643-8385; [email protected] Newton-Curtis, Linda [259-299] Human Services Research Institute; 503-924-3783 x15; [email protected] Ngapo, Chantalle [654] Te Wananga o Aotearoa; +64 7 872 0330; [email protected] Ngugi, Mary [636] Pact Inc; 202-466-5666; [email protected] Nichols, Allison [813] West Virginia University Extension; 304-293-8643; [email protected] Nichols-Barrer, Ira [884] Mathematica Policy Research; 617-674-8364; [email protected] Nickel, Philip [137] AVID Center; 858-380-4739; [email protected] Nielsen, Julie [211-574] NorthPoint Health and Wellness Center Inc; 612-543-2578; [email protected] Nikolova, Valya [836] World Bank; 202-473-4483; [email protected] Nilsen, Corinne [137] Wichita State University; 316-978-7814; [email protected] Nimon, Kim [435] University of North Texas; 214-675-4872; [email protected] Nistler, Mary [327] Learning Point Associates; 312-288-7629; [email protected] NIxon, Carol [525-875] Edvantia Inc; 615-248-0248; [email protected] Nixon, J Alice [609] University of Maryland; 301-405-9369; [email protected] Nkamleu, Guy Blaise [885] African Development Bank; 216-7110-2241; [email protected] Nnawulezi, Nkiru [245] Michigan State University; 517-353-4568; [email protected] Noble, Corinne [116] Center for Human Services Research; 518-591-8785; [email protected] Nochajski, Thomas H [209] State University of New York at Buffalo; 716-645-1245; [email protected] Noda, Joshua [881] Westat; [email protected] Noga, Janice [363-597-724] Pathfinder Evaluation and Consulting; 513-533-1643; [email protected] Norman, Cameron [387] University of Toronto; 416-978-1242; [email protected] Norris, Kathleen [374-734] Plymouth State University; 603-535-3023; [email protected] Novais, Gabe [137] SRI International; 650-859-2835; [email protected] Nuckles, Kimberly [127] Minnesota Pollution Control Agency; 651-757-2618; [email protected] Nunn, Jacqueline [845] Johns Hopkins university; [email protected] Nwangwu, Ndidi [137] Centers for Disease Control and Prevention; 770-488-4286; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 199 OOOOOOOO Ochieng, Cliff [898] Safe Water and AIDS project; [email protected] O'Connell, Ann [600] The Ohio State University; [email protected] O'Conner, Rosemarie [729] ICF Macro; 703-934-3000; ro'[email protected] O'Connor, Alan [527] RTI International; [email protected] Odhiambo, Karen [732] University of Nairobi; +254 722334649; [email protected] O'Donnell, Cara [730] Science and Technology Policy Institute; [email protected] O'Fallon, Liam [730] National Institute of Environmental Health Sciences; [email protected] Officer, Kelly [348] Oregon Criminal Justice Commission; 503-378-6224; [email protected] Ofir, Zenda [132-202-243] Evalnet South Africa; +27 82 881 0251; [email protected] Ogunbanjo, Gboyega [256] University of Limpopo; +012 5214528; [email protected] Ohkubo, Saori [857] Johns Hopkins University; 410-659-6398; [email protected] Oka, Shuichi [890] National Institute of Advanced Industrial Science and Technology; +81 29 862 6069; [email protected] Okonkwo, Charles [137-672] The Ohio State University; [email protected] Olatunji, Anane [226-265-496] Fairfax County Public Schools; 571-423-1445; [email protected] Olderbak, Sally [719] University of Arizona; [email protected] Oliphant, Emmerentie [333] Stephen F Austin State University; 936-622-3814; [email protected] Oliveira, Luisa [137] Fluminense Federal University; luisa,[email protected] Oliveira, Thais [137] Oswaldo Cruz Foundation; 055-21-98111627; [email protected] Oliver, Monica [618] Centers for Disease Control and Prevention; 404-931-9759; [email protected] Olmos-Gallo, Pablo [302] Mental Health Center of Denver; 303-504-6661; [email protected] Olney, Cynthia [512] National Network of Libraries of Medicine; 678-682-3864; [email protected] Olsen, Lenore [799] Rhode Island College; 781-784-9487; [email protected] Olsho, Lauren [227] Abt Associates Inc; 617-349-2326; [email protected] Olson, Chris [352-570] European Bank for Reconstruction and Development; +011 44 207 338 6000; [email protected] Ondrusek, Robert [437] International Federation of Red Cross and Red Crescent Societies; +66-84-752-6159; [email protected] O'Neil, Sasigant [338] Mathematica Policy Research; 617-301-8975; so'[email protected] ONeill, Cassandra [893] Wholonomy Consulting; 520-888-2545; [email protected] Ooi, Kenta [890] National Institute of Advanced Industrial Science and Technology; +81-29-862-6069; [email protected] Oppenheimer, Caitlin [113] NORC at the University of Chicago; 301-634-9322; [email protected] Ordowich, Chris [567] SRI International; 703-247-8485; [email protected] Orians, Carlyn [279-540-720] Battelle Memorial Institute; 206-528-3320; [email protected] Oros, Cheryl [431-569-689] Oros Consulting LLC; 703-524-6420; [email protected] Ortega, Sandra [364] Ohio DELTA and Rape Prevention Education; 614-898-0070; [email protected] Ortez, Omar [849] Oxfam America; 857-928-3241; [email protected] Ortiz, Lorena [530] Berkeley Policy Associates; 510-465-7884 x213; [email protected] Orwin, Robert [137-522] Westat; 301-251-2277; [email protected] Osatuke, Katerine [237-658-695-829] United States Department of Veterans Affairs; 513-247-2255; [email protected] Oscarsson, Lars [268] Orebro University; +46705457410; [email protected] Ostenso, Laura [716] Innovation Network; 202-728-0727 x114; [email protected] O'Sullivan, Rita [137-204-324-424-671-876] University of North Carolina at Chapel-Hill; 919-843-7878; [email protected] Otero, Martina [261] Fonte Institute; 551130321108; [email protected] Otieno, Brian [898] Safe Water and AIDS project; [email protected] Otto, Tamara [845] Johns Hopkins university; [email protected] Outley, Corliss [137] Texas A&M University; 979-458-0937; [email protected] Overbay, Amy [137] North Carolina State University; 919-637-0787; [email protected] Oviedo, Magaly [319] Consorcio por la Salud, Ambiente y Desarrollo (ECOSAD); + 51 1 332 5713 Owens, Corina [740-799] University of South Florida; 813-943-1217; [email protected] Owens, Robert [525] Washington State University; 509-335-8394; [email protected] Owens, Timothy J [600] Purdue University; [email protected] Oyer, Elizabeth [203] EvalSolutions Inc; 317-582-1925; [email protected] Oyloe, Peter [137] Academy for Educational Development; +977 1 444 4753; [email protected] Ozawa, Jennifer [567] SRI International; 703-247-8431; [email protected] Ozga, Jenny [789] University of Edinburgh; [email protected] Öztürk, Mehmet [843] Arizona State University; 602-496-1151; [email protected] PPPPPPPP Pace, April [619] Center for Health Training Resource Group; 206-223-1186; [email protected] Pacifico, Massimiliano [268] Evaluation Unit of Region Lazio; +39 06 51683452; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 200 Packer-Muti, Barbara [256-512] Nova Southeastern University; 954-262-5398; [email protected] Pahl, Dale [607-633-846] United States Environmental Protection Agency; 919-541-1851; [email protected] Pan, Hui-Ling [137] National Taiwan Normal University; +886282111897; [email protected] Pan, Wei [300] University of Cincinnati; 513-556-2610; [email protected] Panagides-Busch, Melissa [533] Academy for Educational Development; 202-884-8142; [email protected] Pankaj, Veena [552-808] Innovation Network; 202-728-0727 x107; [email protected] Pannone, Aaron [137] University of Virginia; 434-924-9032; [email protected] Pant, Prakash Dev [137] N-MARC Project; +977 9841525718; [email protected] Paquette, Ed [868] AIDS Project Hartford; 860-951-4833; [email protected] Park, Jiyoung [137] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); +82 2 589 2290; [email protected] Parker, Loran Carleton [392] Purdue University; 765-494-6646; [email protected] Parker, Susan [557-769] Clear Thinking Communications; 802-748-3070; [email protected] Parman, Mark [137] Cherokee Nation; 918-207-4973; [email protected] Parrish, Donna [409] Clark Atlanta University; 770-883-9974; [email protected] Parsons, Beverly A [110-261-507-743] InSites; 360-638-1442; [email protected] Passa, Aikaterini [137-259-729-798] ICF International; 703-225-2161; [email protected] Pastore, Serafina [375-768] University of Bari; +0039 349 8778918; [email protected] Patel, Mayur [124-745-895] John S and James L Knight Foundation; 305-908-2600; [email protected] Patel-Larson, Alpa [360] Centers for Disease Control and Prevention; 404-639-3253; [email protected] Patrick, Jonathan [268] Department for International Development; [email protected] Patrizi, Patricia [690-745] Patrizi & Associates; 215-732-2200 x235; [email protected] Patroclo, Maria Aparecida [137] National School of Public Health (ENSP/Fiocruz); [email protected] Patron-Cortes, Roger [294] Universidad Autonoma de Campeche; +52-999-9195824; [email protected] Patton, Michael Quinn [100-235-276-307-323-690-736-851] Utilization-Focused Evaluation; 651-690-3254; [email protected] Patton-Terry, Nicole [306] Georgia State University; 404-413-8326; [email protected] Paulmer, Hubert [898] Harry Cummings and Associates Inc; 613-884-2828; [email protected] Paulsell, Diane [307] Mathematica Policy Research; 609-275-2297; [email protected] Paulsen, Christine [137-879] Concord Evaluation Group LLC; 978-369-3519; [email protected] Pawloski, Tammy [874] Francis Marion University; 843-661-1475; [email protected] Payne, Gayle [227] Centers for Disease Control and Prevention; 770-488-8050; [email protected] Payne, Pamela B [773] University of Arizona; 520-621-4284; [email protected] Pearce, Susan [137-779] Battelle Memorial Institute; 206-528-3154; [email protected] Pearsall, Tara [137-518-845-877] Savannah College of Art and Design; 803-546-6119; [email protected] Peaster, Trisha [137] Wichita State University; 316-978-6772; [email protected] Peck, Laura [273-826] Arizona State University; 602-496-0460; [email protected] Peisher, Ann [519-623-678-809] University of Georgia; 706-549-7032; [email protected] Pelkowski, Tracy [223] University of Pittsburgh; 412-624-7240; [email protected] Pelt, Juanita [137] The Evaluation Group; 803-719-5108; [email protected] Pemberton, Neva [876] University of California, Los Angeles; 510-316-9723; [email protected] Pendleton, Karen [437-896] University of South Carolina; 803-978-7574; [email protected] Penna-Firme, Thereza [137-512] Cesgranrio Foundation; +55 21 2279 5849; [email protected] Penuel, William R [116-560] SRI International; 415-269-0902; [email protected] Perez, Jesus [137] Lou Panci, Citrus Health Network; 757-329-4690; [email protected] Perkins, John [619] Center for Health Training Resource Group; 206-223-1186; [email protected] Perrin, Karen [137] University of South Florida; 813-974-6704; [email protected] Perry, Aubrey W [593] Portland State University; 405-596-0005; [email protected] Perry, Joy [605] Fort Morgan School District; 970-867-5633 x48113; [email protected] Perry, Katye [435-554-734-793] Oklahoma State University; 405-744-9447; [email protected] Persaud, Nadini [350-430-676] University of the West Indies; +246-438-0595; [email protected] Pesl Murphrey, Theresa [435] Texas A&M University; 970-458-2749; [email protected] Peters, Jane [127] Research Into Action; 503-287-9136; [email protected] Petersén, Anna [268] Orebro University; +4619303000; [email protected] Peterson, Lance [306] Case Western Reserve University; 216-368-2734; [email protected] Peterson, Linda [758] University of British Columbia; 604-875-4111 x66200; [email protected] Petit-Bois, Merlande [740] University of South Florida; 813-477-2305; [email protected] Petrochenkov, Katya [804] Gatti Evaluation Inc; 412-477-8025; [email protected] Petrosino, Anthony [614] WestEd; 781-481-1100; [email protected] Petrovich, James [885] University of Texas, Arlington; 682-478-7660; [email protected] Petrucci, Carrie [137-367] Evaluation, Management & Training Associates Inc; 818-667-9167; [email protected] Petrulis, Robert [137-777] University of South Carolina; 803-777-1246; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 201 Pettibone, Kristi [602] National Institute of Environmental Health Sciences; 919-541-7752; [email protected] Petty, Richard [329] Independent Living Research Utilization; 713-520-0232; [email protected] Pfaff, John [137] Fordham Law School; 212-636-7661; [email protected] Pham, Thanh [383] University of South Florida; 813-406-7925; [email protected] Phelps, Jerry [137] National Institute of Environmental Health Sciences; 919-541-4259; [email protected] Philipose, Sandy [566] Empirical Education Inc; 650-328-1734 x156; [email protected] Phillips, Kaye [304] Canadian Health Services Research Foundation; 613-327-7483; [email protected] Phillips, Susan [617] Carleton University; 613-520-2600 x2633; [email protected] Phillips, Tina [267-347] Cornell Univeristy; 607-254-2482; [email protected] Philp, Joel [137] The Evaluation Group; 803-719-5102; [email protected] Picher, Helen Davis [263-365] William Penn Foundation; 215-988-1830; [email protected] Pierce, Steven [366-710] Michigan State University; 517-353-9288; [email protected] Pierre, Paule-Anny [537] Department of Canadian Heritage; 819-953-7841; [email protected] Ping, Yu [827] Battelle Memorial Institute; 703-875-2981; [email protected] Pinsker, Eve [662] University of Illinois at Chicago; 773-802-4802; [email protected] Piontek, Mary [374] EmcArts Inc; 734-649-6866; [email protected] Pipi, Kataraina [307-591-782] Independent Consultant; +64 9 827 8967; [email protected] Pirozzi, Stephen [570] World Bank; 202-458-8772; [email protected] Plaskett, Nancy [677] Chicago Children's Museum; 312-527-1000; [email protected] Plaut, Julie [760] Minnesota Campus Compact; 651-707-7820; [email protected] Pless Jr, Albert [541] Cambridge Public Health Department; 617-665-3830; [email protected] Podems, Donna [318-897] ICF Macro International; +27 21 418 3369; [email protected] Polin, Meridith [665] Public/Private Ventures; 212-822-2411; [email protected] Polinsky, Margaret [519-629] Parents Anonymous Inc; 909-621-6184 x213; [email protected] Pollack, Harold [285] University of Chicago; 773-702-4414; [email protected] Pollard, Michael [231] Discovery Logic; 240-912-1901; [email protected] Polt, Wolfgang [726] Joanneum Research; +43 1 5817520; [email protected] Polus, Elena [244] Iowa State University; [email protected] Polush, Elena [623] Iowa State University; 515-460-1443; [email protected] Ponomariov, Branco [569] University of Texas, San Antonio; 210-478-6767; [email protected] Poole, Dennis [830] University of South Carolina; 803-777-7000; [email protected] Pope, Paul [137-394] Texas A&M University; 979-845-7202; [email protected] Popkin, Stephen [736] Volpe National Transportation Systems Center; [email protected] Porowski, Allan [137-259-686-729-798] ICF International; 703-225-2229; [email protected] Porter, Alan [311-531] Georgia Institute of Technology; 404-384-6295; [email protected] Porter, Breanne [803] Florida State University; 850-345-0357; [email protected] Porter, Michael [576] College Center for Library Automation; 850-922-6044; [email protected] Potamites, Liz [845] Mathematica Policy Research; 202-484-9220; [email protected] Poth, Cheryl [261-356] University of Alberta; 780-492-1144; [email protected] Potter, Lance [124-292] Bill & Melinda Gates Foundation; 202-662-8177; [email protected] Potter, Robert [740] University of South Florida; 813-974-6957; [email protected] Powell, Brian [392-511] University of Cincinnati; 513-787-8172; [email protected] Powers, Jane [401-584-699] Cornell University; 607-255-3993; [email protected] Prather, Heather [137] United States Office of Personnel Management; 202-553-1312; [email protected] Pratt, Brandy [137] Western Michigan University; 269-344-0089; [email protected] Preskill, Hallie [124-276-521-720-864-902] Strategic Learning & Evaluation Center; 206-624-6745 x307; [email protected] Pribesh, Shana [734] Old Dominion University; 757-683-6684; [email protected] Price, Karen [386-538-685] South Carolina Educational Policy Center; 803-777-7416; [email protected] Price, Rebecca [223] University of Pittsburgh; 412-624-7240; [email protected] Pride, Bryce [740] University of South Florida; 321-287-5767; [email protected] Prince, Bonnie [616] Ohio University; [email protected] Prince, Mary [564-619] South Carolina Campaign to Prevent Teen Pregnancy; 803-771-7700; [email protected] Probus, Matt [231] Discovery Logic; 240-912-1966; [email protected] Protik, Ali [265] Mathematica Policy Research; 202-484-4232; [email protected] Prottas, Jeffrey [676] Brandeis University; 781-736-3955; [email protected] Przybylski, Roger [357-672-828] RKC Group; 303-949-8551; [email protected] Pugh, Lauren [795] Mosaic Network Inc; 805-692-0992 x223; [email protected] QQQQQQQQ Qian, Qiang [642] University of Maryland; 410-646-2068; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 202 Quartaroli, MaryLynn [223] Professional Evaluation & Assessment Consultants; 928-779-2687; [email protected] Quinn, Brian [112] Robert Wood Johnson Foundation; 609-627-5813; [email protected] Quinn, Martha [137-592] University of Michigan; 734-936-0480; [email protected] Quirk, Matthew [646] University of California, Santa Barbara; 805-893-9000; [email protected] Quizon, Jaime [836] World Bank; 202-458-1916; [email protected] RRRRRRRR Race, Kathryn [137-839] Race & Associates Ltd; 773-878-8535; [email protected] Rafols, Ismael [531] University of Sussex; +447853865382; [email protected] Ragan, Vicky [787] Evaluation and Research Associates; 425-977-4760 x101; [email protected] Rahimian, Afsaneh [137-619] Center for Health Training; 206-447-9538; [email protected] Rahr, Matthew [296] University of Arizona; 520-621-2489; [email protected] Rai, Kalyani [372] University of Wisconsin, Milwakee; 414-227-3271; [email protected] Raia, Anthony [590] University of California, Los Angeles; 310-546-3082; [email protected] Rainwater, Julie [116-230] University of California, Davis; 916-703-9189; [email protected] Rajigah, Lisa [433-589] International Initiative for Impact Evaluation (3ie); 801-540-1329; [email protected] Rajvaidya, Prashant [646] Mosaic Network Inc; 805-692-0992 x225; [email protected] Rallis, Sharon [657-753-902] University of Massachusetts, Amherst; 413-545-1056; [email protected] Ramaswami, Soundaram [317] Kean University; 908-737-5979; [email protected] Ramirez, Amelie [864] University of Texas Health Science Center at San Antonio; 210-562-6500; [email protected] Rana, Meenal [543] Michigan State University; 517-353-8977; [email protected] Ranney, Joyce [235-736] Volpe National Transportation Systems Center; 617-494-2095; [email protected] Ranney, Leah [320] University of North Carolina; 919-843-8354; [email protected] Rao, Vasanthi [286] University of South Carolina; 803-777-1246; [email protected] Rao Hermon, Sandhya [137] Pricewaterhouse Coopers LLP; 510-665-5787; [email protected] Rawlings, Sarah [798] University of Southern Maine; 207-626-5200; [email protected] Raynor, Jared [264-332-831] TCC Group; 215-568-0399 x206; [email protected] Reaves, Taniya [596] University of North Carolina at Chapel-Hill; 919-843-7878; [email protected] Reed, Ehren [413-505-552-711] Innovation Network; 202-728-0727; [email protected] Reed, John [607-655-770] Innovologie LLC; 301-340-8701; [email protected] Reed, Winnie [673] National Institute of Justice; 202-307-2952; [email protected] Reese, April [107] North Carolina Department of Health; 919-707-5344; [email protected] Reeve, Neville [726] European Commission; +32 2 298 9329; [email protected] Reeves, Jennifer [256-512] Nova Southeastern University; 850-646-0214; [email protected] Reich, Stephanie [119] University of California, Irvine; 949-824-5970; [email protected] Reid, Leslie [137] University of Calgary; 403-220-7405; [email protected] Reid, Shani [686] ICF Macro; 301-572-0534; [email protected] Reider, David [875] Education Design LLC; 617-501-7152; [email protected] Reilly, Daniel [137] University of Tennessee, Knoxville; 865-974-1850; [email protected] Reilly, Erin [879] University of Texas, Austin; 512-232-4374; [email protected] Reinhart, George [375-415-848] University of Maryland; 301-226-8996; [email protected] Reis, Ana [137-814] National School of Public Health (ENSP/Fiocruz); [email protected] Reiserer, Randall [222] Centerstone Research Institute; 615-463-6257; [email protected] Reist, Aimee [576] College Center for Library Automation; 850-922-6044; [email protected] Rempert, Tania [137-259-419] University of Illinois at Urbana-Champaign; 708-404-0559; [email protected] Ren, Weijia [137-600-672] The Ohio State University; 617-319-4470; [email protected] Rennekamp, Roger [128-773] Oregon State University; 541-737-1737; [email protected] Renteria, Rose Ann M [847] Academy for Educational Development; 202-884-8608; [email protected] Resch, Alexandra [838] Mathematica Policy Research; [email protected] Resnick, Gary [306] Harder+Company; 415-522-5400; [email protected] Rethwisch, David [525] University of Iowa; 319-335-1413; [email protected] Revels, Michelle [776] ICF Macro International; [email protected] Rewey, Kirsten L [763-798] Action Consulting and Evaluation Team (ACET) Inc; 952-922-1811; [email protected] Reyes, Adrian [602] Behavioral Assessment Inc; 310-652-6449; [email protected] Rhodes, Hilary [277-856] Abt Associates Inc; 617-520-3516; [email protected] Rice, Jessica [678] University of Wisconsin; 414-219-5067; [email protected] Rich, Lauren [266] Chapin Hall; 773-256-5100; [email protected] Rich, Rachel [335] University of the Pacific; 916-622-1140; [email protected] Richards, Boyd [137] Columbia University; 212-305-0229; [email protected] Richards, Patricia [898] University of Georgia; 706-542-3235; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 203 Richardson, Margaret [519-685] Western Michigan University; 269-387-7065; [email protected] Richardson, Robyn [518] Savannah College of Art and Design; 850-294-4452; [email protected] Richards-Schuster, Katie [401-584] University of Michigan; 734-615-2118; [email protected] Richmond-Scott, Alicia [317] United States Department of Health and Human Services; 240-453-2828; [email protected] Rickards, William [848] Alverno College; 414-382-6256; [email protected] Ridge, Bill [607] United States Environmental Protection Agency; 202-564-2165; [email protected] Ridge, Javan [126-606-794] Colorado Springs School District 11; 719-520-2084; [email protected] Riedel, James [413-889] Girl Scouts of the United States of America; 212-852-6552; [email protected] Rifkin, Tronie [802] EVALCORP; 310-420-3895; [email protected] Rigamer, Elmore [708] Catholic Charities of New Orleans; 504-432-1019; [email protected] Rincones-Gomez, Rigoberto [784] Maryland Distribution Council Inc; 813-382-6144; [email protected] Ringholz, David [702] Savannah College of Art and Design; 912-525-6676; [email protected] Ríos, Ruth [137] University of Puerto Rico; 787-758-2525 x4415; [email protected] Ripley, Jeff [137] Texas A&M University; 979-845-7280; [email protected] Risner, Rhoda [415-754] United States Army; 913-684-2029; [email protected] Ritchie, Liesel [137] University of Colorado at Boulder; 662-617-2464; [email protected] Rivera, Melissa [137-222-522] National Center for Prevention and Research Solutions; 386-760-2254; [email protected] Rivero, Rosario [643] University of California, Berkeley; [email protected] Rivers, Desiree [740] Center for Equal Health; 813-974-2140; [email protected] Rivers, Erika [127] Minnesota Department of Natural Resources; 218-999-7914; [email protected] Roberta Pascom, Ana [814] National Aids Program, Brazil; [email protected] Roberts, Carl [623] Iowa State University; 515-294-8929; [email protected] Roberts-Gray, Cindy [225] Third Coast R&D Inc; 409-762-2499; [email protected] Robertson, Kelly [282-342-514-796] Western Michigan University; 269-387-5919; [email protected] Robin, Wagner [271] National Institutes of Health; 301-443-5234; [email protected] Robinson, Amber [118] ICF Macro; 404-592-2292; [email protected] Robst, John [222] University of South Florida; 813-974-1505; [email protected] Rochester, Phyllis [717] Centers for Disease Control and Prevention; 770-488-3096; [email protected] Rodd, Jane A [137-879] State University of New York at Albany; 518-442-5027; [email protected] Rodgers, Philip [137] American Foundation for Suicide Prevention; 267-886-5906; [email protected] Rodi, Michael S [595] ICF Macro; 917-407-9894; [email protected] Rodriguez, Eunice [320] Stanford University; 650-251-9410; [email protected] Rodriguez, Michael C [763] University of Minnesota; 612-624-4324; [email protected] Rodriguez, R Joseph [594] University of Texas, Austin; 512-232-5847; [email protected] Rodriguez-Campos, Liliana [132-324-404-668-740-784-900] University of South Florida; 813-974-1163; [email protected] Rodríguez-Campos, Liliana [204] University of South Florida; 813-974-1163; [email protected] Roeber, Carter [669] LTG Associates Inc; 301-270-0882; [email protected] Roestenburg, Willem [333] University of Johannesburg; +27 11 7875156; [email protected] Rog, Debra [102-500-506-615-881-902] Westat; 301-279-4594; [email protected] Rogers, Diane [137-796] Western Michigan University; 269-377-8434; [email protected] Rogers, Juan [431-531-689-850] School of Public Policy Georgia Institute of Technology; 404-894-6697; [email protected] Rogers, Nancy [392-511-900] University of Cincinnati; 513-556-1476; [email protected] Rogers, Patricia [202-270-309-663] Royal Melbourne Institute of Technology; +61409386499; [email protected] Rogers, Susan [137-754] State University of New York at Albany; 518-442-3687; [email protected] Rogers, Todd [378] Public Health Institute; 650-949-4055; [email protected] Roget, Nancy [137] University of Nevada, Reno; 775-784-6265; [email protected] Roggeveen, Erica [868] Latino Community Services; 860-296-6400; [email protected] Rohrbaugh, Kate [395] Independent Project Analysis; 703-726-5465; [email protected] Rollison, Chris [619] South Carolina Campaign to Prevent Teen Pregnancy; 803-771-7700; [email protected] Rollison, Julia [320] MANILA Consulting Group Inc; 571-633-9797; [email protected] Romero, Carlos [869] Apex Education Inc; 505-828-0082; [email protected] Roney, Candace [320] Lucile Packard Children's Hospital; 650-725-9468; [email protected] Rood, Magdalena [225-837] Third Coast R&D Inc; 512-326-3044; [email protected] Roper, Laura [751] Brandeis University; 617-877-4336; [email protected] Rorrer, Audrey [255-415] University of North Carolina at Charlotte; 704-227-3059; [email protected] Rosas, Scott [0-770] Concept Systems Inc; 607-272-1206; [email protected] Rose, Shyanika [540] Battelle Memorial Institute; 919-544-3717 x118; [email protected] Rosebear, Sharon [137] Red Lake Band of Chippewa Indians; 218-679-1961; [email protected] Rosecrans, Lindsey [226] State University of New York at Albany; 518-442-5027; [email protected] Roseland, Denise [576-812] University of Minnesota; 612-298-2076; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 204 Rosenblum, Andrew [137] National Development and Research Institutes (NDRI); 212-845-4528; [email protected] Rosenthal, Emily [686] Berkeley Policy Associates; 510-465-7884; [email protected] Ross, John A [900] University of Toronto; 705-742-9773 x2206; [email protected] Ross, Shelley [261] University of Alberta; 780-492-1144; [email protected] Rothman, Emily [604] Boston University; 617-414-1385; [email protected] Rothwell, Julie [678] United Way of Greater Milwaukee; 414-263-8127; [email protected] Rountree, Michele [137] University of Texas, Austin; 512-471-7160; [email protected] Routhier, Anne [537-772] Treasury Board of Canada; 613-952-7447; [email protected] Rovin, Laurie [830] United Way Of Greenville County; 864-467-3333; [email protected] Roy, Ajanta [222] Centerstone Research Institute; 615-460-4143; [email protected] Roy, Ria [275] Indiana University; [email protected] Royalty, Janet [776] Centers for Disease Control and Prevention; [email protected] Ruben, Elizabeth [137] National Institute of Environmental Health Sciences; 919-541-9470; [email protected] Ruberg, Laurie [900] Wheeling Jesuit University; 304-243-2480; [email protected] Rubin, Maureen [209-263] University of Texas, San Antonio; 210-458-2922; [email protected] Rubright, Jonathan [691] University of Delaware; 484-529-4466; [email protected] Ruegg, Rosalie [527-567] TIA Consulting Inc; 252-354-9321; [email protected] Ruffini, Stephen J [121] Wested; 202-429-9727; [email protected] Rugh, Jim [236-282-514-553-587-789-898] Independent Consultant; 865-908-3133; [email protected] Ruhf, Robert J [328] Western Michigan University; 269-387-3791; [email protected] Rui, Ning [300-606-799] Research for Better Schools; 215-568-6150 x277; [email protected] Ruitman, Hendrick [298-606] Cobblestone Applied Research & Evaluation Inc; 909-689-9818; [email protected] Rulf Fountain, Alyssa [277-856] Abt Associates Inc; 617-520-2657; [email protected] Runkles, Tina [306] State University of New York College at Potsdam; 315-267-3136; [email protected] Russell, Christina [874] Indiana University; 812-855-4438; [email protected] Russell, Judith [553-748] Independent Consultant; 212-866-2563; [email protected] Russon, Craig [282] International Labor Organization Evaluation Unit; [email protected] Ryan, Katherine [230] University of Illinois at Urbana-Champaign; 217-333-0719; [email protected] Ryker, Sarah [730] Science and Technology Policy Institute; [email protected] Ryman, Tove [898] Centers for Disease Control and Prevention; 404-639-6283; [email protected] SSSSSSSS Sabo Flores, Kim [401-544-584] Evaluation Access and ActKnowledge; 917-817-1841; [email protected] Sachs, Jonathan [304] Canadian Health Services Research Foundation; 613-728-2238 x223; [email protected] Saflund, Peter [670] The Saflund Institute; 253-630-5326; [email protected] Saka, Susan [627] University of Hawaii, Manoa; 808-956-7900; [email protected] Salcedo Baca, Salomon [392] Food and Agriculture Organization of the United Nations; 434-384-7251; [email protected] Salisbury, April [137-779] LCF Research; 505-938-9925; [email protected] Salmona, Michelle [777] Central Michigan University; 989-317-0621; [email protected] Salzman, James [203] Ohio University; 740-593-4419; [email protected] Samico, Isabella [814] Instituto de Medicina; [email protected] Samuel, Cherian [659] International Finance Corporation; 202-473-0802; [email protected] Sanabria, Ida [137] University of Puerto Rico; 787-646-8719; [email protected] Sanacore, Peter [880] KPMG LLP; 201-307-7495; [email protected] Sankar, Pamela [691] University of Pennsylvania; 215-898-7136; [email protected] Santa Maria, Diane [678] University of Texas; 281-298-6899; [email protected] Santoni, Tim [642] University of Maryland; 410-666-7960; [email protected] Santos, Romeo [132] University of the Philippines; +63 2 915 507 4038; [email protected] Santos, Sonia [137] National School of Public Health (ENSP/Fiocruz); [email protected] Santos Dubeux, Luciana [814] Instituto de Medicina; [email protected] Sanz, Belen [318] United Nations Development Fund for Women; [email protected] Sapiano, Tobey [360] Centers for Disease Control and Prevention; 970-568-8037; [email protected] Sargent, Katherine [592] University of California, San Francisco; 415-476-3689; [email protected] Sarpy, Sue Ann [896] Sarpy and Associates LLC; 434-293-4768; [email protected] Sartwell, Crispin [200-322] Dickinson College; [email protected] Sasaki, Ryoh [132] International Development Center of Japan; 81-47-380-0820; [email protected] Sass, James S [305] Research Support Services; 562-777-6455; [email protected] Savage Brown, Amanda [279-709] Cazador; 678-333-5856; [email protected] Savidge, Mildred [288] Research Works Inc; 518-869-9272; [email protected] Scaccia, Jonathan [280] University of South Carolina; 484-868-2971; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 205 Schaffner, Monika [137] Planning and Learning Technologies Inc; 571-314-3862; [email protected] Schaller, Amy [534] University of Arizona; 520-621-7133; [email protected] Scharbatke-Church, Cheyanne [396-735] Besa Consulting; 403-918-5240; [email protected] Schauer, Laura [137-607] PA Consulting Group; 830-317-3600; [email protected] Schaum-Nguyen, Melissa [380] Los Alamos National Laboratory; 505-667-3214; [email protected] Scheie, David [104-756] Touchstone Center for Collaborative Inquiry; 612-825-9100; [email protected] Scheirer, Mary Ann [239] Scheirer Consulting; 609-951-8686; [email protected] Schell, Sarah [638] Washington University in St Louis; 314-935-3750; [email protected] Schenk Jr, Tom [525] Iowa Department of Education; 515-281-3753; [email protected] Schensul, Jay [137] Institute for Community Research; 860-278-2044 x226; [email protected] Schensul, Stephen [889] University of Connecticut; 860-679-1570; [email protected] Scherer, Christina [137] Southern Polytechnic State University; 678-915-7243; [email protected] Scherer, Hilary [113] NORC at the University of Chicago; 301-634-9374; [email protected] Schiffer-Graham, Beate [537] Industry Canada; 613-954-5084; [email protected] Schindler, Jay [212] Northrop Grumman Corporation; 678-530-3626; [email protected] Schlagen, Ronda [553] Independent Consultant; 802-645-9798; [email protected] Schlanger, Karen [898] University of Georgia; 917-613-1596; [email protected] Schleifer, Michael [579] University of Quebec at Montreal; [email protected] Schmidt, Stefanie [526] United States Department of Education; 202-219-2129; [email protected] Schmitt, Lisa [386-509] Austin Independent School District; 512-414-9845; [email protected] Schnell, Joshua [231] Discovery Logic; 240-912-1974; [email protected] Schnell, Joshua D [137] Discovery Logic; 240-912-1974; [email protected] Scholz, Heather [798] Wayside House; 952-922-1811; [email protected] Schooley, Michael [588] Centers for Disease Control and Prevention; 770-488-5780; [email protected] Schouten, Jeffrey [770] Fred Hutchinson Cancer Research Center; 206-667-5980; [email protected] Schrader, Linda [435-693] Florida State University; 850-644-8780; [email protected] Schreiner, Sebastian [207] City of San Antonio; 210-880-4286; [email protected] Schroeder, Aaron [116] Kansas State University; 785-532-5122; [email protected] Schroeder, Kathryn [137-208] University of Denver; 303-871-6390; [email protected] Schroeter, Daniela [117-282-514] Western Michigan University; 269-387-5895; [email protected] Schug, Vicki [137] St Catherine University; 651-690-6940; [email protected] Schwandt, Thomas [202-273-309-572] University of Illinois at Urbana-Champaign; 217-333-5350; [email protected] Schweitzer, Ilse [889] Western Michigan University; 269-387-2573; [email protected] Sciulli, Joe [385] National Science Teachers Association; 703-312-9218; [email protected] Scott, Brianna [640] Rockman et al; 415-544-0788; [email protected] Scott, Caitlin [725-811] Education Northwest; 503-275-9500; [email protected] Scott, Chyllis [226] Texas A&M University; 979-845-8363; [email protected] Scott, Jack [137] The Madrillon Group Inc; 301-588-7344; [email protected] Scriven, Michael [132-742-800] Claremont Graduate University; 415-663-1511; [email protected] Searle, Michelle [218-532-811] Queen's University at Kingston; 519-645-2455; [email protected] Sechrest, Lee [106-206-586-666] University of Arizona; 621-5463; [email protected] Seff, Laura [600] Florida International Unversity; 305-273-0389; [email protected] Sefton, Laura [841] University of Massachusetts; 508-856-4213; [email protected] Segal, Jodi B [133] Johns Hopkins University; 410-955-9866; [email protected] Segerholm, Christina [789] MidSweden University; +46 611 86243; [email protected] Segone, Marco [276-282] United Nations Children's Fund; 212-824-6567; [email protected] Sembiante, Sabrina F [261-557-685] University of Miami; 305-284-3260; [email protected] Seufert, Robert [672] Miami University; 513-217-4306; [email protected] Sewall, Catherine [137] Centerstone Research Institute; 615-460-4160; [email protected] Sexton, Julie [137] University of Northern Colorado; 303-277-9790; [email protected] Seybolt, Diana [302-562] University of Maryland, Baltimore; 410-646-1756; [email protected] Shackelford, Philip [137] Texas A&M University; 979-203-5633; [email protected] Shady, Therese [120] New York State Office of Children and Family Services; 518-486-5581 Shafloot, Fayez [137-589] Western Michigan University; 269-779-8518; [email protected] Shafritz, Lonna [137] Academy for Educational Development; 202-884-8784; [email protected] Shafritz, Lonna B [137] Academy for Educational Development; 202-884-8784; [email protected] Shaftel, Julia [749] University of Kansas; 785-864-0733; [email protected] Shannon, Lisa [290] Magnolia Consulting LLC; 919-367-9433; [email protected] Shao, Jessica [756] Independent Consultant; 415-889-7084; 415) 889-7084 Shapatava, Ekaterine [360] Northrop Grumman Corporation; 404-639-2411; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 206 Shapiro, Marc [399] Millennium Challenge Corporation; 202-521-7229; [email protected] Shatirishvili, Mamuka [399] Millennium Challenge Account-Georgia; +011 995 32 507 770; [email protected] Shatrova, Zhanna [793] Oklahoma State University; 405-744-4715; [email protected] Shaw, Katherine [255-829] Westwood College; 720-524-5140; [email protected] Shear, Linda [278] SRI International; 650-859-4476; [email protected] Sheedy, Cori [682] Abt Associates Inc; 617-349-2560; [email protected] Shellard, David [137] SRA International Inc; 703-568-2490; [email protected] Shelton, Sarah C [827] Washington University in St Louis; 314-935-3723; [email protected] Shepard, Bonnie [221] Social Sectors Development Strategies; 617-421-9644; [email protected] Shepherd, Robert [617] Carleton University; 613-520-2547; [email protected] Shepperson, Tara [346-435-693-894] Eastern Kentucky University; 808-203-4648; [email protected] Sherry, Susan [112] Community Catalyst; 617-275-2816; [email protected] Sherwood, Kay [690] Independent Consultant; 973-509-2994; [email protected] Shi, Bing [513] Chinese Academy of Sciences; +86-10-6859-7459; [email protected] Shi, Susan [830] South Carolina Institute for Child Success; 864-467-3333; [email protected] Shia, Jackie [900] Challenger Learning Center; 304-243-4431; [email protected] Shing, Janet [684] Community Foundation for Monterey County; 831-375-9712; [email protected] Shipman, Stephanie [228-506-542-651-887] United States Government Accountability Office; 202-512-4041; [email protected] Shipp, Stephanie [730] Science and Technology Policy Institute; [email protected] Shires, Deirdre [137-779] Henry Ford Health System; 313-874-5454; [email protected] Shirley, Eleanor [577] Peace Corps; 202-692-1863; [email protected] Shrestha, Gitanjali [137-647-841] Washington State University; 214-406-7871; [email protected] Shrestha, Shrutee [752] Brigham Young University; 510-230-9091; [email protected] Shrestha-Kuwahara, Robin [279-631] Centers for Disease Control and Prevention; 770-488-0791; [email protected] Shulha, Lyn [204-324-362-532-811] Queen's University at Kingston; 613-533-6000 x75016; [email protected] Shumer, Robert [544-760] University of Minnesota; 651-336-7777; [email protected] Sibley, Candace [260-820] University of South Florida; 214-755-5830; [email protected] Sickels, Aimee [280-830] University of South Carolina; 910-200-8576; [email protected] Sidibe, Mamadou [694-778] International Relief & Development; 703-248-0161; [email protected] Siebold, Wendi [367] Evaluation, Management & Training Associates Inc; 206-962-0260; [email protected] Siegel, Jason [783] Claremont Graduate University; 520-975-6264; [email protected] Siegel, Susan [137-798] Communities In Schools; 703-518-2548; [email protected] Silliman, Benjamin [137-354-612-873] North Carolina State University; 919-515-8485; [email protected] Silva, Sandra [321] Altarum Institute; 202-776-5163; [email protected] Silveira, Carol [301] Massachusetts Board of Registration in Nursing; 617-973-0917; [email protected] Silver, Diana [273] New York University; [email protected] Sim, Shao-Chee [744] Charles B Wang Community Health Center; 212-379-6999; [email protected] Simon, Alan [220] Metis Associates; 212-425-8833 x134; [email protected] Singer, Erin [299] Human Services Research Institute; 503-924-3783 x18; [email protected] Singh, Arati [533] Academy for Educational Development; 512-301-8952; [email protected] Singh, Tejinder [256] Christian Medical College; +91-161-2608617; [email protected] Singhapoon, Supol [757] Pact Inc; +66 2 2313402; [email protected] Singleton, Corinne [278-560] SRI International; 512-608-4349; [email protected] Sitzler, Aimee [301] Arizona State University; 602-496-1085; [email protected] SiWan Zimmerman, Stella [763] Action Consulting and Evaluation Team (ACET) Inc; 952-922-1811; [email protected] Skaff, Laura F [131] Altarum Institute; 202-828-5100; [email protected] Skelton, Ellie [798] The Wayside House Inc; 952-405-7636; [email protected] Skolits, Gary [121-315-532-593] University of Tennessee, Knoxville; 865-974-2777; [email protected] Slay, Julie [126-222] EVALCORP; 949-468-9953; [email protected] Sloane, Fraser [654] Sloane Walker Ltd; +64 27 242 9722; [email protected] Slovacek, Simeon [551] California State University, Los Angeles; 323-343-5622; [email protected] Slutsky, Jean [228] United States Department of Health and Human Services; 301-427-1601; [email protected] Smart, Dawn [251] Clegg & Associates; 206-448-0878; [email protected] Smeardon, Becky [137] Quill Research Associates; 703-307-7559; [email protected] Smiaroski, Mary Sue [751] Oxfam International; 617-728-2463; [email protected] Smiley-McDonald, Hope [672] RTI International; 919-485-5743; [email protected] Smith, Christa [385] Kansas State University; 785-532-5127; [email protected] Smith, Debra [218] Lesley University; 617-349-8230; [email protected] Smith, Donald [249] Texas Early Childhood Education Coalition; 512-476-7939; [email protected] Smith, Elliott [310] Cornell University; 607-255-8104; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 207 Smith, Martin [692] University of California, Davis; 530-752-6894; [email protected] Smith, Michael [708] Louisiana Public Health Institute; 504-301-9800; [email protected] Smith, Nick [611] Syracuse University; 315-443-3703; [email protected] Smith, Tommy [530] Berkeley Policy Associates; tommy@@bpacal.com Smith, Veronica [224-593-755] data2insight; 206-290-0374; [email protected] Snilstveit, Birte [614] International Initiative for Impact Evaluation (3ie); [email protected] Sniukaite, Inga [318] United Nations Development Fund for Women; [email protected] Snow, Juna [125-736] University of California, Berkeley; 707-812-1244; [email protected] Snyder, Angela [137] Georgia State University; 404-413-0285; [email protected] Sobolew-Shubin, Sandy [683] WestEd; [email protected] Soloe, Cindy [717] RTI International; 919-316-3363; [email protected] Sonko-Najjemba, Rita [859] Pact Inc; 202-466-5666; [email protected] Sorg, Amy A [827] Washington University in St Louis; 314-935-3732; [email protected] Sosa-Molina, Miguel [137] University of Yucatan; +52 999 9224557; [email protected] Souflee, Andrea [398] United Way of Dallas; 214-978-0047; [email protected] Souza, Rafaela [137] National School of Public Health (ENSP/Fiocruz); +21 25399461; [email protected] Spearman, Christina [133] University of Wisconsin, Madison; 608-262-7586; [email protected] Spence-Almaguer, Emily [885] University of Texas, Arlington; 817-781-8478; [email protected] Sprague, Kimberly [526] Brown University; [email protected] Springer, Fred [367-547] Evaluation, Management & Training Associates Inc; 916-983-6680; [email protected] Sprott, Katherine [385] Kansas State University; 785-532-6408; [email protected] Spybrook, Jessaca [265-685] Western Michigan University; 269-387-3889; [email protected] Sridharan, Sanjeev [503-746] University of Toronto; 416-540-1570; [email protected] St Roseman, Paul [664-794] DataUse Consulting Group; 510-415-2010; [email protected] Stabile, Bonnie [435] George Mason University; 703-789-5423; [email protected] Stachowiak, Sarah [124-292] Organizational Research Services; 206-728-0474 x229; [email protected] Stachowski, Alicia [896] George Mason University; 703-993-1384; [email protected] Stake, Robert [624] University of Illinois at Urbana-Champaign; [email protected] Stanley, Bragg [761] Missouri Department of Elementary and Secondary Education; 573-751-7966; [email protected] Starobin, Soko [525] Iowa State University; 515-294-9121; [email protected] Starr, Christine [380] Los Alamos National Laboratory; 505-606-1976; [email protected] Staub-DeLong, Leah [227] Abt Associates Inc; 617-520-3517; [email protected] Steedly, Katie [418-518] Steedly Consulting; 202-360-6026; [email protected] Steel, Scott [676] Cincinnati Children's Hospital Medical Center; 513-803-0207; [email protected] Steffanowski, Andrés [106] University of Mannheim; +0049 621 181 3128; [email protected] Steger, Scott [137-522] National Center for Prevention and Research Solutions; 386-760-2254; [email protected] Steinberg, Marla [641] The CAPTURE Project; 778-782-6706; [email protected] Steiner, Ivan [261] University of Alberta; 780-492-1144; [email protected] Steiner, Melissa [678] Medical Institute for Sexual Health; 512-328-6268x202; [email protected] Steinke, Megan [236] Save the Children; 203-221-4239; [email protected] Stein-Seroussi, Alan [522] Pacific Institute for Research and Evaluation (PIRE); 919-265-2636; [email protected] Stephens, Robert L [595] ICF Macro; 678-389-8923; [email protected] Stephenson, Blair [380] Los Alamos National Laboratory; 505-665-1423; [email protected] Stevahn, Laurie [137-377] Seattle University; 2062962559; [email protected] Stevens, Beth [210-245] Mathematica Policy Research; 609-716-4542; [email protected] Stevens, Edith [137] ICF Macro; 301-572-0558; [email protected] Stevens, Joseph [380-626] University of Oregon; 541-346-2445; [email protected] Stevens, Xuan [137] Florida International University; 305-653-9615; [email protected] Stevenson, John [535-734-874] University of Rhode island; 401-874-4240; [email protected] Stice, Kim [225] National Head Start Family Literacy Center; 805-388-5635; [email protected] Stigger, Cagney [137] Morehouse School of Medicine; 404-752-1098; [email protected] Stillisano, Jacqueline [226-305] Texas A&M University; 979-845-8098; [email protected] Stipelman, Brooke [137] National Institutes of Health; 301-402-9639; [email protected] Stockmyer, Chrisandra [717] Centers for Disease Control and Prevention; 770-488-5027; [email protected] Stokes, Helga [737] Duquesne University; 412-396-4057; [email protected] Stokols, Dan [137] University of California, Irvine; 949-824-5294; [email protected] Stokols, Daniel [691] University of California, Irvine; 949-824-5294; [email protected] Stone, Mike [705] Impact Strategies Inc; 260-413-9200; [email protected] Stone, Vathsala [770] State University of New York at Buffalo; 716-204-8606 x210; [email protected] Stoneman, Zolinda [137] University of Georgia; 706-254-0477; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 208 Stoner, Dena [137] Texas Department of State Health Services; 512-206-4851; [email protected] Stone-Wiggins, Brenda [717] Research Triangle Institute International; 919-316-3328; [email protected] Stoter, Antoinette [435] University of Iowa; 319-335-5905; [email protected] Stout, Sharon [887] United States Department of Education; 202-260-2493; [email protected] Stratford, Dale [819] Centers for Disease Control and Prevention; 404-639-6276; [email protected] Streke, Andrei [645] Mathematica Policy Research; 202-484-4513; [email protected] Stringer-Hessel, Amy [390] Missouri Foundation for Health; 314-345-5540; [email protected] Strong, Debra [112-307] Mathematica Policy Research; 609-750-2001; [email protected] Stroter, Antionette [496-732-884] University of Iowa; 336-580-4335; [email protected] Strother, Heather [841] University of Massachusetts; 508-856-4042; [email protected] Stuart, Elizabeth [826] Johns Hopkins University; 410-502-6222; [email protected] Stuebe, Claire [597] East Main Educational Consulting; 910-784-9523; [email protected] Styers, Mary [290] Magnolia Consulting LLC; 540-718-2142; [email protected] Suarez-Balcazar, Yolanda [521] University of Illinois at Chicago; 312-413-1007; [email protected] Subah, Marion [278] Jhpiego; [email protected] Subramanian, Sujha [885] RTI International; 781-434-1749; [email protected] Suda, Hiroyuki [890] National Institute of Advanced Industrial Science and Technology; +81 29 862 6069; [email protected] Sugarman, Julie [566] Center for Applied Linguistics; 202-362-0700 x570; julie@cal-org Sulewski, Jennifer [329-368-495] University of Massachusetts, Boston; 617-287-4356; [email protected] Sulik, Gayle [301] Texas Woman's University; 940-231-3184; [email protected] Sullivan, Cris [245] Michigan State University; 517-353-8867; [email protected] Sullivan, Tara [857] Johns Hopkins University; 518-398-0514; [email protected] Sumartojo, Esther [807] Centers for Disease Control and Prevention; 404-498-3072; [email protected] Sun, Hongling [390] University of Illinois at Urbana-Champaign; 217-714-7076; [email protected] Supe, Avinash [256] GS Medical College; +91 22 5227031; [email protected] Sureshbabu, Suman [270] Rockefeller Foundation; 646-670-1779; [email protected] Surgenor, Cathryn [696] New York Theological Seminary; 845-878-6621; [email protected] Susan, York [707] University of Hawaii, Manoa; 808-956-7900; [email protected] Sutphin, Suzanne [878] University of South Carolina; 803-777-8494; [email protected] Sutter, Mary [607] Opinion Dynamics Corporation; 510-444-5050 x104; [email protected] Sutton, John [804] RMC Research Corporation; 800-922-3636; [email protected] Svitakova, Jirina [137] Czech University of Life Sciences; +00420 777 935 336; [email protected] Sweida-DeMania, Gloria [272] Claremont Graduate University; 714-270-1176; [email protected] Sydlik, Mary Anne [328-759] Western Michigan University; 269-387-3791; [email protected] Symonette, Hazel [244] University of Wisconsin; [email protected] Szanyi, Michael [233-812] Claremont Graduate University; 702-285-9909; [email protected] TTTTTTTT Tabone, Carmine [137] Education Arts Team; 201-232-6643; [email protected] Tackett, Wendy [637] iEval; 269-420-3417; [email protected] Taggart, Caroline [762] Ciurczak & Co Inc; 716-362-0627; [email protected] Tagle, Laura [268] Italy's Ministry for Economic Development; +39 335 635 2208; [email protected] Talieri, John [636] Pact Inc; 202-466-5666; [email protected] Tamanoue, Yoshiaki [890] National Institute of Advanced Industrial Science and Technology; +81 29 862 6096; [email protected] Tananis, Cynthia [134-223-305-641] University of Pittsburgh; 412-648-7171; [email protected] Tang, Li [850] Georgia Institute of Technology; 678-896-3133; [email protected] Tangka, Florence [776-885] Centers for Disease Control and Prevention; [email protected] Tanyu, Manolya [327-685] Learning Point Associates; 312-288-7611; [email protected] Tarakeshwar, Nalini [224] Children's Investment Fund Foundation; +44 7825798894; [email protected] Tarsilla, Michele [344-393-514-809] Western Michigan University; 202-361-9183; [email protected] Tashakkori, Abbas [782] University of North Texas; 940-565-4964; [email protected] Tashima, Niel [669] LTG Associates Inc; 301-270-0882; [email protected] Taylor, Brandie K [137] National Institutes of Health; 301-451-3068; [email protected] Taylor, JT [891] Learning for Action Group; 415-392-2850 x306; [email protected] Taylor, Mary [518] Savannah College of Art and Design; [email protected] Taylor, Mascie [137] University of Cambridge, United Kingdom; +44 1223 335456; [email protected] Taylor-Dormond, Marvin [352] World Bank; 202-473-0770 Taylor-Ritzler, Tina [521] Dominican University; 773-882-1731; [email protected] Teather, George [431-689-886] George Teather and Associates; 613-824-2423; [email protected] Tebes, Jacob [739] Yale University; 203-789-7645; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 209 Teh, Bing-ru [884] Mathematica Policy Research; 617-301-8960; [email protected] Tendulkar, Shalini [541] Institute for Community Health; 617-499-6683; [email protected] Tenev, Stoyan [352] World Bank; 202-473-1392; [email protected] Terry, John D [280] University of South Carolina; 803-445-4421; [email protected] Tester, Diana [878] South Carolina Department of Social Services; 803-898-7512; [email protected] Thais, Oliveira [137] Oswaldo Cruz Foundation; 055-21-98111627; [email protected] Thiessen-Love, Lois [599] Uhlich Children's Advantage Network; 773-429-9330; [email protected] Thomas, A Udaya [278] Jhpiego; 410-537-1860; [email protected] Thomas, Cicely [245] Mathematica Policy Research; 617-674-8358; [email protected] Thomas, Patrick [567] 1790 Analytics LLC; 856-216-1790; [email protected] Thomas, Veronica [535] Howard University; 202-806-9093; [email protected] Thomas, Yelena [569-766-889] Ministry of Research Science and Technology; +6449172842; [email protected] Thompson, Bob [607] United States Environmental Protection Agency; 919-541-1904; [email protected] Thompson, Winifred W [541] Emory University; 404-778-1349; [email protected] Thomson, Joan [898] Pennsylvania State University; [email protected] Thurston, Linda [220-289-495-821-897] National Science Foundation; 703-292-4612; [email protected] Tibbetts, Katherine A [111-211-242-372-654] Kamehameha Schools; 808-285-4822; [email protected] Tikoo, Minakshi [889] University of Connecticut; 860-679-5559; [email protected] Tilney, Kate [104] Hope Community Inc; 651-271-8696; [email protected] Tilson, Wilma [113] United States Department of Health and Human Services; 202-205-8841; [email protected] Timko, Gary [137] Community Research Partners; 614-449-8479; [email protected] Tinworth, Katheen [258] Denver Museum of Nature & Science; 303-370-6136; [email protected] Tinworth, Kathleen [137-258] Denver Museum of Nature & Science; 303-370-6136; [email protected] Tisdal, Carey [137-258] Tisdal Consulting; 314-496-9097; [email protected] Titcomb, Allison [893] ALTA Consulting; 520-904-1058; [email protected] Togashi, Shigeko [890] National Institute of Advanced Industrial Science and Technology; +81 29 862 6069; [email protected] Tolley, Leigh M [611] Syracuse University; 315-443-3703; [email protected] Toms, Kathleen [582] Research Works Inc; 845-337-3806; [email protected] Ton, Giel [543] LEI Wageningen UR; +31-317-450347; [email protected] Torkel, Steven [137] Pricewaterhouse Coopers LLP; 973-236-4253; [email protected] Tornberg, Robert [593-693] University of Minnesota; 781-858-5503; [email protected] Torres, Luis R [331] University of Houston; 713-743-8512; [email protected] Torres, Raquel [137] National School of Public Health (ENSP/Fiocruz); [email protected] Torres, Rosalie [385] Torres Consulting Group; 510-681-6567; [email protected] Toure, Itihari [211] The Jegna Collective; [email protected] Towns, Natalie [137] Georgia State University; 404-413-0287; [email protected] Townsend, John [641] Population Council; 202-237-9400; [email protected] Townsend, Julie [717] Centers for Disease Control and Prevention; 770-488-3012; [email protected] Townsend, Lisa [534] University of New Hampshire; 603-862-1031; [email protected] Townsend, Shannon [268] National Research Council Canada; 613-993-1027; [email protected] Townson, Lisa [434] University of New Hampshire; 603-862-1031; [email protected] Trahan, Keith [223-305-515] University of Pittsburgh; 412-624-7240; [email protected] Tran, Rosanna [684] California HealthCare Foundation; 510-587-3130; [email protected] Treiber, Jeanette [880] University of California, Davis; 530-752-9966; [email protected] Trenholm, Christopher [611] Mathematica Policy Research; 609-936-2796; [email protected] Trent, Tererai [137-897] Western Michigan University; 760-356-2599; [email protected] Trevisan, Mike [525] Washington State University; 509-335-4251; [email protected] Tripathi, Sue [104-207] Making Connections, Denver; 303-561-2227; [email protected] Triscari, Robert [137] Florida Gulf Coast University; 239-590-7202; [email protected] Trochim, William M [133-250-283-381-589-770-864-902] Cornell University; 607-255-0887; [email protected] Trotter, Jennie [137] Wholistic Stress Control Institute Inc; 404-755-0068 x3007; [email protected] Truebridge, Sara [592] WestEd; 510-302-4268; [email protected] Trumpet, Jane-Van [137] University of South Florida; 813-562-6555; [email protected] Tseng, Han-yun [622] Washington State University; [email protected] Tseng, Shu-Hui [137] National Taipei University of Technology; +886-2-27712171 x4033; [email protected] Tucker, Susan [288-498-532-731-811] Evaluation & Development Associates; 415-385-8396; [email protected] Tucker Blackmon, Angelique [875] Innovative Learning Concepts LLC; 770-374-8373; [email protected] Tucker Brown, Aisha [409-618] Northrop Grumman Corporation; 678-777-8484; [email protected] Tung, Quoc Mai [641] Population Council; +844 3 7345821; [email protected] Tunik, Jonathan [220] Metis Associates; 212-425-8833 x107; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 210 Tunstall, Rebecca [399] Millennium Challenge Corporation; 202-521-3600; [email protected] Turay, Foday [132] African Development Bank; +0021671103257; [email protected] Turner, Nannette [243] Mercer University; 478-301-5649; [email protected] Tuttle, Christina [884] Mathematica Policy Research; 202-554-7570; [email protected] Tuttle, Christina Clark [884] Mathematica Policy Research; 202-554-7570; [email protected] Tutty, Michael [658] University of Massachusetts; 508-856-4350; [email protected] Tytel, Mallary [550-653] Healthy Workplaces; 860-874-7137; [email protected] Tzeng, Janice [717] RTI International; [email protected] UUUUUUUU Ueda, Kanji [890] National Institute of Advanced Industrial Science and Technology; +81 29 862 6069; [email protected] Uekawa, Kazuaki [137] ICF International; 703-225-2266; [email protected] Uhl, Gary [360] Centers for Disease Control and Prevention; 404-639-0950; [email protected] Unger, Zita [275-563-659] Evaluation Solutions Pty Ltd; +613 9863 7555; [email protected] Urban, Jennifer [381] Montclair State University; 973-655-6884; [email protected] Urdapilleta, Oswaldo [881] IMPAQ International; 443-539-1394; [email protected] Usinger, Janet [314-429-777] University of Nevada, Reno; 775-682-9083; [email protected] Ussery-Hall, Ann [321] National Association of Chronic Disease Directors; 404-378-8590; [email protected] Uyeki, Terry [242-284] Humboldt State University; 707-826-3404; [email protected] VVVVVVVV Valle, José [319] Consorcio por la Salud, Ambiente y Desarrollo, ECOSAD; + 51 1 4371300; [email protected] van der Woerd, Kim [252-320] Reciprocal Consulting; 604-731-3536; [email protected] Van Dyk, Pam [827-875] Evaluation Resources LLC; 919-839-1778; [email protected] Van Dyke, Ray [594] Virginia Tech; 540-231-6003; [email protected] Van Egeren, Laurie [543] Michigan State University; 517-355-0140; [email protected] Van Haneghan, James P [306-525] University of South Alabama; 251-380-2760; [email protected] van Leeuwen, Thed [531] University of Leiden; +31 71 527 3909; [email protected] van Raan, Anthony [531] University of Leiden; +31 71 527 3909; [email protected] VanDevanter, Nancy [744] New York University; 212-998-5328; [email protected] VanEgeren, Laurie [637] Michigan State University; 517-355-0140; [email protected] Vardiman, Phil [275] Abilene Christian University; 325-674-2153; [email protected] Varillas, Walter [319] Consorcio por la Salud, Ambiente y Desarrollo, ECOSAD; [email protected] Varnhagen, Stanley [356] University of Alberta; 780-492-3641; [email protected] Vaughn, Deloris [716] Innovation Network; 202-728-0727 x118; [email protected] Vedung, Evert [243] Uppsala University; +46 26 420 6511; [email protected] Vela, Clemencia [647] Independent Consultant; [email protected] Velasquez, Andrea [108] Brigham Young University; 801-310-6050; [email protected] Velazquez, Melissa [238] Christian Foundation for Children and Aging; 913-384-6500 x7329; [email protected] VeLure Roholt, Ross [536-756] University of Minnesota; 612-624-8785; [email protected] Ventura, Miriam [511] National School of Public Health (ENSP/Fiocruz); [email protected] Vicinanza, Nicole [856] JBS International Inc; 650-373-4952; [email protected] Villasenor, Elodia [592] University of California, San Francisco; 415-476-6594; [email protected] Visscher, Ron [430-556] Aquinas College; 616-510-8206; [email protected] Vo, Anne [233-389-894] University of California, Los Angeles; 510-282-5706; [email protected] Vocke, Karen [889] Western Michigan University; 269-330-2902; [email protected] Voelkle, Manuel [106] Max-Planck-Institute for Human Development Berlin; +49-30-82406-467; [email protected] Vogel, Amanda [137] National Institutes of Health; 301-435-5874; [email protected] Volkov, Boris [247-797-837] University of North Dakota; 701-777-6781; [email protected] Von Sychowski, Shirley [618] Heart and Stroke Foundation of Ontario; 416-489-7111 x339; [email protected] WWWWWWWW Waddington, Hugh [614] International Initiative for Impact Evaluation (3ie); +44-7779-261108; [email protected] Waggett, Jessica [619-699] Institute for Community Health; 617-499-6613; [email protected] Waggle, Joseph [609] University of Maryland; 301-405-6430; [email protected] Wagner, Caroline [271] Science-Metrix Corp; 703-785-2226; [email protected] Waid, Jillian [137] Washington University in St Louis; +88 01746274265; [email protected] Wakelee, Jessica [816] University of Arizona; 520-626-4706; [email protected] Walahoski, Jill [692] University of Nebraska, Lincoln; 402-472-1710; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 211 Wald, Lana [137-616-675] Washington University in St Louis; 314-935-3735; [email protected] Walker, Debbie [227] Abt Associates Inc; 617-349-2390; [email protected] Walker, Elaine [137-317] Seton Hall University; 609-208-9004; [email protected] Walker, Joe [137] Native American Training Institute; 701-255-6374; [email protected] Walker, Kate [733-853] University of Minnesota; 612-624-2116; [email protected] Walker, Michael [345] Educational Testing Service; 609-734-1897; [email protected] Walker, Tjip [858] United States Agency for International Development; 202-712-4842; stwalker @usaid.gov Walker, Uda [243] Gargani + Company; 510-291-4226; [email protected] Walker-Egea, Connie [668-799] University of South Florida; 787-604-9769; [email protected] Wall, Hilary [378] Centers for Disease Control and Prevention; 770-488-8172; [email protected] Wall, Melody [856] Defense Language Institute; 831-393-1508; [email protected] Wallace, Michael [224] Room to Read; 415-561-3331 x111; [email protected] Wallace, Tanner LeBaron [389] University of Pittsburgh; 412-624-6356; [email protected] Wallisch, Lynn [137] University of Texas, Austin; 512-232-0611; [email protected] Walrath-Greene, Christine [595] ICF Macro; 646-695-8154; [email protected] Walser, Tamara M [346-535] University of North Carolina at Wilmington; 910-962-4175; [email protected] Walsh, Michele [586] University of Arizona; 520-318-7259 x130; [email protected] Walters, Bonnie [595-850] University of Colorado, Denver; 303-315-4967; [email protected] Wandersman, Abraham [204-280-312-324-521-604-699-704-820] University of South Carolina; 803-777-7671; [email protected] Wang, Xin [804] Mid-continent Research for Education and Learning; 303-632-5644; [email protected] Wang, Yuanyuan [223-515] University of Pittsburgh; 412-624-7240; [email protected] Wang, Yue [886] Chinese Academy of Sciences; +13031058208; [email protected] Wang, Yushi [518] Savannah College of Art and Design; 405-269-6116; [email protected] Wang'ati, Maureen [712] Measure Africa; +254 722 714991; [email protected] Ward, Thomas [355-436-774] United States Army; 913-684-4408; [email protected] Warner, Lora [105-137-518-857] University of Wisconsin, Green Bay; 920-465-2404; [email protected] Warner, Lynn [116] State University of New York at Albany; 518-591-8734; [email protected] Wasilik, Oksana [120] University of Wyoming; 307-760-3110; [email protected] Wat, Toni [137] Texas State University; 512-245-3287; [email protected] Watanabe, Yukiko [255] University of Hawaii, Manoa; 808-358-4325; [email protected] Waterford, April [137] Lincoln University; 330-541-6502; [email protected] Watkins, Margaret [898] Centers for Disease Control and Prevention; 404-639-8306; [email protected] Watling Neal, Jennifer [630] Michigan State University; 517-353-5015; [email protected] Watson, Angela [554] Oklahoma State University; 918-855-9823; [email protected] Watson, Bill [877] Smithsonian's National Museum of Natural History; 202-633-1127; [email protected] Watson, Erin [630-710] Michigan State University; 517-353-5015; [email protected] Watson, Gabrielle [751] Oxfam America; 617-875-6391; [email protected] Watson, Kenneth [132] Rideau Consultants Ltd; 202-232-0454; [email protected] Watson, Yvonne [601-862] United States Environmental Protection Agency; 202-566-2239; [email protected] Watt, Toni [137] Texas State University; 512-245-3287; [email protected] Wauchope, Barbara [303] University of New Hampshire; 603-862-1235; [email protected] Waxman, Hersh [226-305] Texas A&M University; 979-862-1724; [email protected] Weeks, Peg [600] Institute for Community Research; 860-278-2044 x229; [email protected] Weeks, Peggie [670] Western Michigan University; 607-292-7003; [email protected] Wehipeihana, Nan [307-591-800] Research Evaluation Consultancy Limited; +64 21-686-766; [email protected] Weisblat, Gina [880] Cleveland State University; 216-780-2358; [email protected] Weitzman, Beth [273] New York University; 212-998-7446; [email protected] Welch, Eric [595] University of Illinois at Chicago; 312-413-2416; [email protected] Welsh, Myia [883] Innovation Network; 202-728-0727 x112; [email protected] Wendel, Monica [137] Texas A&M University; 979-458-0937; [email protected] Werb, Shari [877] Smithsonian's National Museum of Natural History; 202-633-1096; [email protected] Were, Valerie [127] University of Minnesota; 612-801-5875; [email protected] West Meiers, Maurya [735] World Bank; 202-473-8543; [email protected] Westine, Carl [137-670-889] Western Michigan University; 503-949-8316; [email protected] Weston, Christine [133] Johns Hopkins University; 443-287-8039; [email protected] Wharton, Tracy C [409] University of Michigan; 205-409-4424; [email protected] Wheat, Norma [392] Campbellsville University; 270-789-5169; [email protected] Wheaton, Nikki [798] University of Nebraska, Lincoln; [email protected] Whipple, Elizabeth [288] Research Works Inc; 518-869-9272; [email protected] White, David [401] Oregon State University; 541-548-6088; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 212 White, Howard [614] International Initiative for Impact Evaluation (3ie); [email protected] White, Jeffry [297-377] University of Louisiana, Lafayette; 337-482-1010; [email protected] White, Jianglan [578-809] Georgia Department of Community Health; 404-657-6602; [email protected] White, Kathleen [237] United States Government Accountability Office; 202-8512; [email protected] Whitmore, Bessa [242-711] Carleton University; 613-234-1547; [email protected] Whitney, Joye [832] Brown University; 401-274-9548; [email protected] Whitsett, Maria [278-388-695] Moak, Casey and Associates; 512-485-7878; [email protected] Whittinghill, Jonathan [551] California State University, Los Angeles; 323-343-5622; [email protected] Wholey, Joseph [312-388-727] University of Southern California; 703-524-3722; [email protected] Widmer, Karen [779] Independent Consultant; 707-815-2286; [email protected] Wighton, Lynne [896] Vanderbilt University; 615-364-2406; [email protected] Wijesinha Rose, Shyanika [279] Battelle Memorial Institute; 919-544-3717; [email protected] Wikoff, Martin [754] Krueger International; [email protected] Wilce, Maureen [631-720] Centers for Disease Control and Prevention; 770-488-3721; [email protected] Wiley, Caroline [680] University of Arizona; 520-621-7828; [email protected] Wilhelm, Mari [744] University of Arizona; 520-621-3902; [email protected] Wilkerson, Stephanie [290] Magnolia Consulting LLC; 434-984-5540; [email protected] Wilkey, Sarah [793] Oklahoma State University; 405-744-6539; [email protected] Wilkinson-Lee, Ada [744] University of Arizona; 520-626-4433; [email protected] Will, Kelli [137] Eastern Virginia Medical School; 757-668-6449; [email protected] Willard, Alice [359] International Relief & Development; 703-533-3126; [email protected] Willems, Gwen [394] University of Minnesota; 651-646-8854; [email protected] Williams, Ashanta [237] United States Government Accountability Office; 202-512-5110; [email protected] Williams, Benita [557] Feedback Research & Analytics; +278 27729709; [email protected] Williams, Bob [583-663] Independent Consultant; +64 4 586 2790; [email protected] Williams, David D [108-752-793] Brigham Young University; 801-422-2765; [email protected] Williams, Duane E [137] Discovery Logic; 240-912-1932; [email protected] Williams, Jennifer [392-511] University of Cincinnati; 513-312-2341; [email protected] Williams, Julia [515] University of Minnesota, Duluth; 218-940-7317; [email protected] Williams, Katherine [641] Population Council; 202-237-9409; [email protected] Williams, Keith [790] Building Services and Consultant LLC; 414-431-2147; [email protected] Williams, Melissa [137] University of North Carolina at Greensboro; 336-315-7415; [email protected] Williams, Sean [137] Clemson University; 864-656-2179; [email protected] Williams, Valerie [502] The Globe Program; [email protected] Williams Kaye, Jacqueline [266-413-665] Atlantic Philanthropies; 212-916-7300; [email protected] Williams-Forson, Psyche [200-322] University of Maryland; [email protected] Willis, Anne [219] Wright State University; 937-775-2886; [email protected] Wilson, Bincy [209] State University of New York at Buffalo; 716-418-5797; [email protected] Wilson, Dawn [137-820] University of South Carolina; 803-777-8032; [email protected] Wilson, Heather [597] Centerstone Research Institute; 615-460-4493; [email protected] Wilson, Kathryn [750-872] Western Michigan University; 517-543-6801; [email protected] Wilson, Mary Martha [312] Healthy Teen Network; 772-219-7566; [email protected] Wilson, Maureen [711] University of Calgary; 403-486-4585; [email protected] Wilson, Tasha-Neisha [137] University of South Florida; 813-974-3014; [email protected] Wilson-Grau, Ricardo [319] Ricardo Wilson-Grau Consulting; +55 21 2284 6889; [email protected] Wind, Tricia [319-690] International Development Research Centre; 613-696-2480; [email protected] Wingate, Lori [117-137-282-670] Western Michigan University; 269-387-5895; [email protected] Winges, Linda [137-279-540-779] Battelle Memorial Institute; 206-528-3151; [email protected] Winston, Donna [214] WestEd; 510-302-4273; [email protected] Wischnowski, Michael [788] St John Fisher College; 585-385-5265; [email protected] Wise, Jean-Marc [115] Florida State University; 850-644-3541; [email protected] Wittmann, Werner [106] University of Mannheim; +0049 621 181 3128; [email protected] Wituk, Scott [137] Wichita State University; 316-978-3327; [email protected] Wolfe, Susan M [305-779-870] Susan Wolfe and Associates LLC; 682-472-1161; [email protected] Wolfgramm, Tania [791] Pou Kapua Consulting; +6421-201-7229; [email protected] Wolowiec-Fisher, Kim [137] University of Illinois at Urbana-Champaign; 847-733-8178; [email protected] Wong, Cindy [618] Bradeis University; 831-708-2741; [email protected] Wong, Faye [776] Centers for Disease Control and Prevention; [email protected] Woo, Annie [137] Education Northwest; 503-617-1848; [email protected] Wood, Andrea [811] Western Michigan University; 616-304-7820; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 213 Wood, Diana [137] Tennessee Technological University; [email protected] Wood, Richard [380] Pima Prevention Partnership; 520-260-5598; [email protected] Woodard, Audra [137] Wholistic Stress Control Institute Inc; 404-755-0069; [email protected] Woodard, Thelma [248-398-593] University of Tennessee, Knoxville; 865-247-5827; [email protected] Woodland, Rebecca [301-565-757] University of Massachusetts, Amherst; 413-545-1751; [email protected] Woody, Jennifer [107] North Carolina Department of Health; 919-707-5428; [email protected] Worley, Trish [373] University of Wyoming; 307-760-6009; [email protected] Wright, Annie [280-699] University of South Carolina; 803-397-7290; [email protected] Wright, David [629-801] Abilene Christian University; 325-674-2790; [email protected] Wright, Kevin [137] National Institutes of Health; 301-402-3574; [email protected] Wu, Gang [137] Shanghai Normal University; +86 2164321005; [email protected] XXXXXXXX Xiao, Xiaoxi [254] Chinese Academy of Sciences; [email protected] Xiong, Guoxiang [886] Chinese Academy of Sciences; +68 97333; [email protected] Xiong, Sharon [320-627] Battelle Memorial Institute; 703-875-2987; [email protected] Xue, Yuanjing [137] University of Minnesota; 612-209-7852; [email protected] Yaacov, Michal [137] Branco Weiss Institute; +972 52 6540321; [email protected] YYYYYYYY Yale, Melissa [137] Purdue University; 574-514-8808; [email protected] Yam, Kai Chi [137] Washington State University; 509-335-2923; [email protected] Yamashita, Mika [390-497-533-616] Academy for Educational Development; 202-464-3825; [email protected] Yamnitzky, Gail [223] University of Pittsburgh; 412-624-7240; [email protected] Yang, Evelyn [630] Community Anti-Drug Coalitions of America; 703-706-0560 x243; [email protected] Yanovsky, Boris [237-695-829] United States Department of Veterans Affairs; 513-247-4292; [email protected] Yanowitz, Karen L [875] Arkansas State University; 870-972-3064; [email protected] Yap, Ching Ching [418-518-598-702] Savannah College of Art and Design; 912-525-5848; [email protected] Yarbrough, Charyl Staci [848] Rutgers University; 732-932-4100 x6211; [email protected] Yarbrough, Donald [133-282-362] University of Iowa; 319-335-5567; [email protected] Yasuda, Susumu [890] National Institute of Advanced Industrial Science and Technology; +81 29 862 6069; [email protected] Yates, Brian [556-805] American University; 301-755-1892; [email protected] Yee, Sue Lin [807] Centers for Disease Control and Prevention; 770-488-3941; [email protected] Yegian, Jill [304] California HealthCare Foundation; 613-327-7483; [email protected] Yetter, Scott [541] CHF International; [email protected] Yi, Chan Goo [886] Pukyong National University; +82 10 2577 3434; [email protected] Yi Zang, 'Leaf' [525] Iowa State University; 515-294-3817; [email protected] Yoder, Brian [277] National Aeronautics and Space Administration; 202-358-7338; [email protected] Yoder, Edgar [898] Pennsylvania State University; [email protected] Yoo, Seung Jun [810] Korea Institute of Science & Technology Evaluation and Planning (KISTEP); +82-2-589-2861; [email protected] Yopp, David [804] Montana State University; 877-572-5032; [email protected] York, Susan [707] University of Hawaii; 808-956-7900; [email protected] York, Valerie [116-831] Kansas State University; 785-532-5930; [email protected] Yost, Jan [604] Health Foundation of Central Massachusetts; 508-438-0009; [email protected] Young, Jennifer [225] South Carolina Department of Education; 803-608-1834; [email protected] Youtie, Jan [531] Georgie Institute of Technology; 404-894-6111; [email protected] Yu, Chien [613] National Taiwan Normal University; +886 2 8211 1897; [email protected] Yu, Hanh Cao [505] Social Policy Research Associates; [email protected] Yu, Ping [320-627] Battelle Memorial Institute; 703-875-2981; [email protected] Yu, Shiuh-Sheng [375] National Chi Nan University; +886 49 2911 242; [email protected] Yuan, Wenhui [305] Fort Worth Independent School District; 269-267-3039; [email protected] Yuen, JoAnn [213] University of Hawaii, Manoa; 808-956-5462; [email protected] Yung, Betty [508] Wright State University; 937-775-4327; [email protected] Zahniser, S Christine [312] Global Evaluation and Applied Research Solutions Inc; 770-488-6304; [email protected] ZZZZZZZZ Zakocs, Ronda [212] Independent Consultant; 503-719-4140; [email protected] Zandniapour, Lily [883] Innovation Network; 202-728-0727 x117; [email protected] Zannini Bull, Karen [137] Syracuse University; 315-708-7504; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 214 Zaro, Susan [776] ICF Macro International; [email protected] Zatsman, Igor [766] Russian Academy of Sciences; +7 499 129 1951; [email protected] Zavala, Maria Elena [342] California State University, Northridge; 818-677-3342; [email protected] Zaveri, Heather [307] Mathematica Policy Research; 202-264-3441; [email protected] Zayas, Luis H [331] Washington University in St Louis; 314-935-9448; [email protected] Zeitler, Leslie [379] California Social Work Education Center; 510-642-9272; [email protected] Zeldin, Shep [401] University of Wisconsin, Madison; 608-263-2383; [email protected] Zeleke, Michael [397] American Red Cross; 202-303-5037; [email protected] Zelermyer, Karen [891] Funders for LGBTQ Issues; 212-475-2930 x13; [email protected] Zerounian, Patricia [684] Monterey County Health Department; 831-755-4583; [email protected] Zhang, Jie [852] Syracuse University; 315-382-7695; [email protected] Zhang, Lei [867] Centers for Disease Control and Prevention; 770-488-1144; [email protected] Zhang, Xiaofang [804] University of South Carolina; 803-553-7715; [email protected] Zhao, Jia [698] Nemours Health and Prevention Services; 302-444-9100; [email protected] Zhao, Jing [137-672] The Ohio State University; 614-707-3410; [email protected] Zheng, Haijun [513] Chinese Academy of Sciences; +86 1062550587; [email protected] Zheng, Xiaohui [566] Empirical Educaiton Inc; 650-328-1734 x155; [email protected] Zheng, Yonghe [886] National Nature Science Foundation of China; +139 10381789; [email protected] Zhou, Changhai [254] Chinese Academy of Sciences; [email protected] Zhou, Jianzhong [886] Chinese Academy of Sciences; +158 10786699; [email protected] Zhou, Mei [841] Georgia State University; 404-413-0314; [email protected] Zhu, Jing [220] Metis Associates; 212-425-8833 x181; [email protected] Zhu, Min [286-518-804] University of South Carolina; 803-777-3459; [email protected] Ziebarth, Steven [315] Western Michigan University; 269-387-4534; [email protected] Zimmer, Jeanne [693] University of Minnesota; 651-292-1424; [email protected] Zimmerman, Stella SiWan [798] Action Consulting and Evaluation Team (ACET) Inc; 952-922-1811; [email protected] Ziner, Andrew Scott [695] Atlantic Social Research Corporation; 610-573-6400; [email protected] Zito, Mark [565] East Hartford Public School District; 860-622-5010; [email protected] Zorn, Debbie [757] University of Cincinnati; 513-556-3818; [email protected] Zuckerman, Brian [137-271-431-689] Science and Technology Policy Institute; 202-419-5485; [email protected] Zuercher, Nancy [113-524] JVA Consulting LLC; 303-477-4896; [email protected] Zukoski, Ann [225] Rainbow Research Inc; 612-824-0724 x207; [email protected] Zurn-Birkhimer, Suzanne M [137] Purdue University; 765-494-9335; [email protected] Zuschlag, Michael [235] Volpe National Transportation Systems Center; 617-494-3250; [email protected] Zvoch, Keith [380-626] University of Oregon; 541-346-1401; [email protected] Zvonikov, Victor [375] State University of Management; [email protected] Evaluation 2010: Appendix A – Index of Presenters and Contributors Page 215 Appendix B: Directory of Sessions by Sponsor Index of Sessions for the Presidential Strand # Time Session Type Session Title Room Name 100 Wed, 3:15 PM to 4:15 PM Plenary Tensions Among Evaluative Perspectives in the Age of Obama: Influences on Evaluation Quality, Thinking and Values Texas A 102 Wed, 4:30 PM to 6:00 PM Panel Improving the Quality of Evaluation Practice by Attending to Context Lone Star A 200 Thu, 8:00 AM to 8:45 AM Plenary Interdisciplinary Perspectives on Evaluation Quality Texas A 202 Thu, 9:15 AM to 10:45 AM Panel Rigor at Stake: Quality Evaluation of Change and Impact in a Complex World Lone Star A 242 Thu, 10:55 AM to 12:25 PM Think Tank Cultural Competency in Evaluation: Discussion of the American Evaluation Association's Public Statement on the Importance… Lone Star A 282 Thu, 1:40 PM to 3:10 PM Panel The Role of Metaevaluation in Promoting Evaluation Quality: National and International Cases Lone Star A 322 Thu, 3:35 PM to 4:20 PM Panel Truth, Beauty, and Justice: A Conversation With Plenary Speakers Lone Star A 362 Thu, 4:30 PM to 6:00 PM Skill-building Using the Program Evaluation Standards, Third Edition, to Define and Enhance Evaluation Quality Lone Star A 500 Fri, 8:00 AM to 8:45 AM Plenary Evaluation Quality: The Good, the Bad, the Beautiful, and the Ugly Texas A 502 Fri, 9:15 AM to 10:45 AM Panel Equity and Quality in Evaluation: Ideas and Illustrations From the Field Lone Star A 542 Fri, 10:55 AM to 11:40 AM Expert Lecture President Obama's Evaluation Policies Lone Star A 582 Fri, 1:40 PM to 3:10 PM Think Tank In the Multi-level Systemic Evaluation Universe, Whose Responsibility is Quality? A Discussion Among Respected Colleagues Lone Star A 622 Fri, 3:35 PM to 4:20 PM Think Tank Exploring the Intersection of Beauty and Quality With the Student Travel Award Winners Lone Star A 662 Fri, 4:30 PM to 6:00 PM Panel Evaluation Anthropology Praxis Today: Building the Future Lone Star A 702 Sat, 8:00 AM to 9:30 AM Panel Design Thinking: The Art of Evaluation Lone Star A 742 Sat, 10:00 AM to 10:45 AM Panel Improving Evaluation Quality by Improving Program Quality: A Theory-based/Theory-driven Perspective Lone Star A 782 Sat, 10:55 AM to 12:25 PM Panel Mixed Methods Contributions to Evaluation Quality Lone Star A 822 Sat, 1:45 PM to 2:30 PM Expert Lecture A Conversation With Ernest House Lone Star A 862 Sat, 2:50 PM to 4:20 PM Panel Tools for Improving the Quality of Evaluations: Four Examples From the Field Lone Star A Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 216 Index of Sessions for the Advocacy and Policy Change TIG # Time Session Type Session Title Room Name 112 212 253 Wed, 4:30 PM to 6:00 PM Thu, 9:15 AM to 10:45 AM Thu, 10:55 AM to 12:25 PM MultiPaper Multipaper Roundtable Bowie C Bowie C Goliad 292 332 413 513 Thu, 1:40 PM to 3:10 PM Thu, 3:35 PM to 4:20 PM Thu, 6:10 PM to 7:00 PM Fri, 9:15 AM to 10:45 AM Think Tank Panel Business Meeting Roundtable 552 592 711 751 831 849 Fri, 10:55 AM to 11:40 AM Fri, 1:40 PM to 3:10 PM Sat, 8:00 AM to 9:30 AM Sat, 10:00 AM to 10:45 AM Sat, 1:45 PM to 2:30 PM Sat, 1:45 PM to 2:30 PM Panel Multipaper Multipaper Panel Multipaper Expert Lecture Understanding, Building, and Evaluating Advocacy Capacity Maintaining Quality in Challenging Contexts Rotation I: Theory of Change Evaluation in the Real World: Lessons Learned from Applying (and Modifying) the TOC Approach… Rotation II: Evaluating Foundation Advocacy Strategies: When Theory and Practice Collide Who Are Champions, What Are Their Impact and How Do You Know? Considerations for Advocates, Funders, and Evaluators Advocacy Capacity Nuance: Helpful, or Too Much? Considering the Cases of Assessing Coalitions Versus Networks and Grassroots… Advocacy and Policy Change TIG Business Meeting Rotation I: Big Money, More Scrutiny: How to Forge Evaluator-Early Childhood Education Program Partnerships… Rotation II: A Study on the Indicator of High Quality Papers: The Case of Casualty Actuarial Society (CAS) How Does Evidence Influence Policy Change? Examining Two Complementary Approaches With Two Complementary Evaluations Health Matters: Evaluating Advocacy and Policy Change Where Theory Meets Practice in Assessing Advocacy and Policy Change Slow Down, You Move too Fast: Calibrating Evaluator Engagement to the Pace of Campaigners and Advocates when Developing… The Role of Evaluation in Informing Local and State Policy Makers Establishing a MEL System for Policy Reform: Lessons From Oxfam America‘s Advocacy on More Country Ownership of US Foreign Aid Bowie C Bowie C Goliad Goliad Bowie C Bowie C Bowie C Bowie C Bowie C Texas C Index of Sessions for the Alcohol, Drug Abuse, and Mental Health TIG # Time Session Type Session Title Room Name 122 222 262 302 312 373 Wed, 4:30 PM to 6:00 PM Thu, 9:15 AM to 10:45 AM Thu, 10:55 AM to 12:25 PM Thu, 1:40 PM to 3:10 PM Thu, 1:40 PM to 3:10 PM Thu, 4:30 PM to 6:00 PM Skill-building Multipaper Multipaper Multipaper Panel Roundtable Presidio C Presidio C Presidio C Presidio C Texas E Goliad 522 562 602 642 682 721 761 801 841 881 Fri, 9:15 AM to 10:45 AM Fri, 10:55 AM to 11:40 AM Fri, 1:40 PM to 3:10 PM Fri, 3:35 PM to 4:20 PM Fri, 4:30 PM to 6:00 PM Sat, 8:00 AM to 9:30 AM Sat, 10:00 AM to 10:45 AM Sat, 10:55 AM to 12:25 PM Sat, 1:45 PM to 2:30 PM Sat, 2:50 PM to 4:20 PM Multipaper Business Meeting Panel Demonstration Panel Panel MultiPaper Multipaper Multipaper MultiPaper Integrating Realist Evaluation Strategies in a SAMHSA System of Care Local Evaluation Evaluation of Youth Mental Health and Substance Abuse Interventions Analytic and Measurement Approaches in Substance Abuse and Mental Health Evaluation Outcome Assessment in Substance Abuse and Mental Health The Cycle of Evidence-based Policy and Practice: Synthesis, Translation, and Evaluation Capacity Building Rotation I: Designing for Change: The Experience of the Quitline Iowa Evaluation Rotation II: Adapting the Strategic Prevention Framework Model for Use in Suicide Prevention and Other Abbreviated Funding Cycles… Evaluating National Substance Abuse Prevention Programs Alcohol, Drug Abuse and Mental Health TIG Business Meeting Assessing Implementation Fidelity of Substance Abuse Prevention Environmental Change Strategies: Lessons Learned From… Building a Flexible, Web-based Analysis Tool to Examine Person Level Changes Over Time in a Mental Health Outcomes… National Evaluation of the Addiction Technology Transfer Center Network (ATTC): Findings and Observations From a Contextually Rich… Taking Stock of the Quality of Evaluation Research on School-Based Prevention Programs Evaluation Capacity in School Mental Health: Lessons From School Counseling Use of Administrative Data for Management and Policy Making Evaluating Mental Health Peer Support and Peer Specialist Programs Evaluating a National Medicaid Children's Mental Health Demonstration Grant Program Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Presidio C Presidio C Presidio C Presidio C Presidio C Presidio C Presidio C Presidio C Presidio C Presidio C Page 217 Index of Sessions for the Assessment in Higher Education TIG # Time Session Type Session Title 115 255 335 375 415 515 594 Wed, 4:30 PM to 6:00 PM Thu, 10:55 AM to 12:25 PM Thu, 3:35 PM to 4:20 PM Thu, 4:30 PM to 6:00 PM Thu, 6:10 PM to 7:00 PM Fri, 9:15 AM to 10:45 AM Fri, 1:40 PM to 3:10 PM Multipaper Multipaper Panel Multipaper Business Meeting Multipaper Roundtable 635 674 Fri, 3:35 PM to 4:20 PM Fri, 4:30 PM to 6:00 PM Expert Lecture Roundtable 714 754 758 833 834 848 860 874 Sat, 8:00 AM to 9:30 AM Sat, 10:00 AM to 10:45 AM Sat, 10:00 AM to 10:45 AM Sat, 1:45 PM to 2:30 PM Sat, 1:45 PM to 2:30 PM Sat, 1:45 PM to 2:30 PM Sat, 1:45 PM to 2:30 PM Sat, 2:50 PM to 4:20 PM Skill-building Multipaper Multipaper Roundtable Demonstration Multipaper MultiPaper Multipaper Assessing Student Learning Outcomes I: Incorporating Feeback Travis A Assessing Student Learning Outcomes II: Three Sides of the Coin Travis A Using Business Frameworks to Evaluate Program Impact on Student Learning Travis A Evaluation Without Borders: Lessons From Other Countries Travis A Assessment in Higher Education TIG Business Meeting Travis A Beyond the Classroom: Assessment in Non-Traditional Settings Travis A Rotation I: Conceptualizing the Quality of Assessment San Jacinto Rotation II: Perspectives on Collaboration in Practice: Expanding the Role and Culture of Assessment in Academic Affairs and Student… Compared to What? Reconsidering Assessment in Higher Education Travis A Rotation I: Accreditation as a Pathway to Build Community and Generate Renewal San Jacinto Rotation II: Using Evaluation to Help Transform Departments in the Challenging Economic Environment of Higher Education Leading Change Through Assessment Travis A The Impact of Exogenous Factors in Classroom Evaluation Travis A Evaluation in Medical Education Independence Toward Improving the Evaluation Practice of Financial Education Programs: Key Issues and the Role of Formative Evaluation San Jacinto Thinking About Thinking: Assessing Critical Thinking Instruction in Higher Education Travis A Evaluation in Community Colleges Texas B Let Quality Guide Evaluation Quality: Recent Trends Implemented in the Middle East Republic C The Importance of Critical Thinking in Assessment in Higher Education Travis A Room Name Index of Sessions for the Business and Industry TIG # Time Session Type Session Title Room Name 235 275 355 395 436 563 573 607 613 653 659 774 846 854 Thu, 9:15 AM to 10:45 AM Thu, 10:55 AM to 12:25 PM Thu, 3:35 PM to 4:20 PM Thu, 4:30 PM to 6:00 PM Thu, 6:10 PM to 7:00 PM Fri, 10:55 AM to 11:40 AM Fri, 10:55 AM to 11:40 AM Fri, 1:40 PM to 3:10 PM Fri, 1:40 PM to 3:10 PM Fri, 3:35 PM to 4:20 PM Fri, 3:35 PM to 4:20 PM Sat, 10:00 AM to 10:45 AM Sat, 1:45 PM to 2:30 PM Sat, 1:45 PM to 2:30 PM Panel Multipaper Multipaper Demonstration Business Meeting Roundtable Demonstration Multipaper Multipaper Expert Lecture Multipaper Think Tank Multipaper Expert Lecture Evaluation Utilization and the Story of the Federal Railroad Administration‘s 10 Year Research and Development Effort to Change… Evaluating Leadership Development in Organizations Behavioral and Systematic Causal Influences in Health and Safety Process Lessons for Applied Research and Evaluation from Capital Projects Business and Industry TIG Business Meeting Assessing Board Performance: Challenges and Constraints How to Use Evaluation to Achieve Human Resources (HR) System Alignment Key Issues in Evaluating Industrial and Commercial Energy Efficiency Programs and Technologies Evaluating Effectiveness in Recruitment, Mentoring, and Human Resources' Functions Small Business Sustainability: A Systems Approach to Triple Bottom Line Success Risk and Tension in Private Sector Development Project Evaluation Leading the Horse to Water, Part II: Winning the Front-end Needs Assessment Tug-of-War in a Knowledge Management Program… Challenges and Recommendations From Evaluating Autobody Shop Environmental Compliance Programs The Thinking Corporation Crockett B Crockett B Crockett B Crockett B Crockett C Bonham A Crockett B Bonham E Crockett B Crockett B Republic C Crockett B Bonham E Crockett B Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 218 Index of Sessions for the Cluster, Multi-site and Multi-level Evaluation TIG # Time Session Type Session Title Room Name 107 Wed, 4:30 PM to 6:00 PM MultiPaper Balancing Autonomy and Uniformity in a Multi-site Evaluation: Evaluation of Program Integration Efforts at the CDC Lone Star F 207 Thu, 9:15 AM to 10:45 AM Panel Serving Two Masters: Local Evaluators Trying to Maintain Evaluation Quality and Use While Participating in a National Multi-site… Lone Star F 288 Thu, 1:40 PM to 3:10 PM Roundtable Rotation I: Evaluating Twenty First Century Community Learning Centers: Reconciling Evaluation Needs and Constraints at Multiple… Rotation II: Simplifying the Complex: Creating Transparent Evaluation in Multi-institutional Education Partnerships Mission A 327 Thu, 3:35 PM to 4:20 PM Panel Evaluating a Multi-site Twenty First Century Learning Program: Strategies and Results Lone Star F 367 Thu, 4:30 PM to 6:00 PM Business Meeting TIG Business Meeting and Demonstration: A Mixed Methods Approach to Measurement for Multi-site Evaluation Lone Star F 547 Fri, 10:55 AM to 11:40 AM Multipaper Multi-method Approaches Lone Star F 582 Fri, 1:40 PM to 3:10 PM Think Tank In the Multi-level Systemic Evaluation Universe, Whose Responsibility is Quality? A Discussion Among Respected Colleagues Lone Star A 627 Fri, 3:35 PM to 4:20 PM Multipaper Exemplars of School Evaluations Lone Star F 667 Fri, 4:30 PM to 6:00 PM Skill-building Evaluation 201: Evaluation Skills Needed After Coursework Lone Star F 707 Sat, 8:00 AM to 9:30 AM Panel The Process of Evaluating Supporting Partnerships to Assure Ready Kids (SPARK) and Ready Kids Follow-Up (RKF): Embracing… Lone Star F 747 Sat, 10:00 AM to 10:45 AM Panel Partner Roles in a Multi-site Evaluation: The Viewpoints and Experiences of the Cross-site Evaluator and the State Program Coordinator Lone Star F 787 Sat, 10:55 AM to 12:25 PM Panel Extended Learning: A Conversation Among Evaluators of the National Science Foundation (NSF) Extension Services Projects 827 Sat, 1:45 PM to 2:30 PM Multipaper Linking With Outcomes Lone Star F 867 Sat, 2:50 PM to 4:20 PM Panel Meeting Needs of Multiple Stakeholders in a High-Scrutiny Multi-site Evaluation: Evaluation of the CPPW Initiative Lone Star F Lone Star F Index of Sessions for the Collaborative, Participatory & Empowerment Evaluation TIG # Time Session Type Session Title Room Name 104 Wed, 4:30 PM to 6:00 PM Panel Building a Learning Culture Within Community Initiatives and Organizations Lone Star C 134 Wed, 4:30 PM to 6:00 PM Skill-building Round Robin Focus Groups: Participatory Inquiry - From Data Gathering to Reporting in an Hour Republic C 204 Thu, 9:15 AM to 10:45 AM MultiPaper The Essential Features of Collaborative, Participatory, and Empowerment Evaluation Lone Star C 227 Thu, 9:15 AM to 10:45 AM Panel Enhancing the Quality of Evaluation Through Collaboration Among Funders, Programs, and Evaluators: The Example of the NYC Health… Bonham E 240 Thu, 9:15 AM to 10:45 AM Demonstration Using a Practical Lens to Develop National-Level Participatory Projects Republic C 244 Thu, 10:55 AM to 12:25 PM Think Tank What We Don‘t Say Can Hurt Us: Working with Undiscussables Lone Star C 280 Thu, 10:55 AM to 12:25 PM MultiPaper A Checklist for Planning, Implementing and Evaluating Implementation Quality Republic C 284 Thu, 1:40 PM to 3:10 PM Think Tank I See What You Mean: Applications of Visual Methods in Evaluation Lone Star C 321 Thu, 1:40 PM to 3:10 PM Panel Five Partners, One Evaluation: A Cohesive Evaluation of the ACHIEVE Healthy Communities Initiative Republic C 324 Thu, 3:35 PM to 4:20 PM Think Tank Exploring the Multiple Roles of Collaborative, Participatory, and Empowerment Evaluators Lone Star C 364 Thu, 4:30 PM to 6:00 PM Skill-building The Biggest Winners: Empowerment Evaluation Exercises to Strengthen Primary Prevention Capacity Lone Star C Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 219 Index of Sessions for the Collaborative, Participatory & Empowerment Evaluation TIG continued # Time Session Type Session Title Room Name 383 Thu, 4:30 PM to 6:00 PM Roundtable Rotation I: Evaluation Goes to College: The Collaborative Evaluation of a Graduate Program Rotation II: Working Together to Design Effective Evaluation Tools Bonham A 401 Thu, 4:30 PM to 6:00 PM Panel Building Capacity for Youth Participatory Evaluation Republic C 404 Thu, 6:10 PM to 7:00 PM Business Meeting Collaborative, Participatory, and Empowerment TIG Business Meeting Lone Star C 504 Fri, 9:15 AM to 10:45 AM Demonstration Youth Led Evaluation in Action: Stomping Out the Stigma of Mental Illness Lone Star C 541 Fri, 9:15 AM to 10:45 AM Multipaper Engaging Participants in the Evaluation Process: A Participatory Approach Republic C 544 Fri, 10:55 AM to 11:40 AM Think Tank Youth Participatory Evaluation: Entering the Age of the Internet Lone Star C 584 Fri, 1:40 PM to 3:10 PM Think Tank Youth Participatory Evaluation: Where Are We and Where Do We Go From Here? Lone Star C 603 Fri, 1:40 PM to 3:10 PM Roundtable Rotation I: Slipping and Sliding Like a Weasel on the Run: Empowerment Evaluation and the Hawthorne Effect Rotation II: Innovations in Youth Empowerment Evaluation Bonham A 619 Fri, 1:40 PM to 3:10 PM MultiPaper Preliminary Results of Prevention Capacity Building in Science-based Teen Pregnancy, HIV, and STI Prevention Republic C 624 Fri, 3:35 PM to 4:20 PM Expert Lecture Rights-based Evaluation and Active Citizenship in Development Contexts Lone Star C 664 Fri, 4:30 PM to 6:00 PM Demonstration The Evaluative Journey: Implementing Evaluation Activities That Faciliate Ongoing Decision Making Lone Star C 668 Fri, 4:30 PM to 6:00 PM Roundtable Rotation I: Examining Collaboration in an Evaluation of a Large Scale Civic Education Program Rotation II: Using Mixed Methods to Evaluate a School Based Civic Engagement Initiative Mission A 673 Fri, 4:30 PM to 6:00 PM Roundtable Rotation I: My First Year as an Internal Evaluator: What I Didn't Know That I Didn't Know Rotation II: Evaluator/ Practitioner Collaborations Goliad 695 Fri, 4:30 PM to 6:00 PM Multipaper Collaboration in Government-Sponsored Evaluations Crockett D 699 Fri, 4:30 PM to 6:00 PM Panel Technical Assistance in Action: How Does the Practice Look? Republic C 704 Sat, 8:00 AM to 9:30 AM MultiPaper Training in Evaluation: Formal and Informal Capacity Building Lone Star C 722 Sat, 8:00 AM to 9:30 AM Roundtable Bonham A 740 744 784 820 842 864 875 900 Sat, 8:00 AM to 9:30 AM Sat, 10:00 AM to 10:45 AM Sat, 10:55 AM to 12:25 PM Sat, 10:55 AM to 12:25 PM Sat, 1:45 PM to 2:30 PM Sat, 2:50 PM to 4:20 PM Sat, 2:50 PM to 4:20 PM Sat, 2:50 PM to 4:20 PM Multipaper Panel Skill-building Multipaper Roundtable Panel Think Tank Multipaper Rotation I: Wearing Different Hats: The Multiple Roles of an Evaluator Rotation II: Valuing Stakeholders: Collaborative Evaluation of Professional Development Needs Collaborative Evaluations: Successes, Challenges, and Lessons Learned REACH US Programs: Creating and Evaluating Community-based Coalitions Collaborative Evaluations Empowerment Evaluations: Insights, Reflections, and Implications Negotiating Multiple Challenges While Maintaining Quality: Lessons From Urban: Rural Alaska Advances in Stakeholder Consultation for Evaluation Quality Positionality Matters: Understanding Culture and Context From the Perspective of Key Stakeholders Strengthening Schools and Youth Through the Use of Evaluation: Issues and Perspectives Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Republic C Lone Star C Lone Star C Republic C Bonham A Lone Star C Travis B Republic C Page 220 Index of Sessions for the College Access Programs TIG # Time Session Type Session Title Room Name 342 Thu, 3:35 PM to 4:20 PM Multipaper Science, Technology, Engineering, and Mathematics (STEM) Recruitment Programs: Evaluation of Effectiveness Presidio C 424 Thu, 6:10 PM to 7:00 PM Business Meeting College Access Programs TIG Business Meeting Bonham B 533 Fri, 9:15 AM to 10:45 AM Panel The GEAR UP Experience: Exploring the Promise of Multi-site Evaluation Texas F 763 Sat, 10:00 AM to 10:45 AM Multipaper Control Groups and Cost Analysis: Innovative Approaches to College Access Program Evaluation Bonham B 843 Sat, 1:45 PM to 2:30 PM Multipaper Evaluation of Underrepresented Student College and Career Choice Programs Bonham B Index of Sessions for the Costs, Effectiveness, Benefits, and Economics TIG # Time Session Type Session Title Room Name 350 Thu, 3:35 PM to 4:20 PM Skill-building New Cost Tools for The Evaluator‘s Toolkit Texas C 430 Thu, 6:10 PM to 7:00 PM Business Meeting Costs, Effectiveness, Benefits, and Economics TIG Business Meeting Texas C 556 Fri, 10:55 AM to 11:40 AM Panel Using CPPOA Data to Improve Substance Abuse Prevention Programs and Portfolios Travis B 676 Fri, 4:30 PM to 6:00 PM Multipaper Methodological Considerations: Choosing an Appropriate Cost Analysis Methodology for the Evaluation Travis B 805 Sat, 10:55 AM to 12:25 PM Think Tank Quality Evaluation: Avoiding Hypocrisy by Formative Evaluation of Evaluation's Outcomes, Processes, and Costs Bonham D 885 Sat, 2:50 PM to 4:20 PM Multipaper Cost Studies in Health Care Bonham D Index of Sessions for the Crime and Justice TIG # Time Session Type Session Title Room Name 348 Thu, 3:35 PM to 4:20 PM MultiPaper Strategies for Evaluation Quality in Government Texas A 357 Thu, 3:35 PM to 4:20 PM Business Meeting Crime and Justice TIG Business Meeting and Paper Presentations Crockett D 672 Fri, 4:30 PM to 6:00 PM Multipaper Evaluations of Court and Corrections Programs Bowie C 828 Sat, 1:45 PM to 2:30 PM Multipaper Dealing With Evaluation Challenges and Complexities in Policing and Prison Environments Mission A Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 221 Index of Sessions for the Disabilities and Other Vulnerable Populations TIG # Time Session Type Session Title Room Name 249 Thu, 10:55 AM to 12:25 PM Panel Issues and Models: Evaluating Universal Design for Learning Mission B 289 Thu, 1:40 PM to 3:10 PM Panel Constructing Relevant Guidelines for Disability Program Evaluations Mission B 329 Thu, 3:35 PM to 4:20 PM Skill-building Quality Evaluation Includes Everyone! Using Universal Design to Make Your Evaluation More Accessible Mission B 368 Thu, 4:30 PM to 6:00 PM Roundtable Rotation I: Special Populations: Strategies for Collecting Data, Giving Voice Rotation II: Toward Universal Design for Evaluation: Continuing the Conversation Mission A 495 Fri, 7:00 AM to 7:50 AM Business Meeting TIG Business Meeting and Presentation: Disability-related Funding Opportunities at the NSF - What Evaluators Have to Offer Mission B 669 Fri, 4:30 PM to 6:00 PM MultiPaper Evaluating Community Capacity Building as a Prevention Strategy Mission B 749 Sat, 10:00 AM to 10:45 AM Multipaper Evaluation of Interventions and Assessments of Individuals With Disabilities Mission B 788 Sat, 10:55 AM to 12:25 PM Roundtable Preparing Teacher Candidates for Parent Partnerships: An Evaluation of a Preservice Course in Teacher Education Mission A 869 Sat, 2:50 PM to 4:20 PM MultiPaper Evaluating Special Education Personnel Development Initiatives in Three Predominately Rural States: Emphasis on Fidelity… Mission B Index of Sessions for the Disaster and Emergency Management Evaluation TIG # Time Session Type Session Title Room Name 334 Thu, 3:35 PM to 4:20 PM Roundtable Being on Target: Evaluation Techniques for Disaster Relief Agencies San Jacinto 397 Thu, 4:30 PM to 6:00 PM Panel Haiti: Challenges in Emergency Response and Recovery Bring Challenges (and Innovation) in Evaluation Crockett D 437 Thu, 6:10 PM to 7:00 PM Business Meeting TIG Business Meeting and Discussion – Lessons From the Tsunami Recover in the Indian Ocean and Earthquake Recover in Haiti Crockett D 816 Sat, 10:55 AM to 12:25 PM Multipaper Development and Selection of Frameworks and Constructs for Disaster Preparedness and Recovery Evaluation Crockett D 896 Sat, 2:50 PM to 4:20 PM Multipaper Impact Evaluation of Approaches to Affect Local Resiliency to Disasters, Enhanced Public Health Emergency Peer Networks and First… Crockett D Index of Sessions for the Distance Education and Other Educational Technologies TIG # Time Session Type Session Title Room Name 108 Wed, 4:30 PM to 6:00 PM Roundtable Rotation I: Using Technological Pedagogical Content Knowledge and an Evaluation Framework to Evaluate Online Courses and Tools Rotation II: REMOTE Messages: The Job Value of a Distance Learning Graduate Program for the Pacific Region Mission A 340 Thu, 3:35 PM to 4:20 PM Business Meeting Distance Education and Other Educational Technologies TIG Business Meeting Presidio A 560 Fri, 10:55 AM to 11:40 AM Multipaper Technology and Student Outcomes: Mathematics, Language Arts, and Big-District Diversity Presidio A 640 Fri, 3:35 PM to 4:20 PM Think Tank Digital Media and Learning for Youth: What Do They Know, When Do They Know It, How Do We Evaluate It? Presidio A 752 Sat, 10:00 AM to 10:45 AM Roundtable Increasing Access Through Openness? Evaluating Open Educational Resources (OER) in Himalayan Community Technology Centres Goliad 879 Sat, 2:50 PM to 4:20 PM Multipaper Online Learning in Adult and Postsecondary Education: Theory and Practice Presidio A Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 222 Index of Sessions for the Environmental Program Evaluation TIG # Time Session Type Session Title Room Name 127 Wed, 4:30 PM to 6:00 PM Multipaper Environmental and Energy Evaluations: Strategies for Pursuing Innovative Approaches That Demonstrate Impact, Promote… Bonham E 267 Thu, 10:55 AM to 12:25 PM Multipaper Environmental Education Evaluation: Examining Citizen Collected Data, Mixed Method Designs, and Professional Development Bonham E 281 Thu, 1:40 PM to 3:10 PM Demonstration San Antonio River Improvements Project: Field Trip to Ecosystem Restoration Sites Off Site Fieldtrip 347 Thu, 3:35 PM to 4:20 PM Demonstration Toolkit for Evaluating Impacts of Public Participation in Scientific Research Bonham E 427 Thu, 6:10 PM to 7:00 PM Business Meeting Environmental Program Evaluation TIG Business Meeting Bonham E 607 Fri, 1:40 PM to 3:10 PM Multipaper Key Issues in Evaluating Industrial and Commercial Energy Efficiency Programs and Technologies Bonham E 647 Fri, 3:35 PM to 4:20 PM Multipaper Improving the Quality of Habitat and Biodiversity Conservation Program Evaluations Using Methodological and Budgetary Techniques Bonham E 687 Fri, 4:30 PM to 6:00 PM Panel The Environmental Evaluators Network: Quality in an Era of Results-based Performance Bonham E 790 Sat, 10:55 AM to 12:25 PM MultiPaper The Home Energy Audit: An Exercise in Complex Systems Thinking for Practitioners and Evaluators Alike Bowie A 824 Sat, 1:45 PM to 2:30 PM Demonstration Estimating Climate Change and Its Use in Evaluation Lone Star C 846 Sat, 1:45 PM to 2:30 PM Multipaper Challenges and Recommendations From Evaluating Autobody Shop Environmental Compliance Programs Bonham E 862 Sat, 2:50 PM to 4:20 PM Panel Tools for Improving the Quality of Evaluations: Four Examples From the Field Lone Star A Index of Sessions for the Evaluating the Arts and Culture TIG # Time Session Type Session Title Room Name 218 Thu, 9:15 AM to 10:45 AM Multipaper Improving Evaluation Quality Through and In the Arts Travis D 258 Thu, 10:55 AM to 12:25 PM Panel Evaluation in Action: A Sampler of Tracking and Timing Methodologies in Museums, Culturals, and Informal Education Settings Travis D 374 Thu, 4:30 PM to 6:00 PM Roundtable Rotation I: The Beauty of Internal Evaluation in the Arts: Using Metaphors and Symbols to Develop the Evaluation Capacity… Rotation II: Evaluating Innovation and Capacity Building in Arts Organizations: Challenges and Lessons Learned in Capturing… San Jacinto 418 Thu, 6:10 PM to 7:00 PM Business Meeting Evaluating the Arts and Culture TIG Business Meeting Travis D 518 Fri, 9:15 AM to 10:45 AM Multipaper Ecologies of Collaboration in the Arts Travis D 598 Fri, 1:40 PM to 3:10 PM Multipaper Implication of Evaluation Approaches on Arts Organization Policies Travis D 634 Fri, 3:35 PM to 4:20 PM Roundtable The Evolution of Integrating Arts-based Inquiry in Evaluation San Jacinto 702 Sat, 8:00 AM to 9:30 AM Panel Design Thinking: The Art of Evaluation Lone Star A 877 Sat, 2:50 PM to 4:20 PM Multipaper Translating Visitors' Experiences Through Evaluation Travis D Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 223 Index of Sessions for the Evaluation Managers and Supervisors TIG # Time Session Type Session Title Room Name 216 Thu, 9:15 AM to 10:45 AM Demonstration Project Management Software: An Important Multi-Purpose Tool in an Evaluation Unit‘s Toolbox Travis B 376 Thu, 4:30 PM to 6:00 PM Business Meeting TIG Business Meeting and Panel: Reflections on Evaluation Management Expertise and Competencies From Two Perspectives Travis B 529 Fri, 9:15 AM to 10:45 AM Skill-building Taking Control of Your Evaluation Career Texas B 548 Fri, 10:55 AM to 11:40 AM Roundtable Controlling Quality Within Museums: Coordinating Internal Evaluation Departments Mission A 588 Fri, 1:40 PM to 3:10 PM Roundtable Rotation I: Directors of Research Ensuring Quality in Practice Rotation II: Managing Evaluation: Continuing the Conversation Mission A 808 Sat, 10:55 AM to 12:25 PM Demonstration Successfully Managing Evaluation Projects: Quality Solutions to Common Project Management Challenges Texas B Index of Sessions for the Evaluation Policy TIG # Time Session Type Session Title Room Name 253 Thu, 10:55 AM to 12:25 PM Roundtable Rotation I: Theory of Change Evaluation in the Real World: Lessons Learned from Applying (and Modifying) the TOC Approach… Rotation II: Evaluating Foundation Advocacy Strategies: When Theory and Practice Collide Goliad 313 Thu, 1:40 PM to 3:10 PM Think Tank Change is a Process, Not An Outcome: Implication for Evolving Federal Evaluation Policy Texas F 369 Thu, 4:30 PM to 6:00 PM Multipaper Historical Shifts in Evaluation Policy abnd Evaluation Practice: What We've Learned About Quality Evaluation Mission B 433 Thu, 6:10 PM to 7:00 PM Business Meeting TIG Business Meeting and Presentation: Evaluation Policy - Where Might We Want To Go, and How Might We Get There Texas F 509 Fri, 9:15 AM to 10:45 AM Panel How Evaluation Policies Affect Evaluation Quality in a Texas Public School District Mission B 542 Fri, 10:55 AM to 11:40 AM Expert Lecture President Obama's Evaluation Policies Lone Star A 589 Fri, 1:40 PM to 3:10 PM Multipaper Evaluation Management Policies: Examining Requirements of Quality Evaluation Mission B 651 Fri, 3:35 PM to 4:20 PM Expert Lecture Introduction to Evaluation and Public Policy Texas F 709 Sat, 8:00 AM to 9:30 AM Panel From Deliverables to Strategies: Experience of Implementing a National Evaluation Policy via Statewide Asthma Programs Mission B 772 Sat, 10:00 AM to 10:45 AM Expert Lecture Quality Evaluation: Drivers and Objectives of the Renewed Canadian Federal Policy on Evaluation Texas F 789 Sat, 10:55 AM to 12:25 PM Multipaper Cross-National Evaluation Policies: Where We've Been, Where We're Going, and What We Need for Quality Evaluation Mission B Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 224 Index of Sessions for the Evaluation Use TIG # Time Session Type Session Title Room Name 232 Thu, 9:15 AM to 10:45 AM Demonstration Why Evaluators Need Graphic Design Skills Texas E 272 Thu, 10:55 AM to 12:25 PM Panel Mainstreaming Evaluation in Diverse Organizational Contexts Texas E 312 Thu, 1:40 PM to 3:10 PM Panel The Cycle of Evidence-based Policy and Practice: Synthesis, Translation, and Evaluation Capacity Building Texas E 328 Thu, 3:35 PM to 4:20 PM Roundtable What Role Should the Evaluator Take When a Project Is Off-Track? Mission A 352 Thu, 3:35 PM to 4:20 PM Panel Evaluating Program Interventions in a Rapidly Changing World: Exploring the Potential of Mid-term Reviews, Real Time… Texas E 392 Thu, 4:30 PM to 6:00 PM Multipaper Case Studies in Evaluation Use Texas E 498 Fri, 7:00 AM to 7:50 AM Business Meeting Evaluation Use TIG Business Meeting and Presentation: Recapturing the "Golden Age" of Research on Evaluation Use Seguin B 532 Fri, 9:15 AM to 10:45 AM Multipaper Clients Speak Out About Evaluation Texas E 570 Fri, 10:55 AM to 11:40 AM Panel Joint Evaluation of Private Sector Development Projects: Benefits and Challenges Texas E 610 Fri, 1:40 PM to 3:10 PM Think Tank Taking a Good, Long Look In the Mirror: How Can We Hold Ourselves Accountable for Quality Recommendations? Texas E 650 Fri, 3:35 PM to 4:20 PM Demonstration Moving Beyond the Weighty Tome: New Approaches to Reporting Evaluation Findings Texas E 677 Fri, 4:30 PM to 6:00 PM Panel From Compliance to Reliance: Critical Moments in Integrating Evaluation Into an Organization‘s Work Travis C 690 Fri, 4:30 PM to 6:00 PM Panel Strategy as Evaluand: Quality and Utilization Issues in Evaluating Strategy Texas E 731 Sat, 8:00 AM to 9:30 AM Demonstration Strategies for Developing Evaluation Capacity in Educational Partnerships Texas E 753 Sat, 10:00 AM to 10:45 AM Roundtable Use, Ethics, and Not Giving Clients What They Ask For San Jacinto 771 Sat, 10:00 AM to 10:45 AM Demonstration Effectively Communicating Evaluation Results: Creative, Innovative, and Technological Ways to Share Evaluation Findings Texas E 794 Sat, 10:55 AM to 12:25 PM Think Tank Making Results Relevant: Designing Evaluations Stakeholders Will Value, Understand, and Use Travis A 811 Sat, 10:55 AM to 12:25 PM Multipaper Evaluators Thinking Evaluatively About Use: Tips for the Trade Texas E 851 Sat, 1:45 PM to 2:30 PM MultiPaper Deeper Implementation of the Student Success Learning to Eighteen Strategy Through Developmental Evaluation Texas E 891 Sat, 2:50 PM to 4:20 PM Panel Thinking Outside the Evaluation Report Box: Transforming Evaluation Results Into a Structural Change Grantmaking Toolkit Texas E Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 225 Index of Sessions for the Extension Education Evaluation TIG # Time Session Type Session Title Room Name 128 Wed, 4:30 PM to 6:00 PM Panel Standards of Evidence for Evaluating Extension Programs: A Changing Picture? Crockett A 274 Thu, 10:55 AM to 12:25 PM Panel The Role of Evaluation During Tough Fiscal Times: Sage Advice From Evaluation Leaders Crockett A 354 Thu, 3:35 PM to 4:20 PM Think Tank Thinking Again About Concept Mapping Crockett A 394 Thu, 4:30 PM to 6:00 PM Multipaper Evaluation Methodology Crockett A 434 Thu, 6:10 PM to 7:00 PM Business Meeting Extension Education Evaluation TIG Business Meeting Crockett A 534 Fri, 9:15 AM to 10:45 AM Multipaper Evaluation and Program Quality Crockett A 612 Fri, 1:40 PM to 3:10 PM Multipaper Extension Educators and Evaluation Crockett A 652 Fri, 3:35 PM to 4:20 PM Demonstration Program Evaluation Network: Capacity and Creativity for Multi-Site Program Evaluation Crockett A 692 Fri, 4:30 PM to 6:00 PM MultiPaper Building Capacity for the 4-H Science, Engineering, and Technology Initiative to Get to Outcomes Crockett A 733 Sat, 8:00 AM to 9:30 AM Demonstration Mapping Extension‘s Networks: Using Social Network Analysis to Explore Extension Outreach Crockett A 773 Sat, 10:00 AM to 10:45 AM MultiPaper Supporting Evaluation Capacity Building Within the Cooperative Extension System to Impact the Lives of Children, Youth and Families… Crockett A 813 Sat, 10:55 AM to 12:25 PM Skill-building Evaluating Advocacy Efforts in Cooperative Extension and Other Outreach Organizations Crockett A 853 Sat, 1:45 PM to 2:30 PM MultiPaper Using Observational Assessments to Measure and Improve Youth Program Quality Crockett A 873 Sat, 2:50 PM to 4:20 PM Roundtable Rotation I: The Unfocused Focus Group: Evaluation Benefit or Bane? Rotation II: eXtension Evaluation Community of Practice (CoP) Grows Up San Jacinto Index of Sessions for the Feminist Issues in Evaluation TIG # Time Session Type Session Title Room Name 318 Thu, 1:40 PM to 3:10 PM Panel Gender and Human Rights Evaluation Seguin B 553 Fri, 10:55 AM to 11:40 AM Roundtable Incorporating Gender into Mainstream Projects Goliad 696 Fri, 4:30 PM to 6:00 PM Multipaper Theorectical Issues in Feminist Evaluation Seguin B 821 Sat, 12:35 PM to 1:30 PM Business Meeting Feminist Issues in Evaluation TIG Business Meeting Goliad 897 Sat, 2:50 PM to 4:20 PM Multipaper Feminist Evaluation and Gender-Specific Programs Seguin B Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 226 Index of Sessions for the Government Evaluation TIG # Time Session Type Session Title Room Name 113 Wed, 4:30 PM to 6:00 PM Roundtable Rotation I: A Conceptual Framework to Assess the Sustainability of Community Coalitions Post-Federal Funding Rotation II: Using Community Partnerships to Reach Hard-to-Reach Populations in Health- Related Evaluations Goliad 131 Wed, 4:30 PM to 6:00 PM MultiPaper Informing Government Policy Through Evaluation: A Cross-site Evaluation of the Self-Employment Initiative (Start-Up USA) Crockett D 228 Thu, 9:15 AM to 10:45 AM Panel Methodological Choices in Assessing the Quality and Strength of Evidence on Effectiveness Texas A 237 Thu, 9:15 AM to 10:45 AM Multipaper Evaluation and Quality: Examples From Government Crockett D 268 Thu, 10:55 AM to 12:25 PM Multipaper International Approaches to Government Evaluation Texas A 277 Thu, 10:55 AM to 12:25 PM MultiPaper NASA Office of Education‘s Portfolio Evaluation Approach: Focus on Questions That Provide High Value Answers Crockett D 308 Thu, 1:40 PM to 3:10 PM Panel Tips From the Trenches: The Role of the Evaluator in Designing a Quality Evaluation Texas A 317 Thu, 1:40 PM to 3:10 PM MultiPaper Towards an Understanding of the Role of the Local Evaluator in Federally Funded Demonstration Projects: The Perspectives of Federal… Crockett D 348 Thu, 3:35 PM to 4:20 PM MultiPaper Strategies for Evaluation Quality in Government Texas A 388 Thu, 4:30 PM to 6:00 PM Business Meeting TIG Business Meeting and Panel: Happy Anniversary to Us! Celebrating Twenty Years of Government Evaluation Texas A 528 Fri, 9:15 AM to 10:45 AM Skill-building The Weakest Link: Does Good Evaluation Lead to Good Decisions? How to Assess Your Organization Texas A 537 Fri, 9:15 AM to 10:45 AM Panel Assessing the Health of and Improving the Evaluation Function Across the Government of Canada Through MAF Crockett D 542 Fri, 10:55 AM to 11:40 AM Expert Lecture President Obama's Evaluation Policies Lone Star A 615 Fri, 1:40 PM to 3:10 PM Panel Perspectives on Conducting Quality Evaluations at Various Levels of Government Crockett D 633 Fri, 3:35 PM to 4:20 PM Roundtable Celebrating Government Evaluation: Forging Links Among Research, Policy Decisions, and Evaluation to Protect Our Nation's Air… Goliad 651 Fri, 3:35 PM to 4:20 PM Expert Lecture Introduction to Evaluation and Public Policy Texas F 655 Fri, 3:35 PM to 4:20 PM Expert Lecture A Theory Driven Multi-year Strategic Evaluation Plan for a Multi-program Government Agency Crockett D 695 Fri, 4:30 PM to 6:00 PM Multipaper Collaboration in Government-Sponsored Evaluations Crockett D 727 Sat, 8:00 AM to 9:30 AM Panel Use of Evaluation: Overcoming the Challenges Texas A 736 Sat, 8:00 AM to 9:30 AM Panel Infusing Evaluation Theory Into Practice in Government Safety Programs: Process Examples From the US DOT Crockett D 759 Sat, 10:00 AM to 10:45 AM Demonstration Guidelines for Independent Consultants/Evaluators Working With Universities: Complying With Federal Funding Source… Presidio A 767 Sat, 10:00 AM to 10:45 AM Panel Demonstrating Results for Federally Funded Programs Texas A 772 Sat, 10:00 AM to 10:45 AM Expert Lecture Quality Evaluation: Drivers and Objectives of the Renewed Canadian Federal Policy on Evaluation Texas F 776 Sat, 10:00 AM to 10:45 AM MultiPaper Evaluation Challenges in Designing and Implementing a Program Evaluation: The Experience of the CDC‘s Colorectal Cancer Control… Crockett D 807 Sat, 10:55 AM to 12:25 PM MultiPaper Conceptualizing and Conducting Quality Peer Reviewed Portfolio Evaluations: Approaches and Lessons Learned From the CDC Texas A 847 Sat, 1:45 PM to 2:30 PM Think Tank The Use of Program Progress Reports in Federal Government Program Evaluations Texas A 856 Sat, 1:45 PM to 2:30 PM Multipaper Evaluating Government-Sponsored Education Programs Crockett D 887 Sat, 2:50 PM to 4:20 PM MultiPaper Straw, Bricks, Construction: Improving Quality of Education Data, Performance Measures, and Evaluation to Enhance Student… Texas A Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 227 Index of Sessions for the Graduate Student and New Evaluator TIG # Time Session Type Session Title Room Name 130 Wed, 4:30 PM to 6:00 PM Skill-building Networking and Getting Involved With the American Evaluation Association Crockett C 208 Thu, 9:15 AM to 10:45 AM Roundtable Rotation I: Truth, Beauty, And Justice For All: A Conversation With Graduate Students Examining Issues of Power, Control… Rotation II: The Role of Evaluation and Research Support in Ensuring Evaluation Quality Mission A 248 Thu, 10:55 AM to 12:25 PM Roundtable Rotation I: Grad Students on Grad Students: Evaluating Peers in a Professional Context Rotation II: A Student-Generated Collaborative Approach to Developing New Evaluator Competencies Mission A 329 Thu, 3:35 PM to 4:20 PM Skill-building Quality Evaluation Includes Everyone! Using Universal Design to Make Your Evaluation More Accessible Mission B 358 Thu, 3:35 PM to 4:20 PM Business Meeting Graduate Student and New Evaluators TIG Business Meeting Seguin B 398 Thu, 4:30 PM to 6:00 PM Multipaper Student Centered Issues in Evaluation Seguin B 571 Fri, 10:55 AM to 11:40 AM Demonstration Using R for Statistical Analysis Texas F 656 Fri, 3:35 PM to 4:20 PM Multipaper Advancing the Field of Evaluation Seguin B 673 Fri, 4:30 PM to 6:00 PM Roundtable Rotation I: My First Year as an Internal Evaluator: What I Didn't Know That I Didn't Know Rotation II: Evaluator/ Practitioner Collaborations Goliad 737 Sat, 8:00 AM to 9:30 AM Panel Emerging Evaluators and the Future of Culturally Responsive Evaluation Seguin B 817 Sat, 10:55 AM to 12:25 PM Panel Reflections of Emerging Professionals: The Culturally Responsive Path Ahead Seguin B 872 Sat, 2:50 PM to 4:20 PM Roundtable Rotation I: The Mentor/Mentee Relationship: Perspectives and Suggestions for Maintaining Successful Relationships Rotation II: Evaluating A Rite of Passage Program as a Vehicle for Systemic Change in At-Risk Female Youths Attitudes and Beliefs Goliad 892 Sat, 2:50 PM to 4:20 PM Skill-building How to Write an Evaluation Plan Texas F Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 228 Index of Sessions for the Health Evaluation TIG # Time Session Type Session Title Room Name 113 Wed, 4:30 PM to 6:00 PM Roundtable Goliad 118 Wed, 4:30 PM to 6:00 PM MultiPaper Rotation I: A Conceptual Framework to Assess the Sustainability of Community Coalitions Post-Federal Funding Rotation II: Using Community Partnerships to Reach Hard-to-Reach Populations in Health- Related Evaluations Emerging Strategies and Tools for Evaluating Environmental and Policy Change Approaches to Chronic Disease Prevention 133 Wed, 4:30 PM to 6:00 PM Panel Evaluation of the Clinical and Translational Science Awards (CTSA) Programs: A Focus on Quality Republic B 239 Thu, 9:15 AM to 10:45 AM Think Tank Evaluating Health Program Sustainability: Improving the Quality of Methods and Measures Republic B 279 Thu, 10:55 AM to 12:25 PM Panel Keep an Eye on the Basics: The Importance of Evaluating Public Health Program Infrastructure Republic B 293 Thu, 1:40 PM to 3:10 PM Roundtable Measuring Communication Campaign Intermediate Outcomes: Tools and Techniques Goliad 301 Thu, 1:40 PM to 3:10 PM Multipaper Improving Medical and Prevention Services Through Continuous Evaluation and Organizational Learning Presidio B 312 Thu, 1:40 PM to 3:10 PM Panel The Cycle of Evidence-based Policy and Practice: Synthesis, Translation, and Evaluation Capacity Building Texas E 320 Thu, 1:40 PM to 3:10 PM Multipaper Improving School-Based Health Through Campus Centers, Nursing, and Effective Interventions Republic B 338 Thu, 3:35 PM to 4:20 PM Demonstration Environmental Scans Using State Legislative Databases for Health Policy Research Travis D 360 Thu, 3:35 PM to 4:20 PM Panel Improving the Design, Methods, and Data Quality of a Public Health Outcome Monitoring Project Republic B 378 Thu, 4:30 PM to 6:00 PM MultiPaper Health Indicator Systems for Evaluation of Local, State, and National Chronic Disease Prevention and Control Initiatives Travis D 400 Thu, 4:30 PM to 6:00 PM Business Meeting TIG Business Meeting and Presentation: Bridging the Evidence Gap in Obesity Prevention - A Framework to Inform Decision Making Republic B 523 Fri, 9:15 AM to 10:45 AM Roundtable Towards Translational Process Evaluation: Implementation, Fidelity, Integration, and Sustainability – A Roundtable Discussion Bonham A 540 Fri, 9:15 AM to 10:45 AM Skill-building Tools for Aligning National-Level and Local-Level Evaluations: Helping Grantees Evaluate Their Public Health Interventions Republic B 558 Fri, 10:55 AM to 11:40 AM Expert Lecture Is Quality Improvement In Healthcare Cost-Effective? Travis D 578 Fri, 10:55 AM to 11:40 AM Demonstration Online Visual System for Strategic Planning and Performance Monitoring: iProgress √ Check Republic B 592 Fri, 1:40 PM to 3:10 PM Multipaper Health Matters: Evaluating Advocacy and Policy Change Bowie C 609 Fri, 1:40 PM to 3:10 PM MultiPaper Report on a Test of a General Method for Quick Evaluation of Medical Research by Morbidity Texas D 618 Fri, 1:40 PM to 3:10 PM Multipaper Examining Heart Disease and Stroke: Sharing Lessons to Improve Evaluation Quality Republic B 638 Fri, 3:35 PM to 4:20 PM Demonstration Is Your Program Sustainable? A Practical Tool for Evaluating Sustainability Travis D 658 Fri, 3:35 PM to 4:20 PM Multipaper Health Care Delivery, Effectiveness, and Reform: Where to Go From Here? Republic B 678 Fri, 4:30 PM to 6:00 PM Multipaper Working Together and Getting the Message Heard in Teen Pregnancy Prevention Programs Travis D 698 Fri, 4:30 PM to 6:00 PM Multipaper Improving Evaluations of Nutrition, Physical Activity, and Obesity Programs Through Schools, Providers, and Statewide Efforts Republic B 717 Sat, 8:00 AM to 9:30 AM Panel Moving Towards Improving the Quality of Our Evaluations: Approaches and Lessons Learned From Comprehensive Cancer Control… Travis D 720 Sat, 8:00 AM to 9:30 AM Panel Measuring Evaluation Capacity to Enhance Quality of ECB Activities in Federal Public Health and Systemic Change Programs Presidio B 739 Sat, 8:00 AM to 9:30 AM MultiPaper National Evaluation of Team Science in the Interdisciplinary Research Consortium Program Republic B 779 Sat, 10:00 AM to 10:45 AM Multipaper Healthy Aging and Health Screenings: Lessons Learned Through Participatory Evaluations Republic B 797 Sat, 10:55 AM to 12:25 PM Multipaper Strategies and Tools to Evaluate the Comprehensive Picture of Health Policy Travis D 819 Sat, 10:55 AM to 12:25 PM Panel Operational Research and Monitoring and Evaluation: Can We Forge a Partnership? Republic B 859 Sat, 1:45 PM to 2:30 PM Multipaper Successess and Lessons Learned From Evaluations of Long-Term HIV/AIDS Programs Republic B 899 Sat, 2:50 PM to 4:20 PM MultiPaper Policy Evaluation and Public Health: Multifaceted Approaches and Examples From the Field Republic B Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Travis D Page 229 Index of Sessions for the Human Services Evaluation TIG # Time Session Type Session Title Room Name 119 Wed, 4:30 PM to 6:00 PM MultiPaper Are Universal School-based Prevention Programs Effective? It Depends on the Students and Outcomes Targeted Independence 219 Thu, 9:15 AM to 10:45 AM MultiPaper Mixed-Method Evaluation in Human Services Settings Independence 259 Thu, 10:55 AM to 12:25 PM Multipaper Implementing Quality Randomized Control Trials in Human Service Evaluations: Applications Addressing Challenges and Barriers Independence 299 Thu, 1:40 PM to 3:10 PM Panel Use of Fidelity Scores in Measuring Outcomes for Children Involved in the Child Welfare System Independence 379 Thu, 4:30 PM to 6:00 PM Panel Quality by Design: Statewide Human Services Workforce Evaluation Using an Integrated Framework Independence 419 Thu, 6:10 PM to 7:00 PM Business Meeting Human Services Evaluation TIG Business Meeting Independence 508 Fri, 9:15 AM to 10:45 AM Roundtable Making Decisions About Program Continuation: A Step-by-Step Process Mission A 519 Fri, 9:15 AM to 10:45 AM Multipaper Challenges and Solutions in Implementing and Conducting Quality Evaluations on Children, Youth, and Families Independence 550 Fri, 10:55 AM to 11:40 AM Panel The Adaptive Action Cycle: Bridging the Gap Between Lessons Learned and Lessons Applied Bowie A 599 Fri, 1:40 PM to 3:10 PM Multipaper Interesting Evaluations in Social Services and Welfare Independence 679 708 Fri, 4:30 PM to 6:00 PM Sat, 8:00 AM to 9:30 AM Think Tank Roundtable 718 Sat, 8:00 AM to 9:30 AM Panel Beyond Fidelity: Evaluating the Implementation of Evidence-based Practices Independence Rotation I: Measuring Success: Applying Short-Term Indicators to Measure Long-Term Success in Human Capital Investment Programs Mission A Rotation II: How to Maintain Evaluation Quality in a Changing Environment: The Importance of Mixed Methods Using Geographic Information Systems (GIS) to Enhance the Quality and Validity of Evaluations in Human Services Independence 798 Sat, 10:55 AM to 12:25 PM Multipaper Mixed Methods and Multiple Measures in Quality Human Services Evaluation: Lessons Learned Independence 830 Sat, 1:45 PM to 2:30 PM Panel BUILD-ing an Institute for Child Success: The Statewide Systems Design for the South Carolina Institute for Child Success Bowie A 878 Sat, 2:50 PM to 4:20 PM Panel Community-Derived Research Partnerships: Working Together to Improve Human Services Independence Index of Sessions for the Independent Consulting TIG # Time Session Type Session Title Room Name 223 Thu, 9:15 AM to 10:45 AM Roundtable Bonham A 290 Thu, 1:40 PM to 3:10 PM Panel Rotation I: Learning About Educational Reform From a Seven-Year Math-Science Partnership Rotation II: When Quality and Policy Collide in Evaluating Math-Science Partnership Programs: Strategies for Resolution The Fight for Evaluation Quality: Perspectives From the Trenches 330 Thu, 3:35 PM to 4:20 PM Demonstration Marketing the Online You: Developing and Maintaining a Professional Online Presence Bowie A 370 Thu, 4:30 PM to 6:00 PM Business Meeting Independent Consulting TIG Business Meeting Bowie A 510 Fri, 9:15 AM to 10:45 AM Think Tank Enhancing the Quality of Evaluation Design, Data Collection, and Reports Through Peer Review Bowie A 590 Fri, 1:40 PM to 3:10 PM Panel Integrating Management Consulting Competencies into the Evaluation Process Bowie A 670 Fri, 4:30 PM to 6:00 PM MultiPaper Evaluation Opportunities Within a National Science Foundation (NSF) Program Bowie A 748 Sat, 10:00 AM to 10:45 AM Roundtable Translating Findings Into Client Action Mission A 750 Sat, 10:00 AM to 10:45 AM Skill-building Evaluations of Community Nonprofits and New Organizations or Developing Programs: Lessons From the Field Bowie A 759 Sat, 10:00 AM to 10:45 AM Demonstration Guidelines for Independent Consultants/Evaluators Working With Universities: Complying With Federal Funding Source… Presidio A 839 Sat, 1:45 PM to 2:30 PM Multipaper Overcoming the Limitations of the Educational Context to Increase Rigor Presidio A 870 Sat, 2:50 PM to 4:20 PM MultiPaper Ensuring Quality in Our Work: Techniques Used by Independent Consultants Bowie A Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Bowie A Page 230 Index of Sessions for the Indigenous Peoples in Evaluation TIG # Time Session Type Session Title Room Name 103 Wed, 4:30 PM to 6:00 PM Skill-building Waawiyeyaa (Circular) Evaluation Tool Lone Star B 252 Thu, 10:55 AM to 12:25 PM Multipaper Culturally Responsive Evaluation: Three Cases From Aboriginal Peoples and First Nations in Canada Bowie C 307 Thu, 1:40 PM to 3:10 PM Panel Grappling With Uncertainty in Innovative and Complex Settings: Weaving Quality in Developmental Evaluation Bonham E 372 Thu, 4:30 PM to 6:00 PM Business Meeting Indigenous Peoples in Evaluation TIG Business Meeting Bowie C 574 Fri, 10:55 AM to 11:40 AM Multipaper Translating Evaluation to Enhance Its Meaning and Use: Examples From Two Indigenous Communities - Urban USA and Rural Uganda Crockett C 654 Fri, 3:35 PM to 4:20 PM Multipaper Understanding Indigenous Higher Education Expenses: Innovative Evaluations From New Zealand and Hawaii Crockett C 731 Sat, 8:00 AM to 9:30 AM Demonstration Strategies for Developing Evaluation Capacity in Educational Partnerships Texas E 791 Sat, 10:55 AM to 12:25 PM Demonstration The REWA System of Transformative Evaluation: Founded on Pono (Truth), Ahua (Beauty) and Tika (Justice)- Evaluating Health… Bowie C Index of Sessions for the Integrating Technology Into Evaluation TIG # Time Session Type Session Title Room Name 116 214 Wed, 4:30 PM to 6:00 PM Thu, 9:15 AM to 10:45 AM Multipaper Roundtable Travis B San Jacinto 256 Thu, 10:55 AM to 12:25 PM Multipaper Viabilities of Technologies in Evaluation Research Rotation I: Using Technology for Efficiency in Evaluation Rotation II: Integrating Website Use Analytics into a Mixed Method Evaluation of a Professional Development Website Visualizing Data for Strategic Planning 296 Thu, 1:40 PM to 3:10 PM Multipaper Contribution of Technology to Evaluation Practice Travis B 336 Thu, 3:35 PM to 4:20 PM Demonstration From Game Shows, to Universities, to Cooperative Extension: The Benefits, Challenges, and Logistics of Using an Audience Response… Travis B 416 Thu, 6:10 PM to 7:00 PM Business Meeting Integrating Technology Into Evaluation TIG Business Meeting Travis B 596 Fri, 1:40 PM to 3:10 PM Demonstration Multimedia Advances in Evaluation: The Use of Skype, Elluminate, and Virtual World Technologies in Conducting Focus Group… Travis B 636 Fri, 3:35 PM to 4:20 PM Panel Using New Technologies to Support Evaluation Quality and Organizational Learning Travis B 650 Fri, 3:35 PM to 4:20 PM Demonstration Moving Beyond the Weighty Tome: New Approaches to Reporting Evaluation Findings Texas E 715 Sat, 8:00 AM to 9:30 AM Demonstration Fewer Errors and Faster Results: How to Automate Production of Tables and Reports with Software You Already Own Travis B 755 Sat, 10:00 AM to 10:45 AM Demonstration Data Dashboard Design for Quality Monitoring and Decision Making Travis B 771 Sat, 10:00 AM to 10:45 AM Demonstration Effectively Communicating Evaluation Results: Creative, Innovative, and Technological Ways to Share Evaluation Findings Texas E 795 Sat, 10:55 AM to 12:25 PM Demonstration An Integrated Web-based Assessment, Planning, and Evaluation System for Strengthening Families Programs Across the Nation Travis B 835 Sat, 1:45 PM to 2:30 PM Skill-building Data Management: How Not to Lose Face Travis B Travis B Index of Sessions for the Internal Evaluation TIG # Time Session Type Session Title 247 Thu, 10:55 AM to 12:25 PM Business Meeting Internal Evaluation TIG Business Meeting and Presentation: A Decade of Internal Evaluation in One School District - How Times Change Lone Star F 512 713 Fri, 9:15 AM to 10:45 AM Sat, 8:00 AM to 9:30 AM Multipaper Roundtable 837 Sat, 1:45 PM to 2:30 PM Multipaper Improving Quality of Programs and Evaluation: Examples From the Field Rotation I: Internal Evaluation: How to Keep the Fox Out of the Hen House Rotation II: The Internal Evaluator's Dual Role as Project Manager and Evaluator: Lessons in Maintaining Evaluation Quality Internal Evaluators: Contextual Considerations and Roles Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Room Name Bowie C San Jacinto Travis D Page 231 Index of Sessions for the International and Cross-cultural Evaluation TIG # Time Session Type Session Title Room Name 132 Wed, 4:30 PM to 6:00 PM Multipaper Evaluation and the Complexities of International Financial Assistance Programs Republic A 236 Thu, 9:15 AM to 10:45 AM Think Tank Assessing Impacts in Real World Evaluations: Alternatives to the Conventional Statistical Counterfactual Crockett C 238 Thu, 9:15 AM to 10:45 AM Multipaper Navigating the Intricacies of Culture and Context in International Program Evaluation Republic A 276 Thu, 10:55 AM to 12:25 PM Panel National Evaluation Capacity Development Crockett C 278 Thu, 10:55 AM to 12:25 PM Multipaper Evaluating Education, Health Education and Agriculture Education Around the Globe Republic A 294 Thu, 1:40 PM to 3:10 PM Roundtable Rotation I: Assessing Principals' Needs for Professional Development Rotation II: Reflection on an Instrument for Capturing School Conditions in Developing Countries San Jacinto 316 Thu, 1:40 PM to 3:10 PM Panel Evaluating Support to Poverty and Gender in Cross Country Aid Programs Crockett C 319 Thu, 1:40 PM to 3:10 PM Panel Reflections From Applying a Complexity Lens to Monitoring and Evaluation Republic A 359 Thu, 3:35 PM to 4:20 PM Expert Lecture Julia Child and Richard Feynman: An Oblique Approach to Evaluation Quality Republic A 396 Thu, 4:30 PM to 6:00 PM Demonstration Improving the Quality of Peacebuilding Evaluation Crockett C 399 Thu, 4:30 PM to 6:00 PM Panel Impact Evaluation at the Millennium Challenge Corporation (MCC): Theory, Application, and Complications Republic A 439 Thu, 6:10 PM to 7:00 PM Business Meeting International and Cross-cultural TIG Business Meeting Republic A 514 Fri, 9:15 AM to 10:45 AM Roundtable Rotation I: Exploring Evaluation Quality in International Development Evaluation: An Examination of How International Development… San Jacinto Rotation II: Practices for Working With and Building Capacity of Local Evaluation Consultants in International Development 536 Fri, 9:15 AM to 10:45 AM Panel Evaluation Within Contested Spaces Crockett C 539 Fri, 9:15 AM to 10:45 AM Panel Complementary Approaches to Evaluating Social Safety Nets at the World Bank Republic A 577 Fri, 10:55 AM to 11:40 AM Demonstration Peace Corps‘ Volunteer Reporting Tool: Increasing the Capacity for Evidence-based Decision-Making at Multiple Levels of the Peace… Republic A 614 Fri, 1:40 PM to 3:10 PM MultiPaper Impact of Social and Economic Development Interventions: Presentation of Synthetic Reviews of Education, Early Childhood… 617 Fri, 1:40 PM to 3:10 PM Panel Building Capacity to Monitor and Evaluate Development Policies, Programs, and Projects: Everyone Wants to do It, but How Should It… Republic A 657 Fri, 3:35 PM to 4:20 PM Multipaper Evaluation Capacity Building in International Contexts Republic A 694 Fri, 4:30 PM to 6:00 PM Skill-building Data Collection Instruments for Quality Evaluation Crockett C 697 Fri, 4:30 PM to 6:00 PM Multipaper Export and Translation: Evaluating the Sharing of People, Programs, and Instruments Across Borders Republic A 712 Sat, 8:00 AM to 9:30 AM Roundtable Rotation I: Improving Methods of Inquiry in Evaluation Practice: Issues and Recommendations to Incorporate Diverse Views… Goliad Rotation II: Investing in Long Term Capacity Building Initiatives for African-based Graduates and Professionals Involved or Interested… 735 Sat, 8:00 AM to 9:30 AM Panel The Role of Monitoring in Evaluation Quality Crockett C 738 778 Sat, 8:00 AM to 9:30 AM Sat, 10:00 AM to 10:45 AM Multipaper Demonstration Impact Evaluation and Beyond: Methodological and Cultural Considerations in Measuring What Works Simulation Model of Evaluation Biases Under Post Conflict Zones Republic A Republic A 815 Sat, 10:55 AM to 12:25 PM Think Tank Quality and International Evaluation Crockett C 858 Sat, 1:45 PM to 2:30 PM MultiPaper Evaluating Peace Building and Conflict Prevention in Fragile States Republic A 898 Sat, 2:50 PM to 4:20 PM Multipaper Case Studies in International M&E Republic A Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Crockett C Page 232 Index of Sessions for the Lesbian, Gay, Bisexual, Transgender Issues TIG # Time Session Type Session Title Room Name 260 Thu, 10:55 AM to 12:25 PM Multipaper Including Everyone: Lesbian, Gay, Bisexual, Transgender, People of Color, and Double Winners Presidio A 339 Thu, 3:35 PM to 4:20 PM MultiPaper Including Sexual Orientation Information in an Evaluation: When, Why, and How? Independence 420 Thu, 6:10 PM to 7:00 PM Business Meeting Lesbian, Gay, Bisexual and Transgender Issues TIG Business Meeting Presidio A 517 Fri, 9:15 AM to 10:45 AM MultiPaper Evaluation of Efforts to Create Safer Environments for Lesbian, Gay, Bisexual, and Transgender (LGBT) Youth Travis C 559 Fri, 10:55 AM to 11:40 AM Multipaper None of the Above: Expanding Binary Categorizations Independence 628 Fri, 3:35 PM to 4:20 PM Roundtable Improving the Quality of Evaluations That Include Lesbian, Gay, Bisexual and Transgender People (LGBT): Tools for the Evaluator? Mission A 639 Fri, 3:35 PM to 4:20 PM Panel Nerd Activism: Using Data as the Vehicle for Community Mobilization Independence 868 Sat, 2:50 PM to 4:20 PM Panel Building Evaluation Capacity in Nonprofit Organizations Serving Lesbian, Gay, Bisexual and Transgender (LGBT) and HIV+ Clients Mission A Index of Sessions for the Mixed Methods Evaluation TIG # Time Session Type Session Title Room Name 109 Wed, 4:30 PM to 6:00 PM Roundtable Rotation I: Increasing Nonprofit Sustainability Activities With Effective Request for Proposals (RFP's): A Mixed Methods Evaluation… Rotation II: Improving the Process of Reviewing Research Proposals: Reflections of a Research Review Committee Mission B 230 Thu, 9:15 AM to 10:45 AM Multipaper Dealing With Technical Challenges in Mixed Methods Evaluation Texas C 270 Thu, 10:55 AM to 12:25 PM Demonstration Better Evaluation - A Toolbox of Evaluation Methods and Applications That Supports Quality and Methodological Diversity Texas C 310 Thu, 1:40 PM to 3:10 PM Multipaper Using Mixed Methods to Expand Frameworks for Program Evaluation Texas C 390 Thu, 4:30 PM to 6:00 PM Multipaper Examining the Mixing in Mixed Methods Evaluation Texas C 497 Fri, 7:00 AM to 7:50 AM Business Meeting Mixed Methods TIG Business Meeting Crockett A 530 Fri, 9:15 AM to 10:45 AM MultiPaper Ensuring High-Quality Data Processes in Evaluation: Examples From Qualitative, Quantitative and Mixed Methods Work Texas C 668 Fri, 4:30 PM to 6:00 PM Roundtable Rotation I: Examining Collaboration in an Evaluation of a Large Scale Civic Education Program Rotation II: Using Mixed Methods to Evaluate a School Based Civic Engagement Initiative Mission A 708 Sat, 8:00 AM to 9:30 AM Roundtable Rotation I: Measuring Success: Applying Short-Term Indicators to Measure Long-Term Success in Human Capital Investment Programs Mission A Rotation II: How to Maintain Evaluation Quality in a Changing Environment: The Importance of Mixed Methods 729 Sat, 8:00 AM to 9:30 AM MultiPaper A Mixed Methods Assessment of the Impact of Three Dropout Prevention Strategies on Student Academic Achievement in Grades 6th… Texas C 788 Sat, 10:55 AM to 12:25 PM Roundtable Preparing Teacher Candidates for Parent Partnerships: An Evaluation of a Preservice Course in Teacher Education Mission A 809 Sat, 10:55 AM to 12:25 PM Multipaper Using Mixed Methods to Evaluate Program Implementation and Inter-agency Collaboration Texas C 889 Sat, 2:50 PM to 4:20 PM Multipaper Challenges and Promises for Using Mixed Methods: Lessons From Implementing Mixed Methods Evaluation Texas C Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 233 Index of Sessions for the Multiethnic Issues in Evaluation TIG # Time Session Type Session Title Room Name 111 Wed, 4:30 PM to 6:00 PM Roundtable Maximizing Our Collective Talent: Conversations With Senior Evaluators Bowie B 211 Thu, 9:15 AM to 10:45 AM Think Tank Third Annual Asa G. Hilliard III Think Tank on Culture and Evaluation Bowie B 213 Thu, 9:15 AM to 10:45 AM Roundtable Rotation I: Engaging Social Justice in a Graduate Course on Program Evaluation Rotation II: Issues of Quality: Guiding Principles for Culturally Competent Teaching and Practice Goliad 251 Thu, 10:55 AM to 12:25 PM Panel Race, Class, and Power: Bringing The Issues Into Discussion and Evaluation Bowie B 291 Thu, 1:40 PM to 3:10 PM Multipaper Advancing Multiethnic Program Evaluation Through Theory and Practice: An Examination of Culture, Cultural Context, and Culturally… Bowie B 331 Thu, 3:35 PM to 4:20 PM Multipaper Overcoming Specific Challenges to Service Delivery Within Hispanic-American Communities Bowie B 371 Thu, 4:30 PM to 6:00 PM Panel Evaluation Quality From a Federal Perspective Bowie B 411 Thu, 6:10 PM to 7:00 PM Business Meeting Multiethnic Issues in Evaluation TIG Business Meeting Bowie B 511 Fri, 9:15 AM to 10:45 AM Multipaper Utilizing Evaluation Methods to Provide Quality Health Care Services to Underserved Populations Bowie B 551 Fri, 10:55 AM to 11:40 AM Multipaper Using Evaluation to Enhance Program Participation With Underrepresented Groups in STEM Fields Bowie B 591 Fri, 1:40 PM to 3:10 PM Panel The Evolution and Revolution of Culturally Responsive Evaluation Bowie B 631 Fri, 3:35 PM to 4:20 PM Demonstration How Well Are We Addressing Asthma Disparities? Demonstration of a New Evaluation Toolkit Bowie B 671 Fri, 4:30 PM to 6:00 PM MultiPaper Practicing Culturally Responsive Evaluation: GEDI Program Intern Reflections on the Role of Competence, Context, and Cultural… Bowie B 716 Sat, 8:00 AM to 9:30 AM Think Tank Evaluating Social Change Programs: How Does a Culturally Responsive Approach Apply Travis C 796 Sat, 10:55 AM to 12:25 PM Demonstration Construct Validity of Race and Its Impact on the Quality of Research and Evaluation Travis C 876 Sat, 2:50 PM to 4:20 PM MultiPaper Practicing Culturally Responsive Evaluation: GEDI Program Intern Reflections on the Role of Competence, Context, and Cultural… Travis C Index of Sessions for the Needs Assessment TIG # Time Session Type Session Title Room Name 117 Wed, 4:30 PM to 6:00 PM Multipaper Planning Programs: Allocating Scarce Resources Based on Needs Assessment Travis C 297 Thu, 1:40 PM to 3:10 PM Skill-building Introduction to Designing Needs Assessment Surveys Travis C 377 Thu, 4:30 PM to 6:00 PM Panel Face to Face With the Authors of the Needs Assessment Kit: Challenging Questions (With a Twist) and Hopefully Meaningful Answers Travis C 417 Thu, 6:10 PM to 7:00 PM Business Meeting Needs Assessment TIG Business Meeting Travis C 857 Sat, 1:45 PM to 2:30 PM Multipaper Designing Surveys for Use in Needs Assessments Seguin B Index of Sessions for the Non-profit and Foundations Evaluation TIG # Time Session Type Session Title Room Name 105 Wed, 4:30 PM to 6:00 PM Think Tank Successful Outcome Measurement in Nonprofits: Overcoming Challenges Lone Star D 124 Wed, 4:30 PM to 6:00 PM Panel The Intersection of Strategy and Evaluation: What Are We Learning? Bonham B 205 Thu, 9:15 AM to 10:45 AM Think Tank Nonprofit Rating Systems and Implications for Evaluation Lone Star D 224 Thu, 9:15 AM to 10:45 AM Multipaper How Did You Do It? Implementing Performance Measurement and Monitoring Systems Bonham B Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 234 Index of Sessions for the Non-profit and Foundations Evaluation TIG, continued # Time Session Type Session Title Room Name 239 Thu, 9:15 AM to 10:45 AM Think Tank Evaluating Health Program Sustainability: Improving the Quality of Methods and Measures Republic B 245 Thu, 10:55 AM to 12:25 PM Multipaper Evaluating Social Service Programs for Government and Foundations Lone Star D 257 Thu, 10:55 AM to 12:25 PM Panel Measuring the Immeasurable: Lessons for Building Grantee Capacity to Evaluate Hard-to-assess Efforts Travis C 263 Thu, 10:55 AM to 12:25 PM Roundtable Rotation I: Evaluation as a Management and Learning Tool for the Successful Development and Scaling of Innovative Program Models Bonham A Rotation II: Evaluating Enterprising Nonprofits: The Social Return on Investment 264 Thu, 10:55 AM to 12:25 PM Panel Using Evaluation to Improve the Quality of the Initial Implementation of a Statewide Community and State Level Policy and Systems… Bonham B 285 Thu, 1:40 PM to 3:10 PM Panel Contextual Issues in a Randomized Control Group Evaluation of a School-based Intervention: Fielding an Evidence-based… Lone Star D 303 Thu, 1:40 PM to 3:10 PM Roundtable Rotation I: Small Foundations With Big Learning Agenda: A Case of Using Analysis of Past Grant Making to Support Future… Rotation II: Challenges in Developing Multi-level Logic Models Bonham A 304 Thu, 1:40 PM to 3:10 PM Multipaper Insights Into Foundation Evaluation Bonham B 325 Thu, 3:35 PM to 4:20 PM Multipaper Evaluation and Nonprofits: Learning From Experience Lone Star D 344 Thu, 3:35 PM to 4:20 PM Multipaper Evaluation: Understanding the Context and Managing Tensions Bonham B 365 Thu, 4:30 PM to 6:00 PM Business Meeting Non-profits & Foundations Evaluation TIG Business Meeting Lone Star D 505 Fri, 9:15 AM to 10:45 AM Panel Strategic Learning: An Embedded Approach for Evaluating Complex Change Lone Star D 524 Fri, 9:15 AM to 10:45 AM Think Tank Aligning Priorities of Diverse Stakeholders Using Collaborative Evaluation Planning Bonham B 545 Fri, 10:55 AM to 11:40 AM Panel Funder‘s Use of Network Analysis to Build Intentional Collaboration Lone Star D 564 Fri, 10:55 AM to 11:40 AM Panel Low-cost, High-Quality Assessments for Nonprofit Adolescent Pregnancy Prevention Program Planning Bonham B 585 Fri, 1:40 PM to 3:10 PM Panel Helping Nonprofit Agencies Move From Measuring Outcomes to Managing Them: A Budding Success Story From the United Way… Lone Star D 604 Fri, 1:40 PM to 3:10 PM Panel Improving Evaluation in the Real World of Nonprofits and Foundations Bonham B 625 Fri, 3:35 PM to 4:20 PM Panel Communities of Practice (CoP) as a Foundation Strategy Lone Star D 665 Fri, 4:30 PM to 6:00 PM Panel Multiple Sites, Multiple Layers, Multiple Players: Lessons From the Field on Keeping Quality High and Frustration Low Lone Star D 684 Fri, 4:30 PM to 6:00 PM Multipaper Making Sense of the Relationships Between Nonprofits, Funders, and Evaluation Bonham B 690 Fri, 4:30 PM to 6:00 PM Panel Strategy as Evaluand: Quality and Utilization Issues in Evaluating Strategy Texas E 705 Sat, 8:00 AM to 9:30 AM Demonstration Foundation Effectiveness: Aligning Impact Strategy and Evaluation Lone Star D 723 745 Sat, 8:00 AM to 9:30 AM Sat, 10:00 AM to 10:45 AM Panel Panel Beauty is in the Eye of the Beholder: Rationalizing Evaluation Needs Amongst Foundation Boards, Staff, and the Nonprofits They Fund Bonham B Evaluation in Foundations: The State of the Art Lone Star D 762 Sat, 10:00 AM to 10:45 AM Roundtable Using Site Visits to Improve Programs Bonham A 785 Sat, 10:55 AM to 12:25 PM Demonstration A Foundation-to-Foundation Partnership: What Went Right, What Took Time- A Look at the Robert Wood Johnson Foundation… Lone Star D 803 Sat, 10:55 AM to 12:25 PM Multipaper Evaluating Family and Community Change Bonham B 825 Sat, 1:45 PM to 2:30 PM Expert Lecture Evaluations Done Right: Paving the Way for Closing a Program Lone Star D 883 Sat, 2:50 PM to 4:20 PM Demonstration 2010 Report: State of Evaluation Practice and Capacity in the Nonprofit Sector Bonham B 891 Sat, 2:50 PM to 4:20 PM Thinking Outside the Evaluation Report Box: Transforming Evaluation Results Into a Structural Change Grantmaking Toolkit Texas E Panel Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 235 Index of Sessions for the Organizational Learning and Evaluation Capacity Building TIG # Time Session Type Session Title Room Name 121 Wed, 4:30 PM to 6:00 PM Business Meeting TIG Business Meeting and Presentations: Advancing Quality in Evaluation Capacity Building Presidio B 217 Thu, 9:15 AM to 10:45 AM Demonstration Assessing Evaluation Capacity: Using the Evaluation Capacity Diagnostic Tool Travis C 221 Thu, 9:15 AM to 10:45 AM Skill-building The Power of Metaphor: Using Images for Organizational Analysis Presidio B 261 Thu, 10:55 AM to 12:25 PM Multipaper Building, Enhancing, and Sustaining Evaluation Quality for Organizational Learning Presidio B 272 Thu, 10:55 AM to 12:25 PM Panel Mainstreaming Evaluation in Diverse Organizational Contexts Texas E 301 Thu, 1:40 PM to 3:10 PM Multipaper Improving Medical and Prevention Services Through Continuous Evaluation and Organizational Learning Presidio B 312 Thu, 1:40 PM to 3:10 PM Panel The Cycle of Evidence-based Policy and Practice: Synthesis, Translation, and Evaluation Capacity Building Texas E 337 Thu, 3:35 PM to 4:20 PM Demonstration CES's Professional Designation Program - How Our Members Are Applying to be Designated as a Credentialed Evaluator Travis C 381 Thu, 4:30 PM to 6:00 PM Panel A Systems Approach to Building and Assessing Evaluation Plan Quality Presidio B 521 Fri, 9:15 AM to 10:45 AM Panel Evaluation Capacity Building (ECB) Models, Measures, And Outcomes: Taking Stock to Forge Ahead Presidio B 557 Fri, 10:55 AM to 11:40 AM Multipaper Communication: At What Level Does It Help or Hinder Evaluation Capacity? Travis C 561 Fri, 10:55 AM to 11:40 AM Demonstration Herding Cats: Improving the Quality and Quantity of Decentralized Evaluation in a Global Organization Through Capacity Building Presidio B 570 Fri, 10:55 AM to 11:40 AM Panel Joint Evaluation of Private Sector Development Projects: Benefits and Challenges Texas E 601 Fri, 1:40 PM to 3:10 PM Demonstration Improving the Quality of Analysis, Interpretation, and Reporting of Program Outcomes Through a Measurement, Evaluation… Presidio B 610 Fri, 1:40 PM to 3:10 PM Think Tank Taking a Good, Long Look In the Mirror: How Can We Hold Ourselves Accountable for Quality Recommendations? Texas E 637 Fri, 3:35 PM to 4:20 PM Demonstration Creating Statewide Guidelines for Twenty First Century Community Learning Centers' Local Evaluation Travis C 641 Fri, 3:35 PM to 4:20 PM Multipaper Engaging Practitioners in the Medical Field to Build Evaluation Capacity Presidio B 677 Fri, 4:30 PM to 6:00 PM Panel From Compliance to Reliance: Critical Moments in Integrating Evaluation Into an Organization‘s Work Travis C 681 Fri, 4:30 PM to 6:00 PM Demonstration Using the Comprehensive Organizational Assessment Tool to Diagnose and Evaluate Organizational Capacity Presidio B 690 Fri, 4:30 PM to 6:00 PM Panel Strategy as Evaluand: Quality and Utilization Issues in Evaluating Strategy Texas E 720 Sat, 8:00 AM to 9:30 AM Panel Measuring Evaluation Capacity to Enhance Quality of ECB Activities in Federal Public Health and Systemic Change Programs Presidio B 731 Sat, 8:00 AM to 9:30 AM Demonstration Strategies for Developing Evaluation Capacity in Educational Partnerships Texas E 756 Sat, 10:00 AM to 10:45 AM Think Tank Strengthening the Learning Culture Within Organizations and Projects Travis C 757 Sat, 10:00 AM to 10:45 AM Multipaper Building Capacity in Community-Level Organizations Travis D 760 Sat, 10:00 AM to 10:45 AM Panel Evaluation Capacity Building Through State Affiliates Presidio B 800 Sat, 10:55 AM to 12:25 PM MultiPaper A Radically Different Approach to Evaluator Competencies Presidio B 836 Sat, 1:45 PM to 2:30 PM Panel Quick and Quality Level Three Evaluations for Corporate Staff Learning Travis C 840 Sat, 1:45 PM to 2:30 PM Demonstration Using Logic Models to Build Evaluation Capacity at the Community Level: Enhancing Program Effectiveness by Building Evaluation… Presidio B 851 Sat, 1:45 PM to 2:30 PM MultiPaper Deeper Implementation of the Student Success Learning to Eighteen Strategy Through Developmental Evaluation Texas E 880 Sat, 2:50 PM to 4:20 PM Multipaper Increasing Evaluation Capacity Through Different Levels of Training and Support Presidio B Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 236 Index of Sessions for the Pre-K - 12 Educational Evaluation TIG # Time Session Type Session Title Room Name 109 Wed, 4:30 PM to 6:00 PM Roundtable Rotation I: Increasing Nonprofit Sustainability Activities With Effective Request for Proposals (RFP's): A Mixed Methods Evaluation… Rotation II: Improving the Process of Reviewing Research Proposals: Reflections of a Research Review Committee Mission B 123 Wed, 4:30 PM to 6:00 PM Roundtable Rotation I: Evaluating the Effects of Year-Long Professional Development on Teachers: Final Refinement of UCLA‘s Center X… Rotation II: Evaluation Quality in Measuring Teacher Quality: The Impact of the Targeted Assistance Coaching Model on LEA… Bonham A 125 Wed, 4:30 PM to 6:00 PM Panel Managing Quality Through the Stages of Science, Technology, Engineering and Mathematics (STEM) Educational Evaluation Bonham C 126 Wed, 4:30 PM to 6:00 PM Multipaper Evaluating Supplementary Programs in Educational Settings Bonham D 223 Thu, 9:15 AM to 10:45 AM Roundtable Rotation I: Learning About Educational Reform From a Seven-Year Math-Science Partnership Rotation II: When Quality and Policy Collide in Evaluating Math-Science Partnership Programs: Strategies for Resolution Bonham A 225 Thu, 9:15 AM to 10:45 AM Multipaper Evaluating K-8 Literacy Programs: Methods and Models Bonham C 226 Thu, 9:15 AM to 10:45 AM Multipaper Methods Leading to Higher Quality Evaluations in Education Evaluation Bonham D 254 Thu, 10:55 AM to 12:25 PM Roundtable Rotation I: Choices of Research and Development (R&D) Evaluation Approaches in (CAS) Institutes: We Reap What We Sow? Rotation II: Producing Evidence of Effectiveness Data in the Real World of Early Childhood Education San Jacinto 265 Thu, 10:55 AM to 12:25 PM Multipaper Group and Cluster Randomized-Control Experimental Interventions in Educational Evaluation Studies Bonham C 266 Thu, 10:55 AM to 12:25 PM Panel Integrating High Quality Evaluation Into a National Integrated Services in Schools Initiative Bonham D 305 Thu, 1:40 PM to 3:10 PM Multipaper Current Topics in Educational Evaluation: An Eclectic Set of Noteworthy Projects Bonham C 306 Thu, 1:40 PM to 3:10 PM Multipaper Methods and Models for Evaluating Pre-Kindergarten and School Readiness Programs Bonham D 345 Thu, 3:35 PM to 4:20 PM MultiPaper Concordances: Development and Appropriate Uses Bonham C 346 Thu, 3:35 PM to 4:20 PM Multipaper Building Evaluation Capacity Among School Leaders Bonham D 385 Thu, 4:30 PM to 6:00 PM Multipaper Education Evaluation: Connecting Professional Development to Changes in Classroom Practice Bonham C 386 Thu, 4:30 PM to 6:00 PM Multipaper Addressing Schools as Organizations in Educational Evaluation Bonham D 496 Fri, 7:00 AM to 7:50 AM Business Meeting PreK-12 Educational Evaluation TIG Business Meeting Bonham C 525 Fri, 9:15 AM to 10:45 AM Multipaper Evaluating Science, Technology, Engineering, and Mathematics (STEM) Initiatives in K-12 Education Bonham C 526 Fri, 9:15 AM to 10:45 AM Panel Evaluating Literacy Curricula for Adolescents: Results From Three Years of Striving Readers Bonham D 565 Fri, 10:55 AM to 11:40 AM Expert Lecture Is Working Together Worth It? The Process and Findings of a Longitudinal Evaluation of a Districtwide Professional Learning … Bonham C 566 Fri, 10:55 AM to 11:40 AM Multipaper Evaluating Education Programs for English Language Learners Bonham D 605 Fri, 1:40 PM to 3:10 PM Think Tank Teacher Effectiveness and Teacher Quality: What's the Difference? Bonham C 606 Fri, 1:40 PM to 3:10 PM Multipaper Fidelity of Program Implementation in Educational Evaluations Bonham D 643 Fri, 3:35 PM to 4:20 PM Roundtable The Cost of Delayed Start: Effect of Early Algebra on End of High School, Transition to College, and End-of-College STEM Participation Bonham A 645 Fri, 3:35 PM to 4:20 PM Multipaper Meta-reviews in Rural Education and Reading Interventions Bonham C 646 683 Fri, 3:35 PM to 4:20 PM Fri, 4:30 PM to 6:00 PM MultiPaper Roundtable Applying Evaluation to Improve Learning Outcomes: Scaling Up From Small Schools to a Million Students Rotation I: Evaluating K-12 Professional Development: Implementation of the SIOP Model Rotation II: School Climate: A Comprehensive Data Collection and School Improvement System Bonham D Bonham A Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 237 Index of Sessions for the Pre-K - 12 Educational Evaluation TIG, continued 685 Fri, 4:30 PM to 6:00 PM Multipaper Current Issues in Evaluating High School Programs Bonham C 686 Fri, 4:30 PM to 6:00 PM MultiPaper Improving Evaluation Quality: A Focus on Better Measures of Implementation Bonham D 724 Sat, 8:00 AM to 9:30 AM Skill-building Systems and Logic Models as Complementary Tools for Educational Evaluation Bonham C 725 Sat, 8:00 AM to 9:30 AM Panel Classroom Observations: Lessons Learned About Five Protocols From Five Multi-site Education Evaluations Bonham D 731 Sat, 8:00 AM to 9:30 AM Demonstration Strategies for Developing Evaluation Capacity in Educational Partnerships Texas E 749 Sat, 10:00 AM to 10:45 AM Multipaper Evaluation of Interventions and Assessments of Individuals With Disabilities Mission B 764 Sat, 10:00 AM to 10:45 AM MultiPaper Promoting Truth and Justice: Evaluation‘s Role in Teacher Education Programs for Candidates From Underrepresented Populations Bonham C 765 Sat, 10:00 AM to 10:45 AM Think Tank Evaluating Twenty-first Century Skills Bonham D 802 Sat, 10:55 AM to 12:25 PM Roundtable Bonham A 804 Sat, 10:55 AM to 12:25 PM Multipaper Rotation I: Overcoming Data Quality Challenges to Evaluation of School-based Programs Rotation II: Standardizing Literacy Data Analyses and Reporting Across Multiple Instruments and Grades Practical Issues in Educational Measurement and Assessment 844 Sat, 1:45 PM to 2:30 PM Panel Fidelity Instruments and School Burden Bonham C 845 Sat, 1:45 PM to 2:30 PM Multipaper Assessing the Use of Test Score Data to Inform Decisions About Student Achievement Bonham D 851 Sat, 1:45 PM to 2:30 PM MultiPaper Deeper Implementation of the Student Success Learning to Eighteen Strategy Through Developmental Evaluation Texas E 869 Sat, 2:50 PM to 4:20 PM MultiPaper Evaluating Special Education Personnel Development Initiatives in Three Predominately Rural States: Emphasis on Fidelity… Mission B 882 Sat, 2:50 PM to 4:20 PM Roundtable Adaptations to Evaluation Design: Two Examples of Ensuring Quality in Practice Bonham A 884 Sat, 2:50 PM to 4:20 PM Multipaper Evaluating the State of Charter Schools and Public Schools of Choice Bonham C 887 Sat, 2:50 PM to 4:20 PM MultiPaper Straw, Bricks, Construction: Improving Quality of Education Data, Performance Measures, and Evaluation to Enhance Student… Texas A Bonham C Index of Sessions for the Program Theory and Theory-driven Evaluation TIG # Time Session Type Session Title Room Name 203 Thu, 9:15 AM to 10:45 AM Panel Implementation From the Ground Up: Defining, Promoting, and Sustaining Fidelity at All Levels of a State Program Lone Star B 243 Thu, 10:55 AM to 12:25 PM Multipaper Improving the Practice of Theory-driven Evaluation: Understanding the Role of Stakeholders and Context in Evaluation Settings Lone Star B 543 Fri, 10:55 AM to 11:40 AM Multipaper Examples From the Field: Using Mixed Methodological Frameworks in Theory-Driven Evaluations Lone Star B 623 Fri, 3:35 PM to 4:20 PM Multipaper Using Quantitative Analyses in the Development and Testing of Theories of Change Lone Star B 663 Fri, 4:30 PM to 6:00 PM Panel Systems Perspectives on Using Logic Models to Improve Evaluation Quality Lone Star B 703 Sat, 8:00 AM to 9:30 AM Panel Theory of Change Online: Implications for Participatory Planning and Evaluation Using Technology Lone Star B 742 Sat, 10:00 AM to 10:45 AM Business Meeting TIG Business Meeting and Panel: Improving Evaluation Quality by Improving Program Quality: A Theory-based… Lone Star A 823 Sat, 1:45 PM to 2:30 PM Panel Culturally Responsive Theory-driven Evaluation: Understanding and Accurately Reflecting Cultural Contexts in Program Evaluation Lone Star B Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 238 Index of Sessions for the Qualitative Methods TIG # Time Session Type Session Title Room Name 269 Thu, 10:55 AM to 12:25 PM Skill-building Circular Dialogue and Other Dialectical Methods of Inquiry Texas B 314 Thu, 1:40 PM to 3:10 PM Panel Quality in Evaluation: How Do We Know It When We See It in Qualitative Evaluations? Crockett A 349 Thu, 3:35 PM to 4:20 PM Demonstration Techniques and Tools for Reporting and Communicating Evaluation Findings Using NVivo Texas B 429 Thu, 6:10 PM to 7:00 PM Business Meeting Qualitative Methods TIG Business Meeting Texas B 520 Fri, 9:15 AM to 10:45 AM Demonstration Does Sensemaker Make Sense? Evaluating Development Initiatives Through Narrative Capture and Tagging in Kenya and Latin America Presidio A 538 Fri, 9:15 AM to 10:45 AM Demonstration Assessing the Quality of Research Instruments Using Cognitive Lab Methodology: A Practical Discussion and Lessons Learned Seguin B 576 Fri, 10:55 AM to 11:40 AM Multipaper Using Qualitative Methods in Evaluations With Limited Resources Seguin B 616 Fri, 1:40 PM to 3:10 PM Multipaper Reaching for the Pot of Gold: Tested Techniques for Enhancing Evaluation Quality With Trustworthiness and Authenticity Seguin B 768 Sat, 10:00 AM to 10:45 AM Multipaper Where Do Values Enter Into Evaluations? Texas B 777 Sat, 10:00 AM to 10:45 AM Multipaper Exploring the Role of Software in Qualitative Analysis Seguin B 832 Sat, 1:45 PM to 2:30 PM Roundtable Use of Implementation Rubrics as Indicators of Evaluation Quality Goliad 888 Sat, 2:50 PM to 4:20 PM Demonstration Web Dialogues: A New Tool for Evaluators Texas B Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 239 Index of Sessions for the Quantitative Methods: Theory and Design TIG # Time Session Type Session Title Room Name 106 Wed, 4:30 PM to 6:00 PM Panel Place Randomized Trials and Alternatives in a Field Setting: Examples From Psychotherapy Research Lone Star E 114 Wed, 4:30 PM to 6:00 PM Roundtable Rotation I: Non-response Bias a Limitation: Practical Perspectives of Evaluation Quality Using Survey and Questionnaire Data Rotation II: Coding Open-Ended Survey Items: A Discussion of Codebook Development and Coding Procedures San Jacinto 120 Wed, 4:30 PM to 6:00 PM Panel Innovative Applications of Propensity Scores and Propensity Score Methodology Adjustments to Address Data Constraints Presidio A 206 Thu, 9:15 AM to 10:45 AM Panel Comparative Effectiveness Research in Program Evaluation Lone Star E 220 Thu, 9:15 AM to 10:45 AM Multipaper Back to the Basics and Beyond Presidio A 246 Thu, 10:55 AM to 12:25 PM Business Meeting Quantitative Methods Theory and Design TIG Business Meeting and Presentation: What is New in Multiple Comparison Procedures Lone Star E 259 Thu, 10:55 AM to 12:25 PM Multipaper Implementing Quality Randomized Control Trials in Human Service Evaluations: Applications Addressing Challenges and Barriers Independence 286 Thu, 1:40 PM to 3:10 PM Demonstration Estimating Rater Consistency: Which Method Is Appropriate? Lone Star E 300 Thu, 1:40 PM to 3:10 PM MultiPaper Propensity Score Matching: Further Methodological Development Presidio A 326 Thu, 3:35 PM to 4:20 PM MultiPaper Bayesian Mixture Modeling Versus Traditional Meta-analysis: Examining the Treatment Advantage Research Using Three… Lone Star E 366 Thu, 4:30 PM to 6:00 PM Demonstration Fundamentals of Power Analysis and Sample Size Determination Lone Star E 380 Thu, 4:30 PM to 6:00 PM Multipaper Assessing Change Over Time Presidio A 506 Fri, 9:15 AM to 10:45 AM Panel Promoting Quality Impact Studies: Constructive, Context-Appropriate Policies for Strengthening Research Designs for Impact… Lone Star E 546 Fri, 10:55 AM to 11:40 AM Demonstration Using Latent Class Analysis to Target and Tailor Programs to Specific Populations Lone Star E 586 Fri, 1:40 PM to 3:10 PM Panel Enhancing the Quality of Evaluations by Rational Planning Lone Star E 600 Fri, 1:40 PM to 3:10 PM Multipaper Structural Equation Modeling Solutions for Evaluators Presidio A 626 Fri, 3:35 PM to 4:20 PM Demonstration Using Regression Discontinuity Designs for Program Evaluation Lone Star E 666 Fri, 4:30 PM to 6:00 PM Panel The Case for Brief(er) Measures Lone Star E 680 Fri, 4:30 PM to 6:00 PM Demonstration Basic Change: Examining a Simple Design From Multiple Approaches Presidio A 706 Sat, 8:00 AM to 9:30 AM Demonstration Applications of Multiple Regression for Evaluators Lone Star E 719 Sat, 8:00 AM to 9:30 AM MultiPaper A Practical Comparison of Longitudinal Data Analysis Methods Presidio A 746 Sat, 10:00 AM to 10:45 AM Expert Lecture Ten Steps to Making Evaluations Matter: Designing Evaluations to Exert Influence Lone Star E 786 Sat, 10:55 AM to 12:25 PM Demonstration Using Rasch Measurement to Strengthen Evaluation Designs and Outcomes Lone Star E 799 Sat, 10:55 AM to 12:25 PM Multipaper Application of Propensity Score Analysis in Assessing Outcomes Presidio A 826 Sat, 1:45 PM to 2:30 PM Multipaper A Closer Look at Non-Equivalent Designs in Evaluation Lone Star E 838 Sat, 1:45 PM to 2:30 PM Multipaper Applications and Issues With Regression Discontinuity Design Independence 866 Sat, 2:50 PM to 4:20 PM Demonstration What Am I Supposed to Do With Three-Way Crosstabs? An Introduction to Log Linear Models Lone Star E Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 240 Index of Sessions for the Research on Evaluation TIG # Time Session Type Session Title Room Name 233 Thu, 9:15 AM to 10:45 AM Panel New Directions for Research on Evaluation Texas F 272 Thu, 10:55 AM to 12:25 PM Panel Mainstreaming Evaluation in Diverse Organizational Contexts Texas E 353 Thu, 3:35 PM to 4:20 PM Business Meeting Research on Evaluation TIG Business Meeting Texas F 393 Thu, 4:30 PM to 6:00 PM Multipaper Research on Evaluation Standards and Methods Texas F 502 Fri, 9:15 AM to 10:45 AM Panel Equity and Quality in Evaluation: Ideas and Illustrations From the Field Lone Star A 554 Fri, 10:55 AM to 11:40 AM Roundtable Utilizing Metaevaluation to Validate Evaluation Quality: Study of a Grant-Funded Graduate Program for Minority Group Students… San Jacinto 579 Fri, 10:55 AM to 11:40 AM Multipaper The Basis for Good Judgment in Evaluation Republic C 611 Fri, 1:40 PM to 3:10 PM Panel Snapshots of Exemplary Evaluations Texas F 691 Fri, 4:30 PM to 6:00 PM Multipaper Research on Data Collection Approaches Texas F 732 Sat, 8:00 AM to 9:30 AM Multipaper Studies of Evaluation Practice Across Multiple Contexts Texas F 812 Sat, 10:55 AM to 12:25 PM Multipaper Research on Participatory Evaluation Texas F 852 Sat, 1:45 PM to 2:30 PM Multipaper Research on Evaluator Competencies Texas F Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 241 Index of Sessions for the Research, Technology, and Development Evaluation TIG # Time Session Type Session Title Room Name 231 Thu, 9:15 AM to 10:45 AM Panel Analysis and Evaluation of Research Portfolios Using Quantitative Science Metrics: Practice Texas D 254 Thu, 10:55 AM to 12:25 PM Roundtable Rotation I: Choices of Research and Development (R&D) Evaluation Approaches in (CAS) Institutes: We Reap What We Sow? Rotation II: Producing Evidence of Effectiveness Data in the Real World of Early Childhood Education San Jacinto 271 Thu, 10:55 AM to 12:25 PM Panel Analysis and Evaluation of Research Portfolios Using Quantitative Science Metrics: Theory Texas D 311 Thu, 1:40 PM to 3:10 PM Demonstration Third Generation Research Knowledge Tracking: Citation Analyses Texas D 343 Thu, 3:35 PM to 4:20 PM Roundtable Methodological Issues in Evaluating Potentially Transformative Research Bonham A 387 Thu, 4:30 PM to 6:00 PM Panel Evaluating the Science of Discovery in Complex Health Systems: Challenges and Opportunities Bonham E 391 Thu, 4:30 PM to 6:00 PM Panel Linking Professional Associations to Advance the Study of Science and Innovation Policy Texas D 431 Thu, 6:10 PM to 7:00 PM Business Meeting Research, Technology and Development Evaluation TIG Business Meeting Texas D 513 Fri, 9:15 AM to 10:45 AM Roundtable Rotation I: Big Money, More Scrutiny: How to Forge Evaluator-Early Childhood Education Program Partnerships in Order to Produce… Rotation II: A Study on the Indicator of High Quality Papers: The Case of Casualty Actuarial Society (CAS) Goliad 527 Fri, 9:15 AM to 10:45 AM Panel Challenges and Best Practices in Benefit Cost Studies of Research and Technology Programs Bonham E 531 Fri, 9:15 AM to 10:45 AM MultiPaper Recent Developments in Research and Development Evaluation: The Academic Side Texas D 567 Fri, 10:55 AM to 11:40 AM Multipaper From Research to Commercialization: Impact Evaluation of Portfolios of Research Bonham E 569 Fri, 10:55 AM to 11:40 AM Multipaper Evaluating Government Research and Technology Policies: Traditional and Emerging Methods Texas D 609 Fri, 1:40 PM to 3:10 PM MultiPaper Report on a Test of a General Method for Quick Evaluation of Medical Research by Morbidity Texas D 649 Fri, 3:35 PM to 4:20 PM Demonstration Assessing Faculty Productivity and Institutional Research Performance: Using Publication and Citation Key Performance Indicators Texas D 689 Fri, 4:30 PM to 6:00 PM Think Tank Your Input, Please: RTD TIG Draft User‘s Guide to Conducting Research and Development Evaluation Texas D 726 Sat, 8:00 AM to 9:30 AM Panel Interim Evaluation: The Quality of Research and the Quality of Evaluation - Case Study of the FP7 Interim Evaluation Bonham E 730 Sat, 8:00 AM to 9:30 AM Panel Metrics for NIEHS: Measuring Outcomes to Advance Partnerships for Environmental Public Health Texas D 766 Sat, 10:00 AM to 10:45 AM Multipaper Systems of Evaluation for Diverse National Portfolios of Research: Lessons From Russia and Finland Bonham E 770 Sat, 10:00 AM to 10:45 AM Multipaper Evaluating Contributions to Knowledge Translation for New Technologies or Medical Treatments Texas D 810 Sat, 10:55 AM to 12:25 PM MultiPaper Evaluation of National Research and Development (R&D) Programs as a Tool for Increasing Efficiency of Public Finance Texas D 850 Sat, 1:45 PM to 2:30 PM Multipaper Informing Portfolio Management Using Tracking Systems and Bibliometrics Texas D 886 Sat, 2:50 PM to 4:20 PM Multipaper Improving Proposals and Programs by Improving Peer and Stakeholder Review Bonham E 890 Sat, 2:50 PM to 4:20 PM MultiPaper Evaluation System of Research, Technology, and Development (RT&D) to Induce Innovation: Strategy, Process, and Reflection Texas D Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 242 Index of Sessions for the Social Network Analysis TIG # Time Session Type Session Title Room Name 295 Thu, 1:40 PM to 3:10 PM Demonstration Why Settle for Silos? Four Applications of Social Network Analysis for Building More Effective Organizational Networks… Travis A 410 Thu, 6:10 PM to 7:00 PM Business Meeting Social Network Analysis TIG Business Meeting Bowie A 595 Fri, 1:40 PM to 3:10 PM Multipaper Social Network Analysis Across Disciplines and Purposes Travis A 675 Fri, 4:30 PM to 6:00 PM Demonstration How to Cast Your Net: Network Analysis Techniques in Public Health Evaluation Travis A 775 Sat, 10:00 AM to 10:45 AM Expert Lecture Longitudinal Social Network Analysis: An Understanding of This Dynamic Network Approach Crockett C 855 Sat, 1:45 PM to 2:30 PM Expert Lecture Reading Sociograms Crockett C 895 Sat, 2:50 PM to 4:20 PM Think Tank The Network of Network Funders: Evaluating Networks and Evaluating with a Network Lens Crockett C Index of Sessions for the Social Work TIG # Time Session Type Session Title Room Name 209 Thu, 9:15 AM to 10:45 AM Multipaper Evaluating the Intervention: A Look at Clinical Treatments and Client Implications Mission B 333 Thu, 3:35 PM to 4:20 PM Roundtable Enhancing Evaluation Quality in a Developing Context: A South African Case Study Goliad 409 Thu, 6:10 PM to 7:00 PM Business Meeting Social Work TIG Business Meeting and Presentation: Evaluation in Social Work Education Practice Mission B 629 Fri, 3:35 PM to 4:20 PM Multipaper Program Fidelity and Development in Social Work Mission B Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 243 Index of Sessions for the Systems in Evaluation TIG # Time Session Type Session Title Room Name 110 Wed, 4:30 PM to 6:00 PM Skill-building A Tool for Designing Evaluations of Paradigm Shifts in Complex System Interventions Bowie A 210 Thu, 9:15 AM to 10:45 AM MultiPaper Using a Multi-stage, Mixed Methods Approach to Improve the Design of System Change Evaluations Bowie A 250 Thu, 10:55 AM to 12:25 PM Think Tank Systems Theories in Evaluation Planning: Differentiating Planning Process from Evaluation Plan Bowie A 283 Thu, 1:40 PM to 3:10 PM Multipaper From Agent-Based Modeling to Cynefin: The ABC's of Systems Frameworks for Evaluation Lone Star B 307 Thu, 1:40 PM to 3:10 PM Panel Grappling With Uncertainty in Innovative and Complex Settings: Weaving Quality in Developmental Evaluation Bonham E 323 Thu, 3:35 PM to 4:20 PM Expert Lecture Developmental Evaluation for Complex Systems: Quality as Speed and Adaptability Lone Star B 363 Thu, 4:30 PM to 6:00 PM Business Meeting Systems in Evaluation TIG Business Meeting and Presentation: Meet and Greet With Systems in Evaluation Authors Lone Star B 381 Thu, 4:30 PM to 6:00 PM Panel A Systems Approach to Building and Assessing Evaluation Plan Quality Presidio B 503 Fri, 9:15 AM to 10:45 AM Think Tank Model Forms, Program Theory, And Unexpected Behavior: What Are the Implications For Program Implementation and Evaluation? Lone Star B 520 Fri, 9:15 AM to 10:45 AM Demonstration Does Sensemaker Make Sense? Evaluating Development Initiatives Through Narrative Capture and Tagging in Kenya and Latin America Presidio A 550 Fri, 10:55 AM to 11:40 AM Panel The Adaptive Action Cycle: Bridging the Gap Between Lessons Learned and Lessons Applied Bowie A 583 Fri, 1:40 PM to 3:10 PM Skill-building Fitting the Key to the Lock: Matching Systems Methods To Evaluation Questions Lone Star B 597 Fri, 1:40 PM to 3:10 PM Multipaper Real World Applications of System Concepts in Evaluation Travis C 630 Fri, 3:35 PM to 4:20 PM MultiPaper The Role of Collaboratives in Promoting Community and Systems Changes Bowie A 663 Fri, 4:30 PM to 6:00 PM Panel Systems Perspectives on Using Logic Models to Improve Evaluation Quality Lone Star B 710 Sat, 8:00 AM to 9:30 AM MultiPaper Framework for Orchestrating Systems Transformation: Theory and Practice for Promoting Dynamic Systems Change Bowie A 743 Sat, 10:00 AM to 10:45 AM Demonstration Expanding Evaluation‘s Utility and Quality Through System-Oriented Data Synthesis Lone Star B 790 Sat, 10:55 AM to 12:25 PM MultiPaper The Home Energy Audit: An Exercise in Complex Systems Thinking for Practitioners and Evaluators Alike Bowie A 830 Sat, 1:45 PM to 2:30 PM Panel BUILD-ing an Institute for Child Success: The Statewide Systems Design for the South Carolina Institute for Child Success Bowie A 863 Sat, 2:50 PM to 4:20 PM Think Tank Integrating Evaluation Into Everyday Organizational Practice: A Complex Systems Perspective Lone Star B Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Page 244 Index of Sessions for the Teaching of Evaluation TIG # Time Session Type Session Title Room Name 129 Wed, 4:30 PM to 6:00 PM Demonstration Using an Interest-Driven Project to Teach Program Planning and Evaluation Crockett B 213 Thu, 9:15 AM to 10:45 AM Roundtable Rotation I: Engaging Social Justice in a Graduate Course on Program Evaluation Rotation II: Issues of Quality: Guiding Principles for Culturally Competent Teaching and Practice Goliad 315 Thu, 1:40 PM to 3:10 PM Multipaper Strategies for Preparing Quality Evaluation Practitioners Crockett B 435 Thu, 6:10 PM to 7:00 PM Business Meeting TIG Business Meeting and Presentations: Critical Concepts for Introductory Evaluation Courses: Multiple Perspectives- Part 1 Crockett B 535 Fri, 9:15 AM to 10:45 AM Multipaper Teaching About Specific Aspects of Evaluation Crockett B 593 Fri, 1:40 PM to 3:10 PM Roundtable Rotation I: The Essentials of a Quality Evaluation Capstone Project, Practicum or Internship: Students‘ Perspectives Rotation II: An Evaluation Seminar: How our Students Gain Practical Experience in Evaluation and Research Methodology Goliad 693 Fri, 4:30 PM to 6:00 PM Multipaper Teaching Through an Interdisciplinary Focus Crockett B 734 Sat, 8:00 AM to 9:30 AM Demonstration Critical Concepts for Introductory Evaluation Courses: Multiple Perspectives- Part 2 Crockett B 792 Sat, 10:55 AM to 12:25 PM Roundtable Rotation I: Who Do They Think We Are? Issues and Dilemmas Raised by Others' Perceptions of Evaluators and Evaluation Rotation II: Resources to Guide Non-evaluators in the Design of Educational Program Evaluations Goliad 793 Sat, 10:55 AM to 12:25 PM Roundtable Rotation I: Evaluation in Late Victorian Literature San Jacinto Rotation II: Epistemological distinctions and values in the evaluation process: A reflective analysis on the quality standards of truth… 814 Sat, 10:55 AM to 12:25 PM MultiPaper Experiencing Quality in Evaluation Training in Brazil and Ethiopia Crockett B 894 Sat, 2:50 PM to 4:20 PM Panel Expanding Our Knowledgebase: Current Research on Teaching Evaluation Crockett B Index of Sessions for the Theories of Evaluation TIG # Time Session Type Session Title Room Name 229 Thu, 9:15 AM to 10:45 AM Panel Evaluating With Validity: Truth, Justice, and the Beautiful Way Texas B 361 Thu, 3:35 PM to 4:20 PM Business Meeting Theories of Evaluation TIG Business Meeting Republic C 389 Thu, 4:30 PM to 6:00 PM MultiPaper Using Logic Models to Facilitate Comparisons of Evaluation Theory Texas B 523 Fri, 9:15 AM to 10:45 AM Roundtable Towards Translational Process Evaluation: Implementation, Fidelity, Integration, and Sustainability – A Roundtable Discussion Bonham A 579 Fri, 10:55 AM to 11:40 AM Multipaper The Basis for Good Judgment in Evaluation Republic C 780 Sat, 10:00 AM to 10:45 AM Multipaper Contextual Influences on the Evaluator, the Evaluation, and the Evaluation Design Republic C 793 Sat, 10:55 AM to 12:25 PM Roundtable Rotation I: Evaluation in Late Victorian Literature San Jacinto Rotation II: Epistemological distinctions and values in the evaluation process: A reflective analysis on the quality standards of truth… 860 Sat, 1:45 PM to 2:30 PM MultiPaper Let Quality Guide Evaluation Quality: Recent Trends Implemented in the Middle East Evaluation 2010: Appendix B – Directory of Sessions by Sponsor Republic C Page 245 Appendix C: Directory of Exhibitors The exhibits may be found outside of the Texas Ballroom on Level Two and the Lone Star Ballroom on Level Four. The exhibits are open from 8:00 am to 5:00 pm on Thursday and Friday, November 11 and 12, and from at least 8:00 am to 12:00 pm on Saturday, November 13. Some exhibits will also be open on Wednesday, at their discretion. Academic Management Systems: CoursEval™, Academic Management Systems web-based software, allows institutional users to evaluate courses and faculty online, typically replacing the paper process. Our software provides a means to create, deploy, and analyze results over time and across courses, departments and schools. CoursEval™ can also be used to conduct formative midcourse evaluations or to create evaluations for clinical evaluations for block schedule courses. CoursEval™ will also support selfassessment activities and has a new feature that allows faculty to 'reflect' on their results as part of the reporting process. Please visit our website at http://www.academicmanagement.com or call 716-867-8434. Alberta Innovates Health Solutions: Created in 2010 as part of a newly aligned research and innovation system in the province of Alberta, Canada building on its 30-year history as Alberta Heritage Foundation for Medical Research. Mandate is to support health research and innovation in key areas to improve the health and socioeconomic wellbeing of Albertans. One of its programs, the Alberta Research Ethics Community Consensus Initiative (ARECCI), has successfully pioneered tools, methodologies, and networks in the area of ethics in applied projects (evaluation).The ARECCI project ethics courses and online decision guides will be featured at this conference. See http://www.ahfmr.ab.ca/arecci. Annie E Casey Foundation: Annie e Casey Foundation is a private charitable organization dedicated to helping build better futures for disadvantaged children in the United States. It was established in 1948 by Jim Casey, one of the founders of UPS, and his siblings, who named the Foundation in honor of their mother. The primary mission of the Foundation is to foster public policies, human-service reforms, and community supports that more effectively meet the needs of today's vulnerable children and families. For more information, please see http://www.aecf.org/ and also our KnowledgeCenter http://www.aecf.org/KnowledgeCenter.aspx and KIDS COUNT Data Center http://datacenter.kidscount.org. Annie E Casey Foundation is sponsoring, but does not have an exhibit table. Battelle: As the world‘s largest independent research and development organization, Battelle provides innovative solutions to the world‘s most pressing needs through its four global businesses: Laboratory Management, National Security, Energy Technology, and Health and Life Sciences. Battelle advances scientific discovery and application by conducting $5.2 billion in global R&D annually through contract research, laboratory management and technology commercialization. Headquartered in Columbus, Ohio, Battelle oversees 20,400 employees in more than 130 locations worldwide, including seven national laboratories which Battelle manages or co-manages for the U.S. Department of Energy and the U.S. Department of Homeland Security. Battelle is also one of the nation‘s leading charitable trusts focusing on societal and economic impact and actively supporting and promoting science and math education. http://www.battelle.org Claremont Graduate University: Located in Southern California, Claremont Graduate University (CGU) is one of the leading providers of education and training in Evaluation and Applied Research Methods. CGU offers one of the largest graduate programs in evaluation, with evaluation concentrations at the MA and PhD level. CGU also offers distance-based Certificate Programs that stress rigorous training and a high level of competence and an array of online and on-site workshops. CGU‘s research institutes perform evaluations for private and public clientele, utilizing world-renowned faculty and an extensive network of evaluation alumni. http://www.cgu.edu/pages/665.asp Compass Evaluation and Research: Compass Evaluation and Research is an evaluation and research consulting company dedicated to working jointly with clients to meet the challenges of developing and sustaining successful programs. Compass provides strategic planning, logic modeling, evaluation planning and design, complete implementation of evaluation activities, research support, and guidance in utilizing evaluation findings. Compass also provides technical assistance and training in all aspects of strategic planning, logic modeling, and evaluation activities. Compass grounds all of its work in a collaborative approach, which engages key program stakeholders throughout the evaluative process and promotes expanding the evaluation expertise of program staff. Compass balance its collaborative approach with independence and thoughtful adherence with accepted professional standards. Our commitment to our clients is to add value beyond expectations. Please contact us at http://www.compasseval.com. Evaluation 2010: Appendix C – Exhibitors Page 246 CUSO-VSO: CUSO-VSO is an international development organization that works through volunteers. As the North American member of the VSO Federation, CUSO-VSO works in over 40 countries and seven focus areas, including: Education, HIV and AIDS, Disability, Health and Social Well-being, Secure Livelihoods, Participation and Governance and Environment and Natural Resource Management. CUSO-VSO recruits skilled professionals from a variety of professional backgrounds to work in partnership with local or national organizations around the world. Volunteers are matched to placements that meet the direct requests of our overseas partners. They work to share skills and experiences with local colleagues, so their impact continues long after they return home. http://www.cuso-vso.org. DecisionEd Group: DecisionEd helps school administrators measure the performance of their district. Specializing in K12 data warehouse solutions, our solution provides authorized staff with a web-based environment to view data from all sources of the district, including assessment, finance, graduation trends, HR, discipline, program costs, IEP, etc., and cross analyze this data to make more informed decisions. This solution is designed as a turnkey, ready-to-go solution containing 245 pre-built reports and dashboards. For more information, visit http://www.DecisionEd.com. Empirical Education Inc: Empirical Education helps educators make cost effective decisions about instructional and professional development programs. Our research services assist districts, developers, and publishers in determining the effectiveness of programs, products, or services—before or after they are in place. Our commitment is to provide rigorous, independent, and objective evidence while remaining sensitive to the unique context of the local research site. We advocate for using evidence in policy decisions, and we provide information and recommendations to trade organizations, policy institutes, foundations, and government entities that make or influence policy and practice in education. http://www.empiricaleducation.com. The Evaluation Center at Western Michigan University: The Evaluation Center has over a 40-year history of providing national and international leadership for advancing the theory, practice, and utilization of evaluation. Unlike most evaluation units in academic settings, the Center is not affiliated with a single academic department or college. This reflects the transdisciplinary nature of evaluation and enables Center personnel to work effectively in an array of subject areas. See http://www.wmich.edu/evalctr/. The Center houses WMU's Interdisciplinary Ph.D. in Evaluation, which features practice-linked learning; more than 30 faculty members from 13 academic departments and The Evaluation Center; and a fully tailored, challenging curriculum. See http://www.wmich.edu/evalctr/idpe. Gravic Inc: Gravic makes software for assisting researchers and evaluators to collect and analyze data from paper and web forms (surveys, evaluations, assessments). Use any word processor to create and print your own plainpaper evaluations and then scan them with Remark Office OMR using an image scanner. Or, create, host and administer online surveys using Remark Web Survey. Host your own online forms; there are no form or respondent limitations. Use both products to combine data from paper and web evaluations. Easily generate analysis reports and graphs with Remark Quick Stats, a built-in analysis component. Or, export data to 35+ different formats (SPSS, Excel, ASCII, etc.). For more information visit our website http://www.gravic.com/remark. Guilford Publications: At Guilford Publications, we know that it can be a challenge to keep up with all the new developments in evaluation or to utilize a technique that you‘ve read about but haven‘t used. We‘re here to help. Come see our latest books, including those by AEA members: Developmental Evaluation by Michael Quinn Patton; Evaluation Essentials: From A to Z by Marv Alkin; Qualitative Research: Studying How Things Work by Bob Stake; Evaluation in the Face of Uncertainty by Jonathan Morell; Oral History for the Qualitative Researcher by Valerie Janesick; and, Hot off the Press—Robert Yin‘s Qualitative Research from Start to Finish. http://www.guilford.com. ICF International: ICF International (NASDAQ:ICFI) partners with government and commercial clients to deliver professional services and technology solutions in the energy and climate change; environment and infrastructure; health, human services, and social programs; and homeland security and defense markets. The firm combines passion for its work with industry expertise and innovative analytics to produce compelling results throughout the entire program life cycle, from research and analysis through implementation and improvement. Since 1969, ICF has been serving government at all levels, major corporations, and multilateral nstitutions. More than 3,500 employees serve these clients worldwide. ICF‘s Web site is http://www.icfi.com. Evaluation 2010: Appendix C – Exhibitors Page 247 Appendix C: Directory of Exhibitors Information Age Publishing: Information Age Publishing was founded in 1999 by George F. Johnson, IAP is a social science publisher of academic and scholarly book series and journals. IAP's goal is to develop a comprehensive list of book series, monographs and journals that break down and define specific niches that lack high-level research material in the fields of Education and Management. Our products will be offered in both print and electronic formats where possible. We at IAP sincerely hope to have you become a part of a new era in publishing as we grow. Visit us at http://www.infoagepub.com. Innovation Network Inc: The Innovation Network is a nonprofit evaluation, research, and consulting firm. We provide knowledge and expertise to help nonprofits and funders learn from their work to improve their results. Our AEA booth each year gives visitors the chance to talk with staff and learn about our services. We also offer materials featuring our most recent evaluation consulting projects and research results. For 2010, we will be spotlighting results from a ―State of Evaluation‖ survey of the U.S. nonprofit sector. Visit us at http://www.innonet.org. The International Program for Development Evaluation Training (IPDET): The International Program for Development Evaluation Training (IPDET) is an executive training program that aims to provide managers and practitioners the generic tools required to evaluate development policies, programs, and projects at the local, national, regional, and global levels. The program features a two-week Core Course, followed by two weeks of more than 25 in-depth workshops, all taught by a dynamic group of leading-edge international faculty drawn from Southern and Northern organizations. An intensive and unique training initiative of the Independent Evaluation Group of the World Bank and Carleton University, it is best known for its flagship training program offered each summer in Ottawa, Canada. Visit http://www.ipdet.org for more information. Jossey Bass, An Imprint of Wiley: Jossey Bass is a leading publisher for students and professionals in research methods and evaluation, including Evaluation Theory, Models, and Applications by (Stufflebeam and Shinkfield), Methods in Educational Research: From Theory to Practice, 2nd Edition (Lodico, Spaulding and Voegtle) and the forthcoming Purposeful Program Theory: Effective Use of Theories of Change and Logic Models (Funnell and Rogers). Wiley/Jossey-Bass also publishes the quarterly report series New Directions for Evaluation in partnership with the American Evaluation Association. http://www.josseybass.com; http://www.wiley.com. LYCEUM Books: Since its founding in 1988, LYCEUM Books has earned a reputation for excellence in the field of social service education. We are an independent publishing house with the editorial freedom to select books for the quality of their ideas, research, writing, and their usefulness to students and practitioners. http://www.lyceumbooks.com. Mathematica Policy Research: Mathematica Policy Research provides a range of research and evaluation services, including program evaluation, policy research, survey design and data collection, research methods and standards, and program management/data system support. Our program evaluations utilize impact and process analyses, quantitative and qualitative data collection, and administrative or other secondary data, depending on the needs of our clients. We have offices in Princeton, NJ; Ann Arbor, MI; Cambridge, MA; Chicago, IL; Oakland, CA; and Washington, DC and a staff of over 700. Our clients include federal and state governments, foundations, private-sector, nonprofit, and international organizations. Visit us at http://www.mathematicampr.com. Mosaic Network Inc: Mosaic Network provides data solutions and evaluation services to multi-site, multi-year human service initiatives. Our vision is to seamlessly integrate our expertise in the areas of research, evaluation, training, and information technology to promote the development of effective social services, with an aim to create healthier and stronger communities. To that end, we collaborate with funders, evaluators and researchers to translate their visions into effective data driven implementations, where results and the process of ascertaining results caters to the unique needs and perspectives of project stakeholders. For more information, please visit http://www.mosaic-network.com or call (805) 692-0992. National Science Foundation: The National Science Foundation is an independent United States federal agency, supports science and engineering (S&E) research, education and evaluation through an annual budget of about $6.9 billion. NSF funds grants and contracts to individuals, academic institutions, and for-profit and non-profit entities selected from over 42,000 proposals received annually. About 50,000 S&E experts volunteer to serve as NSF reviewers each year as part of the grant merit review process that selects promising proposals. Discover more about NSF online at http://www.nsf.gov/, or by phone at 703-292-5111 (TDD 800-281-8749). Evaluation 2010: Appendix C – Exhibitors Page 248 Provalis Research: Provalis Research is the world's leading developer of mixed methods research software with ground-breaking qualitative and quantitative analysis programs, such as QDA Miner, an innovative mixed-models qualitative data analysis software; Simstat, an easy yet powerful statistical software; and WordStat, a powerful add-on module for computer-assisted content analysis and text mining. One of the most distinctive features of these tools is their interoperability, allowing researchers to integrate numerical and textual data into a single project file and to seamlessly move back and forth between quantitative and qualitative data analysis, as well as to easily explore relationships between numerical and textual data. http://www.provalisresearch.com. QSR International: Evaluation programs are often multifaceted. You might be collecting and analyzing data from Word documents, PDFs and audio recordings, through to videos, digital photos and even database tables. QSR International‘s NVivo software helps users make sense of this material quickly and easily. Over 400,000 users in 150 countries use NVivo. From program to personnel evaluation, it removes many of the manual tasks associated with analysis, like classifying and sorting information, so there‘s more time to explore trends and arrive at answers to questions. Be amongst the first to see our new NVivo 9 software at Evaluation 2010. http://www.qsrinternational.com. SAGE: SAGE is an independent international publisher in the social sciences, technology and medicine-provides journals, books, and electronic media of the highest caliber. Researchers, students, and professionals have relied on our innovative resources for over 45 years. Please stop by our booth or visit us at http://www.sagepub.com. Stanford University Press: Stanford University Press is committed to educating and assisting today‘s evaluators and tomorrow‘s leaders in the field. SUP publishes books that stand at the intersection of scholarship and practice. Our books not only introduce readers to today‘s methodological toolkit, but also help them to put evaluation in context — by seeing their practice through the lens of organizational studies, education, and public policy. Please stop by our booth or visit us at http://www.sup.org. SurveyGizmo: SurveyGizmo is a software as a service (SaaS) company that provides software to create online surveys, quizzes, polls, and evaluations. SurveyGizmo is the only company in the market to serve the entire spectrum of survey users; sophisticated enough for advanced market research users while being accessible enough for corporations or small businesses. SurveyGizmo offers the most affordable solution in the industry for the level of sophistication, integration, flexibility, and high level of customer service provided. Contact SurveyGizmo at [email protected] or visit the website at http://www.surveygizmo.com. Westat: Westat is an employee-owned research corporation serving Federal, state, local, and international government agencies, businesses, nonprofit organizations, and foundations. In addition to our capabilities as a leading survey research and data collection and analysis organization, Westat has extensive skill and experience in evaluation, strategic planning, performance measurement, and quantitative/qualitative research methods across a broad range of subject areas. Westat offers a full-range of evaluation services to meet our clients‘ needs, including evaluation planning and design, implementation, data analysis, and reporting for process, implementation, and impact evaluation of programs and services at various stages of development. See our website at http://www.westat.com. WestEd: WestEd is a national nonpartisan, nonprofit research, development, and service agency, works with education and other communities to promote excellence, achieve equity, and improve learning for children, youth, and adults. Evaluation professionals at WestEd perform dozens of analyses each year, including evaluation studies, program design and policy formation, and professional development and training. These evaluations lead to better understanding of whether a program is effective, whether a policy is having the desired impact, whether a chosen approach is the most cost-effective way of accomplishing agreed-upon goals, and how an effort can be improved. To learn more, visit http://www.wested.org. Evaluation 2010: Appendix C – Exhibitors Page 249 Evaluation 2011: Values and Valuing in Evaluation In the fall of 2011, members and friends of AEA will convene in Anaheim, California – land of sun and sea, movie stars, perennial childhood (in nearby Disneyland), as well as an evocative mix of beliefs, traditions, and cultures. Like culture, evaluation is inherently imbued with values. Our work as evaluators intrinsically involves the process of valuing, as our charge is to make judgments about the “goodness” or the quality, merit or worth of a program. Judgments rest on criteria, which in turn reflect priorities and beliefs about what is most important. At Evaluation 2011, I would like us to take up the challenges of values and valuing in evaluation, particularly the plurality of values represented by different evaluation purposes and audiences, key evaluation questions, and quality criteria. I anticipate that greater attention to and openness in the value dimensions of our work can improve our practice, offer voice to diverse stakeholder interests, and enhance our capacity to make a difference in society. The richness and vitality of this conference theme will hopefully generate a wide and deep mixture of ideas, experiences, and insights. The major values underlying the conference theme itself, and thus expected discourse at the conference, include the legitimacy of different standpoints, respectful acceptance of others’ points of view, and norms of listening well to each other. As catalysts for forthcoming conference proposals, I offer the following starting points. First, in terms of the major anchors of values within the design of evaluation studies (purposes and audiences, key evaluation questions, and quality criteria): Which stakeholder interests should be given priority in an evaluation study, and how is this determination made? What strategies exist for evaluators to expand upon the given values in an evaluation context? (Given values are expressed in given purposes/audiences and the criteria for judging program quality, and may be conveyed in the request for proposals, in relevant policies, or in institutional norms.) How can evaluators be forthright and transparent about the values being promoted in their work? Second, as connected to the technical side of evaluators’ work: How do values show up in evaluation methodologies and analyses? How is the process of valuing enacted in evaluation’s design, implementation, and utilization? And third, as connected to the role of evaluation in society: What responsibilities do evaluators have for advancing a valuing of evaluation itself in society? What political role(s) should evaluation play in society? When and where should evaluation primarily serve the interests of the elite – existing policy and decision makers – and thus the status quo? What responsibilities does the evaluation profession have for giving voice to the interests of other legitimate stakeholders – to onsite program administrators, program staff, and especially intended program beneficiaries? I am grateful and humbled by this opportunity to serve as AEA’s president for 2011. And I look forward to celebrating AEA’s 25th at our next gathering in Anaheim CA. Jennifer Greene Jennifer Greene AEA 2011 President