Q&A with the developers - Brookes Publishing Co.
Transcription
Q&A with the developers - Brookes Publishing Co.
Case Two. A 10-year-old shows strong sound-word level skills on phonemic awareness and all the nonword tasks (repetition, reading and spelling), but scores significantly below age level on story retelling (immediate and delayed), as well as on subtests of listening and reading comprehension, vocabulary awareness, social communication, and written expression. A focus on phonics and phonological word structure would not be the best use of treatment time for this student. A better use of treatment time would be to focus on vocabulary, syntax, and discourse skills that could improve comprehension and expression across spoken and written communication modalities, preferably using the student’s actual curricular materials. Q. What are the next steps a school should take after a TILLS assessment? Does TILLS include guidance on what to do next? A. The results of the TILLS assessment can be used by Multidisciplinary Evaluation Teams in schools as a critical piece of valid and reliable evidence in deciding whether a student meets eligibility criteria as having a language impairment or learning disability. TILLS results also may be used to support more specific diagnoses. Consider the following examples: a. A diagnosis of dyslexia would be consistent with a pattern of low TILLS scores in sound and word structure knowledge, reading fluency, and reading comprehension, but higher TILLS scores in listening comprehension and story retelling. This is the upper left-hand corner of the quadrant model. b. A diagnosis of specific deficit in the area of comprehension would be consistent with a pattern of relatively better TILLS scores in sound and word structure knowl- edge and lower TILLS scores in both listening and reading comprehension, as well as problems with vocabulary awareness and social communication. This is the lower right-hand corner of the quadrant model. c. A diagnosis of general spoken-written language-impairment, which may also be called language-learning disability, would be consistent with a pattern of low skills across both language levels and all four modalities, although perhaps still with some areas of relative strength. This is the lower left-hand corner of the quadrant model. A companion tool, the TILLS Student Rating Scale, can be used to document parent, teacher, and student perceptions and priorities related to the student’s strengths and needs. Use of both tools is consistent with the requirements of IDEA that multiple methods and sources of input must be used to determine eligibility for services in schools. By considering the pattern of specific strengths and weaknesses for a given student, along with information on the TILLS Student Rating Scale, the team can prioritize intervention targets and know which areas of strength to draw on. Q. When will I be able to get TILLS? A. TILLS will publish in the summer of 2015. Learn more about TILLS Summer 2015 SAMPLER .3 .......................... .......4 .......................... .......................... ..5 .......................... .......................... .......................... TILLS ............. Introducing ls ....................................... .......................... ...................6 .......................... .......................... .....21 Test Materia Model ............. ................................................................. The TILLS tions ............. ............. .......................226 Subtest Descrip nt Model ............. ts’ Needs ............. ........................2 Quadra The TILLS to Understand Studen .......................... ..............27 ................................................................. Using TILLS Case Studies ............. Additional Asked Questions Frequently A produc Discover a better way to assess language and literacy skills! Find out more in this Q&A with the TILLS developers! d. If students’ scores fall in an area of marginal concern, school teams might decide to recommend further instruction in a response to intervention (RTI) model that does not include special education placement. TILLS could be readministered 6 months to a year later to add to other evidence regarding the student’s need for special education. the new ser look at Take a clo and literacy test language Coming TILLS™ is a groundbreaking assessment that tests listening, speaking, reading, and writing skills in students ages 6–18. Visit www.brookespublishing.com/tills to sign up for alerts, download a TILLS product brochure, and a FREE 28-page sampler that includes descriptions of test components and all 15 subtests, case studies, and frequently asked questions. Stay tuned for more information and updates as the official launch gets closer! Nickola Wolf Nelson, Ph.D., CCC-SLP Elena Plante, Ph.D., CCC-SLP Q. What’s the major goal of the TILLS assessment? What need does it satisfy? A. The major goal of the TILLS assessment is to identify oral and written language disorders and learning disabilities in school-age students (ages 6;0-18;11 years). TILLS is unique in assessing both oral AND written language in a manner that allows comparisons of a student’s sound-word and sentencediscourse level abilities across the four modalities of listening, speaking, reading, and writing. In addition, TILLS includes some subtests aimed directly at measuring aspects of memory that are relevant to classroom performance and performance on the other subtests. TILLS addresses three major assessment goals: • To identify students between the ages of 6 and 18 who have language and literacy impairments. • To provide information about patterns of language and literacy strengths and areas of concern that will guide next steps in assessment and intervention. • To track changes in students’ language and literacy abilities over time (intervals 6 months or longer). t of References Nancy Helm-Estabrooks, Sc.D., CCC-SLP Gillian Hotz, Ph.D., CCC-SLP Q. Can you tell us a little about how TILLS was developed? A. The four authors of TILLS (Nickola Nelson, Elena Plante, Nancy Helm-Estabrooks, and Gillian Hotz) have been working as a team for more than a decade to develop companion tools for assessing the cognitive-linguistic skills of two broad groups of school-age children and adolescents: 1) those affected by traumatic brain injury, and 2) those affected by developmental impairments of language and literacy including primary language disorder, learning disabilities, and dyslexia as well as language problems secondary to other conditions. The Test of Integrated Language and Literacy Skills™, or TILLS™, is a norm-referenced assessment for which standardization was completed in 2015. The authors based the theoretical model for TILLS at least partially on literature regarding differential diagnosis of spoken and written language disorders (Bishop & Snowling, 2004; Catts, Adlof, Hogan, & Ellis Weismer, 2005), which is represented with a quadrant model, as shown in the graphic on the next page. Bishop, D. V. M., & Snowling, M. J. (2004). Developmental dyslexia and specific language impairment: Same or different? Psychological Bulletin, 130, 858-886. Catts, H. W., Adlof, S. M., Hogan, T. P., & Ellis Weismer, S. (2005). Are specific language impairment and dyslexia distinct disorders. Journal of Speech-Language-Hearing Research, 48, 1378-1396. About the Developers MORE INSIDE! Nickola Wolf Nelson, Ph.D., CCC-SLP, is the Director of the PhD program in Interdisciplinary Health Sciences at Western Michigan University, Kalamazoo, Michigan. Elena Plante, Ph.D., CCC-SLP, is a Professor, Department of Speech, Language, and Hearing Sciences, The University of Arizona, Tucson. Nancy Helm-Estabrooks, Sc.D., CCC-SLP, is the Brewer Smith Professor Emerita, Western Carolina University, Cullowhee, North Carolina. Gillian Hotz, Ph.D., CCC-SLP, is the Director of the KiDZ Neuroscience Center, Research Professor, Department of Neurosurgery, University of Miami Miller School of Medicine in Miami, Florida. A product of 1-800-638-3775 | www.brookespublishing.com/tills A product of 1-800-638-3775 | www.brookespublishing.com/tills Q&A DEVELOPER Q&A DEVELOPER Q&A DEVELOPER Q&A DEVELOPER Q&A DEVELOPER Q&A DEVELOPER Q&A DEVELOPER Q&A DEVELOPER Q&A DEVELOPER Q&A DEVELOPER Q&A DEVELOPER Q&A DEVELOPER Q&A DEVELOPER Q&A DEVELOPER Q&A DEVELOPER Q&A DEVELOPER Q&A DEVELOPER Q&A DEVELOPER Q&A DEVELOPER Q&A DEVELOPER Q&A DEVELOPER Q&A DEVELOPER 7KHFULWHULRQUHIHUHQFHG3HGLDWULF7HVWRI%UDLQ,QMXU\ 37%,+RW]+HOP(VWDEURRNV1HOVRQ3ODQWH The TILLS Quadrant Model ZDVSXEOLVKHGŵUVW7KHQRUPUHIHUHQFHG7,//6 VWDQGDUGL]DWLRQYHUVLRQLVLQLWVŵQDOVWDJHVRI Sentence/Discourse Level Ability GHYHORSPHQWDVRIWKH$6+$QDWLRQDOFRQIHUHQFH1 The authors based the theoretical model for the TILLS at least partially on literature regarding differential High listening GLDJQRVLVRIVSRNHQDQGZULWWHQODQJXDJHGLVRUGHUV comp & sentence %LVKRS6QRZOLQJ&DWWV$GORI+RJDQ(OOLV formulation High in both :HLVPHU$VVKRZQLQ7DEOHWKHVXEWHVWVRI Low reading the TILLS are designed to assess language levels and & spelling UHODWHGHOHPHQWVVRXQGZRUGVHQWHQFHGLVFRXUVH Sound/Word vocabulary, and memory) across four modalities Level Ability OLVWHQLQJVSHDNLQJUHDGLQJDQGZULWLQJ7KHSURŵOHV High sound/word that result have implications for differential diagnosis of skills & surface GLVRUGHUVVXFKDV6/,DQGG\VOH[LD reading Low in both Low comprehension 'XULQJQXPHURXVSLORWVWXGLHVDQGŵHOGWULDOVDVZHOO in listening as a national beta trial and &standardization study, the reading WHVWKDVEHHQŵQHWXQHGWRPHHWVWURQJSV\FKRPHWULF VWDQGDUGV,WHPVDQGVXEWHVWVKDYHJRQHWKURXJK extensive pilot testing, including item response theory DQDO\VLVDQGWUDGLWLRQDOWHVWVWDQGDUGL]DWLRQUHVHDUFK &RQŵUPDWRU\IDFWRUDQDO\VLVLQGLFDWHVWKDWWKH7,//6 Table 1 DVVHVVHVWZRODWHQWIDFWRUVŏVRXQGZRUGVWUXFWXUH Language Modality Modality NQRZOHGJHDQGQDUUDWLYHGLVFRXUVHNQRZOHGJH,Q TILLS subtests purposefully Asaddition, shown inthe Table 1, the 15 subtests of TILLS include are designed to FXUULFXOXPUHOHYDQWLQWHJUDWHGWDVNVWKDWGRQRWORDG assess language levels and related elements (sound-word, sentence-discourse, vocabulary, and memory) across four FOHDUO\RQHLWKHUPDMRUIDFWRUFRQVLVWHQWZLWKLWVQDPH modalities (listening, speaking, reading, and writing). The WKH7HVWRI,17(*5$7('/DQJXDJHDQG/LWHUDF\6NLOOV profiles that result have implications for differential diagnoThe outcome is a psychometrically strong battery with sis of disorders, such as specific language impairment (SLI) VFRUHVWKDWFDQEHLQWHUSUHWHGDVSURŵOHVRIUHODWLYH and dyslexia. ODQJXDJHOLWHUDF\VWUHQJWKVDQGFRQFHUQV7KHWHVWLV UHOHYDQWWRPHDVXULQJGLIŵFXOWLHVVWXGHQWVKDYHZKHQ Using scientific evidence gathered in numerous pilot studies IDFLQJWKHFRPSOH[LQWHJUDWHGODQJXDJHOLWHUDF\ and field trials, a national beta trial, and a standardization demands of the general curriculum asfrom study with more than 1800 education children and adolescents across the United States, TILLS has been fine tuned to meet RXWOLQHGZLWKLQWKHFRPPRQFRUHVWDWHVWDQGDUGV strong psychometric standards. Items and subtests have Some elements of thetesting, TILLS were developed in gone through extensive including item response tandem with the whichtest is criterion-referenced theory analysis and PTBI, traditional standardization research. Exploratory factortoanalysis indicates that TILLS assesses and designed be sensitive to changes during the two latent factors—sound and word structure knowledge and DFXWHVWDJHVDQGHDUO\VWDJHVRIUHFRYHU\IURP7%,7KH sentence and discourse knowledge, which support the TILLS, on the other hand, is a fully normed, standardized theoretical model on which the test was constructed. In measure designed for assessing curriculum-relevant addition, some TILLS subtests purposefully include curricuFRJQLWLYHOLQJXLVWLFVNLOOVIRUVWXGHQWVVXVSHFWHG lum-relevant, integrated tasks that do not load clearly on RIKDYLQJSULPDU\GLVRUGHUVRIVSRNHQDQGZULWWHQ either major factor (consistent with its name, the Test of language orLanguage language problems to other INTEGRATED and Literacy secondary Skills). GLVRUGHUV7KHUHIRUHWKHWZRWHVWVVKDUHVRPHVXEWHVW HOHPHQWVEXWQRWRWKHUV Language Level Language Dimension Sound/Word Level Level 1. Vocabulary Awareness 9RFDEXODU\DZDUHQHVV 2. Phonemic Awareness 3KRQHPLFDZDUHQHVV Listening Listening Sentence/Discourse Level Sentence/Discourse Level 6. Listening Comprehension /LVWHQLQJFRPSUHKHQVLRQ 8. Following Directions )ROORZLQJGLUHFWLRQV Speaking Speaking 4. Nonword Repetition 1RQZRUGUHSHWLWLRQ 3. Story Retelling 6WRU\UHWHOOLQJDFRPSUHKHQVLRQ4V 13. Social Communication 6RFLDOFRPPXQLFDWLRQ Reading Reading 10. Nonword Reading 1RQZRUGUHDGLQJ 11. Reading Fluency 5HDGLQJŶXHQF\ 7. Reading Comprehension 5HDGLQJFRPSUHKHQVLRQ Writing Writing 5. Nonword Spelling 1RQZRUGVSHOOLQJ 12a. Written Expression – Word Score D:ULWWHQH[SUHVVLRQZRUGVFRUH 12b. Written Expression – Discourse Score E:ULWWHQH[SUHVVLRQGLVFRXUVHVFRUH F:ULWWHQH[SUHVVLRQVHQWHQFHFRPELQLQJVFRUH 12c. Written Expression – Sentence Combining Score Memory Memory 14. Digit Span Forward 'LJLWVIRUZDUG 'LJLWVEDFNZDUG 15. Digit Span Backward 9. Delayed Story Retelling 'HOD\HGVWRU\UHWHOOLQJ 1HOVRQ1:+HOP(VWDEURRNV1+RW]*3ODQWH(7HVWRI,QWHJUDWHG/DQJXDJHDQG/LWHUDF\6NLOOVŠ7,//6Š6WDQGDUGL]DWLRQ 9HUVLRQ%URRNHV3XEOLVKLQJ&R,QF 7KHŵQDOVWDJHVRIWKLVUHVHDUFKKDYHEHHQVXSSRUWHGE\*UDQW5$IURPWKH,QVWLWXWHRI(GXFDWLRQ6FLHQFHV86'HSDUWPHQWRI The Test of Integrated Language and Literacy Skills™ (TILLS™) by Nickola Wolf Nelson, Ph.D., Elena Plante, Ph.D., Nancy Helm-Estabrooks, Sc.D., and Gillian Hotz, Ph.D. Copyright © 2015 by Paul H. Brookes Publishing Co. All rights reserved. Test of Integrated Language & Literacy Skills™ and TILLS™ are trademarks of Paul H. Brookes Publishing Co. (GXFDWLRQ+RZHYHUWKHRSLQLRQVH[SUHVVHGKHUHDUHWKRVHRIWKHDXWKRUVDQGQRWWKH86JRYHUQPHQW The contents of TILLS were developed under Grant No. R324A100354 from the Institute of Education Sciences of the U.S. Department of Education. However, those contents do not necessarily represent the policy of the Department of Education, and you should not assume endorsement by the Federal Government. 1 1-800-638-3775 ■ www.brookespublishing.com/TILLS 1-800-638-3775 | www.brookespublishing.com/tills A product of A product of Q. Is TILLS fairly easy to implement? Does it require Q. What are the major advantages of using TILLS over special training expertise administer? similar How doesstrong it do aset better job of meeting The outcome is atools? psychometrically of tests with Q. In which settings do youand see TILLS beingto used? Is it scores that be interpreted as profiles of relative designed to be given only by SLPs, or can other professionals thecan needs of SLPs and the children they serve? A. :LWKDOLWWOHSUDFWLFHWKH7,//6LVHDV\WRJLYHVFRUH language/literacy strengths and areas of concerns. TILLS is administer it, too? DQGLQWHUSUHW7KHH[DPLQHUőVERRNOHWLQFOXGHVNH\ relevant A. to )LUVWWKH7,//6ZLOOEHWKHRQO\WHVWRQWKHPDUNHW measuring difficulties students have when facing needed administer WKDWSURYLGHVLQIRUPDWLRQRQGLDJQRVWLFDFFXUDF\LH the complex, integrated language/literacy demands of the A. TILLS information is intended for use in to schools, clinics,each and subtest private and video examples and other training materials will be available general education curriculum as outlined within the practices. It can be administered by speech-language patholVHQVLWLYLW\DQGVSHFLŵFLW\IRUHYHU\DJHDWZKLFKWKHWHVW CommonLVQRUPHG7KLVLVFULWLFDOIRUHYLGHQFHEDVHGSUDFWLFH Core State Standards and other state-generated ogists, neuropsychologists, educational psychologists, and demonstrating how to administer, score, and interpret curricularInstandards. others trained in individualized test administration with HDFKVXEWHVW0RVWVSHHFKODQJXDJHSDWKRORJLVWVDUH this respect, the TILLS stands in contrast to most, if children,already such as familiar reading with specialists, special educators, and elements phonological and syntactic not all, other tests, which either provide no information Q. What are the major advantages of using TILLS over similar other educational specialists. that are considered in scoring and interpreting the on does diagnostic tools? How it do a accuracy better jobor of provide meeting accuracy the needsdata of for a VXEWHVWV group they of children SLPs andsingle the children serve? who represent a wide range of Q. Is TILLS fairly easy to implement? Does it require special training Q. andCan expertise to administer? DJHV7KLVOHDYHVFOLQLFLDQVZLWKLQVXIŵFLHQWHYLGHQFHWR you provide a short case example illustrating A. First, TILLS will be the only test available that provides NQRZZKHWKHUWKHWHVWVFRUHVHDUQHGE\DQ\JLYHQFKLOG WKHEHQHŵWVRI7,//6" information on diagnostic accuracy (i.e., sensitivity and A. With a little practice, TILLS is easy to give, score, and DFWXDOO\UHŶHFWQRUPDORULPSDLUHGSHUIRUPDQFH specificity) for every age at which the test is normed. This is interpret.A.The Examiner’s Manual and Record Form include &DVH2QH$\HDUROGVFRUHVEHORZDJHH[SHFWHG critical for evidence-based practice. In this respect, TILLS key information needed to administer eachnonword subtest, the 8VLQJWKH7,//6FOLQLFLDQVFDQFRQGXFWDFRPSUHKHQVLYH levels on phonemic awareness, reading and stands inDVVHVVPHQWRIVWXGHQWVőVSRNHQDQGZULWWHQODQJXDJH contrast to most, if not all, other tests, which either Examiner’s Practice Workbook provides practice materials for QRQZRUGVSHOOLQJWDVNVDVZHOODVRQUHDGLQJŶXHQF\DQG provide no information on diagnostic accuracy or provide demonstrating how to administer, score, and interpret each VNLOOVDQGFRQVWUXFWDFRPSOHWHSURŵOHWKDWLVPHDQLQJIXO written expression measures; yet, this child scores well accuracy data for a single group of children that combines subtest. Most speech-language pathologists are already WRSDUHQWVWHDFKHUVDQGRWKHUVLQYROYHGLQPDNLQJ on listening comprehension, children of different ages. This prevents clinicians from familiar with phonological and syntacticfollowing elementsdirections, that are and HGXFDWLRQDOGHFLVLRQVIRUVWXGHQWV)RUPRVWVWXGHQWV VRFLDOFRPPXQLFDWLRQ$FKLOGZLWKWKLVW\SHRISURŵOH determining the test’s diagnostic accuracy at the particular considered in scoring and interpreting the subtests. anchild experienced might need intervention focused on sound-symbol age of the they wishclinician to assess.can accomplish this within Q. Can you provide a and shortmorphological case example illustrating association awarenessthe at the word WZRKRXUVLQFOXGLQJVFRULQJ&XUUHQWO\FOLQLFLDQVPXVW Using theadminister TILLS, clinicians can conduct a comprehensive benefits of TILLS? OHYHOKRZHYHUWKHFOLQLFLDQOLNHO\FDQWDNHDGYDQWDJHRI multiple tests over multiple sessions and assessment of students’ andacross writtenmeasures language to skills and VWURQJHURUDOODQJXDJHDWWKHVHQWHQFHGLVFRXUVHOHYHO patch togetheroral results conduct construct a complete profile that is meaningful to parents, A. Case One. A 7-year-old scores below age-expected levels DQGVRFLDOVNLOOVLQSODQQLQJLQWHUYHQWLRQDQGGRHVQRW DFRPSUHKHQVLYHDVVHVVPHQWRIVSRNHQDQGZULWWHQ teachers, and others involved in making educational on phonemic awareness, nonword reading, and nonword decisionsODQJXDJHVNLOOV7KLVLVDSV\FKRPHWULFDOO\TXHVWLRQDEOH for students. For most students, an experienced spelling QHHGWRWDUJHWWKHPLQLQWHUYHQWLRQ tasks, as well as on reading fluency and written clinicianSUDFWLFH7KHRUDODQGZULWWHQFRPSRVLWHVFRUHVWKDW can accomplish this within 90 minutes or less, with expression measures; yet, this child scores well on listening &DVH7ZR$\HDUROGVKRZVVWURQJVRXQGZRUG only a little extra time for scoring. Currently, clinicians must comprehension, following directions, and social communicaresult from administering a wide mixture of items on OHYHOVNLOOVRQSKRQHPLFDZDUHQHVVDOOWKHQRQZRUG administer multiple tests over multiple sessions and patch tion. For a student with this type of profile, the clinician some currently available measures also do not yield WDVNVUHSHWLWLRQUHDGLQJUHDGLQJDQGVSHOOLQJEXW togetherHDVLO\LQWHUSUHWDEOHSURŵOHVWKDWFDQLQIRUPLQWHUYHQWLRQ results across measures to conduct a comprehenwould likely be able to focus intervention on sound-symbol VFRUHVVLJQLŵFDQWO\EHORZDJHOHYHORQVWRU\UHWHOOLQJ sive assessment of oral and written language skills. This is association and morphological awareness at the word level, (immediate andofdelayed), as well as on at subtests of not only Q. time consuming, but is a psychometrically questionwhile taking advantage stronger oral language the In which settings do you see TILLS being used? listening and reading comprehension, vocabulary able practice. The oral and written composite scores that sentence-discourse level and social skills in planning Is it designed to be given only by SLPs, or can other result from administering a wide mixture of items on some intervention and maysocial not need to target thoseand areas in awareness, communication, written professionals administer it, too? currently available measures also do not yield easily interintervention. H[SUHVVLRQ$IRFXVRQSKRQLFVDQGSKRQRORJLFDOZRUG pretable A. profiles that can inform intervention. When scores The TILLS is intended for use in schools, clinics, and VWUXFWXUHZRXOGEHXQQHFHVVDU\IRUWKLVVWXGHQW5DWKHU are compared across tests, differences in the normative SULYDWHSUDFWLFHV,WFDQEHDGPLQLVWHUHGE\VSHHFK further assessment and intervention efforts should focus samples can lead to the appearance of differences across language pathologists, neuropsychologists, educational RQYRFDEXODU\V\QWD[DQGGLVFRXUVHVNLOOVWKDWFRXOG skills that are really only differences in the normative psychologists, and others trained in individualized test LPSURYHFRPSUHKHQVLRQDQGH[SUHVVLRQDFURVVVSRNHQ samples of the different tests. TILLS avoids this problem by with children, such as reading and written communication modalities, perhaps using includingadministration both oral and written language subtests withinspecialists the assessment and basing standard scores on a common DQGRWKHUHGXFDWLRQDOVSHFLDOLVWV WKHVWXGHQWőVDFWXDOFXUULFXODUPDWHULDOV normative sample. 1-800-638-3775 ■ www.brookespublishing.com/TILLS 1-800-638-3775 | www.brookespublishing.com/tills A product ofA product of