Geography for Tourism CP Scoring Guide
Transcription
Geography for Tourism CP Scoring Guide
National Academy Foundation (NAF) Culminating Project Assessment for Certification Geography for Tourism Culminating Project Assessment for Certification Scoring Guide 2012–2013 Introduction In the Culminating Project Assessment for Certification Scoring Guide for Geography for Tourism, you will find the guidelines for scoring the work submitted by students for the course culminating project. Please review the scoring guidelines; they will provide you with the necessary information you need to score the student work. General Scoring Guidelines The general guidelines for scoring student work submitted for course culminating projects apply to all National Academy Foundation course culminating projects. They include the following: You must consider spelling, grammar, and punctuation when scoring the students’ work. Because the work samples and reflections are intended to be reflective of work that students would perform in professional settings, it is important that the students follow proper rules of spelling, grammar, and punctuation. The students are expected to submit two work samples and a final product. Without the two work samples and final product, as well as the reflections, the evidence required for certification assessment is incomplete and the student score for the culminating project must be Insufficient Evidence. The students must submit one work sample from the Planning Stage and one from the Implementation/Production Stage. The students should submit their best work samples. They must also submit the final product(s). If the students submit more than the required number of work samples for each stage, you will review and evaluate the two work samples that demonstrate their best work. Students do not receive extra credit for the additional work samples. Although the students will be working in groups on the culminating projects, you will evaluate them individually and not as a group. Students working on the same project may submit the same work samples, if the work samples represent the best work of each student. However, they must each submit a copy of the work sample and their individual reflections to be evaluated and scored in the Student Certification Assessment System. The students are required to complete one reflection for each work sample selected for each stage and for the final product that they upload to the Student Certification Assessment System. The students will be prompted by the Student Certification Assessment System with a series of questions that help them to complete the reflection when they upload each work sample and the final product. Responses to reflection questions may be prepared in advance of uploading the work sample and then typed (or copied and pasted) into the 1 answer fields provided, but it is critical that these reflections are prepared by individual students. This is not a group writing assignment. No two students should have identical reflections. The students may not submit reflections as a group. The reflections provide an opportunity for each student to demonstrate what she/he has learned when developing each work sample at the different stages of the project. Guidelines for the Scoring Rubric The scoring rubric, which is found online in the Student Certification Assessment System, is comprised of three dimensions against which student work is evaluated: evidence of content knowledge, evidence of awareness of own abilities and performance, and evidence of contribution and collaboration. In addition, the student work is assigned an overall score. All three dimensions and the overall score are rated on a five-point scale from 4 to 0. The scoring rubric appears on the next two pages. It can also be found in Appendix C of the Student Certification Assessment System—Administration Guide. You will use the scoring rubric to score each student’s work on the project as a whole and not as separate pieces. In other words, you will not be scoring each of the work samples and reflections separately. You will consider the work samples, the final product, and the reflections as a whole when scoring the student work. The overall score is a holistic score and not an accumulation of points from the previous sections. You will score the student work samples after the student has submitted all of the work. Descriptions for the dimensions of the scoring rubric appear on page 5, immediately following the scoring rubric. 2 Culminating Project Assessment for Certification (CPAC)—Scoring Rubric Evidence of Content Knowledge and Skills (See CPAC document for list of targeted learning objectives) Evidence of Awareness of Own Abilities and Performance 4 3 2 1 Demonstrates clear understanding of the major ideas, concepts, and skills covered in ALL of the targeted learning objectives. There may be minor errors in understanding. Demonstrates general understanding of the major ideas, concepts, and skills covered in the targeted learning objectives, with some gaps in breadth, depth, and/or accuracy of understanding. Demonstrates limited understanding of major ideas, concepts, and skills covered in the targeted learning objectives, with substantial gaps in breadth, depth, and/or accuracy of understanding. Demonstrates minimal or no understanding of major ideas, concepts, and skills covered in the targeted learning objectives, with complete gaps in breadth, depth, and/or accuracy of understanding (i.e., projects are invalid or incomplete). Submits insufficient required number of work samples to evaluate understanding of major ideas, concepts, and skills covered in the targeted learning objectives (i.e., projects are invalid or incomplete). Demonstrates clear ability to apply the knowledge and skills covered in ALL of the targeted learning objectives. There may be minor errors in application of knowledge and skills. Demonstrates general ability to apply the knowledge and skills covered in the targeted learning objectives, with some skills and knowledge lacking and/or applied in incomplete ways. Demonstrates minimal or no ability to apply the knowledge and skills covered in the targeted learning objectives, with most or all skills and knowledge lacking and/or applied in incomplete or inappropriate ways. Submits insufficient required number of work samples to evaluate ability to apply the knowledge and skills covered in the targeted learning objectives. Demonstrates limited ability to apply the knowledge and skills covered in the targeted learning objectives, with the majority of skills and knowledge lacking and/or applied in incomplete or inappropriate ways. 0 Demonstrates clear ability to reflect on the quality of his/her work in relationship to the targeted learning objectives, providing clear and accurate examples of strengths and limitations of work samples and the final product. Demonstrates general ability to reflect on the quality of his/her work in relationship to the targeted learning objectives, providing examples of strengths and limitations of work samples and the final product. Demonstrates limited ability to reflect on the quality of his/her work in relationship to the targeted learning objectives, providing incomplete and/or inaccurate examples of strengths and limitations of work samples and the final product. Demonstrates minimal or no ability to reflect on the quality of his/her work in relationship to the targeted learning objectives, providing inaccurate or no examples of strengths and limitations of work samples and the final product. Submits insufficient required number of reflection sheets to evaluate the quality of the reflection on his/her work in relationship to the targeted learning objectives. 3 Evidence of Contribution And Collaboration Overall Score (Check One) Demonstrates active and consistent contribution in the group through all stages (i.e., work samples and the final product). Demonstrates general contribution in the group through all stages (i.e., work samples and the final product). Demonstrates limited contribution in the group through all stages (i.e., work samples and the final product). Demonstrates minimal or no contribution in the group through all stages (i.e., work samples and the final product). Submits insufficient required number of work samples and reflection sheets to evaluate the contribution in the group through all stages. Exceeds Expectations Meets Expectations Below Expectations Well Below Expectations Insufficient Evidence 4 Scoring Rubric Dimensions Evidence of Understanding of Major Ideas, Concepts, and Skills Covered in All of the Targeted Learning Objectives: The intent of evidence of understanding of content knowledge, course skills, critical thinking skills, and communication skills is to determine whether students have learned and can apply the concepts and ideas of the course. Students are scored separately for their understanding of content knowledge and for their ability to apply their knowledge. o Evidence of understanding of content knowledge and skills reflects whether the students demonstrate an understanding of the ideas and concepts identified in the targeted learning objectives identified in the reflection. o Evidence of application of content knowledge, technical skills, criticalthinking skills, and communication skills reflects whether the work samples, the final product, and the reflections submitted by the students demonstrate that the students have appropriately applied the concepts they have identified in the reflections on the work samples. Evidence of Awareness of Own Abilities and Performance: The intent of evidence of quality reflection is to determine whether the students are able to take responsibility for their own learning by critically evaluating the quality of their work samples and final product(s) in relation to the concepts learned in the course. They may do this by identifying the strengths and limitations of their work, as well as by suggesting strategies to improve their work. Evidence of Contribution and Collaboration: The intent of evidence of contribution is to determine how much each of the students participated in the development and completion of the culminating project. The students are expected to submit samples of individual work performed on the project. They may submit group work samples from the Planning Stage and the Implementation/Production Stage as well as the group final product. The students should explain in their reflections their contribution to the project. Overall Score: The overall score of the project is a holistic determination rather than an accumulation of points or an average from the previous sections. Students may exhibit different strengthens and weaknesses in the sections, but may receive the same overall scores. Sections may be weighted differently for each student, depending on the quality of the work samples and reflections submitted by each student. 5 Descriptions of Score Points The table below provides a description of the level of performance associated with each score point. Points 4 Points Exceeds Expectations 3 Points Meets Expectations 2 Points Below Expectations 1 Point Well Below Expectations Description Indicates that the student demonstrates a clear understanding of the concepts and ideas learned in the course that are targeted for the culminating project. It indicates a clear ability to apply the concepts and ideas learned in the course to the work samples or to reflect on the quality of the work submitted. It indicates that the student clearly takes responsibility for his own learning. It also indicates that the student clearly demonstrates an active and consistent contribution through all stages of the project. There are minimal or no content, grammatical, or presentation errors in the project work samples or reflections. The work submitted exceeds the expectations for the completion of the project. Indicates that the student demonstrates a general understanding of the concepts and ideas learned in the course that are targeted for the culminating project. It indicates a general ability to apply the concepts and ideas learned in the course to the work samples or to reflect on the quality of the work submitted. It indicates that the student generally takes responsibility for his own learning. It also indicates that the student generally demonstrates a contribution through all stages of the project. There are a few content, grammatical, or presentation errors but no substantive errors in the project work samples or reflections. The work submitted meets the expectations for the completion of the project. Indicates that the student demonstrates a limited understanding of the concepts and ideas learned in the course that are targeted for the culminating project. It indicates a limited ability to apply the concepts and ideas learned in the course to the work samples or to reflect on the quality of the work submitted. It indicates that the student takes limited responsibility for his own learning. It also indicates that the student demonstrates a limited contribution through all stages of the project. There are significant content, grammatical, or presentation errors in the project work samples or reflections. The work submitted is below the expectations for the completion of the project. Indicates that the student demonstrates a minimal understanding of the concepts and ideas learned in the course that are targeted for the culminating project. It indicates a minimal ability to apply the concepts and ideas learned in the course to work samples or to reflect on the quality of the work submitted. It indicates that the student does not take responsibility for his own learning. It also indicates that the student demonstrates minimal or no contribution through all stages of the project. There are major content, grammatical, or presentation errors in the project work samples or reflections. The work submitted is well below the expectations for the completion of the project. 6 0 Points Insufficient Evidence Indicates that the student has submitted an insufficient number of work samples from the Planning Stage, the Implementation/Production Stage, and/or the final product, and reflections to evaluate the contribution of the student to the group through all stages of the project. The work demonstrates insufficient evidence for scoring. How to Use the Scoring Rubric Following are exemplars of rubrics that have been annotated for each of the overall score points for the Principles of Hospitality and Tourism course in the Academy of Hospitality and Tourism. These exemplars will give you a sense of how to distinguish the score points in the scoring rubric. Scoring Instructions 1. Review the exemplars in the Culminating Project Assessment for Certification Scoring Guide before you score the work submitted by a student to understand the quality of student work and reflections associated with the score points. 2. Review the student’s two work samples, the final product, and the reflections as a whole. 3. If a student has not submitted the complete project (all of the work samples, the final product, and the three reflections), score the project as Insufficient Evidence. 4. Evaluate the student’s work against the scoring rubric in the Student Certification Assessment System to determine how you should score the student’s work. 5. Once you have determined which scores to award the student’s work, enter your scores in the Student Certification Assessment System using the scoring rubric. 7 Culminating Project Assessment for Certification (CPAC) Exemplar Annotation Course: Principles of Hospitality and Tourism Overall Score: Exceeds Expectations Exemplar: 4 Points A business proposal for high school vacation package (Planning Stage Work Sample) A special meal plan (Implementation/Production Stage Work Sample) Submitted Student A final vacation package (Final Product) Work A reflection for the Planning Stage Work Sample A reflection for the Implementation/Production Stage Work Sample A reflection for the Final Product Scoring Rubric Score Points Explanation Dimension Evidence of The student demonstrates a clear understanding of Understanding of the concepts and skills in all of the targeted Major Ideas, learning objectives. The student clearly addresses Concepts, and the key learning concepts that are utilized in the 4 Skills Covered in project (e.g., environmental effects of tourism, All of the Targeted current trends in the food and beverage business, Learning and entertainment choices for travelers). Objectives The student demonstrates a general ability to Evidence of apply the concepts and skills in all of the targeted Application of learning objectives. The student has submitted a Knowledge and business proposal that contains all of the necessary Skills Covered in 3 components. The special meal plan is general and All of the Targeted does not provide an itemized budget. The final Learning vacation package promotional brochure and Objectives finalized itinerary contain minor grammatical and punctuation errors. Evidence of The reflections demonstrate that the student Awareness of Own clearly understands the importance of self4 Abilities and reflecting on one’s work and determining ways to Performance improve individual and group performance. Evidence of The student clearly demonstrates his contribution Contribution and 4 to the completion of the project, working on tasks Collaboration in all of the project stages. Exceeds The overall quality of the submitted work exceeds Overall Score Expectations the expectations for the completion of the project. 8 Note To receive an overall score of Exceeds Expectations, a student does not need to receive a score of 4 in every section. 9 Culminating Project Assessment for Certification (CPAC) Exemplar Annotation Course: Principles of Hospitality and Tourism Overall Score: Meets Expectations Exemplar: 3 Points A business proposal for high school vacation package (Planning Stage Work Sample) A vacation package brochure (Implementation/Production Stage Work Sample) Submitted Student A final vacation package (Final Product) Work A reflection for the Planning Stage Work Sample A reflection for the Implementation/Production Stage Work Sample A reflection for the Final Product Scoring Rubric Score Points Explanation Dimension Evidence of The student demonstrates a general understanding Understanding of of the concepts and skills in all of the targeted Major Ideas, learning objectives. The student generally Concepts, and Skills 3 addresses the key learning concepts that are Covered in All of utilized in the project (e.g., environmental effects the Targeted of tourism, current trends in the food and beverage Learning Objectives business, and entertainment choices for travelers). The student demonstrates a general ability to apply the concepts and skills in all of the targeted learning objectives. The student has submitted a business proposal that contains all of the Evidence of necessary components. The vacation package Application of brochure is not well laid out. There are different Knowledge and 3 fonts and it is difficult to read when printed Skills Covered in All because of the color scheme. It also contains of the Targeted general information about the vacation. The final Learning Objectives vacation package contains all of the necessary materials and is well organized. The proposal introduction and lodging report contain minor grammatical errors. The student demonstrates a limited ability to take Evidence of responsibility for his own learning, showing limited Awareness of Own 2 evaluation of the quality of his own work samples Abilities and in relation to the concepts learned in the course. Performance Evidence of Contribution and Collaboration 2 The student demonstrates a limited contribution to the completion of the project, working on tasks in all of the project stages. 10 Overall Score Meets The overall quality of the submitted work meets Expectations the expectations for the completion of the project. Note The student received a range of scores for the different dimensions. The student received an overall score of Meets Expectations because the quality of the work was holistically scored as Meets Expectations. 11 Culminating Project Assessment for Certification (CPAC) Exemplar Annotation Course: Principles of Hospitality and Tourism Overall Score: Below Expectations Exemplar: 2 Points A business proposal for high school vacation package (Planning Stage Work Sample) A special meal plan (Implementation/Production Stage Work Sample) Submitted Student A final vacation package (Final Product) Work A reflection for the Planning Stage Work Sample A reflection for the Implementation/Production Stage Work Sample A reflection for the Final Product Scoring Rubric Score Points Explanation Dimension The student demonstrates a general understanding Evidence of of the concepts and skills in all of the targeted Understanding of learning objectives. The student generally Major Ideas, addresses the key learning concepts that are Concepts, and Skills 3 utilized in the project (e.g., environmental effects Covered in All of of tourism, motivations of travelers, the Targeted accommodations for travelers, and entertainment Learning Objectives choices for travelers). The student demonstrates a limited ability to apply Evidence of the concepts and skills in all of the targeted Application of learning objectives. The business proposal contains Knowledge and all of the necessary components but has numerous 2 Skills Covered in All typographical errors. The meal plan is not well laid of the Targeted out and the budget does not correctly add up. The Learning Objectives final vacation package has all of the components but contains significant grammatical errors. The student demonstrates a minimal ability to take Evidence of responsibility for his own learning, showing Awareness of Own 1 minimal evaluation of the quality of his own work Abilities and samples in relation to the concepts learned in the Performance course. Evidence of The student demonstrates a limited contribution to Contribution and 2 tasks in the Implementation/Production Stage of Collaboration the project. Below The overall quality of the submitted work is below Overall Score Expectations the expectations for the completion of the project. 12 Note The student received a range of scores for the different dimensions. The student received an overall score of Below Expectations because the quality of the work was holistically scored as Below Expectations. 13 Culminating Project Assessment for Certification (CPAC) Exemplar Annotation Course: Principles of Hospitality and Tourism Overall Score: Well Below Expectations Exemplar: 1 Point A business proposal for high school vacation package (Planning Stage Work Sample) A special meal plan (Implementation/Production Stage Work Sample) Submitted Student A final vacation package (Final Product) Work A reflection for the Planning Stage Work Sample A reflection for the Implementation/Production Stage Work Sample A reflection for the Final Product Scoring Rubric Score Points Explanation Dimension Evidence of The student demonstrates a minimal Understanding of understanding of the concepts and skills of the Major Ideas, targeted learning objectives. The student identifies Concepts, and Skills 1 learning objectives in the reflection but does not Covered in All of explain what concepts or skills were learned during the Targeted the project. Learning Objectives The student demonstrates a minimal ability to apply the concepts and skills of the targeted Evidence of learning objectives in the project but has submitted Application of a sketch. The student does not identify any Knowledge and concepts or skills in the learning objectives for the 1 Skills Covered in All project in the reflection for the final product. The of the Targeted business proposal does not contain green travel Learning Objectives tips or explain why the lodging option was chosen. The special meal plan does not have a theme and the budget does not add up. The reflections demonstrate a minimal Evidence of understanding of the importance of self-reflecting Awareness of Own 1 on one’s work. The reflection was vague and Abilities and showed no appreciation for specific content and Performance skills learned in the course. Evidence of The student demonstrates a limited contribution to Contribution and 2 tasks in all three stages of the project. Collaboration The overall quality of the submitted work is well Well Below Overall Score below the expectations for the completion of the Expectations project. 14 Note The student received a score of Well Below Expectations because the quality of the work samples and reflections demonstrated minimal understanding of the culminating project or the targeted learning objectives for the culminating project. 15 Culminating Project Assessment for Certification (CPAC) Exemplar Annotation Course: Principles of Hospitality and Tourism Overall Score: Insufficient Evidence Exemplar: 0 Points A business proposal for high school vacation package (Planning Stage Work Sample) A final vacation package (Final Product) A Planning Stage reflection Submitted Student A Final Product reflection Work The student did not submit an Implementation/Production Stage Work Sample. The student did not submit an Implementation/Production Stage reflection. Scoring Rubric Score Points Explanation Dimension Evidence of Insufficient evidence has been submitted by the Understanding of student for review. The student has not submitted Major Ideas, a work sample or reflection for the Concepts, and Skills 0 Implementation/Production Stage. Covered in All of the Targeted Learning Objectives Evidence of Insufficient evidence has been submitted by the Application of student for review. The student has not submitted Knowledge and a work sample or reflection for the 0 Skills Covered in All Implementation/Production Stage. of the Targeted Learning Objectives Evidence of Insufficient evidence has been submitted by the Awareness of Own student for review. The student has not submitted 0 Abilities and a work sample or reflection for the Performance Implementation/Production Stage. Insufficient evidence has been submitted by the Evidence of student for review. The student has not submitted Contribution and 0 a work sample or reflection for the Collaboration Implementation/Production Stage. Insufficient Insufficient evidence has been submitted to Overall Score Evidence evaluate the student work. Note The student did not submit an Implementation/Production Stage Work Sample or a reflection for the Implementation/Production Stage. As a result, an overall score of Insufficient Evidence has been awarded. 16