MSQA Program Course Lists - ASQ MEA Regional Quality

Performance Excellence
A Case Study in Assessing Performance in
Higher Education
Milton Krivokuca DBA
ASQ Fellow, Past Chair ASQ Quality Management
Division
Objectives for this presentation:
Demonstrate how to develop and
deliver a high performing academic
program using Quality tools.
Academic Planning
• Academic planning must support university goals
• Faculty Senate typically reviews/approves/ recommends course
and program development
• Course/program learning outcomes must be clearly stated
• Learning outcomes assessment must be defined
Academic Planning
• Periodic review of programs by various
agencies to evaluate program learning
effectiveness
California State University,
Dominguez Hills
College of Extended & International Education
Case Study Topic:
Master of Science In
Quality Assurance
Master of Science Quality Assurance
The master of Science in Quality Assurance
(MSQA) is designed to prepare professionals in
quality, engineering, science, management, health
care, government and service industries for career
advancement.
FACULTY
• ONE FULL TIME COORDINATOR
• SIXTEEN PART TIME
– FIVE DOCTORATES
– ELEVEN MASTERS - INCLUDING FIVE PROFESSIONAL ENGINEERS
• MAJORITY OF FACULTY ARE PRACTICING PROFESSIONAL QUALITY
ENGINEERS AND MANAGERS/DIRECTORS/VP’S
• SEVERAL INDUSTRY RECOGNIZED SUBJECT MATTER EXPERTS
Curriculum Design & Assessment:
Alignment of Learning Objectives
MSQA Mission
Learning
Standards for the
Program
Program Goals for Each
Course
Learning Objectives Assessment at
the Course Level
9
MSQA Assessment Process
• Verify MSQA Student Learning Outcomes
(SLOs) align with university mission
• Map the curriculum to SLO’s per course
• Assess effectiveness of meeting each SLO
• Analyze results
• Advisory board meeting
University Mission –
Program Mission
Basis to Map Curriculum
MSQA Program Course Lists
Manufacturing Concentration:
•
•
•
•
•
•
•
•
•
•
•
QAS 510
QAS 511
QAS 512
QAS 513
QAS 514
QAS 515
QAS 516
QAS 518
QAS 598S
QAS 599
Elective
Advanced Probability and Statistics
3 Units
Quality Function Management and TQM
3 Units
Reliability
3 Units
Statistical Quality Control and Sampling
3 Units
Advanced Experimental Design
3 Units
Human Factors in Quality Assurance
3 Units
Measurement and Testing Techniques
3 Units
Quality Project Management & Productivity 3 Units
Directed Research
3 Units
Project
3 Units
(with approval of Academic Coordinator) 3 Units
Total:
33 Units
MSQA Program Course Lists
Service and Health Care Concentration:
•
•
•
•
•
•
•
•
•
•
QAS 511
QAS 515
QAS 516
QAS 518
QAS 530
QAS 531
QAS 532
QAS 598S
QAS 599
Elective
Quality Function Management and TQM
3 Units
Human Factors in Quality Assurance
3 Units
Measurement and Testing Techniques
3 Units
Quality Project Management & Productivity
3 Units
Statistical Quality Control for Service Professionals 3 Units
Customer Satisfaction & Quality Assurance
3 Units
Quality Assurance for the Service Delivery Process 3 Units
Directed Research
3 Units
Project
3 Units
3 Courses
9 Units
Total:
33 Units
Curriculum Map
Program SLO Mapping
Radar Chart
Assessment Planning
Matrix Diagram
Assessment Letter to Faculty
Faculty assessor: ___William Trappen______________
MSQA Student Learning Outcomes #1, #3, #5, #7, and #8
MSQA Course Level Objective #1
Apply advanced principles and tools from quality and measurement science to problem solving and measuring
reliability and performance in production and service industries
MSQA Course Level Objective #3
Evaluate complex, integrated organizational systems and processes in order to recognize and measure system
failures scientifically, synthesize data and form solutions
MSQA Course Level Objective #5
Demonstrate the ability to conduct and present independent research using primary and secondary sources,
analyze information, interpret data, draw conclusions
MSQA Course Level Objective #7
Design a quality system or process to meet industry standards or quality system compliance requirements.
MSQA Course Level Objective #8
Identify, formulate and solve quality problems involving physical, human, and economic parameters inherent to
core processes for both manufacturing and service focused industries.
Spring 2013 Assessment
Prioritization Matrix
MSQA SLO Map Spring 2013
Summative Assessment Radar Chart
Unbalanced SLOs
Formative Assessment Radar Chart
Survey Questions – Lickert Scale 1 -5
Summative Student Results
• The MSQA program provided me with skills
that I can immediately apply 4.5
• The MSQA staff at the university were
supportive of my needs and were a
dependable resource. 4.25
• The faculty were knowledgeable and
approachable to assist with issues or
questions. 4.5
Survey Questions – Lickert Scale 1 -5
• I feel that the personal value I received from
form time and effort will be rewarding in my
career 4.25
• I would recommend the MSQA program to a
friend or professional associate interested in
advancing his or her knowledge of Quality. 4.6
Graduate Survey Results
Matrix Diagram
2011 Graduate Survey Results
Q1
1
2
3
4
5
6
7
8
9
10
11
12
Q2
Q3
Q4
1
5
5
5
5
5
5
4
4
5
5
5
3
5
1
5
5
5
5
4
5
5
5
3
4
4
2
5
5
5
5
5
5
4
5
5
54
4.5
51
4.25
54
4.5
Milt Krivokuca
Q5
4
4
5
5
4
5
4
4
5
5
5
5
3
5
4
5
5
5
4
4
5
5
5
5
15
23
17
25
24
25
23
21
24
24
25
23
51
55
4.25 4.583333
269
22.41667
Survey Results
Report Using Bar Charts
Results
• Reported to academic administration
• Reviewed during annual faculty meetings
• Reviewed during annual program advisory
board meeting
Advisory Board Report
Spring 2013
CSUDH Advisory Board Meeting
Following are the action plans developed as a result of the March 15, 2013 Advisory Board meeting. The
information gained from this meeting was evaluated and developed into a realistic action plan. The planned
activities will assure the CSUDH Quality programs remain current in the content and support the mission of the
University, College of Extended and International and Extended Education, as well as the program itself.
Item I:
Develop CEU certificate program to support the Measurement Science Conference.
Item II:
Request additional information as to the goal for developing CEU credit for CCE CAPE training.
Item III: Formalize BSQA Metrology Certificate of Completion
Item IV: Contact instructors for QAS 512, 513, and 514 to include class assignment or activity supporting
MSQA SLO #4.
Item V:
Revise QAS 538 to address biostatistics. This revision will further address SLOC #7 and review if
revised QAS 538 can replace QAS 530 for a Healthcare specific MSQA track.
Item VI: Revise SLOCs #4 and #7 to be more applicable to the current needs of Quality professionals.
Item VII:Develop new version of QAS523 Software Quality. Place QAS 523 in refrigerator. New course to
include elements of software quality, but move focus to IT and suspect/counterfeit issues.
Item VIII: Develop three (3) new MSQA elective courses: Hoshin Planning, Sustaining Quality Improvement,
Laboratory Accreditation and Proficiency Testing
IX: Revise MSQA program to 3 tracks, Manufacturing (minor program changes), Service (minor program
changes), and Healthcare (new track, but existing classes available for this track).
Milt Krivokuca
April 1, 2013
Next Steps:
Prioritize the Action Plan per the
University Program and Course
revisions policy.
The Final Results
Educational
Excellence!
Thank You!
Milton Krivokuca DBA