Program Outcomes Assessment

Penn College Construction Management
AIC/ CQE Results Outcomes Assessment Summary
About the Associate Constructor Certification
Taken from the AIC Website - http://www.professionalconstructor.org/?page=AC_Certification
The Associate Constructor (AC) is the first level of certification in the Constructor Certification Program. This level of
certification is ideal of recent graduates of 4-Year Construction Management Programs or those transitioning into construction
management from other industries. To take the Associate Constructor or Level 1 Exam a candidate must qualify by meeting
one of the following requirements:
1. Have graduated from or is scheduled to graduate from an accredited 4-year Construction Management
Degree Program. (Individuals will earn the AC certification upon passing the exam and provided proof of
graduation.)
2. Have obtained 4 years of qualifying experience or education or a combination of the two.
Upon passing the Associate Constructor Exam an individual will be awarded the Associate Constructor (AC) credential.
The AC exam is made up of 300 multiple choice questions, given during two 4 hour sessions on a single day. The exam is
given twice per year, in the spring and fall at over 60 locations across the country. Over 50 University Construction
Management Programs currently administer the AC exam, most require the exam as part of their program curriculum.
Penn College use of the CQE
The CQE exam has become a keystone of the program outcomes assesment plan. The construction management program
began considering the use of the CQE in 1995 and upon completion of the review began requiring all final semester seniors to
sit for the certification in the Spring of 1997.
Seniors in the BCM497 Capstone course must register for the Spring Exam offered on campus, typically during the beginning
of April. Students must secure an established minimum score (currently lower than the 210 required to attain the credential) in
order to be eligible to pass the course and graduate. This lower score began much lower than the passing mark but has been
raised each year. In 2014, the required score was 185. Failure to secure the minimum score results in the student receiving
an incomplete for the course. Students are then responsible for making arrangements to retake the exam during the Fall
testing dates and sending the official scores to the instructor. If the minimum score is reached, the grade is changed to that
reflected by the students coursework. If the score is not reached, the grade is changed to failing and the student is required to
retake the class during the next spring semester.
Page 1 of 10
Penn College Construction Management
AIC/ CQE Results Outcomes Assessment Summary
The initial use of the exam as part of the Capstone class in 2007 required that students sit for the exam but did not tie
performance to a grade or require a minimal level of effort. Upon examining the results and interviews with seniors, it
was descovered that some students had not studied and had zero interest in doing well. Faculty proposed tieing the
performance to their grade and also decided to set a minimum threshold of performance that would start below the
CQE passing mark but that would eventually raise up to that standard. By the third year of implementation Penn
College scores exceeded the national average and have stayed there for six straight years.
The scope of the CQE exam and the track-record of performance by graduating seniors is viewed as strong evidence
that the program is producing graduates who have a strong skill set for the industry.
Page 2 of 10
Penn College Construction Management
AIC/ CQE Results Outcomes Assessment Summary
Penn College
National
19
15
978
483
Difference
225.11
204.86
20.25
20.42
20.22
0.2
Notes: Beat national average overall by
over 20 points. Higher than national
average in all categories. We see this as
confirmation that the program is covering
the appropriate content and students are
retaining information required. No major
changes proposed at this time as a result
of this instrument. High score = 99th
percentile, 2nd was 98th percentile.
Actions: Keep doing what is working.
9.74 27.37 22.63 33.16 26.42 35.84 17.37
9.08 25.00 20.49 28.62 23.11 32.37 15.12
0.66
2.37
2.14
4.54
3.31
3.47
2.25
Project
Administration
Construction
Geomatics
Construction Safety
Planning, Scheduling,
& Schedule Control
Budgeting,Costs,
Cost Control
Bidding & Estimating
Materials, Methods, &
Proj Modeling &
Visualization
Management
Concepts
Engineering Concepts
Communications
Average
# Passed
# Taken
2014 CQE Results
5.05 27.11
4.59 26.27
0.46
0.84
2014 Penn College BCM vs. National CQE
Results by Concentration
40.00
35.00
30.00
25.00
20.00
15.00
10.00
5.00
0.00
National
Penn College
Page 3 of 10
Penn College Construction Management
AIC/ CQE Results Outcomes Assessment Summary
Penn College
National
20
14
1013
537
Difference
216.3
208.93
7.37
22.75
21.52
1.23
Notes: Higher than national average but
small deficiencies in Engineering
(Historically a weak point in our nonengineering based approach) and
Budgeting, Costs, and Cost Control
categories. Both were minor misses.
Faculty to increase attention in these areas
over the next year but no major changes
proposed. High score = 96th percentile.
Actions: Increase focus on Engineering
and Budgeting, Costs and Cost Control
areas slightly.
8.45 27.10 22.30 29.65 23.60 34.85 16.55
9.16 25.39 20.53 29.21 24.02 33.45 15.35
-0.71
1.71
1.77
0.44 -0.42
1.4
1.2
Project
Administration
Construction
Geomatics
Construction Safety
Planning, Scheduling,
& Schedule Control
Budgeting,Costs,
Cost Control
Bidding & Estimating
Materials, Methods, &
Proj Modeling &
Visualization
Management
Concepts
Engineering Concepts
Communications
Average
# Passed
# Taken
2013 CQE Results
4.70 26.35
4.64 25.65
0.06
0.7
2013 Penn College BCM vs. National CQE
Results by Concentration
40
35
30
25
20
15
10
5
0
National
Penn College
Page 4 of 10
Penn College Construction Management
AIC/ CQE Results Outcomes Assessment Summary
Penn College
National
28
23
1271
737
Difference
229.07
210.59
18.48
22.93 21.46
20.62 20.25
2.31
1.21
Notes: Beat national average overall and
in every category! Did not notice anything
exceptionally different from previous years
student groups and while the review is
better with time there were no major
changes. Possibly we are seeing results of
coverage of the AIC materials (both
purposeful and not) as the exam has
pervaded our (faculty & student) thinking
at all levels of the program coursework.
Actions: Keep doing what is working.
26.5 24.64 32.96 20.36 36.43 14.96
25.83 21.42 29.86 19.31 34.25 13.05
0.67
3.22
3.1
1.05
2.18
1.91
5.82
5.02
0.8
Project Administration
Construction Geomatics
Construction Safety
Planning, Scheduling, &
Schedule Control
Budgeting,Costs, Cost
Control
Bidding & Estimating
Materials, Methods, &
Proj Modeling &
Visualization
Management Concepts
Engineering Concepts
Communications
Average
# Passed
# Taken
2012 CQE Results
23
20.95
2.05
2012 Penn College BCM vs. National CQE Results
by Concentration
40
35
30
25
20
15
10
5
0
National
Penn College
Page 5 of 10
Penn College Construction Management
AIC/ CQE Results Outcomes Assessment Summary
Penn College
National
29
21
1132
701
Difference
217.31
215.89
1.42
10.97 18.59
10.87 19.13
0.1 -0.54
Notes: Penn College BCM students scored
higher than the Bational Average for the
third straight year. Still have some
individual students not doing well. These
students are mostly predictable based on
in-class experiences in other classes and/or
known test anxiety issues.
Actions: Increase focus on Budgeting,
Costs and Cost Control and review what we
are doing in this area.
9.34 23.93 36.66 20.69 36.38 15.72
9.51 23.13 35.63 21.76 35.54 15.92
-0.17
0.8
1.03 -1.07
0.84
-0.2
Project Administration
Construction Geomatics
Construction Safety
Planning, Scheduling, &
Schedule Control
Budgeting,Costs, Cost
Control
Bidding & Estimating
Materials, Methods, &
Proj Modeling &
Visualization
Management Concepts
Engineering Concepts
Communications
Average
# Passed
# Taken
2011 CQE Results
4.86 40.17
4.55 39.83
0.31
0.34
2011 Penn College BCM vs. National CQE
Results by Concentration
45
40
35
30
25
20
15
10
5
0
National
Penn College
Page 6 of 10
Penn College Construction Management
AIC/ CQE Results Outcomes Assessment Summary
Penn College
National
29
21
1132
701
Difference
217.31
215.89
1.42
10.97 18.59
10.87 19.13
0.1 -0.54
Notes: Had two students do poorly in
every category which hurt the averages.
Can we adjust the numbers if we have
students that blow off the test or do poorly
for reasons outside of the programs
control? Above National Average again.
Actions: Continue to discuss options for
examinees who don't try or have other
issues that don't reflect the programs
achievement. For now, no adjustments.
9.34 23.93 36.66 20.69 36.38 15.72
9.51 23.13 35.63 21.76 35.54 15.92
-0.17
0.8
1.03 -1.07
0.84
-0.2
Project Administration
Construction Geomatics
Construction Safety
Planning, Scheduling, &
Schedule Control
Budgeting,Costs, Cost
Control
Bidding & Estimating
Materials, Methods, &
Proj Modeling &
Visualization
Management Concepts
Engineering Concepts
Communications
Average
# Passed
# Taken
2010 CQE Results
4.86 40.17
4.55 39.83
0.31
0.34
2010 Penn College BCM vs. National CQE
Results by Concentration
45
40
35
30
25
20
15
10
5
0
National
Penn College
Page 7 of 10
Penn College Construction Management
AIC/ CQE Results Outcomes Assessment Summary
Penn College
National
25
18
1009
666
Difference
224.08
219.69
4.39
12.24 20.16
11.65 20.01
0.59
0.15
Notes: BEAT THE NATIONAL AVERAGE!
Improved or held close in most categories.
Systems are working and the culture of
knowing about the exam and coming into
the final semester ready to take it on is
helping. Had one student not meet the
threshold. Many pains with parents
regarding delayed graduation. Having
statistics from classmates and national
averages was helpful and the shift of
responsibility to the student in this case
Actions: Continue to beat the average,
continue to work on communications
across the curriculum.
9.48 23.16
9.59 22.33
-0.11
0.83
35.6 23.72 35.92 16.52
34.85 23.33 34.71 16.83
0.75
0.39
1.21 -0.31
Project Administration
Construction Geomatics
Construction Safety
Planning, Scheduling, &
Schedule Control
Budgeting,Costs, Cost
Control
Bidding & Estimating
Materials, Methods, &
Proj Modeling &
Visualization
Management Concepts
Engineering Concepts
Communications
Average
# Passed
# Taken
2009 CQE Results
5.04 42.24
4.84 41.54
0.2
0.7
2009 Penn College BCM vs. National CQE
Results by Concentration
45
40
35
30
25
20
15
10
5
0
National
Penn College
Page 8 of 10
Penn College Construction Management
AIC/ CQE Results Outcomes Assessment Summary
Project Administration
Construction Geomatics
Planning, Scheduling, &
Schedule Control
Budgeting,Costs, Cost
Control
7.24
19.5
9
1154
664
211.14
8.89
19.8
8.98
23.36
34.88
21.9
30.71
15.41
6.19
41.03
Difference
-6.07
-1.65
-0.3
0.02
0.14
0.83
-2.83
-0.64
-1.27
0.38
-0.82
Average
Notes: Improvement in most areas. Had
one student not meet the minimum
threshold. He was required to retake the
exam in the fall and received an
Incomplete for the course. Process is
developing nicely. Update: This student
performed much better on the fall exam.
Action: Let underclassmen know about the
exam and the ramifications of not
performing to a minimum standard. Instill
a culture of the exam being a testimony to
what they have learned and are prepared
to do. Continue to tweak prep course, look
into alternative methods of study and prep.
Focus on Communications Skills accross
curriculum.
Construction Safety
205.07
Bidding & Estimating
Engineering Concepts
National
Materials, Methods, &
Proj Modeling &
Visualization
Communications
5
# Passed
14
# Taken
Penn College
Management Concepts
2008 CQE Results
23.5 35.71 19.07 30.07 14.14
6.57 40.21
2008 Penn College BCM vs. National CQE
Results by Concentration
45
40
35
30
25
20
15
10
5
0
National
Penn College
Page 9 of 10
Penn College Construction Management
AIC/ CQE Results Outcomes Assessment Summary
National
Construction Geomatics
1040
671
216.94
11.85
23.38
9.79
25.58
32.13
22.58
30.64
18.22
8.14
34.64
Difference
-15.37
-2.5
-3.08
-1.05
-1.1
-0.43
-1.97
-2.07
-0.39
-1.01
-1.77
Average
Notes: The initial year of adoption. This
year served as a wake-up call for the
faculty and students alike. There was much
to learn about preparing for the exam and
how to review concepts from across the
entire curriculum. With the program goal of
beating the national average, we need to
work on all areas of coverage in review and
exam prep but feel the program is covering
the majority of the concepts.. We also
need to require a certain level of
performance or some students do not try
or let disregard it due to other time
commitments
senior
year. thresholds and
Actions:
Implement
minimum
benchmark grades related to course grades.
Continue to develop systems for program
content review.
31.7 20.61 28.57 17.83
Project Administration
8.74 24.48
Construction Safety
20.3
Budgeting,Costs, Cost
Control
Management Concepts
9.35
Bidding & Estimating
Engineering Concepts
201.57
Materials, Methods, &
Proj Modeling &
Visualization
Communications
9
# Passed
23
# Taken
Penn College
Planning, Scheduling, &
Schedule Control
2007 CQE Results
7.13 32.87
2007 Penn College BCM vs. National CQE
Results by Concentration
40
35
30
25
20
15
10
5
0
National
Penn College
Page 10 of 10