CDIO Standards Compliance: Monitoring Perception of Students´ Proficiency Levels

M. Muñoz, C. Martínez, C. Cárdenas (2017). CDIO Standards Compliance: Monitoring Perception of Students´ Proficiency Levels. 10.

2017 13th International CDIO Conference, University of Calgary, Canada

76_Final_PDF.pdf

This article presents a mechanism for monitoring a program's effectiveness and efficiency in reaching its intended educational goals across the curriculum. Starting in 2011, the School of Engineering at the Universidad Católica de la Santísima Concepción (UCSC) has been implementing a curricular reform based on the CDIO approach. Since then, every two years we have performed a self-evaluation of the Computer Science program’s compliance with the CDIO Initiative standards. Along the way, we have developed tools and mechanisms to systematize the gathering of data for these continuous evaluation processes.

In particular, we have defined three intermediate milestones at which to measure the achievement of student learning outcomes associated with CDIO Syllabus levels 2, 3 and 4: at the end of the second semester, at the end of the sixth semester and at the end of the ninth semester. At each milestone, we are interested not only in analyzing data associated with traditional course-level grades, but also in how student achievement levels are perceived by the students and the instructors.

In order to gather the perception of student achievement levels in both students and instructors, we used sample surveys similar to the one presented in Appendix H of the CDIO Syllabus (Crawley, 2001), where the proficiency levels are:

1. To have experienced or been exposed to, 2. To be able to participate in and contribute to, 3. To be able to understand and explain, 4. To be skilled in the practice or implementation, 5. To be able to lead or innovate in

Then, we measure the gaps between these perceptions and present them in easy-to-understand radial graphs. This information is used to detect low proficiency levels and to manage instructors and students expectations of their proficiency levels at each milestone.

Also, students are required to have completed a summer internship by the end of the ninth semester. Students must complete a self-evaluation performance survey regarding their internship, while employers must evaluate the student’s performance. These surveys focus on personal and interpersonal skills and attitudes. Again, we measure the gaps between these results and present them in easy-to-understand radial graphs. This information is used in a similar manner as described before.

This mechanism has been applied every semester since 2015. Our preliminary results have shown that student and instructor perception of proficiency levels show a greater variance for the first two milestones. However, by the end of the ninth semester, these gaps have been reduced, which shows that both students and instructors have a better understanding of their proficiency levels. Moreover, students are slightly more critical of their competence levels than their instructors and employers.

Proceedings of the 13th International CDIO Conference in Calgary, Canada, June 18-22 2017

Authors (New):

Marcia Muñoz

Claudia Martínez

Cristian Cárdenas

Pages:

Affiliations:

Universidad Católica de la Santísima Concepción, Chile

Keywords:

Program evaluation

Standards compliance

Syllabus proficiency levels

CDIO Standard 1

CDIO Standard 2

CDIO Standard 3

CDIO standard 4

CDIO Standard 5

CDIO Standard 6

CDIO Standard 7

CDIO Standard 8

CDIO Standard 9

CDIO Standard 10

CDIO Standard 11

CDIO Standard 12

Year:

2017

Reference:

Brodeur, D. R. & Crawley, E. F. (2005). Program evaluation aligned with the CDIO standards. Proceedings of the ASEE-2005, Portland, Oregon.:

Cárdenas, C., Cepeda, M., Martínez, C., & Muñoz, M. (2012). Modelo de evaluación de actividades curriculares de un plan de estudios basado en resultados de aprendizaje y competencias. Proceedings of XXV Congress of the Chilean Engineering Education Society (SOCHEDI), Antofagasta.:

Cárdenas, C., Martínez, C. & Muñoz, M. (2013). Bringing active learning into engineering curricula: Creating a teaching community. Proceedings of the 9th International CDIO Conference, MIT and Harvard University, Cambridge, MA. :

CDIO (2010). The CDIO standards v2.0 (with customized rubrics). Retrieved from http://www.cdio.org/knowledge-library/documents/cdio-standards-v-20-customized-rubrics.:

Cea P., Cepeda, M., Gutiérrez, M., & Muñoz, M. (2014). Addressing academic and community needs via a service-learning center. Proceedings of the 10th International CDIO Conference, Universitat Politècnica de Catalunya, Barcelona, Spain.:

Cea, P., Muñoz, M., & González, F. (2015). Aprendizaje-servicio en Ingeniería Civil de la UCSC: Experiencia del curso de topografía. RIDAS, Revista Iberoamericana de Aprendizaje y Servicio, 1, 132-137. Recuperado de http://revistes.ub.edu/index.php/RIDAS/article/view/ridas2015.1.8. :

Crawley, E., Malmqvist, J., Ostlund, S., & Brodeur, D. (2007). Rethinking engineering education: The CDIO approach. Springer Sciences + Business Media LLC, New York. :

Crawley, E. (2001). The CDIO Syllabus: A statement of goals for undergraduate engineering education. MIT CDIO Report. :

Crawley, E., Malmqvist, J., Lucas, W., & Brodeur, D. (2011). The CDIO syllabus v2.0. An updated statement of goals for engineering education. In Proceedings of 7th International CDIO Conference, Copenhagen, Denmark. :

Loyer S., Muñoz, M., Cárdenas, C., Martínez, C., Cepeda, M., & Faúndez, V. (2011). A CDIO approach to curriculum design of five engineering programs at UCSC. Proceedings of the 7th International CDIO Conference, Technical University of Denmark, Copenhagen. :

Loyer, S. (2013). Teaching mechanics for real. A different approach for civil engineers. Proceedings of the 9th International CDIO Conference, MIT and Harvard University, Cambridge, MA. :

Martínez, C. & Muñoz, M. (2014). ADTP: An active learning method for a programming lab course. Proceedings of the 10th Internatio Barcelona, Spain. :

Martínez, C., Muñoz, M., Cárdenas, C., & Cepeda, M. (2013). Adopción de la Iniciativa CDIO en los planes de estudio de las carreras de la Facultad de Ingeniería de la UCSC. and Caribbean Conference for Engineering and Technology, Cancún, México.:

Martínez, C., Muñoz, M., & Cárdenas, C. (2015). A tool for CDIO standards compliance levels monitoring. Proceedings of the 11th International CDIO Conference, Chengdu University of Information Technology, Chengdu, Sichuan, P. R. China. :

Martínez, A., & Cárdenas, C. (2014). A methodological strategy for active learning in multivariate analysis. Proceedings of the 10th International CDIO Conference, Universitat Politècnica de Catalunya, Barcelona, Spain. :

Muñoz, M., Martínez, C., Cárdenas, C., & Cepeda, M. (2013). Active learning in first-year engineering courses at Universidad Católica de la Santísima Concepción. Australasian Journal of Engineering Education, 19(1), 27-38. :

on August 11, 2017 - 07:24 MAndersson

CDIO Standards Compliance: Monitoring Perception of Students´ Proficiency Levels

Navigation

CDIO Standards Compliance: Monitoring Perception of Students´ Proficiency Levels

Share this content.