Paper Summary
Share...

Direct link:

Setting Up an Online Learning Environment Using Learning Behavior Analytics in an Engineering Professional Education Course

Sat, April 14, 8:15 to 9:45am, The Parker, Floor: Third Floor, Azekka Room

Abstract

The Technology-Enriched Learning Initiative is a research project aimed at better integrating online learning in on-campus teaching. One of the blended courses it developed is an advanced 3rd year civil engineering professional education course. This course focuses on providing the students with knowledge and understanding in the behaviour and design of steel structures. This course aligns its aims to address some of the learning outcomes as stated by the Hong Kong Institution of Engineers (HKIE) which accredits Engineering institutions and companies across Hong Kong.

The original format of the course followed the traditional didactic style of lecture, in which mathematical theories and engineering concepts were introduced during class time. As a professional education course, it aimed toward cultivating students’ ability to respond to complex real-world problems and demonstrate a threshold of mastery in engineering practice.

Simultaneously the course faced the challenges of incorporating essential skills, such as critical thinking, collaboration, and creativity, which require more interaction between peers and the professor.

Hence, the instructor and TELI team worked together to redesign three weeks of its twelve-week course into a blended mode of delivery to allow more time for in-class activity and longer engagement time with the instructor. These learning designs were further substantiated by providing context through student interviews at the end of the course

The pilot project ran in two phases. In phase I, the course was observed, video recorded and documented for a semester by the instructional designer to better understand the dynamics and interactions occurring inside the classroom. Before the final examination, a series of lecture-recorded videos were released to students to test and gauge which topics they found “useful” as part of their revision resources. The learning behaviour analytics results from phase I was then used to inform the design of the next iteration (phase II) of the course, which was launched a year after the initial run.

This study draws attention to the details of the learning design process in creating the online environment and the in-class activities for students. This study addresses the following key questions:

1. how to condense a 3-hour F2F lecture into a bite-sized video lecture,
2. which topics should be highlighted and included in the video lectures, and
3. how to effectively use LMS to better manage student progress.

Results indicate how learning behavior analytics, such as average watch time, clickstream and retention rate, can be utilized to gauge students interest during F2F lectures to better inform the instructional designer and course team in redesigning and selecting materials during the development of the blended course. These analytic metrics affect the length of each lecture videos and the topics that were included in each set that was released in phase II. At the end of the semester, we interviewed both the professor and the students about their experience and both showed positive feedback toward the blended mode delivery of the course.

Authors