Characterizing the Pedagogical Benefits of Adaptive Feedback for Compilation Errors by Novice ProgrammersSEET
Can automated adaptive feedback for correcting erroneous programs help novice programmers learn to code better? In a large-scale experiment, we compare student performance when tutored by human tutors, and when receiving automated adaptive feedback. The automated feedback was designed using one of two well-known instructional principles: (i) presenting the correct solution for the immediate problem, or (ii) presenting generated examples or analogies that guide towards the correct solution. We report empirical results from a large-scale (10,000+ person hour) experiment assessing the efficacy of these automated compilation-error feedback tools. Using the survival analysis on error rates of students measured over seven weeks, we found that automated feedback allows students to resolve errors in their code more efficiently than students receiving manual feedback. However, we also found that this advantage is primarily logistical and not conceptual; the performance benefit seen during lab assignments disappeared during exams wherein feedback of any kind was withdrawn. We further found that the performance advantage of automated feedback over human tutors increases with problem complexity, and that feedback via example and specific repair have distinct, non-overlapping relative advantages for different categories of programming errors. Our results offer a clear and granular delimitation of the pedagogical benefits of automated feedback in teaching programming to novices.
Thu 9 JulDisplayed time zone: (UTC) Coordinated Universal Time change
07:00 - 08:00 | I14-SEET - Industry Relevant Teaching and OthersSoftware Engineering Education and Training at Goguryeo Chair(s): Letizia Jaccheri Norwegian University of Science and Technology | ||
07:00 12mTalk | Addressing the Double Challenge of Learning and Teaching Enterprise Technologies through Peer TeachingSEET Software Engineering Education and Training Richard Glassey KTH Royal Institute of Technology, Olle Bälter KTH Royal Institute of Technology, Philipp Haller KTH Royal Institute of Technology, Mattias Wiggberg KTH Royal Institute of Technology | ||
07:12 12mTalk | Characterizing the Pedagogical Benefits of Adaptive Feedback for Compilation Errors by Novice ProgrammersSEET Software Engineering Education and Training Umair Z. Ahmed National University of Singapore, Nisheeth Srivastava Indian Institute of Technology, Kanpur, Renuka Sindhgatta Queensland University of Technology, Australia, Amey Karkare IIT Kanpur | ||
07:24 12mTalk | VeriSIM: A Learning Environment for Comprehending Class and Sequence Diagrams using Design TracingSEET Software Engineering Education and Training | ||
07:36 12mTalk | Towards an Open Repository for Teaching Software Modeling applying Active Learning StrategiesSEET Software Engineering Education and Training Williamson Silva UFAM, Bruno Gadelha UFAM, Igor Steinmacher Northern Arizona University, Tayana Conte Universidade Federal do Amazonas | ||
07:48 12mTalk | What prevents Finnish women from applying to software engineering roles? A preliminary analysis of survey dataSEET Software Engineering Education and Training Annika Wolff LUT University, Antti Knutas LUT University, Paula Savolainen Turku University of Applied Sciences Pre-print |