networks & systems laboratory> research> current projects> computer science education research

Computer Science Education Research
Smart Internet Technology Research Group

Overview

A major role for a university is to help students learn. Members of the Computer Science Education Research group collaborate to improve the effectiveness and efficiency of this process. We are committed to innovative pedagogy which takes a student-centred approach, founded on educational research. As IT experts, we seek new ways to use IT appropriately to support learners and teachers.


Teaching Systems

- Information Technology can assist students in their learning, by providing extra opportunities to see examples, practice skills, and get feedback.
- We seek to provide systems that are “intelligent”, for example, by adapting the material presented to the student’s current knowledge and interests. This requires the system to maintain a “student model”.

- It is important for any teaching system to be scrutable, that is, the student should be able to find out why the system behaves as it does. Student reflection is also encouraged by allowing the student to see the model that the system has built of their skills.

- A teaching system should also assist the teachers, by providing access to collective information about the state of understanding, and in particular about any common errors students are making.

- The development of these systems makes strong use of research expertise of members of our group in fields such as User-Adaptive Systems, Intelligent Tutoring Systems, and Adaptive Hypertext.

- See “Learner Control” by J. Kay in User Modeling and User-Adapted Interaction, vol 11, no 1, 2001.

Active and Reflective Learners

- Educational theory suggests that student learning is enhanced when students are actively engaged in constructing meaning from the content and experiences, and when they pay
attention to their own learning. We should encourage students to become partners in planning their study: they should be given explicit guidance on the concepts and skills they must master, and they should identify deficiencies and plan specific action (such as examining case studies, working on simple exercises, etc) to remedy these.

- Problem-Based Learning (discussed elsewhere on this poster) is a very direct attempt to get students participating in learning actively and reflectively. Even in courses with more conventional lecture/lab/assignment structures, we can take steps to encourage deep approaches to learning. For example, students can be given concept inventories, and asked to track which lab activities relate to each concept.

- See “Supporting Reflection in Introductory Computer Science” by A. Fekete, J. Kay, J. Kingston and K. Wimalaratne, in Proceedings of SIGCSE Technical Symposium on Computer Science Education, 2000, published by ACM Press.

Scholarship of Teaching

- We are committed to pursuing educational innovation within a community of scholars devoted to improving student outcomes. We seek careful evaluation of the impact of innovative practices, through quantitative and qualitative studies, and through feedback from students and peers.

- Internationally, the community of scholars is mainly organised through SIGCSE, the Special Interest Group on Computer Science Education within the ACM.

- Our innovations are disseminated to the community through publication in the main conferences sponsored by SIGCSE, including the US-based Technical Symposium in Computer Science Education, the Europe-based Conference on Innovation and Technology in Computer Science Education, and the Australasian Computing Education Conference.

Problem-Based Learning

- Problem-Based Learning (PBL) is an approach to professional education that has been widely used in Engineering, Medical and Health Science degrees. Its use in large-enrolment introductory programming classes was pioneered by members of this CS Education Research Group.

- A key aspect of PBL is that students should work in groups on authentic tasks, with learning driven by the needs of the task. In introductory programming these tasks are the creation of substantial software systems. For example, in the first semester unit, students who have never programmed before are required to build a system to perform a time-step simulation of a physical, biological or economic model. This drives them to learn about classes, methods, loops, etc. These tasks are too large for a student to complete alone, so improving communication and teamwork skills becomes essential for progress. Of course, working in a group also contributes to effective learning, since the students can support and critique one another.

- PBL expects each student to become a partner in planning their own learning. Extensive resources are provided for scaffolding, but each learner needs to decide which resources are most helpful for them, in their current state of knowledge. Students are asked to fill in a weekly diary, which records the plans of what to learn and how to learn it; this encourages reflection as each week’s outcome must be compared with the plan.

- Evaluation of the course shows that compared to conventional lecture/lab/assignment approaches, PBL does not detract from the students learning of technical content, and it enhances desirable affective outcomes and develops generic problem solving skills.

- See “Conveying Technical Content in a Curriculum Using Problem-Based Learning” by A. Fekete, T. Greening and J. Kingston, in Proceedings of Australasian Conference on Computer Science Education, 1998. See also “Problem-Based Learning for Foundation Computer Science courses” by M. Barg, K. Crawford, A. Fekete, T. Greening, O. Hollands, J. Kay and J. Kingston, in Computer Science Education, vol 10, no 2, 2000.

 

Logic Tutor

- The Logic Tutor is an Intelligent Teaching Assistant System developed by Kalina Yacef together with several project and honours students.

- It is used in a second year class where students must learn the syntax and semantics of propositional logic, and also learn to write proofs in a natural deduction style. It aims to alleviate some of the problems arising from large student numbers.

- The system embeds several tools. The Logic Tutor itself is an intelligent tutoring system designed for students to use. It allows them to practice propositional proofs at their own pace, and they receive instant feedback. The system recognizes a number of common mistakes, and provides directed hints when these occur.

- The system also includes tools intended to help the teacher. One manages teaching configuration settings and material. Another, the LT-Analyser, is used to allow the teacher to monitor the progress of the class. This allows access to data on student’s use of the system, and the types of mistakes they are making. The data can be seen student-by-student, or aggregated at various levels.

- See “The Logic Tutor” by D. Abraham, E. Crawford, L. Lesta, A. Merceron, and K. Yacef, in Proceedings of the Conference on Innovation and Technology in Computer Science Education (ITiCSE), 2001, published by ACM Press.

Recognition

- A University of Sydney Teaching Excellence Award was won by the group who developed the Problem-Based Learning curriculum for first-year programming units. Alan Fekete, Tony Greening and Judy Kay were members of this group.

- Judy Kay and Tony Greening also hold individual University Teaching Excellence Awards. Kalina Yacef has won a Faculty of Science Teaching Excellence Award.

- Members of the group are active in the wider community of Computer Science Education Research. Tony Greening has been Program Committee Co-chair for the Australasian Computing Education Conference, and he has edited a book “Computer Science Education in the 21st century” published by Springer Verlag.

The Lifecycle of a Teacher

- To inculcate the casual tutoring staff with sound pedagogy, we follow a staged process by which a student gradually develops the skills and attitudes of an effective student-centred teacher.

- Student: In first year, each student experiences the Problem-Based Learning approach to study. In particular, they discover the value of working in groups, and they are led to reflect on their own learning style. For example, each student needs to pay attention to the different ways they learn, and use this to plan activities that will allow them to learn the required technical content.

- Mentor: In second year, some students volunteer to act as mentor in first year classes. This is an unpaid activity, where the mentor attends lab sessions and acts as a guide and technical resource. The mentors are evaluated by their students. Dedicated and effective mentoring is recognized by a certificate. We have found that mentors place great value on this experience.

- Tutor: In selecting those higher-year students who will be hired as casual tutors, we give great weight to the evaluation from their mentoring experience. All tutors are provided with staff development to help them approach tutoring duties in ways that are appropriate for PBL.

- Reflective teacher: An Honours subject is offered called Computer Science Education Research and Practice (CSERP). This introduces students to the research literature and methods of Computer Science Education. Each student in this class carries out a project within the context of their own tutoring duties.

Funding

- Many projects of the CS Education group have been funded from external and/or university sources.

- The University of Sydney Teaching Innovation Fund has supported the creation of the mentor program, a study of the approaches to group work of students in PBL classes, and the development of support materials for tutors in second year classes.

- The Faculty of Science within the university has provided support under the Teaching Development Fund for developing a self-assessment resource for students to improve software design skills. It has also funded the investigation of mechanisms to assist students at risk of failure in second year programming.

- The Federal Government Department of Education Science and Training, through its Science Lectureships Initiative “Building the Internet Workforce” supports the groups in creation of learning items for topics in networking and software development. A repository storing these items is available for access by tertiary and secondary teachers. This grant is a collaboration with Monash University and the University of Queensland, and is sponsored by Telstra, Sun Microsystems, Compuware, DSTC and Multimedia Victoria. See www.webworkforce.org for more details.

Contacts

Associate Professor Alan Fekete
Associate Professor Judy Kay
Associate Professor Bob Kummerfeld
Dr Tony Greening

Dr Kalina Yacef
Mr Kapila Wimalaratne

 
University of SydneyDesigned by eliu