Evaluate

Source: https://onlinelearninghub.tudelft.nl/evaluate/ Parent: https://learningforlife.tudelft.nl/learning-assessment-regulations/

Deliverables

Review evaluation report and/or survey results
Create an evaluation summary
Confirm a date for the course re-run
Revise and improve course content and activities using improvement plan and re-run checklist
Publish MOOC material on the Delft OpenCourseWare site

Steps

Take a look at our ‘Roadmap for creating online courses‘ for an overview of the total process (legend and sub-processes included).

The Quality Assurance Handbook describes all processes and activities made by Extension School to guarantee a high-quality learning experience.

1. Evaluate
2. Improve course
3. Prepare re-run

1. Evaluate

Evaluation report from survey data

Two surveys (pre- and post-) are added to each online course by the evaluation team. Additional questions may be added upon request.

Evaluation reports for MOOCs are available in Tableau dashboard within one week from the end of the run. For all other courses, survey results will be made available upon request.

Evaluation meeting

Within 1 month of the course’s completion, you are invited for an evaluation meeting with the Extension School product & portfolio manager and learning developer to discuss how the course went, learners satisfaction and identify any necessary improvements. This is part of the Quality Assurance Roadmap. The Extension School takes the lead for the evaluation process during the first run of a course and at regular intervals of three runs or three years if a course runs multiple times a year.

The course team / moderators are expected to evaluate the course, including issues with activities and videos. Staff in charge of moderation should also review the discussion posts during the course to find examples of positive quotes, and also comments/suggestions/criticism for improvement. These are valuable to discuss in the evaluation meeting, for this purpose we recommend to use the Community Management Log.

As conclusion of the evaluation the Extension School takes the lead to create and share with the course team an Evaluation Summary with:

a brief summary of the evaluation meeting from a pedagogical as well as business perspective
an actionable list of improvements or modifications to the course that should be carried out before the rerun
confirmed date(s) for re-run
feedback on support

2. Improve course

Improve course and revision of content & activities

To ensure the continuous improvement of the course, the necessary modifications agreed during the evaluation meeting will be carried out by the staff assigned for these tasks.

The modifications and improvements will be completed in preparation of the course re-run. This activity guarantees that we close the quality assurance cycle by acting upon the feedback and recommendations gathered by learners and discussed in the evaluation.

3. Prepare re-run

Prepare re-run

Copy a Rerun checklist for your type of course and add your own modifications. If your course is changing From instructor-paced to self-paced, ensure the necessary changes are made.

Don’t forget to review your About page so new online learners have the latest information about your course including new dates and mode of instruction.

Publish material on OCW

MOOCs course material (syllabus, learning objectives, unit descriptions and explanations, videos and framing text that accompanies resources curated from third parties will be shared via TU Delft OpenCourseWare website. For other types of courses the amount of content that can be shared is discussed during or after the evaluation meeting.

The OpenCourseWare team will take care of the process and publication. You will be asked for final approval and sometimes for input.