Two useful documents will be shared in this webinar. The first is a five-part Pre-Evaluation Worksheet. The second document is a five-category rubric for evaluating teaching performance of online instructors. These documents are sharable and editable. Use these documents to start or build upon your existing online faculty evaluation process.
2. Today’s Agenda
Review the Online Faculty Evaluation Rubric
• Sharable & Editable (Creative Commons BY-NC-SA 3.0)
Components included:
1. Pre-evaluation worksheet
2. Professional Development documentation
3. Expectations to be Evaluated
• Examples of Meeting Expectation
• Evaluator Comments
3. Creative Commons License
• Creative Commons BY-NC-SA 3.0
• You are free to:
• Share — copy and redistribute the material in any medium
or format
• Adapt — remix, transform, and build upon the material
• The licensor cannot revoke these freedoms as long as you
follow the license terms.
4. Under the following terms:
Attribution — You must give appropriate credit, provide a link to the
license, and indicate if changes were made. You may do so in any
reasonable manner, but not in any way that suggests the licensor endorses
you or your use.
NonCommercial — You may not use the material for commercial
purposes.
ShareAlike — If you remix, transform, or build upon the material, you
must distribute your contributions under the same license as the
original.
No additional restrictions — You may not apply legal terms or technological
measures that legally restrict others from doing anything the license permits.
7. Evaluation System Components
• Student Evaluation of Instruction
• Faculty Self-Evaluation
• Professional Development Plan
• Faculty Peer Review
• Faculty Portfolio
• Supervisor’s Evaluation of Faculty
Usually some combination of the above components
Shared rubric could
be used for any of
these pieces.
8. Poll Questions – answers on next slide
Choose each statement that is true:
1. My school has established a process for online classroom observation to
evaluate the quality of online teaching.
2. Our deans and/or other academic leaders have the online education
experience and knowledge to effectively evaluate the quality of online
teaching.
3. My school uses Quality Matters or a similar process/rubric for reviewing
online course design.
4. My school has a formal process of faculty peer review of online course
design.
5. My school has a formal process of faculty peer review for online teaching.
9. Poll Questions – answers
Choose each statement that is true:
1. My school has established a process for online classroom observation to
evaluate the quality of online teaching. = 17%
2. Our deans and/or other academic leaders have the online education
experience and knowledge to effectively evaluate the quality of online
teaching. = 9%
3. My school uses Quality Matters or a similar process/rubric for reviewing
online course design. = 65%
4. My school has a formal process of faculty peer review of online course
design. = 17%
5. My school has a formal process of faculty peer review for online teaching.
= 4%
11. Pre-Evaluation Worksheet for Online Faculty Evaluation
Faculty name
Evaluator name
Course to be
evaluated
Term/Semester
Yes No Item:
Have you previously taught this course in the online format?
Have you previously had an administrative evaluation completed for this course, at this college?
Are you the primary course designer for this course? If not, indicate designer's name below.
Have you made significant design changes to this course during the past year?
Additional comments:
12. Sources of Instructional Content
“X” if Yes Item: (check all that apply)
Traditional printed textbook – insert ISBN here:
Textbook publisher's e-text or “e-pack” (add link if possible)
Textbook publisher's website (add link to site)
Independent e-book (add link if possible)
Open Educational Resources (add link if possible)
Multimedia components available on the Internet
Instructor-owned instructional assets (describe below)
College-owned instructional assets (describe below)
Commercially-available instructional assets (CD-ROM, etc.- add link if possible)
Instructor's or departmental website, blog, wiki, etc. (add links to sites)
Other – indicate nature of other resources in comments section below.
Additional comments:
13. Instructional Communication Tools
Inside
LMS
Outside
LMS
No Item: (NOTE: Add URLS for any tools used outside course)
Discussion forums
Chat room
Web conferencing tool
Instant messaging or pager
Assignments folder feedback comments
Quiz feedback comments
Email
Blog or wiki
Social networks or other websites
Other – indicate nature of other tools in comments section below.
Additional comments:
14. End of Pre-Eval
Use the following space to communicate anything else that would be beneficial to
you or the reviewer prior to the teaching evaluation.
Adapted from: Lake Superior College Online Faculty Pre-evaluation Worksheet
16. Basic Info
Professional Development:
Is there documentation on file indicating the following?
Faculty name
Evaluator name
Course evaluated
Term/Semester
Start/End dates
Yes No Faculty participation in the following:
Training sessions for faculty who are new to online teaching
Online faculty peer review process
Web accessibility training
Online faculty workshops, webinars, conferences
Additional comments:
17. Evaluation Grading Scale:
A = Exceeds expectations
B = Meets expectations
C = Will meet expectations with minor changes
D = Falls short of expectations
18. Category 1: Basic Expectations for Online Courses
Grade Expectation Examples of Meeting Expectation
Evaluator
Comments
1A: Course syllabus
information matches
approved college
curriculum.
1A: Syllabus will include, but not be limited to, these items:
1) Learning outcomes listed in course match official outcomes.
2) Course description matches official description.
3) Disabilities statement and other standard curriculum language are included.
1B: All required and optional
classroom resources are
clearly identified with
information about access.
1B: Syllabus or introductory information should include:
1) textbook information, including ISBN
2) lab kits, or similar resources
3) equipment needed by students
4) software or other resources
1C: Course time line is
clearly identified and easy to
find; with due dates, and
appropriate windows of
opportunity.
1C: Students often choose online learning because they seek time flexibility in
their schedule management.
1) The "window of opportunity" refers to the number of days that a student may
complete an assignment/quiz/etc. A quiz period that starts on Monday and
closes on Thursday is a four day window of opportunity.
2) Generally speaking, windows of opportunity from 3-7 days are reasonable.
3) Periodic due dates (for example, weekly), are important as many online
students have been found to not keep up with coursework when time line is left
wide open.
19. Category 1: Continued
Grade Expectation Examples of Meeting Expectation
Evaluator
Comments
1D: Expectations for
faculty response times
are clearly articulated for
all major course
components.
1D: Response time, grading turnaround time, or feedback frequencies are clearly
articulated to students for the following, if used in course:
1) email responses
2) quiz grading/feedback (continued next page)
3) assignment grading/feedback
4) discussion forum postings, etc.
1E: Instructor-prepared
course materials are
accurate, professional,
and consistent.
1E: Expectations include:
1) Good grammar
2) No obvious errors, including typos
3) Language level is appropriate for the audience
4) Consistent look and feel on content pages and syllabus
5) “Instructor voice,” in text or multimedia, is appropriate.
1F: Instructor provides
and maintains a
welcoming, safe, and
positive learning
environment.
1F: Examples include:
1) Clearly state the types of behavior that will not be tolerated in the online class.
2) Post and enforce rules for netiquette.
3) Maintain a safe learning environment by:
a) focusing on academic achievement, b) maintaining high standards,
c) fostering positive relationships between students and faculty,
d) reducing negativity, and e) resolving conflict
20. Category 2: Learning Experiences/Opportunities
Grade Expectation Examples of Meeting Expectation
Evaluator
Comments
2A: Has designed learning
opportunities that
encourage higher order
thinking skills such as
analysis, evaluation,
synthesis, problem solving,
and critical thinking.
2A: Non-exclusive list of possibilities:
1) scenario-based problems
2) Case studies and/or simulations/games
3) Peer tutoring, 4 Journaling
5) Exercises in diagramming or visualizations
6) Cooperative learning in groups
2B: Instructor uses
discussion forums
effectively.
2B: Student discussions should serve to:
1) stimulate thinking, 2) challenge attitudes and beliefs
3) develop interpersonal skills
4) investigate questions without simple answers
2C: Learning opportunities
are sufficient for students to
achieve all of the expected
course outcomes.
2C: Significant learning opportunities/requirements:
1) are correlated to specific course learning outcomes.
2) are not tangential to course learning outcomes.
21. Category 2: Continued
Grade Expectation Examples of Meeting Expectation
Evaluator
Comments
2D: Learning experiences
are current, relevant, and
presented in a logical
sequence.
2D: Smaller “chunks” of content or modules tend to enhance student learning.
Content should be kept up-to-date (including links). When possible, course content
in latter part of course should build on content from earlier parts. Possibilities for
chunking include: by module, by week, by chapter, by topic
2E: Learning
opportunities enable
students to engage in a
variety of activities that
promote practice and a
transfer of skills.
2E: For example:
1) Learners can sometimes choose among available options for activities that are
relevant to them.
2) Variety of learning opportunities may allow students to engage with course
content in more than one modality.
Additional comments on Category 2:
22. Category 3: Activity and Interactivity
Grade Expectation Examples of Meeting Expectation
Evaluator
Comments
3A: Class introductions and
start-up procedures are
appropriate for instructor
and students.
3A: Getting off to a good start is crucial in eLearning:
1) Start building a sense of community among faculty and students
during the 1st week.
2) Consider alternate strategies for course introductions (including
audio/video) to build strong sense of instructor presence.
3) Create a quiz on key items from the syllabus and/or key services
available to online students.
3B: Encourages students to
be active participants in
class.
3B: Examples include:
1) Require frequent contributions to the class by all students.
2) Prompt students to share their experiences and knowledge with
other students.
3) Vigilantly track non-attendance or non-participation by lagging
students. Contact students by email or send note to advisor for
students not participating.
4) Add links to relevant and timely news articles and have students do
the same.
23. Category 3: Continued
Grade Expectation Examples of Meeting Expectation
Evaluator
Comments
3C: Instructor
communicates with
students in a clear and
effective manner.
3C: Consider the following:
1) Be professional in your all communications.
2) Double check spelling and factual accuracy of news postings,
discussion postings, emails, assignments, quizzes, etc.
3) Provide written feedback on quizzes/assignments beyond a simple
“good job” or “needs work.”
4) Avoid jargon as much as possible.
3D: Instructor
communicates with
students in a timely
manner.
3D: Possibilities
1) Challenge yourself to meet or exceed the feedback timing
expectations that you have set for the class.
2) Take sanity breaks, but always let students know when they can
expect to hear from you.
3) Intelligent agents (in D2L) can be effective ways of providing timely
feedback on quizzes, dropbox assignments, etc.
24. Category 3: Continued again
Grade Expectation Examples of Meeting Expectation
Evaluator
Comments
3E: Instructor has created
multiple opportunities for
student-to-student
interactions.
3E: Through various online communication tools, require or encourage
students to interact with others on a regular basis. Possible tools:
1) discussion boards
2) web conferencing
3) phone conferencing (or PC)
4) personal profile pages
5) email
6) social networking
3F: Students are required to
engage in active learning
exercises.
3F: Some examples include:
1) Create course activities that take the students away from the
computer screen to accomplish certain tasks or achieve goals toward
course outcomes.
2) Where appropriate, have students engage with community or
industry members for course-related work.
3) Create assignments that encourage use of the college library,
tutoring center, or other support services.
Additional comments on Category 3:
25. Category 4: Evaluations, Assessments, and Grading
Grade Expectation Examples of Meeting Expectation
Evaluator
Comments
4A: Grading policy is easy
to locate, easy to
understand, and
complete.
4A: Instructor’s grading policy:
1) Should always be available in the course shell and in an easy-to-find
location
2) Language used to describe grade determination should be easy to
understand.
3) All components of the policy for determining student grades should be
located in one place.
4B: Utilizes multiple
assessment methods as
required of all college
courses.
4B: Consider a mixture of various options for graded work, including, but
not limited to:
1) quizzes or exams, 2) writing assignments, 3) portfolios
4) lab reports, 5) discussion postings,
6) event participation and analysis, 7) problem sets,
8) oral presentations, 9) debates,
10) simulations, 11) case studies
26. Category 4: Continued
Grade Expectation Examples of Meeting Expectation
Evaluator
Comments
4C: Utilizes the LMS grade
book for students to track
their progress through the
course.
4C: The LMS grade book is essential since it provides a password-
protected, one-stop shop for students to view all assigned grades.
4D: Take appropriate steps
to mitigate security,
honesty, and/or
authentication concerns
regarding student
assessments.
4D: Examples might include:
1) Proctored exams
2) Timed quizzes/exams
3) Lock-down browser
4) Document submission via assignments folder
5) Plagiarism detection
6) Original writing assignments each term
Additional comments on Category 4:
27. Category 5: Other Faculty Expectations
5A: Research Completed or in Progress
Comments:
5B: Committee work or campus involvement
Comments:
5C: Community service
Comments:
5D: Service to students (non-teaching)
Comments:
28. Finding the Rubric
T&L Community Post
Evaluating The Quality Of Online Teaching - Webinar
Archive
bit.ly/dahlrubric