This module focuses on how to assess student messages in an online discussion forum when teaching in an online environment. This module is part of the Best Practices in Online Teaching Course created by Penn State University World Campus as a guide for faculty who are new to teaching in an online environment.
What to do?
Assessing students’ messages in online discussions encourages their participation and hopefully helps improve the quality of discussion as well. Set specific assessment criteria and make the criteria available to students in the beginning of the course.
How to do it?
- Include the assessment criteria for online discussions within one or more locations (
See Example ):
- The course syllabus
- A course announcement prior to the first online discussion task
- The instructions for the discussion task
- Make sure the assessment criteria measure both the quantity and quality of the online messages.
- When designing a rubric for assessing online discussions, consider assigning some points to encourage posting.
- Make use of sample rubrics from literature:
-
Edelstein&Edwards' (2002) Assessing Effectiveness of Student Participation in Online Discussions . This rubric considers five categories that are important for building a learning community: promptness and initiative, delivery of post, relevance of post, expression within the post, and contribution to the learning community.
-
Garrison's, et al. (2001) Cognitive Processing Categories . May be useful when assessing the quality of postings: (1) triggering (questioning); (2) exploration (information seeking and sharing), (3) integration (providing solution), and (4) solution (testing solutions)
-
Kleinman’s (2005) Grading Rubric for Online Discussion Participation . Provides detailed grading criteria.
-
Dringus&Ellis' (2005) Assessment of Student Progress in Forums
- For more information about facilitating online discussions, please see
Ten Tips for Generating Engaged Online Discussions by Donna Reiss.
Example - referring to assessment criterion
Message Board Discussions
How it works: * Midnight Sunday through midnight Friday
I will post a question by midnight Sunday. Your tasks are to:
- Post a thoughtful, unique answer to the instructor's question in 300 words or less (your answer should not be the same as someone who has already posted). You should build an informed response between Sunday night (when the question is posted) and Friday night (when your response is due).
- You will be graded on the quality of your responses--not quantity. Be thoughtful rather than verbose. Due midnight Friday. Each student will be graded on an individual basis (max score is 10)
The grading criteria used includes:
- Your ability to synthesize different aspects of the posted question, particularly with reference to the articles in the course packet. The more detailed your explanation of specific points from the articles, the better the quality of your response.
- Your skill in posting a response with specific and unique examples that showcase your understanding of the salient points of the posted question, as well as your understanding of different aspects of the course materials (such as course packet articles, lecture notes, and textbook readings).
- Your ability to build a final, thoughtful response based on prior postings. This requires you to respond more than once to the instructor's post. Your final response should be structured around your previous postings, and you will attempt to integrate your different thoughts and opinions.
Got questions? Get instant answers now!
Why do it?
When instructors grade discussions in an online course, students tend to participate in the discussions actively and thus have higher levels of sense of community (Rovai, 2003). However, too much emphasis on solely quantitative analysis of postings/messages can only result in coerced participation, poor quality of learning and student contributions to the online discussion (Garrison&Anderson, 2003).
Thomas (2002) suggests that three factors account for the lack of “normal discussion” that is necessary for learning to take place: “isolated mode of participation, the structural organization of messages, and the conflict between the written form and oral function of technology-mediated interpersonal communication” (p.362); good facilitation by a tutor or moderator is important to creating coherent online discussions.
References:
Dringgus, L.P.&Ellis, T. (2005). Using data mining as a strategy assessing asynchronous discussion forums.
Computers&Education, 45 , 141-160
Edelstein, S., and Edwards, J. (2002). If you build it, they will come: Building learning communities through threaded discussions.
The Online Journal of Distance Learning Administration, 5(1) . Available Online:
(External Link)
Garrison, D. R., Anderson, T., and Archer, W. (2001). Critical thinking, cognitive presence, and computer conferencing in distance education.
The American Journal of Distance Education, 15(1) , pp 7-23
Garrison, D.R.&Anderson, T. (2003).
E-learning in the 21st century: A framework for research and practice . New York: RoutledgeFalmer.
Kleinman, S. (2005). Strategies for encouraging active learning, interaction, and academic integrity in online courses.
Communication Teacher, 19(1) , 13-18
Rovai, A. P. (2003). Strategies for grading online discussions: Effects on discussions and classroom community in Internet-based university courses.
Journal of Computing in Higher Education, 15(1) , 89-107.
Thomas, M.J.W. (2002). Learning within incoherent structures: the space of online discussion forums.
Journal of Computer Assisted Learning, 18 , 351-366
