Rubric forms in Sakai

I am working on a set of forms for a well-researched set of rubrics for portfolio evaluation to donate to the http://openedpractices.org community library. There are 14 rubrics in the set, each dealing with a specific learning outcome. Every rubric has a set of 5-6 criteria that can be rated on a 0-4 scale. The rubrics contain descriptors for rating values 1-4 that describe under what conditions an evaluator should award each rating for each criteria and instructions to an evaluator encouraging them to award a "0" to anything that doesn't satisfy the descriptor for a rating of "1".

To implement these rubrics I am building OSP forms with a custom renderer. Here is how I plan to make them work:

  • An evaluator will be presented with a table of criteria (rows) and rating values "1"-"4" (columns) for the rubric. Each cell of the table will include a clickable descriptor.
  • The evaluator will also be presented text input fields for each criteria that would allow them to type in a rating value of 0-4. Each text input will be initialized with a "0" value.
  • There will be a single text field for comments.
  • When an evaluator clicks a descriptor in the table, the descriptor will be highlighted and the text input field will reflect the rating value for that table column.
  • When an evaluator clicks a highlighted descriptor, the descriptor highlighting will be removed and the text input for that criteria will be set to "0".
  • When an evaluator enters a text value for a rating, the value is immediately validated as a 0-5 value and the appropriate descriptor in the table is highlighted.
  • If an evaluator decides not to enter a rating, she may delete the rating from the text input box. None of the fields are "required".

If you have any interest in providing some feedback into the behaviors of Sakai rubric forms, I'd love to hear about it.

Comments

iRubric for Sakai

Hi Sean, Just ran into your blog. We actually do have a comprehensive rubric creation, assessment, and analysis tool that is fully integrated with Sakai. You can find more info at http://www.irubric.com/sakai, or see Indiana University's podcasts at http://education.indiana.edu/iRubric/tabid/13556/Default.aspx. Please let us know if you're interested. Regards, Ramesh

Awesome!

Your offering looks great.

What we are working on is building on the Sakai portfolio tools (namely the Forms tool) to create a rubric for evaluating ePortfolios. Does iRubric integrate with the portfolio tools?

iRubric integration

The integration is through Sakai's gradebook and rubric scores are saved back in the gradebook. This video may be helpful http://www.rcampus.com/sakai/index.cfm?#video BTW, is there a way to subscribe to this blog to get a notification of your replies?

Saw your video

Our RSS feed is here: http://threecanoes.com/blog/feed

I saw your video and realized it was a gradebook integration. It turns out that Sakai ePortfolios haven't been evaluated in the Gradebook yet. Possibly because ePortfolio workflows often live outsode the realm of any ONE class and attempt to get the student/faculty to select a meaningful collection of work and reflect on their experiences ACROSS their courses.

By the way, iRubric did get mentioned on the portfolio list today.

Assessing ePortfolios

I see what you mean. Yes, we do have a rubric assessment tool that works independently from courses and gradebooks. In most cases though, ePortfolios (or their components) are created in response to classroom activities and the evaluation is reflected in the gradebook. Thanks for the link. Nice discussion...