How to evaluate - tutorial for external evaluators

How to evaluate - tutorial for external evaluators

MakeItRational is collaborative multi-criteria decision making software and allows its users to perform group evaluation online (via links) as well as offline (via files). This tutorial contains step by step instructions for evaluators in multiple evaluation scenarios.

Online evaluation

This kind of evaluation allows project owners to generate and distribute special links to online application that allow incorporate others to provide their individual judgments.

If you get that link and want to provide your judgments please follow this steps:

  1. Ensure that you have installed Silverlight 4.0 (it's small plug-in from Microsoft similar to Flash player)
  2. Open the link in your browser
  3. Enter your judgments
  4. Click "Save" button

Offline evaluation

Offline evaluation relies on exchanging special files between project owner and evaluators. Project owners have to generate empty evaluation files from MakeItRational application and distribute them to evaluators who enter their judgments using special Silverlight application available on MakeItRational.com (online as well as downloadable version).

If you want to provide your judgments please follow this steps:

  1. Ensure that you have installed Silverlight 4.0 (it's small plug-in from Microsoft similar to Flash player)
  2. Open this link https://makeitrational.com/evaluation in your browser to start Evaluation application

a) Online mode

  1. Enter your judgments
  2. Click "Open preferences from file" and choose file that you get
  3. Enter your judgments
  4. Click "Save" button and overwrite your file
  5. Pass back this file to the project owner

b) Desktop mode

  1. Click mouse right button in application and choose option "Install MakeItRational preferences onto this computer..." to install desktop version of this application
  2. Desktop application will be installed onto your computer and automatically launched
  3. Click "Open preferences from file" and choose file that you get
  4. Enter your judgments
  5. Click "Save" button and overwrite your file
  6. Pass back this file to the project owner