How to evaluate. Tutorial for external evaluators

MakeItRational is a collaborative decision making software and allows to perform group evaluation online (via links) as well as offline (via files). This tutorial contains step by step instructions for external evaluators in multiple evaluation scenarios.

Online evaluation

Project owner generates and sends special links that allow external evaluators to provide their judgments.

If you get this link and want to provide your judgments please follow these steps:

  1. Ensure that you have installed Silverlight 4.0 (it's small plug-in from Microsoft similar to Flash player)
  2. Open the link in your browser
  3. Enter your judgments
  4. Click "Save" button

Offline evaluation

Offline evaluation is based on exchanging files between project owner and evaluators. Project owner generates an empty evaluation file and sends it to evaluators who provide their judgments using a special application (online as well as downloadable version).

If you would like to provide your judgments please follow these steps:

  1. Ensure that you have installed Silverlight 4.0 (it's small plug-in from Microsoft similar to Flash player)
  2. Open this link https://makeitrational.com/evaluation in your browser to start application

a) Online mode

  1. Enter your judgments
  2. Click "Open preferences from file" and choose file that you get
  3. Enter your judgments
  4. Click "Save" button and overwrite your file
  5. Send this file to the project owner

b) Desktop mode

  1. Click mouse right button in application and choose option "Install MakeItRational preferences onto this computer..." to install desktop version of this application
  2. Desktop application will be installed onto your computer and automatically launched
  3. Click "Open preferences from file" and choose file that you get
  4. Enter your judgments
  5. Click "Save" button and overwrite your file
  6. Send this file to the project owner