Skip to main content
  • Bewertung
    Bewerten - Priorisieren - Konsens messen

XLeap Rating spaces

Assess, Prioritize, Measure consensus

XLeap Rating

XLeap Rating offers all customary rating methods. It consists of a family of interrelated workspaces, namely rating sheets, results tables, and charts by which groups can

  • determine priorities
  • assess ideas, opinions, facts (or whatever) by multiple criteria
  • make consensus or dissent visible

Results are available immediately both as results tables and as charts. This lets you focus on what is most promising, urgent, or important instead of wasting time on lesser topics.

XLeap Rating sheet numeric scale

After rating, you know where the group is aligned. If they disagree on certain items, this may be nothing to worry about. If it matters, you may want to pause and spend a minute or two on why opinions differ.

Rating sheets

XLeap rating sheets list any number of items for rating. Rate items could be products, or quotations or the ideas (facts, suggestions) of a prior brainstorming session. Paste items to the rating sheet or create them one-by-one.

XLeap provides all customary rating methods, namely:

  • Numeric scales
  • Multiple selection
  • Rank order
  • Estimate
  • Budget allocation
XLeap Multi-criteria rating sheet

Groups can rate any list of items on multiple criteria, for instance, 'effectiveness', 'feasibility' and 'cost'. Such multi-criteria rating can occur by separate Rating sheets for each criterion or with a Multi-criteria rating sheet. 

Anomymity. Most rating will be with full anonymity, simply to get the most honest assessment.

Rating by 'team'. Sometimes it makes sense to let participants pick a ‘team’ before they submit their rating sheets so you can analyse the results by 'team'. Personal anonymity remains assured.

Results analysis

XLeap delivers the results of rating instantly. Whether you and your group prefer to use tables or charts, appraisal of the results usually centers on three questions:

  1. What are the top-scoring items?
  2. What items are irrelevant for the purpose of this session?
  3. Where do we (dis)agree?

Results tables

Results tables not only give the mean rating but also how many participants have selected any specific value.

Hosts can highlight dissent by marking up high values of (normalized) Standard Deviation.

If participants have picked a 'team' before rating, results can be analyzed by team or between teams. This can provide essential information, for instance:

  • Is dissent caused by different departmental priorities or views?
  • Or does disagreement run across departments?
XLeap Results table for one criterion with details

Multi-criteria analysis

Multi-criteria results tables are created when items are rated on more than one criterion, for instance, 'Importance', 'Urgency' and 'Feasibility'. This enables e.g., utility analyses whose results can be discussed directly in the meeting, often accelerating decision making significantly.

Indicator values can be calculated in real time. For instance, in risk assessments, 'risk' can be calculated from the ratings on 'Impact' and 'Likelihood'. The appraisal of results can also be enhanced by coloring cells based on thresholds and suitable color schemes. Groups can draw conclusions then and there or, for instance, commission further research with a sharp focus on what is relevant.

XLeap Multi-criteria results table with sensitivity analysis

Results charts

Results charts represent the results of ratings graphically: Ratings on one criterion are given as bar charts or, for budget allocation, pie charts.
Ratings on multiple criteria produce cartesian graphs. A third data line (criterion) can be visualized as 'bubble size'. Hosts can add charts at will to display all relevant data, such as indicator values, graphically.
The number of items per chart can be set. Items can also be viewed by 'folder' (category).
When rating has occurred by ‘team' results charts can be analyzed by team. In this case, data points are color-coded by team.

XLeap Multi-criteria results chart

Documentation - Export

Results tables and charts are included in the Word Report, which Hosts can create by pushing a button.

Of course, there is plenty scope for customization of the Report, for instance:

  • include only a specified top or bottom range of items
  • give results by 'team' (when rating has occurred with 'team' tags)

Export of results tables to Excel (.xlsx) is also push-button.