Skip to main content
  • Rating
    Assess - Prioritize - Measure consensus

XLeap Rating

Assess, Prioritize, Measure consensus

XLeap Rating

XLeap Rating offers all customary rating methods. It consists of a family of interrelated workspaces - rating sheets, results tables, and charts - by which groups can

  • Determine priorities
  • Assess ideas, opinions, facts (or whatever) by multiple criteria
  • Make consensus or dissent visible

Results are available immediately both as results tables and as charts. This lets you focus on what is most promising, urgent, or important instead of wasting time on lesser topics.

XLeap Rating sheet numeric scale

After Rating, you know where the group is aligned. If there is disagreement on certain items, this may be nothing to worry about - or you may want to pause and spend some time on why opinions differ.

Rating sheets

XLeap Rating sheets list any number of items for rating. Items could be products, or quotations or the ideas (facts, suggestions) of a prior brainstorming session. Paste items to the Rating sheet or create them one-by-one.

XLeap provides all customary rating methods, namely:

  • Numeric scales
  • Multiple selection
  • Rank order
  • Estimate
  • Budget allocation
XLeap Multi-criteria rating sheet

Groups can rate any list of items on multiple criteria; for instance, effectiveness, feasibility and cost. Such multi-criteria rating can occur by separate Rating sheets for each criterion or with a Multi-criteria rating sheet. 

Anomymity. Most rating should be with full anonymity, simply to get the most honest assessment.

Rating by team. Sometimes it makes sense to let participants pick a team before they submit their rating sheets, so you can analyze the results by team. Personal anonymity remains assured.

Results analysis

XLeap delivers the results of Rating instantly. Whether you and your group prefer to use tables or charts, appraisal of the results usually centers on three questions:

  1. What are the top-scoring items?
  2. What items are irrelevant for the purpose of this session?
  3. Where do we (dis)agree?

Results tables

Results tables not only give the mean rating, but also how many participants have selected any specific value.

Hosts can highlight dissent by marking up high values of (normalized) standard deviation.

If participants have picked a team before rating, results can be analyzed by team or between teams. This can provide essential information such as:

  • Is dissent caused by different departmental priorities or views?
  • Or does disagreement run across departments?
XLeap Results table for one criterion with details

Multi-criteria analysis

Multi-criteria Results tables are created when items are rated on more than one criterion; for instance, importance, urgency and feasibility. This enables utility analyses whose results can be discussed directly in the meeting, often significantly accelerating decision making.

Indicator values can be calculated in real time. For instance, in risk assessments, risk can be calculated from the ratings on impact and likelihood.

Sudden impact

The appraisal of Results can also be enhanced by coloring cells based on thresholds - suitable color schemes can provide instant visual impact and reveal decision points. Groups can draw conclusions then and there or commission further research with a sharp focus on what is relevant.

XLeap Multi-criteria results table with sensitivity analysis

Results charts

Results charts represent the results of ratings graphically: Ratings on one criterion are given as bar charts or as pie charts (budget allocations).
Ratings on multiple criteria produce Cartesian graphs. A third data line (criterion) can be visualized as 'bubble sizes' in a scatter graph.

Visualize data

Hosts can add charts at will to display all relevant data including indicator values graphically. The number of items per chart can be set. Items can also be viewed by folder or category.

When rating has occurred by team, the results charts can be analyzed by team. In this case, data points are color-coded by team for clarity.

XLeap Multi-criteria results chart

Documentation - Export

Results tables and charts are included in the Word Report, which Hosts can create with a keystroke.

Of course, there is wide scope for customization of reports:

  • include only a specified top or bottom range of items
  • give results by team (when rating has occurred with team tags)

Export of results tables to Excel (.xlsx) is also push-button - simple and quick.