Help CenterReviewing and moving ideas

Rating ideas and answering step questions

Each step in a collection, and the Inbox, can have its own questions, such as a score for impact and effort or a yes/no decision. The people working on the idea answer them on the idea, in the section for that step. Each person gives their own answer. Collection managers can compare ideas side by side in the Voting and Scoring views.

Who can do this: collection managers and Admins, for any step. Panel members, for the step the idea is in now (or the Inbox, for the Inbox panel).

Step questions are different from the submission form. The form is what people fill in when they submit an idea. Step questions are for the people working on the idea afterwards. To set up step questions, see Question types and settings.

Answer or score an idea

  1. Open the idea.
  2. If you manage the collection, click the Manage tab and find the section for the step. There is one for the Inbox and one for each step. The step the idea is in now says Now and is open; click another step to open it. If you are on the panel, use Waiting for you on the idea.
  3. Fill in or score any question you haven’t answered yet, then click Save answer.
  4. To change an answer later, click Edit answer, or Edit your score for a scoring question.

Each section shows the date the idea arrived there and how many of its questions have been answered, for example “12 Oct · 1 of 4 done”.

A line under the question tells you who will see your answer, for example “Only the Collection’s managers and the panel see your answer.”

Your own answers show as You.

If you try to leave the idea with an answer you haven’t saved, Hives asks “Leave without saving your answer?” Click Keep editing to go back to it, or Leave to go without saving.

The scoring controls

A scoring question has a slider for each criterion you score, such as impact or effort.

  • Clear removes your score, so the question is left unanswered. It only appears when the question isn’t required.
  • Comment (optional) lets you explain your score. Under the box it says “Your rationale is shown to the collection managers and the other scorers.”

Once someone has scored the idea, the question shows a summary:

  • The total score, for example “18 of 25 in total”. This is the sum of the average score for each criterion, out of the sum of their highest scores.
  • “Scored by N people”.
  • The average for each criterion, with a bar.
  • Scorer comments, the comments people added to their scores, each with who wrote it and the score they gave.

Collection managers, Admins and the step’s panel also see Who gave each score. It lists everyone who has scored, with their total, for example “18 of 25”. Then it lists the panel members who haven’t scored yet, each marked Not rated yet. Other people never see this list.

Everyone gives their own answer

Step questions are answered per person. If three people score the same idea, the idea has three scores. The idea then shows the average for each criterion, and a total score that adds those averages up.

When you can answer

As a collection manager or Admin, you can answer or correct the questions of any step at any time. That includes steps the idea has already left. Earlier answers stay on the idea when it moves on.

As a panel member, you answer and score the questions of your step in Waiting for you while the idea is in that step. It says “You’re on the panel for [step]. Answer and score its questions, and see who gave each score.” Inbox panel members answer the Inbox questions while the idea is in the Inbox. Once the idea moves on, your answers stay, but you can no longer change them. See Reviewers and panels.

Step questions whose Visible to level is Managers include the current step’s panel for that step’s questions.

Good to know: Required step questions don’t stop anyone from moving an idea to the next step. If you want every idea scored before it moves on, agree on that within your team.

Work through ideas one at a time

When step questions are waiting for you, they show up in My work. Panel members get the questions of their step. On a step with no panel, they wait for the collection’s named managers.

As a collection manager, when two or more ideas in a step are waiting for you, the step in the collection’s Manage view shows a card such as “5 ideas wait for you in Review”, with a button such as Queue up 5 ideas. The queue shows one idea at a time and saves as you go. Panel members start the queue from My work. See My work: everything that is waiting for you.

Compare ideas with Voting and Scoring

Who can do this: collection managers and Admins.

  1. Open the collection’s Manage view.
  2. Click the Inbox or a step in the sidebar.
  3. On the Ideas tab, pick a view next to Gallery and List:
    • Voting shows the results of options questions (where people pick one or more options) for each idea in that step
    • Scoring shows the scores for each idea in that step

Voting only shows when the step has an Options question, and Scoring only when it has a Scoring question. If the step has several, pick the question at the top of the view.

Scoring lists every idea with a small bar for each criterion, its Total score and its Scorers. The line at the top says how many ideas have been scored and what the total score is out of. An idea’s total score is the sum of the average score for each criterion, out of the sum of their highest scores. For example, an average of 2 out of 5 and 7 out of 10 makes 9 out of 15.

Ideas are sorted with the highest total first. Use Sort to sort by one criterion, by the number of scorers or by title. Click the number of scorers to see who gave which score and why.

Panel members don’t get the Voting and Scoring views. They see everyone’s answers and scores for their step on each idea, in Waiting for you, including who gave them.

Who sees the scores

Collection managers and Admins see every answer and score, and who gave it. Panel members see the answers and scores for their step while the idea is there, and who gave them. Members who aren’t on the panel don’t see step answers on the idea.

Answers to the submission form work differently. Who can read those depends on each question’s Visible to setting. See Who can see and answer a question.

Things to know

  • Deleting a question keeps its answers. If a collection manager deletes a step question, its answers stay on each idea, in a section headed Deleted questions.
  • Deleting a step keeps its answers too. The ideas in it go back to the Inbox, and the step’s answers and scores stay on each idea, in a section headed Answered in [step]. See Changing the steps of one collection.
  • Changing the workflow keeps step answers. Applying a different workflow replaces the steps, but the answers given to their questions stay on the ideas.
  • Step answers are not in the spreadsheet export. The spreadsheet export only includes the submission form. See Exporting a collection to a spreadsheet. To share one idea with its step answers, use ⋯ > Export as PDF. See Managing an idea: the Manage tab.