Idea Screening in Engineering Design Using Employee-Driven Wisdom of the Crowds

Balder Onarheim, Bo Thomas Christensen

Research output: Working paperResearch

Abstract

The paper investigates the question of screening ideas in the ‘fuzzy front end’ of engineering design, examining the validity of employee voting schemes and related biases. After an employee-driven innovation project at {Company Name removed for review}, 99 ideas were to be screened for further development. Based on the concept of ‘wisdom of the crowds’, all ideas were individually rated by a broad selection of employees, and their choices of ideas and idea categories compared to those of a small team of senior marketers. The study also tested for two biases: visual complexity and endowment effect/ownership of ideas. The study shows that the crowd wisdom of employees significantly correlates with the preferences of the marketing team: overall, in top 12 selected ideas and in choice of idea categories. This match increases when including only the ratings of the most experienced employees. The experienced employees also proved to be less affected by visual complexity in the ideas presented. The endowment effect was potent in that every employee proved to be more likely to select their own ideas over others, but this effect disappeared when aggregating across the crowd of employees.
The paper investigates the question of screening ideas in the ‘fuzzy front end’ of engineering design, examining the validity of employee voting schemes and related biases. After an employee-driven innovation project at {Company Name removed for review}, 99 ideas were to be screened for further development. Based on the concept of ‘wisdom of the crowds’, all ideas were individually rated by a broad selection of employees, and their choices of ideas and idea categories compared to those of a small team of senior marketers. The study also tested for two biases: visual complexity and endowment effect/ownership of ideas. The study shows that the crowd wisdom of employees significantly correlates with the preferences of the marketing team: overall, in top 12 selected ideas and in choice of idea categories. This match increases when including only the ratings of the most experienced employees. The experienced employees also proved to be less affected by visual complexity in the ideas presented. The endowment effect was potent in that every employee proved to be more likely to select their own ideas over others, but this effect disappeared when aggregating across the crowd of employees.
LanguageEnglish
Place of PublicationFrederiksberg
PublisherCopenhagen Business School [wp]
Number of pages21
StatePublished - 2011

Keywords

  • Evaluation of Creative Ideas
  • Creativity
  • Idea Evaluation
  • Idea Screening
  • Engineering Design
  • Fuzzy Front End
  • Innovation
  • Evaluator Experience
  • New Product Development
  • Wisdom of the Crowds
  • Employee-driven Innovation
  • Idea Filtering

Cite this

Onarheim, B., & Christensen, B. T. (2011). Idea Screening in Engineering Design Using Employee-Driven Wisdom of the Crowds. Frederiksberg: Copenhagen Business School [wp].
Onarheim, Balder ; Christensen, Bo Thomas. / Idea Screening in Engineering Design Using Employee-Driven Wisdom of the Crowds. Frederiksberg : Copenhagen Business School [wp], 2011.
@techreport{646245606c0949598060fcff4402c835,
title = "Idea Screening in Engineering Design Using Employee-Driven Wisdom of the Crowds",
abstract = "The paper investigates the question of screening ideas in the ‘fuzzy front end’ of engineering design, examining the validity of employee voting schemes and related biases. After an employee-driven innovation project at {Company Name removed for review}, 99 ideas were to be screened for further development. Based on the concept of ‘wisdom of the crowds’, all ideas were individually rated by a broad selection of employees, and their choices of ideas and idea categories compared to those of a small team of senior marketers. The study also tested for two biases: visual complexity and endowment effect/ownership of ideas. The study shows that the crowd wisdom of employees significantly correlates with the preferences of the marketing team: overall, in top 12 selected ideas and in choice of idea categories. This match increases when including only the ratings of the most experienced employees. The experienced employees also proved to be less affected by visual complexity in the ideas presented. The endowment effect was potent in that every employee proved to be more likely to select their own ideas over others, but this effect disappeared when aggregating across the crowd of employees.",
keywords = "Evaluation of Creative Ideas, Creativity, Idea Evaluation, Idea Screening, Engineering Design, Fuzzy Front End, Innovation, Evaluator Experience, New Product Development, Wisdom of the Crowds, Employee-driven Innovation, Idea Filtering, Evaluation of Creative Ideas, Creativity, Idea Evaluation, Idea Screening, Engineering Design, Fuzzy Front End, Innovation, Evaluator Experience, New Product Development, Wisdom of the Crowds, Employee-driven Innovation, Idea Filtering",
author = "Balder Onarheim and Christensen, {Bo Thomas}",
year = "2011",
language = "English",
publisher = "Copenhagen Business School [wp]",
address = "Denmark",
type = "WorkingPaper",
institution = "Copenhagen Business School [wp]",

}

Onarheim, B & Christensen, BT 2011 'Idea Screening in Engineering Design Using Employee-Driven Wisdom of the Crowds' Copenhagen Business School [wp], Frederiksberg.

Idea Screening in Engineering Design Using Employee-Driven Wisdom of the Crowds. / Onarheim, Balder; Christensen, Bo Thomas.

Frederiksberg : Copenhagen Business School [wp], 2011.

Research output: Working paperResearch

TY - UNPB

T1 - Idea Screening in Engineering Design Using Employee-Driven Wisdom of the Crowds

AU - Onarheim,Balder

AU - Christensen,Bo Thomas

PY - 2011

Y1 - 2011

N2 - The paper investigates the question of screening ideas in the ‘fuzzy front end’ of engineering design, examining the validity of employee voting schemes and related biases. After an employee-driven innovation project at {Company Name removed for review}, 99 ideas were to be screened for further development. Based on the concept of ‘wisdom of the crowds’, all ideas were individually rated by a broad selection of employees, and their choices of ideas and idea categories compared to those of a small team of senior marketers. The study also tested for two biases: visual complexity and endowment effect/ownership of ideas. The study shows that the crowd wisdom of employees significantly correlates with the preferences of the marketing team: overall, in top 12 selected ideas and in choice of idea categories. This match increases when including only the ratings of the most experienced employees. The experienced employees also proved to be less affected by visual complexity in the ideas presented. The endowment effect was potent in that every employee proved to be more likely to select their own ideas over others, but this effect disappeared when aggregating across the crowd of employees.

AB - The paper investigates the question of screening ideas in the ‘fuzzy front end’ of engineering design, examining the validity of employee voting schemes and related biases. After an employee-driven innovation project at {Company Name removed for review}, 99 ideas were to be screened for further development. Based on the concept of ‘wisdom of the crowds’, all ideas were individually rated by a broad selection of employees, and their choices of ideas and idea categories compared to those of a small team of senior marketers. The study also tested for two biases: visual complexity and endowment effect/ownership of ideas. The study shows that the crowd wisdom of employees significantly correlates with the preferences of the marketing team: overall, in top 12 selected ideas and in choice of idea categories. This match increases when including only the ratings of the most experienced employees. The experienced employees also proved to be less affected by visual complexity in the ideas presented. The endowment effect was potent in that every employee proved to be more likely to select their own ideas over others, but this effect disappeared when aggregating across the crowd of employees.

KW - Evaluation of Creative Ideas

KW - Creativity

KW - Idea Evaluation

KW - Idea Screening

KW - Engineering Design

KW - Fuzzy Front End

KW - Innovation

KW - Evaluator Experience

KW - New Product Development

KW - Wisdom of the Crowds

KW - Employee-driven Innovation

KW - Idea Filtering

KW - Evaluation of Creative Ideas

KW - Creativity

KW - Idea Evaluation

KW - Idea Screening

KW - Engineering Design

KW - Fuzzy Front End

KW - Innovation

KW - Evaluator Experience

KW - New Product Development

KW - Wisdom of the Crowds

KW - Employee-driven Innovation

KW - Idea Filtering

M3 - Working paper

BT - Idea Screening in Engineering Design Using Employee-Driven Wisdom of the Crowds

PB - Copenhagen Business School [wp]

CY - Frederiksberg

ER -

Onarheim B, Christensen BT. Idea Screening in Engineering Design Using Employee-Driven Wisdom of the Crowds. Frederiksberg: Copenhagen Business School [wp]. 2011.