The Wisdom of Gummy Bears

A couple of weeks ago I reviewed James Surowiecki’s The Wisdom of Crowds.  To briefly recap:

Under the right circumstances, groups are remarkably intelligent, and are often smarter than the smartest people in them.  Groups do not need to be dominated by exceptionally intelligent people in order to be smart.  Even if most of the people within a group are not especially well-informed or rational, it can still reach a collectively wise decision.

The book opens with an example of an impromptu experiment conducted by the scientist Francis Galton in 1906:

Galton was at a country fair where a live ox was placed on display.  Fairgoers were invited to guess the weight of the ox after it had been slaughtered and dressed.  Eight hundred ordinary people from all walks of life tried their luck.  They included experts such as butchers and farmers, as well as non-experts.  Out of interest, when the contest was over, Galton collected the used tickets and averaged the punters’ individual guesses.  This figure represented the “wisdom of the crowd”, and in this case the crowd had guessed the ox would weigh 1197 pounds.  After it had been slaughtered and dressed the ox weighed 1198 pounds.  The crowd’s judgement was essentially perfect.

I think this is amazing.  The “experiment” was a success because the “crowd” in this example had met Surowiecki’s conditions for making a “wise” decision. That is, they:

  1. were diverse, from a range of backgrounds, including experts and non-experts
  2. understood the process and outcome.  That is, the task was simply to guess the weight of an ox.
  3. acted independently using their own judgement to come to a personal decision, free of undue external influence
  4. made a decision that was aggregatable, in this case via Galton’s calculation of the average
  5. produced a result. The competition was run and when it was over there was a definitive winner.

Several weeks ago I had an opportunity to re-create Galton’s 100+ year old experiment.  I was at a party and one of the games was to guess the number of gummy bears in a big glass jar.  Like Galton in 1906 I was curious to test the decision making ability of a group of people.  So after the competition was over I asked the host for a list of all the contestants’ individual guesses.  A total of twenty three people had participated in the game and made the following estimates.

Contestant Contestant’s Guess
A 203
B 215
C 306
D 295
E 237
F 500
G 251
H 1000
I (winner)
J 450
K 150
L 300
M 1002
N 462
O 200
P 174
Q 295
R 187
S 305
T 420
U 483
V 250
W 1200
Average 402

In fact there were 387 gummy bears in the jar.  So contestant “I” was the clear winner (it wasn’t me, by the way!) with a guess of 369 gummy bears.  Not a bad effort.  Only 18 away from the true value.  But the really striking outcome for me was that the “crowd” faired even better.  The average of everyone’s guesses was 402, just 15 off the actual number.  In other words, the crowd was smarter than the smartest individual member.

An extraordinary result.

It also leads to an optimum strategy, if you ever find yourself participating in one of these “guess how much/how many” kind of games.  Wait until the last minute and take an average everybody else’s guesses.  In all likelihood that will be closer than any other individual estimate.

I didn’t follow my own brilliant strategy, by the way, which is why I’m not eating gummy bears at the moment.


One Response

  1. […] human-powered aggregates.  In groups, humans are surprisingly accurate at estimating quantities (jelly beans in a jar, anyone?).  We’re building an operator that takes advantage of this ability to count with a […]

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s

%d bloggers like this: