Mocha Express
Commentaries
Thought provoking commentary on
Business, Technology, Organizations, and Organizational Dynamics
to clarify my thinking and engage in intelligent conversation.
Library: Commentary  Book: Elucidate

2.5 The End Of Innovation or How To Lie With Statistics?

July 02, 2005


References:
    Entering a Dark Age of Innovation?, Adler, Robert, NewScienctist.com
      How to Lie With Statistics, Huff, Darrell, , WW Norton&Co, 1954

.1 This is a Joke, Right?

The article in the NewScientist.com about an upcoming paper, had all the trappings of a "tongue in cheek" joke:  Someone from someplace respectable proposes something highly controversial by cooking the numbers.

When I read the article, I found it didn't pass the "laugh test".

The fundamental "errors of statistics" so totally bias the statistical results that could have been used to advertise Darrell Huff's book!

But, looking on the web, I found that "controversy" seems to win out over intelligence and common sense.  (This was just like the time in Intel when some undergrad at a 3rd rate college in New Hampshire managed to send a mail to Andy Grove requesting a computer for his "important research" and got attention from over 4 levels of management.)

For a bit of fun, you read the article:
    can you identify the 10 or 16 "problems"?, each of which means the results are totally useless?

Then, do a quick search on the web and look at what "respected reporters" say.
Below is my summary and analysis.
Have fun.

.2 Summary of NewScientist.com Article "Entering a dark age of innovation"

The article is a "review" of an upcoming article by Jonathan Huebner, a physicist working at the Pentagon's Naval Air Warfare Center in China Lake, California to be published in Technological Forecasting and Social Change.

Based on his insight that "promised advances in technology were not appearing as quickly as predicted", he wondered if "there was a reason for this".  "Perhaps there is a limit to what technology can achieve."

Huebner does some statistical analysis on inventions and, voila, concludes that innovation is declining.  His conclusions (as summarized in the review) include:

  1. Using the 7200 "key inventions" in "The History of Technology" and dividing by world population, you get a peak in innovation in 1873
  2. Currently, in the world, there are approximately 7 "important inventions/billion people" each year
  3. "Linearly extending the downward curve" moves below the 1400's Dark Ages and hits "zero important inventions" in 2055
  4. Using US patents in a decade (1990's being the most recent), dividing by US population yields a peak in 1914 (World War I) (although 1990's decade was up significantly over 1980's)

Huebner concludes that:

  1. "It is more difficult now for people to develop new technology
  2. "We are approaching the 'dark ages point', when the rate of innovation is the same as during the Dark Ages"
  3. Perhaps there is a limit to what technology can achive.
  4. Currently, in the world, there are approximately 7 "important inventions/billion people" each year
  5. "Linearly extending the downward curve" moves below the 1400's Dark Ages and hits "zero important inventions" in 2055
  6. Using US patents in a decade (1990's being the most recent), dividing by US population yields a peak in 1914 (World War I)

.3 What's Wrong With This Picture?

I've made the analysis a lot easier by picking out the "results" from the chaff it was embedded within.

My assessment is;

1) "7200 key inventions" - just what does it take to be "key"?
  1. First, any book that covers all of history and remains finite size is going to have to do some pruning.Inventions are NOT "key inventions" from day one: it takes a bit of time for the innovation to since in. 
  2. Thus anything in the past 25 year will have the advantage of "recent" and the liability of "impact not known"
  3. Author's knowledge constraints- what you don't understand, will be hard to judge (See my commentary on "Communication, Mis-communication and Speaking Gibberish"). I doubt the author of the 7200 is terribly savvy on semiconductors, nano machines, bio-tech, robotics, etc.  Ex. is the Prius (hybrid car) "one innovation" or "1000 innovations"?
  4. Small changes in small numbers - classic trick, constrain the data set to make the numbers small, then carefully round up and down to whole numbers to make your point
Bottom line: biased data - the 7200 is a totally meaningless number for "entertainment purposes only"

2) "7 Important technological developments/billion people
  1. So, only 42 "important technological developments" last year? Really?
  2. Why were you able to get "important technological developments for last year but
  3. I bet the criteria for "important" is a bit different today from 1600.
  4. Why is it meaningful divide by population?
  5. Why the "whole world" when the "whole" world isn't equally invested in innovation either now or in 1600?
  6. The rate of population growth has, as I understand it, exploded since WW II.  What is the impact of "young people" on the mean age to be productively innovative?
  7. What is the relevance of a "productivity" metric when your conclusions are "volumetric"?
    => does this nicely turn the graph downward to meet your needs?
Bottom Line: draw the curve, then divide by something that gets you there to generate controversy
3) Patents granted per decade are declining
  • Why drop the recent data: the 1990's are large up tick, why ignore 1/2 of 2000 (which is an even bigger up tick)?
  • So, not much was "invented" during World War II but the Great Depression was highly innovative?  This doesn't pass the "smell" test.
  • Why aggregating by numerical decade?  Excel can easily handle that many years.
  • Why are all patents of the same "quality" and has the ratio of "quality to quantity" changed?
  • Why does he think ROI on filing patents hasn't changed?
Bottom Line: opaque statistical analysis - drop/ignore data you don't like to get the curve of your choice

Now, it could be that the author has all this covered in his paper...
but the summaries don't read that way. 
=> They read as if he is about to go job hunting and wanted to get his name known!


Recent Commentaries
in Elucidate Book

Commentary:Elucidate - December 29, 2016
9  Ice Age Survival
Commentary:Elucidate - September 22, 2016
8  Ice Core TimeLine Munge
Commentary:Elucidate - June 23, 2016
7   Why did Agriculture Start 13,000 years ago
Commentary:Elucidate - June 15, 2016
6  BBC Propaganda, again
Commentary:Elucidate - June 10, 2016
5  BBC - Propaganda
Commentary:Elucidate - March 23, 2016
4  Finches:Urban Ones Smart??
Commentary:Elucidate - January 25, 2014
3.3  Qualifying Experts
Commentary:Elucidate - April 24, 2013
3.2   Degrees of Risk
Commentary:Elucidate - April 06, 2013
3.1  Analysis of Medical Insurance Discussion
Commentary:Elucidate - February 17, 2013
2.2  Rewarding Accomplishing Goals
Commentary:Elucidate - February 03, 2013
2.4  Computer ate my Sbx Reward
Commentary:Elucidate - November 16, 2012
2.1  Stifle Free Speech
Commentary:Elucidate - February 20, 2012
1.1  Mayberry Rules
Commentary:Elucidate - June 28, 2011
2.7  Everything Old is New Again
Commentary:Elucidate - August 02, 2009
2.3  Banana Slugs:The Law of Unintended Consequences:Protect and Lose

Elucidate
      Chapters

1   Clever, but not very Smart
  January 01, 1997
1.1   Mayberry Rules
    February 20, 2012
2   Random Elucidatons
  January 01, 1997
2.1   Stifle Free Speech
    November 16, 2012
2.2   Rewarding Accomplishing Goals
    February 17, 2013
2.3   Banana Slugs:The Law of Unintended Consequences:Protect and Lose
    August 02, 2009
2.4   Computer ate my Sbx Reward
    February 03, 2013
2.5   The End Of Innovation or How To Lie With Statistics?
    July 02, 2005
2.6   Lying With Statistics:CNN Article that Organic Food is Not "more nutritious'
    August 22, 2008
2.7   Everything Old is New Again
    June 28, 2011
2.8   Topical:just like Sub-Prime => Commodity Greed
    April 19, 2008
2.9   Tools:Spreading Knowledge That Can Hurt:
    April 14, 2008
2.10   Tools:Trying to Help While Still Selling Corn
    February 27, 2008
2.11   The Game is Rigged:Attacking with Speculative Analysis
    January 06, 2008
2.12   Getting your "Eyes On" to see ATV Damage
    November 26, 2007
2.13   US Forest Service - "Leave No Trace... or you will do Trail Maintenance with a Trowel!"
    October 13, 2007
2.14   Act Locally, Destroy Globally:Cultivate Disease Resistance
    March 04, 2007
2.15   Joisting with Self-Glorifying Windmills
    March 03, 2007
3   Analysis
  January 01, 1997
3.1   Analysis of Medical Insurance Discussion
    April 06, 2013
3.2    Degrees of Risk
    April 24, 2013
3.3   Qualifying Experts
    January 25, 2014
4   Finches:Urban Ones Smart??
  March 23, 2016
5   BBC - Propaganda
  June 10, 2016
6   BBC Propaganda, again
  June 15, 2016
7    Why did Agriculture Start 13,000 years ago
  June 23, 2016
8   Ice Core TimeLine Munge
  September 22, 2016
9   Ice Age Survival
  December 29, 2016
Carpe Diem: What you can envision, you can achieve!sm
If you like this or found something useful/educational, be sure to pay the piper.
home        contact
copyright 1998-2017