Insights and Must-Knows
from the Big Data Blog

Big Data Blog

Speed Up Your Data to Slow Down Your Decisions

Mar 4

Written by:
3/4/2013 7:01 AM  RssIcon

Serve Big Data

Mark Twain said, “Never put off till tomorrow what you can do the day after tomorrow.”  Although that quote is typically taken as an oath for procrastination, generally speaking we can’t spend too much time planning before acting.  However, as Leonard Bernstein said, “To achieve great things, two things are needed: a plan, and not quite enough time."

In his excellent book Wait: The Art and Science of Delay, Frank Partnoy examined the data-driven decision making involved in many circumstances, including fast-paced sports such as tennis, where there definitely seems to be not quite enough time to plan before acting since the average window for returning a professional tennis serve is 500 milliseconds, which Partnoy broke down into three phases: See, Prepare, Hit.

The first phase is all about the visual reaction time of when a player first sees the ball leave their opponent’s racket.  Partnoy cited research that found human visual reaction time is surprisingly consistent across all people and all activities — 200 milliseconds, which is roughly half the time it takes for you to blink your eyes.  Professional tennis players need just as much time as everyone else for the See phase, leaving only 300 milliseconds for the Prepare and Hit phases.

As Partnoy explained, the Hit phase “is a serious problem for most of us.  The physical reaction time available to hit a professional tennis serve is barely long enough for us to adjust our racket by a few inches.  Amateurs cannot move to the correct spot and produce a swing with accuracy or power in 300 milliseconds.”

Return Predictive Analytics

By contrast, professionals are so skilled and practiced they can produce near-instantaneous muscle contractions to move their bodies and execute a swing in approximately 100 milliseconds.  Because professional tennis players are so fast, they have more time to gather and process information, albeit not much more time — 200 milliseconds.  But what happens during the Prepare phase can make all the difference.  To paraphrase Twain, “Never return in 100 milliseconds a serve that you can return in 200 milliseconds.”  Or, as Partnoy phrased it, professional tennis players “procrastinate at the speed of light,” enabling them to return serves as slowly as they possibly can.  “They go fast first in order to go slow later.”

Result Great Data-Driven Decisions

As Paige Roberts recently blogged, the real advantage of Hadoop-related technology “aside from the fact that it can handle massive volumes of data without choking and dying, or killing your operating budget, is speed.  We are not a patient society.  The cutthroat world of business has become all about who can get the right answer faster.”  Roberts also cited the recent Harvard Business Review article by Paul Barth and Randy Bean, which explained that “the real quantum leap for companies comes from the ability to accelerate the speed at which they can get to a decision.”

In other words, the faster you can get to the point where you have gathered and processed all of the data needed to support a decision, the more time you will have to leverage that data to make a better decision.  Although it sounds counterintuitive, big data analytics helps you speed up your data to slow down your decisions, thus enabling you to make better decisions faster.

 

 

Originally published in Pervasive Big Data & Analytics Blog

2 comment(s) so far...


Gravatar

Re: Speed Up Your Data to Slow Down Your Decisions

Nice post, Jim. I love Frank's book and agree with you that a major challenge of Big Data is patience. People want results very quickly, but Hadoop, NoSQL, and other Big Data tools may take a while to develop and deploy.

By Phil Simon on   3/4/2013 8:23 AM
Gravatar

Re: Speed Up Your Data to Slow Down Your Decisions

Thanks for your comment, Phil.

Yes, it may take a while to develop and deploy big data analytical solutions. Even more important to note is that once big data analytics is in place, initially the decision-making process will not be appear to produce results any quicker than before, but will instead be doing a better job of integrating more data into the decision-making process.

As better data-driven results drive increased adoption of big data analytics, decision-makers will become as skilled and practiced as professional tennis players, allowing them to make near-instantaneous use of available data, and enabling them to make better decisions faster.

Best Regards,

Jim

By Jim Harris on   3/4/2013 9:18 AM

Your name:
Gravatar Preview
Your email:
(Optional) Email used only to show Gravatar.
Your website:
Title:
Comment:
Security Code
CAPTCHA image
Enter the code shown above in the box below
Add Comment   Cancel 

Search Big Data Blogs

Tags

Big Data (114)
Analytics (59)
Pervasive (50)
DataRush (32)
Hadoop (29)
predictive analytics (20)
Scalability (20)
Industry trends (18)
Multicore (15)
Data Mining (12)
Parallelism (10)
Java (9)
Cloud (8)
Cyber Security (8)
KNIME (8)
MapReduce (8)
RushAnalytics (7)
Volumes (7)
Algorithms (6)
Cost-effective (6)
Data Volumes (6)
Data Warehouse (6)
RushAnalyzer (6)
David Loshin (5)
Decision Support (5)
machine learning (5)
Dataflow (4)
Forrester (4)
Google (4)
Green IT (4)
Healthcare (4)
Actian (3)
analytics processes (3)
BigQuery (3)
data centers (3)
data integration (3)
Data Preparation (3)
data-driven (3)
DataMatcher (3)
Jim Harris (3)
Malstone B (3)
Opera Solutions (3)
Retail Analytics (3)
Security (3)
Solutions (3)
telecommunications (3)
transportation analytics (3)
YARN (3)
analytics tools (2)
Austin (2)
big data analytics (2)
Big Data Science (2)
Bloor (2)
Bloor Research (2)
Data Rush (2)
David Inbar (2)
David Norris (2)
fraud (2)
fraud detection (2)
Gartner (2)
GigaOM (2)
Hadoop Summit (2)
IntegrationWorld (2)
Julie Hunt (2)
machine generated data (2)
meetup (2)
Mike Hoskins (2)
ParAccel (2)
Pervasive DataRush (2)
Rexer Analytics (2)
software (2)
#FollowFriday (1)
Amazon (1)
analytics accuracy (1)
analytics workflow (1)
Application Development (1)
automation (1)
Benchmarks (1)
Business Intelligence (1)
Cloud Analytics Summit (1)
cloud computing (1)
Cloudera (1)
contests (1)
cost (1)
cyber security issues (1)
Data Integrator - Hadoop Edition (1)
data quality (1)
Data Science (1)
data tools (1)
Door64 (1)
easy big data analytics (1)
Ericson (1)
Esri (1)
Facebook (1)
Fuzzy Matching (1)
Goverment (1)
Hadoop User Group (1)
Hadoop World (1)
intelligent transportation systems (1)
Jazoon (1)
Jim Falgout (1)
MalStoneB (1)
Mansour Raad (1)
McKinsey (1)
Neil Raden (1)
Netflix (1)
NetFlow (1)
para (1)
PIG (1)
Predictive Analytics World (1)
psychohistory (1)
Public Sector (1)
Redshift (1)
Rosaria Silipo (1)
RushAccelerator (1)
Sampling (1)
Signal and Noise (1)
Smart Grid (1)
SmartDataCollective (1)
spatial analytics (1)
speed (1)
sports (1)
Stephen Swoyer (1)
Steve Shine (1)
Strata (1)
SXSW (1)
Telecom Analytics (1)
Telecommunications Industry Association (1)
TIA (1)
Transportation (1)
TurboRush (1)
VectorWise (1)
Zementis (1)

Big Data Blog Archives

Archive
<May 2013>
SunMonTueWedThuFriSat
2829301234
567891011
12131415161718
19202122232425
2627282930311
2345678
Monthly
Go