Insights and Must-Knows
from the Big Data Blog

Big Data Blog

Big Data, Sporks, and Decision Frames

Jan 14

Written by:
1/14/2013 5:50 AM  RssIcon

There are times when big data seems to resemble that big mountain of mashed potatoes formed by “Weird Al” Yankovic in the movie UHF, about which he mutters (mimicking Richard Dreyfuss in the movie Close Encounters of the Third Kind): “This means something.  This is important.”

Big data analytics sometimes seems like we are digging through all those mashed potatoes with sporks, hoping to simultaneously scoop away all the noise and stab any signals we can find.  (By the way, I also think a spork — part spoon, part fork — is a good metaphor for the part SQL, part NoSQL tool needed for big data analytics, which Neil Raden recently called Forked SQL).

Although it’s occasionally a good idea to engage in a sporking free-for-all with reckless abandon, more often it’s a better idea to start with some sense of what we’re looking to find.  This might allow us to filter out potential noise or irrelevant signal ahead of time.  At the very least, this will frame our analysis so that when we look at the results we will have a sound basis for saying: “This means something.  This is important.”

“At the start of any decision-making process, whether it is perceived as analytical or intuitive,” Jeffrey Ma explained in his book The House Advantage: Playing the Odds to Win Big In Business, “is a question or set of questions asked by someone seeking truth.  This is called the decision frame, and it is the first step in the decision-making process.  Getting clarity on the core issue being addressed is the key to making good decisions.”

According to Ma, a decision frame has three interwoven components:

  1. Purpose — What you hope to accomplish.
  2. Scope — What to include or exclude in arriving at the decision.
  3. Perspective — Your point of view in approaching this decision.

“Having the right decision frame,” Ma explained, “is not unlike taking a picture with a zoom camera: What we want to take the picture of is the purpose, what is included in the shot is the scope, and what angle we take the picture from is the perspective.”

Having the right decision frame is essential to whether big data analytics provides meaningful business insight.  What business problem you are trying to solve is the purpose, what data is included in your analysis is the scope, and what drives your organization’s decision making is the perspective.

In other words, the best way to approach big data is to make sure you frame before you spork.

2 comment(s) so far...


Gravatar

Spork away...

You and Neil are right, Jim. I honestly doubt that a one-size-fits-all approach works with Big Data.

By Phil Simon on   1/21/2013 1:56 PM
Gravatar

Re: Spork away...

Thanks for your comment, Phil.

Yes, a one-size-fits-all approach to selecting your tools definitely won’t work with Big Data, but even more important is that Big Data initiatives can’t be a one-solution-fits-all-problems approach — define the business problem first, then figure out how much of what kinds of data and tools can best help you build a solution.

Best Regards,

Jim

By Jim Harris on   1/23/2013 5:37 PM

Your name:
Gravatar Preview
Your email:
(Optional) Email used only to show Gravatar.
Your website:
Title:
Comment:
Security Code
CAPTCHA image
Enter the code shown above in the box below
Add Comment   Cancel 

Search Big Data Blogs

Tags

Big Data (113)
Analytics (59)
Pervasive (50)
DataRush (32)
Hadoop (29)
predictive analytics (20)
Scalability (20)
Industry trends (18)
Multicore (15)
Data Mining (12)
Parallelism (10)
Java (9)
Cloud (8)
Cyber Security (8)
MapReduce (8)
KNIME (7)
Volumes (7)
Algorithms (6)
Cost-effective (6)
Data Volumes (6)
Data Warehouse (6)
RushAnalytics (6)
RushAnalyzer (6)
David Loshin (5)
Decision Support (5)
machine learning (5)
Dataflow (4)
Forrester (4)
Google (4)
Green IT (4)
Healthcare (4)
Actian (3)
analytics processes (3)
BigQuery (3)
data centers (3)
data integration (3)
Data Preparation (3)
data-driven (3)
DataMatcher (3)
Jim Harris (3)
Malstone B (3)
Opera Solutions (3)
Retail Analytics (3)
Security (3)
Solutions (3)
telecommunications (3)
transportation analytics (3)
YARN (3)
analytics tools (2)
Austin (2)
big data analytics (2)
Big Data Science (2)
Bloor (2)
Bloor Research (2)
Data Rush (2)
David Inbar (2)
David Norris (2)
fraud (2)
fraud detection (2)
Gartner (2)
GigaOM (2)
Hadoop Summit (2)
IntegrationWorld (2)
Julie Hunt (2)
machine generated data (2)
meetup (2)
Mike Hoskins (2)
ParAccel (2)
Pervasive DataRush (2)
Rexer Analytics (2)
software (2)
#FollowFriday (1)
Amazon (1)
analytics accuracy (1)
analytics workflow (1)
Application Development (1)
automation (1)
Benchmarks (1)
Business Intelligence (1)
Cloud Analytics Summit (1)
cloud computing (1)
Cloudera (1)
contests (1)
cost (1)
cyber security issues (1)
Data Integrator - Hadoop Edition (1)
data quality (1)
Data Science (1)
data tools (1)
Door64 (1)
easy big data analytics (1)
Ericson (1)
Esri (1)
Facebook (1)
Fuzzy Matching (1)
Goverment (1)
Hadoop User Group (1)
Hadoop World (1)
intelligent transportation systems (1)
Jazoon (1)
Jim Falgout (1)
MalStoneB (1)
Mansour Raad (1)
McKinsey (1)
Neil Raden (1)
Netflix (1)
NetFlow (1)
para (1)
PIG (1)
Predictive Analytics World (1)
psychohistory (1)
Public Sector (1)
Redshift (1)
RushAccelerator (1)
Sampling (1)
Signal and Noise (1)
Smart Grid (1)
SmartDataCollective (1)
spatial analytics (1)
speed (1)
sports (1)
Stephen Swoyer (1)
Steve Shine (1)
Strata (1)
SXSW (1)
Telecom Analytics (1)
Telecommunications Industry Association (1)
TIA (1)
Transportation (1)
TurboRush (1)
VectorWise (1)
Zementis (1)

Big Data Blog Archives

Archive
<May 2013>
SunMonTueWedThuFriSat
2829301234
567891011
12131415161718
19202122232425
2627282930311
2345678
Monthly
Go