Big Data Blog

Big Data Blog

Big Data, Sporks, and Decision Frames

Jan 14

Written by:
1/14/2013 5:50 AM  RssIcon

There are times when big data seems to resemble that big mountain of mashed potatoes formed by “Weird Al” Yankovic in the movie UHF, about which he mutters (mimicking Richard Dreyfuss in the movie Close Encounters of the Third Kind): “This means something.  This is important.”

Big data analytics sometimes seems like we are digging through all those mashed potatoes with sporks, hoping to simultaneously scoop away all the noise and stab any signals we can find.  (By the way, I also think a spork — part spoon, part fork — is a good metaphor for the part SQL, part NoSQL tool needed for big data analytics, which Neil Raden recently called Forked SQL).

Although it’s occasionally a good idea to engage in a sporking free-for-all with reckless abandon, more often it’s a better idea to start with some sense of what we’re looking to find.  This might allow us to filter out potential noise or irrelevant signal ahead of time.  At the very least, this will frame our analysis so that when we look at the results we will have a sound basis for saying: “This means something.  This is important.”

“At the start of any decision-making process, whether it is perceived as analytical or intuitive,” Jeffrey Ma explained in his book The House Advantage: Playing the Odds to Win Big In Business, “is a question or set of questions asked by someone seeking truth.  This is called the decision frame, and it is the first step in the decision-making process.  Getting clarity on the core issue being addressed is the key to making good decisions.”

According to Ma, a decision frame has three interwoven components:

  1. Purpose — What you hope to accomplish.
  2. Scope — What to include or exclude in arriving at the decision.
  3. Perspective — Your point of view in approaching this decision.

“Having the right decision frame,” Ma explained, “is not unlike taking a picture with a zoom camera: What we want to take the picture of is the purpose, what is included in the shot is the scope, and what angle we take the picture from is the perspective.”

Having the right decision frame is essential to whether big data analytics provides meaningful business insight.  What business problem you are trying to solve is the purpose, what data is included in your analysis is the scope, and what drives your organization’s decision making is the perspective.

In other words, the best way to approach big data is to make sure you frame before you spork.

Search Big Data Blogs

Tags

Big Data (126)
Analytics (66)
Pervasive (50)
DataRush (33)
Hadoop (31)
Industry trends (22)
predictive analytics (20)
Scalability (20)
Multicore (15)
Data Mining (12)
Parallelism (10)
Java (9)
Jim Harris (9)
KNIME (9)
Cloud (8)
Cyber Security (8)
MapReduce (8)
big data analytics (7)
Data Volumes (7)
Data Warehouse (7)
RushAnalytics (7)
Volumes (7)
Actian (6)
Algorithms (6)
Cost-effective (6)
David Loshin (6)
Decision Support (6)
Julie Hunt (6)
RushAnalyzer (6)
analytics tools (5)
Dataflow (5)
machine learning (5)
Data Science (4)
Forrester (4)
Google (4)
Green IT (4)
Healthcare (4)
Phil Simon (4)
YARN (4)
analytics processes (3)
Big Data Science (3)
BigQuery (3)
Bloor (3)
data centers (3)
data integration (3)
Data Preparation (3)
data tools (3)
data-driven (3)
DataMatcher (3)
machine generated data (3)
Malstone B (3)
Mike Hoskins (3)
Opera Solutions (3)
Retail Analytics (3)
Security (3)
Smart Grid (3)
software (3)
Solutions (3)
telecommunications (3)
transportation analytics (3)
Age of Data (2)
analytics accuracy (2)
architecture (2)
Austin (2)
Bloor Research (2)
Business Intelligence (2)
data management (2)
Data Rush (2)
David Inbar (2)
David Norris (2)
fraud (2)
fraud detection (2)
Gartner (2)
GigaOM (2)
Hadoop Summit (2)
IntegrationWorld (2)
intelligent transportation systems (2)
internet of things (2)
McKinsey (2)
meetup (2)
ParAccel (2)
Pervasive DataRush (2)
Rexer Analytics (2)
smart meters (2)
#FollowFriday (1)
a (1)
Amazon (1)
analytics workflow (1)
Application Development (1)
automation (1)
Benchmarks (1)
best practices (1)
Cloud Analytics Summit (1)
cloud computing (1)
Cloudera (1)
contests (1)
cost (1)
cyber security issues (1)
data flow architecture (1)
Data Integrator - Hadoop Edition (1)
data quality (1)
data visualization (1)
digital marketing (1)
Door64 (1)
easy big data analytics (1)
Ericson (1)
Esri (1)
Facebook (1)
Fuzzy Matching (1)
Goverment (1)
Hadoop User Group (1)
Hadoop World (1)
hardware (1)
HBase (1)
HDFS (1)
industrial internet (1)
Jazoon (1)
Jim Falgout (1)
MalStoneB (1)
Mansour Raad (1)
Neil Raden (1)
Netflix (1)
NetFlow (1)
operational intelligence (1)
Paige Roberts (1)
para (1)
PIG (1)
pilot projects (1)
Predictive Analytics World (1)
psychohistory (1)
Public Sector (1)
Redshift (1)
Robin Bloor (1)
ROI (1)
Rosaria Silipo (1)
RushAccelerator (1)
RushLoader (1)
Sampling (1)
Signal and Noise (1)
SmartDataCollective (1)
spatial analytics (1)
speed (1)
sports (1)
Stephen Swoyer (1)
Steve Shine (1)
Strata (1)
SXSW (1)
Telecom Analytics (1)
Telecommunications Industry Association (1)
TIA (1)
Transportation (1)
TurboRush (1)
VectorWise (1)
Zementis (1)

Latest Posts

Actian Big Data & Analytics Blog has MOVED!
Big Data Phrenology
Big Data, Simpson's Paradox and Sufficient Tools
Data Science and the Art of Data Visualization

Big Data Blog Archives

Archive
<April 2014>
SunMonTueWedThuFriSat
303112345
6789101112
13141516171819
20212223242526
27282930123
45678910
Monthly
Go

Accelerating Big Data 2.0™