I HEART BIG DATA

PRESENTATION OUTLINE

WE WILL EXPLORE THE WORLD OF BIG DATA IN THESE ARENAS

THE CONTRIBUTORS

INDUSTRY EXPERTS WEIGH IN

ABOUT ME

I'M A SENIOR B.I. CONSULTANT AT PRAGMATIC WORKS WITH A KEEN INTEREST IN BIG DATA AND DATA SCIENCE

Webinar_BigDataAndYourCareer_10.jpg

THE Vs OF BIG DATA

THERE ARE 3 Vs MOST COMMONLY ASSOCIATED WITH BIG DATA - DENNY LEE ADDS A FOURTH - ''VARIABILITY'

IT'S NOT SIMPLY UNSTRUCTURED DATA

BIG DATA IS AN ECOSYSTEM OF TOOLS TO MOVE BEYOND THE RELATIONAL WORLD TO SOLVE PROBLEMS THAT ALIGN MORE CLOSELY TO THE QUESTION THAT IS ASKED

VALUE OPPORTUNITIES

BUSINESSES OF ANY SIZE FACE THE SAME CHALLENGES AND NEED THE SAME CLASS OF INFORMATION

DIMENSIONS AND ANGLES

MAKING BETTER DECISIONS AND GETTING BETTER GUIDANCE OUT OF DATA IN AND AROUND THEIR BUSINESS...

GETTING RELEVANT DATA

TARGETED DATA FOR TARGETED ANALYSIS

BEYOND THE AVERAGE DATA

TARGETED, VALUE RICH DATA LIKE NEVER BEFORE - DISCOVERING THE POWER HIDDEN IN TRANSACTIONAL DATA

CERN IN THE 1960S

THE DAWN OF MACHINE GENERATED DATA - IN THE 1960'S SCIENTISTS WERE FORCED TO TRAVEL TO THE DATA TO DO THEIR ANALYSIS

HYBRID ENVIRONMENTS

RELATIONAL, NON-RELATIONAL AND DISTRIBUTED ENVIRONMENTS WORKING TOGETHER ARE THE FUTURE OF BIG DATA

CHEAPER AND FASTER

MASSIVE AMOUNTS OF DATA IS GENERATED, STORED AND ANALYZED FASTER AND CHEAPER THAN EVER BEFORE

MORE TOOLS - SHARED KNOWLEDGE

MORE TOOLS IN YOUR BAG, BREAKTHROUGHS IN MACHINE LEARNING AND SOCIALIZATION OF MINING TECNIQUES USED TO SOLVE DATA DISTRIBUTION AND PROCESSING ISSUES

NECESSITY BREEDS INVENTION

USE DATA AND MONEY MORE WISELY - OR GET BEATEN BY THE COMPETITION

LOTS OF PLAYERS FIGHTING FOR A PIECE OF THE BIG DATA PIE - MAJORS AND STARTUPS VYING FOR POSITION; VENDORS ARE EMBRACING NEW TECHNOLOGIES; NEW BIG DATA SERVICES COME ONLINE ON A DAILY BASIS

WE ARE EXPERIENCING THE BIRTH OF A NEW INDUSTRY - EVERYONE IS SCRAMBLING TO ESTABLISH THEMSELVES AS A LEADER IN THE PRODUCTION, CONSUMPTION, AND UTILIZATION OF THE NEW DATA SOURCES

AN ESTIMATED 40% OF THE $500 BILLION SPENT ON ADVERTISING EVERY YEAR IS WASTED - CLOUD SERVICES AND DATA STORES ENABLE FAIL FAST RESEARCH AT MINIMAL COST AND THEREFORE VIRTUALLY NO RISK

THE AGILE NATURE OF BIG DATA IS THE GOLDEN EGG - THE ABILITY TO COMPLETELY CHANGE DIRECTIONS WITHOUT INCURRING THE STANDARD UP FRONT COSTS OF RELATIONAL SYSTEMS ENABLES A BROADER RANGE OF “WHAT IF” ANALYSIS WITH LITTLE OR NO PENALTY

EASE OF IMPLEMENTATION BELIES THE PITFALLS OF INACCURATE DATA MODELING - IT MAY STILL TAKE AN EXPERT TO FORMULATE QUESTIONS WHOSE ANSWERS ACTUALLY SOLVE THE INTENDED PROBLEM

WE ARE AT THE BEGINNING STAGES OF GETTING SIGNIFICANT VALUE OUT OF BIG DATA - EVERY RUSH TO ADOPTION A BIG DATA SOLUTION IS AN INVITATION FOR DISASTER WITHOUT PROPER OVERSIGHT AND VALIDATION AND TESTING OF RESULTS

THE PIONEERS AND EARLY ADOPTERS HAVE PAID THE PRICE BUT GAINED THE - EXPERIENCE THE GAINS FOR THE MASSES THAT ARE ADOPTING NOW ARE SECURED BY THE WINS AND LOSSES OF THE LEADERS. HOWEVER, THERE IS STILL HUGE OPPORTUNITY FOR ANYONE THAT “GETS IT RIGHT”

HADOOP HAS COME OF AGE

THE CORE PLATFORM IS STABLE - IS RUNNING ON THOUSANDS OF MACHINE - AND HAS HUNDREDS OF COMPANIES INVESTING THEIR RESOURCES TO MAKE IT BETTER - IMPROVE CAPABILITIES AND PERFORMANCE - AND OFFER THEIR OWN SERVICES AND PLUG-INS.

PRIMARY COMPONENTS OF THE HADOOP ECOSYSTEM - THERE ARE LITERALLY HUNDREDS OF ADD-ONS TO THE CORE HADOOP PLATFORM WHICH IMPROVE ITS SPEED, PERFORMANCE, AND MAINTAINABILITY.

STRENGTH IMPROVES WHILE WEAKNESSES ARE DIMINISHING.

THE MICROSOFT IMPLEMENTATION OF HADOOP

THE PROJECTIONS ARE EVERY BIT AS BIG AS THE DATA WE ARE DISCUSSING - DIRECT AND SUPPORTING SKILLS ARE IN VERY HIGH DEMAND AND VERY SHORT SUPPLY

I BELIEVE THERE IS A HUGE MISUNDERSTANDING OF THE BIG DATA SKILL REQUIREMENTS - MANY BUSINESSES ARE STILL FAIRLY PRIMITIVE IN THEIR USE OF THEIR OWN DATA INDICATING THERE IS ROOM FOR ANYONE WITH SUFFICIENT INTEREST TO TRAIN AND SECURE A PLACE IN THE BIG DATA EXPLOSION