Xenomorph
  • Solutions
  • Technology
  • Customers
  • Resources
  • News
  • About Us
  • Request a Demo
  • Search
  • Menu Menu
  • Twitter
  • LinkedIn

News

When Big Data is not Big Understanding

Good article from Tim Harford (he of the enjoyable “Undercover Economist” books) in the FT last week called “Big data: are we making a big mistake“. Tim injects some healthy realism into the hype of Big Data without dismissing its importance and potential benefits. The article talks about the four claims often made when talking about Big Data:

  1. Data analysis often produces uncannily accurate results
  2. Make statistical samplying obsolete by capturing all the data
  3. Statistical correlation is all you need – no need to understand causation
  4. Enough data means that scientific or statistical models aren’t needed

Now models can have their own problems, but I can see where he is coming from, for instance 3. and 4. above seem to be in direct contradiction. I particularly like the comment later in the article that “causality won’t be discarded, but it is being knocked off its pedestal as the primary fountain of meaning.”

Also I liked the definition by one of the academics mentioned of a big data set being one where “N = All”, and that you have “all” the data is an incorrect assumption behind some Big Data analysis put forward. Large data sets can mean that sample error is low, but sample bias is still a potentially big problem – for example everyone on Twitter is probably not representative of the population of the human race in general.

So I will now press save on this blog post, publish in Twitter and help re-enforce the impression that Big Data is a hot topic…which it is, but not for everyone I guess is the point.

Share this entry
  • Share on Twitter
  • Share on LinkedIn
  • Share by Mail
https://www.xenomorph.com/wp-content/uploads/2019/07/logo-xeno.png 0 0 Brian Sentance https://www.xenomorph.com/wp-content/uploads/2019/07/logo-xeno.png Brian Sentance2014-04-07 17:09:142020-02-06 12:16:57When Big Data is not Big Understanding
1 reply
  1. Brian Sentance says:
    April 9, 2014 at 11:10 pm

    On the NYTimes: http://www.nytimes.com/2014/04/07/opinion/eight-no-nine-problems-with-big-data.html

Comments are closed.

Categories

  • Blog Post
  • Events
  • Press Release

Archives

About Xenomorph

Xenomorph provides trusted data management solutions to many of the world’s leading financial institutions.

With more than two decades’ experience managing large volumes of complex data and analytics we can quickly configure a solution for your requirements.

Xenomorph London

4th Floor
10 Lloyd’s Avenue
London EC3N 3AJ
UK

+44 (0)20 7614 8600

info@xenomorph.com

map

Xenomorph New York

45 Rockefeller Plaza, FL 20
New York
NY 10111
USA

+1-212-401-7894

info@xenomorph.com

map


Xenomorph Boston

53 State Street
Suite 500
Boston, MA 02109
USA

+1-617-465-2050

info@xenomorph.com

map

© Xenomorph Software Ltd 2022 - Privacy policy | Anti-Bribery Policy
Scroll to top
This website uses cookies to improve your experience. If you continue to use the site we will assume your consent. ACCEPTRead More
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these cookies, the cookies that are categorized as necessary are stored on your browser as they are as essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may have an effect on your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
SAVE & ACCEPT