How far are we from the tipping point of Big Data? When will the world’s icebergs of data melt into one sea? More importantly, when it happens, will we be ready to do something useful with it all?
Those are questions asked by Michael Driscoll in is big data at a tipping point. The post came to my attention via Paul Kedrosky and talks about a potential tipping point for Big Data, which occurs in a connected world. He goes on to talk about various data efforts, including one that I care about a lot
.
But lets return to the key part of his thesis. He believes that the transition from relatively unconnected to mostly connected, occurs when we have about half as many nodes as edges. This also fits in somewhat with the jigsaw puzzle analogy that Jeff Jonas uses for perpetual analytics. There comes a point when the next steps just become that much more obvious.
How will this trend towards data connectivity evolve? The arguments above scream linked data loud and clear, but that can only be a mechanism around which the entire ecosystem is built. You have derived information which has value which might need to be monetized. You have security needs, you have the risk of stale and stagnant data. All of that needs to be reconciled either via human or automated agents.
That last bit is critical if we want to be able to affirmatively answer Michael’s last question.
Connected data and the tipping point
Those are questions asked by Michael Driscoll in is big data at a tipping point. The post came to my attention via Paul Kedrosky and talks about a potential tipping point for Big Data, which occurs in a connected world. He goes on to talk about various data efforts, including one that I care about a lot
.
But lets return to the key part of his thesis. He believes that the transition from relatively unconnected to mostly connected, occurs when we have about half as many nodes as edges. This also fits in somewhat with the jigsaw puzzle analogy that Jeff Jonas uses for perpetual analytics. There comes a point when the next steps just become that much more obvious.
How will this trend towards data connectivity evolve? The arguments above scream linked data loud and clear, but that can only be a mechanism around which the entire ecosystem is built. You have derived information which has value which might need to be monetized. You have security needs, you have the risk of stale and stagnant data. All of that needs to be reconciled either via human or automated agents.
That last bit is critical if we want to be able to affirmatively answer Michael’s last question.