Big Data: the shift from ocean to stream will hit you like a tsunami

tsunami2So the fabled Mary Meeker powerpoint tome hit the internet at the D11 conference this week and if you have the patience to wade through the stats the messages are pretty clear: it’s a wearable, shareable future for mankind.

But there’s a shift in how people are willing to share now.

Share it. Delete it.

500m photos are shared on average every day. Of those, 150m are shared via Snapchat, a very nifty little semi-social network app that deletes the photo from the server after it’s been viewed by the recipient. Users can dial in just how long that photo is available for after viewing but once it’s gone it’s gone for good (at least in theory).

And this is a definite trend which will continue for the next few years. As Gen X makes way for Gen Y, the latter doesn’t want their digital footprint to linger for months and years for organizations to benefit from (or leave a trail that can be used negatively) and services like Snapchat offer a way out of the ocean mentality that Gen X has built its empire on. Gen Y is a stream culture as Toby Beresford, a social strategist and founder of Leaderboarded succinctly put it.

Big Data or Disappearing Data?

So where does this leave the Big Data promise? The premise of Big Data analytics is built on having use of massive amounts of data that is constantly being generated and available for weeks, months, years. Big Data was built for the ocean culture of Gen X. But if the mechanism behind Snapchat take off and proliferate across other networks, organizations may find themselves in a difficult position; they’ll have no ocean from which to trawl data, it’ll have slowed to a trickle. Which means they have to react faster and in real-time to data that could potentially appear and disappear within seconds. And with privacy being an ongoing concern for users, having access to that data and being able to store it outside of those parameters could very well breach regulations.

For personal data that we’ve assumed will be around when needed, this could mean a rethinking of event processing and process management.

This is obviously a small use case example and there are many others where the ocean mentality fits the model perfectly (for now, until volumes grow and velocity increases). But with people already crying that Big Data has hit the infamous Trough of Disillusionment the industry needs to re-examine what it means to harness data, analyze it and act on it.

Because in some cases now, you no longer have months to play data scientist, you have seconds.

Screen Shot 2013-05-30 at 7.32.37 AM


Tags: , , , ,

Categories: Data Analytics / Big Data, Information Technology, Real-time

Author:Theo Priestley

"I had more creative ideas from Theo in 6 months than I have had in 6 years from most people." Theo Priestley is one of the most recognised independent technology industry influencers and evangelists, ranking in the Top 100 thought leaders across Virtual/ Augmented Reality, FinTech, Artificial Intelligence, Big Data, Internet of Things and future trends. Theo has written insights for Forbes, Wired, The European Magazine, Venturebeat to name a few, and has been interviewed for many online publications including the BBC on his thoughts on technology and the future. A regular paid keynote speaker and panelist at conferences and events, Theo is engaged for his forthright views and isn't afraid to challenge conventional thinking and the marketing hype surrounding the industry when presenting, never pulling punches to get the message across on how technology can be applied to improve business and the customer experience. He has also successfully organised and run TEDx and Ignite events. Highly active across social networks, he sits in the Top 1% for social media engagement on Kred and Klout and is constantly sharing articles and his analysis that he feels his audience would be interested in. Theo is also active in the startup community, mentoring within UK and US accelerators and sits on a number of advisory boards. Former VP and Chief Technology Evangelist at a Top 25 European enterprise software company with a career spanning both innovation strategy and delivery of software and business change in Financial Services, and as an independent technology industry analyst. Follow Theo on Twitter @tprstly or connect here directly for constant insights on tech and marketing trends. • Top 1% Influencer on Kred (915) • Top 1% Influencer on Klout (70+) • 12,000+ Followers on LinkedIn • 13,000+ Followers on Twitter • Recognised Top Influencer in AI, Virtual/ Augmented Reality, Fintech, IOT and Wearable Tech, Big Data and Analytics.

Subscribe to the blog

Subscribe and receive an email when new articles are published

No comments yet.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s

%d bloggers like this: