Leading an organization through Big Data adoption requires some changes
I was looking again at Phil Simon’s book, Too Big to Ignore and saw his 5 important things that an executive must do before they are able to lead an organization into the brave new world of Big Data. They are concise, insightful, and deserve discussion.
- Recognize that the world has changed – and isn’t changing back
- Disavow themselves of antiquated mindsets
- Realize that Big Data represents big opportunity
- Understand that existing tools like relational databases are insufficient to handle the explosion of unstructured data
- Embrace new and Big Data-specific tools – and encourage employees to utilize and experiment with them
These five simple actions summarize the mental preparation that is necessary to make the commitment to start the journey.
The world has changed for the better. Tools make it practical to think about things like “all my network traffic”, “all tweets about my company or products”, “all the signals from remote sensors” and “all email messages” as valuable data to be mined for actionable insights.
We have trained ourselves to be blind to data that we could not use and to intuitively think of data as normalized relationships. These habits must be broken to be effective with Big Data.
What is buried in that 80% of data we have been ignoring is at least as valuable as all the data we have been processing. Maybe doubly so given that not all of your competitors are looking at it.
Relational databases are extremely powerful, but impose serious restrictions on data before it can be stored and processed. The ETL process is a fundamental flaw in approaching Big Data and it cannot be overcome. New tools and new approaches are necessary.
You need to become familiar and effective with the new tools. Encourage your staff to invest in themselves and to take some risks in order to build the skills they will need to support your directives.