People believe the best way to learn from the data is to have a hypothesis and then go check it, but the data is so complex that someone who is working with a data set will not know the most significant things to ask. That's a huge problem.
Ayasdi's customers can finally learn the answers to questions that they didn't know to ask in the first place.
I'm going to say something rather controversial. Big data, as people understand it today, is just a bigger version of small data. Fundamentally, what we're doing with data has not changed; there's just more of it.
Technologies like Ayasdi's exist now to automatically discover information from data without having someone making guesses up front.
To learn something from your data, the forming of a hypothesis lies with the human being, which turns into a query, which becomes a result. The problem is that there are too many queries to make, too many questions to ask.
The number of queries in a large dataset is exponential, and it's growing exponentially. No matter how fast you make your system, you're never going to be able to get all that information.
If you know people with Type 2 diabetes, there's a high likelihood they will have different medication regimes and different lifestyle options. When we label all these various types as the same thing, we treat them the same way, and they should not be treated the same way.
The biggest challenge in big data today is asking the right questions of data. There are so many questions to ask that you don't have the time to ask them all, so it doesn't even make sense to think about where to start your analysis.
The answers to today's most important scientific, business, and social problems lie in data.
The power of Ayasdi is its unique ability to automatically discover insights - regardless of complexity - without asking questions.