BigInsights - overview
Enterprises generate tremendous volumes of data from internal sources such as transaction systems, web logs, product tracking information, and customer online correspondence. They also utilize a great deal of information on customer demographics, competitors, public sentiment and more. Platforms such as Hadoop, an Apache open source project, have been designed to store web-scale data and support complex web analytics programmed using the Map-Reduce paradigm. We are exploring the use of Hadoop, with important extensions, as an enterprise platform for extreme, enterprise analytics - that is, extremely complex analytics on extremely large volumes of data. Our goal is to build a powerful analytics platform, and to use it to create analytic applications providing solutions to problems that have not been economically feasible to solve until now.