A couple interesting videos on large-scale machine learning and data mining using Hadoop from Hadoop World 2010.
1 – Large-Scale Text Analytics at AOL
The first is a presentation on Text Analysis from AOL:
Slides for the presentation can be found here.
AOL’s high-level text analytics architecture – built on top of HDFS – is shown in the visual below:
Related presentations on AOL’s use of Hadoop for Content Analytics and Ad Targeting can be seen below:
- Architecting AOL’s Data Layer for Content Analytics – Ian Holsman, October 2010
- An emerging data management architectural pattern behind interactive web applications – Cloudera, February 2011
The Text Analytics modules perform analysis that is then fed into important AOL applications. Two targeted advertising examples – shown below – are Location-Aware Contextual Advertising and User Aware Ad Targeting:
2 – Sentiment Analysis at GE
The second presentation is from GE on large-scale Sentiment Analysis using Hadoop:
glenn
