This article from Cloudera offers up use cases (such as customer sentiment) and a tutorial for using Apache Flume for near-real-time indexing (as emails arrive on your mail server) or MapReduce (actually MapReduceIndexerTool) for batch indexing of email archives. The two methods can be combined if you decide to do real-time, but later decide to add another MIME header field into the index.
Cloudera Search is based on Apache Solr (which contains components like Apache Lucene, SolrCloud, Apache Tika, and Solr Cell).
The email (including the MIME header) is parsed (with the help of Cloudera Morphlines), then uses Flume to push the messages into HDFS, as Solr intercepts and indexes the contents of the email fields.
Searching and viewing the results can be done using the Solr GUI or Hue’s search application.
Sources:
- http://blog.cloudera.com/blog/2013/09/email-indexing-using-cloudera-search/
- http://www.cloudera.com/content/cloudera/en/products/cdh/search.html
- http://lucene.apache.org/solr/
- http://lucene.apache.org/
- http://wiki.apache.org/solr/SolrCloud
- http://tika.apache.org/
- http://wiki.apache.org/solr/ExtractingRequestHandler
- http://cloudera.github.io/hue/
Cloud (IaaS) & Big Data 