Each technology Daniel,
Want to do a little investigating, the younger brother companies want to build a log collection and analysis system, excuse me each log collection tools are used in the company? (such as flume, open source tools such as scribe), the other is
1. After the log collection is made from local hadoop analysis or on cloud with cloud computing? (because the flume and scribe can be directly to the HDFS, so curious about everyone is directly calculate local hope to cloud computing)
2. Log data is locally generated or the cloud?
3. Use the open source log collection software can meet the requirements? Consider using log collection commercial software?

Also welcome to provide other better way