Home > other >  CombineTextInputFormat merge small file anomalies
CombineTextInputFormat merge small file anomalies

Time:10-06


There are several small files, Hdfs path


Use CombineTextInputFormat way to merge processing, the code is as follows:


Mapper code:


Reduce code:


Run command:
Hadoop jar/usr/local/hadoop/jars/Mr - 1.0.1. Jar com. Jyong. Boots/wordcount/output/input/wordcount

Run error message:



I use the default TextInputFormat way, is not normal operation error, instead CombineTextInputFormat is washed-up,
Everyone a great god, and have met this kind of situation, how to solve?
  • Related