20/05/17 00:57:21 INFO graphs. The Job: the map reduce 50% 0%
20/05/17 00:57:26 INFO graphs. The Job: the map reduce 58% 0%
20/05/17 00:57:29 INFO graphs. The Job: the map reduce 60% 0%
20/05/17 00:57:29 INFO graphs. Job: Task Id: attempt_1589647746660_0003_m_000000_1, Status: FAILED
Error: Java. Lang. RuntimeException: native - lzo library not available
At com.hadoop.com pression. Lzo. LzopCodec. GetDecompressorType (LzopCodec. Java: 156)
Press the at org.apache.hadoop.io.com. CodecPool. GetDecompressor (CodecPool. Java: 178)
At org, apache hadoop. Graphs. Lib. Input. LineRecordReader. The initialize (LineRecordReader. Java: 90)
At org, apache hadoop. Mapred. MapTask $NewTrackingRecordReader. The initialize (MapTask. Java: 548)
At org, apache hadoop. Mapred. MapTask. RunNewMapper (MapTask. Java: 786)
At org, apache hadoop. Mapred. MapTask. Run (341) MapTask. Java:
At org, apache hadoop. Mapred. YarnChild $2. The run (164) YarnChild. Java:
The at Java. Security. The AccessController. DoPrivileged (Native Method)
At javax.mail. Security. Auth. Subject. The doAs (422) Subject. Java:
At org, apache hadoop. Security. UserGroupInformation. DoAs (UserGroupInformation. Java: 1657)
At org, apache hadoop. Mapred. YarnChild. Main (158) YarnChild. Java:

20/05/17 00:57:31 INFO graphs. The Job: the map reduce 60% 17%
20/05/17 00:57:32 INFO graphs. The Job: the map reduce 62% 17%
20/05/17 00:57:35 INFO graphs. The Job: the map reduce 65% 17%
20/05/17 00:57:38 INFO graphs. The Job: the map reduce 68% 17%
20/05/17 00:57:41 INFO graphs. The Job: the map reduce 72% 17%
20/05/17 00:57:44 INFO graphs. The Job: the map reduce 75% 17%
20/05/17 00:57:44 INFO graphs. Job: Task Id: attempt_1589647746660_0003_m_000000_2, Status: FAILED
Error: Java. Lang. RuntimeException: native - lzo library not available
At com.hadoop.com pression. Lzo. LzopCodec. GetDecompressorType (LzopCodec. Java: 156)
Press the at org.apache.hadoop.io.com. CodecPool. GetDecompressor (CodecPool. Java: 178)
At org, apache hadoop. Graphs. Lib. Input. LineRecordReader. The initialize (LineRecordReader. Java: 90)
At org, apache hadoop. Mapred. MapTask $NewTrackingRecordReader. The initialize (MapTask. Java: 548)
At org, apache hadoop. Mapred. MapTask. RunNewMapper (MapTask. Java: 786)
At org, apache hadoop. Mapred. MapTask. Run (341) MapTask. Java:
At org, apache hadoop. Mapred. YarnChild $2. The run (164) YarnChild. Java:
The at Java. Security. The AccessController. DoPrivileged (Native Method)
At javax.mail. Security. Auth. Subject. The doAs (422) Subject. Java:
At org, apache hadoop. Security. UserGroupInformation. DoAs (UserGroupInformation. Java: 1657)
At org, apache hadoop. Mapred. YarnChild. Main (YarnChild. Java: 158)

CodePudding user response:

I have the same problem, environment variables are set, or not

CodePudding user response:

Lack of hadoop - lzo jar download and unpack after installation, you need to modify the corresponding core configuration file - site. XML