Home > other >  Sqoop1 import data into parquet spark dataframe cannot be used
Sqoop1 import data into parquet spark dataframe cannot be used

Time:09-24

With sqoop1-1.4.5 - as - aprquet to save data imported from MySQL to the HDFS into parquet but spark cannot use
Save sqoop save file is not parquet file

CodePudding user response:

Stick sqoop ordered up to look at it

CodePudding user response:

Sqoop import - connect "JDBC: oracle: thin: @ host: nettele" - the username admin - P admin - split - by CUSTOMER_ID -- query 'select * from the table where createdate is not null and $the CONDITIONS' -- target - dir/user/tkonline/test - parquet/- num - 6 - as - parquetfile mappers

CodePudding user response:

Spark jdbcreader than sqoop much better,,,,
Give up sqoop,,

  • Related