I want to ask the elder brothers, I now is to do the ETL, also done some bi report, but they're in some SQL + business, I want to improve myself, want to transformation for warehouse, several positions, please will need to Hadoop, spark these? Several positions are mainly use HQL + service + some shell script is enough Hadoop, spark just need to know principle, (such as shuffle, etc.) do the work of several warehouse don't have to write Java code, Scala code to write the spark streaming what of, mainly use most is the spark of SQL, flink SQL more