I'm trying to read cassandra from spark but I m getting :
Unsupported data source V2 partitioning type: CassandraPartitioning
spark : 3.3 scala : 2.12 cassandra connector : 3.2.0
CodePudding user response:
V2 partitioning is completely new in Spark 3.3 introduced by SPARK-37377.
At the time of writing, the latest version of Spark Cassandra connector (v3.2) only works with Apache Spark 3.2. The connector currently does not support Spark 3.3. Cheers!
CodePudding user response:
maximum spark version supported by the cassandra connector is 3.2.2