How to read excel xlsx file using pyspark
You need to install the crealytics library. You can do it via pip:
pip install xlrd
My requirement is to read an excel using Pyspark, while doing same getting below error.
Or else alternatively is there any solution using Pandas to read excel and convert into Pyspark dataframe ? Any one is fine.
lat_data=spark.read.format('com.crealytics.spark.excel').option("header","true").load("a1.xlsx")
error:
Py4JJavaError: An error occurred while calling o756.load.
: java.lang.ClassNotFoundException: Failed to find data source: com.crealytics.spark.excel.
Thanks in advance.