FileNotFoundException when trying to use com.crealytics.spark.excel about spark-excel HOT 15 CLOSED

You're mixing up things.
Delete the .option("location",...) part and specify the full URL in load

from spark-excel.

Then I get this

java.lang.IllegalArgumentException: Parameter "location" is missing in options.

from spark-excel.

Seems you're using an outdated version.

from spark-excel.

Thanks a lot for your quick response.
I am using spark-excel_2.11-0.9.17
My Spark version is spark 2.3.1
My Scala Version 2.11

from spark-excel.

I think something is messed up with your classpath. This is definitely not version 0.9.17 because that option is now called path (see the checkParameter("path")):
https://github.com/crealytics/spark-excel/blob/master/src/main/scala/com/crealytics/spark/excel/DefaultSource.scala

from spark-excel.

Thanks a lot. I cleaned up the classpath and now I am getting location exception but I am still getting other exception. This is the excel sheet I am getting from business so I can't even modify it manually.
org.apache.spark.sql.AnalysisException: Attribute name "Contract Identification Number" contains invalid character(s) among " ,;{}()\n\t=".

from spark-excel.

Thanks a lot. I cleaned up the classpath and now I am not getting location exception but I am still getting other exception. This is the excel sheet I am getting from business so I can't even modify it manually.
org.apache.spark.sql.AnalysisException: Attribute name "Contract Identification Number" contains invalid character(s) among " ,;{}()\n\t=".

from spark-excel.

Does this help? http://mail-archives.apache.org/mod_mbox/spark-user/201507.mbox/%3CCAAswR-6D7CGv1varyA0cYWnoH3nSr17gb+hypHORi3APGrhB7A@mail.gmail.com%3E

from spark-excel.

Something is weird. I am creating a generic framework to extract any csv and excel. I am using spark-csv library , I extract the schema and save it and if schema is already there I will apply that schema in future.

However in case of Spark-excel library , when I extract schema I get all the column names, datatypes and nullable but I also get column names like this
"StructField(ReportingPeriodEndingDate,StringType,true)_color".

from spark-excel.

One more question: What should be the format of custom schema?

from spark-excel.

When I convert excel to CSV, it generates a lot of empty columns.

from spark-excel.

That strange-looking column should actually be called "ReportingPeriodEndingDate_color" and is a generated column that contains the cell color of the "ReportingPeriodEndingDate" column.
You can turn that of by leaving out the .option("addColorColumns", "true").

from spark-excel.

If I turn it off then it doesn't generate schema. I need to capture the schema.

from spark-excel.

Wdym, "it doesn't generate schema"?
After reading from an Excel file to a df: DataFrame, you always have an associated schema with df.schema.

from spark-excel.

Thanks a lot for your quick response and your help. I am able to solve the problem.

from spark-excel.