Giter Club home page Giter Club logo

Comments (10)

nightscape avatar nightscape commented on July 19, 2024 1

Hmm, I thought I had published for 2.10 as well, but my memory fails me quite frequently 😉
@shoffing I just tried the link and now it shows some files.
Can you check and report back here?

from spark-excel.

nightscape avatar nightscape commented on July 19, 2024

Hi @bssulfikkar,

that's workable, thanks for rephrasing the issue 👍
I just published the version to Sonatype, it should appear here within the next hours:
https://repo1.maven.org/maven2/com/crealytics/spark-excel_2.11/0.8.2/
When this link doesn't give you a 404 anymore then you should be able to start spark-shell with the package like this

spark-shell --packages com.crealytics:spark-excel_2.11:0.8.2

from spark-excel.

 avatar commented on July 19, 2024

Hi @nightscape

Thanks for the information. Could you please let me know how can I utilize the com.crealytics.spark.excel for running the code from local eclipse.

import org.apache.spark.sql.SQLContext
import org.apache.spark.{SparkConf, SparkContext}

object Test {
def main(args:Array[String]): Unit ={
val conf = new SparkConf().setAppName("Test-Excel Importer").setMaster("local[*]")
val sc = new SparkContext(conf)
val sqlContext = new SQLContext(sc)
val df = sqlContext.read
.format("com.crealytics.spark.excel")
.option("location", "GL.xlsx")
.option("sheetName", "ISDA")
.option("useHeader", "true")
.option("treatEmptyValuesAsNulls", "true")
.option("inferSchema", "true")
.option("addColorColumns", "true")
.load("GL")
df.printSchema()
df.show()
}
}

Error is

Exception in thread "main" java.lang.ClassNotFoundException: Failed to find data source: com.crealytics.spark.excel. Please find packages at http://spark-packages.org

from spark-excel.

 avatar commented on July 19, 2024

Description Resource Path Location Type
spark-excel_2.11-0.8.2.jar of sulfi build path is cross-compiled with an incompatible version of Scala (2.11.0). In case this report is mistaken, this check can be disabled in the compiler preference page. sulfi Unknown Scala Version Problem

I may need to use the 2.11.0 jar... or 2.10 version jars.

from spark-excel.

nightscape avatar nightscape commented on July 19, 2024

It sounds like you are using a Spark version based on Scala 2.10, so in that case you have to use the 2.10 version of this plugin as well.

from spark-excel.

 avatar commented on July 19, 2024

i am using scala plugin version 2.11 and using the scala compilor of 2.10...How can I get the jar spark-excel with 2.10 version..

from spark-excel.

nightscape avatar nightscape commented on July 19, 2024

The same way you got the 2.11 one (SBT, Maven, Gradle, manual download, whatever), just replace 2.11 by 2.10.

from spark-excel.

nightscape avatar nightscape commented on July 19, 2024

@bssulfikkar Can this issue be closed?

from spark-excel.

shoffing avatar shoffing commented on July 19, 2024

https://repo1.maven.org/maven2/com/crealytics/spark-excel_2.10/0.8.2/
404 Not Found

Is there a released 2.10 version?

from spark-excel.

shoffing avatar shoffing commented on July 19, 2024

Yes, I also see the files now. Thank you!

from spark-excel.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.