Ufdjrw

Is flight data recorder erased after every flight?

Multiply Two Integer Polynomials

What does ひと匙 mean in this manga and has it been used colloquially?

What are the motivations for publishing new editions of an existing textbook, beyond new discoveries in a field?

Output the Arecibo Message

Am I thawing this London Broil safely?

How are circuits which use complex ICs normally simulated?

Lightning Grid - Columns and Rows?

Resizing object distorts it (Illustrator CC 2018)

How to manage monthly salary

Aging parents with no investments

How to type this arrow in math mode?

Why was M87 targetted for the Event Horizon Telescope instead of Sagittarius A*?

Did Section 31 appear in Star Trek: The Next Generation?

What do hard-Brexiteers want with respect to the Irish border?

Can we generate random numbers using irrational numbers like π and e?

One word riddle: Vowel in the middle

Are spiders unable to hurt humans, especially very small spiders?

Are there any other methods to apply to solving simultaneous equations?

What could be the right powersource for 15 seconds lifespan disposable giant chainsaw?

What is the motivation for a law requiring 2 parties to consent for recording a conversation

During Temple times, who can butcher a kosher animal?

How to answer pointed "are you quitting" questioning when I don't want them to suspect

Does the shape of a die affect the probability of a number being rolled?

java.lang.NoSuchMethodError: org.apache.solr.client.solrj.impl.CloudSolrClient$Builder.withHttpClient

.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;

0

I am following this example to get data from Solr to my Scala Spark program. Below is my code:

val solrURL = "someurl"
val collectionName = "somecollection"

val solrRDD = new SelectSolrRDD(solrURL,collectionName,sc)

val solrQuery=new SolrQuery("somequery")
solrQuery.setTimeAllowed(0)

val solrDataRDD=solrRDD.query(solrQuery)

When I run this code on my local Spark cluster, I get the following exception at new selectSolrRDD line:

java.lang.NoSuchMethodError: org.apache.solr.client.solrj.impl.CloudSolrClient$Builder.withHttpClient(Lorg/apache/http/client/HttpClient;)Lorg/apache/solr/client/solrj/impl/SolrClientBuilder;

I looked at some other answers on StackOverflow but nothing worked.

apache-spark solr solrj

share|improve this question

asked Mar 8 at 9:38

Piyush ShrivastavaPiyush Shrivastava

463623

• 
  
  
  

  
  2
  

  
  
  
  
  
  

  
  
  Possible duplicate of Resolving dependency problems in Apache Spark
  
  – user10938362
  Mar 8 at 10:05
  

  
  
  
  

add a comment | 

0

I am following this example to get data from Solr to my Scala Spark program. Below is my code:

val solrURL = "someurl"
val collectionName = "somecollection"

val solrRDD = new SelectSolrRDD(solrURL,collectionName,sc)

val solrQuery=new SolrQuery("somequery")
solrQuery.setTimeAllowed(0)

val solrDataRDD=solrRDD.query(solrQuery)

When I run this code on my local Spark cluster, I get the following exception at new selectSolrRDD line:

java.lang.NoSuchMethodError: org.apache.solr.client.solrj.impl.CloudSolrClient$Builder.withHttpClient(Lorg/apache/http/client/HttpClient;)Lorg/apache/solr/client/solrj/impl/SolrClientBuilder;

I looked at some other answers on StackOverflow but nothing worked.

apache-spark solr solrj

share|improve this question

asked Mar 8 at 9:38

Piyush ShrivastavaPiyush Shrivastava

463623

• 
  
  
  

  
  2
  

  
  
  
  
  
  

  
  
  Possible duplicate of Resolving dependency problems in Apache Spark
  
  – user10938362
  Mar 8 at 10:05
  

  
  
  
  

add a comment | 

I am following this example to get data from Solr to my Scala Spark program. Below is my code:

val solrURL = "someurl"
val collectionName = "somecollection"

val solrRDD = new SelectSolrRDD(solrURL,collectionName,sc)

val solrQuery=new SolrQuery("somequery")
solrQuery.setTimeAllowed(0)

val solrDataRDD=solrRDD.query(solrQuery)

When I run this code on my local Spark cluster, I get the following exception at new selectSolrRDD line:

java.lang.NoSuchMethodError: org.apache.solr.client.solrj.impl.CloudSolrClient$Builder.withHttpClient(Lorg/apache/http/client/HttpClient;)Lorg/apache/solr/client/solrj/impl/SolrClientBuilder;

I looked at some other answers on StackOverflow but nothing worked.

apache-spark solr solrj

share|improve this question

asked Mar 8 at 9:38

Piyush ShrivastavaPiyush Shrivastava

463623

val solrURL = "someurl"
val collectionName = "somecollection"

val solrRDD = new SelectSolrRDD(solrURL,collectionName,sc)

val solrQuery=new SolrQuery("somequery")
solrQuery.setTimeAllowed(0)

val solrDataRDD=solrRDD.query(solrQuery)

share|improve this question

asked Mar 8 at 9:38

Piyush ShrivastavaPiyush Shrivastava

463623

share|improve this question

asked Mar 8 at 9:38

Piyush ShrivastavaPiyush Shrivastava

463623

asked Mar 8 at 9:38

Piyush ShrivastavaPiyush Shrivastava

463623

asked Mar 8 at 9:38

Piyush ShrivastavaPiyush Shrivastava

463623

2 Answers
2

active

oldest

votes

0

The problem is with your packaging and deployment (your pom.xml assuming you are using maven). The issue is that the Solr client libraries are not being loaded when you run your Spark app. You need to package your app and any dependencies into an "uber jar" for deployment to a cluster.

Take a look at how spark-solr has it setup. They use the maven-shade-plugin to generate the uber jar.

share|improve this answer

answered Mar 8 at 22:45

Kit MenkeKit Menke

6,59612752

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  I am using Scala and sbt and am building the jar using sbt assembly plugin which creates a fat jar. Could there be any other reason why solr libraries are not getting loaded?
  
  – Piyush Shrivastava
  Mar 11 at 7:43
  

  
  
  
  

add a comment | 

0

My cluster had jars of spark-solr already present which were conflicting with the jars I was using. After removing those jars, my code worked correctly.

share|improve this answer

answered Mar 11 at 7:49

Piyush ShrivastavaPiyush Shrivastava

463623

add a comment | 

Your Answer

StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);

draft saved

draft discarded

Sign up or log in

StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);

Sign up using Google

Sign up using Facebook

Sign up using Email and Password

Post as a guest

Name

Email

Required, but never shown

StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55060410%2fjava-lang-nosuchmethoderror-org-apache-solr-client-solrj-impl-cloudsolrclientb%23new-answer', 'question_page');

);

Post as a guest

Name

Email

Required, but never shown

0

The problem is with your packaging and deployment (your pom.xml assuming you are using maven). The issue is that the Solr client libraries are not being loaded when you run your Spark app. You need to package your app and any dependencies into an "uber jar" for deployment to a cluster.

Take a look at how spark-solr has it setup. They use the maven-shade-plugin to generate the uber jar.

share|improve this answer

answered Mar 8 at 22:45

Kit MenkeKit Menke

6,59612752

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  I am using Scala and sbt and am building the jar using sbt assembly plugin which creates a fat jar. Could there be any other reason why solr libraries are not getting loaded?
  
  – Piyush Shrivastava
  Mar 11 at 7:43
  

  
  
  
  

add a comment | 

0

The problem is with your packaging and deployment (your pom.xml assuming you are using maven). The issue is that the Solr client libraries are not being loaded when you run your Spark app. You need to package your app and any dependencies into an "uber jar" for deployment to a cluster.

Take a look at how spark-solr has it setup. They use the maven-shade-plugin to generate the uber jar.

share|improve this answer

answered Mar 8 at 22:45

Kit MenkeKit Menke

6,59612752

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  I am using Scala and sbt and am building the jar using sbt assembly plugin which creates a fat jar. Could there be any other reason why solr libraries are not getting loaded?
  
  – Piyush Shrivastava
  Mar 11 at 7:43
  

  
  
  
  

add a comment | 

The problem is with your packaging and deployment (your pom.xml assuming you are using maven). The issue is that the Solr client libraries are not being loaded when you run your Spark app. You need to package your app and any dependencies into an "uber jar" for deployment to a cluster.

Take a look at how spark-solr has it setup. They use the maven-shade-plugin to generate the uber jar.

share|improve this answer

answered Mar 8 at 22:45

Kit MenkeKit Menke

6,59612752

share|improve this answer

answered Mar 8 at 22:45

Kit MenkeKit Menke

6,59612752

answered Mar 8 at 22:45

Kit MenkeKit Menke

6,59612752

answered Mar 8 at 22:45

Kit MenkeKit Menke

6,59612752

0

My cluster had jars of spark-solr already present which were conflicting with the jars I was using. After removing those jars, my code worked correctly.

share|improve this answer

answered Mar 11 at 7:49

Piyush ShrivastavaPiyush Shrivastava

463623

add a comment | 

0

My cluster had jars of spark-solr already present which were conflicting with the jars I was using. After removing those jars, my code worked correctly.

share|improve this answer

answered Mar 11 at 7:49

Piyush ShrivastavaPiyush Shrivastava

463623

add a comment | 

My cluster had jars of spark-solr already present which were conflicting with the jars I was using. After removing those jars, my code worked correctly.

share|improve this answer

answered Mar 11 at 7:49

Piyush ShrivastavaPiyush Shrivastava

463623

share|improve this answer

answered Mar 11 at 7:49

Piyush ShrivastavaPiyush Shrivastava

463623

answered Mar 11 at 7:49

Piyush ShrivastavaPiyush Shrivastava

463623

answered Mar 11 at 7:49

Piyush ShrivastavaPiyush Shrivastava

463623