Disable Apache Spark metrics collector (for CI)How to set up Spark on Windows?How to set Apache Spark Executor memoryApache Spark logging within ScalaDistributed Web crawling using Apache Spark - Is it Possible?Apache Spark - Saving ModelsSpark 1.6.0 throwing classcast exception in Cluster Mode works fine in local modeHow to Disable or do minimal Logging for apache spark client Driver program?Is it possible to configure Apache Livy to run with Spark Standalone?Apache Spark: Disable Spark Web UI in Spark Standalone modeUsing different version of hadoop client library with apache spark
Drawing ramified coverings with tikz
Will adding a BY-SA image to a blog post make the entire post BY-SA?
Melting point of aspirin, contradicting sources
Aligning individual characters/glyphs like a monospace font
How can Trident be so inexpensive? Will it orbit Triton or just do a (slow) flyby?
Java - What do constructor type arguments mean when placed *before* the type?
Frequency of inspection at vegan restaurants
How to color a curve
What's the difference between 違法 and 不法?
API Access HTML/Javascript
A Permanent Norse Presence in America
Query about absorption line spectra
Why do IPv6 unique local addresses have to have a /48 prefix?
What does this horizontal bar at the first measure mean?
When quoting, must I also copy hyphens used to divide words that continue on the next line?
Confusion on Parallelogram
Global amount of publications over time
How to align and center standalone amsmath equations?
Do the concepts of IP address and network interface not belong to the same layer?
Engineer refusing to file/disclose patents
Should I stop contributing to retirement accounts?
What linear sensor for a keyboard?
Can someone explain how this makes sense electrically?
Flux received by a negative charge
Disable Apache Spark metrics collector (for CI)
How to set up Spark on Windows?How to set Apache Spark Executor memoryApache Spark logging within ScalaDistributed Web crawling using Apache Spark - Is it Possible?Apache Spark - Saving ModelsSpark 1.6.0 throwing classcast exception in Cluster Mode works fine in local modeHow to Disable or do minimal Logging for apache spark client Driver program?Is it possible to configure Apache Livy to run with Spark Standalone?Apache Spark: Disable Spark Web UI in Spark Standalone modeUsing different version of hadoop client library with apache spark
Running Apache Spark in a CI environment, I try to disable all unnecessary Spark features (such as web UI, metrics...) because it throws lot of org.jacoco.agent exceptions.
Is it possible to disable it (with Spark 1.6.x)?
apache-spark
asked Mar 7 at 9:07
Thomas DecauxThomas Decaux
13.3k25764
add a comment |
Running Apache Spark in a CI environment, I try to disable all unnecessary Spark features (such as web UI, metrics...) because it throws lot of org.jacoco.agent exceptions.
Is it possible to disable it (with Spark 1.6.x)?
apache-spark
asked Mar 7 at 9:07
Thomas DecauxThomas Decaux
13.3k25764
1
My guess is that you should be able to configure jacoco plugin to ignore specific classes/packages instead of disabling Spark features.
– ALincoln
Mar 7 at 20:17
Do you know how to do that?
– Thomas Decaux
Mar 8 at 9:27
I don't know, as I need to dive deeper into some specifics of how you run/use it (Maven, Gradle, Sbt). But it should be pretty straightforward if you look into Jacoco's documentation, as for Maven's example: eclemma.org/jacoco/trunk/doc/check-mojo.html
– ALincoln
Mar 9 at 11:56
add a comment |
Running Apache Spark in a CI environment, I try to disable all unnecessary Spark features (such as web UI, metrics...) because it throws lot of org.jacoco.agent exceptions.
Is it possible to disable it (with Spark 1.6.x)?
apache-spark
asked Mar 7 at 9:07
Thomas DecauxThomas Decaux
13.3k25764
Running Apache Spark in a CI environment, I try to disable all unnecessary Spark features (such as web UI, metrics...) because it throws lot of org.jacoco.agent exceptions.
Is it possible to disable it (with Spark 1.6.x)?
apache-spark
apache-spark
asked Mar 7 at 9:07
Thomas DecauxThomas Decaux
13.3k25764
asked Mar 7 at 9:07
Thomas DecauxThomas Decaux
13.3k25764
asked Mar 7 at 9:07
Thomas DecauxThomas Decaux
13.3k25764
asked Mar 7 at 9:07
Thomas DecauxThomas Decaux
13.3k25764
asked Mar 7 at 9:07
Thomas DecauxThomas Decaux
13.3k25764
13.3k25764
1
My guess is that you should be able to configure jacoco plugin to ignore specific classes/packages instead of disabling Spark features.
– ALincoln
Mar 7 at 20:17
Do you know how to do that?
– Thomas Decaux
Mar 8 at 9:27
I don't know, as I need to dive deeper into some specifics of how you run/use it (Maven, Gradle, Sbt). But it should be pretty straightforward if you look into Jacoco's documentation, as for Maven's example: eclemma.org/jacoco/trunk/doc/check-mojo.html
– ALincoln
Mar 9 at 11:56
add a comment |
1
My guess is that you should be able to configure jacoco plugin to ignore specific classes/packages instead of disabling Spark features.
– ALincoln
Mar 7 at 20:17
Do you know how to do that?
– Thomas Decaux
Mar 8 at 9:27
I don't know, as I need to dive deeper into some specifics of how you run/use it (Maven, Gradle, Sbt). But it should be pretty straightforward if you look into Jacoco's documentation, as for Maven's example: eclemma.org/jacoco/trunk/doc/check-mojo.html
– ALincoln
Mar 9 at 11:56
1
1
My guess is that you should be able to configure jacoco plugin to ignore specific classes/packages instead of disabling Spark features.
– ALincoln
Mar 7 at 20:17
My guess is that you should be able to configure jacoco plugin to ignore specific classes/packages instead of disabling Spark features.
– ALincoln
Mar 7 at 20:17
Do you know how to do that?
– Thomas Decaux
Mar 8 at 9:27
Do you know how to do that?
– Thomas Decaux
Mar 8 at 9:27
I don't know, as I need to dive deeper into some specifics of how you run/use it (Maven, Gradle, Sbt). But it should be pretty straightforward if you look into Jacoco's documentation, as for Maven's example: eclemma.org/jacoco/trunk/doc/check-mojo.html
– ALincoln
Mar 9 at 11:56
I don't know, as I need to dive deeper into some specifics of how you run/use it (Maven, Gradle, Sbt). But it should be pretty straightforward if you look into Jacoco's documentation, as for Maven's example: eclemma.org/jacoco/trunk/doc/check-mojo.html
– ALincoln
Mar 9 at 11:56
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55039882%2fdisable-apache-spark-metrics-collector-for-ci%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55039882%2fdisable-apache-spark-metrics-collector-for-ci%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
My guess is that you should be able to configure jacoco plugin to ignore specific classes/packages instead of disabling Spark features.
– ALincoln
Mar 7 at 20:17
Do you know how to do that?
– Thomas Decaux
Mar 8 at 9:27
I don't know, as I need to dive deeper into some specifics of how you run/use it (Maven, Gradle, Sbt). But it should be pretty straightforward if you look into Jacoco's documentation, as for Maven's example: eclemma.org/jacoco/trunk/doc/check-mojo.html
– ALincoln
Mar 9 at 11:56