Running spark beeline on Yarn2019 Community Moderator ElectionWhere are logs in Spark on YARN?Apache Spark: The number of cores vs. the number of executorsSpark on yarn concept understandingYARN not preempting resources based on fair shares when running a Spark jobSpark Yarn running 1000 jobs in queueSpark History UI not working | Ambari | YARNHow to get execution DAG from spark web UI after job has finished running, when I am running spark on YARN?spark on yarn not release resource memory (Cloudera Manager)Run Spark on YARN without spark-submit but with javaWorking with Beeline connecting to Hive and Spark (HDP)
Create chunks from an array
In the world of The Matrix, what is "popping"?
Should we avoid writing fiction about historical events without extensive research?
What does it mean when I add a new variable to my linear model and the R^2 stays the same?
Was it really inappropriate to write a pull request for the company I interviewed with?
Practical reasons to have both a large police force and bounty hunting network?
Where do you go through passport control when transiting through another Schengen airport on your way out of the Schengen area?
Split a number into equal parts given the number of parts
Is being socially reclusive okay for a graduate student?
Replacing tantalum capacitor with ceramic capacitor for Op Amps
Called into a meeting and told we are being made redundant (laid off) and "not to share outside". Can I tell my partner?
Affine transformation of circular arc in 3D
Integrating function with /; in its definition
What is the oldest European royal house?
Why are special aircraft used for the carriers in the United States Navy?
Why doesn't "adolescent" take any articles in "listen to adolescent agonising"?
If nine coins are tossed, what is the probability that the number of heads is even?
Linear Combination of Atomic Orbitals
Can you run a ground wire from stove directly to ground pole in the ground
Ultrafilters as a double dual
How can I be pwned if I'm not registered on the compromised site?
Are angels creatures (Mark 16:15) and can they repent (Rev 2:5 and Rom 8:21)
How spaceships determine each other's mass in space?
What is Tony Stark injecting into himself in Iron Man 3?
Running spark beeline on Yarn
2019 Community Moderator ElectionWhere are logs in Spark on YARN?Apache Spark: The number of cores vs. the number of executorsSpark on yarn concept understandingYARN not preempting resources based on fair shares when running a Spark jobSpark Yarn running 1000 jobs in queueSpark History UI not working | Ambari | YARNHow to get execution DAG from spark web UI after job has finished running, when I am running spark on YARN?spark on yarn not release resource memory (Cloudera Manager)Run Spark on YARN without spark-submit but with javaWorking with Beeline connecting to Hive and Spark (HDP)
I am using beeline to execute hql queries.
The job does not seem show up in resource manager for Spark History server on HDP 2.6.
How to make it run on Yarn?
Thanks
apache-spark hadoop apache-spark-sql yarn
asked yesterday
J-kramJ-kram
61
add a comment |
I am using beeline to execute hql queries.
The job does not seem show up in resource manager for Spark History server on HDP 2.6.
How to make it run on Yarn?
Thanks
apache-spark hadoop apache-spark-sql yarn
asked yesterday
J-kramJ-kram
61
add a comment |
I am using beeline to execute hql queries.
The job does not seem show up in resource manager for Spark History server on HDP 2.6.
How to make it run on Yarn?
Thanks
apache-spark hadoop apache-spark-sql yarn
asked yesterday
J-kramJ-kram
61
I am using beeline to execute hql queries.
The job does not seem show up in resource manager for Spark History server on HDP 2.6.
How to make it run on Yarn?
Thanks
apache-spark hadoop apache-spark-sql yarn
apache-spark hadoop apache-spark-sql yarn
asked yesterday
J-kramJ-kram
61
asked yesterday
J-kramJ-kram
61
asked yesterday
J-kramJ-kram
61
asked yesterday
J-kramJ-kram
61
asked yesterday
J-kramJ-kram
61
61
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
Beeline is an Apache Hive client and has nothing to do with Spark so you won't see queries show up in the Spark history server. The queries should be running in YARN though, and if you go to the YARN Resource Manager Web UI (should be under quick links if you have access to Ambari) you will see them there.
answered yesterday
Kit MenkeKit Menke
6,52612751
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55022269%2frunning-spark-beeline-on-yarn%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Beeline is an Apache Hive client and has nothing to do with Spark so you won't see queries show up in the Spark history server. The queries should be running in YARN though, and if you go to the YARN Resource Manager Web UI (should be under quick links if you have access to Ambari) you will see them there.
answered yesterday
Kit MenkeKit Menke
6,52612751
add a comment |
Beeline is an Apache Hive client and has nothing to do with Spark so you won't see queries show up in the Spark history server. The queries should be running in YARN though, and if you go to the YARN Resource Manager Web UI (should be under quick links if you have access to Ambari) you will see them there.
answered yesterday
Kit MenkeKit Menke
6,52612751
add a comment |
Beeline is an Apache Hive client and has nothing to do with Spark so you won't see queries show up in the Spark history server. The queries should be running in YARN though, and if you go to the YARN Resource Manager Web UI (should be under quick links if you have access to Ambari) you will see them there.
answered yesterday
Kit MenkeKit Menke
6,52612751
Beeline is an Apache Hive client and has nothing to do with Spark so you won't see queries show up in the Spark history server. The queries should be running in YARN though, and if you go to the YARN Resource Manager Web UI (should be under quick links if you have access to Ambari) you will see them there.
answered yesterday
Kit MenkeKit Menke
6,52612751
answered yesterday
Kit MenkeKit Menke
6,52612751
answered yesterday
Kit MenkeKit Menke
6,52612751
answered yesterday
Kit MenkeKit Menke
6,52612751
6,52612751
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55022269%2frunning-spark-beeline-on-yarn%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
