How do I add Dataflow memory usage to Stackdriver?Reserved CPU Time in Google DataflowCost of each pipeline jobUsing custom docker containers in DataflowGoogle Dataflow “Workflow failed” with no reasonGoogle Dataflow custom metrics not showing on StackdriverMetrics getting reset after restarting dataflow pipelineMonitoring works or identifying bottlenecks in data pipelineMonitor GC Dataflow events per minute in StackdriverHow to monitor Nvidia GPU computation/memory usage on GCP Stackdriver?Can Cloud Dataflow streaming job scale to zero?
Failed to fetch jessie backports repository
How do I define a right arrow with bar in LaTeX?
At which point does a character regain all their Hit Dice?
How could Frankenstein get the parts for his _second_ creature?
Displaying the order of the columns of a table
How do I rename a LINUX host without needing to reboot for the rename to take effect?
Is it correct to write "is not focus on"?
Can I Retrieve Email Addresses from BCC?
Hide Select Output from T-SQL
Why "be dealt cards" rather than "be dealing cards"?
How was Earth single-handedly capable of creating 3 of the 4 gods of chaos?
Do I need a multiple entry visa for a trip UK -> Sweden -> UK?
HashMap containsKey() returns false although hashCode() and equals() are true
Is the destination of a commercial flight important for the pilot?
Best way to store options for panels
Star/Wye electrical connection math symbol
Go Pregnant or Go Home
Where in the Bible does the greeting ("Dominus Vobiscum") used at Mass come from?
How will losing mobility of one hand affect my career as a programmer?
apt-get update is failing in debian
What is the intuitive meaning of having a linear relationship between the logs of two variables?
How to prove that the query oracle is unitary?
Is there an Impartial Brexit Deal comparison site?
Is it okay / does it make sense for another player to join a running game of Munchkin?
How do I add Dataflow memory usage to Stackdriver?
Reserved CPU Time in Google DataflowCost of each pipeline jobUsing custom docker containers in DataflowGoogle Dataflow “Workflow failed” with no reasonGoogle Dataflow custom metrics not showing on StackdriverMetrics getting reset after restarting dataflow pipelineMonitoring works or identifying bottlenecks in data pipelineMonitor GC Dataflow events per minute in StackdriverHow to monitor Nvidia GPU computation/memory usage on GCP Stackdriver?Can Cloud Dataflow streaming job scale to zero?
Problem:
We want to understand the memory usage of our Cloud Dataflow job, preferably per worker/VM. We'd like to add this to Stackdriver, but it seems we can only add cpu usage and disk I/O metrics.
Question:
Is there a way to add Cloud Dataflow memory usage to Stackdriver?
google-cloud-dataflow google-cloud-stackdriver
asked Mar 7 at 11:35
Jonny5Jonny5
461418
add a comment |
Problem:
We want to understand the memory usage of our Cloud Dataflow job, preferably per worker/VM. We'd like to add this to Stackdriver, but it seems we can only add cpu usage and disk I/O metrics.
Question:
Is there a way to add Cloud Dataflow memory usage to Stackdriver?
google-cloud-dataflow google-cloud-stackdriver
asked Mar 7 at 11:35
Jonny5Jonny5
461418
add a comment |
Problem:
We want to understand the memory usage of our Cloud Dataflow job, preferably per worker/VM. We'd like to add this to Stackdriver, but it seems we can only add cpu usage and disk I/O metrics.
Question:
Is there a way to add Cloud Dataflow memory usage to Stackdriver?
google-cloud-dataflow google-cloud-stackdriver
asked Mar 7 at 11:35
Jonny5Jonny5
461418
Problem:
We want to understand the memory usage of our Cloud Dataflow job, preferably per worker/VM. We'd like to add this to Stackdriver, but it seems we can only add cpu usage and disk I/O metrics.
Question:
Is there a way to add Cloud Dataflow memory usage to Stackdriver?
google-cloud-dataflow google-cloud-stackdriver
google-cloud-dataflow google-cloud-stackdriver
asked Mar 7 at 11:35
Jonny5Jonny5
461418
asked Mar 7 at 11:35
Jonny5Jonny5
461418
asked Mar 7 at 11:35
Jonny5Jonny5
461418
asked Mar 7 at 11:35
Jonny5Jonny5
461418
asked Mar 7 at 11:35
Jonny5Jonny5
461418
461418
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
As described here you can use the --experiments=enable_stackdriver_agent_metrics flag to enable Agent metrics for your Dataflow job. This will include JVM metrics such as memory/usage.
answered Mar 7 at 14:55
Guillem XercavinsGuillem Xercavins
2,1101419
It works, thanks! ;)
– Jonny5
Mar 7 at 17:26
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55042843%2fhow-do-i-add-dataflow-memory-usage-to-stackdriver%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
As described here you can use the --experiments=enable_stackdriver_agent_metrics flag to enable Agent metrics for your Dataflow job. This will include JVM metrics such as memory/usage.
answered Mar 7 at 14:55
Guillem XercavinsGuillem Xercavins
2,1101419
It works, thanks! ;)
– Jonny5
Mar 7 at 17:26
add a comment |
As described here you can use the --experiments=enable_stackdriver_agent_metrics flag to enable Agent metrics for your Dataflow job. This will include JVM metrics such as memory/usage.
answered Mar 7 at 14:55
Guillem XercavinsGuillem Xercavins
2,1101419
It works, thanks! ;)
– Jonny5
Mar 7 at 17:26
add a comment |
As described here you can use the --experiments=enable_stackdriver_agent_metrics flag to enable Agent metrics for your Dataflow job. This will include JVM metrics such as memory/usage.
answered Mar 7 at 14:55
Guillem XercavinsGuillem Xercavins
2,1101419
As described here you can use the --experiments=enable_stackdriver_agent_metrics flag to enable Agent metrics for your Dataflow job. This will include JVM metrics such as memory/usage.
answered Mar 7 at 14:55
Guillem XercavinsGuillem Xercavins
2,1101419
answered Mar 7 at 14:55
Guillem XercavinsGuillem Xercavins
2,1101419
answered Mar 7 at 14:55
Guillem XercavinsGuillem Xercavins
2,1101419
answered Mar 7 at 14:55
Guillem XercavinsGuillem Xercavins
2,1101419
2,1101419
It works, thanks! ;)
– Jonny5
Mar 7 at 17:26
add a comment |
It works, thanks! ;)
– Jonny5
Mar 7 at 17:26
It works, thanks! ;)
– Jonny5
Mar 7 at 17:26
It works, thanks! ;)
– Jonny5
Mar 7 at 17:26
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55042843%2fhow-do-i-add-dataflow-memory-usage-to-stackdriver%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
