CloudML does not log epoch progress (Batch stats missing) The 2019 Stack Overflow Developer Survey Results Are In“gcloud app logs tail” shows week old dataTensorflow dequeue is very slow on Cloud MLWhat does global step mean?gcloud job can't access my files, either they are in GCS or in my cloud shellTensorflow file_io.read_file_to_string says unexpected keyword argument binary_modecloudml R package--bash errors prevent it workingtf.datasets input_fn getting error after 1 epochTraining R Keras Model using cloudml failsSpeeding up TFRecords feed into Keras model on CloudML for GPUSlow performance after syncing storage bucket with gcsfuse
How can I define good in a religion that claims no moral authority?
Is it safe to harvest rainwater that fell on solar panels?
How do I free up internal storage if I don't have any apps downloaded?
The difference between dialogue marks
Is an up-to-date browser secure on an out-of-date OS?
Is it ethical to upload a automatically generated paper to a non peer-reviewed site as part of a larger research?
Can an undergraduate be advised by a professor who is very far away?
Did the UK government pay "millions and millions of dollars" to try to snag Julian Assange?
How to charge AirPods to keep battery healthy?
RequirePermission not working
writing variables above the numbers in tikz picture
What is this sharp, curved notch on my knife for?
Are spiders unable to hurt humans, especially very small spiders?
Can a flute soloist sit?
Short story: child made less intelligent and less attractive
What information about me do stores get via my credit card?
A word that means fill it to the required quantity
Will it cause any balance problems to have PCs level up and gain the benefits of a long rest mid-fight?
Accepted by European university, rejected by all American ones I applied to? Possible reasons?
How come people say “Would of”?
Why not take a picture of a closer black hole?
Cooking pasta in a water boiler
Does HR tell a hiring manager about salary negotiations?
Why can I use a list index as an indexing variable in a for loop?
CloudML does not log epoch progress (Batch stats missing)
The 2019 Stack Overflow Developer Survey Results Are In“gcloud app logs tail” shows week old dataTensorflow dequeue is very slow on Cloud MLWhat does global step mean?gcloud job can't access my files, either they are in GCS or in my cloud shellTensorflow file_io.read_file_to_string says unexpected keyword argument binary_modecloudml R package--bash errors prevent it workingtf.datasets input_fn getting error after 1 epochTraining R Keras Model using cloudml failsSpeeding up TFRecords feed into Keras model on CloudML for GPUSlow performance after syncing storage bucket with gcsfuse
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
Why doesn't cloud ML log epoch progress?
The progress appears only once the epoch is completed fully as so:
However, while the epoch is running, we get:
Now the above was just a test, the real dataset has 100x more data than the first example.
I can see that in the first example, it takes ~ 15s per epoch. So I would expect 1500s per epoch on full dataset. However, it just seems to run forever and there is NO LOGGING to see what is actually happening.
Locally, we get a moving bar which fills up as the batches are processed, so why doesn't CLOUDML log batch progress?
google-cloud-platform google-cloud-ml
asked Mar 8 at 11:16
GRSGRS
3551830
add a comment |
Why doesn't cloud ML log epoch progress?
The progress appears only once the epoch is completed fully as so:
However, while the epoch is running, we get:
Now the above was just a test, the real dataset has 100x more data than the first example.
I can see that in the first example, it takes ~ 15s per epoch. So I would expect 1500s per epoch on full dataset. However, it just seems to run forever and there is NO LOGGING to see what is actually happening.
Locally, we get a moving bar which fills up as the batches are processed, so why doesn't CLOUDML log batch progress?
google-cloud-platform google-cloud-ml
asked Mar 8 at 11:16
GRSGRS
3551830
add a comment |
Why doesn't cloud ML log epoch progress?
The progress appears only once the epoch is completed fully as so:
However, while the epoch is running, we get:
Now the above was just a test, the real dataset has 100x more data than the first example.
I can see that in the first example, it takes ~ 15s per epoch. So I would expect 1500s per epoch on full dataset. However, it just seems to run forever and there is NO LOGGING to see what is actually happening.
Locally, we get a moving bar which fills up as the batches are processed, so why doesn't CLOUDML log batch progress?
google-cloud-platform google-cloud-ml
asked Mar 8 at 11:16
GRSGRS
3551830
Why doesn't cloud ML log epoch progress?
The progress appears only once the epoch is completed fully as so:
However, while the epoch is running, we get:
Now the above was just a test, the real dataset has 100x more data than the first example.
I can see that in the first example, it takes ~ 15s per epoch. So I would expect 1500s per epoch on full dataset. However, it just seems to run forever and there is NO LOGGING to see what is actually happening.
Locally, we get a moving bar which fills up as the batches are processed, so why doesn't CLOUDML log batch progress?
google-cloud-platform google-cloud-ml
google-cloud-platform google-cloud-ml
asked Mar 8 at 11:16
GRSGRS
3551830
asked Mar 8 at 11:16
GRSGRS
3551830
asked Mar 8 at 11:16
GRSGRS
3551830
asked Mar 8 at 11:16
GRSGRS
3551830
asked Mar 8 at 11:16
GRSGRS
3551830
3551830
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55062097%2fcloudml-does-not-log-epoch-progress-batch-stats-missing%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55062097%2fcloudml-does-not-log-epoch-progress-batch-stats-missing%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
