MPI gather data into different indices for each rank2019 Community Moderator ElectionQuestion in MPI_Gather parallel programmingMPI Gather different Sizepartition a 2D array column-wise and use allgathermpi gather collect dataMPI Gather Corrupting ArraysMPI Bcast or Scatter to specific ranksHow to send a 2D array in MPI with variation for each processorGathering a distributed array using MPIScattering to more nodes than there is dataMPI communication with different sized datatypes

Professor being mistaken for a grad student

Official degrees of earth’s rotation per day

Are all passive ability checks floors for active ability checks?

Why does a Star of David appear at a rally with Francisco Franco?

Instead of a Universal Basic Income program, why not implement a "Universal Basic Needs" program?

How to terminate ping <dest> &

How to write cleanly even if my character uses expletive language?

How are passwords stolen from companies if they only store hashes?

combinatorics floor summation

What is the significance behind "40 days" that often appears in the Bible?

Recruiter wants very extensive technical details about all of my previous work

What is the Japanese sound word for the clinking of money?

What is a ^ b and (a & b) << 1?

What is the adequate fee for a reveal operation?

Describing a chess game in a novel

What is "focus distance lower/upper" and how is it different from depth of field?

Is a party consisting of only a bard, a cleric, and a warlock functional long-term?

Why one should not leave fingerprints on bulbs and plugs?

Are Roman Catholic priests ever addressed as pastor

Why did it take so long to abandon sail after steamships were demonstrated?

How to make healing in an exploration game interesting

How could an airship be repaired midflight?

Is there a symmetric-key algorithm which we can use for creating a signature?

What do you call the act of removing a part of a word and replacing it with an apostrophe



MPI gather data into different indices for each rank



2019 Community Moderator ElectionQuestion in MPI_Gather parallel programmingMPI Gather different Sizepartition a 2D array column-wise and use allgathermpi gather collect dataMPI Gather Corrupting ArraysMPI Bcast or Scatter to specific ranksHow to send a 2D array in MPI with variation for each processorGathering a distributed array using MPIScattering to more nodes than there is dataMPI communication with different sized datatypes










0















Pretend I have 5 x 3 array that I need to fill with data from other ranks. Each rank has a different number of rows (n x 3) that they need to send, but ideally I would like to specify the row that the data should occupy in the final array. For example (sorry for the Pythony syntax):



Rank 0
Data = [[A1,A2,A3],
[A4,A5,A6]]
Indices = [1, 4]

Rank 1
Data = [[B1,B2,B3]]
Indices = [2]

Rank 2
Data = [[C1,C2,C3],
[C4,C5,C6]]
Indices = [0,3]


Post Gather Data
Rank 0 = [[C1,C2,C3],
[A1,A2,A3],
[B1,B2,B3],
[C4,C5,C6],
[A4,A5,A6]]


The mapping of which rank is responsible for which indices is available on all ranks, so I can definitely do a gatherv() and map it back into the final array, but I was hoping I could fill it up correctly as part of the communication.



When doing IO, I do a very similar operation by having each rank define their own indexed data type and then calling MPI_File_write_all(), but I'm having trouble finding an equivalent to fill an buffer. Sorry if I'm just missing something obvious.










share|improve this question


























    0















    Pretend I have 5 x 3 array that I need to fill with data from other ranks. Each rank has a different number of rows (n x 3) that they need to send, but ideally I would like to specify the row that the data should occupy in the final array. For example (sorry for the Pythony syntax):



    Rank 0
    Data = [[A1,A2,A3],
    [A4,A5,A6]]
    Indices = [1, 4]

    Rank 1
    Data = [[B1,B2,B3]]
    Indices = [2]

    Rank 2
    Data = [[C1,C2,C3],
    [C4,C5,C6]]
    Indices = [0,3]


    Post Gather Data
    Rank 0 = [[C1,C2,C3],
    [A1,A2,A3],
    [B1,B2,B3],
    [C4,C5,C6],
    [A4,A5,A6]]


    The mapping of which rank is responsible for which indices is available on all ranks, so I can definitely do a gatherv() and map it back into the final array, but I was hoping I could fill it up correctly as part of the communication.



    When doing IO, I do a very similar operation by having each rank define their own indexed data type and then calling MPI_File_write_all(), but I'm having trouble finding an equivalent to fill an buffer. Sorry if I'm just missing something obvious.










    share|improve this question
























      0












      0








      0








      Pretend I have 5 x 3 array that I need to fill with data from other ranks. Each rank has a different number of rows (n x 3) that they need to send, but ideally I would like to specify the row that the data should occupy in the final array. For example (sorry for the Pythony syntax):



      Rank 0
      Data = [[A1,A2,A3],
      [A4,A5,A6]]
      Indices = [1, 4]

      Rank 1
      Data = [[B1,B2,B3]]
      Indices = [2]

      Rank 2
      Data = [[C1,C2,C3],
      [C4,C5,C6]]
      Indices = [0,3]


      Post Gather Data
      Rank 0 = [[C1,C2,C3],
      [A1,A2,A3],
      [B1,B2,B3],
      [C4,C5,C6],
      [A4,A5,A6]]


      The mapping of which rank is responsible for which indices is available on all ranks, so I can definitely do a gatherv() and map it back into the final array, but I was hoping I could fill it up correctly as part of the communication.



      When doing IO, I do a very similar operation by having each rank define their own indexed data type and then calling MPI_File_write_all(), but I'm having trouble finding an equivalent to fill an buffer. Sorry if I'm just missing something obvious.










      share|improve this question














      Pretend I have 5 x 3 array that I need to fill with data from other ranks. Each rank has a different number of rows (n x 3) that they need to send, but ideally I would like to specify the row that the data should occupy in the final array. For example (sorry for the Pythony syntax):



      Rank 0
      Data = [[A1,A2,A3],
      [A4,A5,A6]]
      Indices = [1, 4]

      Rank 1
      Data = [[B1,B2,B3]]
      Indices = [2]

      Rank 2
      Data = [[C1,C2,C3],
      [C4,C5,C6]]
      Indices = [0,3]


      Post Gather Data
      Rank 0 = [[C1,C2,C3],
      [A1,A2,A3],
      [B1,B2,B3],
      [C4,C5,C6],
      [A4,A5,A6]]


      The mapping of which rank is responsible for which indices is available on all ranks, so I can definitely do a gatherv() and map it back into the final array, but I was hoping I could fill it up correctly as part of the communication.



      When doing IO, I do a very similar operation by having each rank define their own indexed data type and then calling MPI_File_write_all(), but I'm having trouble finding an equivalent to fill an buffer. Sorry if I'm just missing something obvious.







      mpi






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Mar 6 at 20:40









      rpmcnallyrpmcnally

      1098




      1098






















          0






          active

          oldest

          votes











          Your Answer






          StackExchange.ifUsing("editor", function ()
          StackExchange.using("externalEditor", function ()
          StackExchange.using("snippets", function ()
          StackExchange.snippets.init();
          );
          );
          , "code-snippets");

          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "1"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55031809%2fmpi-gather-data-into-different-indices-for-each-rank%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Stack Overflow!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55031809%2fmpi-gather-data-into-different-indices-for-each-rank%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          AWS Lex not identifying response if by a variable The 2019 Stack Overflow Developer Survey Results Are In Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern) The Ask Question Wizard is Live! Data science time! April 2019 and salary with experienceEnforcing custom enumeration in AWS LEX for slot valuesHow to give response based on user response in Amazon Lex?Intercepting AWS Lambda Response to a AWS Lex QueryLex chat bot error: Reached second execution of fulfillment lambda on the same utteranceamazon lex showing invalid responseLambda response send back to Lex slot?Response card in Amazon lexAmazon Lex - Lambda response return HTML to botHow can I solve 424 (Failed Dependency) (python) obtained from Amazon lex?

          Алба-Юлія

          Захаров Федір Захарович