Transferring single entry between gemfire WAN clusterAdd a new server to Gemfire cluster hosting a replicated regionHow to bootstrap spring application context from gemfire?Pivotal Gemfire NoAvailableLocatorsExceptionA connection to a distributed system already exist in this VMControlling Gemfire cache updates in the backgroundGemfire WAN Gateway-sender configurationGemfire WAN with Peer to Peer combinedGemfire/geode native client configuration for failoverInitialize a GemFire cache by loading a Map of data from Spring Boot applicationTransferring data through clusters using gemfire
Why "Having chlorophyll without photosynthesis is actually very dangerous" and "like living with a bomb"?
Example of a continuous function that don't have a continuous extension
How to format long polynomial?
Minkowski space
Why dont electromagnetic waves interact with each other?
Can divisibility rules for digits be generalized to sum of digits
Why are electrically insulating heatsinks so rare? Is it just cost?
What typically incentivizes a professor to change jobs to a lower ranking university?
Has the BBC provided arguments for saying Brexit being cancelled is unlikely?
Is it important to consider tone, melody, and musical form while writing a song?
Which models of the Boeing 737 are still in production?
What does it mean to describe someone as a butt steak?
Is it possible to do 50 km distance without any previous training?
What does CI-V stand for?
The use of multiple foreign keys on same column in SQL Server
Why doesn't H₄O²⁺ exist?
What are the differences between the usage of 'it' and 'they'?
Why do I get two different answers for this counting problem?
Writing rule stating superpower from different root cause is bad writing
If I cast Expeditious Retreat, can I Dash as a bonus action on the same turn?
How is the claim "I am in New York only if I am in America" the same as "If I am in New York, then I am in America?
Today is the Center
Why don't electron-positron collisions release infinite energy?
A newer friend of my brother's gave him a load of baseball cards that are supposedly extremely valuable. Is this a scam?
Transferring single entry between gemfire WAN cluster
Add a new server to Gemfire cluster hosting a replicated regionHow to bootstrap spring application context from gemfire?Pivotal Gemfire NoAvailableLocatorsExceptionA connection to a distributed system already exist in this VMControlling Gemfire cache updates in the backgroundGemfire WAN Gateway-sender configurationGemfire WAN with Peer to Peer combinedGemfire/geode native client configuration for failoverInitialize a GemFire cache by loading a Map of data from Spring Boot applicationTransferring data through clusters using gemfire
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
I have two gemfire (version 8.2) clusters (sender and receiver) connected through WAN. Sender cluster gets data from DB and transmits entries to Receiver through WAN gateway until both clusters are online. Sometime few cache nodes from Receiver cluster goes down due to environment issue that causes data loss in Receiver cluster and impacts my clients connected to it. We are using gemfire-toolkit to transmit all data from sender to receiver in case almost all data is missing, but this solution doesn't fit right if there is few data missing in Receiver cluster.
I have a requirement that if my client connected to receiver cluster is looking for an entry and that not available in cache, I want to load that entry from Sender cluster on the fly. Also I can't rely on gateway-sender as it will transmit data asynchronously according to configured batch-time-interval.
I am thinking to expose RESTful end-point in sender cluster and configure a cache loader in receiver to call that end-point, get data and put into the it's cluster.
Is there anyway I can ask Sender cluster to transmit required entry to receiver synchronously or immediately without exposing any web-service. Or is there any other best solution someone can propose me explore?
gemfire spring-data-gemfire
asked Mar 8 at 4:32
sanitsanit
95111018
add a comment |
I have two gemfire (version 8.2) clusters (sender and receiver) connected through WAN. Sender cluster gets data from DB and transmits entries to Receiver through WAN gateway until both clusters are online. Sometime few cache nodes from Receiver cluster goes down due to environment issue that causes data loss in Receiver cluster and impacts my clients connected to it. We are using gemfire-toolkit to transmit all data from sender to receiver in case almost all data is missing, but this solution doesn't fit right if there is few data missing in Receiver cluster.
I have a requirement that if my client connected to receiver cluster is looking for an entry and that not available in cache, I want to load that entry from Sender cluster on the fly. Also I can't rely on gateway-sender as it will transmit data asynchronously according to configured batch-time-interval.
I am thinking to expose RESTful end-point in sender cluster and configure a cache loader in receiver to call that end-point, get data and put into the it's cluster.
Is there anyway I can ask Sender cluster to transmit required entry to receiver synchronously or immediately without exposing any web-service. Or is there any other best solution someone can propose me explore?
gemfire spring-data-gemfire
asked Mar 8 at 4:32
sanitsanit
95111018
add a comment |
I have two gemfire (version 8.2) clusters (sender and receiver) connected through WAN. Sender cluster gets data from DB and transmits entries to Receiver through WAN gateway until both clusters are online. Sometime few cache nodes from Receiver cluster goes down due to environment issue that causes data loss in Receiver cluster and impacts my clients connected to it. We are using gemfire-toolkit to transmit all data from sender to receiver in case almost all data is missing, but this solution doesn't fit right if there is few data missing in Receiver cluster.
I have a requirement that if my client connected to receiver cluster is looking for an entry and that not available in cache, I want to load that entry from Sender cluster on the fly. Also I can't rely on gateway-sender as it will transmit data asynchronously according to configured batch-time-interval.
I am thinking to expose RESTful end-point in sender cluster and configure a cache loader in receiver to call that end-point, get data and put into the it's cluster.
Is there anyway I can ask Sender cluster to transmit required entry to receiver synchronously or immediately without exposing any web-service. Or is there any other best solution someone can propose me explore?
gemfire spring-data-gemfire
asked Mar 8 at 4:32
sanitsanit
95111018
I have two gemfire (version 8.2) clusters (sender and receiver) connected through WAN. Sender cluster gets data from DB and transmits entries to Receiver through WAN gateway until both clusters are online. Sometime few cache nodes from Receiver cluster goes down due to environment issue that causes data loss in Receiver cluster and impacts my clients connected to it. We are using gemfire-toolkit to transmit all data from sender to receiver in case almost all data is missing, but this solution doesn't fit right if there is few data missing in Receiver cluster.
I have a requirement that if my client connected to receiver cluster is looking for an entry and that not available in cache, I want to load that entry from Sender cluster on the fly. Also I can't rely on gateway-sender as it will transmit data asynchronously according to configured batch-time-interval.
I am thinking to expose RESTful end-point in sender cluster and configure a cache loader in receiver to call that end-point, get data and put into the it's cluster.
Is there anyway I can ask Sender cluster to transmit required entry to receiver synchronously or immediately without exposing any web-service. Or is there any other best solution someone can propose me explore?
gemfire spring-data-gemfire
gemfire spring-data-gemfire
asked Mar 8 at 4:32
sanitsanit
95111018
asked Mar 8 at 4:32
sanitsanit
95111018
edited Mar 9 at 14:00
sanit
asked Mar 8 at 4:32
sanitsanit
95111018
asked Mar 8 at 4:32
sanitsanit
95111018
asked Mar 8 at 4:32
sanitsanit
95111018
95111018
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
From your description it looks like you can easily get to know exactly what entries are missing from the receiving cluster... if that's the case, then the easiest solution would be to simply "touch" (region.get() followed by a region.put() without modifying the value) those entries on the sending cluster.
This will basically generate a new event on the sending cluster, which will be automatically replicated to the receiving cluster without requiring anything extra on your end.
Hope this helps.
Cheers.
answered Mar 8 at 9:34
Juan RamosJuan Ramos
57138
Correct, I have key with me that is missing, but the problem is how should I invoke get() followed by put() on Sender cluster. As like gemtouch, I can register a function on Sender cluster which will perform "get();put()" but my Receiver cluster can't call that function as it must connect to Sender as client but Receiver itself is another independent server cluster and gemfire has restriction where a VM can't be both client and server at the same time.
– sanit
Mar 9 at 14:17
Hello Sanit, I've missed that part of the requirement, sorry about that... I'm not aware of any way of doing this out of box. The REST approach sounds feasible, though, just keep in mind that theCacheLoaderis synchronously invoked by the member when there's a cache miss so you should take extra care regarding time outs when invoking the REST endpoint and cluster workload.
– Juan Ramos
Mar 11 at 11:00
As a side note, GemFire comes with a REST API out of the box so you can use that instead of implementing your own one, you can have a look at Developing REST Applications for Pivotal GemFire.
– Juan Ramos
Mar 11 at 11:01
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55056765%2ftransferring-single-entry-between-gemfire-wan-cluster%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
From your description it looks like you can easily get to know exactly what entries are missing from the receiving cluster... if that's the case, then the easiest solution would be to simply "touch" (region.get() followed by a region.put() without modifying the value) those entries on the sending cluster.
This will basically generate a new event on the sending cluster, which will be automatically replicated to the receiving cluster without requiring anything extra on your end.
Hope this helps.
Cheers.
answered Mar 8 at 9:34
Juan RamosJuan Ramos
57138
Correct, I have key with me that is missing, but the problem is how should I invoke get() followed by put() on Sender cluster. As like gemtouch, I can register a function on Sender cluster which will perform "get();put()" but my Receiver cluster can't call that function as it must connect to Sender as client but Receiver itself is another independent server cluster and gemfire has restriction where a VM can't be both client and server at the same time.
– sanit
Mar 9 at 14:17
Hello Sanit, I've missed that part of the requirement, sorry about that... I'm not aware of any way of doing this out of box. The REST approach sounds feasible, though, just keep in mind that theCacheLoaderis synchronously invoked by the member when there's a cache miss so you should take extra care regarding time outs when invoking the REST endpoint and cluster workload.
– Juan Ramos
Mar 11 at 11:00
As a side note, GemFire comes with a REST API out of the box so you can use that instead of implementing your own one, you can have a look at Developing REST Applications for Pivotal GemFire.
– Juan Ramos
Mar 11 at 11:01
add a comment |
From your description it looks like you can easily get to know exactly what entries are missing from the receiving cluster... if that's the case, then the easiest solution would be to simply "touch" (region.get() followed by a region.put() without modifying the value) those entries on the sending cluster.
This will basically generate a new event on the sending cluster, which will be automatically replicated to the receiving cluster without requiring anything extra on your end.
Hope this helps.
Cheers.
answered Mar 8 at 9:34
Juan RamosJuan Ramos
57138
Correct, I have key with me that is missing, but the problem is how should I invoke get() followed by put() on Sender cluster. As like gemtouch, I can register a function on Sender cluster which will perform "get();put()" but my Receiver cluster can't call that function as it must connect to Sender as client but Receiver itself is another independent server cluster and gemfire has restriction where a VM can't be both client and server at the same time.
– sanit
Mar 9 at 14:17
Hello Sanit, I've missed that part of the requirement, sorry about that... I'm not aware of any way of doing this out of box. The REST approach sounds feasible, though, just keep in mind that theCacheLoaderis synchronously invoked by the member when there's a cache miss so you should take extra care regarding time outs when invoking the REST endpoint and cluster workload.
– Juan Ramos
Mar 11 at 11:00
As a side note, GemFire comes with a REST API out of the box so you can use that instead of implementing your own one, you can have a look at Developing REST Applications for Pivotal GemFire.
– Juan Ramos
Mar 11 at 11:01
add a comment |
From your description it looks like you can easily get to know exactly what entries are missing from the receiving cluster... if that's the case, then the easiest solution would be to simply "touch" (region.get() followed by a region.put() without modifying the value) those entries on the sending cluster.
This will basically generate a new event on the sending cluster, which will be automatically replicated to the receiving cluster without requiring anything extra on your end.
Hope this helps.
Cheers.
answered Mar 8 at 9:34
Juan RamosJuan Ramos
57138
From your description it looks like you can easily get to know exactly what entries are missing from the receiving cluster... if that's the case, then the easiest solution would be to simply "touch" (region.get() followed by a region.put() without modifying the value) those entries on the sending cluster.
This will basically generate a new event on the sending cluster, which will be automatically replicated to the receiving cluster without requiring anything extra on your end.
Hope this helps.
Cheers.
answered Mar 8 at 9:34
Juan RamosJuan Ramos
57138
answered Mar 8 at 9:34
Juan RamosJuan Ramos
57138
answered Mar 8 at 9:34
Juan RamosJuan Ramos
57138
answered Mar 8 at 9:34
Juan RamosJuan Ramos
57138
57138
Correct, I have key with me that is missing, but the problem is how should I invoke get() followed by put() on Sender cluster. As like gemtouch, I can register a function on Sender cluster which will perform "get();put()" but my Receiver cluster can't call that function as it must connect to Sender as client but Receiver itself is another independent server cluster and gemfire has restriction where a VM can't be both client and server at the same time.
– sanit
Mar 9 at 14:17
Hello Sanit, I've missed that part of the requirement, sorry about that... I'm not aware of any way of doing this out of box. The REST approach sounds feasible, though, just keep in mind that theCacheLoaderis synchronously invoked by the member when there's a cache miss so you should take extra care regarding time outs when invoking the REST endpoint and cluster workload.
– Juan Ramos
Mar 11 at 11:00
As a side note, GemFire comes with a REST API out of the box so you can use that instead of implementing your own one, you can have a look at Developing REST Applications for Pivotal GemFire.
– Juan Ramos
Mar 11 at 11:01
add a comment |
Correct, I have key with me that is missing, but the problem is how should I invoke get() followed by put() on Sender cluster. As like gemtouch, I can register a function on Sender cluster which will perform "get();put()" but my Receiver cluster can't call that function as it must connect to Sender as client but Receiver itself is another independent server cluster and gemfire has restriction where a VM can't be both client and server at the same time.
– sanit
Mar 9 at 14:17
Hello Sanit, I've missed that part of the requirement, sorry about that... I'm not aware of any way of doing this out of box. The REST approach sounds feasible, though, just keep in mind that theCacheLoaderis synchronously invoked by the member when there's a cache miss so you should take extra care regarding time outs when invoking the REST endpoint and cluster workload.
– Juan Ramos
Mar 11 at 11:00
As a side note, GemFire comes with a REST API out of the box so you can use that instead of implementing your own one, you can have a look at Developing REST Applications for Pivotal GemFire.
– Juan Ramos
Mar 11 at 11:01
Correct, I have key with me that is missing, but the problem is how should I invoke get() followed by put() on Sender cluster. As like gemtouch, I can register a function on Sender cluster which will perform "get();put()" but my Receiver cluster can't call that function as it must connect to Sender as client but Receiver itself is another independent server cluster and gemfire has restriction where a VM can't be both client and server at the same time.
– sanit
Mar 9 at 14:17
Correct, I have key with me that is missing, but the problem is how should I invoke get() followed by put() on Sender cluster. As like gemtouch, I can register a function on Sender cluster which will perform "get();put()" but my Receiver cluster can't call that function as it must connect to Sender as client but Receiver itself is another independent server cluster and gemfire has restriction where a VM can't be both client and server at the same time.
– sanit
Mar 9 at 14:17
Hello Sanit, I've missed that part of the requirement, sorry about that... I'm not aware of any way of doing this out of box. The REST approach sounds feasible, though, just keep in mind that the
CacheLoader is synchronously invoked by the member when there's a cache miss so you should take extra care regarding time outs when invoking the REST endpoint and cluster workload.– Juan Ramos
Mar 11 at 11:00
Hello Sanit, I've missed that part of the requirement, sorry about that... I'm not aware of any way of doing this out of box. The REST approach sounds feasible, though, just keep in mind that the
CacheLoader is synchronously invoked by the member when there's a cache miss so you should take extra care regarding time outs when invoking the REST endpoint and cluster workload.– Juan Ramos
Mar 11 at 11:00
As a side note, GemFire comes with a REST API out of the box so you can use that instead of implementing your own one, you can have a look at Developing REST Applications for Pivotal GemFire.
– Juan Ramos
Mar 11 at 11:01
As a side note, GemFire comes with a REST API out of the box so you can use that instead of implementing your own one, you can have a look at Developing REST Applications for Pivotal GemFire.
– Juan Ramos
Mar 11 at 11:01
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55056765%2ftransferring-single-entry-between-gemfire-wan-cluster%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
