[jgroups-users] How to manage this behaviour when using NotifyingFuture/DistributedExecutor APIs?
2013-10-07 22:24:06 GMT
Hi JGroups team, and Bela,
We have an ISPN 5.1.6 data grid (that executes on top of JGroups) that includes the following topology:
2 x Linux host(s)
Each with 30 x Java VM Nodes
TOTAL = 60 Nodes
On this 60 Node grid we use the
APIs to manage the dispatch/co-ordination/consolidation of a MapReduce TASK that originates from a dedicated TASK SENDER Node and targets the full set of 60 TASK RECEIVER Nodes to complete the computation.
The exact API invoke (from the Task SENDER) – of course – looks like
//build the DistributedExecutorService and Callable instance references
List<Future<T>> futureList = distExecSvc.submitEverywhere(ourCallableTask);
Now, as expected, 99+% of the time we are able to realize exactly 1 Task being distributed to all 60 RECEIVER Nodes and we see exactly 1 Future List entry being returned per Node submitted.
However, under very rare circumstances … and *only* when a certain subset of RECEIVER Nodes are enduring a major GC event, we are able to see undeniable evidence that the callableTask is being submitted multiple times to a certain subset of the RECEIVER Nodes.
Is there any ISPN/JGroups API or configuration mechanism by which we can be assured of being able to prevent the callableTask being submitted multiple times to a certain subset of the RECEIVER Nodes?
Thanks for any insights,
Ben D. Cotton III
Liquidity Risk Technology
277 Park Ave Desk 08-GG64
New York, NY 10172-0003
ben.cotton <at> jpmorgan.com
This email is confidential and subject to important disclaimers and conditions including on offers for the purchase or sale of securities, accuracy and completeness of information, viruses, confidentiality, legal privilege, and legal entity disclaimers, available at http://www.jpmorgan.com/pages/disclosures/email.
------------------------------------------------------------------------------ October Webinars: Code for Performance Free Intel webinars can help you accelerate application performance. Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from the latest Intel processors and coprocessors. See abstracts and register > http://pubads.g.doubleclick.net/gampad/clk?id=60134071&iu=/4140/ostg.clktrk
_______________________________________________ javagroups-users mailing list javagroups-users <at> lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/javagroups-users