Picon
Picon

[jgroups-users] JGroups - JChannel hanging in connect()

Hi

 

I have a cluster setup with 5 nodes using TCP. It seems none of the node is able to connect to the cluster.

I took a thread dump and see that my application has not moved ahead of the call to JChannel.connect().

As anyone encountered this issue.?  I am on 3.6.6.Final. Thread dump below. 

 

java.lang.Thread.State: TIMED_WAITING (parking)

        at sun.misc.Unsafe.park(Native Method)

        - parking to wait for  <0x00002aab1b246418> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)

        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)

        at org.jgroups.util.CondVar.waitFor(CondVar.java:64)

        at org.jgroups.util.Responses.waitFor(Responses.java:129)

        at org.jgroups.protocols.pbcast.ClientGmsImpl.joinInternal(ClientGmsImpl.java:82)

        at org.jgroups.protocols.pbcast.ClientGmsImpl.join(ClientGmsImpl.java:41)

        at org.jgroups.protocols.pbcast.GMS.down(GMS.java:1087)

        at org.jgroups.protocols.FC.down(FC.java:428)

        at org.jgroups.protocols.FRAG2.down(FRAG2.java:136)

        at org.jgroups.stack.ProtocolStack.down(ProtocolStack.java:1038)

        at org.jgroups.JChannel.down(JChannel.java:790)

        at org.jgroups.JChannel._connect(JChannel.java:564)

        at org.jgroups.JChannel.connect(JChannel.java:294)

        - locked <0x00002aab178a1d08> (a org.jgroups.JChannel)

        at org.jgroups.JChannel.connect(JChannel.java:279)

        - locked <0x00002aab178a1d08> (a org.jgroups.JChannel)

 

 

-regards

Seemanto Barua

212.298.4097

 


PLEASE READ: This message is for the named person's use only. It may contain confidential, proprietary or legally privileged information. No confidentiality or privilege is waived or lost by any mistransmission. If you receive this message in error, please delete it and all copies from your system, destroy any hard copies and notify the sender. You must not, directly or indirectly, use, disclose, distribute, print, or copy any part of this message if you are not the intended recipient. Nomura Holding America Inc., Nomura Securities International, Inc, and their respective subsidiaries each reserve the right to monitor all e-mail communications through its networks. Any views expressed in this message are those of the individual sender, except where the message states otherwise and the sender is authorized to state the views of such entity. Unless otherwise stated, any pricing information in this message is indicative only, is subject to change and does not constitute an offer to deal at any price quoted. Any reference to the terms of executed transactions should be treated as preliminary only and subject to our formal written confirmation.
------------------------------------------------------------------------------
Go from Idea to Many App Stores Faster with Intel(R) XDK
Give your users amazing mobile app experiences with Intel(R) XDK.
Use one codebase in this all-in-one HTML5 development environment.
Design, debug & build mobile apps & 2D/3D high-impact games for multiple OSs.
http://pubads.g.doubleclick.net/gampad/clk?id=254741911&iu=/4140
_______________________________________________
javagroups-users mailing list
javagroups-users <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/javagroups-users
Picon
Picon

[jgroups-users] What is PING over TUNNEL for?

Documentation for TUNNEL says " Note that it is not recommended to use TCPGOSSIP for discovery if TUNNEL is used (use PING instead).", and for PING "Initial (dirty) discovery of members. Used to detect the coordinator (oldest member), by mcasting PING requests to an IP multicast address.", however as far as I understand, TUNNEL only works with explicitly specified hosts (Gossip routers).

So, I wonder what PING over TUNNEL is used for? (couldn't find any information in documentation nor mail archive) [*].

Kind regards

[*] Removing PING from the stack causes an exception in GMS. Is the only purpose of including PING to avoid this error in the expectations of GMS?
------------------------------------------------------------------------------
_______________________________________________
javagroups-users mailing list
javagroups-users <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/javagroups-users
Picon
Picon

[jgroups-users] Recommended architecture for heterogeneously connected networks

Hi everyone, I'm just starting in the JGroups world and I would really appreciate insights about the best architecture for my use case.
What I'm trying to accomplish is an auto-discovery, fully "inter-connected" heterogeneous network. What I'm mean by heterogeneous network is a network where:
  • Not all nodes are reachable directly by each other
  • All node are reachable _through_ other (undefined) node.
In this situation, I may have a node connected to two networks (different network IPs) with nodes being in (any of the following cases):
  1. the same two networks (reachable by both of the IPs)
  2. only one network
  3. only reachable by another node in any of the cases 1 or 2
The additional difficulty is that, in some cases, connection establishment can be one way only (e.g. because of a node being behind a NAT).

I don't (can't) know in advance the topology of the network, so any topology dependent configuration must be done in runtime. Also, nodes can go down or up at any time.

Sooo, my question is, is there any recommended configuration for this use case? 
(I have been researching and have a few ideas in mind, but I don' want to post them yet to avoid biased recommendations and to keep this mail shorter :) )

I would really appreciate your feedback!
Kind regards

------------------------------------------------------------------------------
_______________________________________________
javagroups-users mailing list
javagroups-users <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/javagroups-users
Picon
Picon

[jgroups-users] Monitor org.jgroups.util.Table

Question:

Any way we can monitor the Table object for each sender through probe. 
I am facing an issue where gust of messages are sent through jgroups
filling up the Table eventually and running out of memory


Best,
Pooja
------------------------------------------------------------------------------
_______________________________________________
javagroups-users mailing list
javagroups-users <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/javagroups-users
Picon
Picon

[jgroups-users] Memory consumption of org.jgroups.protocols.Discovery

Hello,

I recently looked at a heap dump and noticed that the field 
"ping_responses" uses a lot of memory.
My dump shows that it uses around 52 MB because the map contains about 
10000 entries. It seems that all of these org.jgroups.util.Responses 
entries contain 24 org.jgroups.protocols.PingData entries.

As far as I can see in the code[1], the only method that will remove 
entries from the map is addResponse and that is only called from the up 
method. This is especially strange because the code suggests that the 
method will remove an entry when the o.j.u.Responses object has the done 
flag set to true. Interestingly, my heap dump shows that all 
o.j.u.Responses objects have the done flag set to true, so I don't 
really understand why they are still in the map.

Can anyone help me with that? I just had my cluster up for about 3 days, 
if I don't restart it periodically, I will get out of memory errors 
sooner or later.

I am working with JGroups 3.6.4.Final within Wildfly 9.0.1.Final and the 
S3_PING protocol.

[1]

https://github.com/belaban/JGroups/blob/master/src/org/jgroups/protocols/Discovery.java#L519 

------------------------------------------------------------------------------
Picon
Picon

[jgroups-users] MessageDispatcher::sendMessageWithFuture with RequestOptions

Hi JGroups users!
I'm new to JGroups and it looks really interesting so I'm planning to use it on a personal project.

Playing with it I noticed one oddity that I would like to share in the hopes of helping to improve the framework.
In JGroups 3.6.6.Final:
In MessageDispatcher::sendMessageWithFuture there are some validations to check the case of RequestOptions options being null. However, if one calls that method with a null RequestOptions argument, the execution ends in failure (with a NPE in the resulting future) [1].
So, my point is, either the validations are unnecessary and should exists a preconditions check at the beginning of the method, or it should set a (documented) default RequestOptions so the sending can be completed.

What do you think? Should I fill an improvement request in JIRA (couldn't find one related to this)?

Kind regards,
Matías

[1] the source of the NPE is UnicastRequest::sendRequest when trying to access the RequestOptions's getMode method.
------------------------------------------------------------------------------
_______________________________________________
javagroups-users mailing list
javagroups-users <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/javagroups-users
Picon
Picon

[jgroups-users] Java Zero Day Serialisation Issue

Hi,

in Light of the recently published Java Zero Day Issue related to 
serialisation
(see http://de.slideshare.net/frohoff1/appseccali-2015-marshalling-pickles)
and having commons-collections in the classpath I wonder how JGroups is 
doing the (de)serialisation.

The multicast and unicast related methods (especially class 
org.jgroups.blocks.MethodCall) seem
to be able to take any object as parameter.

Is there some way on server side to prevent the serialisation of 
'unexpected' objects?
Can this be configured or is there some filter that can be set before 
the actual deserialisation is happening?

For example this article describes some possible way to prevent this:
http://www.ibm.com/developerworks/library/se-lookahead/

Best Regards,
Simon Kulessa

------------------------------------------------------------------------------
Picon
Picon

[jgroups-users] Add dependency to JGroups

Hi folks,

I am trying to add dependency (oshi) to JGroups but I could not. I run ant
command on Lunix machine to compile the code, not Maven. 

Simply how to add dependency or external library to JGroups when I use ant
command to compile the code?

Thank you

Ibrahim

--
View this message in context: http://jgroups.1086181.n5.nabble.com/Add-dependency-to-JGroups-tp10801.html
Sent from the JGroups - General mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Presto, an open source distributed SQL query engine for big data, initially
developed by Facebook, enables you to easily query your data on Hadoop in a 
more interactive manner. Teradata is also now providing full enterprise
support for Presto. Download a free open source copy now.
http://pubads.g.doubleclick.net/gampad/clk?id=250295911&iu=/4140
Picon
Picon

[jgroups-users] JGroups AUTH

From the documentation at https://developer.jboss.org/wiki/JGroupsAUTH it's clear that enabling auth can prevent a malicious node from joining a group. However, would a malicious node not still be able to send and receive message?

I'm not to concerned with malicious nodes being able to read messages, but I need to prevent unauthenticated nodes from sending messages. Is auth sufficient for that or would I also need to enable encryption?
------------------------------------------------------------------------------
_______________________________________________
javagroups-users mailing list
javagroups-users <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/javagroups-users
Picon
Picon

[jgroups-users] Test DMARC

Hope this email is not classified as spam...
--

-- 
Bela Ban, JGroups lead (http://www.jgroups.org)

------------------------------------------------------------------------------
Bela Ban | 31 Oct 18:02 2015
Picon
Gravatar

[jgroups-users] JUG Berlin on JBoss middleware

Apologoies in advance for the wide distribution...

There's a talk at the JUG Berlin Nov 19 about JBoss middleware (JGroups, 
Infinispan, Wildfly clustering) and free food plus beverages after the talk.

A lot of JBoss middleware devs will be there for the purpose of mingling 
after the talks and drinking beer... :-)

I'd be happy to see many people there !

[1] http://www.jug-berlin-brandenburg.de/blog/2015/jgroups.html

--

-- 
Bela Ban, JGroups lead (http://www.jgroups.org)

------------------------------------------------------------------------------

Gmane