Gray Watson | 30 Jan 2013 15:46
Picon

[jgroups-users] fund raising for a jgroups EC2 test cluster

On a different note, I'd like to start a discussion about doing some fundraising for jgroups to get Bela (et
al) an Amazon EC2 account that he can play with.  With EC2 you can boot 50 servers and watch mass starts.  The
capabilities of this sort of configuration to debug Jgroups issues and test Jgroups performance would
seem to be to be quite valuable.

I'm pretty sure I can talk my boss into US$500 or $1k to get the ball rolling.  Anyone else interesting in
chipping in?  I have a good bit of experience with building EC2 images and instances and I'd be happy to help
engineer a system which would download and boot software from S3 automagically on boot, etc., etc..

I guess a question that has to be answer first however is if the jgroups development team could use this?
gray

------------------------------------------------------------------------------
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_jan
Bela Ban | 30 Jan 2013 15:23
Picon
Favicon
Gravatar

[jgroups-users] Message batching in JGroups

FYI,

a heads up on message batching:
http://belaban.blogspot.ch/2013/01/buy-one-get-many-for-free-message.html

--

-- 
Bela Ban, JGroups lead (http://www.jgroups.org)

------------------------------------------------------------------------------
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_jan
Christian T Trimble | 29 Jan 2013 14:33
Gravatar

[jgroups-users] JGroups AWS Discovery 1.3 release

Hello JGroups Users,

  The JGroups AWS Discovery project recently released version 1.3 of the AWS_PING protocol.  This release adds support for custom AWSCredentialsProvider instances (thanks to Aldrin Leal.)  You can find the artifact on Maven Central and the source code on GitHub.

- Christian Trimble

------------------------------------------------------------------------------
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnnow-d2d
_______________________________________________
javagroups-users mailing list
javagroups-users <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/javagroups-users
Gray Watson | 28 Jan 2013 19:24
Picon

[jgroups-users] problems with UNICAST2?

Hey folks:

I'm seeing missing messages in my receiver running Jgroups 3.1.0 with the following stack:

	http://pastebin.com/J32S05xz

Our logs show:

	...
	i-6adc031a: got message from i-9ead71ee: shopping:PUT_MANY, 50 keyValues
	i-6adc031a: sending message to i-9ead71ee: shopping:PUT_MANY_ACK, value=1150
	i-9ead71ee: got message from i-6adc031a: shopping:PUT_MANY_ACK, value=1150
	i-9ead71ee: sending message to i-6adc031a: shopping:PUT_MANY, 50 keyValues
	but no message received on i-6adc031a

After looking through my code carefully and making sure I'm logging everything, I decide to wander through
UNICAST2.  I quickly see that the Table.getNumMissing() code is not synchronized:

	public int getNumMissing() {
		return (int)(hr-hd-size);
	}

There is no locking around the hr/hd/size longs and it seems like if those were out of sync, UNICAST2 would
not function.  Here's the code from the RetransmitTask:

	if(buf != null && buf.getNumMissing() > 0) { 

Seems like this is a bug.  Has this been addressed in 3.2.X?  In looking at the change notes I don't see anything
about UNICAST2.  Makes me wonder if anyone is using Jgroups and UDP for any point-to-point large scale
unicast transmission.  Maybe my problem is that another message has not come from the same host.  If the next
sequence number were sent maybe retransmit task would fire again.

Also, I see a number of places where:

     <at> GuardedBy("lock")
    public void forEach(long from, long to, Visitor<T> visitor) {

But the caller doesn't hold the lock.  In this case Table.forEach(...) called from
NACKACK2.sizeOfAllMessages(...).  Maybe an audit of these annotations needs to be made?  Should there
_really_ be any public methods with  <at> GuardedBy enabled give that lock is protected?

thanks,
gray

------------------------------------------------------------------------------
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnnow-d2d
Scott Lewis | 24 Jan 2013 23:16
Gravatar

[jgroups-users] transition from 2.X to 3.X info?

Hello,

I've got some code that's based upon JGroups 2.X  (2.5.0 specifically).  
I would like to update to latest...3.2.6...assuming that's recommended.

I see that the API has changed in some apparently significant ways from 
2.X to 3.X (e.g. JChannelFactory class gone, some exception types gone, 
etc), and am wondering if there are any docs that describe these 
differences and how best to resolve them (i.e. getting same 
functionality out of 3.2.6).  Any pointers to such docs?

Thanksinadvance,

Scott

------------------------------------------------------------------------------
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnnow-d2d
Gonçalo Amador | 17 Jan 2013 02:38
Picon

[jgroups-users] JGroups

Salutations

I'm a first year PhD Student working with MMOGs.
I require to have multicast groups per game area/zone/partition.
However it is unclear to me how can I detect two users joining a 
multicast group that is visible in distinct lans (one user in each).
Any help or suggestion?

Best regards!

--

-- 
“Since light travels faster than sound, people appear bright until you hear them speak.”
“If you can't convince them, confuse them.”
“If at first you don't succeed, destroy all evidence that you tried!”
“Romance is thinking about your significant other, when you are supposed to be thinking about something else.”

------------------------------------------------------------------------------
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122712
William Burns | 10 Jan 2013 15:30
Picon

Re: [jgroups-users] FW: Failover for ExecutionService / "Cluster wide task execution" ?


From: matthias.gaertner <at> gtnexus.com [matthias.gaertner <at> gtnexus.com]
Sent: Thursday, January 10, 2013 7:51 AM
To: javagroups-users <at> lists.sourceforge.net
Subject: [jgroups-users] Failover for ExecutionService / "Cluster wide task     execution" ?

Hello,

is there a best practice to enable "Failover" for the JGroups "Cluster wide task execution" building block?

  http://www.jgroups.org/manual-3.x/html/user-building-blocks.html#ExecutionService


I see the round-robin selection among the registered "worker nodes" working all right.
"Worker nodes" are those that have some ExecutionRunner run by some worker thread on the channel.
So, some "client" node attaches to the channel, sends a "Job" via ExecutionService, and *one* of the worker nodes processes it. Works great.


Now let's assume the selected worker has some local issue while executing the request there throws some Exception. This would not be network-related. As a contrived example, consider local disk space. The Job may require more disk space than is availble on the selected worker, and hence would fail on some, but probably not all of the worker nodes.

Today, I see that this exception escapes the "exec_service.submit(new MyCallable()).get()" call that fetches the result from the cluster (see sample code in above link).  
I don't quite understand what you mean by escapes.  Any exception thrown by the submitted callable will be sent back to the person who submitted it.  Thus the client could retry this for a different node if desired.  The problem is if this is the only node you will just get the error over and over.
Q: Is there a way to make the ExecutionService _fail over transparently_ to some of the other worker nodes?

The service will automatically fail over to another node if the node that is currently running the submitted callable is detected to have gone down via your failure detection protocol.  Also to note that if the node that submits the task goes down and the running node then it will not be resubmitted.  If the submitting node goes down the running node will still run the task to completion. 

Thanks in advance for your input,
Matthias


P.S. I am thinking about a ResponseFilter, but I am not sure how to attach that to that to the ExecutionService. That seems to be related to Rpc (only?)
        http://www.jgroups.org/manual-3.x/html/user-building-blocks.html#RspFilter
As far as I am aware a response filter will not work with this protocol.  This is more for returning early if a certain number of responses meet a certain criteria instead of blocking for all.  Bela could explain better though. 




------------------------------------------------------------------------------
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122712
_______________________________________________
javagroups-users mailing list
javagroups-users <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/javagroups-users


------------------------------------------------------------------------------
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122712
_______________________________________________
javagroups-users mailing list
javagroups-users <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/javagroups-users
Favicon

[jgroups-users] Failover for ExecutionService / "Cluster wide task execution" ?

Hello,

is there a best practice to enable "Failover" for the JGroups "Cluster wide task execution" building block?

  http://www.jgroups.org/manual-3.x/html/user-building-blocks.html#ExecutionService

I see the round-robin selection among the registered "worker nodes" working all right.
"Worker nodes" are those that have some ExecutionRunner run by some worker thread on the channel.
So, some "client" node attaches to the channel, sends a "Job" via ExecutionService, and *one* of the worker
nodes processes it. Works great.

Now let's assume the selected worker has some local issue while executing the request there throws some
Exception. This would not be network-related. As a contrived example, consider local disk space. The Job
may require more disk space than is availble on the selected worker, and hence would fail on some, but
probably not all of the worker nodes.

Today, I see that this exception escapes the "exec_service.submit(new MyCallable()).get()" call that
fetches the result from the cluster (see sample code in above link). 

Q: Is there a way to make the ExecutionService _fail over transparently_ to some of the other worker nodes?

Thanks in advance for your input,
Matthias

P.S. I am thinking about a ResponseFilter, but I am not sure how to attach that to that to the
ExecutionService. That seems to be related to Rpc (only?)
	http://www.jgroups.org/manual-3.x/html/user-building-blocks.html#RspFilter

------------------------------------------------------------------------------
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122712
Favicon

[jgroups-users] Unexpected UUID in View - how to get details such as address/port?

Hello,

I have made some effort to properly _name_ each channel in our clusters, which runs on multiple machines
with multiple JVMs.
	channel.setName(name) // Submitter-XYZ or SERVERXYZ-INSTANCE
	channel.connect(...)

Now, a dump of the "view" still shows a UUID occasionally.

	Worker View: [Submitter-ABC|5] [Submitter-ABC, b4a6db89-a4c9-c988-ffb8-9b620bcf7c84,
SERVERXYZ-01, Submitter-DEF] [...]

What API do I need to use to find out just where this "b4a6db89-a4c9-c988-ffb8-9b620bcf7c84" comes from,
i.e. to find out IP address/port?

Thanks,
Matthias

------------------------------------------------------------------------------
Master Java SE, Java EE, Eclipse, Spring, Hibernate, JavaScript, jQuery
and much more. Keep your Java skills current with LearnJavaNow -
200+ hours of step-by-step video tutorials by Java experts.
SALE $49.99 this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122612 
Sapan Vashishth | 7 Jan 2013 11:25
Picon

[jgroups-users] Using Unicast as communication between members of jgroups cluster

Hi,


I am new to Jgroups and would like to know about using unicast for the cluster members.

As I know is that the members of the cluster use broadcast / multicast to find the available members to the cluster.
(I might be totally wrong at this :)

Can this be reduced to using unicast for finding the cluster members.

Like we configure every member to know its peer members and instead of broadcasting it just unicast to the peers to find the cluster membership.



Thanks in advance
Sapan


------------------------------------------------------------------------------
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. SALE $99.99 this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122412
_______________________________________________
javagroups-users mailing list
javagroups-users <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/javagroups-users
Kresimir Simatovic | 3 Jan 2013 10:30
Picon

[jgroups-users] Big messages and memory management


Hi!

I have one question regarding internal memory management inside jgroups. If
big messages (i.e. 1MB in fragments of 64kb) are frequently sent does
jgroups allocates and releases 1MB memory when each message is assembled or
uses some memory pool for these operations ?

I'm concerned about memory fragmentation problems - i.e. when application
runs for 30 or more days memory gets fragmented and it is could be pretty
expensive operation to allocate 1MB on heap (usually triggers major garbage
collections).

Tnx!
--

-- 
View this message in context: http://old.nabble.com/Big-messages-and-memory-management-tp34854381p34854381.html
Sent from the JGroups - General mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122712

Gmane