headers
Scott Eade | 1 Jan 2003 13:30
Picon
Favicon

Re: Problem reading large jtl file

Mike,

It is an Aggregate Reporter that I am using.

I eventually noticed a couple of OutOfMemoryExceptions sitting in the
console window used to start JMeter.  After upping mx to 256m, then 300m and
then finally to 512m it was eventually able to load all 57MB of jtl data.
Windows task manager shows 350MB of memory in use and that almost 15 minutes
of CPU time were used to load the file (on a paltry by today's standards
dual Celeron 500 machine).

I'll take a stab in the dark and suggest that the jtl file is being read
using a dom style parser (reads the entire tree into memory before dishing
the data out) rather than a sax parser (which can dish the data out and
dispose of it as it reads the file).  I'll add a note to check this to my
steadily growing list of JMeter bugs and enhancements.

Thanks,

Scott
--

-- 
Scott Eade
Backstage Technologies Pty. Ltd.
http://www.backstagetech.com.au
.Mac Chat/AIM: seade at mac dot com

On 31/12/2002 12:53 AM, "Mike Stover" <mstover1 <at> apache.org> wrote:

> Which visualizer are you trying to open it with?  I would suggest trying the
> aggregate reporter since it uses the least memory (avoid the tree results
(Continue reading)

Permalink | Reply | 0 comments |
headers
Scott Eade | 1 Jan 2003 14:00
Picon
Favicon

Re: Is JMeter using too much memory?

On 31/12/2002 9:49 AM, "Jordi Salvat i Alabart" <jsalvata <at> atg.com> wrote:
> 1.4 JDKs have a pretty serious performance bug in the URL.encode method.
> You'll run much MUCH faster if you use JDK 1.3 or you don't encode your
> parameters, etc.

Why don't we switch to an encoder that does not suffer from this problem -
presumably the commons httpclient will include such a method somewhere (but
undoubtedly others exist).

I guess as a more general question, are the JMeter developers considering
using any of the APIs offered by commons?  It seems that httpclient would be
an obvious one to consider.  A discussion on the jmeter-dev list leads me to
think that jorphan was/is Mike's own personal set of common routines that
might be better sourced from commons (where they exist, with perhaps some
new APIs defined if there are some that are missing).  Just a thought.

Cheers,

Scott
--

-- 
Scott Eade
Backstage Technologies Pty. Ltd.
http://www.backstagetech.com.au
.Mac Chat/AIM: seade at mac dot com
Permalink | Reply | 0 comments |
headers
Mike Stover | 1 Jan 2003 15:03
Picon
Favicon

Re: Problem reading large jtl file

JMeter uses Avalon's Configuration code to save jtl's, and yes it is dom-style.  The 
solution is that the jtl files need to be in a format other than xml - it's just not well 
suited.  CSV files would be better.

-Mike

On 1 Jan 2003 at 23:30, Scott Eade wrote:

> Mike,
> 
> It is an Aggregate Reporter that I am using.
> 
> I eventually noticed a couple of OutOfMemoryExceptions sitting in the
> console window used to start JMeter.  After upping mx to 256m, then 300m and
> then finally to 512m it was eventually able to load all 57MB of jtl data.
> Windows task manager shows 350MB of memory in use and that almost 15 minutes
> of CPU time were used to load the file (on a paltry by today's standards
> dual Celeron 500 machine).
> 
> I'll take a stab in the dark and suggest that the jtl file is being read
> using a dom style parser (reads the entire tree into memory before dishing
> the data out) rather than a sax parser (which can dish the data out and
> dispose of it as it reads the file).  I'll add a note to check this to my
> steadily growing list of JMeter bugs and enhancements.
> 
> Thanks,
> 
> Scott
> -- 
> Scott Eade
(Continue reading)

Permalink | Reply | 0 comments |
headers
russo | 1 Jan 2003 20:10
Favicon

RE: Remote JMeter

To Mike, Steve, Barry:

Hi Mike:
> As far as problems with remote testing, all I can say is that, on
> Windows2000, jdk1.4.0, it works for me.  I won't deny that the classpath
> issues can be tricky, however.
  Using JMeter 1.8?  Would you mind sending your classpath and any related
environment variables you have set? Maybe this will help Steve as well?
Maybe I have conflict with other java paths already defined not
related to JMeter. Just don't know java well enough to debug this on my
own.

Hi Steve: Thanks for the sympathy. ;) Other team members here are in
dialog with Mercury Interactive if you can afford to go the
consulting route. They're _very_ expensive (at least when you
have no money). Estimate cost so far 50-70K:
http://www.mercuryinteractive.com/ but, I believe they're doing much more
than load testing.

Hi Barry:
> I have gotten JMeter working remotely.  I run the GUI on a RedHat 8 box,
> andhave 5 Windows 2000 boxes running as slaves.  Getting the CLASSPATH
> was a little tricky, and I put a "pause" in the .bat file...
Using JMeter 1.8 and jre 1.4.0 ? Please confirm since there seems
to be 3 big variances here, outside of classpath, which _could_ be
causing the problem (OS,JMeter, and JRE versions).
I did just try following the instructions first. Simply adding the 3
stated items to my classpath did not work. Did notice the missing .jar
extension on logkit. Had a pause in my script as well. ;)
(Continue reading)

Permalink | Reply | 4 comments |
headers
Mike Stover | 1 Jan 2003 20:24
Picon
Favicon

RE: Remote JMeter

Yes, using 1.8.  I don't know what all this talk of a pause in the script is about.  I 
start rmiregistry on one command line, and then go start jmeter in a different one.  
I never use system-wide classpaths, as that's a recipe for hard-to-debug problems.  
instead, I define a more local classpath in the command line for rmiregistry, and 
then start rmiregistry.  Admittedly, windows doesn't localize such things as well as 
L/Unix, but, that's how I do it since I'm more used to Unix in that regard.

So, anyway, I just tried it again, and it worked perfectly my first try.  For 
rmiregistry, I opened a windows command prompt, set the CLASSPATH to the full 
paths to jorphan.jar, logkitxxx.jar, and ApacheJMeter_core.jar.  Then I started 
rmiregistry.

Then, I opened a new command prompt, and changed directory to jmeter's bin dir, 
and started the server via "jmeter -s".

then, I verified that my jmeter properties file included the "remote_hosts" line 
uncommented (it did, with ip of 127.0.0.1 - I have only one computer, but that 
shouldn't matter, it's still using RMI to communicate).

Then, I started the JMeter gui, made a simple script,and ran it through the remote 
ip.  No problems.

I am running Windows2000, jdk1.4.0, and latest JMeter code from CVS, which is 
not different from 1.8 in this area.

-Mike

On 1 Jan 2003 at 14:10, russo <at> albany.edu wrote:

> To Mike, Steve, Barry:
(Continue reading)

Permalink | Reply | 3 comments |
headers
Scott Eade | 1 Jan 2003 22:21
Picon
Favicon

Re: Remote JMeter

I have also had this working in the last couple of weeks - Win2k client and
Mac OS X server.  One important step was to disable the firewall on the Mac
so that rmi could make it's connections.  Other than this it worked fine for
me (a way of configuring the port that will be used is on my list of
potential enhancement requests).

Not sure about the out of memory references that are included in this thread
- I assume you are allocating more of the available memory to the JVM used
to tun JMeter by altering the java mx parameter on startup?

Scott
--

-- 
Scott Eade
Backstage Technologies Pty. Ltd.
http://www.backstagetech.com.au
.Mac Chat/AIM: seade at mac dot com

On 2/01/2003 6:24 AM, "Mike Stover" <mstover1 <at> apache.org> wrote:

> Yes, using 1.8.  I don't know what all this talk of a pause in the script is
> about.  I start rmiregistry on one command line, and then go start jmeter in a
> different one.  I never use system-wide classpaths, as that's a recipe for
> hard-to-debug problems.  instead, I define a more local classpath in the
> command line for rmiregistry, and then start rmiregistry.  Admittedly, windows
> doesn't localize such things as well as L/Unix, but, that's how I do it since
> I'm more used to Unix in that regard.
> 
> So, anyway, I just tried it again, and it worked perfectly my first try.  For
> rmiregistry, I opened a windows command prompt, set the CLASSPATH to the full
> paths to jorphan.jar, logkitxxx.jar, and ApacheJMeter_core.jar.  Then I
(Continue reading)

Permalink | Reply | 1 comment |
headers
Barry Roberts | 2 Jan 2003 06:50

RE: Remote JMeter


Sorry I wasn't clear on that.  I e-mailed out a batch file to several people whose machines I wanted to use as
remote slaves after hours.  The batch file  set the classpath, started rmiregistry, then paused and waited
for key before starting jmeter-server (or jmeter -s).  Without the pause it didn't seem to work every time. 
I would imagine the .bat file is quite a bit quicker than typing the commands by hand.

Barry Roberts

-----Original Message-----
From:	Mike Stover [mailto:mstover1 <at> apache.org]
Sent:	Wed 1/1/2003 12:24 PM
To:	JMeter Users List
Cc:	
Subject:	RE: Remote JMeter
Yes, using 1.8.  I don't know what all this talk of a pause in the script is about.  I 
start rmiregistry on one command line, and then go start jmeter in a different one.  
I never use system-wide classpaths, as that's a recipe for hard-to-debug problems.  
instead, I define a more local classpath in the command line for rmiregistry, and 
then start rmiregistry.  Admittedly, windows doesn't localize such things as well as 
L/Unix, but, that's how I do it since I'm more used to Unix in that regard.

So, anyway, I just tried it again, and it worked perfectly my first try.  For 
rmiregistry, I opened a windows command prompt, set the CLASSPATH to the full 
paths to jorphan.jar, logkitxxx.jar, and ApacheJMeter_core.jar.  Then I started 
rmiregistry.

Then, I opened a new command prompt, and changed directory to jmeter's bin dir, 
and started the server via "jmeter -s".

then, I verified that my jmeter properties file included the "remote_hosts" line
(Continue reading)

Permalink | Reply | 0 comments |
headers
Lawrence, Steve | 2 Jan 2003 15:54
Picon
Favicon

RE: Remote JMeter

> As far as problems with remote testing, all I can say is that, on
> Windows2000, jdk1.4.0, it works for me.  

This hit me, just this morning... 

jdk1.4.0?

Now... When I first installed Jmeter on this windows machine, it had a jre
on it by default. A corporate standard jre. Jmeter didn't work with it. I
upgraded to Sun's JRE 1.4.1 - and it worked fine.

The Linux box(s) also got Sun's JRE on them. Also 1.4.1, downloaded from :
http://java.sun.com/j2se/1.4.1/download.html

Now.. forgive me... jre, j2se, jdk, sdk? Which am I s'posed to be using? Is
SDK the same as JDK?
I figure I know the answer to this question - JRE = runtime, JDK=
development kit, which includes the runtime components, yes? 

Is it *compulsory* to have the JDK (what sun calls the SDK?) to make this
work? Because Jmeter in ordinary mode works fine with the JRE. If so.. what
is it that I'm getting from the SDK that I'm not from the JDE?

Steve.

------------------------------------------------------------------------------
Notice: This e-mail message, together with any attachments, contains information of Merck & Co., Inc.
(Whitehouse Station, New Jersey, USA) that may be confidential, proprietary copyrighted and/or
legally privileged, and is intended solely for the use of the individual or entity named on this message. 
If you are not the intended recipient, and have received this message in error, please immediately return
(Continue reading)

Permalink | Reply | 3 comments |
headers
Jordi Salvat i Alabart | 2 Jan 2003 16:06

Re: Remote JMeter

Hi Lawrence.

Responses inline.

Lawrence, Steve wrote:
> Now.. forgive me... jre, j2se, jdk, sdk? Which am I s'posed to be using?

Any should will do.

 > Is SDK the same as JDK?

Yer. It's just the marketing guys confusing everyone else.

> I figure I know the answer to this question - JRE = runtime, JDK=
> development kit, which includes the runtime components, yes? 

Yes.

> Is it *compulsory* to have the JDK (what sun calls the SDK?) to make this
> work? Because Jmeter in ordinary mode works fine with the JRE. If so.. what
> is it that I'm getting from the SDK that I'm not from the JDE?

You should be fine with the JRE. If you aren't it's a bug, and needs to 
be fixed.

Salut,

Jordi.
Permalink | Reply | 0 comments |
headers
Mike Stover | 2 Jan 2003 16:00
Picon
Favicon

RE: Remote JMeter

Forgive me,  I always just say JDK when JRE/SDK would also be accurate.  You 
don't need the JDK unless you're doing some development or building a JMeter 
tarball (ie non-binary download).  The JRE will do fine if you just want to run 
JMeter.

But, JMeter 1.8 requires Java 1.4 (JRE/JDK/SDK), and 1.3 will cause some 
problems.

-Mike

On 2 Jan 2003 at 9:54, Lawrence, Steve wrote:

> > As far as problems with remote testing, all I can say is that, on
> > Windows2000, jdk1.4.0, it works for me.  
> 
> This hit me, just this morning... 
> 
> jdk1.4.0?
> 
> Now... When I first installed Jmeter on this windows machine, it had a jre
> on it by default. A corporate standard jre. Jmeter didn't work with it. I
> upgraded to Sun's JRE 1.4.1 - and it worked fine.
> 
> The Linux box(s) also got Sun's JRE on them. Also 1.4.1, downloaded from :
> http://java.sun.com/j2se/1.4.1/download.html
> 
> Now.. forgive me... jre, j2se, jdk, sdk? Which am I s'posed to be using? Is
> SDK the same as JDK?
> I figure I know the answer to this question - JRE = runtime, JDK=
> development kit, which includes the runtime components, yes?
(Continue reading)

Permalink | Reply | 0 comments |

Gmane