mailing list for the eXist opensource XML database

Raja | 1 Oct 2011 12:49

exist-db load balancing process -reg

Hi Exist community members !!!!

We have developed an XRX application with eXist-db . the application almost complete in shape, Now we need to do the load testing .
How to do that in eXist-db . Specifically for xquery kind of apps - entirely written in XRX model . That means at a time 100 or 1000 users access the same page then the entire apps get-down or some time exist-db get crashed.

We are using exist-db -1.4.1 rev15155 version
Ubuntu 10.4 (both 32 and 64 bit systems) with same configuration
increased JVM to 4GB to avoid heap size error.

Pls suggest your comments to get success in this pbm.

By

--

Rajamani Marimuthu
Junior Research Fellow-JRF
NIC -Open Technology Centre
Rajaji Bhavan
Besant Nagar,
Chennai - 90
Cell : 9677192096

------------------------------------------------------------------------------
All of the data generated in your IT infrastructure is seriously valuable.
Why? It contains a definitive record of application performance, security
threats, fraudulent activity, and more. Splunk takes this data and makes
sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-d2dcopy2

_______________________________________________
Exist-open mailing list
Exist-open <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/exist-open

headers

Dannes Wessels | 1 Oct 2011 13:54

Re: Resolving of external URIs from XSLT broken?

Hi

On Fri, Sep 30, 2011 at 10:25 PM, Christian Mahnke <cmahnke <at> googlemail.com> wrote:

This works for me in Xalan and Saxon from Oxygen, xsltproc and various other ways (like the Ant XSLT task), only in eXist this is seem to be seriously broken.

In exist.log I get:
Resolving database path http://viaf.org/processed/DNB|11855073X with base null to /db/archaeo18/transformations/http:/viaf.org/processed/DNB|11855073X (URI = xmldb:/db/archaeo18/transformations/http:/viaf.org/processed/DNB|11855073X)

It's hard to believe that this is a bug, since it's quite obvious to use the document function to access REST based web services from XSLT, what do I need to enable to get this to work?

Which version of eXist-db are you using?

D.

--
eXist-db Native XML Database - http://exist-db.org
Join us on linked-in: http://www.linkedin.com/groups?gid=35624

------------------------------------------------------------------------------
All of the data generated in your IT infrastructure is seriously valuable.
Why? It contains a definitive record of application performance, security
threats, fraudulent activity, and more. Splunk takes this data and makes
sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-d2dcopy2

_______________________________________________
Exist-open mailing list
Exist-open <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/exist-open

headers

Dannes Wessels | 1 Oct 2011 14:04

Re: exist-db load balancing process -reg

Raja

On Sat, Oct 1, 2011 at 12:49 PM, Raja <m.rajamani <at> nic.in> wrote:

then the entire apps get-down or some time exist-db get crashed.

....

Pls suggest your comments to get success in this pbm.

Unfortunately we do not have this supernatural talent to understand about the problems you see, without you providing any information other than "I have a problem, help me'.

Please, if you write to this mailing list, take your time for writing, and provide (useful) information that helps analyzing the problems you see. Think of logging, and stacktraces. We are all volunteers on this list, so please help us helping you in an time efficient way.

Thnx

Dannes

--
eXist-db Native XML Database - http://exist-db.org
Join us on linked-in: http://www.linkedin.com/groups?gid=35624

------------------------------------------------------------------------------
All of the data generated in your IT infrastructure is seriously valuable.
Why? It contains a definitive record of application performance, security
threats, fraudulent activity, and more. Splunk takes this data and makes
sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-d2dcopy2

_______________________________________________
Exist-open mailing list
Exist-open <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/exist-open

headers

Raja | 1 Oct 2011 14:20

Re: exist-db load balancing process -reg

Hi Dannes !!!!

Sorry for the incomplete information ... the exact problem is ,

we created an application - XRX style. all application code and data files located inside the /db in eXist-db (v1.4.1rev15155). we using JMeter to check the load balancing (no of parallel hit in the application page) . upto 10 parallel thread the application responding well if u increase the number of hit then the responses are fail. pls suggest how solve this pbm. is there any configuration file to change this options ...

By
Raja M

On 10/01/11, Dannes Wessels <dannes <at> exist-db.org> wrote:

Raja

On Sat, Oct 1, 2011 at 12:49 PM, Raja <m.rajamani <at> nic.in> wrote:
then the entire apps get-down or some time exist-db get crashed.

....

Pls suggest your comments to get success in this pbm.

Unfortunately we do not have this supernatural talent to understand about the problems you see, without you providing any information other than "I have a problem, help me'.

Please, if you write to this mailing list, take your time for writing, and provide (useful) information that helps analyzing the problems you see. Think of logging, and stacktraces. We are all volunteers on this list, so please help us helping you in an time efficient way.

Thnx

Dannes

--
eXist-db Native XML Database - http://exist-db.org
Join us on linked-in: http://www.linkedin.com/groups?gid=35624

--

Rajamani Marimuthu
Junior Research Fellow-JRF
NIC -Open Technology Centre
Rajaji Bhavan
Besant Nagar,
Chennai - 90
Cell : 9677192096

------------------------------------------------------------------------------
All of the data generated in your IT infrastructure is seriously valuable.
Why? It contains a definitive record of application performance, security
threats, fraudulent activity, and more. Splunk takes this data and makes
sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-d2dcopy2

_______________________________________________
Exist-open mailing list
Exist-open <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/exist-open

headers

Dannes Wessels | 1 Oct 2011 14:24

Re: exist-db load balancing process -reg

Raja

On Saturday, 1 October 2011 at 14:20 , Raja wrote:

upto 10 parallel thread the application responding well if u increase the number of hit then the responses are fail.

responses fail….. WHAT does this mean, what does actually happen? what do you see in the HTTP response, is there something in the server log visible, in the server std out….etc. That is what I asked for in the previous mail…..

cheers

Dannes

--

eXist-db Native XML Database - http://exist-db.org

Join us on linked-in: http://www.linkedin.com/groups?gid=35624

------------------------------------------------------------------------------
All of the data generated in your IT infrastructure is seriously valuable.
Why? It contains a definitive record of application performance, security
threats, fraudulent activity, and more. Splunk takes this data and makes
sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-d2dcopy2

_______________________________________________
Exist-open mailing list
Exist-open <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/exist-open

headers

Ubbo Veentjer | 1 Oct 2011 14:03

Fwd: Re: exist-db load balancing process -reg

missed the "reply to list" button

-------- Original Message -------- Subject: Date: From: To:

Re: [Exist-open] exist-db load balancing process -reg

Sat, 01 Oct 2011 13:13:50 +0200

Ubbo Veentjer <veentjer <at> sub.uni-goettingen.de>

Raja <m.rajamani <at> nic.in>

Hi,

if I understood you correctly and you are asking how to do stress testing I would suggest JMeter: http://jakarta.apache.org/jmeter/ . It could be configured to do HTTP requests, and you could define how much parallel threads (or clients) are supposed to produce load.

If you are asking for load balancing I would also be curious about solutions ;-)

.

Cheers,
Ubbo

On 01.10.2011 12:49, Raja wrote:

Hi Exist community members !!!!

We have developed an XRX application with eXist-db . the application almost complete in shape, Now we need to do the load testing .
How to do that in eXist-db . Specifically for xquery kind of apps - entirely written in XRX model . That means at a time 100 or 1000 users access the same page then the entire apps get-down or some time exist-db get crashed.

We are using exist-db -1.4.1 rev15155 version
Ubuntu 10.4 (both 32 and 64 bit systems) with same configuration
increased JVM to 4GB to avoid heap size error.

Pls suggest your comments to get success in this pbm.

By

--
Rajamani Marimuthu
Junior Research Fellow-JRF
NIC -Open Technology Centre
Rajaji Bhavan
Besant Nagar,
Chennai - 90
Cell : 9677192096
------------------------------------------------------------------------------ All of the data generated in your IT infrastructure is seriously valuable. Why? It contains a definitive record of application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-d2dcopy2 _______________________________________________ Exist-open mailing list Exist-open <at> lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/exist-open

-- Ubbo Veentjer Research and Development Department (RDD) Goettingen State and University Library Georg-August-Universitaet Goettingen 37073 Goettingen Germany Phone: +49 551 39 7700 Fax: +49 551 39 3856 veentjer <at> sub.uni-goettingen.de http://www.sub.uni-goettingen.de/

------------------------------------------------------------------------------
All of the data generated in your IT infrastructure is seriously valuable.
Why? It contains a definitive record of application performance, security
threats, fraudulent activity, and more. Splunk takes this data and makes
sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-d2dcopy2

_______________________________________________
Exist-open mailing list
Exist-open <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/exist-open

headers

vicmortelmans | 1 Oct 2011 15:01

Re: Admin password reset when restarting database

OK,

so it looks like I was confused by the svn-download build option, assuming that it would update svn, which it (probably?) doesn't.

So after an explicit "svn update" and a "build.sh rebuild", I now have running this version:

Version: 1.5.0dev
SVN Revision: 15423
Build: 20111001
User: admin

And the admin password problem is solved!

Best regards,

Vic

2011/9/29 Joe Wicentowski [via eXist] <[hidden email]>

Hi Vic and Dannes,

>> Note that after the rebuild I had to restore my data, I guess that's normal?
>
> no, only after a build.sh clean ... which is maybe called by build.sh
> rebuild, not sure....

It does. The "rebuild" target calls (1) "clean" and then (2) "all"
(the default build target, which includes a "prepare" target that in
turn calls "svn-prepare" from build/subversion.xml, which is what
updates VERSION.txt).

Perhaps I should have suggested "./build.sh svn-prepare", to save Vic
the task of restoring your data - sorry, Vic.

But in general the cycle for building from trunk is:

1. First time, checkout the repo and "./build.sh svn-download", then
"./build.sh" to build eXist with the correct SVN revision stamps

2. Thereafter, when you want to update to trunk and rebuild eXist,
update your SVN working copy and run "./build.sh rebuild". Note: This
does "clean" (i.e. wipe) your data directory, so you will need to
restore your data into eXist, so backup first.

Cheers,
Joe

------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2dcopy1
_______________________________________________
Exist-open mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/exist-open

If you reply to this email, your message will be added to the discussion below:

http://exist.2174344.n4.nabble.com/Admin-password-reset-when-restarting-database-tp3841421p3857547.html

To start a new topic under eXist, email [hidden email]
To unsubscribe from eXist, click here.

--
Vic Mortelmans
Klappeistraat 34A - 2060 ANTWERPEN
03 297 40 23 - 0499 71 06 37

View this message in context: Re: Admin password reset when restarting database
Sent from the exist-open mailing list archive at Nabble.com.

------------------------------------------------------------------------------
All of the data generated in your IT infrastructure is seriously valuable.
Why? It contains a definitive record of application performance, security
threats, fraudulent activity, and more. Splunk takes this data and makes
sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-d2dcopy2

_______________________________________________
Exist-open mailing list
Exist-open <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/exist-open

headers

Dannes Wessels | 1 Oct 2011 15:08

Re: Admin password reset when restarting database

Hi,

On 1 Oct 2011, at 15:01 , vicmortelmans wrote:

so it looks like I was confused by the svn-download build option, assuming that it would update svn, which it (probably?) doesn't.

So after an explicit "svn update" and a "build.sh rebuild", I now have running this version:

Version: 1.5.0dev

SVN Revision: 15423

Build: 20111001

User: admin

And the admin password problem is solved!

sorry, I could have been more clear; with build.sh svn-download some jar files are downloaded, which are used to determine the svn-version of you local check-out copy of exist-db. When build.sh (all) is called, the revision info is merged into the exist-db application.

(visible in html admin client, and present in each jar file)

cheers

Dannes

------------------------------------------------------------------------------
All of the data generated in your IT infrastructure is seriously valuable.
Why? It contains a definitive record of application performance, security
threats, fraudulent activity, and more. Splunk takes this data and makes
sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-d2dcopy2

_______________________________________________
Exist-open mailing list
Exist-open <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/exist-open

headers

Wolfgang Meier | 1 Oct 2011 15:19

Re: exist-db load balancing process -reg

Hi,

The first and most important step should be to use the query profiler in the admin web app to identify any bottlenecks in your queries in a singe user environment. In particular, check if there are expressions you could speed up by creating a proper index. If you have one slow query which needs to do a full document scan due to missing indexes, it will likely become a major bottleneck under high load (because it keeps blocking documents).

You may also consider increasing the broker pool max size setting in conf.xml.

Wolfgang

------------------------------------------------------------------------------
All of the data generated in your IT infrastructure is seriously valuable.
Why? It contains a definitive record of application performance, security
threats, fraudulent activity, and more. Splunk takes this data and makes
sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-d2dcopy2

_______________________________________________
Exist-open mailing list
Exist-open <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/exist-open

headers

Dan McCreary | 1 Oct 2011 15:22

Re: exist-db load balancing process -reg

Hello Raja,

If you are asking about what tools do people use to do load testing with eXist, many of us are using "JMeter" to simulate large user loads on a server. There are many youtube videos on how to use it. You can set up JMeter to simulate multiple threads and simulate many concurrent users. Let us know if you have any problems getting it working.

- Dan

On Sat, Oct 1, 2011 at 5:49 AM, Raja <m.rajamani <at> nic.in> wrote:

Hi Exist community members !!!!

We have developed an XRX application with eXist-db . the application almost complete in shape, Now we need to do the load testing .
How to do that in eXist-db . Specifically for xquery kind of apps - entirely written in XRX model . That means at a time 100 or 1000 users access the same page then the entire apps get-down or some time exist-db get crashed.

We are using exist-db -1.4.1 rev15155 version
Ubuntu 10.4 (both 32 and 64 bit systems) with same configuration
increased JVM to 4GB to avoid heap size error.

Pls suggest your comments to get success in this pbm.

By

--
Rajamani Marimuthu
Junior Research Fellow-JRF
NIC -Open Technology Centre
Rajaji Bhavan
Besant Nagar,
Chennai - 90
Cell : 9677192096

------------------------------------------------------------------------------
All of the data generated in your IT infrastructure is seriously valuable.
Why? It contains a definitive record of application performance, security
threats, fraudulent activity, and more. Splunk takes this data and makes
sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-d2dcopy2
_______________________________________________
Exist-open mailing list
Exist-open <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/exist-open

--
Dan McCreary
Semantic Solutions Architect
office: (952) 931-9198
cell: (612) 986-1552

------------------------------------------------------------------------------
All of the data generated in your IT infrastructure is seriously valuable.
Why? It contains a definitive record of application performance, security
threats, fraudulent activity, and more. Splunk takes this data and makes
sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-d2dcopy2

_______________________________________________
Exist-open mailing list
Exist-open <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/exist-open

216	May 2013
324	April 2013
428	March 2013
453	February 2013
453	January 2013
294	December 2012
495	November 2012
461	October 2012
401	September 2012
251	August 2012
241	July 2012
373	June 2012
408	May 2012
215	April 2012
343	March 2012
466	February 2012
357	January 2012
359	December 2011
614	November 2011
619	October 2011
418	September 2011
540	August 2011
426	July 2011
403	June 2011
475	May 2011
463	April 2011
465	March 2011
514	February 2011
626	January 2011
426	December 2010
391	November 2010
268	October 2010
406	September 2010
571	August 2010
696	July 2010
555	June 2010
311	May 2010
241	April 2010
530	March 2010
420	February 2010
620	January 2010
328	December 2009
735	November 2009
580	October 2009
671	September 2009
322	August 2009
322	July 2009
341	June 2009
235	May 2009
276	April 2009
278	March 2009
220	February 2009
324	January 2009
277	December 2008
198	November 2008
206	October 2008
243	September 2008
337	August 2008
321	July 2008
355	June 2008
343	May 2008
381	April 2008
433	March 2008
314	February 2008
352	January 2008
263	December 2007
351	November 2007
316	October 2007
253	September 2007
311	August 2007
315	July 2007
318	June 2007
398	May 2007
297	April 2007
389	March 2007
424	February 2007
353	January 2007
246	December 2006
414	November 2006
414	October 2006
252	September 2006
296	August 2006
551	July 2006
401	June 2006
403	May 2006
295	April 2006
496	March 2006
419	February 2006
584	January 2006
506	December 2005
425	November 2005
413	October 2005
257	September 2005
319	August 2005
302	July 2005
278	June 2005
358	May 2005
272	April 2005
336	March 2005
312	February 2005
220	January 2005
184	December 2004
214	November 2004
229	October 2004
260	September 2004
389	August 2004
191	July 2004
222	June 2004
320	May 2004
213	April 2004
219	March 2004
229	February 2004
130	January 2004
167	December 2003
159	November 2003
124	October 2003
201	September 2003
145	August 2003
181	July 2003
76	June 2003

Mon	Tue	Wed	Thu	Fri	Sat	Sun

					1	2
3	4	5	6	7	8	9
10	11	12	13	14	15	16
17	18	19	20	21	22	23
24	25	26	27	28	29	30
31