headers
JAVIER | 3 Feb 15:39
Favicon
Gravatar

memory leak

I built clucene for iOS, but I'm having some problems with a
memory leak when updating documents.

I need to add some aditional text to a indexed document, but
the only store of indexed data is lucene.
So, I need to search first for the document, then delete old
document and add new document.

If searcher and writer are opened at the same time, it leaks memory.

¿Any help other than not searching and indexing at the same time?

------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
_______________________________________________
CLucene-developers mailing list
CLucene-developers <at> lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/clucene-developers
Permalink | Reply | 1 comment |
headers
dulsi | 18 Jan 17:24

Multi-threaded stress test

When stress clucene 2.3.3.4, we have been getting an Access Violation in
lucene::index::Payload::setData. We got a similar error with 0.9.21b. We
are creating separate indexSearchers for each search which is not
recommended but doesn't look like it should be a problem. We are using the
static lucene::queryParser::QueryParser::parse due to having ported from
0.9.21b. I was planning on trying to create a simple test program that
demonstrates the problem but figured I'd ask now in case someone
recognizes the problem.

------------------------------------------------------------------------------
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
Permalink | Reply | 0 comments |
headers
曾小伟 | 19 Dec 10:00
Favicon

Clucene crash in multithread search

hi all,
I using clucene 0.9.2.1 build an index,and this index has more than 1 million doc in it.
when I searching something in multithread mode(more the 20 threads and each thread searching as hard as it can).

The crash issue occured after the searhc test begin 2~10 hours.

Is there anyone who had a similar issue, or tell me how to resolve the issue.
thanks.

here is is the Backtrace of the crashing:
___________________________________________________________________________
*** glibc detected *** <unknown>: corrupted double-linked list: 0x00002aaaac1a1e10 ***
======= Backtrace: =========
/lib64/libc.so.6[0x3df96733d0]
/lib64/libc.so.6(__libc_malloc+0x6e)[0x3df9674e2 e]
/usr/lib64/libstdc++.so.6(_Znwm+0x1d)[0x3dfcebd1dd]
/usr/lib64/libstdc++.so.6(_Znam+0x9)[0x3dfcebd2f9]
./libSearch.so(_Z12lucenewcsdupPKw+0x2c)[0x2b7b4404c55c]
./libSearch.so(_ZN6lucene5index4Term3setEPKwS3_b+0x125)[0x2b7b44031aa5]
./libSearch.so(_ZN6lucene5index15TermInfosReader17ensureIndexIsReadEv+0x196)[0x2b7b44032476]
./libSearch.so(_ZN6lucene5index15TermInfosReader3getEPKNS0_4TermE+0x3d)[0x2b7b4403287d]
./libSearch.so(_ZNK6lucene5index13SegmentReader7docFreqEPKNS0_4TermE+0xf)[0x2b7b4402b6cf]
./libSearch.so(_ZN6lucene6search10Similarity3idfEPNS_5index4TermEPNS0_8SearcherE+0x45)[0x2b7b44049d85]
./libSearch.so(_ZN6lucene6search9TermQuery10TermWeight19sumOfSquaredWeightsEv+0x38)[0x2b7b4404ab78]
./libSearch.so(_ZN6lucene6search5Query6weightEPNS0_8Searche rE+0x42)[0x2b7b44048f82]
./libSearch.so(_ZN6lucene6search13IndexSearcher7_searchEPNS0_5QueryEPNS0_6FilterEi+0x2b)[0x2b7b4404394b]
./libSearch.so(_ZN6lucene6search4Hits11getMoreDocsEm+0x165)[0x2b7b44042995]
./libSearch.so(_ZN6lucene6search4HitsC1EPNS0_8SearcherEPNS0_5QueryEPNS0_6FilterEPKNS0_4SortE+0xc9)[0x2b7b44042ee9]
./libSearch.so(_ZN6lucene6search8Searcher6searchEPNS0_5QueryEPNS0_6FilterE+0x3e)[0x2b7b44009a02]
./libSearch.so(_ZN6lucene6search8Searcher6searchEPNS0_5QueryE+0x22)[0x2b7b44009a58]
./libSearch.so(_Z21SearchStringRSbIwSt11char_traitsIwESaIwEES3_+0x504)[0x2b7b44007190]
[0x403b74]
[0x402674]
/lib64/libpthread.so.0[0x3df9e0673d]
/lib64/libc.so.6(clone+0x6d)[0x3df96d44bd]
======= Memory map: ========
00400000-00406000 r-xp 00000000 08:0a 1351 6808                           /usr/local/apps/SearchLib/code/CluceneTest/
00605000-00606000 rw-p 00005000 08:0a 13516808                           /usr/local/apps/SearchLib/code/CluceneTest/
135cf000-14754000 rw-p 135cf000 00:00 0                                  [heap]
40390000-40391000 ---p 40390000 00:00 0
40391000-40d91000 rw-p 40391000 00:00 0
40d9 1000-40d92000 ---p 40d91000 00:00 0
40d92000-41792000 rw-p 40d92000 00:00 0
41792000-41793000 ---p 41792000 00:00 0
41793000-42193000 rw-p 41793000 00:00 0
42193000-42194000 ---p 42193000 00:00 0
42194000-42b94000 rw-p 42194000 00:00 0
42b94000-42b95000 ---p 42b94000 00:00 0
42b95000-43595000 rw-p 42b95000 00:00 0
43595000-43596000 ---p 43595000 00:00 0
43596000-43f96000 rw-p 43596000 00:00 0
43f96000-43f97000 ---p 43f96000 00:00 0
43f97000-44997000 rw-p 43f97000 00:00 0
44997000-44998000 ---p 44997000 00:00 0
44998000-45398000 rw-p 44998000 00:00 0
45398000-45399000 ---p 45398000 00:00 0
45399000-45d99000 rw-p 45399000 00:00 0
45d99000-45d9a000 ---p 45d99000 00:00 0
45d9a000-4679a000 rw-p 45d9a000 00:00 0
4679a000-4 679b000 ---p 4679a000 00:00 0
4679b000-4719b000 rw-p 4679b000 00:00 0
4719b000-4719c000 ---p 4719b000 00:00 0
4719c000-47b9c000 rw-p 4719c000 00:00 0
47b9c000-47b9d000 ---p 47b9c000 00:00 0
47b9d000-4859d000 rw-p 47b9d000 00:00 0
4859d000-4859e000 ---p 4859d000 00:00 0
4859e000-48f9e000 rw-p 4859e000 00:00 0
48f9e000-48f9f000 ---p 48f9e000 00:00 0
48f9f000-4999f000 rw-p 48f9f000 00:00 0
4999f000-499a0000 ---p 4999f000 00:00 0
499a0000-4a3a0000 rw-p 499a0000 00:00 0
4a3a0000-4a3a1000 ---p 4a3a0000 00:00 0
4a3a1000-4ada1000 rw-p 4a3a1000 00:00 0
4ada1000-4ada2000 ---p 4ada1000 00:00 0
4ada2000-4b7a2000 rw-p 4ada2000 00:00 0
4b7a2000-4b7a3000 ---p 4b7a2000 00:00 0
4b7a3000-4c1a3000 rw-p 4b7a3000 00:00 0
4c1a3000-4c1a400 0 ---p 4c1a3000 00:00 0
4c1a4000-4cba4000 rw-p 4c1a4000 00:00 0
4cba4000-4cba5000 ---p 4cba4000 00:00 0
4cba5000-4d5a5000 rw-p 4cba5000 00:00 0
4d5a5000-4d5a6000 ---p 4d5a5000 00:00 0
4d5a6000-4dfa6000 rw-p 4d5a6000 00:00 0
4dfa6000-4dfa7000 ---p 4dfa6000 00:00 0
___________________________________________________________________________



Best wishes,
Zeng



------------------------------------------------------------------------------
Learn Windows Azure Live!  Tuesday, Dec 13, 2011
Microsoft is holding a special Learn Windows Azure training event for 
developers. It will provide a great way to learn Windows Azure and what it 
provides. You can attend the event by watching it streamed LIVE online.  
Learn more at http://p.sf.net/sfu/ms-windowsazure
_______________________________________________
CLucene-developers mailing list
CLucene-developers@...
https://lists.sourceforge.net/lists/listinfo/clucene-developers
Permalink | Reply | 3 comments |
headers
Ahmed | 30 Nov 18:12
Picon

Custom Filter

Hi,
I want to build a custom filter that separate words, i mean if it find a 
word like:
test123
it will convert it to:
test 123

my implementation is this:
http://pastebin.com/x7wkdKVC
http://pastebin.com/y1WG8CjN

the problem is that this analyzer when it separte words it they are 
converted to exact match query, in the prevois example i want the query 
to be:
(test 123)
but what i get is:
("test 123")

how can i fix that?
thank you

------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure 
contains a definitive record of customers, application performance, 
security threats, fraudulent activity, and more. Splunk takes this 
data and makes sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-novd2d
Permalink | Reply | 4 comments |
headers
pradeepa kumar | 29 Nov 23:53
Picon

developer volunteer

Hi
I am a C++ developer and would like to volunteer in development tasks
Could you pease let me know how and where  do I start
Thanks

------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure 
contains a definitive record of customers, application performance, 
security threats, fraudulent activity, and more. Splunk takes this 
data and makes sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-novd2d
Permalink | Reply | 1 comment |
headers
Albin Stigö | 20 Oct 19:21
Picon
Gravatar

Clucene on iOS?

I wonder if anyone could give me some pointers on how to build clucene
as a static library for iOS?

Thanks,
Albin

------------------------------------------------------------------------------
The demand for IT networking professionals continues to grow, and the
demand for specialized networking skills is growing even more rapidly.
Take a complimentary Learning <at> Cisco Self-Assessment and learn 
about Cisco certifications, training, and career opportunities. 
http://p.sf.net/sfu/cisco-dev2dev
Permalink | Reply | 3 comments |
headers
Klaus Gruen | 28 Sep 06:00
Picon
Favicon

pre-built clucene windows binaries (32 and 64 bit) for download ?

Hi all,

I am not a compiling guru and struggle with building windows binaries...can ANYONE kindly post a link or point me to compiled EXE binaries for windows, or put it up temporarily for me ?  I cannot even move forward until this in place, and I followed the directions here with dismal failure results: http://clucene.sourceforge.net/download.shtml#2_3_2

thank you!!!!!
klaus
------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2dcopy1
_______________________________________________
CLucene-developers mailing list
CLucene-developers@...
https://lists.sourceforge.net/lists/listinfo/clucene-developers
Permalink | Reply | 2 comments |
headers
Greg Hellings | 16 Sep 16:51
Picon

Upgrade Path

I'm working to update two of my projects which utilize CLucene 0.21b
and trying to update them to CLucene 2.3.3.4.  I haven't come across
any posts or wiki pages that document a suggested upgrade path - are
there any?  If so, it might make my transition proceed much more
quickly.  At present I have the following specific questions:

My project utilizes lucene_utf8towcs and lucene_wcstoutf8. These are
still present in CLucene but are not included in the publicly
installed headers.  Is this purposeful or not? If it is, what is the
proper way to do those conversions when passing data into and out of
CLucene?

There are a number of other missing classes or the like which were
being used in 0.9.21b which are not present in 2.3.3.4.  These lead to
error messages like

error: ‘Text’ is not a member of ‘lucene::document::Field’
error: ‘UnStored’ is not a member of ‘lucene::document::Field’
error: no matching function for call to
‘lucene::index::IndexWriter::addIndexes(lucene::store::Directory*
[2])’

and similar.  Again, is there a document somewhere that defines
standard upgrade paths and suggestions?  Thanks.

--Greg

------------------------------------------------------------------------------
BlackBerry&reg; DevCon Americas, Oct. 18-20, San Francisco, CA
http://p.sf.net/sfu/rim-devcon-copy2
Permalink | Reply | 1 comment |
headers
cel tix44 | 14 Sep 15:25
Picon

Compiling v.2.3.3.4 with VC6

Team


When compiled with VC6, v.2.3.3.4 throws some 300 errors.

May I please ask the DEV team whether Clucene is still going to be compatible with VC6?

If yes, I'll fix what I can, but I will need help from the DEV team where it's over my head, please.   

Regards
Celto
------------------------------------------------------------------------------
BlackBerry&reg; DevCon Americas, Oct. 18-20, San Francisco, CA
Learn about the latest advances in developing for the 
BlackBerry&reg; mobile platform with sessions, labs & more.
See new tools and technologies. Register for BlackBerry&reg; DevCon today!
http://p.sf.net/sfu/rim-devcon-copy1 
_______________________________________________
CLucene-developers mailing list
CLucene-developers@...
https://lists.sourceforge.net/lists/listinfo/clucene-developers
Permalink | Reply | 11 comments |
headers
cel tix44 | 12 Sep 16:01
Picon

Compile error in v.2.3.3.4 - TestIndexSearcher.cpp - usleep(9999);

Team


Tried to compile v.2.3.3.4 by using VS2008 -- got 2 errors in TestIndexSearcher.cpp:

error C3861: 'usleep': identifier not found

Fixed it as follows:

1) replace usleep(9999) with _LUCENE_SLEEP(9999)

2) add this include to test.h:
    #include "CLucene/_SharedHeader.h"

Regards
Celto
------------------------------------------------------------------------------
Doing More with Less: The Next Generation Virtual Desktop 
What are the key obstacles that have prevented many mid-market businesses
from deploying virtual desktops?   How do next-generation virtual desktops
provide companies an easier-to-deploy, easier-to-manage and more affordable
virtual desktop model.http://www.accelacomm.com/jaw/sfnl/114/51426474/
_______________________________________________
CLucene-developers mailing list
CLucene-developers@...
https://lists.sourceforge.net/lists/listinfo/clucene-developers
Permalink | Reply | 1 comment |
headers
Asharudeen | 18 Aug 13:22
Picon

Grab content that to be indexed from Clucene

Hi,


Currently I am indexing documents using Solr, by directly adding files as 'req.addFile(fi);' or by sending the content of the file like 'req.addContentStream(stream);' (with solrj library). Actually, I need to index the documents from my local network to Solr server running on a remote network. The reason is, I would like to perform searches on server end and dont want to store the indexed data at client side. Typically, the approach is to transfer the entire file content to remote server (since, Solr server is running on different remote network).

However, I believe, in Lucene the indexed data would only be 1% to 10% of the original file data. Plz correct me, if I am wrong. So, I want to check if i would be able to use 'CLucene' project in the client side, and generate only the analysed data that needs to be stored in an index. Then, i would transfer this data to the server (through socket or curl upload), and index the analysed content on the server side. So, with this approach, i want to avoid transfering entire files and transfer only the indexable portion of the content as input to the server. Then on the server side, i want to perform the necessary processing to create the index with this input data.

Is there any way/api to achieve these steps on both the client and server side using CLucene. Or any way to achieve this by digging into the CLucene codes/project ?

Regards,
Rahul.
------------------------------------------------------------------------------
Get a FREE DOWNLOAD! and learn more about uberSVN rich system, 
user administration capabilities and model configuration. Take 
the hassle out of deploying and managing Subversion and the 
tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2
_______________________________________________
CLucene-developers mailing list
CLucene-developers@...
https://lists.sourceforge.net/lists/listinfo/clucene-developers
Permalink | Reply | 1 comment |

Gmane