headers
Jason Rutherglen (JIRA | 1 May 2009 01:20
Picon
Favicon

[jira] Updated: (LUCENE-1313) Realtime Search


     [
https://issues.apache.org/jira/browse/LUCENE-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jason Rutherglen updated LUCENE-1313:
-------------------------------------

    Attachment: LUCENE-1313.patch

Fixed and cleaned up more.

All tests pass

Added entry in CHANGES.txt

I'm going to integrate LUCENE-1618 and test that out as a part of the next patch.

> Realtime Search
> ---------------
>
>                 Key: LUCENE-1313
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1313
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Index
>    Affects Versions: 2.4.1
>            Reporter: Jason Rutherglen
>            Priority: Minor
>             Fix For: 2.9
>
(Continue reading)

Permalink | Reply | 0 comments |
headers
Hoss Man (JIRA | 1 May 2009 01:43
Picon
Favicon

[jira] Updated: (LUCENE-1494) Additional features for searching for value across multiple fields (many-to-one style)


     [
https://issues.apache.org/jira/browse/LUCENE-1494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hoss Man updated LUCENE-1494:
-----------------------------

    Attachment: LUCENE-1494-masking.patch

some things looked like they wouldn't work with the masking patch, so i wrote some test cases to convince
myself they were broken (and because new code should always have test cases).  In particular i was worried
about the lack of equals/hashCode methods, and the broken rewrite method

one interesting thing I discovered was that the code worked in many cases even though rewrite was
constantly just returning the masked inner query -- digging into it i realized the reason was because none
of the other SpanQuery classes pay any attention to what their nested clauses return when they
recursively rewrite, so a SpanNearQuery whose constructor freaks out if the fields of all the clauses
don't match, happily generates spans if one of those clauses returns a complteley different SpanQuery on rewrite.

I also removed the proxying of getBoost and setBoost ... it was causing problems with some stock testing
framework code that expects a q1.equals(q1.clone().setBoost(newBoost)) to be false (this was
evaluating to true because it's a shallow clone and setBoost was proxying and modifying the original
inner query's boost value) ... this means that FieldMaskingSpanQuery is consistent with how other
SpanQueries deal with boost (they ignore the boosts of their nested clauses)

new patch (with tests) attached ... i'd like to have some more tests before committing (spans is deep
voodoo, we're doing funky stuff with spans, all the more reason to test thoroughly)

> Additional features for searching for value across multiple fields (many-to-one style)
> --------------------------------------------------------------------------------------
(Continue reading)

Permalink | Reply | 0 comments |
headers
Apache Hudson Server | 1 May 2009 05:55
Picon
Favicon

Hudson build is back to normal: Lucene-trunk #813

See http://hudson.zones.apache.org/hudson/job/Lucene-trunk/813/changes
Permalink | Reply | 0 comments |
headers
Michael McCandless (JIRA | 1 May 2009 12:27
Picon
Favicon

[jira] Resolved: (LUCENE-1624) Don't commit an empty segments_N when IW is opened with create=true


     [
https://issues.apache.org/jira/browse/LUCENE-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael McCandless resolved LUCENE-1624.
----------------------------------------

    Resolution: Fixed

> Don't commit an empty segments_N when IW is opened with create=true
> -------------------------------------------------------------------
>
>                 Key: LUCENE-1624
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1624
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>            Reporter: Michael McCandless
>            Assignee: Michael McCandless
>            Priority: Minor
>             Fix For: 2.9
>
>         Attachments: LUCENE-1624.patch
>
>
> If IW is opened with create=true, it forcefully commits an empty
> segments_N.  But really it should not: if autoCommit is false, nothing
> should be committed until commit or close is explicitly called.
> Spinoff from http://www.nabble.com/no-segments*-file-found:-files:-Error-on-opening-index-td23219520.html
(Continue reading)

Permalink | Reply | 0 comments |
headers
Michael McCandless (JIRA | 1 May 2009 12:57
Picon
Favicon

[jira] Resolved: (LUCENE-1623) Back-compat break with non-ascii field names


     [
https://issues.apache.org/jira/browse/LUCENE-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael McCandless resolved LUCENE-1623.
----------------------------------------

    Resolution: Fixed

Committed to trunk & 2.4 branch.

> Back-compat break with non-ascii field names
> --------------------------------------------
>
>                 Key: LUCENE-1623
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1623
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: Index
>    Affects Versions: 2.4, 2.4.1
>            Reporter: Michael McCandless
>            Assignee: Michael McCandless
>             Fix For: 2.9
>
>         Attachments: LUCENE-1623.patch
>
>
> If a field name contains non-ascii characters in a 2.3.x index, then
> on upgrade to 2.4.x unexpected problems are hit.  It's possible to hit
> a "read past EOF" IOException; it's also possible to not hit an
(Continue reading)

Permalink | Reply | 0 comments |
headers
Michael McCandless (JIRA | 1 May 2009 14:07
Picon
Favicon

[jira] Assigned: (LUCENE-1618) Allow setting the IndexWriter docstore to be a different directory


     [
https://issues.apache.org/jira/browse/LUCENE-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael McCandless reassigned LUCENE-1618:
------------------------------------------

    Assignee: Michael McCandless

> Allow setting the IndexWriter docstore to be a different directory
> ------------------------------------------------------------------
>
>                 Key: LUCENE-1618
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1618
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>    Affects Versions: 2.4.1
>            Reporter: Jason Rutherglen
>            Assignee: Michael McCandless
>            Priority: Minor
>             Fix For: 2.9
>
>         Attachments: LUCENE-1618.patch, LUCENE-1618.patch, MemoryCachedDirectory.java
>
>   Original Estimate: 336h
>  Remaining Estimate: 336h
>
> Add an IndexWriter.setDocStoreDirectory method that allows doc
> stores to be placed in a different directory than the IW default
(Continue reading)

Permalink | Reply | 0 comments |
headers
Michael McCandless (JIRA | 1 May 2009 14:33
Picon
Favicon

[jira] Updated: (LUCENE-1618) Allow setting the IndexWriter docstore to be a different directory


     [
https://issues.apache.org/jira/browse/LUCENE-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael McCandless updated LUCENE-1618:
---------------------------------------

    Attachment: LUCENE-1618.patch

New patch attached w/ minor fixes: added more detail in CHANGES entry; renamed "real" and "other" dir to
"primary" and "secondary" dir; tweaked javadocs.  I plan to commit later today.

Once this is in, Jason can you update LUCENE-1313 to use this class?  Thanks.

> Allow setting the IndexWriter docstore to be a different directory
> ------------------------------------------------------------------
>
>                 Key: LUCENE-1618
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1618
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>    Affects Versions: 2.4.1
>            Reporter: Jason Rutherglen
>            Assignee: Michael McCandless
>            Priority: Minor
>             Fix For: 2.9
>
>         Attachments: LUCENE-1618.patch, LUCENE-1618.patch, LUCENE-1618.patch, MemoryCachedDirectory.java
>
(Continue reading)

Permalink | Reply | 0 comments |
headers
Tim Smith (JIRA | 1 May 2009 15:36
Picon
Favicon

[jira] Created: (LUCENE-1625) openReaderPassed not populated in CheckIndex.Status.SegmentInfoStatus

openReaderPassed not populated in CheckIndex.Status.SegmentInfoStatus
---------------------------------------------------------------------

                 Key: LUCENE-1625
                 URL: https://issues.apache.org/jira/browse/LUCENE-1625
             Project: Lucene - Java
          Issue Type: Bug
          Components: Index
    Affects Versions: 2.4
            Reporter: Tim Smith

When using CheckIndex programatically, the openReaderPassed flag on the SegmentInfoStatus is never
populated (so it always comes back false)

looking at the code, its clear that openReaderPassed is defined, but never used

furthermore, it appears that not all information that is propagated to the "InfoStream" is available via SegmentIinfoStatus

All of the following information should be able to be gather from public properties on the SegmentInfoStatus:
test: open reader.........OK
test: fields, norms.......OK [2 fields]
test: terms, freq, prox...OK [101 terms; 133 terms/docs pairs; 133 tokens]
test: stored fields.......OK [100 total field count; avg 1 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/freq vector fields per doc]

--

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
(Continue reading)

Permalink | Reply | 7 comments |
headers
Michael McCandless (JIRA | 1 May 2009 15:59
Picon
Favicon

[jira] Commented: (LUCENE-1313) Realtime Search


    [
https://issues.apache.org/jira/browse/LUCENE-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12704995#action_12704995
] 

Michael McCandless commented on LUCENE-1313:
--------------------------------------------

Patch looks good!  Some comments:

  * I don't think the caller should provide the RAMDir... and we
    should have a getter to get it. I think this should be
    under-the-hood.  This is simply a nice way for IW to use RAM as
    buffer in the presence of frequent NRT readers being opened.

  * If NRT is never used, the behavior of IW should be unchanged
    (which is not the case w/ this patch I think).  RAMDir should be
    created the first time a flush is done due to NRT creation.

  * StoredFieldsWriter & TermVectorsTermsWriter now writes to
    IndexWriter.getFlushDirectory(), which is confusing because that
    method returns the RAMDir if set?  Shouldn't this be the opposite?
    (Ie it should flush to IndexWriter.getDirectory()?  Or we should
    change getFlushDiretory to NOT return the ramdir?)

  * Why did you need to add synchronized to some of the SegmentInfo
    files methods?  (What breaks if you undo that?).  The contract
    here is IW protects access to SegmentInfo/s.

  * The MergePolicy needs some smarts when it's dealing w/ RAM.  EG it
(Continue reading)

Permalink | Reply | 0 comments |
headers
Michael McCandless (JIRA | 1 May 2009 16:34
Picon
Favicon

[jira] Commented: (LUCENE-1614) Add next() and skipTo() variants to DocIdSetIterator that return the current doc, instead of boolean


    [
https://issues.apache.org/jira/browse/LUCENE-1614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12705003#action_12705003
] 

Michael McCandless commented on LUCENE-1614:
--------------------------------------------

bq. Then, we can see how to proceed with check() and whether it should be part of this issue or another one.

Fair enough!

bq. I have a feeling my last couple of issues just grew larger the more we discussed them, so I hope to keep this
one containable 

Alas this is what happens when you tackle tricky issues... sort of like pulling out that innocent looking
thread sticking out on the bottom of your shirt ;)

> Add next() and skipTo() variants to DocIdSetIterator that return the current doc, instead of boolean
> ----------------------------------------------------------------------------------------------------
>
>                 Key: LUCENE-1614
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1614
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Search
>            Reporter: Shai Erera
>             Fix For: 2.9
>
>
(Continue reading)

Permalink | Reply | 0 comments |

Gmane