From java-devzlewis@example.net Mon Sep 01 02:28:37 2008 Return-Path: <java-devzlewis@example.net> Delivered-To: zlewis@example.net Received: (qmail 12392 invoked from network); 1 Sep 2008 02:28:36 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Sep 2008 02:28:36 -0000 Received: (qmail 77061 invoked by uid 500); 1 Sep 2008 02:28:33 -0000 Delivered-To: zlewis@example.net Received: (qmail 77012 invoked by uid 500); 1 Sep 2008 02:28:33 -0000 Mailing-List: contact zlewis@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:zlewis@example.net> List-Unsubscribe: <mailto:zlewis@example.net> List-Post: <mailto:zlewis@example.net> List-Id: <java-dev.lucene.apache.org> Reply-To: zlewis@example.net Delivered-To: mailing list zlewis@example.net Received: (qmail 76993 invoked by uid 99); 1 Sep 2008 02:28:33 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 31 Aug 2008 19:28:33 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Sep 2008 02:27:43 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 50C32234C1B8 for <zlewis@example.net>; Sun, 31 Aug 2008 19:27:44 -0700 (PDT) Message-ID: <1762183471.1220236064316.JavaMail.jira@brutus> Date: Sun, 31 Aug 2008 19:27:44 -0700 (PDT) From: "Paul Cowan (JIRA)" <zlewis@example.net> To: zlewis@example.net Subject: [jira] Created: (LUCENE-1372) Proposal: introduce more sensible sorting when a doc has multiple values for a term MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org Proposal: introduce more sensible sorting when a doc has multiple values for a term ----------------------------------------------------------------------------------- Key: LUCENE-1372 URL: https://issues.apache.org/jira/browse/LUCENE-1372 Project: Lucene - Java Issue Type: Improvement Components: Search Affects Versions: 2.3.2 Reporter: Paul Cowan Priority: Minor At the moment, FieldCacheImpl has somewhat disconcerting values when sorting on a field for which multiple values exist for one document. For example, imagine a field "fruit" which is added to a document multiple times, with the values as follows: doc 1: {"apple"} doc 2: {"banana"} doc 3: {"apple", "banana"} doc 4: {"apple", "zebra"} if one sorts on the field "fruit", the loop in FieldCacheImpl.stringsIndexCache.createValue() (and similarly for the other methods in the various FieldCacheImpl caches) does the following: while (termDocs.next()) { retArray[termDocs.doc()] = t; } which means that we look over the terms in their natural order and, on each one, overwrite retArray[doc] with the value for each document with that term. Effectively, this overwriting means that a string sort in this circumstance will sort by the LAST term lexicographically, so the docs above will effecitvely be sorted as if they had the single values ("apple", "banana", "banana", "zebra") which is nonintuitive. To change this to sort on the first time in the TermEnum seems relatively trivial and low-overhead; while it's not perfect (it's not local-aware, for example) the behaviour seems much more sensible to me. Interested to see what people think. Patch to follow. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. --------------------------------------------------------------------- To unsubscribe, e-mail: zlewis@example.net For additional commands, e-mail: zlewis@example.net From java-devzlewis@example.net Mon Sep 01 02:32:41 2008 Return-Path: <java-devzlewis@example.net> Delivered-To: zlewis@example.net Received: (qmail 13781 invoked from network); 1 Sep 2008 02:32:41 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Sep 2008 02:32:41 -0000 Received: (qmail 78716 invoked by uid 500); 1 Sep 2008 02:32:33 -0000 Delivered-To: zlewis@example.net Received: (qmail 78694 invoked by uid 500); 1 Sep 2008 02:32:33 -0000 Mailing-List: contact zlewis@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:zlewis@example.net> List-Unsubscribe: <mailto:zlewis@example.net> List-Post: <mailto:zlewis@example.net> List-Id: <java-dev.lucene.apache.org> Reply-To: zlewis@example.net Delivered-To: mailing list zlewis@example.net Received: (qmail 78684 invoked by uid 99); 1 Sep 2008 02:32:33 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 31 Aug 2008 19:32:33 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Sep 2008 02:31:43 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 7C4DE234C1C3 for <zlewis@example.net>; Sun, 31 Aug 2008 19:31:44 -0700 (PDT) Message-ID: <+1-706-882-4860.1220236304507.JavaMail.jira@brutus> Date: Sun, 31 Aug 2008 19:31:44 -0700 (PDT) From: "Paul Cowan (JIRA)" <zlewis@example.net> To: zlewis@example.net Subject: [jira] Updated: (LUCENE-1372) Proposal: introduce more sensible sorting when a doc has multiple values for a term In-Reply-To: <1762183471.1220236064316.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/LUCENE-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Cowan updated LUCENE-1372: ------------------------------- Attachment: lucene-multisort.patch Patch which deals with this in the case of Strings, with a test case. This is a POC example; if people are happy with the approach I'll implement for the other types (float, int, etc) as I think it makes sense there also. > Proposal: introduce more sensible sorting when a doc has multiple values for a term > ----------------------------------------------------------------------------------- > > Key: LUCENE-1372 > URL: https://issues.apache.org/jira/browse/LUCENE-1372 > Project: Lucene - Java > Issue Type: Improvement > Components: Search > Affects Versions: 2.3.2 > Reporter: Paul Cowan > Priority: Minor > Attachments: lucene-multisort.patch > > > At the moment, FieldCacheImpl has somewhat disconcerting values when sorting on a field for which multiple values exist for one document. For example, imagine a field "fruit" which is added to a document multiple times, with the values as follows: > doc 1: {"apple"} > doc 2: {"banana"} > doc 3: {"apple", "banana"} > doc 4: {"apple", "zebra"} > if one sorts on the field "fruit", the loop in FieldCacheImpl.stringsIndexCache.createValue() (and similarly for the other methods in the various FieldCacheImpl caches) does the following: > while (termDocs.next()) { > retArray[termDocs.doc()] = t; > } > which means that we look over the terms in their natural order and, on each one, overwrite retArray[doc] with the value for each document with that term. Effectively, this overwriting means that a string sort in this circumstance will sort by the LAST term lexicographically, so the docs above will effecitvely be sorted as if they had the single values ("apple", "banana", "banana", "zebra") which is nonintuitive. To change this to sort on the first time in the TermEnum seems relatively trivial and low-overhead; while it's not perfect (it's not local-aware, for example) the behaviour seems much more sensible to me. Interested to see what people think. > Patch to follow. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. --------------------------------------------------------------------- To unsubscribe, e-mail: zlewis@example.net For additional commands, e-mail: zlewis@example.net From java-devzlewis@example.net Mon Sep 01 02:33:23 2008 Return-Path: <java-devzlewis@example.net> Delivered-To: zlewis@example.net Received: (qmail 13981 invoked from network); 1 Sep 2008 02:33:22 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Sep 2008 02:33:22 -0000 Received: (qmail 79512 invoked by uid 500); 1 Sep 2008 02:33:19 -0000 Delivered-To: zlewis@example.net Received: (qmail 79465 invoked by uid 500); 1 Sep 2008 02:33:19 -0000 Mailing-List: contact zlewis@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:zlewis@example.net> List-Unsubscribe: <mailto:zlewis@example.net> List-Post: <mailto:zlewis@example.net> List-Id: <java-dev.lucene.apache.org> Reply-To: zlewis@example.net Delivered-To: mailing list zlewis@example.net Received: (qmail 79456 invoked by uid 99); 1 Sep 2008 02:33:19 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 31 Aug 2008 19:33:19 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hudson.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Sep 2008 02:32:17 +0000 Received: from hudson.zones.apache.org (localhost [83.161.120.155]) by hudson.zones.apache.org (8.13.8+Sun/8.13.8) with ESMTP id m812WmsR010009 for <zlewis@example.net>; Sun, 31 Aug 2008 22:32:48 -0400 (EDT) Date: Mon, 1 Sep 2008 02:32:47 +0000 (UTC) From: Apache Hudson Server <zlewis@example.net> To: zlewis@example.net Message-ID: <zlewis@example.net> Subject: Build failed in Hudson: Lucene-trunk #573 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org See http://hudson.zones.apache.org/hudson/job/Lucene-trunk/573/changes Changes: [kalle] Javadocs fix ------------------------------------------ [...truncated 9731 lines...] [junit] No terms in bi field for: kxor* [junit] No terms in bi field for: kxork* [junit] No terms in bi field for: kxor* [junit] ------------- ---------------- --------------- [delete] Deleting: http://hudson.zones.apache.org/hudson/job/Lucene-trunk/ws/trunk/build/contrib/surround/test/junitfailed.flag [echo] Building swing... javacc-uptodate-check: javacc-notice: jflex-uptodate-check: jflex-notice: common.init: build-lucene: init: test: [echo] Building swing... javacc-uptodate-check: javacc-notice: jflex-uptodate-check: jflex-notice: common.init: build-lucene: init: compile-test: [echo] Building swing... javacc-uptodate-check: javacc-notice: jflex-uptodate-check: jflex-notice: common.init: build-lucene: init: clover.setup: clover.info: clover: compile-core: common.compile-test: common.test: [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Lucene-trunk/ws/trunk/build/contrib/swing/test [junit] Testsuite: org.apache.lucene.swing.models.TestBasicList [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.811 sec [junit] [junit] Testsuite: org.apache.lucene.swing.models.TestBasicTable [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.602 sec [junit] [junit] Testsuite: org.apache.lucene.swing.models.TestSearchingList [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.637 sec [junit] [junit] Testsuite: org.apache.lucene.swing.models.TestSearchingTable [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.678 sec [junit] [junit] Testsuite: org.apache.lucene.swing.models.TestUpdatingList [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 1.8 sec [junit] [junit] Testsuite: org.apache.lucene.swing.models.TestUpdatingTable [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.913 sec [junit] [delete] Deleting: http://hudson.zones.apache.org/hudson/job/Lucene-trunk/ws/trunk/build/contrib/swing/test/junitfailed.flag [echo] Building wikipedia... javacc-uptodate-check: javacc-notice: jflex-uptodate-check: jflex-notice: common.init: build-lucene: init: test: [echo] Building wikipedia... javacc-uptodate-check: javacc-notice: jflex-uptodate-check: jflex-notice: common.init: build-lucene: init: compile-test: [echo] Building wikipedia... javacc-uptodate-check: javacc-notice: jflex-uptodate-check: jflex-notice: common.init: build-lucene: init: clover.setup: clover.info: clover: compile-core: common.compile-test: common.test: [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Lucene-trunk/ws/trunk/build/contrib/wikipedia/test [junit] Testsuite: org.apache.lucene.wikipedia.analysis.WikipediaTokenizerTest [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 2.223 sec [junit] [delete] Deleting: http://hudson.zones.apache.org/hudson/job/Lucene-trunk/ws/trunk/build/contrib/wikipedia/test/junitfailed.flag [echo] Building wordnet... javacc-uptodate-check: javacc-notice: jflex-uptodate-check: jflex-notice: common.init: build-lucene: init: test: [echo] Building xml-query-parser... javacc-uptodate-check: javacc-notice: jflex-uptodate-check: jflex-notice: common.init: build-lucene: init: test: [echo] Building xml-query-parser... javacc-uptodate-check: javacc-notice: jflex-uptodate-check: jflex-notice: common.init: build-lucene: init: compile-test: [echo] Building xml-query-parser... build-queries: javacc-uptodate-check: javacc-notice: jflex-uptodate-check: jflex-notice: common.init: build-lucene: init: clover.setup: clover.info: clover: common.compile-core: compile-core: common.compile-test: common.test: [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Lucene-trunk/ws/trunk/build/contrib/xml-query-parser/test [junit] Testsuite: org.apache.lucene.xmlparser.TestParser [junit] Tests run: 17, Failures: 0, Errors: 0, Time elapsed: 3.158 sec [junit] [junit] Testsuite: org.apache.lucene.xmlparser.TestQueryTemplateManager [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.94 sec [junit] [delete] Deleting: http://hudson.zones.apache.org/hudson/job/Lucene-trunk/ws/trunk/build/contrib/xml-query-parser/test/junitfailed.flag BUILD FAILED http://hudson.zones.apache.org/hudson/job/Lucene-trunk/ws/trunk/build.xml :574: Contrib tests failed! Total time: 17 minutes 6 seconds Publishing Javadoc Recording test results --------------------------------------------------------------------- To unsubscribe, e-mail: zlewis@example.net For additional commands, e-mail: zlewis@example.net From java-devzlewis@example.net Mon Sep 01 09:10:19 2008 Return-Path: <java-devzlewis@example.net> Delivered-To: zlewis@example.net Received: (qmail 24656 invoked from network); 1 Sep 2008 09:10:19 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Sep 2008 09:10:19 -0000 Received: (qmail 43056 invoked by uid 500); 1 Sep 2008 09:10:15 -0000 Delivered-To: zlewis@example.net Received: (qmail 43018 invoked by uid 500); 1 Sep 2008 09:10:15 -0000 Mailing-List: contact zlewis@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:zlewis@example.net> List-Unsubscribe: <mailto:zlewis@example.net> List-Post: <mailto:zlewis@example.net> List-Id: <java-dev.lucene.apache.org> Reply-To: zlewis@example.net Delivered-To: mailing list zlewis@example.net Received: (qmail 43009 invoked by uid 99); 1 Sep 2008 09:10:15 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Sep 2008 02:10:15 -0700 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [83.161.120.155] (HELO an-out-0708.google.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Sep 2008 09:09:14 +0000 Received: by an-out-0708.google.com with SMTP id c37so260473anc.49 for <zlewis@example.net>; Mon, 01 Sep 2008 02:09:25 -0700 (PDT) Received: by 83.161.120.155 with SMTP id d15mr5622005anc.33.1220260165283; Mon, 01 Sep 2008 02:09:25 -0700 (PDT) Received: from ?83.161.120.155? ( [83.161.120.155]) by mx.google.com with ESMTPS id c23sm9992603ana.18.283.161.120.155.09.24 (version=TLSv1/SSLv3 cipher=RC4-MD5); Mon, 01 Sep 2008 02:09:24 -0700 (PDT) Message-Id: <zlewis@example.net> From: Michael McCandless <zlewis@example.net> To: zlewis@example.net In-Reply-To: <zlewis@example.net> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v926) Subject: Re: Build failed in Hudson: Lucene-trunk #573 Date: Mon, 1 Sep 2008 05:09:23 -0400 References: <zlewis@example.net> X-Mailer: Apple Mail (2.926) X-Virus-Checked: Checked by ClamAV on apache.org This is the 2nd time in recent memory that we've had a false failure from HighlighterTest.testEncoding -- here's the traceback this time: [junit] Testcase: testEncoding(org.apache.lucene.search.highlight.HighlighterTest): Caused an ERROR [junit] Connection refused [junit] java.net.ConnectException: Connection refused [junit] at java.net.PlainSocketImpl.socketConnect(Native Method) [junit] at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333) [junit] at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195) [junit] at java.net.PlainSocketImpl.connect(PlainSocketImpl.java: 182) [junit] at java.net.Socket.connect(Socket.java:520) [junit] at java.net.Socket.connect(Socket.java:470) [junit] at sun.net.NetworkClient.doConnect(NetworkClient.java:157) [junit] at sun.net.www.http.HttpClient.openServer(HttpClient.java:388) [junit] at sun.net.www.http.HttpClient.openServer(HttpClient.java:523) [junit] at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java: 640) [junit] at sun.net.www.protocol.http.HttpURLConnection.getInputStream (HttpURLConnection.java:957) [junit] at org.apache.xerces.impl.XMLEntityManager.setupCurrentEntity(Unknown Source) [junit] at org.apache.xerces.impl.XMLEntityManager.startEntity(Unknown Source) [junit] at org.apache.xerces.impl.XMLEntityManager.startEntity(Unknown Source) [junit] at org.apache.xerces.impl.XMLDTDScannerImpl.startPE(Unknown Source) [junit] at org.apache.xerces.impl.XMLDTDScannerImpl.skipSeparator(Unknown Source) [junit] at org.apache.xerces.impl.XMLDTDScannerImpl.scanDecls(Unknown Source) [junit] at org.apache.xerces.impl.XMLDTDScannerImpl.scanDTDExternalSubset(Unknown Source) [junit] at org.apache.xerces.impl.XMLDocumentScannerImpl $DTDDispatcher.dispatch(Unknown Source) [junit] at org .apache .xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source) [junit] at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) [junit] at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) [junit] at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) [junit] at org.apache.xerces.parsers.DOMParser.parse(Unknown Source) [junit] at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source) [junit] at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:98) [junit] at org .apache .lucene .search.highlight.HighlighterTest.testEncoding(HighlighterTest.java: 1010) [junit] I just committed a small change to the XML fragment used in that test not declare its DOCTYPE (which refers to the DTD that xerces was trying to load). Mike Apache Hudson Server wrote: > See http://hudson.zones.apache.org/hudson/job/Lucene-trunk/573/changes > > Changes: > > [kalle] Javadocs fix > > ------------------------------------------ > [...truncated 9731 lines...] > [junit] No terms in bi field for: kxor* > [junit] No terms in bi field for: kxork* > [junit] No terms in bi field for: kxor* > [junit] ------------- ---------------- --------------- > [delete] Deleting: http://hudson.zones.apache.org/hudson/job/Lucene-trunk/ws/trunk/build/contrib/surround/test/junitfailed.flag > [echo] Building swing... > > javacc-uptodate-check: > > javacc-notice: > > jflex-uptodate-check: > > jflex-notice: > > common.init: > > build-lucene: > > init: > > test: > [echo] Building swing... > > javacc-uptodate-check: > > javacc-notice: > > jflex-uptodate-check: > > jflex-notice: > > common.init: > > build-lucene: > > init: > > compile-test: > [echo] Building swing... > > javacc-uptodate-check: > > javacc-notice: > > jflex-uptodate-check: > > jflex-notice: > > common.init: > > build-lucene: > > init: > > clover.setup: > > clover.info: > > clover: > > compile-core: > > common.compile-test: > > common.test: > [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Lucene-trunk/ws/trunk/build/contrib/swing/test > [junit] Testsuite: org.apache.lucene.swing.models.TestBasicList > [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.811 > sec > [junit] > [junit] Testsuite: org.apache.lucene.swing.models.TestBasicTable > [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.602 > sec > [junit] > [junit] Testsuite: org.apache.lucene.swing.models.TestSearchingList > [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.637 > sec > [junit] > [junit] Testsuite: > org.apache.lucene.swing.models.TestSearchingTable > [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.678 > sec > [junit] > [junit] Testsuite: org.apache.lucene.swing.models.TestUpdatingList > [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 1.8 sec > [junit] > [junit] Testsuite: org.apache.lucene.swing.models.TestUpdatingTable > [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.913 > sec > [junit] > [delete] Deleting: http://hudson.zones.apache.org/hudson/job/Lucene-trunk/ws/trunk/build/contrib/swing/test/junitfailed.flag > [echo] Building wikipedia... > > javacc-uptodate-check: > > javacc-notice: > > jflex-uptodate-check: > > jflex-notice: > > common.init: > > build-lucene: > > init: > > test: > [echo] Building wikipedia... > > javacc-uptodate-check: > > javacc-notice: > > jflex-uptodate-check: > > jflex-notice: > > common.init: > > build-lucene: > > init: > > compile-test: > [echo] Building wikipedia... > > javacc-uptodate-check: > > javacc-notice: > > jflex-uptodate-check: > > jflex-notice: > > common.init: > > build-lucene: > > init: > > clover.setup: > > clover.info: > > clover: > > compile-core: > > common.compile-test: > > common.test: > [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Lucene-trunk/ws/trunk/build/contrib/wikipedia/test > [junit] Testsuite: > org.apache.lucene.wikipedia.analysis.WikipediaTokenizerTest > [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 2.223 > sec > [junit] > [delete] Deleting: http://hudson.zones.apache.org/hudson/job/Lucene-trunk/ws/trunk/build/contrib/wikipedia/test/junitfailed.flag > [echo] Building wordnet... > > javacc-uptodate-check: > > javacc-notice: > > jflex-uptodate-check: > > jflex-notice: > > common.init: > > build-lucene: > > init: > > test: > [echo] Building xml-query-parser... > > javacc-uptodate-check: > > javacc-notice: > > jflex-uptodate-check: > > jflex-notice: > > common.init: > > build-lucene: > > init: > > test: > [echo] Building xml-query-parser... > > javacc-uptodate-check: > > javacc-notice: > > jflex-uptodate-check: > > jflex-notice: > > common.init: > > build-lucene: > > init: > > compile-test: > [echo] Building xml-query-parser... > > build-queries: > > javacc-uptodate-check: > > javacc-notice: > > jflex-uptodate-check: > > jflex-notice: > > common.init: > > build-lucene: > > init: > > clover.setup: > > clover.info: > > clover: > > common.compile-core: > > compile-core: > > common.compile-test: > > common.test: > [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Lucene-trunk/ws/trunk/build/contrib/xml-query-parser/test > [junit] Testsuite: org.apache.lucene.xmlparser.TestParser > [junit] Tests run: 17, Failures: 0, Errors: 0, Time elapsed: > 3.158 sec > [junit] > [junit] Testsuite: > org.apache.lucene.xmlparser.TestQueryTemplateManager > [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.94 > sec > [junit] > [delete] Deleting: http://hudson.zones.apache.org/hudson/job/Lucene-trunk/ws/trunk/build/contrib/xml-query-parser/test/junitfailed.flag > > BUILD FAILED > http://hudson.zones.apache.org/hudson/job/Lucene-trunk/ws/trunk/build.xml > :574: Contrib tests failed! > > Total time: 17 minutes 6 seconds > Publishing Javadoc > Recording test results > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: zlewis@example.net > For additional commands, e-mail: zlewis@example.net > --------------------------------------------------------------------- To unsubscribe, e-mail: zlewis@example.net For additional commands, e-mail: zlewis@example.net From java-devzlewis@example.net Mon Sep 01 12:51:58 2008 Return-Path: <java-devzlewis@example.net> Delivered-To: zlewis@example.net Received: (qmail 30816 invoked from network); 1 Sep 2008 12:51:57 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Sep 2008 12:51:57 -0000 Received: (qmail 71306 invoked by uid 500); 1 Sep 2008 12:51:49 -0000 Delivered-To: zlewis@example.net Received: (qmail 71284 invoked by uid 500); 1 Sep 2008 12:51:49 -0000 Mailing-List: contact zlewis@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:zlewis@example.net> List-Unsubscribe: <mailto:zlewis@example.net> List-Post: <mailto:zlewis@example.net> List-Id: <java-dev.lucene.apache.org> Reply-To: zlewis@example.net Delivered-To: mailing list zlewis@example.net Received: (qmail 71270 invoked by uid 99); 1 Sep 2008 12:51:49 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Sep 2008 05:51:49 -0700 X-ASF-Spam-Status: No, hits=2.0 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [83.161.120.155] (HELO mgw-mx06.nokia.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Sep 2008 12:50:51 +0000 Received: from esebh106.NOE.Nokia.com (esebh106.ntc.nokia.com [83.161.120.155]) by mgw-mx06.nokia.com (Switch-3.2.6/Switch-3.2.6) with ESMTP id m81CopDP006424 for <zlewis@example.net>; Mon, 1 Sep 2008 15:51:18 +0300 Received: from esebh102.NOE.Nokia.com ([83.161.120.155]) by esebh106.NOE.Nokia.com with Microsoft SMTPSVC+1-706-882-4860); Mon, 1 Sep 2008 15:50:53 +0300 Received: from esebe108.NOE.Nokia.com ([83.161.120.155]) by esebh102.NOE.Nokia.com with Microsoft SMTPSVC+1-706-882-4860); Mon, 1 Sep 2008 15:50:53 +0300 X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----_=_NextPart_001_01C90C31.5E8B944F" Subject: Multi Phrase Search at the Beginning of a field Date: Mon, 1 Sep 2008 15:50:53 +0300 Message-ID: <zlewis@example.net> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: Multi Phrase Search at the Beginning of a field Thread-Index: AckMMV5C15lumi7YTceoaYiYWNI7kQ== From: <zlewis@example.net> To: <zlewis@example.net> X-OriginalArrivalTime: 01 Sep 2008 12:50:53.0379 (UTC) FILETIME=[5E6B4930:01C90C31] X-Nokia-AV: Clean X-Virus-Checked: Checked by ClamAV on apache.org ------_=_NextPart_001_01C90C31.5E8B944F Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi, Can some one please help me in providing a solution for my problem: I have a single field defined in my document. Now I want to do a MultiPhraseQuery - but at the beginning of the field.=20 For e.g: If there are 3 documents with single field ( say 'title' ) has the values -> "Hello Love you", "Love You Sister", "Love Yoxyz"=20 Then my search for "Love yo*" -> MultiPhraseQuery with first term "Love" ( using addTerm("Love") and the next terms ( using addTerms("Yo*" - after getting all terms 'You' and 'Yoxyz' using IndexReader.terms(Yo) ) should return only the documents "Love You Sister", "Love Yoxyz" - but not "Hello Love you". Can some one please help me on how to get it done. Regards, Vinay ------_=_NextPart_001_01C90C31.5E8B944F Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN"> <HTML> <HEAD> <META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; = charset=3Dus-ascii"> <META NAME=3D"Generator" CONTENT=3D"MS Exchange Server version = 6.5.7653.3"> <TITLE>Multi Phrase Search at the Beginning of a field</TITLE> </HEAD> <BODY> <!-- Converted from text/rtf format --> <P><FONT SIZE=3D2 FACE=3D"Arial">Hi,</FONT> </P> <P><FONT SIZE=3D2 FACE=3D"Arial">Can some one please help me in = providing a solution for my problem:</FONT> </P> <P><FONT SIZE=3D2 FACE=3D"Arial">I have a single field defined in my = document. Now I want to do a MultiPhraseQuery - but at the beginning of = the field. </FONT> </P> <P><FONT SIZE=3D2 FACE=3D"Arial">For e.g: If there are 3 documents with = single field ( say 'title' ) has the values -&gt; &quot;Hello Love = you&quot;, &quot;Love You Sister&quot;, &quot;Love Yoxyz&quot; = </FONT></P> <P><FONT SIZE=3D2 FACE=3D"Arial">Then my search for &quot;Love yo*&quot; = -&gt;&nbsp; MultiPhraseQuery with first term &quot;Love&quot; ( using = addTerm(&quot;Love&quot;) and the next terms ( using = addTerms(&quot;Yo*&quot;&nbsp; - after getting all terms 'You' and = 'Yoxyz' using IndexReader.terms(Yo) ) should return only the documents = &quot;Love You Sister&quot;, &quot;Love Yoxyz&quot; - but not = &quot;Hello Love you&quot;.</FONT></P> <P><FONT SIZE=3D2 FACE=3D"Arial">Can some one please help me on how to = get it done.</FONT> </P> <BR> <P><FONT SIZE=3D2 FACE=3D"Arial">Regards,</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">Vinay</FONT> </P> </BODY> </HTML> ------_=_NextPart_001_01C90C31.5E8B944F-- From java-devzlewis@example.net Mon Sep 01 13:40:02 2008 Return-Path: <java-devzlewis@example.net> Delivered-To: zlewis@example.net Received: (qmail 55209 invoked from network); 1 Sep 2008 13:40:02 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Sep 2008 13:40:02 -0000 Received: (qmail 51164 invoked by uid 500); 1 Sep 2008 13:39:54 -0000 Delivered-To: zlewis@example.net Received: (qmail 51121 invoked by uid 500); 1 Sep 2008 13:39:54 -0000 Mailing-List: contact zlewis@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:zlewis@example.net> List-Unsubscribe: <mailto:zlewis@example.net> List-Post: <mailto:zlewis@example.net> List-Id: <java-dev.lucene.apache.org> Reply-To: zlewis@example.net Delivered-To: mailing list zlewis@example.net Received: (qmail 51112 invoked by uid 99); 1 Sep 2008 13:39:54 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Sep 2008 06:39:54 -0700 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [83.161.120.155] (HELO qb-out-0506.google.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Sep 2008 13:38:54 +0000 Received: by qb-out-0506.google.com with SMTP id o24so1228683qba.1 for <zlewis@example.net>; Mon, 01 Sep 2008 06:39:22 -0700 (PDT) Received: by 83.161.120.155 with SMTP id n11mr4590267fga.64.1220276362041; Mon, 01 Sep 2008 06:39:22 -0700 (PDT) Received: from ?83.161.120.155? ( [83.161.120.155]) by mx.google.com with ESMTPS id l12sm6623743fgb.6.283.161.120.155.39.21 (version=TLSv1/SSLv3 cipher=RC4-MD5); Mon, 01 Sep 2008 06:39:21 -0700 (PDT) Subject: Re: Multi Phrase Search at the Beginning of a field From: Andraz Tori <zlewis@example.net> To: zlewis@example.net In-Reply-To: <zlewis@example.net> References: <zlewis@example.net> Content-Type: text/plain; charset=utf-8 Organization: Zemanta Date: Mon, 01 Sep 2008 15:38:38 +0200 Message-Id: <1220276318.6099.111.camel@localhost> Mime-Version: 1.0 X-Mailer: Evolution 83.161.120.155 Content-Transfer-Encoding: 8bit X-Virus-Checked: Checked by ClamAV on apache.org You can use standard trick. Insert a special token at the beginning of every field you are indexing, and add that special token to beginning of every query. Since this token will not occur anywhere else in the field, you will know that your queries match only beginnings of fields bye andraz On Mon, 2008-09-01 at 15:50 +0300, zlewis@example.net wrote: > Hi, > > Can some one please help me in providing a solution for my problem: > > I have a single field defined in my document. Now I want to do a > MultiPhraseQuery - but at the beginning of the field. > > For e.g: If there are 3 documents with single field ( say 'title' ) > has the values -> "Hello Love you", "Love You Sister", "Love Yoxyz" > > Then my search for "Love yo*" -> MultiPhraseQuery with first term > "Love" ( using addTerm("Love") and the next terms ( using > addTerms("Yo*" - after getting all terms 'You' and 'Yoxyz' using > IndexReader.terms(Yo) ) should return only the documents "Love You > Sister", "Love Yoxyz" - but not "Hello Love you". > > Can some one please help me on how to get it done. > > > Regards, > Vinay > -- Andraz Tori, CTO Zemanta Ltd, London, Ljubljana www.zemanta.com mail: zlewis@example.net tel: +1-706-882-4860 twitter: andraz, skype: minmax_test --------------------------------------------------------------------- To unsubscribe, e-mail: zlewis@example.net For additional commands, e-mail: zlewis@example.net From java-devzlewis@example.net Mon Sep 01 20:41:36 2008 Return-Path: <java-devzlewis@example.net> Delivered-To: zlewis@example.net Received: (qmail 93004 invoked from network); 1 Sep 2008 20:41:36 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Sep 2008 20:41:36 -0000 Received: (qmail 1867 invoked by uid 500); 1 Sep 2008 20:41:33 -0000 Delivered-To: zlewis@example.net Received: (qmail 1817 invoked by uid 500); 1 Sep 2008 20:41:33 -0000 Mailing-List: contact zlewis@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:zlewis@example.net> List-Unsubscribe: <mailto:zlewis@example.net> List-Post: <mailto:zlewis@example.net> List-Id: <java-dev.lucene.apache.org> Reply-To: zlewis@example.net Delivered-To: mailing list zlewis@example.net Received: (qmail 1807 invoked by uid 99); 1 Sep 2008 20:41:33 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Sep 2008 13:41:33 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Sep 2008 20:40:43 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 40440234C1C6 for <zlewis@example.net>; Mon, 1 Sep 2008 13:40:44 -0700 (PDT) Message-ID: <1673248367.1220301644262.JavaMail.jira@brutus> Date: Mon, 1 Sep 2008 13:40:44 -0700 (PDT) From: "Chris Harris (JIRA)" <zlewis@example.net> To: zlewis@example.net Subject: [jira] Updated: (LUCENE-1370) Patch to make ShingleFilter output a unigram if no ngrams can be generated In-Reply-To: <1433805798.1220050664247.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/LUCENE-1370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Harris updated LUCENE-1370: --------------------------------- Attachment: LUCENE-1370.patch Fixing to merge cleanly against changes made in r687359. The patch file will also now have a proper name, LUCENE-1370.patch. > Patch to make ShingleFilter output a unigram if no ngrams can be generated > -------------------------------------------------------------------------- > > Key: LUCENE-1370 > URL: https://issues.apache.org/jira/browse/LUCENE-1370 > Project: Lucene - Java > Issue Type: Improvement > Components: contrib/analyzers > Reporter: Chris Harris > Attachments: LUCENE-1370.patch, ShingleFilter.patch > > > Currently if ShingleFilter.outputUnigrams==false and the underlying token stream is only one token long, then ShingleFilter.next() won't return any tokens. This patch provides a new option, outputUnigramIfNoNgrams; if this option is set and the underlying stream is only one token long, then ShingleFilter will return that token, regardless of the setting of outputUnigrams. > My use case here is speeding up phrase queries. The technique is as follows: > First, doing index-time analysis using ShingleFilter (using outputUnigrams==true), thereby expanding things as follows: > "please divide this sentence into shingles" -> > "please", "please divide" > "divide", "divide this" > "this", "this sentence" > "sentence", "sentence into" > "into", "into shingles" > "shingles" > Second, do query-time analysis using ShingleFilter (using outputUnigrams==false and outputUnigramIfNoNgrams==true). If the user enters a phrase query, it will get tokenized in the following manner: > "please divide this sentence into shingles" -> > "please divide" > "divide this" > "this sentence" > "sentence into" > "into shingles" > By doing phrase queries with bigrams like this, I can gain a very considerable speedup. Without the outputUnigramIfNoNgrams option, then a single word query would tokenize like this: > "please" -> > [no tokens] > But thanks to outputUnigramIfNoNgrams, single words will now tokenize like this: > "please" -> > "please" > **** > The patch also adds a little to the pre-outputUnigramIfNoNgrams option tests. > **** > I'm not sure if the patch in this state is useful to anyone else, but I thought I should throw it up here and try to find out. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. --------------------------------------------------------------------- To unsubscribe, e-mail: zlewis@example.net For additional commands, e-mail: zlewis@example.net From java-devzlewis@example.net Mon Sep 01 20:43:06 2008 Return-Path: <java-devzlewis@example.net> Delivered-To: zlewis@example.net Received: (qmail 93604 invoked from network); 1 Sep 2008 20:43:06 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Sep 2008 20:43:06 -0000 Received: (qmail 6103 invoked by uid 500); 1 Sep 2008 20:43:04 -0000 Delivered-To: zlewis@example.net Received: (qmail 5433 invoked by uid 500); 1 Sep 2008 20:43:03 -0000 Mailing-List: contact zlewis@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:zlewis@example.net> List-Unsubscribe: <mailto:zlewis@example.net> List-Post: <mailto:zlewis@example.net> List-Id: <java-dev.lucene.apache.org> Reply-To: zlewis@example.net Delivered-To: mailing list zlewis@example.net Received: (qmail 5420 invoked by uid 99); 1 Sep 2008 20:43:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Sep 2008 13:43:03 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Sep 2008 20:42:13 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 34296234C1C3 for <zlewis@example.net>; Mon, 1 Sep 2008 13:42:44 -0700 (PDT) Message-ID: <317575924.1220301764198.JavaMail.jira@brutus> Date: Mon, 1 Sep 2008 13:42:44 -0700 (PDT) From: "Chris Harris (JIRA)" <zlewis@example.net> To: zlewis@example.net Subject: [jira] Issue Comment Edited: (LUCENE-1370) Patch to make ShingleFilter output a unigram if no ngrams can be generated In-Reply-To: <1433805798.1220050664247.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/LUCENE-1370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12627533#action_12627533 ] ryguasu edited comment on LUCENE-1370 at 9/1/08 1:40 PM: -------------------------------------------------------------- Fixing to merge cleanly against changes made in r687357. The patch file will also now have a proper name, LUCENE-1370.patch. was (Author: ryguasu): Fixing to merge cleanly against changes made in r687359. The patch file will also now have a proper name, LUCENE-1370.patch. > Patch to make ShingleFilter output a unigram if no ngrams can be generated > -------------------------------------------------------------------------- > > Key: LUCENE-1370 > URL: https://issues.apache.org/jira/browse/LUCENE-1370 > Project: Lucene - Java > Issue Type: Improvement > Components: contrib/analyzers > Reporter: Chris Harris > Attachments: LUCENE-1370.patch, ShingleFilter.patch > > > Currently if ShingleFilter.outputUnigrams==false and the underlying token stream is only one token long, then ShingleFilter.next() won't return any tokens. This patch provides a new option, outputUnigramIfNoNgrams; if this option is set and the underlying stream is only one token long, then ShingleFilter will return that token, regardless of the setting of outputUnigrams. > My use case here is speeding up phrase queries. The technique is as follows: > First, doing index-time analysis using ShingleFilter (using outputUnigrams==true), thereby expanding things as follows: > "please divide this sentence into shingles" -> > "please", "please divide" > "divide", "divide this" > "this", "this sentence" > "sentence", "sentence into" > "into", "into shingles" > "shingles" > Second, do query-time analysis using ShingleFilter (using outputUnigrams==false and outputUnigramIfNoNgrams==true). If the user enters a phrase query, it will get tokenized in the following manner: > "please divide this sentence into shingles" -> > "please divide" > "divide this" > "this sentence" > "sentence into" > "into shingles" > By doing phrase queries with bigrams like this, I can gain a very considerable speedup. Without the outputUnigramIfNoNgrams option, then a single word query would tokenize like this: > "please" -> > [no tokens] > But thanks to outputUnigramIfNoNgrams, single words will now tokenize like this: > "please" -> > "please" > **** > The patch also adds a little to the pre-outputUnigramIfNoNgrams option tests. > **** > I'm not sure if the patch in this state is useful to anyone else, but I thought I should throw it up here and try to find out. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. --------------------------------------------------------------------- To unsubscribe, e-mail: zlewis@example.net For additional commands, e-mail: zlewis@example.net From java-devzlewis@example.net Mon Sep 01 20:45:07 2008 Return-Path: <java-devzlewis@example.net> Delivered-To: zlewis@example.net Received: (qmail 94855 invoked from network); 1 Sep 2008 20:45:06 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Sep 2008 20:45:06 -0000 Received: (qmail 9845 invoked by uid 500); 1 Sep 2008 20:45:04 -0000 Delivered-To: zlewis@example.net Received: (qmail 9182 invoked by uid 500); 1 Sep 2008 20:45:03 -0000 Mailing-List: contact zlewis@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:zlewis@example.net> List-Unsubscribe: <mailto:zlewis@example.net> List-Post: <mailto:zlewis@example.net> List-Id: <java-dev.lucene.apache.org> Reply-To: zlewis@example.net Delivered-To: mailing list zlewis@example.net Received: (qmail 9167 invoked by uid 99); 1 Sep 2008 20:45:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Sep 2008 13:45:03 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Sep 2008 20:44:13 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 47370234C1C6 for <zlewis@example.net>; Mon, 1 Sep 2008 13:44:44 -0700 (PDT) Message-ID: <2111211904.1220301884290.JavaMail.jira@brutus> Date: Mon, 1 Sep 2008 13:44:44 -0700 (PDT) From: "Chris Harris (JIRA)" <zlewis@example.net> To: zlewis@example.net Subject: [jira] Updated: (LUCENE-1370) Patch to make ShingleFilter output a unigram if no ngrams can be generated In-Reply-To: <1433805798.1220050664247.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/LUCENE-1370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Harris updated LUCENE-1370: --------------------------------- Attachment: LUCENE-1370.patch Getting rid of Windows-style newlines > Patch to make ShingleFilter output a unigram if no ngrams can be generated > -------------------------------------------------------------------------- > > Key: LUCENE-1370 > URL: https://issues.apache.org/jira/browse/LUCENE-1370 > Project: Lucene - Java > Issue Type: Improvement > Components: contrib/analyzers > Reporter: Chris Harris > Attachments: LUCENE-1370.patch, LUCENE-1370.patch, ShingleFilter.patch > > > Currently if ShingleFilter.outputUnigrams==false and the underlying token stream is only one token long, then ShingleFilter.next() won't return any tokens. This patch provides a new option, outputUnigramIfNoNgrams; if this option is set and the underlying stream is only one token long, then ShingleFilter will return that token, regardless of the setting of outputUnigrams. > My use case here is speeding up phrase queries. The technique is as follows: > First, doing index-time analysis using ShingleFilter (using outputUnigrams==true), thereby expanding things as follows: > "please divide this sentence into shingles" -> > "please", "please divide" > "divide", "divide this" > "this", "this sentence" > "sentence", "sentence into" > "into", "into shingles" > "shingles" > Second, do query-time analysis using ShingleFilter (using outputUnigrams==false and outputUnigramIfNoNgrams==true). If the user enters a phrase query, it will get tokenized in the following manner: > "please divide this sentence into shingles" -> > "please divide" > "divide this" > "this sentence" > "sentence into" > "into shingles" > By doing phrase queries with bigrams like this, I can gain a very considerable speedup. Without the outputUnigramIfNoNgrams option, then a single word query would tokenize like this: > "please" -> > [no tokens] > But thanks to outputUnigramIfNoNgrams, single words will now tokenize like this: > "please" -> > "please" > **** > The patch also adds a little to the pre-outputUnigramIfNoNgrams option tests. > **** > I'm not sure if the patch in this state is useful to anyone else, but I thought I should throw it up here and try to find out. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. --------------------------------------------------------------------- To unsubscribe, e-mail: zlewis@example.net For additional commands, e-mail: zlewis@example.net From java-devzlewis@example.net Tue Sep 02 03:29:44 2008 Return-Path: <java-devzlewis@example.net> Delivered-To: zlewis@example.net Received: (qmail 3552 invoked from network); 2 Sep 2008 03:29:44 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Sep 2008 03:29:44 -0000 Received: (qmail 16968 invoked by uid 500); 2 Sep 2008 03:29:36 -0000 Delivered-To: zlewis@example.net Received: (qmail 16920 invoked by uid 500); 2 Sep 2008 03:29:36 -0000 Mailing-List: contact zlewis@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:zlewis@example.net> List-Unsubscribe: <mailto:zlewis@example.net> List-Post: <mailto:zlewis@example.net> List-Id: <java-dev.lucene.apache.org> Reply-To: zlewis@example.net Delivered-To: mailing list zlewis@example.net Received: (qmail 16911 invoked by uid 99); 2 Sep 2008 03:29:35 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Sep 2008 20:29:35 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hudson.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Sep 2008 03:28:45 +0000 Received: from hudson.zones.apache.org (localhost [83.161.120.155]) by hudson.zones.apache.org (8.13.8+Sun/8.13.8) with ESMTP id m823Ljph003499 for <zlewis@example.net>; Mon, 1 Sep 2008 23:21:45 -0400 (EDT) Date: Tue, 2 Sep 2008 03:21:45 +0000 (UTC) From: Apache Hudson Server <zlewis@example.net> To: zlewis@example.net Message-ID: <zlewis@example.net> In-Reply-To: <zlewis@example.net> References: <zlewis@example.net> Subject: Hudson build is back to normal: Lucene-trunk #574 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org See http://hudson.zones.apache.org/hudson/job/Lucene-trunk/574/changes --------------------------------------------------------------------- To unsubscribe, e-mail: zlewis@example.net For additional commands, e-mail: zlewis@example.net From java-devzlewis@example.net Tue Sep 02 07:05:23 2008 Return-Path: <java-devzlewis@example.net> Delivered-To: zlewis@example.net Received: (qmail 24532 invoked from network); 2 Sep 2008 07:05:23 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Sep 2008 07:05:23 -0000 Received: (qmail 53318 invoked by uid 500); 2 Sep 2008 07:05:15 -0000 Delivered-To: zlewis@example.net Received: (qmail 53267 invoked by uid 500); 2 Sep 2008 07:05:15 -0000 Mailing-List: contact zlewis@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:zlewis@example.net> List-Unsubscribe: <mailto:zlewis@example.net> List-Post: <mailto:zlewis@example.net> List-Id: <java-dev.lucene.apache.org> Reply-To: zlewis@example.net Delivered-To: mailing list zlewis@example.net Received: (qmail 53258 invoked by uid 99); 2 Sep 2008 07:05:15 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Sep 2008 00:05:15 -0700 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [83.161.120.155] (HELO smtp-vbr10.xs4all.nl) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Sep 2008 07:04:16 +0000 Received: from k8u.lan (porta.xs4all.nl [83.161.120.155]) by smtp-vbr10.xs4all.nl (8.13.8/8.13.8) with ESMTP id m8274FRH035699 for <zlewis@example.net>; Tue, 2 Sep 2008 09:04:16 +0200 (CEST) (envelope-from zlewis@example.net) From: Paul Elschot <zlewis@example.net> To: zlewis@example.net Subject: Re: SpanNearQuery: All matches within slop Date: Tue, 2 Sep 2008 09:04:15 +0200 User-Agent: KMail/1.9.9 References: <zlewis@example.net> <zlewis@example.net> In-Reply-To: <zlewis@example.net> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <zlewis@example.net> X-Virus-Scanned: by XS4ALL Virus Scanner X-Virus-Checked: Checked by ClamAV on apache.org A bit late in reacting, but you may also may want to take a look at this: Paolo Boldi, Sebastiano Vigna Efficient Optimally Lazy Algorithms for Minimal-Interval Semantics Oct 2007, arXiv:0710.1525v1 The algorithms used in the lucene spans package are surprisingly similar. Nevertheless, there are some differences too, especially in the queue ordering conditions. Regards, Paul Elschot Op Thursday 28 August 2008 01:09:51 schreef Mark Miller: > Its a matter of speed. Once you know the document matches the query, > it would in general, make no sense to keep looking unless you had a > strong reason to factor it into scoring. So I don't think it makes > much sense to modify...now adding new Span classes... > > > Is there any > > general interest in modifying NearSpanOrdered/NearSpanUnordered to > > include all possible spans? > > > > Thanks, > > > > Nathan > > --------------------------------------------------------------------- > To unsubscribe, e-mail: zlewis@example.net > For additional commands, e-mail: zlewis@example.net --------------------------------------------------------------------- To unsubscribe, e-mail: zlewis@example.net For additional commands, e-mail: zlewis@example.net From java-devzlewis@example.net Tue Sep 02 09:07:38 2008 Return-Path: <java-devzlewis@example.net> Delivered-To: zlewis@example.net Received: (qmail 76869 invoked from network); 2 Sep 2008 09:07:37 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Sep 2008 09:07:37 -0000 Received: (qmail 41017 invoked by uid 500); 2 Sep 2008 09:07:34 -0000 Delivered-To: zlewis@example.net Received: (qmail 40977 invoked by uid 500); 2 Sep 2008 09:07:33 -0000 Mailing-List: contact zlewis@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:zlewis@example.net> List-Unsubscribe: <mailto:zlewis@example.net> List-Post: <mailto:zlewis@example.net> List-Id: <java-dev.lucene.apache.org> Reply-To: zlewis@example.net Delivered-To: mailing list zlewis@example.net Received: (qmail 40967 invoked by uid 99); 2 Sep 2008 09:07:33 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Sep 2008 02:07:33 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Sep 2008 09:06:44 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id E1F23234C1D1 for <zlewis@example.net>; Tue, 2 Sep 2008 02:06:44 -0700 (PDT) Message-ID: <1812931297.1220346404924.JavaMail.jira@brutus> Date: Tue, 2 Sep 2008 02:06:44 -0700 (PDT) From: "Karl Wettin (JIRA)" <zlewis@example.net> To: zlewis@example.net Subject: [jira] Commented: (LUCENE-1313) Ocean Realtime Search In-Reply-To: <1125794672.1214154225042.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/LUCENE-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12627612#action_12627612 ] Karl Wettin commented on LUCENE-1313: ------------------------------------- Hi Jason, I took an inital look at your code last night. Didn't actually execute anything, just followed method calls around to see what it was up to. My first comment is sort of boring, but there are virtually no javadocs for the core classes such as TransactionSystem, Batch and Index. It would be great if there was a bit at the class level exaplaining what classes they interact with and how. It would also be very helpful if there was method level javadocs for at least the top level commit related logic. One thing that early cought my attention is this method in TransactionSystem: {code:java} public OceanSearcher getSearcher() throws IOException { Snapshot snapshot = snapshots.getLatestSnapshot(); if (searcherPolicy instanceof SingleThreadSearcherPolicy) { return new OceanSearcher(snapshot); } else { return new OceanMultiThreadSearcher(snapshot, searchThreadPool); } } {code} Am I supposed to call this method for each query (as suggested by the method name) or is this a factory method used to update my own Searcher instance after committing documents to the index (as suggested by the code)? It's not such a big deal, but I personally think you should refactor the instanceOf to a Policy.searcherFactory method, or perhaps even a SearcherPolicyVisitor. Actually, this goes for a few other places in the module too: you have used instanceOf and unchecked casting a bit more extensive to solve problems than what I would have. But as it does not seem to be used in places where it would be a costrly thing to do these comments are mearly about code readability and gut feelings about future problems. I'm a bit concerned about the potential loss of data while documents only resides in InstantiatedIndex or RAMDirectory. I think I'd like an option on some sort of transaction log that could be played up in case of a crash. I think the easiset way would be to convert all documents to be pre-analyzed (field.tokenStream) before passing them on to the instantiated writer. I don't know how much resources that might consume, but it would make me feel safer. karl > Ocean Realtime Search > --------------------- > > Key: LUCENE-1313 > URL: https://issues.apache.org/jira/browse/LUCENE-1313 > Project: Lucene - Java > Issue Type: New Feature > Components: contrib/* > Reporter: Jason Rutherglen > Attachments: lucene-1313.patch, lucene-1313.patch, lucene-1313.patch, lucene-1313.patch > > > Provides realtime search using Lucene. Conceptually, updates are divided into discrete transactions. The transaction is recorded to a transaction log which is similar to the mysql bin log. Deletes from the transaction are made to the existing indexes. Document additions are made to an in memory InstantiatedIndex. The transaction is then complete. After each transaction TransactionSystem.getSearcher() may be called which allows searching over the index including the latest transaction. > TransactionSystem is the main class. Methods similar to IndexWriter are provided for updating. getSearcher returns a Searcher class. > - getSearcher() > - addDocument(Document document) > - addDocument(Document document, Analyzer analyzer) > - updateDocument(Term term, Document document) > - updateDocument(Term term, Document document, Analyzer analyzer) > - deleteDocument(Term term) > - deleteDocument(Query query) > - commitTransaction(List<Document> documents, Analyzer analyzer, List<Term> deleteByTerms, List<Query> deleteByQueries) > Sample code: > {code} > // setup > FSDirectoryMap directoryMap = new FSDirectoryMap(new File("/testocean"), "log"); > LogDirectory logDirectory = directoryMap.getLogDirectory(); > TransactionLog transactionLog = new TransactionLog(logDirectory); > TransactionSystem system = new TransactionSystem(transactionLog, new SimpleAnalyzer(), directoryMap); > // transaction > Document d = new Document(); > d.add(new Field("contents", "hello world", Field.Store.YES, Field.Index.TOKENIZED)); > system.addDocument(d); > // search > OceanSearcher searcher = system.getSearcher(); > ScoreDoc[] hits = searcher.search(query, null, 1000).scoreDocs; > System.out.println(hits.length + " total results"); > for (int i = 0; i < hits.length && i < 10; i++) { > Document d = searcher.doc(hits[i].doc); > System.out.println(i + " " + hits[i].score+ " " + d.get("contents"); > } > {code} > There is a test class org.apache.lucene.ocean.TestSearch that was used for basic testing. > A sample disk directory structure is as follows: > |/snapshot_105_00.xml | XML file containing which indexes and their generation numbers correspond to a snapshot. Each transaction creates a new snapshot file. In this file the 105 is the snapshotid, also known as the transactionid. The 00 is the minor version of the snapshot corresponding to a merge. A merge is a minor snapshot version because the data does not change, only the underlying structure of the index| > |/3 | Directory containing an on disk Lucene index| > |/log | Directory containing log files| > |/log/log00000001.bin | Log file. As new log files are created the suffix number is incremented| -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. --------------------------------------------------------------------- To unsubscribe, e-mail: zlewis@example.net For additional commands, e-mail: zlewis@example.net From java-devzlewis@example.net Tue Sep 02 09:31:14 2008 Return-Path: <java-devzlewis@example.net> Delivered-To: zlewis@example.net Received: (qmail 86254 invoked from network); 2 Sep 2008 09:31:12 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Sep 2008 09:31:12 -0000 Received: (qmail 66183 invoked by uid 500); 2 Sep 2008 09:31:08 -0000 Delivered-To: zlewis@example.net Received: (qmail 66138 invoked by uid 500); 2 Sep 2008 09:31:08 -0000 Mailing-List: contact zlewis@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:zlewis@example.net> List-Unsubscribe: <mailto:zlewis@example.net> List-Post: <mailto:zlewis@example.net> List-Id: <java-dev.lucene.apache.org> Reply-To: zlewis@example.net Delivered-To: mailing list zlewis@example.net Received: (qmail 66129 invoked by uid 99); 2 Sep 2008 09:31:08 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Sep 2008 02:31:08 -0700 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [83.161.120.155] (HELO hermes-uno.uned.es) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Sep 2008 09:30:06 +0000 Received: from hermes-uno.uned.es (localhost.localdomain [83.161.120.155]) by localhost.uned.es (Postfix) with ESMTP id 3C8C930D380; Tue, 2 Sep 2008 11:30:35 +0200 (CEST) Received: from [83.161.120.155] (gabarra.lsi.uned.es [83.161.120.155]) by hermes-uno.uned.es (Postfix) with ESMTP id 22AA830D377; Tue, 2 Sep 2008 11:30:35 +0200 (CEST) Message-ID: <zlewis@example.net> Date: Tue, 02 Sep 2008 11:28:05 +0200 From: Joaquin Perez Iglesias <zlewis@example.net> Reply-To: zlewis@example.net Organization: LSI UNED User-Agent: Thunderbird 83.161.120.155 (X11/20080724) MIME-Version: 1.0 To: zlewis@example.net Cc: zlewis@example.net, zlewis@example.net Subject: Re: Summer of Code idea for lucene References: <zlewis@example.net> In-Reply-To: <zlewis@example.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit X-Virus-Checked: Checked by ClamAV on apache.org Hi all, finally I got some time to finish the BM25/BM25F implementation for Lucene you can find more details at http://nlp.uned.es/~jperezi/Lucene-BM25/, it has been tested but I cannot assure that is bugs free. It would be great to receive some feedback about it. There are some details about the implementation that I consider will be of interest,as how to calculate the average_length or idf at document level. Please if you find any bug or mistake in the supplied implementation let me know and I will try to solve it, same for questions. Hope that some of you will find useful. Thanks in advance. zlewis@example.net escribió: > Hi Otis, > > as my colleague said, we have a first implementation of BM25 over Lucene, this development is part of a (almost finished) thesis project that compares different IR models, over an standard collection. At the same time we are trying to extend this first implementation in order to support BM25F for multifield queries, unfortunately at this time we are too busy to prepare a final version of this code, so we will have to finish this code over the summer (hopefully we will have more time :-))), and make it public at this time. > > We will inform to this list when we will finish the preparation of a final version. > > Thanks to everybody for the interest!!! > > Bye > Joaquin > > ----------------------------------------------------------- > Joaquín Pérez Iglesias > Dpto. Lenguajes y Sistemas Informáticos > E.T.S.I. Informática (UNED) > Ciudad Universitaria > C/ Juan del Rosal nº 16 > 28040 Madrid - Spain > Phone. +1-706-882-4860 > Fax +1-706-882-4860 > Office 2.07 > Email: zlewis@example.net > ----------------------------------------------------------- > Otis Gospodnetic <zlewis@example.net> escribe : > > >> Hi Jose, >> >> I was wondering if you ever got to this. I would love to see and try BM25 for >> Lucene! >> >> >> I'm looking at http://code.google.com/soc/2008/asf/about.html >> and it looks like this didn't make it into GSoC, but this would still be great >> to have. >> >> Thanks, >> Otis >> -- >> Sematext -- http://sematext.com/ -- >> Lucene - Solr - Nutch >> >> >> ----- Original Message ---- >> >>> From: José Ramón Pérez Agüera <zlewis@example.net> >>> To: zlewis@example.net; >>> >> Joaquin Perez-Iglesias <zlewis@example.net> >> >>> Sent: Saturday, March 15, 2008 4:54:08 AM >>> Subject: Re: Summer of Code idea for lucene >>> >>> we have almost implemented BM25 using lucene structure, but we need >>> help to finish query parser and other details. If you o somebody want >>> We can send you the code and you can help us to implement the query >>> parser and prepare the code to sandbox. >>> >>> If there are people interested I can made a web page for the project >>> and put our implementatio to download >>> >>> Somebody is interested? >>> >>> jose >>> >>> -- >>> José Ramón Pérez Agüera >>> >>> Dept. de Ingeniería del Software e Inteligencia Artificial >>> Despacho 411 tlf. 913947599 >>> Facultad de Informática >>> Universidad Complutense de Madrid >>> >>> On Sat, Mar 15, 2008 at 5:32 AM, Ian Holsman wrote: >>> >>>> If no one objects (I don't think it's too late) >>>> >>>> would you mind a GSOC project to implement BM25 >>>> >> relevancy/scoring? >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: zlewis@example.net >> For additional commands, e-mail: zlewis@example.net >> > > ________________________________________________ > Servicio WebMail de CiberUNED http://www.uned.es > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: zlewis@example.net > For additional commands, e-mail: zlewis@example.net > > > -- ----------------------------------------------------------- Joaquín Pérez Iglesias Dpto. Lenguajes y Sistemas Informáticos E.T.S.I. Informática (UNED) Ciudad Universitaria C/ Juan del Rosal nº 16 28040 Madrid - Spain Phone. +1-706-882-4860 Fax +1-706-882-4860 Office 2.07 Email: zlewis@example.net web: http://nlp.uned.es/~jperezi/ ----------------------------------------------------------- --------------------------------------------------------------------- To unsubscribe, e-mail: zlewis@example.net For additional commands, e-mail: zlewis@example.net From java-devzlewis@example.net Tue Sep 02 10:08:55 2008 Return-Path: <java-devzlewis@example.net> Delivered-To: zlewis@example.net Received: (qmail 4279 invoked from network); 2 Sep 2008 10:08:54 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Sep 2008 10:08:54 -0000 Received: (qmail 9467 invoked by uid 500); 2 Sep 2008 10:08:42 -0000 Delivered-To: zlewis@example.net Received: (qmail 9303 invoked by uid 500); 2 Sep 2008 10:08:41 -0000 Mailing-List: contact zlewis@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:zlewis@example.net> List-Unsubscribe: <mailto:zlewis@example.net> List-Post: <mailto:zlewis@example.net> List-Id: <java-dev.lucene.apache.org> Reply-To: zlewis@example.net Delivered-To: mailing list zlewis@example.net Received: (qmail 9243 invoked by uid 99); 2 Sep 2008 10:08:40 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Sep 2008 03:08:40 -0700 X-ASF-Spam-Status: No, hits=2.0 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of zlewis@example.net designates 83.161.120.155 as permitted sender) Received: from [83.161.120.155] (HELO mu-out-0910.google.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Sep 2008 10:07:42 +0000 Received: by mu-out-0910.google.com with SMTP id i10so2214587mue.5 for <zlewis@example.net>; Tue, 02 Sep 2008 03:07:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type; bh=IVar2nCIT6YmtIuYNOinj9atqZKVh05ynLgg0vb5Rek=; b=SWB0swSjY8pevK3wuoKVwP10uAhrqKWrxhD51xQt1xMhnl9ds0AZ1kzTR0xjQ/+Ry6 0DhiW40k7DiRrpRVH7C9xJNLsd4snfFOv19zxKyrtMLNlMAQ3RPbLPTI1Kg7qjoiLvU8 MHyvHzX7ESs579veB1wbiWZ1DOrDQo4bqbKJg= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type; b=dpHjKF+DpOR9IKugR1wCzmDrGoORuSh5EApQt3sVEtYu+2XWOGRswUkUkoNG66qCdn rLZB1KfgYh+EiGj1h0OssUcVJ3yO6T+K9dqJnbIRyUGpy+nzmFCLae7A0v32sYr34Nkc 4PeFBb0UBaxyEaBbTugQp4lyCbkLCxrjaEdxs= Received: by 83.161.120.155 with SMTP id r1mr5085224muh.25.1220350073988; Tue, 02 Sep 2008 03:07:53 -0700 (PDT) Received: by 83.161.120.155 with HTTP; Tue, 2 Sep 2008 03:07:53 -0700 (PDT) Message-ID: <zlewis@example.net> Date: Tue, 2 Sep 2008 13:07:53 +0300 From: "Shai Erera" <zlewis@example.net> To: zlewis@example.net Subject: Moving SweetSpotSimilarity out of contrib MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_3546_24314348.1220350073967" X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_3546_24314348.1220350073967
{'source': 'Apache Software Foundation Public Mail Archives'}