From osmith@example.org Fri Apr 01 04:03:01 2011 Return-Path: <osmith@example.org> Delivered-To: osmith@example.org Received: (qmail 40275 invoked from network); 1 Apr 2011 04:03:00 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 04:03:00 -0000 Received: (qmail 9398 invoked by uid 500); 1 Apr 2011 04:03:00 -0000 Delivered-To: osmith@example.org Received: (qmail 9209 invoked by uid 500); 1 Apr 2011 04:02:46 -0000 Mailing-List: contact osmith@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:osmith@example.org> List-Unsubscribe: <mailto:osmith@example.org> List-Post: <mailto:osmith@example.org> List-Id: <dev.nutch.apache.org> Reply-To: osmith@example.org Delivered-To: mailing list osmith@example.org Received: (qmail 9199 invoked by uid 99); 1 Apr 2011 04:02:43 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 04:02:43 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO aegis.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 04:02:39 +0000 Received: from aegis (localhost [83.161.120.155]) by aegis.apache.org (Postfix) with ESMTP id B65D7C0013 for <osmith@example.org>; Fri, 1 Apr 2011 04:02:17 +0000 (UTC) Date: Fri, 1 Apr 2011 04:02:17 +0000 (UTC) From: Apache Hudson Server <osmith@example.org> To: osmith@example.org Message-ID: <681807261.12241301630537745.JavaMail.hudson@aegis> In-Reply-To: <611967192.10871301544158429.JavaMail.hudson@aegis> References: <611967192.10871301544158429.JavaMail.hudson@aegis> Subject: Build failed in Jenkins: Nutch-trunk #1443 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org See <https://hudson.apache.org/hudson/job/Nutch-trunk/1443/> ------------------------------------------ [...truncated 1009 lines...] A src/plugin/subcollection/src/java/org/apache/nutch/collection A src/plugin/subcollection/src/java/org/apache/nutch/collection/Subcollection.java A src/plugin/subcollection/src/java/org/apache/nutch/collection/CollectionManager.java A src/plugin/subcollection/src/java/org/apache/nutch/collection/package.html A src/plugin/subcollection/src/java/org/apache/nutch/indexer A src/plugin/subcollection/src/java/org/apache/nutch/indexer/subcollection A src/plugin/subcollection/src/java/org/apache/nutch/indexer/subcollection/SubcollectionIndexingFilter.java A src/plugin/subcollection/README.txt A src/plugin/subcollection/plugin.xml A src/plugin/subcollection/build.xml A src/plugin/index-more A src/plugin/index-more/ivy.xml A src/plugin/index-more/src A src/plugin/index-more/src/test A src/plugin/index-more/src/test/org A src/plugin/index-more/src/test/org/apache A src/plugin/index-more/src/test/org/apache/nutch A src/plugin/index-more/src/test/org/apache/nutch/indexer A src/plugin/index-more/src/test/org/apache/nutch/indexer/more A src/plugin/index-more/src/test/org/apache/nutch/indexer/more/TestMoreIndexingFilter.java A src/plugin/index-more/src/java A src/plugin/index-more/src/java/org A src/plugin/index-more/src/java/org/apache A src/plugin/index-more/src/java/org/apache/nutch A src/plugin/index-more/src/java/org/apache/nutch/indexer A src/plugin/index-more/src/java/org/apache/nutch/indexer/more A src/plugin/index-more/src/java/org/apache/nutch/indexer/more/MoreIndexingFilter.java A src/plugin/index-more/src/java/org/apache/nutch/indexer/more/package.html A src/plugin/index-more/plugin.xml A src/plugin/index-more/build.xml AU src/plugin/plugin.dtd A src/plugin/parse-ext A src/plugin/parse-ext/ivy.xml A src/plugin/parse-ext/src A src/plugin/parse-ext/src/test A src/plugin/parse-ext/src/test/org A src/plugin/parse-ext/src/test/org/apache A src/plugin/parse-ext/src/test/org/apache/nutch A src/plugin/parse-ext/src/test/org/apache/nutch/parse A src/plugin/parse-ext/src/test/org/apache/nutch/parse/ext A src/plugin/parse-ext/src/test/org/apache/nutch/parse/ext/TestExtParser.java A src/plugin/parse-ext/src/java A src/plugin/parse-ext/src/java/org A src/plugin/parse-ext/src/java/org/apache A src/plugin/parse-ext/src/java/org/apache/nutch A src/plugin/parse-ext/src/java/org/apache/nutch/parse A src/plugin/parse-ext/src/java/org/apache/nutch/parse/ext A src/plugin/parse-ext/src/java/org/apache/nutch/parse/ext/ExtParser.java A src/plugin/parse-ext/plugin.xml A src/plugin/parse-ext/build.xml A src/plugin/parse-ext/command A src/plugin/urlnormalizer-pass A src/plugin/urlnormalizer-pass/ivy.xml A src/plugin/urlnormalizer-pass/src A src/plugin/urlnormalizer-pass/src/test A src/plugin/urlnormalizer-pass/src/test/org A src/plugin/urlnormalizer-pass/src/test/org/apache A src/plugin/urlnormalizer-pass/src/test/org/apache/nutch A src/plugin/urlnormalizer-pass/src/test/org/apache/nutch/net A src/plugin/urlnormalizer-pass/src/test/org/apache/nutch/net/urlnormalizer A src/plugin/urlnormalizer-pass/src/test/org/apache/nutch/net/urlnormalizer/pass AU src/plugin/urlnormalizer-pass/src/test/org/apache/nutch/net/urlnormalizer/pass/TestPassURLNormalizer.java A src/plugin/urlnormalizer-pass/src/java A src/plugin/urlnormalizer-pass/src/java/org A src/plugin/urlnormalizer-pass/src/java/org/apache A src/plugin/urlnormalizer-pass/src/java/org/apache/nutch A src/plugin/urlnormalizer-pass/src/java/org/apache/nutch/net A src/plugin/urlnormalizer-pass/src/java/org/apache/nutch/net/urlnormalizer A src/plugin/urlnormalizer-pass/src/java/org/apache/nutch/net/urlnormalizer/pass AU src/plugin/urlnormalizer-pass/src/java/org/apache/nutch/net/urlnormalizer/pass/PassURLNormalizer.java AU src/plugin/urlnormalizer-pass/plugin.xml AU src/plugin/urlnormalizer-pass/build.xml A src/plugin/parse-html A src/plugin/parse-html/ivy.xml A src/plugin/parse-html/lib A src/plugin/parse-html/lib/tagsoup.LICENSE.txt A src/plugin/parse-html/src A src/plugin/parse-html/src/test A src/plugin/parse-html/src/test/org A src/plugin/parse-html/src/test/org/apache A src/plugin/parse-html/src/test/org/apache/nutch A src/plugin/parse-html/src/test/org/apache/nutch/parse A src/plugin/parse-html/src/test/org/apache/nutch/parse/html A src/plugin/parse-html/src/test/org/apache/nutch/parse/html/TestRobotsMetaProcessor.java A src/plugin/parse-html/src/test/org/apache/nutch/parse/html/TestDOMContentUtils.java A src/plugin/parse-html/src/java A src/plugin/parse-html/src/java/org A src/plugin/parse-html/src/java/org/apache A src/plugin/parse-html/src/java/org/apache/nutch A src/plugin/parse-html/src/java/org/apache/nutch/parse A src/plugin/parse-html/src/java/org/apache/nutch/parse/html A src/plugin/parse-html/src/java/org/apache/nutch/parse/html/HtmlParser.java A src/plugin/parse-html/src/java/org/apache/nutch/parse/html/XMLCharacterRecognizer.java A src/plugin/parse-html/src/java/org/apache/nutch/parse/html/DOMBuilder.java A src/plugin/parse-html/src/java/org/apache/nutch/parse/html/DOMContentUtils.java A src/plugin/parse-html/src/java/org/apache/nutch/parse/html/HTMLMetaProcessor.java A src/plugin/parse-html/src/java/org/apache/nutch/parse/html/package.html AU src/plugin/parse-html/plugin.xml AU src/plugin/parse-html/build.xml A src/plugin/protocol-httpclient A src/plugin/protocol-httpclient/ivy.xml A src/plugin/protocol-httpclient/src A src/plugin/protocol-httpclient/src/test A src/plugin/protocol-httpclient/src/test/conf A src/plugin/protocol-httpclient/src/test/conf/nutch-site-test.xml A src/plugin/protocol-httpclient/src/test/conf/httpclient-auth-test.xml A src/plugin/protocol-httpclient/src/test/org A src/plugin/protocol-httpclient/src/test/org/apache A src/plugin/protocol-httpclient/src/test/org/apache/nutch A src/plugin/protocol-httpclient/src/test/org/apache/nutch/protocol A src/plugin/protocol-httpclient/src/test/org/apache/nutch/protocol/httpclient A src/plugin/protocol-httpclient/src/test/org/apache/nutch/protocol/httpclient/TestProtocolHttpClient.java A src/plugin/protocol-httpclient/src/java A src/plugin/protocol-httpclient/src/java/org A src/plugin/protocol-httpclient/src/java/org/apache A src/plugin/protocol-httpclient/src/java/org/apache/nutch A src/plugin/protocol-httpclient/src/java/org/apache/nutch/protocol A src/plugin/protocol-httpclient/src/java/org/apache/nutch/protocol/httpclient AU src/plugin/protocol-httpclient/src/java/org/apache/nutch/protocol/httpclient/Http.java AU src/plugin/protocol-httpclient/src/java/org/apache/nutch/protocol/httpclient/HttpAuthentication.java AU src/plugin/protocol-httpclient/src/java/org/apache/nutch/protocol/httpclient/DummySSLProtocolSocketFactory.java AU src/plugin/protocol-httpclient/src/java/org/apache/nutch/protocol/httpclient/HttpBasicAuthentication.java AU src/plugin/protocol-httpclient/src/java/org/apache/nutch/protocol/httpclient/HttpAuthenticationFactory.java AU src/plugin/protocol-httpclient/src/java/org/apache/nutch/protocol/httpclient/DummyX509TrustManager.java AU src/plugin/protocol-httpclient/src/java/org/apache/nutch/protocol/httpclient/HttpAuthenticationException.java AU src/plugin/protocol-httpclient/src/java/org/apache/nutch/protocol/httpclient/HttpResponse.java AU src/plugin/protocol-httpclient/src/java/org/apache/nutch/protocol/httpclient/package.html A src/plugin/protocol-httpclient/jsp A src/plugin/protocol-httpclient/jsp/ntlm.jsp A src/plugin/protocol-httpclient/jsp/cookies.jsp A src/plugin/protocol-httpclient/jsp/noauth.jsp A src/plugin/protocol-httpclient/jsp/digest.jsp A src/plugin/protocol-httpclient/jsp/basic.jsp AU src/plugin/protocol-httpclient/plugin.xml AU src/plugin/protocol-httpclient/build.xml A src/plugin/urlfilter-domain A src/plugin/urlfilter-domain/ivy.xml A src/plugin/urlfilter-domain/src A src/plugin/urlfilter-domain/src/test A src/plugin/urlfilter-domain/src/test/org A src/plugin/urlfilter-domain/src/test/org/apache A src/plugin/urlfilter-domain/src/test/org/apache/nutch A src/plugin/urlfilter-domain/src/test/org/apache/nutch/urlfilter A src/plugin/urlfilter-domain/src/test/org/apache/nutch/urlfilter/domain A src/plugin/urlfilter-domain/src/test/org/apache/nutch/urlfilter/domain/TestDomainURLFilter.java A src/plugin/urlfilter-domain/src/java A src/plugin/urlfilter-domain/src/java/org A src/plugin/urlfilter-domain/src/java/org/apache A src/plugin/urlfilter-domain/src/java/org/apache/nutch A src/plugin/urlfilter-domain/src/java/org/apache/nutch/urlfilter A src/plugin/urlfilter-domain/src/java/org/apache/nutch/urlfilter/domain A src/plugin/urlfilter-domain/src/java/org/apache/nutch/urlfilter/domain/DomainURLFilter.java A src/plugin/urlfilter-domain/src/java/org/apache/nutch/urlfilter/domain/package.html A src/plugin/urlfilter-domain/data A src/plugin/urlfilter-domain/data/hosts.txt A src/plugin/urlfilter-domain/plugin.xml A src/plugin/urlfilter-domain/build.xml A src/plugin/protocol-http A src/plugin/protocol-http/ivy.xml A src/plugin/protocol-http/src A src/plugin/protocol-http/src/java A src/plugin/protocol-http/src/java/org A src/plugin/protocol-http/src/java/org/apache A src/plugin/protocol-http/src/java/org/apache/nutch A src/plugin/protocol-http/src/java/org/apache/nutch/protocol A src/plugin/protocol-http/src/java/org/apache/nutch/protocol/http AU src/plugin/protocol-http/src/java/org/apache/nutch/protocol/http/Http.java A src/plugin/protocol-http/src/java/org/apache/nutch/protocol/http/HttpResponse.java A src/plugin/protocol-http/src/java/org/apache/nutch/protocol/http/package.html AU src/plugin/protocol-http/plugin.xml AU src/plugin/protocol-http/build.xml A pom.xml A KEYS A README.txt A build.xml U . At revision 1087575 no change for http://svn.apache.org/repos/asf/nutch/trunk since the previous build [Nutch-trunk] $ /bin/bash -xe /var/tmp/hudson1141645865251904188.sh + PATH=/home/hudson/tools/java/latest1.6/bin:/usr/bin:/opt/sfw/bin:/opt/subversion-current/bin:/usr/ucb:/usr/local/bin:/usr/bin:/usr/sfw/bin:/usr/sfw/sbin:/opt/sfw/bin:/opt/sfw/sbin:/opt/SUNWspro/bin:/usr/X/bin:/usr/ucb:/usr/sbin:/usr/ccs/bin + export ANT_HOME=/export/home/hudson/tools/ant/latest + ANT_HOME=/export/home/hudson/tools/ant/latest + export PATH ANT_HOME + cd trunk + /export/home/hudson/tools/ant/latest/bin/ant -Dversion=2011-04-01_04-00-58 -Dtest.junit.output.format=xml nightly Buildfile: build.xml ivy-probe-antlib: ivy-download: -ivy-download-unchecked: ivy-init-antlib: ivy-init: init: [mkdir] Created dir: /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build [mkdir] Created dir: /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build/classes [mkdir] Created dir: /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build/release [mkdir] Created dir: /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build/test [mkdir] Created dir: /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build/test/classes [copy] Copying 9 files to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/conf [copy] Copying /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/conf/regex-normalize.xml.template to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/conf/regex-normalize.xml [copy] Copying /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/conf/nutch-site.xml.template to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/conf/nutch-site.xml [copy] Copying /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/conf/automaton-urlfilter.txt.template to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/conf/automaton-urlfilter.txt [copy] Copying /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/conf/hbase-site.xml.template to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/conf/hbase-site.xml [copy] Copying /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/conf/suffix-urlfilter.txt.template to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/conf/suffix-urlfilter.txt [copy] Copying /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/conf/regex-urlfilter.txt.template to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/conf/regex-urlfilter.txt [copy] Copying /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/conf/subcollections.xml.template to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/conf/subcollections.xml [copy] Copying /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/conf/prefix-urlfilter.txt.template to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/conf/prefix-urlfilter.txt [copy] Copying /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/conf/httpclient-auth.xml.template to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/conf/httpclient-auth.xml clean-lib: resolve-default: [ivy:resolve] 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 Ivy 2.1.0 - 20090925235825 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 http://ant.apache.org/ivy/ 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 [ivy:resolve] 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 loading settings 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 file = /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/ivy/ivysettings.xml [ivy:resolve] [ivy:resolve] 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 problems summary 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 [ivy:resolve] 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 WARNINGS [ivy:resolve] module not found: org.apache.gora#gora-core;0.1 [ivy:resolve] ==== local: tried [ivy:resolve] /export/home/hudson/.ivy2/local/org.apache.gora/gora-core/0.1/ivys/ivy.xml [ivy:resolve] -- artifact org.apache.gora#gora-core;0.1!gora-core.jar: [ivy:resolve] /export/home/hudson/.ivy2/local/org.apache.gora/gora-core/0.1/jars/gora-core.jar [ivy:resolve] module not found: org.apache.gora#gora-sql;0.1 [ivy:resolve] ==== local: tried [ivy:resolve] /export/home/hudson/.ivy2/local/org.apache.gora/gora-sql/0.1/ivys/ivy.xml [ivy:resolve] -- artifact org.apache.gora#gora-sql;0.1!gora-sql.jar: [ivy:resolve] /export/home/hudson/.ivy2/local/org.apache.gora/gora-sql/0.1/jars/gora-sql.jar [ivy:resolve] 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 [ivy:resolve] 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 UNRESOLVED DEPENDENCIES 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 [ivy:resolve] 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 [ivy:resolve] 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 org.apache.gora#gora-core;0.1: not found [ivy:resolve] 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 org.apache.gora#gora-sql;0.1: not found [ivy:resolve] 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 [ivy:resolve] [ivy:resolve] 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS BUILD FAILED /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build.xml:452: impossible to resolve dependencies: resolve failed - see output for details Total time: 5 seconds Publishing Javadoc Archiving artifacts Recording test results From osmith@example.org Fri Apr 01 13:05:52 2011 Return-Path: <osmith@example.org> Delivered-To: osmith@example.org Received: (qmail 36409 invoked from network); 1 Apr 2011 13:05:52 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 13:05:52 -0000 Received: (qmail 81533 invoked by uid 500); 1 Apr 2011 13:05:51 -0000 Delivered-To: osmith@example.org Received: (qmail 81468 invoked by uid 500); 1 Apr 2011 13:05:51 -0000 Mailing-List: contact osmith@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:osmith@example.org> List-Unsubscribe: <mailto:osmith@example.org> List-Post: <mailto:osmith@example.org> List-Id: <dev.nutch.apache.org> Reply-To: osmith@example.org Delivered-To: mailing list osmith@example.org Received: (qmail 81461 invoked by uid 99); 1 Apr 2011 13:05:50 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 13:05:50 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 13:05:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id B2D918DDE0 for <osmith@example.org>; Fri, 1 Apr 2011 13:05:05 +0000 (UTC) Date: Fri, 1 Apr 2011 13:05:05 +0000 (UTC) From: "Markus Jelsma (JIRA)" <osmith@example.org> To: osmith@example.org Message-ID: <osmith@example.org> Subject: [jira] [Updated] (NUTCH-897) Subcollection requires blacklist element MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/NUTCH-897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Markus Jelsma updated NUTCH-897: -------------------------------- Affects Version/s: 2.0 1.3 Fix Version/s: 2.0 1.3 Assignee: Markus Jelsma > Subcollection requires blacklist element > ---------------------------------------- > > Key: NUTCH-897 > URL: https://issues.apache.org/jira/browse/NUTCH-897 > Project: Nutch > Issue Type: Bug > Components: indexer > Affects Versions: 1.2, 1.3, 2.0 > Reporter: Markus Jelsma > Assignee: Markus Jelsma > Priority: Trivial > Fix For: 1.3, 2.0 > > > This is a very minor issue with in Subcollection.java. It throws an error if the (empty) blacklist element was omitted. I think it should either not silently fail in case of an omitted blacklist element or throw a decent error message that the blacklist element is required. The following exception gets thrown if the blacklist element is omitted in a subcollection block: > 2010-09-06 13:32:30,438 INFO collection.CollectionManager - Instantiating CollectionManager > 2010-09-06 13:32:30,438 INFO collection.CollectionManager - initializing CollectionManager > 2010-09-06 13:32:30,451 INFO collection.CollectionManager - file has1 elements > 2010-09-06 13:32:30,456 WARN collection.CollectionManager - Error occured:java.lang.NullPointerException > 2010-09-06 13:32:30,469 WARN collection.CollectionManager - java.lang.NullPointerException > 2010-09-06 13:32:30,470 WARN collection.CollectionManager - at org.apache.nutch.collection.Subcollection.initialize(Subcollection.java:173) > 2010-09-06 13:32:30,470 WARN collection.CollectionManager - at org.apache.nutch.collection.CollectionManager.parse(CollectionManager.java:98) > 2010-09-06 13:32:30,470 WARN collection.CollectionManager - at org.apache.nutch.collection.CollectionManager.init(CollectionManager.java:75) > 2010-09-06 13:32:30,470 WARN collection.CollectionManager - at org.apache.nutch.collection.CollectionManager.<init>(CollectionManager.java:56) > 2010-09-06 13:32:30,471 WARN collection.CollectionManager - at org.apache.nutch.collection.CollectionManager.getCollectionManager(CollectionManager.java:115) > 2010-09-06 13:32:30,471 WARN collection.CollectionManager - at org.apache.nutch.indexer.subcollection.SubcollectionIndexingFilter.addSubCollectionField(SubcollectionIndexingFilter.java:65) > 2010-09-06 13:32:30,471 WARN collection.CollectionManager - at org.apache.nutch.indexer.subcollection.SubcollectionIndexingFilter.filter(SubcollectionIndexingFilter.java:71) > 2010-09-06 13:32:30,471 WARN collection.CollectionManager - at org.apache.nutch.indexer.IndexingFilters.filter(IndexingFilters.java:109) > 2010-09-06 13:32:30,471 WARN collection.CollectionManager - at org.apache.nutch.indexer.IndexerMapReduce.reduce(IndexerMapReduce.java:134) > 2010-09-06 13:32:30,472 WARN collection.CollectionManager - at org.apache.nutch.indexer.IndexerMapReduce.reduce(IndexerMapReduce.java:50) > 2010-09-06 13:32:30,472 WARN collection.CollectionManager - at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463) > 2010-09-06 13:32:30,472 WARN collection.CollectionManager - at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411) > 2010-09-06 13:32:30,472 WARN collection.CollectionManager - at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216) -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From osmith@example.org Fri Apr 01 13:33:47 2011 Return-Path: <osmith@example.org> Delivered-To: osmith@example.org Received: (qmail 19308 invoked from network); 1 Apr 2011 13:33:47 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 13:33:47 -0000 Received: (qmail 9361 invoked by uid 500); 1 Apr 2011 13:33:46 -0000 Delivered-To: osmith@example.org Received: (qmail 9308 invoked by uid 500); 1 Apr 2011 13:33:46 -0000 Mailing-List: contact osmith@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:osmith@example.org> List-Unsubscribe: <mailto:osmith@example.org> List-Post: <mailto:osmith@example.org> List-Id: <dev.nutch.apache.org> Reply-To: osmith@example.org Delivered-To: mailing list osmith@example.org Received: (qmail 9301 invoked by uid 99); 1 Apr 2011 13:33:46 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 13:33:46 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 13:33:44 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id 0D73F8DA94 for <osmith@example.org>; Fri, 1 Apr 2011 13:33:06 +0000 (UTC) Date: Fri, 1 Apr 2011 13:33:06 +0000 (UTC) From: "Markus Jelsma (JIRA)" <osmith@example.org> To: osmith@example.org Message-ID: <osmith@example.org> Subject: [jira] [Updated] (NUTCH-897) Subcollection requires blacklist element MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/NUTCH-897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Markus Jelsma updated NUTCH-897: -------------------------------- Patch Info: [Patch Available] > Subcollection requires blacklist element > ---------------------------------------- > > Key: NUTCH-897 > URL: https://issues.apache.org/jira/browse/NUTCH-897 > Project: Nutch > Issue Type: Bug > Components: indexer > Affects Versions: 1.2, 1.3, 2.0 > Reporter: Markus Jelsma > Assignee: Markus Jelsma > Priority: Trivial > Fix For: 1.3, 2.0 > > > This is a very minor issue with in Subcollection.java. It throws an error if the (empty) blacklist element was omitted. I think it should either not silently fail in case of an omitted blacklist element or throw a decent error message that the blacklist element is required. The following exception gets thrown if the blacklist element is omitted in a subcollection block: > 2010-09-06 13:32:30,438 INFO collection.CollectionManager - Instantiating CollectionManager > 2010-09-06 13:32:30,438 INFO collection.CollectionManager - initializing CollectionManager > 2010-09-06 13:32:30,451 INFO collection.CollectionManager - file has1 elements > 2010-09-06 13:32:30,456 WARN collection.CollectionManager - Error occured:java.lang.NullPointerException > 2010-09-06 13:32:30,469 WARN collection.CollectionManager - java.lang.NullPointerException > 2010-09-06 13:32:30,470 WARN collection.CollectionManager - at org.apache.nutch.collection.Subcollection.initialize(Subcollection.java:173) > 2010-09-06 13:32:30,470 WARN collection.CollectionManager - at org.apache.nutch.collection.CollectionManager.parse(CollectionManager.java:98) > 2010-09-06 13:32:30,470 WARN collection.CollectionManager - at org.apache.nutch.collection.CollectionManager.init(CollectionManager.java:75) > 2010-09-06 13:32:30,470 WARN collection.CollectionManager - at org.apache.nutch.collection.CollectionManager.<init>(CollectionManager.java:56) > 2010-09-06 13:32:30,471 WARN collection.CollectionManager - at org.apache.nutch.collection.CollectionManager.getCollectionManager(CollectionManager.java:115) > 2010-09-06 13:32:30,471 WARN collection.CollectionManager - at org.apache.nutch.indexer.subcollection.SubcollectionIndexingFilter.addSubCollectionField(SubcollectionIndexingFilter.java:65) > 2010-09-06 13:32:30,471 WARN collection.CollectionManager - at org.apache.nutch.indexer.subcollection.SubcollectionIndexingFilter.filter(SubcollectionIndexingFilter.java:71) > 2010-09-06 13:32:30,471 WARN collection.CollectionManager - at org.apache.nutch.indexer.IndexingFilters.filter(IndexingFilters.java:109) > 2010-09-06 13:32:30,471 WARN collection.CollectionManager - at org.apache.nutch.indexer.IndexerMapReduce.reduce(IndexerMapReduce.java:134) > 2010-09-06 13:32:30,472 WARN collection.CollectionManager - at org.apache.nutch.indexer.IndexerMapReduce.reduce(IndexerMapReduce.java:50) > 2010-09-06 13:32:30,472 WARN collection.CollectionManager - at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463) > 2010-09-06 13:32:30,472 WARN collection.CollectionManager - at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411) > 2010-09-06 13:32:30,472 WARN collection.CollectionManager - at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216) -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From osmith@example.org Fri Apr 01 13:35:44 2011 Return-Path: <osmith@example.org> Delivered-To: osmith@example.org Received: (qmail 28893 invoked from network); 1 Apr 2011 13:35:44 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 13:35:44 -0000 Received: (qmail 15126 invoked by uid 500); 1 Apr 2011 13:35:44 -0000 Delivered-To: osmith@example.org Received: (qmail 15097 invoked by uid 500); 1 Apr 2011 13:35:44 -0000 Mailing-List: contact osmith@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:osmith@example.org> List-Unsubscribe: <mailto:osmith@example.org> List-Post: <mailto:osmith@example.org> List-Id: <dev.nutch.apache.org> Reply-To: osmith@example.org Delivered-To: mailing list osmith@example.org Received: (qmail 15090 invoked by uid 99); 1 Apr 2011 13:35:44 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 13:35:44 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 13:35:42 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id 1AA4C8DBDB for <osmith@example.org>; Fri, 1 Apr 2011 13:35:06 +0000 (UTC) Date: Fri, 1 Apr 2011 13:35:06 +0000 (UTC) From: "Markus Jelsma (JIRA)" <osmith@example.org> To: osmith@example.org Message-ID: <osmith@example.org> Subject: [jira] [Updated] (NUTCH-897) Subcollection requires blacklist element MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/NUTCH-897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Markus Jelsma updated NUTCH-897: -------------------------------- Attachment: NUTCH-897.patch Attached tested fix and if confirmed to work and not break existing configurations. Patch works for 1.3 and trunk. > Subcollection requires blacklist element > ---------------------------------------- > > Key: NUTCH-897 > URL: https://issues.apache.org/jira/browse/NUTCH-897 > Project: Nutch > Issue Type: Bug > Components: indexer > Affects Versions: 1.2, 1.3, 2.0 > Reporter: Markus Jelsma > Assignee: Markus Jelsma > Priority: Trivial > Fix For: 1.3, 2.0 > > Attachments: NUTCH-897.patch > > > This is a very minor issue with in Subcollection.java. It throws an error if the (empty) blacklist element was omitted. I think it should either not silently fail in case of an omitted blacklist element or throw a decent error message that the blacklist element is required. The following exception gets thrown if the blacklist element is omitted in a subcollection block: > 2010-09-06 13:32:30,438 INFO collection.CollectionManager - Instantiating CollectionManager > 2010-09-06 13:32:30,438 INFO collection.CollectionManager - initializing CollectionManager > 2010-09-06 13:32:30,451 INFO collection.CollectionManager - file has1 elements > 2010-09-06 13:32:30,456 WARN collection.CollectionManager - Error occured:java.lang.NullPointerException > 2010-09-06 13:32:30,469 WARN collection.CollectionManager - java.lang.NullPointerException > 2010-09-06 13:32:30,470 WARN collection.CollectionManager - at org.apache.nutch.collection.Subcollection.initialize(Subcollection.java:173) > 2010-09-06 13:32:30,470 WARN collection.CollectionManager - at org.apache.nutch.collection.CollectionManager.parse(CollectionManager.java:98) > 2010-09-06 13:32:30,470 WARN collection.CollectionManager - at org.apache.nutch.collection.CollectionManager.init(CollectionManager.java:75) > 2010-09-06 13:32:30,470 WARN collection.CollectionManager - at org.apache.nutch.collection.CollectionManager.<init>(CollectionManager.java:56) > 2010-09-06 13:32:30,471 WARN collection.CollectionManager - at org.apache.nutch.collection.CollectionManager.getCollectionManager(CollectionManager.java:115) > 2010-09-06 13:32:30,471 WARN collection.CollectionManager - at org.apache.nutch.indexer.subcollection.SubcollectionIndexingFilter.addSubCollectionField(SubcollectionIndexingFilter.java:65) > 2010-09-06 13:32:30,471 WARN collection.CollectionManager - at org.apache.nutch.indexer.subcollection.SubcollectionIndexingFilter.filter(SubcollectionIndexingFilter.java:71) > 2010-09-06 13:32:30,471 WARN collection.CollectionManager - at org.apache.nutch.indexer.IndexingFilters.filter(IndexingFilters.java:109) > 2010-09-06 13:32:30,471 WARN collection.CollectionManager - at org.apache.nutch.indexer.IndexerMapReduce.reduce(IndexerMapReduce.java:134) > 2010-09-06 13:32:30,472 WARN collection.CollectionManager - at org.apache.nutch.indexer.IndexerMapReduce.reduce(IndexerMapReduce.java:50) > 2010-09-06 13:32:30,472 WARN collection.CollectionManager - at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463) > 2010-09-06 13:32:30,472 WARN collection.CollectionManager - at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411) > 2010-09-06 13:32:30,472 WARN collection.CollectionManager - at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216) -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From osmith@example.org Fri Apr 01 14:02:45 2011 Return-Path: <osmith@example.org> Delivered-To: osmith@example.org Received: (qmail 1168 invoked from network); 1 Apr 2011 14:02:45 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 14:02:45 -0000 Received: (qmail 62256 invoked by uid 500); 1 Apr 2011 14:02:45 -0000 Delivered-To: osmith@example.org Received: (qmail 62222 invoked by uid 500); 1 Apr 2011 14:02:45 -0000 Mailing-List: contact osmith@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:osmith@example.org> List-Unsubscribe: <mailto:osmith@example.org> List-Post: <mailto:osmith@example.org> List-Id: <dev.nutch.apache.org> Reply-To: osmith@example.org Delivered-To: mailing list osmith@example.org Received: (qmail 62207 invoked by uid 99); 1 Apr 2011 14:02:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:02:45 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [83.161.120.155] (HELO office.openindex.io) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:02:36 +0000 Received: from localhost (localhost [83.161.120.155]) by office.openindex.io (Postfix) with ESMTP id 74E6E46002 for <osmith@example.org>; Fri, 1 Apr 2011 14:09:40 +0000 (UTC) X-Virus-Scanned: Debian osmith@example.org Received: from office.openindex.io ([83.161.120.155]) by localhost (office.openindex.io [83.161.120.155]) (amavisd-new, port 10024) with ESMTP id g+uPf5Zbbw1M for <osmith@example.org>; Fri, 1 Apr 2011 14:09:34 +0000 (UTC) Received: from midas.localnet (D4B295B2.static.ziggozakelijk.nl [83.161.120.155]) (Authenticated sender: osmith@example.org) by office.openindex.io (Postfix) with ESMTPA id 5EBB546001 for <osmith@example.org>; Fri, 1 Apr 2011 14:09:34 +0000 (UTC) From: Markus Jelsma <osmith@example.org> Reply-To: osmith@example.org Organization: Openindex To: osmith@example.org Subject: Clean up open legacy issues in Jira Date: Fri, 1 Apr 2011 16:03:45 +0200 User-Agent: KMail/1.13.5 (Linux/2.6.32-30-generic; KDE/4.4.5; x86_64; ; ) MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Message-Id: <osmith@example.org> X-Virus-Checked: Checked by ClamAV on apache.org Hi guys, There's an awful lot of legacy in Jira. I propose we close the bulk of the issues that deal with the old search server, very old plugins or really old code. Thoughts? Cheers, From osmith@example.org Fri Apr 01 14:05:47 2011 Return-Path: <osmith@example.org> Delivered-To: osmith@example.org Received: (qmail 32286 invoked from network); 1 Apr 2011 14:05:46 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 14:05:46 -0000 Received: (qmail 65728 invoked by uid 500); 1 Apr 2011 14:05:46 -0000 Delivered-To: osmith@example.org Received: (qmail 65684 invoked by uid 500); 1 Apr 2011 14:05:46 -0000 Mailing-List: contact osmith@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:osmith@example.org> List-Unsubscribe: <mailto:osmith@example.org> List-Post: <mailto:osmith@example.org> List-Id: <dev.nutch.apache.org> Reply-To: osmith@example.org Delivered-To: mailing list osmith@example.org Received: (qmail 65677 invoked by uid 99); 1 Apr 2011 14:05:46 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:05:46 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:05:44 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id 342718D8BA for <osmith@example.org>; Fri, 1 Apr 2011 14:05:06 +0000 (UTC) Date: Fri, 1 Apr 2011 14:05:06 +0000 (UTC) From: "Markus Jelsma (JIRA)" <osmith@example.org> To: osmith@example.org Message-ID: <osmith@example.org> In-Reply-To: <osmith@example.org> Subject: [jira] [Commented] (NUTCH-973) Remove Segment Merger in 1.3 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/NUTCH-973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13014566#comment-13014566 ] Markus Jelsma commented on NUTCH-973: ------------------------------------- I'm not sure we should. In 1.x fetches still generate loose segments which i just might want to merge for simplicity. For example, i have a test setup where multiple segments are generated each day, then they get merged so i have a single segment per day. It's a bit easier to maintain and reindex fewer segments. I do delete segments older than the fetch interval but in my case that's just deleting one segment a day. This is in a local environment. > Remove Segment Merger in 1.3 > ---------------------------- > > Key: NUTCH-973 > URL: https://issues.apache.org/jira/browse/NUTCH-973 > Project: Nutch > Issue Type: Task > Reporter: Julien Nioche > Priority: Minor > Fix For: 1.3 > > > The code for the segment merging is still in 1.3, as far as I understand its original function it was mostly useful for having a single data structure where the search app could get the cached data from. Now that we've delegated the indexing and search to SOLR we don't really need to worry about the cache anymore. Would it make sense to purge it or do you guys think it would still be useful? -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From osmith@example.org Fri Apr 01 14:10:03 2011 Return-Path: <osmith@example.org> Delivered-To: osmith@example.org Received: (qmail 33753 invoked from network); 1 Apr 2011 14:10:02 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 14:10:02 -0000 Received: (qmail 79190 invoked by uid 500); 1 Apr 2011 14:10:02 -0000 Delivered-To: osmith@example.org Received: (qmail 79159 invoked by uid 500); 1 Apr 2011 14:10:02 -0000 Mailing-List: contact osmith@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:osmith@example.org> List-Unsubscribe: <mailto:osmith@example.org> List-Post: <mailto:osmith@example.org> List-Id: <dev.nutch.apache.org> Reply-To: osmith@example.org Delivered-To: mailing list osmith@example.org Received: (qmail 79152 invoked by uid 99); 1 Apr 2011 14:10:02 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:10:02 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [83.161.120.155] (HELO office.openindex.io) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:09:55 +0000 Received: from localhost (localhost [83.161.120.155]) by office.openindex.io (Postfix) with ESMTP id 8F8F346002 for <osmith@example.org>; Fri, 1 Apr 2011 14:16:59 +0000 (UTC) X-Virus-Scanned: Debian osmith@example.org Received: from office.openindex.io ([83.161.120.155]) by localhost (office.openindex.io [83.161.120.155]) (amavisd-new, port 10024) with ESMTP id 4boy5Dt0N7Ul for <osmith@example.org>; Fri, 1 Apr 2011 14:16:55 +0000 (UTC) Received: from midas.localnet (D4B295B2.static.ziggozakelijk.nl [83.161.120.155]) (Authenticated sender: osmith@example.org) by office.openindex.io (Postfix) with ESMTPA id 465C246001 for <osmith@example.org>; Fri, 1 Apr 2011 14:16:55 +0000 (UTC) From: Markus Jelsma <osmith@example.org> Reply-To: osmith@example.org Organization: Openindex To: osmith@example.org Subject: Re: java.sql.BatchUpdateException after fetch and wrong WebPage.protocolStatus in trunk Date: Fri, 1 Apr 2011 16:11:06 +0200 User-Agent: KMail/1.13.5 (Linux/2.6.32-30-generic; KDE/4.4.5; x86_64; ; ) References: <osmith@example.org> In-Reply-To: <osmith@example.org> MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <osmith@example.org> X-Virus-Checked: Checked by ClamAV on apache.org Any thoughts? On Tuesday 22 March 2011 17:19:57 Markus Jelsma wrote: > Hi, > > I did a few successful fetches for testing trunk's solrclean. After > removing some pages for having a few NOTFOUND entries in the WebDB (with > HSQLDB as storage backend) the following exception occured: > > 2011-03-22 16:53:49,727 INFO fetcher.FetcherJob - -activeThreads=0 > 2011-03-22 16:53:51,036 WARN mapred.LocalJobRunner - job_local_0001 > java.io.IOException: java.sql.BatchUpdateException: data exception: string > data, right truncation > at org.apache.gora.sql.store.SqlStore.flush(SqlStore.java:340) > at org.apache.gora.sql.store.SqlStore.close(SqlStore.java:185) > at > org.apache.gora.mapreduce.GoraRecordWriter.close(GoraRecordWriter.java:55) > at > org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:567) > at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408) > at > org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216) > Caused by: java.sql.BatchUpdateException: data exception: string data, > right truncation > at org.hsqldb.jdbc.JDBCPreparedStatement.executeBatch(Unknown > Source) at org.apache.gora.sql.store.SqlStore.flush(SqlStore.java:328) ... > 5 more > > Also, when i execute solrclean and log WebPage.ProtocolStatus() i see wrong > values for pages that were removed, instead of ProtocolStatusCodes.NOTFOUND > (13) they got just 0. > > It smells like a bug but i could be doing things the wrong way, of course > ;) > > > Cheers, -- Markus Jelsma - CTO - Openindex http://www.linkedin.com/in/markus17 050-8536620 / 06-50258350 From osmith@example.org Fri Apr 01 14:20:56 2011 Return-Path: <osmith@example.org> Delivered-To: osmith@example.org Received: (qmail 60972 invoked from network); 1 Apr 2011 14:20:56 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 14:20:56 -0000 Received: (qmail 2567 invoked by uid 500); 1 Apr 2011 14:20:55 -0000 Delivered-To: osmith@example.org Received: (qmail 2536 invoked by uid 500); 1 Apr 2011 14:20:55 -0000 Mailing-List: contact osmith@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:osmith@example.org> List-Unsubscribe: <mailto:osmith@example.org> List-Post: <mailto:osmith@example.org> List-Id: <dev.nutch.apache.org> Reply-To: osmith@example.org Delivered-To: mailing list osmith@example.org Received: (qmail 2529 invoked by uid 99); 1 Apr 2011 14:20:55 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:20:55 +0000 X-ASF-Spam-Status: No, hits=-2.3 required=5.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [83.161.120.155] (HELO mail.jpl.nasa.gov) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:20:48 +0000 Received: from mail.jpl.nasa.gov (altvirehtstap01.jpl.nasa.gov [83.161.120.155]) by smtp.jpl.nasa.gov (Switch-3.4.3/Switch-3.4.3) with ESMTP id p31EKPUh009724 (using TLSv1/SSLv3 with cipher RC4-MD5 (128 bits) verified NO); Fri, 1 Apr 2011 07:20:25 -0700 Received: from ALTPHYEMBEVSP20.RES.AD.JPL ([83.161.120.155]) by ALTVIREHTSTAP01.RES.AD.JPL ([83.161.120.155]) with mapi; Fri, 1 Apr 2011 07:20:25 -0700 From: "Mattmann, Chris A (388J)" <osmith@example.org> To: "osmith@example.org" <osmith@example.org>, "osmith@example.org" <osmith@example.org> Date: Fri, 1 Apr 2011 07:20:24 -0700 Subject: Re: Clean up open legacy issues in Jira Thread-Topic: Clean up open legacy issues in Jira Thread-Index: Acvwd/EteOjNAEDDS2WZyk1NFBcUmQ== Message-ID: <osmith@example.org> References: <osmith@example.org> In-Reply-To: <osmith@example.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Source-IP: altvirehtstap01.jpl.nasa.gov [83.161.120.155] X-Source-Sender: osmith@example.org X-AUTH: Authorized X-Virus-Checked: Checked by ClamAV on apache.org Super +1 Markus -- I've tried over the past 9 months to do this periodicall= y when I've rolled releases, but if everyone could take a look and close ou= t really old or non-applicable bugs, that would be great! BTW, time is freeing up for me lately, so it might be time finally for the = 1.3 release, if folks are cool with me RM'ing it :) Cheers, Chris On Apr 1, 2011, at 7:03 AM, Markus Jelsma wrote: > Hi guys, >=20 > There's an awful lot of legacy in Jira. I propose we close the bulk of t= he=20 > issues that deal with the old search server, very old plugins or really o= ld=20 > code. Thoughts? >=20 > Cheers, ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Chris Mattmann, Ph.D. Senior Computer Scientist NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA Office: 171-266B, Mailstop: 171-246 Email: osmith@example.org WWW: http://sunset.usc.edu/~mattmann/ ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Adjunct Assistant Professor, Computer Science Department University of Southern California, Los Angeles, CA 90089 USA ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ From osmith@example.org Fri Apr 01 14:21:44 2011 Return-Path: <osmith@example.org> Delivered-To: osmith@example.org Received: (qmail 66146 invoked from network); 1 Apr 2011 14:21:43 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 14:21:43 -0000 Received: (qmail 4736 invoked by uid 500); 1 Apr 2011 14:21:43 -0000 Delivered-To: osmith@example.org Received: (qmail 4605 invoked by uid 500); 1 Apr 2011 14:21:43 -0000 Mailing-List: contact osmith@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:osmith@example.org> List-Unsubscribe: <mailto:osmith@example.org> List-Post: <mailto:osmith@example.org> List-Id: <dev.nutch.apache.org> Reply-To: osmith@example.org Delivered-To: mailing list osmith@example.org Received: (qmail 4598 invoked by uid 99); 1 Apr 2011 14:21:43 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:21:43 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:21:42 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id B0F7D8DF2F for <osmith@example.org>; Fri, 1 Apr 2011 14:21:05 +0000 (UTC) Date: Fri, 1 Apr 2011 14:21:05 +0000 (UTC) From: "Julien Nioche (JIRA)" <osmith@example.org> To: osmith@example.org Message-ID: <osmith@example.org> In-Reply-To: <osmith@example.org> Subject: [jira] [Closed] (NUTCH-973) Remove Segment Merger in 1.3 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/NUTCH-973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Nioche closed NUTCH-973. ------------------------------- Resolution: Not A Problem You are right, let's leave it for now. It won't be a problem once we're on 2.0 anyway > Remove Segment Merger in 1.3 > ---------------------------- > > Key: NUTCH-973 > URL: https://issues.apache.org/jira/browse/NUTCH-973 > Project: Nutch > Issue Type: Task > Reporter: Julien Nioche > Priority: Minor > Fix For: 1.3 > > > The code for the segment merging is still in 1.3, as far as I understand its original function it was mostly useful for having a single data structure where the search app could get the cached data from. Now that we've delegated the indexing and search to SOLR we don't really need to worry about the cache anymore. Would it make sense to purge it or do you guys think it would still be useful? -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From osmith@example.org Fri Apr 01 14:27:44 2011 Return-Path: <osmith@example.org> Delivered-To: osmith@example.org Received: (qmail 81043 invoked from network); 1 Apr 2011 14:27:44 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 14:27:44 -0000 Received: (qmail 10078 invoked by uid 500); 1 Apr 2011 14:27:43 -0000 Delivered-To: osmith@example.org Received: (qmail 10046 invoked by uid 500); 1 Apr 2011 14:27:43 -0000 Mailing-List: contact osmith@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:osmith@example.org> List-Unsubscribe: <mailto:osmith@example.org> List-Post: <mailto:osmith@example.org> List-Id: <dev.nutch.apache.org> Reply-To: osmith@example.org Delivered-To: mailing list osmith@example.org Received: (qmail 10039 invoked by uid 99); 1 Apr 2011 14:27:43 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:27:43 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:27:42 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id 0DEC98D28A for <osmith@example.org>; Fri, 1 Apr 2011 14:27:06 +0000 (UTC) Date: Fri, 1 Apr 2011 14:27:06 +0000 (UTC) From: "Markus Jelsma (JIRA)" <osmith@example.org> To: osmith@example.org Message-ID: <osmith@example.org> Subject: [jira] [Closed] (NUTCH-18) Windows servers include illegal characters in URLs MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/NUTCH-18?page=3Dcom.atlassian.= jira.plugin.system.issuetabpanels:all-tabpanel ] Markus Jelsma closed NUTCH-18. ------------------------------ Resolution: Won't Fix Bulk close of legacy issues: http://www.lucidimagination.com/search/document/2738eeb014805854/clean_up_o= pen_legacy_issues_in_jira > Windows servers include illegal characters in URLs > -------------------------------------------------- > > Key: NUTCH-18 > URL: https://issues.apache.org/jira/browse/NUTCH-18 > Project: Nutch > Issue Type: Bug > Components: fetcher > Reporter: Stefan Groschupf > Priority: Minor > > Transfered from: > http://sourceforge.net/tracker/index.php?func=3Ddetail&aid=3D1110243&grou= p_id=3D59548&atid=3D491356 > submitted by: > Ken Meltsner > While spidering our intranet, I found that IIS may include=20 > illegal characters in URLs -- specifically, characters with=20 > the high bit set to produce non-English letters. In=20 > addition, both Firefox and IE will accept URLs with high- > bit characters, but Java won't. > While this may not be Nutch's (or Java's) fault, it would=20 > help if high-bit characters (and other illegal characters)=20 > in URLs could be escaped (using percent-hex notation)=20 > as part of the URL fix-up process, probably right after=20 > the hostname lower-case conversion. > Example document name in Portuguese(with high-bit=20 > characters) taken from a longer URL: > Nota%20tecnica%20-%20Altera=C3=A7=C3=A3o%20de% > 20escopo.doc > and with percent-escaped characters: > Nota%20tecnica%20-%20Altera%e7%e3o%20de% > 20escopo.doc -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From osmith@example.org Fri Apr 01 14:27:45 2011 Return-Path: <osmith@example.org> Delivered-To: osmith@example.org Received: (qmail 81090 invoked from network); 1 Apr 2011 14:27:45 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 14:27:45 -0000 Received: (qmail 10415 invoked by uid 500); 1 Apr 2011 14:27:44 -0000 Delivered-To: osmith@example.org Received: (qmail 10347 invoked by uid 500); 1 Apr 2011 14:27:44 -0000 Mailing-List: contact osmith@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:osmith@example.org> List-Unsubscribe: <mailto:osmith@example.org> List-Post: <mailto:osmith@example.org> List-Id: <dev.nutch.apache.org> Reply-To: osmith@example.org Delivered-To: mailing list osmith@example.org Received: (qmail 10242 invoked by uid 99); 1 Apr 2011 14:27:44 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:27:44 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:27:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id 48D2F8D295 for <osmith@example.org>; Fri, 1 Apr 2011 14:27:06 +0000 (UTC) Date: Fri, 1 Apr 2011 14:27:06 +0000 (UTC) From: "Markus Jelsma (JIRA)" <osmith@example.org> To: osmith@example.org Message-ID: <osmith@example.org> Subject: [jira] [Closed] (NUTCH-39) pagination in search result MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/NUTCH-39?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Markus Jelsma closed NUTCH-39. ------------------------------ Resolution: Won't Fix Bulk close of legacy issues: http://www.lucidimagination.com/search/document/2738eeb014805854/clean_up_open_legacy_issues_in_jira > pagination in search result > --------------------------- > > Key: NUTCH-39 > URL: https://issues.apache.org/jira/browse/NUTCH-39 > Project: Nutch > Issue Type: Improvement > Components: web gui > Environment: all > Reporter: Jack Tang > Priority: Trivial > > Now in nutch search.jsp, user navigate all search result using "Next" button. And google like pagination will feel better. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From osmith@example.org Fri Apr 01 14:27:48 2011 Return-Path: <osmith@example.org> Delivered-To: osmith@example.org Received: (qmail 81202 invoked from network); 1 Apr 2011 14:27:47 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 14:27:47 -0000 Received: (qmail 11601 invoked by uid 500); 1 Apr 2011 14:27:46 -0000 Delivered-To: osmith@example.org Received: (qmail 11559 invoked by uid 500); 1 Apr 2011 14:27:46 -0000 Mailing-List: contact osmith@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:osmith@example.org> List-Unsubscribe: <mailto:osmith@example.org> List-Post: <mailto:osmith@example.org> List-Id: <dev.nutch.apache.org> Reply-To: osmith@example.org Delivered-To: mailing list osmith@example.org Received: (qmail 11545 invoked by uid 99); 1 Apr 2011 14:27:46 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:27:46 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:27:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id 32C5A8D290 for <osmith@example.org>; Fri, 1 Apr 2011 14:27:06 +0000 (UTC) Date: Fri, 1 Apr 2011 14:27:06 +0000 (UTC) From: "Markus Jelsma (JIRA)" <osmith@example.org> To: osmith@example.org Message-ID: <osmith@example.org> Subject: [jira] [Closed] (NUTCH-36) Chinese in Nutch MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/NUTCH-36?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Markus Jelsma closed NUTCH-36. ------------------------------ Resolution: Won't Fix Bulk close of legacy issues: http://www.lucidimagination.com/search/document/2738eeb014805854/clean_up_open_legacy_issues_in_jira > Chinese in Nutch > ---------------- > > Key: NUTCH-36 > URL: https://issues.apache.org/jira/browse/NUTCH-36 > Project: Nutch > Issue Type: Improvement > Components: indexer, searcher > Environment: all > Reporter: Jack Tang > Priority: Minor > Attachments: &#26700 > > > Nutch now support Chinese in very simple way: NutchAnalysis segments CJK term word-by-word. > So, if I search Chinese term 'FooBar'(two Chinese words: 'Foo' and 'Bar'), the result in web gui will highlight 'FooBar' and 'Foo', 'Bar'. While we expect Nutch only highlights 'FooBar'. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From osmith@example.org Fri Apr 01 14:27:48 2011 Return-Path: <osmith@example.org> Delivered-To: osmith@example.org Received: (qmail 81222 invoked from network); 1 Apr 2011 14:27:47 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 14:27:47 -0000 Received: (qmail 11631 invoked by uid 500); 1 Apr 2011 14:27:46 -0000 Delivered-To: osmith@example.org Received: (qmail 11561 invoked by uid 500); 1 Apr 2011 14:27:46 -0000 Mailing-List: contact osmith@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:osmith@example.org> List-Unsubscribe: <mailto:osmith@example.org> List-Post: <mailto:osmith@example.org> List-Id: <dev.nutch.apache.org> Reply-To: osmith@example.org Delivered-To: mailing list osmith@example.org Received: (qmail 11546 invoked by uid 99); 1 Apr 2011 14:27:46 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:27:46 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:27:44 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id 5B1A28D298 for <osmith@example.org>; Fri, 1 Apr 2011 14:27:06 +0000 (UTC) Date: Fri, 1 Apr 2011 14:27:06 +0000 (UTC) From: "Markus Jelsma (JIRA)" <osmith@example.org> To: osmith@example.org Message-ID: <osmith@example.org> Subject: [jira] [Closed] (NUTCH-13) If dns points to 83.161.120.155, the url is also crawled MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/NUTCH-13?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Markus Jelsma closed NUTCH-13. ------------------------------ Resolution: Won't Fix Bulk close of legacy issues: http://www.lucidimagination.com/search/document/2738eeb014805854/clean_up_open_legacy_issues_in_jira > If dns points to 83.161.120.155, the url is also crawled > --------------------------------------------------- > > Key: NUTCH-13 > URL: https://issues.apache.org/jira/browse/NUTCH-13 > Project: Nutch > Issue Type: Bug > Components: fetcher > Reporter: Matthias Jaekle > Priority: Minor > > For example www.tik24.de points to 83.161.120.155. > If you follow a link to www.tik24.de fetcher will crawl content from your own machine. > Wrong DNS entries could create unwanted entries in segments. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From osmith@example.org Fri Apr 01 14:29:46 2011 Return-Path: <osmith@example.org> Delivered-To: osmith@example.org Received: (qmail 83423 invoked from network); 1 Apr 2011 14:29:46 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 14:29:46 -0000 Received: (qmail 18612 invoked by uid 500); 1 Apr 2011 14:29:43 -0000 Delivered-To: osmith@example.org Received: (qmail 18572 invoked by uid 500); 1 Apr 2011 14:29:43 -0000 Mailing-List: contact osmith@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:osmith@example.org> List-Unsubscribe: <mailto:osmith@example.org> List-Post: <mailto:osmith@example.org> List-Id: <dev.nutch.apache.org> Reply-To: osmith@example.org Delivered-To: mailing list osmith@example.org Received: (qmail 18552 invoked by uid 99); 1 Apr 2011 14:29:43 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:29:43 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:29:42 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id C22648D3C4 for <osmith@example.org>; Fri, 1 Apr 2011 14:29:05 +0000 (UTC) Date: Fri, 1 Apr 2011 14:29:05 +0000 (UTC) From: "Markus Jelsma (JIRA)" <osmith@example.org> To: osmith@example.org Message-ID: <osmith@example.org> Subject: [jira] [Closed] (NUTCH-79) Fault tolerant searching. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/NUTCH-79?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Markus Jelsma closed NUTCH-79. ------------------------------ Resolution: Won't Fix Bulk close of legacy issues: http://www.lucidimagination.com/search/document/2738eeb014805854/clean_up_open_legacy_issues_in_jira > Fault tolerant searching. > ------------------------- > > Key: NUTCH-79 > URL: https://issues.apache.org/jira/browse/NUTCH-79 > Project: Nutch > Issue Type: New Feature > Components: searcher > Reporter: Piotr Kosiorowski > Attachments: patch > > > I have finally managed to prepare first version of fault tolerant searching I have promised long time ago. > It reads server configuration from search-groups.txt file (in startup directory or directory specified by searcher.dir) if no search-servers.txt file is present. If search-servers.txt is presentit would be read and handled as previously. > --------------------------------------------------- > Format of search-groups.txt: > * <pre> > * search.group.count=[int] > * search.group.name.[i]=[string] (for i=0 to count-1) > * > * For each name: > * [name].part.count=[int] partitionCount > * [name].part.[i].host=[string] (for i=0 to partitionCount-1) > * [name].part.[i].port=int (for i=0 to partitionCount-1) > * > * Example: > * search.group.count=2 > * search.group.name.0=master > * search.group.name.1=backup > * > * master.part.count=2 > * master.part.0.host=host1 > * master.part.0.port=7777 > * master.part.1.host=host2 > * master.part.1.port=7777 > * > * backup.part.count=2 > * backup.part.0.host=host3 > * backup.part.0.port=7777 > * backup.part.1.host=host4 > * backup.part.1.port=7777 > * </pre>. > ------------------------------------------------ > If more than one search group is defined in configuration file requests are distributed among groups in round-robin fashion. If one of the servers from the group fails to respond the whole group is treated as inactive and removed from the pool used to distributed requests. There is a separate recovery thread that every "searcher.recovery.delay" seconds (default 60) tries to check if inactive became alive and if so adds it back to the pool of active groups. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From osmith@example.org Fri Apr 01 14:29:48 2011 Return-Path: <osmith@example.org> Delivered-To: osmith@example.org Received: (qmail 83531 invoked from network); 1 Apr 2011 14:29:47 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 14:29:47 -0000 Received: (qmail 19999 invoked by uid 500); 1 Apr 2011 14:29:45 -0000 Delivered-To: osmith@example.org Received: (qmail 19955 invoked by uid 500); 1 Apr 2011 14:29:45 -0000 Mailing-List: contact osmith@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:osmith@example.org> List-Unsubscribe: <mailto:osmith@example.org> List-Post: <mailto:osmith@example.org> List-Id: <dev.nutch.apache.org> Reply-To: osmith@example.org Delivered-To: mailing list osmith@example.org Received: (qmail 19930 invoked by uid 99); 1 Apr 2011 14:29:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:29:45 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:29:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id CF82A8D3C6 for <osmith@example.org>; Fri, 1 Apr 2011 14:29:05 +0000 (UTC) Date: Fri, 1 Apr 2011 14:29:05 +0000 (UTC) From: "Markus Jelsma (JIRA)" <osmith@example.org> To: osmith@example.org Message-ID: <osmith@example.org> Subject: [jira] [Closed] (NUTCH-83) Release deliverable as zip MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/NUTCH-83?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Markus Jelsma closed NUTCH-83. ------------------------------ Resolution: Won't Fix Bulk close of legacy issues: http://www.lucidimagination.com/search/document/2738eeb014805854/clean_up_open_legacy_issues_in_jira > Release deliverable as zip > -------------------------- > > Key: NUTCH-83 > URL: https://issues.apache.org/jira/browse/NUTCH-83 > Project: Nutch > Issue Type: Improvement > Environment: Windows > Reporter: AJ Banck > Attachments: build_zip.patch > > > Like Lucene, Nutch could be delivered as a .zip file so it can be used with default tools on Windows. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From osmith@example.org Fri Apr 01 14:29:50 2011 Return-Path: <osmith@example.org> Delivered-To: osmith@example.org Received: (qmail 83639 invoked from network); 1 Apr 2011 14:29:49 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 14:29:49 -0000 Received: (qmail 20091 invoked by uid 500); 1 Apr 2011 14:29:45 -0000 Delivered-To: osmith@example.org Received: (qmail 20052 invoked by uid 500); 1 Apr 2011 14:29:45 -0000 Mailing-List: contact osmith@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:osmith@example.org> List-Unsubscribe: <mailto:osmith@example.org> List-Post: <mailto:osmith@example.org> List-Id: <dev.nutch.apache.org> Reply-To: osmith@example.org Delivered-To: mailing list osmith@example.org Received: (qmail 20020 invoked by uid 99); 1 Apr 2011 14:29:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:29:45 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:29:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id DC10C8D3C8 for <osmith@example.org>; Fri, 1 Apr 2011 14:29:05 +0000 (UTC) Date: Fri, 1 Apr 2011 14:29:05 +0000 (UTC) From: "Markus Jelsma (JIRA)" <osmith@example.org> To: osmith@example.org Message-ID: <osmith@example.org> Subject: [jira] [Closed] (NUTCH-103) Vivisimo like treeview and url redirect MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/NUTCH-103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Markus Jelsma closed NUTCH-103. ------------------------------- Resolution: Won't Fix Bulk close of legacy issues: http://www.lucidimagination.com/search/document/2738eeb014805854/clean_up_open_legacy_issues_in_jira > Vivisimo like treeview and url redirect > --------------------------------------- > > Key: NUTCH-103 > URL: https://issues.apache.org/jira/browse/NUTCH-103 > Project: Nutch > Issue Type: Improvement > Components: web gui > Affects Versions: 0.8 > Environment: linux > Reporter: robert benea > Priority: Trivial > Attachments: clusty.tar > > > First, I modified cluster.jsp and now the cluster has a vivisimo look. I used javascript to show the treeview. Another small change is that I call the cluster recursively twice, so that two levels of clustering are shown. > Second, I added redirect.jsp in order to log the links that were clicked during search and because of that search.jsp is changed as well. > The code is not clean as all started as an experiment, I hope someone else finds it useful and clean it up ;-). > To install it just copy the files where you deployed the nutch.war and will work auto-magically. > Regards, > R. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From osmith@example.org Fri Apr 01 14:31:45 2011 Return-Path: <osmith@example.org> Delivered-To: osmith@example.org Received: (qmail 98841 invoked from network); 1 Apr 2011 14:31:44 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 14:31:44 -0000 Received: (qmail 28822 invoked by uid 500); 1 Apr 2011 14:31:43 -0000 Delivered-To: osmith@example.org Received: (qmail 28786 invoked by uid 500); 1 Apr 2011 14:31:43 -0000 Mailing-List: contact osmith@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:osmith@example.org> List-Unsubscribe: <mailto:osmith@example.org> List-Post: <mailto:osmith@example.org> List-Id: <dev.nutch.apache.org> Reply-To: osmith@example.org Delivered-To: mailing list osmith@example.org Received: (qmail 28779 invoked by uid 99); 1 Apr 2011 14:31:43 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:31:43 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:31:42 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id F3AD08D58E for <osmith@example.org>; Fri, 1 Apr 2011 14:31:05 +0000 (UTC) Date: Fri, 1 Apr 2011 14:31:05 +0000 (UTC) From: "David Escuer (JIRA)" <osmith@example.org> To: osmith@example.org Message-ID: <osmith@example.org> Subject: [jira] [Commented] (NUTCH-18) Windows servers include illegal characters in URLs MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/NUTCH-18?page=3Dcom.atlassian.j= ira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D130145= 81#comment-13014581 ]=20 David Escuer commented on NUTCH-18: ----------------------------------- La persona amb la qui vol contactar estar=C3=A0 fora de les oficines de SIMPPLE des del 30 de mar=C3=A7 fins al 7 d'abril, ambd=C3=B3s inclosos. La persona con la que quiere contactar estar=C3=A1 fuera de las oficinas de SIMPPLE desde el 30 de marzo hasta el 7 de abril, ambos incluidos. The person you are trying to reach will be out of the office from march 30 until april 7 (both included). > Windows servers include illegal characters in URLs > -------------------------------------------------- > > Key: NUTCH-18 > URL: https://issues.apache.org/jira/browse/NUTCH-18 > Project: Nutch > Issue Type: Bug > Components: fetcher > Reporter: Stefan Groschupf > Priority: Minor > > Transfered from: > http://sourceforge.net/tracker/index.php?func=3Ddetail&aid=3D1110243&grou= p_id=3D59548&atid=3D491356 > submitted by: > Ken Meltsner > While spidering our intranet, I found that IIS may include=20 > illegal characters in URLs -- specifically, characters with=20 > the high bit set to produce non-English letters. In=20 > addition, both Firefox and IE will accept URLs with high- > bit characters, but Java won't. > While this may not be Nutch's (or Java's) fault, it would=20 > help if high-bit characters (and other illegal characters)=20 > in URLs could be escaped (using percent-hex notation)=20 > as part of the URL fix-up process, probably right after=20 > the hostname lower-case conversion. > Example document name in Portuguese(with high-bit=20 > characters) taken from a longer URL: > Nota%20tecnica%20-%20Altera=C3=A7=C3=A3o%20de% > 20escopo.doc > and with percent-escaped characters: > Nota%20tecnica%20-%20Altera%e7%e3o%20de% > 20escopo.doc -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From osmith@example.org Fri Apr 01 14:31:45 2011 Return-Path: <osmith@example.org> Delivered-To: osmith@example.org Received: (qmail 98999 invoked from network); 1 Apr 2011 14:31:45 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 14:31:45 -0000 Received: (qmail 29419 invoked by uid 500); 1 Apr 2011 14:31:44 -0000 Delivered-To: osmith@example.org Received: (qmail 29364 invoked by uid 500); 1 Apr 2011 14:31:44 -0000 Mailing-List: contact osmith@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:osmith@example.org> List-Unsubscribe: <mailto:osmith@example.org> List-Post: <mailto:osmith@example.org> List-Id: <dev.nutch.apache.org> Reply-To: osmith@example.org Delivered-To: mailing list osmith@example.org Received: (qmail 29266 invoked by uid 99); 1 Apr 2011 14:31:44 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:31:44 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:31:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id 6D6448D59A for <osmith@example.org>; Fri, 1 Apr 2011 14:31:06 +0000 (UTC) Date: Fri, 1 Apr 2011 14:31:06 +0000 (UTC) From: "Markus Jelsma (JIRA)" <osmith@example.org> To: osmith@example.org Message-ID: <{{EMAIL+PHONE}}> Subject: [jira] [Closed] (NUTCH-104) Nutch query parser does not support CJK bi-gram segmentation. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/NUTCH-104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Markus Jelsma closed NUTCH-104. ------------------------------- Resolution: Won't Fix Bulk close of legacy issues: http://www.lucidimagination.com/search/document/2738eeb014805854/clean_up_open_legacy_issues_in_jira > Nutch query parser does not support CJK bi-gram segmentation. > ------------------------------------------------------------- > > Key: NUTCH-104 > URL: https://issues.apache.org/jira/browse/NUTCH-104 > Project: Nutch > Issue Type: Bug > Components: searcher > Affects Versions: 0.6 > Environment: all > Reporter: Jack Tang > Priority: Minor > > I customize one query filter using "test" as my field. And when i try to search "test:(c1)(c2)(c3)", the query object which is generated by NutchAnalysis is wrong. Now the result is > test:(c1)(c2) [DEFAULT](c2)(c3). > However, the expected result is > test:"(c1)(c2) (c2)(c3)". -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From osmith@example.org Fri Apr 01 14:31:46 2011 Return-Path: <osmith@example.org> Delivered-To: osmith@example.org Received: (qmail 99138 invoked from network); 1 Apr 2011 14:31:45 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 14:31:45 -0000 Received: (qmail 29539 invoked by uid 500); 1 Apr 2011 14:31:44 -0000 Delivered-To: osmith@example.org Received: (qmail 29500 invoked by uid 500); 1 Apr 2011 14:31:44 -0000 Mailing-List: contact osmith@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:osmith@example.org> List-Unsubscribe: <mailto:osmith@example.org> List-Post: <mailto:osmith@example.org> List-Id: <dev.nutch.apache.org> Reply-To: osmith@example.org Delivered-To: mailing list osmith@example.org Received: (qmail 29455 invoked by uid 99); 1 Apr 2011 14:31:44 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:31:44 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:31:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id 8F8BF8D5A0 for <osmith@example.org>; Fri, 1 Apr 2011 14:31:06 +0000 (UTC) Date: Fri, 1 Apr 2011 14:31:06 +0000 (UTC) From: "Markus Jelsma (JIRA)" <osmith@example.org> To: osmith@example.org Message-ID: <osmith@example.org> Subject: [jira] [Closed] (NUTCH-144) corrupt language identifier tri files and bad language recognition for german MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/NUTCH-144?page=3Dcom.atlassian= .jira.plugin.system.issuetabpanels:all-tabpanel ] Markus Jelsma closed NUTCH-144. ------------------------------- Resolution: Won't Fix Bulk close of legacy issues: http://www.lucidimagination.com/search/document/2738eeb014805854/clean_up_o= pen_legacy_issues_in_jira > corrupt language identifier tri files and bad language recognition for ge= rman > -------------------------------------------------------------------------= ---- > > Key: NUTCH-144 > URL: https://issues.apache.org/jira/browse/NUTCH-144 > Project: Nutch > Issue Type: Improvement > Affects Versions: 0.8 > Reporter: Bernhard Messer > Priority: Minor > > Hi, > i had a look at the generated language guesser tri files. As far as i can= say, several of them (de.ngp, da.ngp, es.ngp) seems to be corrupt which le= eds to bad language recognition ratio. For example the german tri file shou= ld contain the german special characters "=C3=A4", "=C3=B6", "=C3=BC" with = their frequency. The text "gr=C3=BCne H=C3=BCte" which is typical german, i= s recognized as danish. May be the problem comes from wrong character encod= ing during training. > Jerome, could you provide the training files so that the language identif= ier can be retrained ? > regards > Bernhard -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From osmith@example.org Fri Apr 01 14:31:47 2011 Return-Path: <osmith@example.org> Delivered-To: osmith@example.org Received: (qmail 99279 invoked from network); 1 Apr 2011 14:31:46 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 14:31:46 -0000 Received: (qmail 29836 invoked by uid 500); 1 Apr 2011 14:31:44 -0000 Delivered-To: osmith@example.org Received: (qmail 29770 invoked by uid 500); 1 Apr 2011 14:31:44 -0000 Mailing-List: contact osmith@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:osmith@example.org> List-Unsubscribe: <mailto:osmith@example.org> List-Post: <mailto:osmith@example.org> List-Id: <dev.nutch.apache.org> Reply-To: osmith@example.org Delivered-To: mailing list osmith@example.org Received: (qmail 29739 invoked by uid 99); 1 Apr 2011 14:31:44 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:31:44 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 14:31:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id 964048D5A1 for <osmith@example.org>; Fri, 1 Apr 2011 14:31:06 +0000 (UTC) Date: Fri, 1 Apr 2011 14:31:06 +0000 (UTC) From: "Markus Jelsma (JIRA)" <osmith@example.org> To: osmith@example.org Message-ID: <osmith@example.org> Subject: [jira] [Closed] (NUTCH-180) Performance problem with widely used keywords MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/NUTCH-180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Markus Jelsma closed NUTCH-180. ------------------------------- Resolution: Won't Fix Bulk close of legacy issues: http://www.lucidimagination.com/search/document/2738eeb014805854/clean_up_open_legacy_issues_in_jira > Performance problem with widely used keywords > --------------------------------------------- > > Key: NUTCH-180 > URL: https://issues.apache.org/jira/browse/NUTCH-180 > Project: Nutch > Issue Type: Wish > Components: searcher > Reporter: Mike Alulin > > It looks like Nutch is very slow when the search phrase includes a few widely used keywords. For example "I 1 2 3 4 5 6 7 8 9 0" typed without the quotes to Yahoo, Google, or MSN is processed in less than a second. Nutch on the other hand requires much more time for this even on smaller databases. For example this phrase made objectssearch.com think more than 1 minute although their DB is much smaller than DBs of the big 3 guys. On my test Nutch DB with only 3M pages this phrase took a few seconds to process. > Unfortunately I do not know much about search algorithms, but it looks like Nutch do have some space to improve the search performance. The current implementation can be easily
{'source': 'Apache Software Foundation Public Mail Archives'}