From johnwilliams@example.org Wed Sep 03 02:44:01 2008 Return-Path: <johnwilliams@example.org> Delivered-To: johnwilliams@example.org Received: (qmail 35721 invoked from network); 3 Sep 2008 02:44:00 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Sep 2008 02:44:00 -0000 Received: (qmail 13622 invoked by uid 500); 3 Sep 2008 02:43:58 -0000 Delivered-To: johnwilliams@example.org Received: (qmail 13530 invoked by uid 500); 3 Sep 2008 02:43:58 -0000 Mailing-List: contact johnwilliams@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:johnwilliams@example.org> List-Unsubscribe: <mailto:johnwilliams@example.org> List-Post: <mailto:johnwilliams@example.org> List-Id: <commits.labs.apache.org> Reply-To: johnwilliams@example.org Delivered-To: mailing list johnwilliams@example.org Received: (qmail 13521 invoked by uid 99); 3 Sep 2008 02:43:58 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Sep 2008 19:43:58 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO eris.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Sep 2008 02:43:08 +0000 Received: by eris.apache.org (Postfix, from userid 65534) id 3D34C238899E; Tue, 2 Sep 2008 19:43:39 -0700 (PDT) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r691475 - in /labs/pinpoint/trunk: ./ pinpoint-cli/ pinpoint-core/ pinpoint-importer/ pinpoint-loadgenerator/ pinpoint-metric/ pinpoint-reports/ pinpoint-search/ pinpoint-service-appender/ pinpoint-service/ pinpoint-service/src/assembly/ pi... Date: Wed, 03 Sep 2008 02:43:38 -0000 To: johnwilliams@example.org From: johnwilliams@example.org X-Mailer: svnmailer-1.0.8 Message-Id: <johnwilliams@example.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: psmith Date: Tue Sep 2 19:43:38 2008 New Revision: 691475 URL: http://svn.apache.org/viewvc?rev=691475&view=rev Log: Removed .zip as a assembly for the service (it just takes too long to generate). Tidy up some Eclipse turdlets and svn:ignoe Removed: labs/pinpoint/trunk/.classpath labs/pinpoint/trunk/.project labs/pinpoint/trunk/pinpoint-importer/.classpath Modified: labs/pinpoint/trunk/ (props changed) labs/pinpoint/trunk/pinpoint-cli/ (props changed) labs/pinpoint/trunk/pinpoint-core/ (props changed) labs/pinpoint/trunk/pinpoint-importer/ (props changed) labs/pinpoint/trunk/pinpoint-loadgenerator/ (props changed) labs/pinpoint/trunk/pinpoint-metric/ (props changed) labs/pinpoint/trunk/pinpoint-reports/ (props changed) labs/pinpoint/trunk/pinpoint-search/ (props changed) labs/pinpoint/trunk/pinpoint-service/ (props changed) labs/pinpoint/trunk/pinpoint-service-appender/ (props changed) labs/pinpoint/trunk/pinpoint-service/src/assembly/service.xml labs/pinpoint/trunk/pinpoint-swing/ (props changed) labs/pinpoint/trunk/pinpoint-web/ (props changed) labs/pinpoint/trunk/pom.xml Propchange: labs/pinpoint/trunk/ ------------------------------------------------------------------------------ --- svn:ignore (original) +++ svn:ignore Tue Sep 2 19:43:38 2008 @@ -3,3 +3,6 @@ activemq-data derbydb derby.log +target-eclipse +.classpath +.project Propchange: labs/pinpoint/trunk/pinpoint-cli/ ------------------------------------------------------------------------------ --- svn:ignore (original) +++ svn:ignore Tue Sep 2 19:43:38 2008 @@ -1,4 +1,5 @@ target +target-eclipse .settings .classpath .project Propchange: labs/pinpoint/trunk/pinpoint-core/ ------------------------------------------------------------------------------ --- svn:ignore (original) +++ svn:ignore Tue Sep 2 19:43:38 2008 @@ -1,4 +1,5 @@ target +target-eclipse hsql* .settings .classpath Propchange: labs/pinpoint/trunk/pinpoint-importer/ ------------------------------------------------------------------------------ --- svn:ignore (original) +++ svn:ignore Tue Sep 2 19:43:38 2008 @@ -2,3 +2,4 @@ .settings .classpath .project +target-eclipse Propchange: labs/pinpoint/trunk/pinpoint-loadgenerator/ ------------------------------------------------------------------------------ --- svn:ignore (original) +++ svn:ignore Tue Sep 2 19:43:38 2008 @@ -1 +1,5 @@ target +target-eclipse +.settings +.classpath +.project Propchange: labs/pinpoint/trunk/pinpoint-metric/ ------------------------------------------------------------------------------ --- svn:ignore (original) +++ svn:ignore Tue Sep 2 19:43:38 2008 @@ -1,4 +1,5 @@ target +target-eclipse .settings .classpath .project Propchange: labs/pinpoint/trunk/pinpoint-reports/ ------------------------------------------------------------------------------ --- svn:ignore (original) +++ svn:ignore Tue Sep 2 19:43:38 2008 @@ -1,2 +1,6 @@ target +target-eclipse +.project +.classpath +.settings Propchange: labs/pinpoint/trunk/pinpoint-search/ ------------------------------------------------------------------------------ --- svn:ignore (original) +++ svn:ignore Tue Sep 2 19:43:38 2008 @@ -1,4 +1,5 @@ target +target-eclipse .settings .project .classpath Propchange: labs/pinpoint/trunk/pinpoint-service/ ------------------------------------------------------------------------------ --- svn:ignore (original) +++ svn:ignore Tue Sep 2 19:43:38 2008 @@ -4,3 +4,4 @@ .project activem* metricGraph.jpg +target-eclipse Propchange: labs/pinpoint/trunk/pinpoint-service-appender/ ------------------------------------------------------------------------------ --- svn:ignore (original) +++ svn:ignore Tue Sep 2 19:43:38 2008 @@ -1,5 +1,6 @@ .project .classpath target +target-eclipse activemq-data .settings Modified: labs/pinpoint/trunk/pinpoint-service/src/assembly/service.xml URL: http://svn.apache.org/viewvc/labs/pinpoint/trunk/pinpoint-service/src/assembly/service.xml?rev=691475&r1=691474&r2=691475&view=diff ============================================================================== --- labs/pinpoint/trunk/pinpoint-service/src/assembly/service.xml (original) +++ labs/pinpoint/trunk/pinpoint-service/src/assembly/service.xml Tue Sep 2 19:43:38 2008 @@ -2,7 +2,6 @@ <assembly> <id>service</id> <formats> - <format>zip</format> <format>tar.gz</format> </formats> <fileSets> Propchange: labs/pinpoint/trunk/pinpoint-swing/ ------------------------------------------------------------------------------ --- svn:ignore (original) +++ svn:ignore Tue Sep 2 19:43:38 2008 @@ -1 +1,5 @@ target +target-eclipse +.classpath +.project +.settings Propchange: labs/pinpoint/trunk/pinpoint-web/ ------------------------------------------------------------------------------ --- svn:ignore (original) +++ svn:ignore Tue Sep 2 19:43:38 2008 @@ -1,4 +1,5 @@ target +target-eclipse .settings .project .classpath Modified: labs/pinpoint/trunk/pom.xml URL: http://svn.apache.org/viewvc/labs/pinpoint/trunk/pom.xml?rev=691475&r1=691474&r2=691475&view=diff ============================================================================== --- labs/pinpoint/trunk/pom.xml (original) +++ labs/pinpoint/trunk/pom.xml Tue Sep 2 19:43:38 2008 @@ -41,7 +41,7 @@ <spring.version>2.5.1</spring.version> <jfreechart.version>1.0.5</jfreechart.version> <joda.version>1.4</joda.version> - <ehcache.version>1.4.0-beta</ehcache.version> + <ehcache.version>1.4.1</ehcache.version> <derby.version>83.161.120.155</derby.version> <json-lib.version>2.2.1</json-lib.version> <junit.version>3.8.2</junit.version> --------------------------------------------------------------------- To unsubscribe, e-mail: johnwilliams@example.org For additional commands, e-mail: johnwilliams@example.org From johnwilliams@example.org Wed Sep 03 21:17:56 2008 Return-Path: <johnwilliams@example.org> Delivered-To: johnwilliams@example.org Received: (qmail 93545 invoked from network); 3 Sep 2008 21:17:55 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Sep 2008 21:17:55 -0000 Received: (qmail 99905 invoked by uid 500); 3 Sep 2008 21:17:54 -0000 Delivered-To: johnwilliams@example.org Received: (qmail 99753 invoked by uid 500); 3 Sep 2008 21:17:53 -0000 Mailing-List: contact johnwilliams@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:johnwilliams@example.org> List-Unsubscribe: <mailto:johnwilliams@example.org> List-Post: <mailto:johnwilliams@example.org> List-Id: <commits.labs.apache.org> Reply-To: johnwilliams@example.org Delivered-To: mailing list johnwilliams@example.org Received: (qmail 99742 invoked by uid 99); 3 Sep 2008 21:17:52 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Sep 2008 14:17:52 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO eris.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Sep 2008 21:17:02 +0000 Received: by eris.apache.org (Postfix, from userid 65534) id 820A1238896F; Wed, 3 Sep 2008 14:17:33 -0700 (PDT) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Subject: svn commit: r691776 - in /labs/droids/trunk/docs: changes.html changes.pdf todo.html todo.pdf Date: Wed, 03 Sep 2008 21:17:33 -0000 To: johnwilliams@example.org From: johnwilliams@example.org X-Mailer: svnmailer-1.0.8 Message-Id: <johnwilliams@example.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: thorsten Date: Wed Sep 3 14:17:32 2008 New Revision: 691776 URL: http://svn.apache.org/viewvc?rev=691776&view=rev Log: Adding new todos and updating changes Modified: labs/droids/trunk/docs/changes.html labs/droids/trunk/docs/changes.pdf labs/droids/trunk/docs/todo.html labs/droids/trunk/docs/todo.pdf Modified: labs/droids/trunk/docs/changes.html URL: http://svn.apache.org/viewvc/labs/droids/trunk/docs/changes.html?rev=691776&r1=691775&r2=691776&view=diff ============================================================================== --- labs/droids/trunk/docs/changes.html (original) +++ labs/droids/trunk/docs/changes.html Wed Sep 3 14:17:32 2008 @@ -223,6 +223,12 @@ <img alt="update" class="icon" src="images/update.jpg" /> Cleaning up old nutch based code with a clean new spring implementation. Committed by thorsten.</li> +<li> +<img alt="update" class="icon" src="images/update.jpg" /> + Strip down dependencies to the bare limit. + The core just has some depencies on spring + and infrastructure code (e.g. logging). + Committed by thorsten.</li> </ul> </div> <a name="docs" title="docs"> </a> Modified: labs/droids/trunk/docs/changes.pdf URL: http://svn.apache.org/viewvc/labs/droids/trunk/docs/changes.pdf?rev=691776&r1=691775&r2=691776&view=diff ============================================================================== Binary files - no diff available. Modified: labs/droids/trunk/docs/todo.html URL: http://svn.apache.org/viewvc/labs/droids/trunk/docs/todo.html?rev=691776&r1=691775&r2=691776&view=diff ============================================================================== --- labs/droids/trunk/docs/todo.html (original) +++ labs/droids/trunk/docs/todo.html Wed Sep 3 14:17:32 2008 @@ -184,14 +184,17 @@ <ul> <li> <strong>[code]</strong> - Strip down dependencies to the bare limit and let plugin - have their own dependecies. The core should just have - some depencies on spring and infrastructure code (e.g. logging). - → thorsten</li> + Replace parse/parser code with Apache Tika. + → open</li> +<li> +<strong>[code]</strong> + Create plugin repository and build infrastructure + for them so that they can define their own dependecies. + → open</li> <li> <strong>[code]</strong> Finish Indexer example and document it. - → thorsten</li> + → open</li> <li> <strong>[docs]</strong> Create roadmap for the upcoming feature/enhancements. Modified: labs/droids/trunk/docs/todo.pdf URL: http://svn.apache.org/viewvc/labs/droids/trunk/docs/todo.pdf?rev=691776&r1=691775&r2=691776&view=diff ============================================================================== Binary files - no diff available. --------------------------------------------------------------------- To unsubscribe, e-mail: johnwilliams@example.org For additional commands, e-mail: johnwilliams@example.org From johnwilliams@example.org Wed Sep 03 21:18:18 2008 Return-Path: <johnwilliams@example.org> Delivered-To: johnwilliams@example.org Received: (qmail 94247 invoked from network); 3 Sep 2008 21:18:17 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Sep 2008 21:18:17 -0000 Received: (qmail 681 invoked by uid 500); 3 Sep 2008 21:18:15 -0000 Delivered-To: johnwilliams@example.org Received: (qmail 585 invoked by uid 500); 3 Sep 2008 21:18:15 -0000 Mailing-List: contact johnwilliams@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:johnwilliams@example.org> List-Unsubscribe: <mailto:johnwilliams@example.org> List-Post: <mailto:johnwilliams@example.org> List-Id: <commits.labs.apache.org> Reply-To: johnwilliams@example.org Delivered-To: mailing list johnwilliams@example.org Received: (qmail 576 invoked by uid 99); 3 Sep 2008 21:18:15 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Sep 2008 14:18:15 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO eris.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Sep 2008 21:17:17 +0000 Received: by eris.apache.org (Postfix, from userid 65534) id A6210238899B; Wed, 3 Sep 2008 14:17:48 -0700 (PDT) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r691777 - /labs/droids/trunk/docs/changes.rss Date: Wed, 03 Sep 2008 21:17:48 -0000 To: johnwilliams@example.org From: johnwilliams@example.org X-Mailer: svnmailer-1.0.8 Message-Id: <johnwilliams@example.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: thorsten Date: Wed Sep 3 14:17:48 2008 New Revision: 691777 URL: http://svn.apache.org/viewvc?rev=691777&view=rev Log: Adding new todos and updating changes Modified: labs/droids/trunk/docs/changes.rss Modified: labs/droids/trunk/docs/changes.rss URL: http://svn.apache.org/viewvc/labs/droids/trunk/docs/changes.rss?rev=691777&r1=691776&r2=691777&view=diff ============================================================================== --- labs/droids/trunk/docs/changes.rss (original) +++ labs/droids/trunk/docs/changes.rss Wed Sep 3 14:17:48 2008 @@ -52,6 +52,15 @@ Adding Droids javadoc. </description></item> + <item><title>MyProject code update</title><link>http://myproj.mygroup.org//changes.html</link><description>code update + by + thorsten + : + + Strip down dependencies to the bare limit. + The core just has some depencies on spring + and infrastructure code (e.g. logging). + </description></item> @@ -84,4 +93,12 @@ : Adding Droids javadoc. + </description></item><item><title>MyProject code update</title><link>http://myproj.mygroup.org//changes.html</link><description>code update + by + thorsten + : + + Strip down dependencies to the bare limit. + The core just has some depencies on spring + and infrastructure code (e.g. logging). </description></item></channel></rss> \ No newline at end of file --------------------------------------------------------------------- To unsubscribe, e-mail: johnwilliams@example.org For additional commands, e-mail: johnwilliams@example.org From johnwilliams@example.org Wed Sep 03 23:05:21 2008 Return-Path: <johnwilliams@example.org> Delivered-To: johnwilliams@example.org Received: (qmail 76830 invoked from network); 3 Sep 2008 23:05:21 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Sep 2008 23:05:21 -0000 Received: (qmail 46560 invoked by uid 500); 3 Sep 2008 23:05:19 -0000 Delivered-To: johnwilliams@example.org Received: (qmail 46427 invoked by uid 500); 3 Sep 2008 23:05:18 -0000 Mailing-List: contact johnwilliams@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:johnwilliams@example.org> List-Unsubscribe: <mailto:johnwilliams@example.org> List-Post: <mailto:johnwilliams@example.org> List-Id: <commits.labs.apache.org> Reply-To: johnwilliams@example.org Delivered-To: mailing list johnwilliams@example.org Received: (qmail 46418 invoked by uid 99); 3 Sep 2008 23:05:18 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Sep 2008 16:05:18 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO eris.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Sep 2008 23:04:29 +0000 Received: by eris.apache.org (Postfix, from userid 65534) id F35CA238896F; Wed, 3 Sep 2008 16:04:29 -0700 (PDT) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r691817 - /labs/droids/trunk/src/core/java/org/apache/droids/parse/html/HtmlParser.java Date: Wed, 03 Sep 2008 23:04:29 -0000 To: johnwilliams@example.org From: johnwilliams@example.org X-Mailer: svnmailer-1.0.8 Message-Id: <johnwilliams@example.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: thorsten Date: Wed Sep 3 16:04:29 2008 New Revision: 691817 URL: http://svn.apache.org/viewvc?rev=691817&view=rev Log: Removing sysout debugs Modified: labs/droids/trunk/src/core/java/org/apache/droids/parse/html/HtmlParser.java Modified: labs/droids/trunk/src/core/java/org/apache/droids/parse/html/HtmlParser.java URL: http://svn.apache.org/viewvc/labs/droids/trunk/src/core/java/org/apache/droids/parse/html/HtmlParser.java?rev=691817&r1=691816&r2=691817&view=diff ============================================================================== --- labs/droids/trunk/src/core/java/org/apache/droids/parse/html/HtmlParser.java (original) +++ labs/droids/trunk/src/core/java/org/apache/droids/parse/html/HtmlParser.java Wed Sep 3 16:04:29 2008 @@ -65,7 +65,6 @@ public Parse getParse(InputStream stream, Task newLink) { this.link = newLink; final String id = link.getId(); - System.out.println("id: "+id); try { this.base = new URL(newLink.getId()); } catch (MalformedURLException e1) { @@ -142,7 +141,6 @@ String nodeName = node.getNodeName().toLowerCase(); if (elements.containsKey(nodeName)) { String value = elements.get(nodeName); - System.out.println("key "+nodeName+" value "+value); NamedNodeMap attrs = node.getAttributes(); String target = null; for (int i = 0; i < attrs.getLength(); i++) { --------------------------------------------------------------------- To unsubscribe, e-mail: johnwilliams@example.org For additional commands, e-mail: johnwilliams@example.org From johnwilliams@example.org Wed Sep 03 23:06:20 2008 Return-Path: <johnwilliams@example.org> Delivered-To: johnwilliams@example.org Received: (qmail 77592 invoked from network); 3 Sep 2008 23:06:19 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Sep 2008 23:06:19 -0000 Received: (qmail 46903 invoked by uid 500); 3 Sep 2008 23:06:17 -0000 Delivered-To: johnwilliams@example.org Received: (qmail 46797 invoked by uid 500); 3 Sep 2008 23:06:17 -0000 Mailing-List: contact johnwilliams@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:johnwilliams@example.org> List-Unsubscribe: <mailto:johnwilliams@example.org> List-Post: <mailto:johnwilliams@example.org> List-Id: <commits.labs.apache.org> Reply-To: johnwilliams@example.org Delivered-To: mailing list johnwilliams@example.org Received: (qmail 46765 invoked by uid 99); 3 Sep 2008 23:06:17 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Sep 2008 16:06:17 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO eris.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Sep 2008 23:05:27 +0000 Received: by eris.apache.org (Postfix, from userid 65534) id 70A47238896F; Wed, 3 Sep 2008 16:05:58 -0700 (PDT) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r691818 - /labs/droids/trunk/status.xml Date: Wed, 03 Sep 2008 23:05:58 -0000 To: johnwilliams@example.org From: johnwilliams@example.org X-Mailer: svnmailer-1.0.8 Message-Id: <johnwilliams@example.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: thorsten Date: Wed Sep 3 16:05:57 2008 New Revision: 691818 URL: http://svn.apache.org/viewvc?rev=691818&view=rev Log: Adding new todos and updating changes Modified: labs/droids/trunk/status.xml Modified: labs/droids/trunk/status.xml URL: http://svn.apache.org/viewvc/labs/droids/trunk/status.xml?rev=691818&r1=691817&r2=691818&view=diff ============================================================================== --- labs/droids/trunk/status.xml (original) +++ labs/droids/trunk/status.xml Wed Sep 3 16:05:57 2008 @@ -48,16 +48,23 @@ <action dev="thorsten" type="add" context="docs"> Adding Droids javadoc. </action> + <action context="code" dev="thorsten" type="update"> + Strip down dependencies to the bare limit. + The core just has some depencies on spring + and infrastructure code (e.g. logging). + </action> </release> </changes> <todo> <actions priority="high"> - <action context="code" dev="thorsten"> - Strip down dependencies to the bare limit and let plugin - have their own dependecies. The core should just have - some depencies on spring and infrastructure code (e.g. logging). + <action context="code" dev="open" fixes-bug="LABS-118"> + Replace parse/parser code with Apache Tika. + </action> + <action context="code" dev="open"> + Create plugin repository and build infrastructure + for them so that they can define their own dependecies. </action> - <action context="code" dev="thorsten"> + <action context="code" dev="open"> Finish Indexer example and document it. </action> <action context="docs" dev="thorsten"> --------------------------------------------------------------------- To unsubscribe, e-mail: johnwilliams@example.org For additional commands, e-mail: johnwilliams@example.org From johnwilliams@example.org Wed Sep 03 23:08:46 2008 Return-Path: <johnwilliams@example.org> Delivered-To: johnwilliams@example.org Received: (qmail 79467 invoked from network); 3 Sep 2008 23:08:45 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Sep 2008 23:08:45 -0000 Received: (qmail 47702 invoked by uid 500); 3 Sep 2008 23:08:43 -0000 Delivered-To: johnwilliams@example.org Received: (qmail 47614 invoked by uid 500); 3 Sep 2008 23:08:43 -0000 Mailing-List: contact johnwilliams@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:johnwilliams@example.org> List-Unsubscribe: <mailto:johnwilliams@example.org> List-Post: <mailto:johnwilliams@example.org> List-Id: <commits.labs.apache.org> Reply-To: johnwilliams@example.org Delivered-To: mailing list johnwilliams@example.org Received: (qmail 47604 invoked by uid 99); 3 Sep 2008 23:08:43 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Sep 2008 16:08:43 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO eris.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Sep 2008 23:07:53 +0000 Received: by eris.apache.org (Postfix, from userid 65534) id 44678238896F; Wed, 3 Sep 2008 16:08:24 -0700 (PDT) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r691819 - /labs/droids/trunk/src/core/java/org/apache/droids/DefaultWorker.java Date: Wed, 03 Sep 2008 23:08:24 -0000 To: johnwilliams@example.org From: johnwilliams@example.org X-Mailer: svnmailer-1.0.8 Message-Id: <johnwilliams@example.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: thorsten Date: Wed Sep 3 16:08:23 2008 New Revision: 691819 URL: http://svn.apache.org/viewvc?rev=691819&view=rev Log: Extracting variable Modified: labs/droids/trunk/src/core/java/org/apache/droids/DefaultWorker.java Modified: labs/droids/trunk/src/core/java/org/apache/droids/DefaultWorker.java URL: http://svn.apache.org/viewvc/labs/droids/trunk/src/core/java/org/apache/droids/DefaultWorker.java?rev=691819&r1=691818&r2=691819&view=diff ============================================================================== --- labs/droids/trunk/src/core/java/org/apache/droids/DefaultWorker.java (original) +++ labs/droids/trunk/src/core/java/org/apache/droids/DefaultWorker.java Wed Sep 3 16:08:23 2008 @@ -64,10 +64,11 @@ setUri(link.getId()); String url = getUri(); Core.threadMessage("url " + url); - setProtocol(protocolFactory.getProtocol(url)); + final Protocol protocol = protocolFactory.getProtocol(url); + setProtocol(protocol); long workerId = getId(); - if (getProtocol().isAllowed(url)) { - String contentType = getProtocol().getContentType(url); + if (protocol.isAllowed(url)) { + String contentType = protocol.getContentType(url); Core.threadMessage("contentType " + contentType); if (contentType!=null){ parser = parserFactory.getParser(contentType); --------------------------------------------------------------------- To unsubscribe, e-mail: johnwilliams@example.org For additional commands, e-mail: johnwilliams@example.org From johnwilliams@example.org Wed Sep 03 23:11:58 2008 Return-Path: <johnwilliams@example.org> Delivered-To: johnwilliams@example.org Received: (qmail 81892 invoked from network); 3 Sep 2008 23:11:57 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Sep 2008 23:11:57 -0000 Received: (qmail 49774 invoked by uid 500); 3 Sep 2008 23:11:55 -0000 Delivered-To: johnwilliams@example.org Received: (qmail 49660 invoked by uid 500); 3 Sep 2008 23:11:55 -0000 Mailing-List: contact johnwilliams@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:johnwilliams@example.org> List-Unsubscribe: <mailto:johnwilliams@example.org> List-Post: <mailto:johnwilliams@example.org> List-Id: <commits.labs.apache.org> Reply-To: johnwilliams@example.org Delivered-To: mailing list johnwilliams@example.org Received: (qmail 49640 invoked by uid 99); 3 Sep 2008 23:11:55 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Sep 2008 16:11:55 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO eris.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Sep 2008 23:11:05 +0000 Received: by eris.apache.org (Postfix, from userid 65534) id 3F2C323889A0; Wed, 3 Sep 2008 16:11:06 -0700 (PDT) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r691821 - in /labs/droids/trunk/src/core/java: org/apache/droids/droids-core-context.xml org/apache/droids/protocol/file/ org/apache/droids/protocol/file/FileProtocol.java org/apache/droids/protocol/file/package-info.java regex-urlfilter.txt Date: Wed, 03 Sep 2008 23:11:05 -0000 To: johnwilliams@example.org From: johnwilliams@example.org X-Mailer: svnmailer-1.0.8 Message-Id: <johnwilliams@example.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: thorsten Date: Wed Sep 3 16:11:05 2008 New Revision: 691821 URL: http://svn.apache.org/viewvc?rev=691821&view=rev Log: Adding start of a file implementation as protocol. Missing the getContentType method. Allowing file protocol for crawling. Added: labs/droids/trunk/src/core/java/org/apache/droids/protocol/file/ labs/droids/trunk/src/core/java/org/apache/droids/protocol/file/FileProtocol.java (with props) labs/droids/trunk/src/core/java/org/apache/droids/protocol/file/package-info.java (with props) Modified: labs/droids/trunk/src/core/java/org/apache/droids/droids-core-context.xml labs/droids/trunk/src/core/java/regex-urlfilter.txt Modified: labs/droids/trunk/src/core/java/org/apache/droids/droids-core-context.xml URL: http://svn.apache.org/viewvc/labs/droids/trunk/src/core/java/org/apache/droids/droids-core-context.xml?rev=691821&r1=691820&r2=691821&view=diff ============================================================================== --- labs/droids/trunk/src/core/java/org/apache/droids/droids-core-context.xml (original) +++ labs/droids/trunk/src/core/java/org/apache/droids/droids-core-context.xml Wed Sep 3 16:11:05 2008 @@ -44,6 +44,8 @@ <property name="timeout" value="10000"/> <property name="forceAllow" value="@droids.protocol.http.force@"/> </bean> + <bean name="org.apache.droids.api.Protocol/file" + class="org.apache.droids.protocol.file.FileProtocol" scope="prototype"/> <!-- Parser --> <bean name="text/html" Added: labs/droids/trunk/src/core/java/org/apache/droids/protocol/file/FileProtocol.java URL: http://svn.apache.org/viewvc/labs/droids/trunk/src/core/java/org/apache/droids/protocol/file/FileProtocol.java?rev=691821&view=auto ============================================================================== --- labs/droids/trunk/src/core/java/org/apache/droids/protocol/file/FileProtocol.java (added) +++ labs/droids/trunk/src/core/java/org/apache/droids/protocol/file/FileProtocol.java Wed Sep 3 16:11:05 2008 @@ -0,0 +1,39 @@ +package org.apache.droids.protocol.file; + +import java.io.BufferedInputStream; +import java.io.File; +import java.io.FileInputStream; +import java.io.IOException; +import java.io.InputStream; +import java.net.MalformedURLException; + +import org.apache.droids.api.Protocol; + +public class FileProtocol implements Protocol { + FileInputStream fileInputStream=null; + + public String getContentType(String url) { + // FIXME: to be implemented + return null; + } + + public boolean isAllowed(String url) throws MalformedURLException { + File file = new File(extractLocation(url)); + return file.canRead(); + } + + public InputStream openStream(String url) throws IOException { + url = extractLocation(url); + fileInputStream = new FileInputStream(url); + return new BufferedInputStream(fileInputStream); + } + + private String extractLocation(String url) { + final int start = url.indexOf("://"); + if(start>-1){ + url = url.substring(start+3); + } + return url; + } + +} Propchange: labs/droids/trunk/src/core/java/org/apache/droids/protocol/file/FileProtocol.java ------------------------------------------------------------------------------ svn:eol-style = native Added: labs/droids/trunk/src/core/java/org/apache/droids/protocol/file/package-info.java URL: http://svn.apache.org/viewvc/labs/droids/trunk/src/core/java/org/apache/droids/protocol/file/package-info.java?rev=691821&view=auto ============================================================================== --- labs/droids/trunk/src/core/java/org/apache/droids/protocol/file/package-info.java (added) +++ labs/droids/trunk/src/core/java/org/apache/droids/protocol/file/package-info.java Wed Sep 3 16:11:05 2008 @@ -0,0 +1,21 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ +/** + * This package contains various parser. + */ +package org.apache.droids.protocol.file; + Propchange: labs/droids/trunk/src/core/java/org/apache/droids/protocol/file/package-info.java ------------------------------------------------------------------------------ svn:eol-style = native Modified: labs/droids/trunk/src/core/java/regex-urlfilter.txt URL: http://svn.apache.org/viewvc/labs/droids/trunk/src/core/java/regex-urlfilter.txt?rev=691821&r1=691820&r2=691821&view=diff ============================================================================== --- labs/droids/trunk/src/core/java/regex-urlfilter.txt (original) +++ labs/droids/trunk/src/core/java/regex-urlfilter.txt Wed Sep 3 16:11:05 2008 @@ -23,7 +23,7 @@ # matches, the URL is ignored. # skip file: ftp: and mailto: urls --^(file|ftp|mailto): +-^(ftp|mailto): # skip URLs containing certain characters as probable queries, etc. -[*!@#] --------------------------------------------------------------------- To unsubscribe, e-mail: johnwilliams@example.org For additional commands, e-mail: johnwilliams@example.org From johnwilliams@example.org Wed Sep 03 23:25:38 2008 Return-Path: <johnwilliams@example.org> Delivered-To: johnwilliams@example.org Received: (qmail 91472 invoked from network); 3 Sep 2008 23:25:37 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Sep 2008 23:25:37 -0000 Received: (qmail 56284 invoked by uid 500); 3 Sep 2008 23:25:35 -0000 Delivered-To: johnwilliams@example.org Received: (qmail 56198 invoked by uid 500); 3 Sep 2008 23:25:35 -0000 Mailing-List: contact johnwilliams@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:johnwilliams@example.org> List-Unsubscribe: <mailto:johnwilliams@example.org> List-Post: <mailto:johnwilliams@example.org> List-Id: <commits.labs.apache.org> Reply-To: johnwilliams@example.org Delivered-To: mailing list johnwilliams@example.org Received: (qmail 56189 invoked by uid 99); 3 Sep 2008 23:25:35 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Sep 2008 16:25:34 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO eris.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Sep 2008 23:24:45 +0000 Received: by eris.apache.org (Postfix, from userid 65534) id F04D0238896F; Wed, 3 Sep 2008 16:24:45 -0700 (PDT) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r691826 - /labs/droids/trunk/src/core/java/org/apache/droids/DefaultWorker.java Date: Wed, 03 Sep 2008 23:24:45 -0000 To: johnwilliams@example.org From: johnwilliams@example.org X-Mailer: svnmailer-1.0.8 Message-Id: <johnwilliams@example.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: thorsten Date: Wed Sep 3 16:24:45 2008 New Revision: 691826 URL: http://svn.apache.org/viewvc?rev=691826&view=rev Log: Ryan McKinley pointed out that each uri is opened twice. This commit fixes this. Thanks Ryan. Modified: labs/droids/trunk/src/core/java/org/apache/droids/DefaultWorker.java Modified: labs/droids/trunk/src/core/java/org/apache/droids/DefaultWorker.java URL: http://svn.apache.org/viewvc/labs/droids/trunk/src/core/java/org/apache/droids/DefaultWorker.java?rev=691826&r1=691825&r2=691826&view=diff ============================================================================== --- labs/droids/trunk/src/core/java/org/apache/droids/DefaultWorker.java (original) +++ labs/droids/trunk/src/core/java/org/apache/droids/DefaultWorker.java Wed Sep 3 16:24:45 2008 @@ -1,6 +1,7 @@ package org.apache.droids; import java.io.IOException; +import java.io.InputStream; import java.net.MalformedURLException; import java.net.URL; import java.util.ArrayList; @@ -49,6 +50,8 @@ private HandlerFactory handlerFactory; private DelayTimer delayTimer; + + private InputStream openStream; private int depth; @@ -66,6 +69,7 @@ Core.threadMessage("url " + url); final Protocol protocol = protocolFactory.getProtocol(url); setProtocol(protocol); + openStream = getProtocol().openStream(getUri()); long workerId = getId(); if (protocol.isAllowed(url)) { String contentType = protocol.getContentType(url); @@ -85,13 +89,19 @@ } } catch (Exception e) { e.printStackTrace(); + }finally{ + try { + openStream.close(); + } catch (IOException e) { + e.printStackTrace(); + } } } protected void handle(Parse parse) throws MalformedURLException, IOException { String url = getUri(); - handlerFactory.handle(getProtocol().openStream(url), new URL(url), parse); + handlerFactory.handle(openStream, new URL(url), parse); } protected Parse getParse() { @@ -99,7 +109,7 @@ if (null != parser) { try { // extract links - parse = parser.getParse(getProtocol().openStream(getUri()), link); + parse = parser.getParse(openStream, link); // all links from the page unfiltered filter(parse); } catch (Exception e) { --------------------------------------------------------------------- To unsubscribe, e-mail: johnwilliams@example.org For additional commands, e-mail: johnwilliams@example.org From johnwilliams@example.org Thu Sep 04 11:23:50 2008 Return-Path: <johnwilliams@example.org> Delivered-To: johnwilliams@example.org Received: (qmail 28463 invoked from network); 4 Sep 2008 11:23:50 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 4 Sep 2008 11:23:50 -0000 Received: (qmail 35975 invoked by uid 500); 4 Sep 2008 11:23:47 -0000 Delivered-To: johnwilliams@example.org Received: (qmail 35850 invoked by uid 500); 4 Sep 2008 11:23:47 -0000 Mailing-List: contact johnwilliams@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:johnwilliams@example.org> List-Unsubscribe: <mailto:johnwilliams@example.org> List-Post: <mailto:johnwilliams@example.org> List-Id: <commits.labs.apache.org> Reply-To: johnwilliams@example.org Delivered-To: mailing list johnwilliams@example.org Received: (qmail 35841 invoked by uid 99); 4 Sep 2008 11:23:47 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Sep 2008 04:23:47 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO eris.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Sep 2008 11:22:47 +0000 Received: by eris.apache.org (Postfix, from userid 65534) id 148A4238899C; Thu, 4 Sep 2008 04:22:48 -0700 (PDT) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r691967 - in /labs/droids/trunk/src/documentation: content/xdocs/images/droidsOverview.svg content/xdocs/index.xml resources/dia/ resources/dia/droidsOverview.dia Date: Thu, 04 Sep 2008 11:22:47 -0000 To: johnwilliams@example.org From: johnwilliams@example.org X-Mailer: svnmailer-1.0.8 Message-Id: <johnwilliams@example.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: thorsten Date: Thu Sep 4 04:22:46 2008 New Revision: 691967 URL: http://svn.apache.org/viewvc?rev=691967&view=rev Log: adding more documentation and some graphics to explain the architecture. Added: labs/droids/trunk/src/documentation/content/xdocs/images/droidsOverview.svg (with props) labs/droids/trunk/src/documentation/resources/dia/ labs/droids/trunk/src/documentation/resources/dia/droidsOverview.dia (with props) Modified: labs/droids/trunk/src/documentation/content/xdocs/index.xml Added: labs/droids/trunk/src/documentation/content/xdocs/images/droidsOverview.svg URL: http://svn.apache.org/viewvc/labs/droids/trunk/src/documentation/content/xdocs/images/droidsOverview.svg?rev=691967&view=auto ============================================================================== --- labs/droids/trunk/src/documentation/content/xdocs/images/droidsOverview.svg (added) +++ labs/droids/trunk/src/documentation/content/xdocs/images/droidsOverview.svg Thu Sep 4 04:22:46 2008 @@ -0,0 +1,323 @@ +<?xml version="1.0" encoding="UTF-8" standalone="no"?> +<!-- Created by diasvg.py --> +<svg + xmlns:dc="http://purl.org/dc/elements/1.1/" + xmlns:cc="http://creativecommons.org/ns#" + xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" + xmlns:svg="http://www.w3.org/2000/svg" + xmlns="http://www.w3.org/2000/svg" + xmlns:sodipodi="http://sodipodi.sourceforge.net/DTD/sodipodi-0.dtd" + xmlns:inkscape="http://www.inkscape.org/namespaces/inkscape" + width="33.800cm" + height="12.250cm" + viewBox="1.050 -0.050 34.850 12.200" + id="svg2" + sodipodi:version="0.32" + inkscape:version="0.46" + sodipodi:docname="droidsOverview.svg" + inkscape:output_extension="org.inkscape.output.svg.inkscape"> + <metadata + id="metadata69"> + <rdf:RDF> + <cc:Work + rdf:about=""> + <dc:format>image/svg+xml</dc:format> + <dc:type + rdf:resource="http://purl.org/dc/dcmitype/StillImage" /> + </cc:Work> + </rdf:RDF> + </metadata> + <defs + id="defs67"> + <inkscape:perspective + sodipodi:type="inkscape:persp3d" + inkscape:vp_x="0 : 217.02756 : 1" + inkscape:vp_y="0 : 1000 : 0" + inkscape:vp_z="1197.6378 : 217.02756 : 1" + inkscape:persp3d-origin="598.81891 : 144.68504 : 1" + id="perspective71" /> + </defs> + <sodipodi:namedview + inkscape:window-height="949" + inkscape:window-width="1279" + inkscape:pageshadow="2" + inkscape:pageopacity="0.0" + guidetolerance="10.0" + gridtolerance="10.0" + objecttolerance="10.0" + borderopacity="1.0" + bordercolor="#666666" + pagecolor="#ffffff" + id="base" + showgrid="false" + inkscape:zoom="0.45172254" + inkscape:cx="729.78415" + inkscape:cy="217.02756" + inkscape:window-x="0" + inkscape:window-y="25" + inkscape:current-layer="svg2" /> + <rect + x="1.100" + y="-0.000" + width="6.600" + height="3.800" + fill="#FFFFFF" + stroke="none" + stroke-width="0" + id="rect4" /> + <rect + x="1.100" + y="-0.000" + width="6.600" + height="3.800" + fill="none" + stroke="#000000" + stroke-width="0.100" + id="rect6" /> + <text + x="2.4702404" + y="2.25" + font-size="1.50" + font-style="normal" + font-weight="700" + id="text8" + style="font-size:1.5px;font-style:normal;font-weight:700;text-anchor:start;fill:#000000;font-family:sans">Core</text> + <rect + x="14.500" + y="0.100" + width="6.850" + height="3.750" + fill="#FFFFFF" + stroke="none" + stroke-width="0" + id="rect10" /> + <rect + x="14.500" + y="0.100" + width="6.850" + height="3.750" + fill="none" + stroke="#000000" + stroke-width="0.100" + id="rect12" /> + <text + x="15.693024" + y="1.9680001" + font-size="1.50" + font-style="normal" + font-weight="700" + id="text14" + style="font-size:1.5px;font-style:normal;font-weight:700;text-anchor:start;fill:#000000;font-family:sans">droid</text> + <line + x1="7.924" + y1="1.902" + x2="14.276" + y2="1.973" + stroke="#000000" + stroke-width="0.100" + id="line16" /> + <polyline + fill="none" + stroke="#000000" + stroke-width="0.100" + points="8.315,1.657 7.812,1.901 8.309,2.157 " + id="polyline18" /> + <polyline + fill="none" + stroke="#000000" + stroke-width="0.100" + points="13.885,2.218 14.388,1.974 13.891,1.718 " + id="polyline20" /> + <text + x="9.900" + y="1.400" + fill="#000000" + text-anchor="start" + font-size="0.80" + font-family="sans" + font-style="normal" + font-weight="400" + id="text22"> +invokes</text> + <text + x="10.000" + y="2.850" + fill="#000000" + text-anchor="start" + font-size="0.80" + font-family="sans" + font-style="normal" + font-weight="400" + id="text24"> +reports</text> + <text + x="14.972141" + y="3.3394177" + font-size="0.80" + font-style="normal" + font-weight="400" + id="text26" + style="font-size:0.80000001px;font-style:normal;font-weight:400;line-height:100%;text-anchor:start;fill:#000000;font-family:sans" + sodipodi:linespacing="100%"> + <tspan + style="text-align:start;line-height:100%;writing-mode:lr-tb;text-anchor:start" + id="tspan2448">defaultCrawler</tspan> + </text> + <rect + x="28.100" + y="0.100" + width="6.700" + height="3.750" + fill="#FFFFFF" + stroke="none" + stroke-width="0" + id="rect28" /> + <rect + x="28.100" + y="0.100" + width="6.700" + height="3.750" + fill="none" + stroke="#000000" + stroke-width="0.100" + id="rect30" /> + <text + x="28.582569" + y="1.918" + font-size="1.50" + font-style="normal" + font-weight="700" + id="text32" + style="font-size:1.5px;font-style:normal;font-weight:700;text-anchor:start;fill:#000000;font-family:sans">worker</text> + <text + x="28.519075" + y="3.2218356" + font-size="0.80" + font-style="normal" + font-weight="400" + id="text34" + style="font-size:0.80000001px;font-style:normal;font-weight:400;text-anchor:start;fill:#000000;font-family:sans">defaultWorker</text> + <line + x1="21.574" + y1="1.975" + x2="27.876" + y2="1.975" + stroke="#000000" + stroke-width="0.100" + id="line36" /> + <polyline + fill="none" + stroke="#000000" + stroke-width="0.100" + points="21.962,1.725 21.462,1.975 21.962,2.225 " + id="polyline38" /> + <polyline + fill="none" + stroke="#000000" + stroke-width="0.100" + points="27.488,2.225 27.988,1.975 27.488,1.725 " + id="polyline40" /> + <text + x="23.541" + y="1.517" + fill="#000000" + text-anchor="start" + font-size="0.80" + font-family="sans" + font-style="normal" + font-weight="400" + id="text42"> +invokes</text> + <text + x="23.641" + y="2.967" + fill="#000000" + text-anchor="start" + font-size="0.80" + font-family="sans" + font-style="normal" + font-weight="400" + id="text44"> +reports</text> + <rect + x="14.050" + y="8.550" + width="7.800" + height="3.600" + fill="#FFFFFF" + stroke="none" + stroke-width="0" + id="rect46" /> + <rect + x="14.050" + y="8.550" + width="7.800" + height="3.600" + fill="none" + stroke="#000000" + stroke-width="0.100" + id="rect48" /> + <text + x="14.911987" + y="10.235329" + font-size="1.50" + font-style="normal" + font-weight="700" + id="text50" + style="font-size:1.5px;font-style:normal;font-weight:700;text-anchor:start;fill:#000000;font-family:sans">plugins</text> + <line + x1="31.450" + y1="3.850" + x2="22.035" + y2="10.225" + stroke="#000000" + stroke-width="0.100" + id="line52" /> + <polyline + fill="none" + stroke="#000000" + stroke-width="0.100" + points="22.217,9.800 21.943,10.287 22.497,10.214 " + id="polyline54" /> + <text + x="25.000" + y="6.800" + fill="#000000" + text-anchor="start" + font-size="0.80" + font-family="sans" + font-style="normal" + font-weight="400" + id="text56"> +uses</text> + <text + x="14.306746" + y="11.743254" + font-size="0.80" + font-style="normal" + font-weight="400" + id="text58" + style="font-size:0.80000001px;font-style:normal;font-weight:400;text-anchor:start;fill:#000000;font-family:sans">Parser, Handler, ...</text> + <line + x1="14.050" + y1="10.350" + x2="4.585" + y2="3.926" + stroke="#000000" + stroke-width="0.100" + id="line60" /> + <polyline + fill="none" + stroke="#000000" + stroke-width="0.100" + points="5.047,3.937 4.493,3.863 4.766,4.350 " + id="polyline62" /> + <text + x="8.1000004" + y="6" + font-size="0.80" + font-style="normal" + font-weight="400" + id="text64" + style="font-size:0.80000001px;font-style:normal;font-weight:400;text-anchor:start;fill:#000000;font-family:sans">register with Factories</text> +</svg> Propchange: labs/droids/trunk/src/documentation/content/xdocs/images/droidsOverview.svg ------------------------------------------------------------------------------ svn:eol-style = native Modified: labs/droids/trunk/src/documentation/content/xdocs/index.xml URL: http://svn.apache.org/viewvc/labs/droids/trunk/src/documentation/content/xdocs/index.xml?rev=691967&r1=691966&r2=691967&view=diff ============================================================================== --- labs/droids/trunk/src/documentation/content/xdocs/index.xml (original) +++ labs/droids/trunk/src/documentation/content/xdocs/index.xml Thu Sep 4 04:22:46 2008 @@ -51,6 +51,54 @@ Spring instead. The main reason is that Spring has become a standard and helps to make Droids as extensible as possible.</p> </section> + + <section> + <title>Feature list</title> + <ul> + <li> + <strong>Customizable.</strong> + Completely controlled by its default.properties which can be + easily be overridden by creating a file build.properties and + overriding the default properties that are needed. + </li> + <li> + <strong>Spring based.</strong> + The properties mentioned above get picked up by the build process + which inject them in the spring configuration. + </li> + <li> + <strong>Extensible.</strong> + The spring configuration makes usage of the cocoon-configurator and + its dynamic registry support (making extending droids a pleasure). + </li> + <li> + <strong>Multi-threaded.</strong> + The architecture is that a robot (e.g. DefaultDroid) controls + various worker (threads) that are doing the actual work. + </li> + <li> + <strong>Honor robots.txt.</strong> + By default droids honors the robot.txt. However you can turn on the +hostile mode of a droid (droids.protocol.http.force=true). + </li> + <li><strong>Crawl throttling.</strong> + You can configure the amount of concurrent threads that a droid can +distribute to their workers (droids.maxThreads=5) and the delay time +between the requests (droids.delay.request=500). +You can use one of the different delay components:<ul> +<li>SimpleDelayTimer</li> +<li>RandomDelayTimer</li> +<li>GaussianRandomDelayTime</li> +</ul> +</li> + </ul> +</section> + +<section> +<title>Architecture</title> +<p>The following graph shows the basic architecture of droids with the help of the first implementation (defaultCrawler).</p> +<figure src="images/droidsOverview.png" alt="Overview" width="400" /> +</section> <section> <title>Requirements</title> Added: labs/droids/trunk/src/documentation/resources/dia/droidsOverview.dia URL: http://svn.apache.org/viewvc/labs/droids/trunk/src/documentation/resources/dia/droidsOverview.dia?rev=691967&view=auto ============================================================================== Binary file - no diff available. Propchange: labs/droids/trunk/src/documentation/resources/dia/droidsOverview.dia ------------------------------------------------------------------------------ svn:mime-type = application/octet-stream --------------------------------------------------------------------- To unsubscribe, e-mail: johnwilliams@example.org For additional commands, e-mail: johnwilliams@example.org From johnwilliams@example.org Thu Sep 04 11:26:23 2008 Return-Path: <johnwilliams@example.org> Delivered-To: johnwilliams@example.org Received: (qmail 30063 invoked from network); 4 Sep 2008 11:26:22 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 4 Sep 2008 11:26:22 -0000 Received: (qmail 37532 invoked by uid 500); 4 Sep 2008 11:26:20 -0000 Delivered-To: johnwilliams@example.org Received: (qmail 37432 invoked by uid 500); 4 Sep 2008 11:26:20 -0000 Mailing-List: contact johnwilliams@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:johnwilliams@example.org> List-Unsubscribe: <mailto:johnwilliams@example.org> List-Post: <mailto:johnwilliams@example.org> List-Id: <commits.labs.apache.org> Reply-To: johnwilliams@example.org Delivered-To: mailing list johnwilliams@example.org Received: (qmail 37423 invoked by uid 99); 4 Sep 2008 11:26:20 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Sep 2008 04:26:19 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO eris.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Sep 2008 11:25:18 +0000 Received: by eris.apache.org (Postfix, from userid 65534) id 8741423889FF; Thu, 4 Sep 2008 04:25:49 -0700 (PDT) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r691971 - /labs/droids/trunk/src/documentation/content/xdocs/index.xml Date: Thu, 04 Sep 2008 11:25:49 -0000 To: johnwilliams@example.org From: johnwilliams@example.org X-Mailer: svnmailer-1.0.8 Message-Id: <johnwilliams@example.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: thorsten Date: Thu Sep 4 04:25:48 2008 New Revision: 691971 URL: http://svn.apache.org/viewvc?rev=691971&view=rev Log: white noise - formating changes Modified: labs/droids/trunk/src/documentation/content/xdocs/index.xml Modified: labs/droids/trunk/src/documentation/content/xdocs/index.xml URL: http://svn.apache.org/viewvc/labs/droids/trunk/src/documentation/content/xdocs/index.xml?rev=691971&r1=691970&r2=691971&view=diff ============================================================================== --- labs/droids/trunk/src/documentation/content/xdocs/index.xml (original) +++ labs/droids/trunk/src/documentation/content/xdocs/index.xml Thu Sep 4 04:25:48 2008 @@ -1,159 +1,145 @@ <?xml version="1.0" encoding="UTF-8"?> -<!-- - Licensed to the Apache Software Foundation (ASF) under one or more - contributor license agreements. See the NOTICE file distributed with - this work for additional information regarding copyright ownership. - The ASF licenses this file to You under the Apache License, Version 2.0 - (the "License"); you may not use this file except in compliance with - the License. You may obtain a copy of the License at - - http://www.apache.org/licenses/LICENSE-2.0 - - Unless required by applicable law or agreed to in writing, software - distributed under the License is distributed on an "AS IS" BASIS, - WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. - See the License for the specific language governing permissions and - limitations under the License. ---> + <!-- + Licensed to the Apache Software Foundation (ASF) under one or more + contributor license agreements. See the NOTICE file distributed with + this work for additional information regarding copyright ownership. + The ASF licenses this file to You under the Apache License, Version + 2.0 (the "License"); you may not use this file except in compliance + with the License. You may obtain a copy of the License at + http://www.apache.org/licenses/LICENSE-2.0 Unless required by + applicable law or agreed to in writing, software distributed under + the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES + OR CONDITIONS OF ANY KIND, either express or implied. See the + License for the specific language governing permissions and + limitations under the License. + --> <!DOCTYPE document PUBLIC "-//APACHE//DTD Documentation V2.0//EN" "http://forrest.apache.org/dtd/document-v20.dtd"> <document> <header> <title>Welcome to Apache Droids</title> </header> - <body> - <section - id="what"> + <section id="what"> <title>What is this?</title> - - <p>Droids aims to be an intelligent standalone robot framework that - allows to create and extend existing droids (robots). In the future - it will offer an administration application to manage and controll - the different droids.</p> - - <p>Droids makes it very easy to extend existing robots or write a new one - from scratch, which can automatically seek out relevant online information - based on the user's specifications.</p> + <p>Droids aims to be an intelligent standalone robot + framework that allows to create and extend existing droids + (robots). In the future it will offer an administration + application to manage and controll the different droids.</p> + <p>Droids makes it very easy to extend existing robots or + write a new one from scratch, which can automatically seek out + relevant online information based on the user's specifications.</p> </section> - <section> <title>Why was it created?</title> - - <p>Mainly because of personal curiosity: The background of this work is - that Cocoon trunk does not provide a crawler anymore and Forrest is based - on it, meaning we cannot update anymore till we found a crawler - replacement. Getting more involved in Solr and Nutch I see request for a - generic standalone crawler.</p> - - <p>For the first core I took nutch, ripped out and modified the plugin/extension - framework. However the second version were not based on it anymore but was using - Spring instead. The main reason is that Spring has become a standard and helps to make + <p>Mainly because of personal curiosity: The background of + this work is that Cocoon trunk does not provide a crawler + anymore and Forrest is based on it, meaning we cannot update + anymore till we found a crawler replacement. Getting more + involved in Solr and Nutch I see request for a generic + standalone crawler.</p> + <p>For the first core I took nutch, ripped out and modified the + plugin/extension framework. However the second version were not + based on it anymore but was using Spring instead. The main + reason is that Spring has become a standard and helps to make Droids as extensible as possible.</p> </section> - <section> - <title>Feature list</title> - <ul> - <li> - <strong>Customizable.</strong> - Completely controlled by its default.properties which can be - easily be overridden by creating a file build.properties and - overriding the default properties that are needed. - </li> - <li> - <strong>Spring based.</strong> - The properties mentioned above get picked up by the build process - which inject them in the spring configuration. - </li> - <li> - <strong>Extensible.</strong> - The spring configuration makes usage of the cocoon-configurator and - its dynamic registry support (making extending droids a pleasure). - </li> - <li> - <strong>Multi-threaded.</strong> - The architecture is that a robot (e.g. DefaultDroid) controls - various worker (threads) that are doing the actual work. - </li> - <li> - <strong>Honor robots.txt.</strong> - By default droids honors the robot.txt. However you can turn on the -hostile mode of a droid (droids.protocol.http.force=true). - </li> - <li><strong>Crawl throttling.</strong> - You can configure the amount of concurrent threads that a droid can -distribute to their workers (droids.maxThreads=5) and the delay time -between the requests (droids.delay.request=500). -You can use one of the different delay components:<ul> -<li>SimpleDelayTimer</li> -<li>RandomDelayTimer</li> -<li>GaussianRandomDelayTime</li> -</ul> -</li> - </ul> -</section> - -<section> -<title>Architecture</title> -<p>The following graph shows the basic architecture of droids with the help of the first implementation (defaultCrawler).</p> -<figure src="images/droidsOverview.png" alt="Overview" width="400" /> -</section> - + <title>Feature list</title> + <ul> + <li> + <strong>Customizable.</strong> + Completely controlled by its default.properties which can be + easily be overridden by creating a file build.properties and + overriding the default properties that are needed. + </li> + <li> + <strong>Spring based.</strong> + The properties mentioned above get picked up by the build + process which inject them in the spring configuration. + </li> + <li> + <strong>Extensible.</strong> + The spring configuration makes usage of the + cocoon-configurator and its dynamic registry support (making + extending droids a pleasure). + </li> + <li> + <strong>Multi-threaded.</strong> + The architecture is that a robot (e.g. DefaultDroid) controls + various worker (threads) that are doing the actual work. + </li> + <li> + <strong>Honor robots.txt.</strong> + By default droids honors the robot.txt. However you can turn + on the hostile mode of a droid + (droids.protocol.http.force=true). + </li> + <li> + <strong>Crawl throttling.</strong> + You can configure the amount of concurrent threads that a + droid can distribute to their workers (droids.maxThreads=5) + and the delay time between the requests + (droids.delay.request=500). You can use one of the different + delay components: + <ul> + <li>SimpleDelayTimer</li> + <li>RandomDelayTimer</li> + <li>GaussianRandomDelayTime</li> + </ul> + </li> + </ul> + </section> + <section> + <title>Architecture</title> + <p>The following graph shows the basic architecture of droids + with the help of the first implementation (defaultCrawler).</p> + <figure src="images/droidsOverview.png" alt="Overview" + width="400" /> + </section> <section> <title>Requirements</title> - <warning label="Ant Optional Tasks">Important is that you have as well the optional - Ant tasks installed! Otherwise you will not be able to build!</warning> + <warning label="Ant Optional Tasks">Important is that you have as well + the optional Ant tasks installed! Otherwise you will not be able + to build!</warning> <ul> <li>Apache Ant version 1.7.0 or higher</li> <li>JDK 1.5 or higher</li> </ul> </section> - - <warning - label="HEADSUP">!!! Please ONLY crawl localhost NEVER a internet site when - you test the first time!!! You will need to adjust the urlfilters to limit - loops.</warning> - + <warning label="HEADSUP">!!! Please ONLY crawl localhost NEVER a + internet site when you test the first time!!! You will need to + adjust the urlfilters to limit loops.</warning> <section> <title>Links / related projects</title> - <ul> <li> - <a - href="http://lucene.apache.org/nutch/">Nutch web-search software</a> + <a href="http://lucene.apache.org/nutch/">Nutch web-search software</a> </li> - <li> - <a - href="http://www.robotstxt.org/wc/robots.html">The Web Robots - Pages</a> + <a href="http://www.robotstxt.org/wc/robots.html">The Web Robots Pages</a> </li> - <li> <a - href="http://www.andreas-hess.info/programming/webcrawler/index.html"> - Programming webcrawler</a> + href="http://www.andreas-hess.info/programming/webcrawler/index.html"> Programming webcrawler</a> </li> - <li> <a - href="http://www.andreas-hess.info/programming/webcrawler/index.html"> - Writing a Web Crawler in the Java Programming Language</a> + href="http://www.andreas-hess.info/programming/webcrawler/index.html"> Writing a Web Crawler in the Java Programming Language</a> </li> - <li> <a - href="http://svn.apache.org/repos/asf/httpcomponents/norobots-rfc/trunk/src/java/org/apache/http/norobots/"> - Norbert</a> + href="http://svn.apache.org/repos/asf/httpcomponents/norobots-rfc/trunk/src/java/org/apache/http/norobots/"> Norbert</a> </li> <li> - <a href="http://www.ajaxprojects.com/ajax/newsdetails.php?itemid=178">Crawling AJAX</a> + <a + href="http://www.ajaxprojects.com/ajax/newsdetails.php?itemid=178">Crawling AJAX</a> </li> - <li><a href="http://simile.mit.edu/wiki/Crowbar">Crowbar is a web scraping environment based on the use of a server-side headless mozilla-based browser.</a> + <li> + <a href="http://simile.mit.edu/wiki/Crowbar">Crowbar is a web scraping environment based + on the use of a server-side headless mozilla-based browser.</a> </li> </ul> </section> </body> -</document> - +</document> \ No newline at end of file --------------------------------------------------------------------- To unsubscribe, e-mail: johnwilliams@example.org For additional commands, e-mail: johnwilliams@example.org From johnwilliams@example.org Thu Sep 04 19:19:14 2008 Return-Path: <johnwilliams@example.org> Delivered-To: johnwilliams@example.org Received: (qmail 75941 invoked from network); 4 Sep 2008 19:19:13 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 4 Sep 2008 19:19:13 -0000 Received: (qmail 43273 invoked by uid 500); 4 Sep 2008 19:19:11 -0000 Delivered-To: johnwilliams@example.org Received: (qmail 43132 invoked by uid 500); 4 Sep 2008 19:19:10 -0000 Mailing-List: contact johnwilliams@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:johnwilliams@example.org> List-Unsubscribe: <mailto:johnwilliams@example.org> List-Post: <mailto:johnwilliams@example.org> List-Id: <commits.labs.apache.org> Reply-To: johnwilliams@example.org Delivered-To: mailing list johnwilliams@example.org Received: (qmail 43123 invoked by uid 99); 4 Sep 2008 19:19:10 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Sep 2008 12:19:10 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO eris.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Sep 2008 19:18:08 +0000 Received: by eris.apache.org (Postfix, from userid 65534) id 360CA238896C; Thu, 4 Sep 2008 12:18:38 -0700 (PDT) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r692198 - /labs/droids/trunk/build-doc.sh Date: Thu, 04 Sep 2008 19:18:37 -0000 To: johnwilliams@example.org From: johnwilliams@example.org X-Mailer: svnmailer-1.0.8 Message-Id: <johnwilliams@example.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: thorsten Date: Thu Sep 4 12:18:37 2008 New Revision: 692198 URL: http://svn.apache.org/viewvc?rev=692198&view=rev Log: Adding small convenient script to build the docu Added: labs/droids/trunk/build-doc.sh (with props) Added: labs/droids/trunk/build-doc.sh URL: http://svn.apache.org/viewvc/labs/droids/trunk/build-doc.sh?rev=692198&view=auto ============================================================================== --- labs/droids/trunk/build-doc.sh (added) +++ labs/droids/trunk/build-doc.sh Thu Sep 4 12:18:37 2008 @@ -0,0 +1,22 @@ +#!/bin/sh + +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license agreements. See the NOTICE file distributed with +# this work for additional information regarding copyright ownership. +# The ASF licenses this file to You under the Apache License, Version 2.0 +# (the "License"); you may not use this file except in compliance with +# the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. + +ant droids.clean ivy.resolve droids.jar droids.javadoc +forrest +cp build/docs/api/ docs/ -r +cp -r build/site/* docs/ + Propchange: labs/droids/trunk/build-doc.sh ------------------------------------------------------------------------------ svn:eol-style = native Propchange: labs/droids/trunk/build-doc.sh ------------------------------------------------------------------------------ svn:executable = * --------------------------------------------------------------------- To unsubscribe, e-mail: johnwilliams@example.org For additional commands, e-mail: johnwilliams@example.org From johnwilliams@example.org Thu Sep 04 22:20:33 2008 Return-Path: <johnwilliams@example.org> Delivered-To: johnwilliams@example.org Received: (qmail 96324 invoked from network); 4 Sep 2008 22:20:32 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 4 Sep 2008 22:20:32 -0000 Received: (qmail 29388 invoked by uid 500); 4 Sep 2008 22:20:20 -0000 Delivered-To: johnwilliams@example.org Received: (qmail 29299 invoked by uid 500); 4 Sep 2008 22:20:20 -0000 Mailing-List: contact johnwilliams@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:johnwilliams@example.org> List-Unsubscribe: <mailto:johnwilliams@example.org> List-Post: <mailto:johnwilliams@example.org> List-Id: <commits.labs.apache.org> Reply-To: johnwilliams@example.org Delivered-To: mailing list johnwilliams@example.org Received: (qmail 29265 invoked by uid 99); 4 Sep 2008 22:20:19 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Sep 2008 15:20:19 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO eris.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Sep 2008 22:19:29 +0000 Received: by eris.apache.org (Postfix, from userid 65534) id 4A760238898F; Thu, 4 Sep 2008 15:20:00 -0700 (PDT) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r692276 - /labs/droids/trunk/src/core/java/org/apache/droids/protocol/file/package-info.java Date: Thu, 04 Sep 2008 22:19:59 -0000 To: johnwilliams@example.org From: johnwilliams@example.org X-Mailer: svnmailer-1.0.8 Message-Id: <johnwilliams@example.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: thorsten Date: Thu Sep 4 15:19:58 2008 New Revision: 692276 URL: http://svn.apache.org/viewvc?rev=692276&view=rev Log: Fixin description Modified: labs/droids/trunk/src/core/java/org/apache/droids/protocol/file/package-info.java Modified: labs/droids/trunk/src/core/java/org/apache/droids/protocol/file/package-info.java URL: http://svn.apache.org/viewvc/labs/droids/trunk/src/core/java/org/apache/droids/protocol/file/package-info.java?rev=692276&r1=692275&r2=692276&view=diff ============================================================================== --- labs/droids/trunk/src/core/java/org/apache/droids/protocol/file/package-info.java (original) +++ labs/droids/trunk/src/core/java/org/apache/droids/protocol/file/package-info.java Thu Sep 4 15:19:58 2008 @@ -15,7 +15,7 @@ * limitations under the License. */ /** - * This package contains various parser. + * This package contains various file protocol implementations. */ package org.apache.droids.protocol.file; --------------------------------------------------------------------- To unsubscribe, e-mail: johnwilliams@example.org For additional commands, e-mail: johnwilliams@example.org From johnwilliams@example.org Thu Sep 04 22:32:36 2008 Return-Path: <johnwilliams@example.org> Delivered-To: johnwilliams@example.org Received: (qmail 8180 invoked from network); 4 Sep 2008 22:32:35 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 4 Sep 2008 22:32:34 -0000 Received: (qmail 54183 invoked by uid 500); 4 Sep 2008 22:32:32 -0000 Delivered-To: johnwilliams@example.org Received: (qmail 54082 invoked by uid 500); 4 Sep 2008 22:32:32 -0000 Mailing-List: contact johnwilliams@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:johnwilliams@example.org> List-Unsubscribe: <mailto:johnwilliams@example.org> List-Post: <mailto:johnwilliams@example.org> List-Id: <commits.labs.apache.org> Reply-To: johnwilliams@example.org Delivered-To: mailing list johnwilliams@example.org Received: (qmail 54073 invoked by uid 99); 4 Sep 2008 22:32:32 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Sep 2008 15:32:32 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO eris.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Sep 2008 22:31:34 +0000 Received: by eris.apache.org (Postfix, from userid 65534) id 73C2A2388A05; Thu, 4 Sep 2008 15:32:05 -0700 (PDT) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r692282 [3/3] - in /labs/droids/trunk/docs/api: ./ org/apache/droids/ org/apache/droids/api/ org/apache/droids/api/class-use/ org/apache/droids/class-use/ org/apache/droids/delay/ org/apache/droids/delay/class-use/ org/apache/droids/excepti... Date: Thu, 04 Sep 2008 22:31:59 -0000 To: johnwilliams@example.org From: johnwilliams@example.org X-Mailer: svnmailer-1.0.8 Message-Id: <johnwilliams@example.org> X-Virus-Checked: Checked by ClamAV on apache.org Modified: labs/droids/trunk/docs/api/org/apache/http/norobots/package-use.html URL: http://svn.apache.org/viewvc/labs/droids/trunk/docs/api/org/apache/http/norobots/package-use.html?rev=692282&r1=692281&r2=692282&view=diff ============================================================================== --- labs/droids/trunk/docs/api/org/apache/http/norobots/package-use.html (original) +++ labs/droids/trunk/docs/api/org/apache/http/norobots/package-use.html Thu Sep 4 15:31:55 2008 @@ -2,7 +2,7 @@ <!--NewPage--> <HTML> <HEAD> -<!-- Generated by javadoc (build 1.5.0_12) on Sun Aug 24 01:37:48 CEST 2008 --> +<!-- Generated by javadoc (build 1.5.0_12) on Fri Sep 05 00:24:06 CEST 2008 --> <TITLE> Uses of Package org.apache.http.norobots (Droids initial API) </TITLE> Modified: labs/droids/trunk/docs/api/org/apache/http/package-frame.html URL: http://svn.apache.org/viewvc/labs/droids/trunk/docs/api/org/apache/http/package-frame.html?rev=692282&r1=692281&r2=692282&view=diff ============================================================================== --- labs/droids/trunk/docs/api/org/apache/http/package-frame.html (original) +++ labs/droids/trunk/docs/api/org/apache/http/package-frame.html Thu Sep 4 15:31:55 2008 @@ -2,7 +2,7 @@ <!--NewPage--> <HTML> <HEAD> -<!-- Generated by javadoc (build 1.5.0_12) on Sun Aug 24 01:37:48 CEST 2008 --> +<!-- Generated by javadoc (build 1.5.0_12) on Fri Sep 05 00:24:04 CEST 2008 --> <TITLE> org.apache.http (Droids initial API) </TITLE> Modified: labs/droids/trunk/docs/api/org/apache/http/package-summary.html URL: http://svn.apache.org/viewvc/labs/droids/trunk/docs/api/org/apache/http/package-summary.html?rev=692282&r1=692281&r2=692282&view=diff ============================================================================== --- labs/droids/trunk/docs/api/org/apache/http/package-summary.html (original) +++ labs/droids/trunk/docs/api/org/apache/http/package-summary.html Thu Sep 4 15:31:55 2008 @@ -2,7 +2,7 @@ <!--NewPage--> <HTML> <HEAD> -<!-- Generated by javadoc (build 1.5.0_12) on Sun Aug 24 01:37:48 CEST 2008 --> +<!-- Generated by javadoc (build 1.5.0_12) on Fri Sep 05 00:24:04 CEST 2008 --> <TITLE> org.apache.http (Droids initial API) </TITLE> Modified: labs/droids/trunk/docs/api/org/apache/http/package-tree.html URL: http://svn.apache.org/viewvc/labs/droids/trunk/docs/api/org/apache/http/package-tree.html?rev=692282&r1=692281&r2=692282&view=diff ============================================================================== --- labs/droids/trunk/docs/api/org/apache/http/package-tree.html (original) +++ labs/droids/trunk/docs/api/org/apache/http/package-tree.html Thu Sep 4 15:31:55 2008 @@ -2,7 +2,7 @@ <!--NewPage--> <HTML> <HEAD> -<!-- Generated by javadoc (build 1.5.0_12) on Sun Aug 24 01:37:48 CEST 2008 --> +<!-- Generated by javadoc (build 1.5.0_12) on Fri Sep 05 00:24:04 CEST 2008 --> <TITLE> org.apache.http Class Hierarchy (Droids initial API) </TITLE> Modified: labs/droids/trunk/docs/api/org/apache/http/package-use.html URL: http://svn.apache.org/viewvc/labs/droids/trunk/docs/api/org/apache/http/package-use.html?rev=692282&r1=692281&r2=692282&view=diff ============================================================================== --- labs/droids/trunk/docs/api/org/apache/http/package-use.html (original) +++ labs/droids/trunk/docs/api/org/apache/http/package-use.html Thu Sep 4 15:31:55 2008 @@ -2,7 +2,7 @@ <!--NewPage--> <HTML> <HEAD> -<!-- Generated by javadoc (build 1.5.0_12) on Sun Aug 24 01:37:48 CEST 2008 --> +<!-- Generated by javadoc (build 1.5.0_12) on Fri Sep 05 00:24:06 CEST 2008 --> <TITLE> Uses of Package org.apache.http (Droids initial API) </TITLE> Modified: labs/droids/trunk/docs/api/overview-frame.html URL: http://svn.apache.org/viewvc/labs/droids/trunk/docs/api/overview-frame.html?rev=692282&r1=692281&r2=692282&view=diff ============================================================================== --- labs/droids/trunk/docs/api/overview-frame.html (original) +++ labs/droids/trunk/docs/api/overview-frame.html Thu Sep 4 15:31:55 2008 @@ -2,7 +2,7 @@ <!--NewPage--> <HTML> <HEAD> -<!-- Generated by javadoc (build 1.5.0_12) on Sun Aug 24 01:37:48 CEST 2008 --> +<!-- Generated by javadoc (build 1.5.0_12) on Fri Sep 05 00:24:04 CEST 2008 --> <TITLE> Overview (Droids initial API) </TITLE> @@ -52,6 +52,8 @@ <BR> <FONT CLASS="FrameItemFont"><A HREF="org/apache/droids/protocol/package-frame.html" target="packageFrame">org.apache.droids.protocol</A></FONT> <BR> +<FONT CLASS="FrameItemFont"><A HREF="org/apache/droids/protocol/file/package-frame.html" target="packageFrame">org.apache.droids.protocol.file</A></FONT> +<BR> <FONT CLASS="FrameItemFont"><A HREF="org/apache/droids/protocol/http/package-frame.html" target="packageFrame">org.apache.droids.protocol.http</A></FONT> <BR> <FONT CLASS="FrameItemFont"><A HREF="org/apache/droids/queue/package-frame.html" target="packageFrame">org.apache.droids.queue</A></FONT> Modified: labs/droids/trunk/docs/api/overview-summary.html URL: http://svn.apache.org/viewvc/labs/droids/trunk/docs/api/overview-summary.html?rev=692282&r1=692281&r2=692282&view=diff ============================================================================== --- labs/droids/trunk/docs/api/overview-summary.html (original) +++ labs/droids/trunk/docs/api/overview-summary.html Thu Sep 4 15:31:55 2008 @@ -2,7 +2,7 @@ <!--NewPage--> <HTML> <HEAD> -<!-- Generated by javadoc (build 1.5.0_12) on Sun Aug 24 01:37:49 CEST 2008 --> +<!-- Generated by javadoc (build 1.5.0_12) on Fri Sep 05 00:24:06 CEST 2008 --> <TITLE> Overview (Droids initial API) </TITLE> @@ -129,6 +129,10 @@ <TD>This package contains various class around the support of protocol specific classes.</TD> </TR> <TR BGCOLOR="white" CLASS="TableRowColor"> +<TD WIDTH="20%"><B><A HREF="org/apache/droids/protocol/file/package-summary.html">org.apache.droids.protocol.file</A></B></TD> +<TD>This package contains various file protocol implementations.</TD> +</TR> +<TR BGCOLOR="white" CLASS="TableRowColor"> <TD WIDTH="20%"><B><A HREF="org/apache/droids/protocol/http/package-summary.html">org.apache.droids.protocol.http</A></B></TD> <TD>This package contains various http protocol implementations.</TD> </TR> Modified: labs/droids/trunk/docs/api/overview-tree.html URL: http://svn.apache.org/viewvc/labs/droids/trunk/docs/api/overview-tree.html?rev=692282&r1=692281&r2=692282&view=diff ============================================================================== --- labs/droids/trunk/docs/api/overview-tree.html (original) +++ labs/droids/trunk/docs/api/overview-tree.html Thu Sep 4 15:31:55 2008 @@ -2,7 +2,7 @@ <!--NewPage--> <HTML> <HEAD> -<!-- Generated by javadoc (build 1.5.0_12) on Sun Aug 24 01:37:48 CEST 2008 --> +<!-- Generated by javadoc (build 1.5.0_12) on Fri Sep 05 00:24:06 CEST 2008 --> <TITLE> Class Hierarchy (Droids initial API) </TITLE> @@ -80,7 +80,7 @@ Hierarchy For All Packages</H2> </CENTER> <DL> -<DT><B>Package Hierarchies:</B><DD><A HREF="org/apache/droids/package-tree.html">org.apache.droids</A>, <A HREF="org/apache/droids/api/package-tree.html">org.apache.droids.api</A>, <A HREF="org/apache/droids/delay/package-tree.html">org.apache.droids.delay</A>, <A HREF="org/apache/droids/exception/package-tree.html">org.apache.droids.exception</A>, <A HREF="org/apache/droids/handle/package-tree.html">org.apache.droids.handle</A>, <A HREF="org/apache/droids/helper/package-tree.html">org.apache.droids.helper</A>, <A HREF="org/apache/droids/helper/factories/package-tree.html">org.apache.droids.helper.factories</A>, <A HREF="org/apache/droids/net/package-tree.html">org.apache.droids.net</A>, <A HREF="org/apache/droids/parse/package-tree.html">org.apache.droids.parse</A>, <A HREF="org/apache/droids/parse/html/package-tree.html">org.apache.droids.parse.html</A>, <A HREF="org/apache/droids/protocol/package-tree.html">org.apache.droids.protocol</A>, <A HREF="org/apache/droids/protoc ol/http/package-tree.html">org.apache.droids.protocol.http</A>, <A HREF="org/apache/droids/queue/package-tree.html">org.apache.droids.queue</A>, <A HREF="org/apache/http/package-tree.html">org.apache.http</A>, <A HREF="org/apache/http/norobots/package-tree.html">org.apache.http.norobots</A></DL> +<DT><B>Package Hierarchies:</B><DD><A HREF="org/apache/droids/package-tree.html">org.apache.droids</A>, <A HREF="org/apache/droids/api/package-tree.html">org.apache.droids.api</A>, <A HREF="org/apache/droids/delay/package-tree.html">org.apache.droids.delay</A>, <A HREF="org/apache/droids/exception/package-tree.html">org.apache.droids.exception</A>, <A HREF="org/apache/droids/handle/package-tree.html">org.apache.droids.handle</A>, <A HREF="org/apache/droids/helper/package-tree.html">org.apache.droids.helper</A>, <A HREF="org/apache/droids/helper/factories/package-tree.html">org.apache.droids.helper.factories</A>, <A HREF="org/apache/droids/net/package-tree.html">org.apache.droids.net</A>, <A HREF="org/apache/droids/parse/package-tree.html">org.apache.droids.parse</A>, <A HREF="org/apache/droids/parse/html/package-tree.html">org.apache.droids.parse.html</A>, <A HREF="org/apache/droids/protocol/package-tree.html">org.apache.droids.protocol</A>, <A HREF="org/apache/droids/protoc ol/file/package-tree.html">org.apache.droids.protocol.file</A>, <A HREF="org/apache/droids/protocol/http/package-tree.html">org.apache.droids.protocol.http</A>, <A HREF="org/apache/droids/queue/package-tree.html">org.apache.droids.queue</A>, <A HREF="org/apache/http/package-tree.html">org.apache.http</A>, <A HREF="org/apache/http/norobots/package-tree.html">org.apache.http.norobots</A></DL> <HR> <H2> Class Hierarchy @@ -90,7 +90,8 @@ <LI TYPE="circle">org.apache.droids.<A HREF="org/apache/droids/AbstractDroid.html" title="class in org.apache.droids"><B>AbstractDroid</B></A> (implements org.apache.droids.api.<A HREF="org/apache/droids/api/Droid.html" title="interface in org.apache.droids.api">Droid</A>) <UL> <LI TYPE="circle">org.apache.droids.<A HREF="org/apache/droids/DefaultCrawler.html" title="class in org.apache.droids"><B>DefaultCrawler</B></A></UL> -<LI TYPE="circle">org.apache.droids.<A HREF="org/apache/droids/Cli.html" title="class in org.apache.droids"><B>Cli</B></A><LI TYPE="circle">org.apache.droids.<A HREF="org/apache/droids/Core.html" title="class in org.apache.droids"><B>Core</B></A><LI TYPE="circle">org.apache.droids.helper.factories.<A HREF="org/apache/droids/helper/factories/GenericFactory.html" title="class in org.apache.droids.helper.factories"><B>GenericFactory</B></A><UL> +<LI TYPE="circle">org.apache.droids.<A HREF="org/apache/droids/Cli.html" title="class in org.apache.droids"><B>Cli</B></A><LI TYPE="circle">org.apache.droids.<A HREF="org/apache/droids/Core.html" title="class in org.apache.droids"><B>Core</B></A><LI TYPE="circle">org.apache.droids.protocol.file.<A HREF="org/apache/droids/protocol/file/FileProtocol.html" title="class in org.apache.droids.protocol.file"><B>FileProtocol</B></A> (implements org.apache.droids.api.<A HREF="org/apache/droids/api/Protocol.html" title="interface in org.apache.droids.api">Protocol</A>) +<LI TYPE="circle">org.apache.droids.helper.factories.<A HREF="org/apache/droids/helper/factories/GenericFactory.html" title="class in org.apache.droids.helper.factories"><B>GenericFactory</B></A><UL> <LI TYPE="circle">org.apache.droids.helper.factories.<A HREF="org/apache/droids/helper/factories/DroidFactory.html" title="class in org.apache.droids.helper.factories"><B>DroidFactory</B></A><LI TYPE="circle">org.apache.droids.helper.factories.<A HREF="org/apache/droids/helper/factories/HandlerFactory.html" title="class in org.apache.droids.helper.factories"><B>HandlerFactory</B></A><LI TYPE="circle">org.apache.droids.helper.factories.<A HREF="org/apache/droids/helper/factories/ParserFactory.html" title="class in org.apache.droids.helper.factories"><B>ParserFactory</B></A><LI TYPE="circle">org.apache.droids.helper.factories.<A HREF="org/apache/droids/helper/factories/ProtocolFactory.html" title="class in org.apache.droids.helper.factories"><B>ProtocolFactory</B></A><LI TYPE="circle">org.apache.droids.helper.factories.<A HREF="org/apache/droids/helper/factories/URLFiltersFactory.html" title="class in org.apache.droids.helper.factories"><B>URLFiltersFactory</B></A></UL> <LI TYPE="circle">org.apache.droids.helper.<A HREF="org/apache/droids/helper/Loggable.html" title="class in org.apache.droids.helper"><B>Loggable</B></A><UL> <LI TYPE="circle">org.apache.droids.parse.html.<A HREF="org/apache/droids/parse/html/HtmlParser.html" title="class in org.apache.droids.parse.html"><B>HtmlParser</B></A> (implements org.apache.droids.api.<A HREF="org/apache/droids/api/Parser.html" title="interface in org.apache.droids.api">Parser</A>) Modified: labs/droids/trunk/docs/api/package-list URL: http://svn.apache.org/viewvc/labs/droids/trunk/docs/api/package-list?rev=692282&r1=692281&r2=692282&view=diff ============================================================================== --- labs/droids/trunk/docs/api/package-list (original) +++ labs/droids/trunk/docs/api/package-list Thu Sep 4 15:31:55 2008 @@ -9,6 +9,7 @@ org.apache.droids.parse org.apache.droids.parse.html org.apache.droids.protocol +org.apache.droids.protocol.file org.apache.droids.protocol.http org.apache.droids.queue org.apache.http Modified: labs/droids/trunk/docs/api/serialized-form.html URL: http://svn.apache.org/viewvc/labs/droids/trunk/docs/api/serialized-form.html?rev=692282&r1=692281&r2=692282&view=diff ============================================================================== --- labs/droids/trunk/docs/api/serialized-form.html (original) +++ labs/droids/trunk/docs/api/serialized-form.html Thu Sep 4 15:31:55 2008 @@ -2,7 +2,7 @@ <!--NewPage--> <HTML> <HEAD> -<!-- Generated by javadoc (build 1.5.0_12) on Sun Aug 24 01:37:48 CEST 2008 --> +<!-- Generated by javadoc (build 1.5.0_12) on Fri Sep 05 00:24:04 CEST 2008 --> <TITLE> Serialized Form (Droids initial API) </TITLE> --------------------------------------------------------------------- To unsubscribe, e-mail: johnwilliams@example.org For additional commands, e-mail: johnwilliams@example.org From johnwilliams@example.org Thu Sep 04 22:33:07 2008 Return-Path: <johnwilliams@example.org> Delivered-To: johnwilliams@example.org Received: (qmail 8946 invoked from network); 4 Sep 2008 22:33:07 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 4 Sep 2008 22:33:07 -0000 Received: (qmail 56864 invoked by uid 500); 4 Sep 2008 22:33:05 -0000 Delivered-To: johnwilliams@example.org Received: (qmail 56760 invoked by uid 500); 4 Sep 2008 22:33:04 -0000 Mailing-List: contact johnwilliams@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:johnwilliams@example.org> List-Unsubscribe: <mailto:johnwilliams@example.org> List-Post: <mailto:johnwilliams@example.org> List-Id: <commits.labs.apache.org> Reply-To: johnwilliams@example.org Delivered-To: mailing list johnwilliams@example.org Received: (qmail 56751 invoked by uid 99); 4 Sep 2008 22:33:04 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Sep 2008 15:33:04 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO eris.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Sep 2008 22:32:04 +0000 Received: by eris.apache.org (Postfix, from userid 65534) id 5E3E5238899E; Thu, 4 Sep 2008 15:32:05 -0700 (PDT) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r692282 [1/3] - in /labs/droids/trunk/docs/api: ./ org/apache/droids/ org/apache/droids/api/ org/apache/droids/api/class-use/ org/apache/droids/class-use/ org/apache/droids/delay/ org/apache/droids/delay/class-use/ org/apache/droids/excepti... Date: Thu, 04 Sep 2008 22:31:59 -0000 To: johnwilliams@example.org From: johnwilliams@example.org X-Mailer: svnmailer-1.0.8 Message-Id: <johnwilliams@example.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: thorsten Date: Thu Sep 4 15:31:55 2008 New Revision: 692282 URL: http://svn.apache.org/viewvc?rev=692282&view=rev Log: Updating java docs Modified: labs/droids/trunk/docs/api/allclasses-frame.html labs/droids/trunk/docs/api/allclasses-noframe.html labs/droids/trunk/docs/api/constant-values.html labs/droids/trunk/docs/api/deprecated-list.html labs/droids/trunk/docs/api/help-doc.html labs/droids/trunk/docs/api/index-all.html labs/droids/trunk/docs/api/index.html labs/droids/trunk/docs/api/org/apache/droids/AbstractDroid.html labs/droids/trunk/docs/api/org/apache/droids/Cli.html labs/droids/trunk/docs/api/org/apache/droids/Core.html labs/droids/trunk/docs/api/org/apache/droids/DefaultCrawler.html labs/droids/trunk/docs/api/org/apache/droids/DefaultWorker.html labs/droids/trunk/docs/api/org/apache/droids/SimpleThreads.html labs/droids/trunk/docs/api/org/apache/droids/api/DelayTimer.html labs/droids/trunk/docs/api/org/apache/droids/api/DelayWorker.html labs/droids/trunk/docs/api/org/apache/droids/api/Droid.html labs/droids/trunk/docs/api/org/apache/droids/api/Handler.html labs/droids/trunk/docs/api/org/apache/droids/api/Link.html labs/droids/trunk/docs/api/org/apache/droids/api/Parse.html labs/droids/trunk/docs/api/org/apache/droids/api/Parser.html labs/droids/trunk/docs/api/org/apache/droids/api/Protocol.html labs/droids/trunk/docs/api/org/apache/droids/api/Queue.html labs/droids/trunk/docs/api/org/apache/droids/api/Task.html labs/droids/trunk/docs/api/org/apache/droids/api/URLFilter.html labs/droids/trunk/docs/api/org/apache/droids/api/Worker.html labs/droids/trunk/docs/api/org/apache/droids/api/class-use/DelayTimer.html labs/droids/trunk/docs/api/org/apache/droids/api/class-use/DelayWorker.html labs/droids/trunk/docs/api/org/apache/droids/api/class-use/Droid.html labs/droids/trunk/docs/api/org/apache/droids/api/class-use/Handler.html labs/droids/trunk/docs/api/org/apache/droids/api/class-use/Link.html labs/droids/trunk/docs/api/org/apache/droids/api/class-use/Parse.html labs/droids/trunk/docs/api/org/apache/droids/api/class-use/Parser.html labs/droids/trunk/docs/api/org/apache/droids/api/class-use/Protocol.html labs/droids/trunk/docs/api/org/apache/droids/api/class-use/Queue.html labs/droids/trunk/docs/api/org/apache/droids/api/class-use/Task.html labs/droids/trunk/docs/api/org/apache/droids/api/class-use/URLFilter.html labs/droids/trunk/docs/api/org/apache/droids/api/class-use/Worker.html labs/droids/trunk/docs/api/org/apache/droids/api/package-frame.html labs/droids/trunk/docs/api/org/apache/droids/api/package-summary.html labs/droids/trunk/docs/api/org/apache/droids/api/package-tree.html labs/droids/trunk/docs/api/org/apache/droids/api/package-use.html labs/droids/trunk/docs/api/org/apache/droids/class-use/AbstractDroid.html labs/droids/trunk/docs/api/org/apache/droids/class-use/Cli.html labs/droids/trunk/docs/api/org/apache/droids/class-use/Core.html labs/droids/trunk/docs/api/org/apache/droids/class-use/DefaultCrawler.html
{'source': 'Apache Software Foundation Public Mail Archives'}