From mahout-devchristyflores@example.org Sat Mar 01 02:34:34 2008 Return-Path: <mahout-devchristyflores@example.org> Delivered-To: christyflores@example.org Received: (qmail 84538 invoked from network); 1 Mar 2008 02:34:34 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Mar 2008 02:34:34 -0000 Received: (qmail 76663 invoked by uid 500); 1 Mar 2008 02:34:27 -0000 Delivered-To: christyflores@example.org Received: (qmail 76640 invoked by uid 500); 1 Mar 2008 02:34:27 -0000 Mailing-List: contact christyflores@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:christyflores@example.org> List-Unsubscribe: <mailto:christyflores@example.org> List-Post: <mailto:christyflores@example.org> List-Id: <mahout-dev.lucene.apache.org> Reply-To: christyflores@example.org Delivered-To: mailing list christyflores@example.org Received: (qmail 76621 invoked by uid 99); 1 Mar 2008 02:34:27 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 Feb 2008 18:34:27 -0800 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [83.161.120.155] (HELO spunkymail-a1.g.dreamhost.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2008 02:33:40 +0000 Received: from [83.161.120.155] (adsl-074-229-189-244.sip.rmo.bellsouth.net [83.161.120.155]) by spunkymail-a1.g.dreamhost.com (Postfix) with ESMTP id 33F971000AC for <christyflores@example.org>; Fri, 29 Feb 2008 18:34:00 -0800 (PST) Message-Id: <christyflores@example.org> From: Grant Ingersoll <christyflores@example.org> To: christyflores@example.org Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v919.2) Subject: Google Summer of Code Date: Fri, 29 Feb 2008 21:33:58 -0500 X-Mailer: Apple Mail (2.919.2) X-Virus-Checked: Checked by ClamAV on apache.org Hi Gang, I think we should put in for this: http://wiki.apache.org/general/SummerOfCode2008 I would be there are some students interested in doing ML on Hadoop. Any of the other committers willing to mentor? I am, but would also like some others to help out if you have the time. See http://wiki.apache.org/general/SummerOfCodeMentor . Thanks, Grant From mahout-devchristyflores@example.org Sat Mar 01 02:38:35 2008 Return-Path: <mahout-devchristyflores@example.org> Delivered-To: christyflores@example.org Received: (qmail 86680 invoked from network); 1 Mar 2008 02:38:35 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Mar 2008 02:38:35 -0000 Received: (qmail 79848 invoked by uid 500); 1 Mar 2008 02:38:30 -0000 Delivered-To: christyflores@example.org Received: (qmail 79813 invoked by uid 500); 1 Mar 2008 02:38:30 -0000 Mailing-List: contact christyflores@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:christyflores@example.org> List-Unsubscribe: <mailto:christyflores@example.org> List-Post: <mailto:christyflores@example.org> List-Id: <mahout-dev.lucene.apache.org> Reply-To: christyflores@example.org Delivered-To: mailing list christyflores@example.org Received: (qmail 79804 invoked by uid 99); 1 Mar 2008 02:38:30 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 Feb 2008 18:38:30 -0800 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [83.161.120.155] (HELO spunkymail-a2.g.dreamhost.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2008 02:37:44 +0000 Received: from [83.161.120.155] (adsl-074-229-189-244.sip.rmo.bellsouth.net [83.161.120.155]) by spunkymail-a2.g.dreamhost.com (Postfix) with ESMTP id 7295688095 for <christyflores@example.org>; Fri, 29 Feb 2008 18:38:01 -0800 (PST) Message-Id: <christyflores@example.org> From: Grant Ingersoll <christyflores@example.org> To: christyflores@example.org In-Reply-To: <christyflores@example.org> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v919.2) Subject: Re: Google Summer of Code Date: Fri, 29 Feb 2008 21:38:02 -0500 References: <christyflores@example.org> X-Mailer: Apple Mail (2.919.2) X-Virus-Checked: Checked by ClamAV on apache.org Also, any thoughts on what we might want someone to do? I think it would be great to have someone implement one of the algorithms on our wiki. -Grant On Feb 29, 2008, at 9:33 PM, Grant Ingersoll wrote: > Hi Gang, > > I think we should put in for this: http://wiki.apache.org/general/SummerOfCode2008 > > I would be there are some students interested in doing ML on > Hadoop. Any of the other committers willing to mentor? I am, but > would also like some others to help out if you have the time. See http://wiki.apache.org/general/SummerOfCodeMentor > . > > > Thanks, > Grant > > From mahout-devchristyflores@example.org Sat Mar 01 02:42:52 2008 Return-Path: <mahout-devchristyflores@example.org> Delivered-To: christyflores@example.org Received: (qmail 87556 invoked from network); 1 Mar 2008 02:42:52 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Mar 2008 02:42:52 -0000 Received: (qmail 83199 invoked by uid 500); 1 Mar 2008 02:42:47 -0000 Delivered-To: christyflores@example.org Received: (qmail 83170 invoked by uid 500); 1 Mar 2008 02:42:47 -0000 Mailing-List: contact christyflores@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:christyflores@example.org> List-Unsubscribe: <mailto:christyflores@example.org> List-Post: <mailto:christyflores@example.org> List-Id: <mahout-dev.lucene.apache.org> Reply-To: christyflores@example.org Delivered-To: mailing list christyflores@example.org Received: (qmail 83160 invoked by uid 99); 1 Mar 2008 02:42:47 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 Feb 2008 18:42:47 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2008 02:42:20 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 571D9234C077 for <christyflores@example.org>; Fri, 29 Feb 2008 18:41:51 -0800 (PST) Message-ID: <1823008365.1204339311355.JavaMail.jira@brutus> Date: Fri, 29 Feb 2008 18:41:51 -0800 (PST) From: "Grant Ingersoll (JIRA)" <christyflores@example.org> To: christyflores@example.org Subject: [jira] Commented: (MAHOUT-5) Implement a k-means clustering prototype In-Reply-To: <298179946.1203277714636.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/MAHOUT-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12574053#action_12574053 ] Grant Ingersoll commented on MAHOUT-5: -------------------------------------- I have rev 630694 as the latest. I'm still getting errors in applying the patch. > Implement a k-means clustering prototype > ----------------------------------------- > > Key: MAHOUT-5 > URL: https://issues.apache.org/jira/browse/MAHOUT-5 > Project: Mahout > Issue Type: New Feature > Components: Clustering > Affects Versions: 0.1 > Reporter: Jeff Eastman > Assignee: Grant Ingersoll > Priority: Minor > Attachments: kmeans.zip, MAHOUT-5a.diff, MAHOUT-5b.diff, MAHOUT-5c.diff, MAHOUT-5d.diff, MAHOUT-5e.diff > > > K-means clustering is closely related to Canopy clustering and often uses canopies to determine the initial clusters. I'd like to implement a k-means prototype and tests in the package org.apache.mahout.clustering.kmeans. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mahout-devchristyflores@example.org Sat Mar 01 02:52:51 2008 Return-Path: <mahout-devchristyflores@example.org> Delivered-To: christyflores@example.org Received: (qmail 89659 invoked from network); 1 Mar 2008 02:52:51 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Mar 2008 02:52:51 -0000 Received: (qmail 88996 invoked by uid 500); 1 Mar 2008 02:52:47 -0000 Delivered-To: christyflores@example.org Received: (qmail 88960 invoked by uid 500); 1 Mar 2008 02:52:46 -0000 Mailing-List: contact christyflores@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:christyflores@example.org> List-Unsubscribe: <mailto:christyflores@example.org> List-Post: <mailto:christyflores@example.org> List-Id: <mahout-dev.lucene.apache.org> Reply-To: christyflores@example.org Delivered-To: mailing list christyflores@example.org Received: (qmail 88951 invoked by uid 99); 1 Mar 2008 02:52:46 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 Feb 2008 18:52:46 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2008 02:52:20 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id B7456234C075 for <christyflores@example.org>; Fri, 29 Feb 2008 18:51:51 -0800 (PST) Message-ID: <1696064828.1204339911749.JavaMail.jira@brutus> Date: Fri, 29 Feb 2008 18:51:51 -0800 (PST) From: "Grant Ingersoll (JIRA)" <christyflores@example.org> To: christyflores@example.org Subject: [jira] Commented: (MAHOUT-5) Implement a k-means clustering prototype In-Reply-To: <298179946.1203277714636.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/MAHOUT-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12574055#action_12574055 ] Grant Ingersoll commented on MAHOUT-5: -------------------------------------- OK, I fixed the patch. Will upload a patch shortly. Also, Jeff, check where you are getting the Mahout Jar from in various places. It is currently being built by ant into dist/apache-mahout-0.1.jar. I fixed it in kMeans, so just FYI for future. I am assuming you are generating it outside of Ant > Implement a k-means clustering prototype > ----------------------------------------- > > Key: MAHOUT-5 > URL: https://issues.apache.org/jira/browse/MAHOUT-5 > Project: Mahout > Issue Type: New Feature > Components: Clustering > Affects Versions: 0.1 > Reporter: Jeff Eastman > Assignee: Grant Ingersoll > Priority: Minor > Attachments: kmeans.zip, MAHOUT-5a.diff, MAHOUT-5b.diff, MAHOUT-5c.diff, MAHOUT-5d.diff, MAHOUT-5e.diff > > > K-means clustering is closely related to Canopy clustering and often uses canopies to determine the initial clusters. I'd like to implement a k-means prototype and tests in the package org.apache.mahout.clustering.kmeans. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mahout-devchristyflores@example.org Sat Mar 01 02:54:58 2008 Return-Path: <mahout-devchristyflores@example.org> Delivered-To: christyflores@example.org Received: (qmail 90272 invoked from network); 1 Mar 2008 02:54:57 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Mar 2008 02:54:57 -0000 Received: (qmail 95004 invoked by uid 500); 1 Mar 2008 02:54:49 -0000 Delivered-To: christyflores@example.org Received: (qmail 94966 invoked by uid 500); 1 Mar 2008 02:54:49 -0000 Mailing-List: contact christyflores@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:christyflores@example.org> List-Unsubscribe: <mailto:christyflores@example.org> List-Post: <mailto:christyflores@example.org> List-Id: <mahout-dev.lucene.apache.org> Reply-To: christyflores@example.org Delivered-To: mailing list christyflores@example.org Received: (qmail 94915 invoked by uid 99); 1 Mar 2008 02:54:49 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 Feb 2008 18:54:49 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2008 02:54:10 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id B3CB7234C09D for <christyflores@example.org>; Fri, 29 Feb 2008 18:53:51 -0800 (PST) Message-ID: <317657844.1204340031735.JavaMail.jira@brutus> Date: Fri, 29 Feb 2008 18:53:51 -0800 (PST) From: "Grant Ingersoll (JIRA)" <christyflores@example.org> To: christyflores@example.org Subject: [jira] Updated: (MAHOUT-5) Implement a k-means clustering prototype In-Reply-To: <298179946.1203277714636.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/MAHOUT-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Ingersoll updated MAHOUT-5: --------------------------------- Attachment: MAHOUT-5.patch Fixes various issues with last 5e.diff patch. All tests pass. Will review a bit more and then commit, assuming no other issues. > Implement a k-means clustering prototype > ----------------------------------------- > > Key: MAHOUT-5 > URL: https://issues.apache.org/jira/browse/MAHOUT-5 > Project: Mahout > Issue Type: New Feature > Components: Clustering > Affects Versions: 0.1 > Reporter: Jeff Eastman > Assignee: Grant Ingersoll > Priority: Minor > Attachments: kmeans.zip, MAHOUT-5.patch, MAHOUT-5a.diff, MAHOUT-5b.diff, MAHOUT-5c.diff, MAHOUT-5d.diff, MAHOUT-5e.diff > > > K-means clustering is closely related to Canopy clustering and often uses canopies to determine the initial clusters. I'd like to implement a k-means prototype and tests in the package org.apache.mahout.clustering.kmeans. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mahout-devchristyflores@example.org Sat Mar 01 03:34:56 2008 Return-Path: <mahout-devchristyflores@example.org> Delivered-To: christyflores@example.org Received: (qmail 15526 invoked from network); 1 Mar 2008 03:34:56 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Mar 2008 03:34:56 -0000 Received: (qmail 28451 invoked by uid 500); 1 Mar 2008 03:34:51 -0000 Delivered-To: christyflores@example.org Received: (qmail 28425 invoked by uid 500); 1 Mar 2008 03:34:51 -0000 Mailing-List: contact christyflores@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:christyflores@example.org> List-Unsubscribe: <mailto:christyflores@example.org> List-Post: <mailto:christyflores@example.org> List-Id: <mahout-dev.lucene.apache.org> Reply-To: christyflores@example.org Delivered-To: mailing list christyflores@example.org Received: (qmail 28416 invoked by uid 99); 1 Mar 2008 03:34:51 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 Feb 2008 19:34:51 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2008 03:34:10 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 2460E234C076 for <christyflores@example.org>; Fri, 29 Feb 2008 19:33:51 -0800 (PST) Message-ID: <1957879226.1204342431147.JavaMail.jira@brutus> Date: Fri, 29 Feb 2008 19:33:51 -0800 (PST) From: "Grant Ingersoll (JIRA)" <christyflores@example.org> To: christyflores@example.org Subject: [jira] Resolved: (MAHOUT-5) Implement a k-means clustering prototype In-Reply-To: <298179946.1203277714636.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/MAHOUT-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Ingersoll resolved MAHOUT-5. ---------------------------------- Resolution: Fixed Fix Version/s: 0.1 Committed revision 632543. Thanks Jeff! > Implement a k-means clustering prototype > ----------------------------------------- > > Key: MAHOUT-5 > URL: https://issues.apache.org/jira/browse/MAHOUT-5 > Project: Mahout > Issue Type: New Feature > Components: Clustering > Affects Versions: 0.1 > Reporter: Jeff Eastman > Assignee: Grant Ingersoll > Priority: Minor > Fix For: 0.1 > > Attachments: kmeans.zip, MAHOUT-5.patch, MAHOUT-5a.diff, MAHOUT-5b.diff, MAHOUT-5c.diff, MAHOUT-5d.diff, MAHOUT-5e.diff > > > K-means clustering is closely related to Canopy clustering and often uses canopies to determine the initial clusters. I'd like to implement a k-means prototype and tests in the package org.apache.mahout.clustering.kmeans. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mahout-devchristyflores@example.org Sat Mar 01 04:16:53 2008 Return-Path: <mahout-devchristyflores@example.org> Delivered-To: christyflores@example.org Received: (qmail 29927 invoked from network); 1 Mar 2008 04:16:52 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Mar 2008 04:16:52 -0000 Received: (qmail 53436 invoked by uid 500); 1 Mar 2008 04:16:47 -0000 Delivered-To: christyflores@example.org Received: (qmail 53413 invoked by uid 500); 1 Mar 2008 04:16:47 -0000 Mailing-List: contact christyflores@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:christyflores@example.org> List-Unsubscribe: <mailto:christyflores@example.org> List-Post: <mailto:christyflores@example.org> List-Id: <mahout-dev.lucene.apache.org> Reply-To: christyflores@example.org Delivered-To: mailing list christyflores@example.org Received: (qmail 53404 invoked by uid 99); 1 Mar 2008 04:16:47 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 Feb 2008 20:16:47 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2008 04:16:21 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id B6094234C078 for <christyflores@example.org>; Fri, 29 Feb 2008 20:15:52 -0800 (PST) Message-ID: <1573240774.1204344952744.JavaMail.jira@brutus> Date: Fri, 29 Feb 2008 20:15:52 -0800 (PST) From: "Grant Ingersoll (JIRA)" <christyflores@example.org> To: christyflores@example.org Subject: [jira] Updated: (MAHOUT-6) Need a matrix implementation In-Reply-To: <1400973700.1203651499647.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/MAHOUT-6?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Ingersoll updated MAHOUT-6: --------------------------------- Attachment: MAHOUT-6h.patch minor updates to Vector, mostly javadocs. Also added in a start to a Vector test for sanity purposes. > Need a matrix implementation > ---------------------------- > > Key: MAHOUT-6 > URL: https://issues.apache.org/jira/browse/MAHOUT-6 > Project: Mahout > Issue Type: New Feature > Reporter: Ted Dunning > Attachments: MAHOUT-6a.diff, MAHOUT-6b.diff, MAHOUT-6c.diff, MAHOUT-6d.diff, MAHOUT-6e.diff, MAHOUT-6f.diff, MAHOUT-6g.diff, MAHOUT-6h.patch > > > We need matrices for Mahout. > An initial set of basic requirements includes: > a) sparse and dense support are required > b) row and column labels are important > c) serialization for hadoop use is required > d) reasonable floating point performance is required, but awesome FP is not > e) the API should be simple enough to understand > f) it should be easy to carve out sub-matrices for sending to different reducers > g) a reasonable set of matrix operations should be supported, these should eventually include: > simple matrix-matrix and matrix-vector and matrix-scalar linear algebra operations, A B, A + B, A v, A + x, v + x, u + v, dot(u, v) > row and column sums > generalized level 2 and 3 BLAS primitives, alpha A B + beta C and A u + beta v > h) easy and efficient iteration constructs, especially for sparse matrices > i) easy to extend with new implementations -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mahout-devchristyflores@example.org Sat Mar 01 07:09:24 2008 Return-Path: <mahout-devchristyflores@example.org> Delivered-To: christyflores@example.org Received: (qmail 50341 invoked from network); 1 Mar 2008 07:09:24 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Mar 2008 07:09:24 -0000 Received: (qmail 16380 invoked by uid 500); 1 Mar 2008 07:09:20 -0000 Delivered-To: christyflores@example.org Received: (qmail 16343 invoked by uid 500); 1 Mar 2008 07:09:19 -0000 Mailing-List: contact christyflores@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:christyflores@example.org> List-Unsubscribe: <mailto:christyflores@example.org> List-Post: <mailto:christyflores@example.org> List-Id: <mahout-dev.lucene.apache.org> Reply-To: christyflores@example.org Delivered-To: mailing list christyflores@example.org Received: (qmail 16334 invoked by uid 99); 1 Mar 2008 07:09:19 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 Feb 2008 23:09:19 -0800 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_HELO_PASS,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of christyflores@example.org designates 83.161.120.155 as permitted sender) Received: from [83.161.120.155] (HELO research.iiit.ac.in) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2008 07:08:45 +0000 Received: from mailtest.iiit.ac.in (localhost.localdomain [83.161.120.155]) by research.iiit.ac.in (8.13.8/8.13.8) with ESMTP id m2178jw7031407 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for <christyflores@example.org>; Sat, 1 Mar 2008 12:38:45 +0530 Received: (from apache@localhost) by mailtest.iiit.ac.in (8.13.8/8.13.8/Submit) id m2178e2H031401; Sat, 1 Mar 2008 12:38:40 +0530 From: christyflores@example.org X-Authentication-Warning: research.iiit.ac.in: apache set sender to christyflores@example.org using -f Received: from 83.161.120.155 (proxying for 83.161.120.155) (SquirrelMail authenticated user jaideep) by research.iiit.ac.in with HTTP; Sat, 1 Mar 2008 12:38:40 +0530 (IST) Message-ID: <christyflores@example.org> In-Reply-To: <christyflores@example.org> References: <christyflores@example.org> Date: Sat, 1 Mar 2008 12:38:40 +0530 (IST) Subject: Re: Google Summer of Code To: christyflores@example.org User-Agent: SquirrelMail/1.4.8-4.fc5 MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Priority: 3 (Normal) Importance: Normal X-Spam-Checker-Version: SpamAssassin 3.2.1 (2007-05-02) on research.iiit.ac.in X-IIITH-MailScanner-Information: Please contact the IIITH Server Room for more information X-IIITH-MailScanner: Found to be clean X-IIITH-MailScanner-From: christyflores@example.org X-Virus-Checked: Checked by ClamAV on apache.org X-Old-Spam-Status: No, score=-1.4 required=5.0 tests=ALL_TRUSTED autolearn=failed version=3.2.1, No > Hi Gang, > > I think we should put in for this: > http://wiki.apache.org/general/SummerOfCode2008 > > I would be there are some students interested in doing ML on Hadoop. Yes. I would be happy to work :) Didn't know that Mahout is also participating in SoC. > Any of the other committers willing to mentor? I am, but would also > like some others to help out if you have the time. See > http://wiki.apache.org/general/SummerOfCodeMentor > . > > > Thanks, > Grant > > > > From mahout-devchristyflores@example.org Sat Mar 01 14:44:43 2008 Return-Path: <mahout-devchristyflores@example.org> Delivered-To: christyflores@example.org Received: (qmail 36154 invoked from network); 1 Mar 2008 14:44:43 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Mar 2008 14:44:43 -0000 Received: (qmail 12265 invoked by uid 500); 1 Mar 2008 14:44:38 -0000 Delivered-To: christyflores@example.org Received: (qmail 12227 invoked by uid 500); 1 Mar 2008 14:44:38 -0000 Mailing-List: contact christyflores@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:christyflores@example.org> List-Unsubscribe: <mailto:christyflores@example.org> List-Post: <mailto:christyflores@example.org> List-Id: <mahout-dev.lucene.apache.org> Reply-To: christyflores@example.org Delivered-To: mailing list christyflores@example.org Received: (qmail 12218 invoked by uid 99); 1 Mar 2008 14:44:38 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2008 06:44:38 -0800 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [83.161.120.155] (HELO spunkymail-a20.g.dreamhost.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2008 14:44:03 +0000 Received: from [83.161.120.155] (adsl-074-229-189-244.sip.rmo.bellsouth.net [83.161.120.155]) by spunkymail-a20.g.dreamhost.com (Postfix) with ESMTP id A6823E24EC for <christyflores@example.org>; Sat, 1 Mar 2008 06:44:11 -0800 (PST) Message-Id: <christyflores@example.org> From: Grant Ingersoll <christyflores@example.org> To: christyflores@example.org In-Reply-To: <christyflores@example.org> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v919.2) Subject: Re: Google Summer of Code X-Priority: 3 (Normal) Date: Sat, 1 Mar 2008 09:44:10 -0500 References: <christyflores@example.org> <christyflores@example.org> X-Mailer: Apple Mail (2.919.2) X-Virus-Checked: Checked by ClamAV on apache.org Well, here's your chance. Make a proposal of something you would like to work on that fits with what we are doing and we'll discuss it and possibly put it up as a project. I think it would be great if anyone took on something like M/R SVM implementation, or one of the other ones that is not already under way. -Grant On Mar 1, 2008, at 2:08 AM, christyflores@example.org wrote: >> Hi Gang, >> >> I think we should put in for this: >> http://wiki.apache.org/general/SummerOfCode2008 >> >> I would be there are some students interested in doing ML on Hadoop. > Yes. I would be happy to work :) Didn't know that Mahout is also > participating in SoC. >> Any of the other committers willing to mentor? I am, but would also >> like some others to help out if you have the time. See >> http://wiki.apache.org/general/SummerOfCodeMentor >> . >> >> >> Thanks, >> Grant >> >> >> >> > > > From mahout-devchristyflores@example.org Sat Mar 01 18:53:55 2008 Return-Path: <mahout-devchristyflores@example.org> Delivered-To: christyflores@example.org Received: (qmail 93058 invoked from network); 1 Mar 2008 18:53:55 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Mar 2008 18:53:55 -0000 Received: (qmail 73774 invoked by uid 500); 1 Mar 2008 18:53:50 -0000 Delivered-To: christyflores@example.org Received: (qmail 73736 invoked by uid 500); 1 Mar 2008 18:53:50 -0000 Mailing-List: contact christyflores@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:christyflores@example.org> List-Unsubscribe: <mailto:christyflores@example.org> List-Post: <mailto:christyflores@example.org> List-Id: <mahout-dev.lucene.apache.org> Reply-To: christyflores@example.org Delivered-To: mailing list christyflores@example.org Received: (qmail 73727 invoked by uid 99); 1 Mar 2008 18:53:50 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2008 10:53:50 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2008 18:53:12 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 483DE234C077 for <christyflores@example.org>; Sat, 1 Mar 2008 10:52:51 -0800 (PST) Message-ID: <1129542800.1204397571294.JavaMail.jira@brutus> Date: Sat, 1 Mar 2008 10:52:51 -0800 (PST) From: "Jeff Eastman (JIRA)" <christyflores@example.org> To: christyflores@example.org Subject: [jira] Updated: (MAHOUT-6) Need a matrix implementation In-Reply-To: <1400973700.1203651499647.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/MAHOUT-6?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Eastman updated MAHOUT-6: ------------------------------ Attachment: MAHOUT-6i.diff Initial implementation of Matrices and unit tests based upon the spirit of Vector. This needs to be merged with Grant's tweaks to Vector. > Need a matrix implementation > ---------------------------- > > Key: MAHOUT-6 > URL: https://issues.apache.org/jira/browse/MAHOUT-6 > Project: Mahout > Issue Type: New Feature > Reporter: Ted Dunning > Attachments: MAHOUT-6a.diff, MAHOUT-6b.diff, MAHOUT-6c.diff, MAHOUT-6d.diff, MAHOUT-6e.diff, MAHOUT-6f.diff, MAHOUT-6g.diff, MAHOUT-6h.patch, MAHOUT-6i.diff > > > We need matrices for Mahout. > An initial set of basic requirements includes: > a) sparse and dense support are required > b) row and column labels are important > c) serialization for hadoop use is required > d) reasonable floating point performance is required, but awesome FP is not > e) the API should be simple enough to understand > f) it should be easy to carve out sub-matrices for sending to different reducers > g) a reasonable set of matrix operations should be supported, these should eventually include: > simple matrix-matrix and matrix-vector and matrix-scalar linear algebra operations, A B, A + B, A v, A + x, v + x, u + v, dot(u, v) > row and column sums > generalized level 2 and 3 BLAS primitives, alpha A B + beta C and A u + beta v > h) easy and efficient iteration constructs, especially for sparse matrices > i) easy to extend with new implementations -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mahout-devchristyflores@example.org Sat Mar 01 21:56:08 2008 Return-Path: <mahout-devchristyflores@example.org> Delivered-To: christyflores@example.org Received: (qmail 44752 invoked from network); 1 Mar 2008 21:56:08 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Mar 2008 21:56:08 -0000 Received: (qmail 88284 invoked by uid 500); 1 Mar 2008 21:56:04 -0000 Delivered-To: christyflores@example.org Received: (qmail 88207 invoked by uid 500); 1 Mar 2008 21:56:03 -0000 Mailing-List: contact christyflores@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:christyflores@example.org> List-Unsubscribe: <mailto:christyflores@example.org> List-Post: <mailto:christyflores@example.org> List-Id: <mahout-dev.lucene.apache.org> Reply-To: christyflores@example.org Delivered-To: mailing list christyflores@example.org Received: (qmail 88198 invoked by uid 99); 1 Mar 2008 21:56:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2008 13:56:03 -0800 X-ASF-Spam-Status: No, hits=0.2 required=10.0 tests=RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: 83.161.120.155 is neither permitted nor denied by domain of christyflores@example.org) Received: from [83.161.120.155] (HELO ch-smtp02.sth.basefarm.net) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2008 21:55:26 +0000 Received: from c83-249-106-113.bredband.comhem.se ([83.161.120.155]:51984 helo=kodapan.lan) by ch-smtp02.sth.basefarm.net with esmtps (TLSv1:AES256-SHA:256) (Exim 4.68) (envelope-from <christyflores@example.org>) id 1JVZg6-0008Cz-8m for christyflores@example.org; Sat, 01 Mar 2008 22:55:35 +0100 Message-ID: <christyflores@example.org> Date: Sat, 01 Mar 2008 22:55:28 +0100 From: Karl Wettin <christyflores@example.org> User-Agent: Thunderbird 83.161.120.155 (Macintosh/20080213) MIME-Version: 1.0 To: christyflores@example.org Subject: Re: [jira] Updated: (MAHOUT-8) Data definition model References: <christyflores@example.org> In-Reply-To: <christyflores@example.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: 83.161.120.155 X-Scan-Result: No virus found in message 1JVZg6-0008Cz-8m. X-Scan-Signature: ch-smtp02.sth.basefarm.net 1JVZg6-0008Cz-8m 036ee32fca6b0040306ccf3c11c65d73 X-Virus-Checked: Checked by ClamAV on apache.org Sorry for killing the conversation with my last comment. I'll try again. There is all this really nice code in the SVN. Thats great. But I really want a low level random access instances "input stream" and a generic header definition so that anything we do have some common ground. In the long run, I belive this is vital for the project. Even more important than having lots and lots of algorithms. And that is why I stay in this layer. If the JSRs and the code I posted in the Jira is overkill, I'm ok with that. I'm still quite attacted by the JSRs and I'm going to stay in this layer until someone tells me I'm nothing but the devils advocate. karl Ted Dunning skrev: > > The thing that brings me up short when reading things like this JSR is that > they have a LOT of mechanism here to explain something that is pretty simple > in a language like R with the data.frame object. > > I am left with the question of what is going on with the complexity. Some > explanations that I could imagine include: > > A) the complexity is optional and R has a simpler solution > > B) the language of discourse is somehow evil and R is just as complex, but > it is somehow vastly easier to explain an R data.frame than it is to explain > what the JSR is talking about. > > C) Java itself is somehow at fault and it is forcing complexity on the > problem that isn't necessary > > D) I am clueless and R lacks the complexity, the JSR has it but it is all > necessary. > > My gut says that (a) is the right answer. My ego causes me to discount (d). > My religion causes me to discount (mostly) (c). I would find it hard to > argue why (b) is not true. > > Anybody else have an opinion? > > On 2/28/08 11:40 AM, "Karl Wettin" <christyflores@example.org> wrote: > >> The simplest way to explain this is to say it is the data headers. Here >> is a simple example: >> >> Say column 1 is a numeric value and column 2 is a class value. Some >> algorithms might only accept discrete values, but I know for a fact that >> the numeric value is an integer between 1 and 10 and could thus be >> treaded as discerete value even though it is not. I don't want to go >> messing about in the headers of the physical data set, nor do I want to >> transform the complete data set, instead I remap the first column and >> state it is a discrete value in my logical data set. >> >> The data definition model does not care if the attribute values are >> integers, string or what not. They are all objects and they can be >> transformed to the type it was mapped as. And the seperation of layers >> makes it very simple. >> >> But most important, I really want to see a unison data model definition >> (typed instance headers) and a very simple abstract way to access >> physical data records (the instances) we can share between data >> tranformation suites, ML algorithms, feature selectors and what not. >> >> Do you read UML? The JSRs have some great documentation then. >> >> There is more to it that what I tried to explain here. And I probably >> didn't pick half of the ideas behind the JSR data models. >> >> >> karl >> >> Grant Ingersoll skrev: >>> I haven't christyflores@example.org. Can you explain the use cases a bit more? >>> How it would be used in M/R, and in implementations? I like the sounds >>> of it >>> >>> >>> On Feb 25, 2008, at 4:34 PM, Karl Wettin (JIRA) wrote: >>> >>>> [ >>>> https://issues.apache.org/jira/browse/MAHOUT-8?page=com.atlassian.jira.plugi >>>> n.system.issuetabpanels:all-tabpanel ] >>>> >>>> >>>> Karl Wettin updated MAHOUT-8: >>>> ----------------------------- >>>> >>>> Attachment: pseudo_jsr.txt >>>> >>>> My question is, did anyone else take a closer look at the JSRs? I >>>> would very much like to hear what you people think of this data model. >>>> I'm quite attracted to it. >>>> >>>> It says nothing about how data is stored, it is about roles and >>>> abstract access to physical instance data. And it seperates logical >>>> (the data set definition used by ML algorithms) from physical (the >>>> deta set definition describing the source data) model, allowing one to >>>> vitually transform the data set by mapping logical data to the >>>> physical data in any way without messing things up. >>>> >>>> I now have this half baked pseudo implementation of this. It uses >>>> abstract classes rather than interfaces, and some of the interfaces >>>> have been merged to a single class. It would however not be a big deal >>>> to have it implement the interfaces if one wish. I feel some of the >>>> stuff in there is a bit overkill at this point, but I tried to follow >>>> the specs as well as I could (I replaced a bit of ad hoc enum classes >>>> with enums, etc). >>>> >>>> There is no documentation, tests or anything concrete, just a bunch of >>>> classes I'm now popping in the JIRA to show what it could look like. >>>> >>>> Actually, there is an early attempt at an abstract seekable physical >>>> data record reader. And an ARFF writer. They are sort of my dry coded >>>> thoughts. You can ignore them. >>>> >>>> >>>>> Data definition model >>>>> --------------------- >>>>> >>>>> Key: MAHOUT-8 >>>>> URL: https://issues.apache.org/jira/browse/MAHOUT-8 >>>>> Project: Mahout >>>>> Issue Type: New Feature >>>>> Reporter: Karl Wettin >>>>> Attachments: pseudo_jsr.txt >>>>> >>>>> >>>>> How do we define classes, attributes and instance data? >>>>> This has nothing to do with physical data records, this is about data >>>>> types, roles, etc. >>>> -- >>>> This message is automatically generated by JIRA. >>>> - >>>> You can reply to this email to add a comment to the issue online. >>>> >>> -------------------------- >>> Grant Ingersoll >>> http://www.lucenebootcamp.com >>> Next Training: April 7, 2008 at ApacheCon Europe in Amsterdam >>> >>> Lucene Helpful Hints: >>> http://wiki.apache.org/lucene-java/BasicsOfPerformance >>> http://wiki.apache.org/lucene-java/LuceneFAQ >>> >>> >>> >>> >>> >> > From mahout-devchristyflores@example.org Sun Mar 02 00:01:19 2008 Return-Path: <mahout-devchristyflores@example.org> Delivered-To: christyflores@example.org Received: (qmail 68279 invoked from network); 2 Mar 2008 00:01:19 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Mar 2008 00:01:19 -0000 Received: (qmail 42419 invoked by uid 500); 2 Mar 2008 00:01:14 -0000 Delivered-To: christyflores@example.org Received: (qmail 42391 invoked by uid 500); 2 Mar 2008 00:01:14 -0000 Mailing-List: contact christyflores@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:christyflores@example.org> List-Unsubscribe: <mailto:christyflores@example.org> List-Post: <mailto:christyflores@example.org> List-Id: <mahout-dev.lucene.apache.org> Reply-To: christyflores@example.org Delivered-To: mailing list christyflores@example.org Received: (qmail 42382 invoked by uid 99); 2 Mar 2008 00:01:14 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2008 16:01:14 -0800 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [83.161.120.155] (HELO hapkido.dreamhost.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 02 Mar 2008 00:00:25 +0000 Received: from spunkymail-a11.g.dreamhost.com (sd-green-bigip-207.dreamhost.com [83.161.120.155]) by hapkido.dreamhost.com (Postfix) with ESMTP id 883001780A9 for <christyflores@example.org>; Sat, 1 Mar 2008 16:00:42 -0800 (PST) Received: from [83.161.120.155] (adsl-074-229-189-244.sip.rmo.bellsouth.net [83.161.120.155]) by spunkymail-a11.g.dreamhost.com (Postfix) with ESMTP id 1459EB899A for <christyflores@example.org>; Sat, 1 Mar 2008 16:00:30 -0800 (PST) Message-Id: <christyflores@example.org> From: Grant Ingersoll <christyflores@example.org> To: christyflores@example.org In-Reply-To: <christyflores@example.org> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v919.2) Subject: Re: [jira] Updated: (MAHOUT-8) Data definition model Date: Sat, 1 Mar 2008 19:00:29 -0500 References: <christyflores@example.org> <christyflores@example.org> X-Mailer: Apple Mail (2.919.2) X-Virus-Checked: Checked by ClamAV on apache.org Hey Karl, I recall when we first started this, that we all seemed to agree that trying to unify things too early is not time well spent and that we should focus on algorithms and not on building a framework for commonality across all the algorithms. As I recall, our general sentiment was that it would bring a sense of a lowest common denominator to the project since each algorithm may not be best suited for the framework. The take away for me, is I feel like it is too early to know what is going to be needed across the algorithms we are implementing. My gut says, let's focus on building algs up through say release 0.5, and then we can think about what gets us to 1.0, which probably will involve what you are talking about here, but it may not. Otherwise, I think it will be a bit of the cart before the horse, in that we will be creating infrastructure for things that we aren't sure will need that infrastructure (granted, this stuff is probably needed by most, but that is to be determined) -Grant On Mar 1, 2008, at 4:55 PM, Karl Wettin wrote: > Sorry for killing the conversation with my last comment. I'll try > again. > > There is all this really nice code in the SVN. Thats great. But I > really > want a low level random access instances "input stream" and a generic > header definition so that anything we do have some common ground. > > In the long run, I belive this is vital for the project. Even more > important than having lots and lots of algorithms. And that is why I > stay in this layer. > > If the JSRs and the code I posted in the Jira is overkill, I'm ok with > that. I'm still quite attacted by the JSRs and I'm going to stay in > this > layer until someone tells me I'm nothing but the devils advocate. > > > > karl > > > Ted Dunning skrev: >> The thing that brings me up short when reading things like this JSR >> is that >> they have a LOT of mechanism here to explain something that is >> pretty simple >> in a language like R with the data.frame object. >> I am left with the question of what is going on with the >> complexity. Some >> explanations that I could imagine include: >> A) the complexity is optional and R has a simpler solution >> B) the language of discourse is somehow evil and R is just as >> complex, but >> it is somehow vastly easier to explain an R data.frame than it is >> to explain >> what the JSR is talking about. >> C) Java itself is somehow at fault and it is forcing complexity on >> the >> problem that isn't necessary >> D) I am clueless and R lacks the complexity, the JSR has it but it >> is all >> necessary. >> My gut says that (a) is the right answer. My ego causes me to >> discount (d). >> My religion causes me to discount (mostly) (c). I would find it >> hard to >> argue why (b) is not true. >> Anybody else have an opinion? >> On 2/28/08 11:40 AM, "Karl Wettin" <christyflores@example.org> wrote: >>> The simplest way to explain this is to say it is the data headers. >>> Here >>> is a simple example: >>> >>> Say column 1 is a numeric value and column 2 is a class value. Some >>> algorithms might only accept discrete values, but I know for a >>> fact that >>> the numeric value is an integer between 1 and 10 and could thus be >>> treaded as discerete value even though it is not. I don't want to go >>> messing about in the headers of the physical data set, nor do I >>> want to >>> transform the complete data set, instead I remap the first column >>> and >>> state it is a discrete value in my logical data set. >>> >>> The data definition model does not care if the attribute values are >>> integers, string or what not. They are all objects and they can be >>> transformed to the type it was mapped as. And the seperation of >>> layers >>> makes it very simple. >>> >>> But most important, I really want to see a unison data model >>> definition >>> (typed instance headers) and a very simple abstract way to access >>> physical data records (the instances) we can share between data >>> tranformation suites, ML algorithms, feature selectors and what not. >>> >>> Do you read UML? The JSRs have some great documentation then. >>> >>> There is more to it that what I tried to explain here. And I >>> probably >>> didn't pick half of the ideas behind the JSR data models. >>> >>> >>> karl >>> >>> Grant Ingersoll skrev: >>>> I haven't christyflores@example.org. Can you explain the use cases a bit >>>> more? >>>> How it would be used in M/R, and in implementations? I like the >>>> sounds >>>> of it >>>> >>>> >>>> On Feb 25, 2008, at 4:34 PM, Karl Wettin (JIRA) wrote: >>>> >>>>> [ https://issues.apache.org/jira/browse/MAHOUT-8?page=com.atlassian.jira.plugi >>>>> n.system.issuetabpanels:all-tabpanel ] >>>>> >>>>> >>>>> Karl Wettin updated MAHOUT-8: >>>>> ----------------------------- >>>>> >>>>> Attachment: pseudo_jsr.txt >>>>> >>>>> My question is, did anyone else take a closer look at the JSRs? I >>>>> would very much like to hear what you people think of this data >>>>> model. >>>>> I'm quite attracted to it. >>>>> >>>>> It says nothing about how data is stored, it is about roles and >>>>> abstract access to physical instance data. And it seperates >>>>> logical >>>>> (the data set definition used by ML algorithms) from physical (the >>>>> deta set definition describing the source data) model, allowing >>>>> one to >>>>> vitually transform the data set by mapping logical data to the >>>>> physical data in any way without messing things up. >>>>> >>>>> I now have this half baked pseudo implementation of this. It uses >>>>> abstract classes rather than interfaces, and some of the >>>>> interfaces >>>>> have been merged to a single class. It would however not be a >>>>> big deal >>>>> to have it implement the interfaces if one wish. I feel some of >>>>> the >>>>> stuff in there is a bit overkill at this point, but I tried to >>>>> follow >>>>> the specs as well as I could (I replaced a bit of ad hoc enum >>>>> classes >>>>> with enums, etc). >>>>> >>>>> There is no documentation, tests or anything concrete, just a >>>>> bunch of >>>>> classes I'm now popping in the JIRA to show what it could look >>>>> like. >>>>> >>>>> Actually, there is an early attempt at an abstract seekable >>>>> physical >>>>> data record reader. And an ARFF writer. They are sort of my dry >>>>> coded >>>>> thoughts. You can ignore them. >>>>> >>>>> >>>>>> Data definition model >>>>>> --------------------- >>>>>> >>>>>> Key: MAHOUT-8 >>>>>> URL: https://issues.apache.org/jira/browse/MAHOUT-8 >>>>>> Project: Mahout >>>>>> Issue Type: New Feature >>>>>> Reporter: Karl Wettin >>>>>> Attachments: pseudo_jsr.txt >>>>>> >>>>>> >>>>>> How do we define classes, attributes and instance data? >>>>>> This has nothing to do with physical data records, this is >>>>>> about data >>>>>> types, roles, etc. >>>>> -- >>>>> This message is automatically generated by JIRA. >>>>> - >>>>> You can reply to this email to add a comment to the issue online. >>>>> >>>> -------------------------- >>>> Grant Ingersoll >>>> http://www.lucenebootcamp.com >>>> Next Training: April 7, 2008 at ApacheCon Europe in Amsterdam >>>> >>>> Lucene Helpful Hints: >>>> http://wiki.apache.org/lucene-java/BasicsOfPerformance >>>> http://wiki.apache.org/lucene-java/LuceneFAQ >>>> >>>> >>>> >>>> >>>> >>> > > -------------------------- Grant Ingersoll http://www.lucenebootcamp.com Next Training: April 7, 2008 at ApacheCon Europe in Amsterdam Lucene Helpful Hints: http://wiki.apache.org/lucene-java/BasicsOfPerformance http://wiki.apache.org/lucene-java/LuceneFAQ From mahout-devchristyflores@example.org Sun Mar 02 00:08:59 2008 Return-Path: <mahout-devchristyflores@example.org> Delivered-To: christyflores@example.org Received: (qmail 69855 invoked from network); 2 Mar 2008 00:08:59 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Mar 2008 00:08:59 -0000 Received: (qmail 48248 invoked by uid 500); 2 Mar 2008 00:08:55 -0000 Delivered-To: christyflores@example.org Received: (qmail 48219 invoked by uid 500); 2 Mar 2008 00:08:55 -0000 Mailing-List: contact christyflores@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:christyflores@example.org> List-Unsubscribe: <mailto:christyflores@example.org> List-Post: <mailto:christyflores@example.org> List-Id: <mahout-dev.lucene.apache.org> Reply-To: christyflores@example.org Delivered-To: mailing list christyflores@example.org Received: (qmail 48210 invoked by uid 99); 2 Mar 2008 00:08:55 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2008 16:08:55 -0800 X-ASF-Spam-Status: No, hits=3.2 required=10.0 tests=HTML_MESSAGE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: 83.161.120.155 is neither permitted nor denied by domain of christyflores@example.org) Received: from [83.161.120.155] (HELO sp-exchmbc.sp.corp.collab.net) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 02 Mar 2008 00:08:09 +0000 X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----_=_NextPart_001_01C87BF9.8AED8FED" Subject: Merging 6h & 6i Date: Sat, 1 Mar 2008 16:08:26 -0800 Message-ID: <christyflores@example.org> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: Merging 6h & 6i Thread-Index: Ach7+Ym8/2QmSR50S7itjFAUR4XcoQ== From: "Jeff Eastman" <christyflores@example.org> To: <christyflores@example.org> X-Virus-Checked: Checked by ClamAV on apache.org ------_=_NextPart_001_01C87BF9.8AED8FED Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi Grant, =20 I'm trying to figure out how to merge our two recent patches, do you have a strategy? =20 Jeff ------_=_NextPart_001_01C87BF9.8AED8FED-- From mahout-devchristyflores@example.org Sun Mar 02 01:44:17 2008 Return-Path: <mahout-devchristyflores@example.org> Delivered-To: christyflores@example.org Received: (qmail 96450 invoked from network); 2 Mar 2008 01:44:17 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Mar 2008 01:44:17 -0000 Received: (qmail 95073 invoked by uid 500); 2 Mar 2008 01:44:12 -0000 Delivered-To: christyflores@example.org Received: (qmail 94962 invoked by uid 500); 2 Mar 2008 01:44:12 -0000 Mailing-List: contact christyflores@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:christyflores@example.org> List-Unsubscribe: <mailto:christyflores@example.org> List-Post: <mailto:christyflores@example.org> List-Id: <mahout-dev.lucene.apache.org> Reply-To: christyflores@example.org Delivered-To: mailing list christyflores@example.org Received: (qmail 94953 invoked by uid 99); 2 Mar 2008 01:44:12 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2008 17:44:12 -0800 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [83.161.120.155] (HELO spunkymail-a14.g.dreamhost.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 02 Mar 2008 01:43:37 +0000 Received: from [83.161.120.155] (adsl-074-229-189-244.sip.rmo.bellsouth.net [83.161.120.155]) by spunkymail-a14.g.dreamhost.com (Postfix) with ESMTP id 69131190E2C for <christyflores@example.org>; Sat, 1 Mar 2008 17:43:49 -0800 (PST) Message-Id: <christyflores@example.org> From: Grant Ingersoll <christyflores@example.org> To: christyflores@example.org In-Reply-To: <christyflores@example.org> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v919.2) Subject: Re: Merging 6h & 6i Date: Sat, 1 Mar 2008 20:43:45 -0500 References: <christyflores@example.org> X-Mailer: Apple Mail (2.919.2) X-Virus-Checked: Checked by ClamAV on apache.org Mine should be all in the vector one, so apply that, and then apply yours to a clean trunk. You may have to clean up a bit, but it shouldn't be too bad. Otherwise, all I really did was replace javadocs that had Matrix1D refs. and added a Vector test. -Grant On Mar 1, 2008, at 7:08 PM, Jeff Eastman wrote: > Hi Grant, > > > > I'm trying to figure out how to merge our two recent patches, do you > have a strategy? > > > > Jeff > From mahout-devchristyflores@example.org Sun Mar 02 04:06:24 2008 Return-Path: <mahout-devchristyflores@example.org> Delivered-To: christyflores@example.org Received: (qmail 31113 invoked from network); 2 Mar 2008 04:06:24 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Mar 2008 04:06:24 -0000 Received: (qmail 98074 invoked by uid 500); 2 Mar 2008 04:06:19 -0000 Delivered-To: christyflores@example.org Received: (qmail 98051 invoked by uid 500); 2 Mar 2008 04:06:19 -0000 Mailing-List: contact christyflores@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:christyflores@example.org> List-Unsubscribe: <mailto:christyflores@example.org> List-Post: <mailto:christyflores@example.org> List-Id: <mahout-dev.lucene.apache.org> Reply-To: christyflores@example.org Delivered-To: mailing list christyflores@example.org Received: (qmail 98042 invoked by uid 99); 2 Mar 2008 04:06:19 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2008 20:06:19 -0800 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: 83.161.120.155 is neither permitted nor denied by domain of christyflores@example.org) Received: from [83.161.120.155] (HELO sp-exchmbc.sp.corp.collab.net) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 02 Mar 2008 04:05:45 +0000 X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Subject: RE: Merging 6h & 6i Date: Sat, 1 Mar 2008 20:05:55 -0800 Message-ID: <christyflores@example.org> In-Reply-To: <christyflores@example.org> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: Merging 6h & 6i Thread-Index: Ach8Bu1jvujwgHThShuVc5pcuuoOngAEYR6g References: <christyflores@example.org> <christyflores@example.org> From: "Jeff Eastman" <christyflores@example.org> To: <christyflores@example.org> X-Virus-Checked: Checked by ClamAV on apache.org Ok, I will do that. I made only a couple of changes in Vector so I will make a separate patch for Matrix and then merge our Vector changes. This will all be easier once we have stuff in SVN. Diffing diffs is a new experience for me <grin> Jeff -----Original Message----- From: Grant Ingersoll [mailto:christyflores@example.org]=20 Sent: Saturday, March 01, 2008 5:44 PM To: christyflores@example.org Subject: Re: Merging 6h & 6i Mine should be all in the vector one, so apply that, and then apply =20 yours to a clean trunk. You may have to clean up a bit, but it =20 shouldn't be too bad. Otherwise, all I really did was replace javadocs that had Matrix1D =20 refs. and added a Vector test. -Grant On Mar 1, 2008, at 7:08 PM, Jeff Eastman wrote: > Hi Grant, > > > > I'm trying to figure out how to merge our two recent patches, do you > have a strategy? > > > > Jeff > From mahout-devchristyflores@example.org Sun Mar 02 05:14:29 2008 Return-Path: <mahout-devchristyflores@example.org> Delivered-To: christyflores@example.org Received: (qmail 42266 invoked from network); 2 Mar 2008 05:14:27 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Mar 2008 05:14:27 -0000 Received: (qmail 13996 invoked by uid 500); 2 Mar 2008 05:14:22 -0000 Delivered-To: christyflores@example.org Received: (qmail 13956 invoked by uid 500); 2 Mar 2008 05:14:22 -0000 Mailing-List: contact christyflores@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:christyflores@example.org> List-Unsubscribe: <mailto:christyflores@example.org> List-Post: <mailto:christyflores@example.org> List-Id: <mahout-dev.lucene.apache.org> Reply-To: christyflores@example.org Delivered-To: mailing list christyflores@example.org Received: (qmail 13947 invoked by uid 99); 2 Mar 2008 05:14:22 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2008 21:14:22 -0800 X-ASF-Spam-Status: No, hits=2.8 required=10.0 tests=RCVD_IN_DNSWL_LOW,RCVD_NUMERIC_HELO,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [83.161.120.155] (HELO ex9.myhostedexchange.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 02 Mar 2008 05:13:47 +0000 Received: from 83.161.120.155 ([83.161.120.155]) by ex9.hostedexchange.local ([83.161.120.155]) with Microsoft Exchange Server HTTP-DAV ; Sun, 2 Mar 2008 05:13:56 +0000 User-Agent: Microsoft-Entourage/83.161.120.155214 Date: Sat, 01 Mar 2008 21:13:46 -0800 Subject: Re: Merging 6h & 6i From: Ted Dunning <christyflores@example.org> To: <christyflores@example.org> Message-ID: <christyflores@example.org> Thread-Topic: Merging 6h & 6i Thread-Index: Ach8Bu1jvujwgHThShuVc5pcuuoOngAEYR6gAALvvgw= In-Reply-To: <christyflores@example.org> Mime-version: 1.0 Content-type: text/plain; charset="US-ASCII" Content-transfer-encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org An alternative strategy is to apply the diffs to two different copies of trunk and diff those. When done, the diff of the merged versions is a merged diff (by def). On 3/1/08 8:05 PM, "Jeff Eastman" <christyflores@example.org> wrote: > Ok, I will do that. I made only a couple of changes in Vector so I will > make a separate patch for Matrix and then merge our Vector changes. This > will all be easier once we have stuff in SVN. Diffing diffs is a new > experience for me <grin> > > Jeff > > -----Original Message----- > From: Grant Ingersoll [mailto:christyflores@example.org] > Sent: Saturday, March 01, 2008 5:44 PM > To: christyflores@example.org > Subject: Re: Merging 6h & 6i > > Mine should be all in the vector one, so apply that, and then apply > yours to a clean trunk. You may have to clean up a bit, but it > shouldn't be too bad. > > Otherwise, all I really did was replace javadocs that had Matrix1D > refs. and added a Vector test. > > -Grant > > On Mar 1, 2008, at 7:08 PM, Jeff Eastman wrote: > >> Hi Grant, >> >> >> >> I'm trying to figure out how to merge our two recent patches, do you >> have a strategy? >> >> >> >> Jeff >> > > > From mahout-devchristyflores@example.org Mon Mar 03 13:27:32 2008 Return-Path: <mahout-devchristyflores@example.org> Delivered-To: christyflores@example.org Received: (qmail 26878 invoked from network); 3 Mar 2008 13:27:32 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Mar 2008 13:27:32 -0000 Received: (qmail 516 invoked by uid 500); 3 Mar 2008 13:27:28 -0000 Delivered-To: christyflores@example.org Received: (qmail 454 invoked by uid 500); 3 Mar 2008 13:27:27 -0000 Mailing-List: contact christyflores@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:christyflores@example.org> List-Unsubscribe: <mailto:christyflores@example.org> List-Post: <mailto:christyflores@example.org> List-Id: <mahout-dev.lucene.apache.org> Reply-To: christyflores@example.org Delivered-To: mailing list christyflores@example.org Received: (qmail 437 invoked by uid 99); 3 Mar 2008 13:27:27 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Mar 2008 05:27:27 -0800 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [83.161.120.155] (HELO spunkymail-a19.g.dreamhost.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Mar 2008 13:26:51 +0000 Received: from [83.161.120.155] (adsl-074-229-189-244.sip.rmo.bellsouth.net [83.161.120.155]) by spunkymail-a19.g.dreamhost.com (Postfix) with ESMTP id 4939D11D1A; Mon, 3 Mar 2008 05:27:00 -0800 (PST) Message-Id: <christyflores@example.org> From: Grant Ingersoll <christyflores@example.org> To: christyflores@example.org, christyflores@example.org Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v919.2) Subject: ApacheCon EU BOF Date: Mon, 3 Mar 2008 08:26:59 -0500 X-Mailer: Apple Mail (2.919.2) X-Virus-Checked: Checked by ClamAV on apache.org If you are going to be at ApacheCon EU, we are planning a Mahout BOF for Thursday night immediately following the Hadoop BOF (should be a good overlap). See http://wiki.apache.org/apachecon/BirdsOfaFeatherEu08 Hope to see you there, Grant From mahout-devchristyflores@example.org Mon Mar 03 21:16:04 2008 Return-Path: <mahout-devchristyflores@example.org> Delivered-To: christyflores@example.org Received: (qmail 99361 invoked from network); 3 Mar 2008 21:16:04 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Mar 2008 21:16:04 -0000 Received: (qmail 26458 invoked by uid 500); 3 Mar 2008 21:15:59 -0000 Delivered-To: christyflores@example.org Received: (qmail 26439 invoked by uid 500); 3 Mar 2008 21:15:59 -0000 Mailing-List: contact christyflores@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:christyflores@example.org> List-Unsubscribe: <mailto:christyflores@example.org> List-Post: <mailto:christyflores@example.org> List-Id: <mahout-dev.lucene.apache.org> Reply-To: christyflores@example.org Delivered-To: mailing list christyflores@example.org Received: (qmail 26430 invoked by uid 99); 3 Mar 2008 21:15:59 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Mar 2008 13:15:59 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with
{'source': 'Apache Software Foundation Public Mail Archives'}