From mapreduce-dev-returnschneiderjacob@example.net Mon Mar 01 07:24:10 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 38506 invoked from network); 1 Mar 2010 07:24:10 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 1 Mar 2010 07:24:10 -0000 Received: (qmail 1411 invoked by uid 500); 1 Mar 2010 04:37:29 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 1229 invoked by uid 500); 1 Mar 2010 04:37:28 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 1191 invoked by uid 99); 1 Mar 2010 04:37:27 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Mar 2010 04:37:27 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Mar 2010 04:37:27 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 2AA10234C48D for <schneiderjacob@example.net>; Mon, 1 Mar 2010 04:37:07 +0000 (UTC) Message-ID: <schneiderjacob@example.net> Date: Mon, 1 Mar 2010 04:37:07 +0000 (UTC) From: "Vinod K V (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Created: (MAPREDUCE-1543) Log messages of JobACLsManager should use security logging of HADOOP-6586 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Log messages of JobACLsManager should use security logging of HADOOP-6586 ------------------------------------------------------------------------- Key: MAPREDUCE-1543 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1543 Project: Hadoop Map/Reduce Issue Type: Bug Components: security Reporter: Vinod K V Fix For: 0.22.0 {{JobACLsManager}} added in MAPREDUCE-1307 logs the successes and failures w.r.t job-level authorization in the corresponding Daemons' logs. The log messages should instead use security logging of HADOOP-6586. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Mon Mar 01 07:59:30 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 7397 invoked from network); 1 Mar 2010 07:59:30 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 1 Mar 2010 07:59:30 -0000 Received: (qmail 77422 invoked by uid 500); 1 Mar 2010 03:59:28 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 77362 invoked by uid 500); 1 Mar 2010 03:59:27 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 77354 invoked by uid 99); 1 Mar 2010 03:59:27 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Mar 2010 03:59:27 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Mar 2010 03:59:27 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 58E25234C48D for <schneiderjacob@example.net>; Mon, 1 Mar 2010 03:59:07 +0000 (UTC) Message-ID: <schneiderjacob@example.net> Date: Mon, 1 Mar 2010 03:59:07 +0000 (UTC) From: "Vinod K V (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Created: (MAPREDUCE-1542) Deprecate mapred.permissions.supergroup in favor of hadoop.cluster.administrators MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Deprecate mapred.permissions.supergroup in favor of hadoop.cluster.administrators --------------------------------------------------------------------------------- Key: MAPREDUCE-1542 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1542 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Vinod K V Fix For: 0.22.0 HADOOP-6568 added the configuration {{hadoop.cluster.administrators}} through which admins can configure who the superusers/supergroups for the cluster are. MAPREDUCE itself already has {{mapred.permissions.supergroup}} (which is just a single group). As agreed upon at HADOOP-6568, this should be deprecated in favor of {{hadoop.cluster.administrators}}. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Mon Mar 01 22:40:31 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 50261 invoked from network); 1 Mar 2010 22:40:31 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 1 Mar 2010 22:40:31 -0000 Received: (qmail 5744 invoked by uid 500); 1 Mar 2010 22:40:29 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 5363 invoked by uid 500); 1 Mar 2010 22:40:28 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 5044 invoked by uid 99); 1 Mar 2010 22:40:28 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Mar 2010 22:40:28 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Mar 2010 22:40:26 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id C33E0234C4AD for <schneiderjacob@example.net>; Mon, 1 Mar 2010 22:40:05 +0000 (UTC) Message-ID: <schneiderjacob@example.net> Date: Mon, 1 Mar 2010 22:40:05 +0000 (UTC) From: "Todd Lipcon (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Created: (MAPREDUCE-1544) Miscellaneous improvements to HTML markup for web UIs MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Miscellaneous improvements to HTML markup for web UIs ----------------------------------------------------- Key: MAPREDUCE-1544 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1544 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Todd Lipcon Priority: Minor The Web UIs have various bits of bad markup (eg missing <head> sections, some pages missing CSS links, inconsistent td vs th for table headings). We should fix this up. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Mon Mar 01 23:08:32 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 58823 invoked from network); 1 Mar 2010 23:08:31 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 1 Mar 2010 23:08:31 -0000 Received: (qmail 51302 invoked by uid 500); 1 Mar 2010 23:08:29 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 51241 invoked by uid 500); 1 Mar 2010 23:08:29 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 51227 invoked by uid 99); 1 Mar 2010 23:08:29 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Mar 2010 23:08:29 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Mar 2010 23:08:26 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id DBB6A234C4B4 for <schneiderjacob@example.net>; Mon, 1 Mar 2010 23:08:05 +0000 (UTC) Message-ID: <{{EMAIL+PHONE}}> Date: Mon, 1 Mar 2010 23:08:05 +0000 (UTC) From: "Arun C Murthy (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Created: (MAPREDUCE-1545) Add 'first-task-launched' to job-summary MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Add 'first-task-launched' to job-summary ---------------------------------------- Key: MAPREDUCE-1545 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1545 Project: Hadoop Map/Reduce Issue Type: Improvement Components: jobtracker Reporter: Arun C Murthy Assignee: Arun C Murthy Fix For: 0.22.0 It would be useful to track 'first-task-launched' time to job-summary for better reporting. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Tue Mar 02 02:02:31 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 7901 invoked from network); 2 Mar 2010 02:02:30 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 2 Mar 2010 02:02:30 -0000 Received: (qmail 34943 invoked by uid 500); 2 Mar 2010 02:02:28 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 34904 invoked by uid 500); 2 Mar 2010 02:02:28 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 34896 invoked by uid 99); 2 Mar 2010 02:02:28 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Mar 2010 02:02:28 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Mar 2010 02:02:26 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id CC4AA29A0011 for <schneiderjacob@example.net>; Tue, 2 Mar 2010 02:02:05 +0000 (UTC) Message-ID: <schneiderjacob@example.net> Date: Tue, 2 Mar 2010 02:02:05 +0000 (UTC) From: "Scott Chen (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Created: (MAPREDUCE-1546) jobdetails.jsp and taskdetials.jsp should show links to the corresponding jobdetailshistory.jsp and taskdetailshistory.jsp if the task/job is gone MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org jobdetails.jsp and taskdetials.jsp should show links to the corresponding jobdetailshistory.jsp and taskdetailshistory.jsp if the task/job is gone -------------------------------------------------------------------------------------------------------------------------------------------------- Key: MAPREDUCE-1546 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1546 Project: Hadoop Map/Reduce Issue Type: Improvement Affects Versions: 0.22.0 Reporter: Scott Chen Assignee: Scott Chen Priority: Minor Fix For: 0.22.0 It will be good if there is a link goes to the history page when the job/task is gone from JobTracker memory. That way we don't have to look for the history link again. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Tue Mar 02 05:15:54 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 42729 invoked from network); 2 Mar 2010 05:15:54 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 2 Mar 2010 05:15:54 -0000 Received: (qmail 65696 invoked by uid 500); 2 Mar 2010 05:15:51 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 65571 invoked by uid 500); 2 Mar 2010 05:15:50 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 65563 invoked by uid 99); 2 Mar 2010 05:15:49 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Mar 2010 05:15:49 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Mar 2010 05:15:48 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 3955A234C4A8 for <schneiderjacob@example.net>; Tue, 2 Mar 2010 05:15:27 +0000 (UTC) Message-ID: <schneiderjacob@example.net> Date: Tue, 2 Mar 2010 05:15:27 +0000 (UTC) From: "Iyappan Srinivasan (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Created: (MAPREDUCE-1547) Build Hadoop-Mapreduce-trunk fails MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Build Hadoop-Mapreduce-trunk fails ---------------------------------- Key: MAPREDUCE-1547 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1547 Project: Hadoop Map/Reduce Issue Type: Bug Components: build Affects Versions: 0.22.0 Reporter: Iyappan Srinivasan http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-Mapreduce-trunk/243/console Build fails with thsi message BUILD FAILED /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build.xml:1382: Execute failed: java.io.IOException: Cannot run program "autoreconf" (in directory "/grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/c++/utils"): java.io.IOException: error=2, No such file or directory -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Tue Mar 02 09:11:51 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 1930 invoked from network); 2 Mar 2010 09:11:51 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 2 Mar 2010 09:11:51 -0000 Received: (qmail 60888 invoked by uid 500); 2 Mar 2010 09:11:47 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 60854 invoked by uid 500); 2 Mar 2010 09:11:47 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 60846 invoked by uid 99); 2 Mar 2010 09:11:47 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Mar 2010 09:11:47 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Mar 2010 09:11:47 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 55C1F234C4AE for <schneiderjacob@example.net>; Tue, 2 Mar 2010 09:11:27 +0000 (UTC) Message-ID: <schneiderjacob@example.net> Date: Tue, 2 Mar 2010 09:11:27 +0000 (UTC) From: "Rodrigo Schmidt (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Created: (MAPREDUCE-1548) Hadoop archives should be able to preserve times and other properties from original files MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Hadoop archives should be able to preserve times and other properties from original files ----------------------------------------------------------------------------------------- Key: MAPREDUCE-1548 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1548 Project: Hadoop Map/Reduce Issue Type: Improvement Components: harchive Reporter: Rodrigo Schmidt Files inside hadoop archives don't keep their original: - modification time - access time - permission - owner - group all such properties are currently taken from the file storing the archive index, and not the stored files. This doesn't look very correct. There should be possible to preserve the original properties of the stored files. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Tue Mar 02 09:11:51 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 1987 invoked from network); 2 Mar 2010 09:11:51 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 2 Mar 2010 09:11:51 -0000 Received: (qmail 61156 invoked by uid 500); 2 Mar 2010 09:11:48 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 61102 invoked by uid 500); 2 Mar 2010 09:11:48 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 61020 invoked by uid 99); 2 Mar 2010 09:11:48 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Mar 2010 09:11:48 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Mar 2010 09:11:47 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 51A27234C4AB for <schneiderjacob@example.net>; Tue, 2 Mar 2010 09:11:27 +0000 (UTC) Message-ID: <schneiderjacob@example.net> Date: Tue, 2 Mar 2010 09:11:27 +0000 (UTC) From: "Giridharan Kesavan (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Resolved: (MAPREDUCE-1547) Build Hadoop-Mapreduce-trunk and Mapreduce-trunk-Commit fails In-Reply-To: <schneiderjacob@example.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giridharan Kesavan resolved MAPREDUCE-1547. ------------------------------------------- Resolution: Fixed Fix Version/s: 0.22.0 > Build Hadoop-Mapreduce-trunk and Mapreduce-trunk-Commit fails > -------------------------------------------------------------- > > Key: MAPREDUCE-1547 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1547 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: build > Affects Versions: 0.22.0 > Reporter: Iyappan Srinivasan > Assignee: Giridharan Kesavan > Fix For: 0.22.0 > > > http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-Mapreduce-trunk/243/console > Build Hadoop-Mapreduce-trunk fails with this message > BUILD FAILED > /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build.xml:1382: Execute failed: java.io.IOException: Cannot run program "autoreconf" (in directory "/grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/c++/utils"): java.io.IOException: error=2, No such file or directory > http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-Mapreduce-trunk-Commit/251/console > Build Mapreduce-trunk-Commit fails with this message: > /bin/bash /tmp/hudson2120484997034746272.sh > bash: /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk-Commit/nightly/commitBuild.sh: No such file or directory -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Tue Mar 02 10:15:51 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 26938 invoked from network); 2 Mar 2010 10:15:51 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 2 Mar 2010 10:15:51 -0000 Received: (qmail 42254 invoked by uid 500); 2 Mar 2010 10:15:47 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 42195 invoked by uid 500); 2 Mar 2010 10:15:47 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 42187 invoked by uid 99); 2 Mar 2010 10:15:47 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Mar 2010 10:15:47 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Mar 2010 10:15:47 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 1FB98234C4AB for <schneiderjacob@example.net>; Tue, 2 Mar 2010 10:15:27 +0000 (UTC) Message-ID: <schneiderjacob@example.net> Date: Tue, 2 Mar 2010 10:15:27 +0000 (UTC) From: "Amar Kamat (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Created: (MAPREDUCE-1549) TestTrackerDistributedCacheManager failed on some machines MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 TestTrackerDistributedCacheManager failed on some machines ---------------------------------------------------------- Key: MAPREDUCE-1549 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1549 Project: Hadoop Map/Reduce Issue Type: Bug Components: test Reporter: Amar Kamat TestTrackerDistributedCacheManager.testPublicPrivateCache fails on some machines. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Tue Mar 02 20:21:55 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 48130 invoked from network); 2 Mar 2010 20:21:53 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 2 Mar 2010 20:21:53 -0000 Received: (qmail 17900 invoked by uid 500); 2 Mar 2010 20:21:48 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 17665 invoked by uid 500); 2 Mar 2010 20:21:48 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 17564 invoked by uid 99); 2 Mar 2010 20:21:48 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Mar 2010 20:21:48 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Mar 2010 20:21:47 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 52B46234C4C7 for <schneiderjacob@example.net>; Tue, 2 Mar 2010 20:21:27 +0000 (UTC) Message-ID: <schneiderjacob@example.net> Date: Tue, 2 Mar 2010 20:21:27 +0000 (UTC) From: "Devaraj Das (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Created: (MAPREDUCE-1550) UGI.doAs should not be used for getting the history file of jobs MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 UGI.doAs should not be used for getting the history file of jobs ---------------------------------------------------------------- Key: MAPREDUCE-1550 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1550 Project: Hadoop Map/Reduce Issue Type: Bug Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Fix For: 0.22.0 When the jobtracker tries to open a job history file it does a doAs to get the filesystem for the user (that had submitted the job). This should not be done since the job history files are owned by the jobtracker. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Tue Mar 02 23:30:55 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 2616 invoked from network); 2 Mar 2010 23:30:55 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 2 Mar 2010 23:30:55 -0000 Received: (qmail 6028 invoked by uid 500); 2 Mar 2010 23:30:49 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 5969 invoked by uid 500); 2 Mar 2010 23:30:49 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 5953 invoked by uid 99); 2 Mar 2010 23:30:49 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Mar 2010 23:30:49 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Mar 2010 23:30:48 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 4417D234C4C5 for <schneiderjacob@example.net>; Tue, 2 Mar 2010 23:30:27 +0000 (UTC) Message-ID: <schneiderjacob@example.net> Date: Tue, 2 Mar 2010 23:30:27 +0000 (UTC) From: "Chris Douglas (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Created: (MAPREDUCE-1551) TestMiniMRLocalFS fails MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org TestMiniMRLocalFS fails ----------------------- Key: MAPREDUCE-1551 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1551 Project: Hadoop Map/Reduce Issue Type: Bug Components: test Affects Versions: 0.22.0 Reporter: Chris Douglas {{TestMiniMRLocalFS}} fails consistently on trunk: {noformat} Testcase: testWithLocal took 38.957 sec Caused an ERROR File QuasiMonteCarlo_TMP_3_141592654/out/reduce-out does not exist. java.io.FileNotFoundException: File QuasiMonteCarlo_TMP_3_141592654/out/reduce-out does not exist. at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:420) at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:246) at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1466) at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1447) at org.apache.hadoop.examples.QuasiMonteCarlo.estimatePi(QuasiMonteCarlo.java:313) at org.apache.hadoop.mapred.TestMiniMRWithDFS.runPI(TestMiniMRWithDFS.java:235) at org.apache.hadoop.mapred.TestMiniMRLocalFS.testWithLocal(TestMiniMRLocalFS.java:68) {noformat} -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Wed Mar 03 00:31:55 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 20645 invoked from network); 3 Mar 2010 00:31:55 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 3 Mar 2010 00:31:55 -0000 Received: (qmail 82930 invoked by uid 500); 3 Mar 2010 00:31:50 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 82801 invoked by uid 500); 3 Mar 2010 00:31:49 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 82692 invoked by uid 99); 3 Mar 2010 00:31:49 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Mar 2010 00:31:49 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Mar 2010 00:31:48 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 38AD7234C4BB for <schneiderjacob@example.net>; Wed, 3 Mar 2010 00:31:27 +0000 (UTC) Message-ID: <schneiderjacob@example.net> Date: Wed, 3 Mar 2010 00:31:27 +0000 (UTC) From: "Allen Wittenauer (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Created: (MAPREDUCE-1552) TaskTracker should report which fs during error MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org TaskTracker should report which fs during error ----------------------------------------------- Key: MAPREDUCE-1552 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1552 Project: Hadoop Map/Reduce Issue Type: Improvement Affects Versions: 0.20.2 Reporter: Allen Wittenauer We run with ZFS with fs quotas for the mapred spill space to prevent it over-running the HDFS space. During merge, we some times end up running out of space. It would be useful if the stack trace (see below) included which file system the errors actually came from. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Wed Mar 03 03:37:56 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 9330 invoked from network); 3 Mar 2010 03:37:56 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 3 Mar 2010 03:37:56 -0000 Received: (qmail 29158 invoked by uid 500); 3 Mar 2010 03:37:50 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 29100 invoked by uid 500); 3 Mar 2010 03:37:50 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 29079 invoked by uid 99); 3 Mar 2010 03:37:49 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Mar 2010 03:37:49 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Mar 2010 03:37:48 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 3B72D234C1F0 for <schneiderjacob@example.net>; Wed, 3 Mar 2010 03:37:27 +0000 (UTC) Message-ID: <schneiderjacob@example.net> Date: Wed, 3 Mar 2010 03:37:27 +0000 (UTC) From: "Hemanth Yamijala (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Resolved: (MAPREDUCE-1551) TestMiniMRLocalFS fails In-Reply-To: <schneiderjacob@example.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/MAPREDUCE-1551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hemanth Yamijala resolved MAPREDUCE-1551. ----------------------------------------- Resolution: Duplicate This is a duplicate of MAPREDUCE-1520. There's a patch on it with a +1 from Devaraj. Can it be committed ? > TestMiniMRLocalFS fails > ----------------------- > > Key: MAPREDUCE-1551 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1551 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test > Affects Versions: 0.22.0 > Reporter: Chris Douglas > > {{TestMiniMRLocalFS}} fails consistently on trunk: > {noformat} > Testcase: testWithLocal took 38.957 sec > Caused an ERROR > File QuasiMonteCarlo_TMP_3_141592654/out/reduce-out does not exist. > java.io.FileNotFoundException: File QuasiMonteCarlo_TMP_3_141592654/out/reduce-out does not exist. > at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:420) > at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:246) > at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1466) > at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1447) > at org.apache.hadoop.examples.QuasiMonteCarlo.estimatePi(QuasiMonteCarlo.java:313) > at org.apache.hadoop.mapred.TestMiniMRWithDFS.runPI(TestMiniMRWithDFS.java:235) > at org.apache.hadoop.mapred.TestMiniMRLocalFS.testWithLocal(TestMiniMRLocalFS.java:68) > {noformat} -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Wed Mar 03 07:07:38 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 97007 invoked from network); 3 Mar 2010 06:39:57 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 3 Mar 2010 06:39:57 -0000 Received: (qmail 1948 invoked by uid 500); 3 Mar 2010 06:39:51 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 1823 invoked by uid 500); 3 Mar 2010 06:39:50 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 1810 invoked by uid 99); 3 Mar 2010 06:39:49 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Mar 2010 06:39:49 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Mar 2010 06:39:48 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 33BAC234C1F0 for <schneiderjacob@example.net>; Wed, 3 Mar 2010 06:39:27 +0000 (UTC) Message-ID: <schneiderjacob@example.net> Date: Wed, 3 Mar 2010 06:39:27 +0000 (UTC) From: "Amareshwari Sriramadasu (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Created: (MAPREDUCE-1553) mapred.userlog.retain.hours is improperly renamed in MAPREDUCE-849 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org mapred.userlog.retain.hours is improperly renamed in MAPREDUCE-849 ------------------------------------------------------------------ Key: MAPREDUCE-1553 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1553 Project: Hadoop Map/Reduce Issue Type: Bug Components: documentation Affects Versions: 0.21.0 Reporter: Amareshwari Sriramadasu Fix For: 0.21.0 mapred.userlog.retain.hours is renamed as mapred.task.userlog.retain.hours in JobContext. But, in mapred-default, it is mapreduce.task.userlog.retain.hours. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Wed Mar 03 09:22:20 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 35608 invoked from network); 3 Mar 2010 09:22:19 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 3 Mar 2010 09:22:19 -0000 Received: (qmail 54439 invoked by uid 500); 3 Mar 2010 09:22:13 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 54328 invoked by uid 500); 3 Mar 2010 09:22:12 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 54074 invoked by uid 99); 3 Mar 2010 09:22:12 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Mar 2010 09:22:12 +0000 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [83.161.120.155] (HELO ext.lri.fr) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Mar 2010 09:22:03 +0000 Received: from localhost (localhost [83.161.120.155]) by ext.lri.fr (Postfix) with ESMTP id ADD39A4633; Wed, 3 Mar 2010 10:21:41 +0100 (CET) X-Virus-Scanned: Debian schneiderjacob@example.net Received: from ext.lri.fr ([83.161.120.155]) by localhost (ext.lri.fr [83.161.120.155]) (amavisd-new, port 10024) with ESMTP id JCfJhf8cyYdM; Wed, 3 Mar 2010 10:21:41 +0100 (CET) Received: from [83.161.120.155] (dhcp-13-177.lip.ens-lyon.fr [83.161.120.155]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ext.lri.fr (Postfix) with ESMTP id 84857A45F9; Wed, 3 Mar 2010 10:21:41 +0100 (CET) Message-ID: <schneiderjacob@example.net> Date: Wed, 03 Mar 2010 10:20:44 +0100 From: Gilles Fedak <schneiderjacob@example.net> User-Agent: Thunderbird 83.161.120.155 (X11/20090817) MIME-Version: 1.0 To: schneiderjacob@example.net CC: schneiderjacob@example.net Subject: [CFP] Deadline extension MAPREDUCE'2010 @ HPDC X-Enigmail-Version: 0.95.7 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit (We apologize if you have received multiple copies of this CFP) ------------------------------------------------------------------- CALL FOR PAPERS The First International Workshop on MapReduce and its Applications (MAPREDUCE'10) June 22nd, 2010 HPDC'2010, Chicago, IL, USA (http://graal.ens-lyon.fr/mapreduce/) ------------------------------------------------------------------- SCOPE Since its introduction in 2004 by Google, MapReduce has become the programming model of choice for processing large data sets. MapReduce borrows from functional programming, where a programmer can define both a Map task that maps a data set into another data set, and a Reduce task that combines intermediate outputs into a final result. Although MapReduce was originally developed for use by web enterprises in large data-centers, this technique has gained a lot of attention from the scientific community for its applicability in large parallel data analysis (including geographic, high energy physics, genomics, etc..). The purpose of the workshop is to provide a forum for discussing recent advances, identifying open issues, introducing developments and tools, and presenting applications and enhancements for MapReduce (or very similar) systems. We therefore cordially invite contributions that investigate these issues, introduce new execution environments, apply performance evaluations and show the applicability to science and enterprise applications. TOPICS OF INTEREST * MapReduce implementation issues and improvements * Implementation optimization for GPU and multi-core systems * Extensions to the programing model * Large-scale MapReduce (Grid and Desktop Grid) * Use of CDN and P2P techniques * Heterogeneity and fault-tolerance * Scientific data-sets analysis * Data and compute-intensive applications * Tools and environments for MapReduce * Algorithms using the MapReduce paradigm PAPER SUBMISSIONS Authors are invited to submit full papers of at most 8 pages, including all figures and references. Papers should be formatted in the ACM proceedings style (e.g., http://www.acm.org/sigs/publications/proceedings-templates). Submitted papers must be original work that has not appeared in and is not under consideration for another conference or a journal. Accepted papers will be published by ACM in the conference workshops proceedings. Papers should be submitted here: http://www.easychair.org/conferences/?conf=mapreduce2010. IMPORTANT DATES * Manuscript submission deadline : March 15, 2010 * Acceptance notification : April 1st, 2010 * Camera-ready paper deadline : April 10, 2010 * Workshop dates : June 22, 2010 ORGANIZATION COMMITTEE General Chairs Gilles Fedak, INRIA/LIP (contact: schneiderjacob@example.net) Geoffrey Fox, Indiana University Program chair Haiwu He, INRIA PROGRAM COMMITTEE * Alexandre de Assis Bento Lima, Federal University of Rio de Janeiro * Gabriel Antoniu, INRIA * Francisco V. Brasileiro, Federal University of Campina Grande * Rajkumar Buyya, University of Melbourne * George Bosilca, University of Tennessee Knoxville * Franck Cappello, JointLab INRIA UUIC * Christian Engelmann, Oak Ridge National Laboratory * Shantenu Jha, Louisiana State University * Ian Kelley, Cardiff University * Oleg Lodygensky, CNRS * Carlo Mastroianni, ICAR-CNR * Hidemoto Nakada, AIST * Matei Ripeanu, University of Britsh Columbia * Xuanhuan Shi, Huazhong University of Science and Technology * Patrick Valduriez, INRIA * Sudharshan Vazhkudai, Oak Ridge National Laboratory From mapreduce-dev-returnschneiderjacob@example.net Wed Mar 03 09:39:56 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 40030 invoked from network); 3 Mar 2010 09:39:55 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 3 Mar 2010 09:39:55 -0000 Received: (qmail 76564 invoked by uid 500); 3 Mar 2010 09:39:49 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 76322 invoked by uid 500); 3 Mar 2010 09:39:48 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 76306 invoked by uid 99); 3 Mar 2010 09:39:48 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Mar 2010 09:39:48 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Mar 2010 09:39:47 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 7C0B0234C4C5 for <schneiderjacob@example.net>; Wed, 3 Mar 2010 09:39:27 +0000 (UTC) Message-ID: <schneiderjacob@example.net> Date: Wed, 3 Mar 2010 09:39:27 +0000 (UTC) From: "Ravi Gummadi (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Created: (MAPREDUCE-1554) If user name contains '_', then searching of jobs based on user name on job history web UI doesn't work MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 If user name contains '_', then searching of jobs based on user name on job history web UI doesn't work ------------------------------------------------------------------------------------------------------- Key: MAPREDUCE-1554 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1554 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Ravi Gummadi If user name contains '_', then searching of jobs based on user name on job history web UI doesn't work. This is because in code, everywhere split("_") is done on history file name to get user name. And other parts of history file name also should not be obtained by using split("_"). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Wed Mar 03 17:20:58 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 94424 invoked from network); 3 Mar 2010 17:20:58 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 3 Mar 2010 17:20:58 -0000 Received: (qmail 28249 invoked by uid 500); 3 Mar 2010 17:20:50 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 28205 invoked by uid 500); 3 Mar 2010 17:20:50 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 28095 invoked by uid 99); 3 Mar 2010 17:20:50 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Mar 2010 17:20:50 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Mar 2010 17:20:48 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 4093E234C4BC for <schneiderjacob@example.net>; Wed, 3 Mar 2010 17:20:27 +0000 (UTC) Message-ID: <schneiderjacob@example.net> Date: Wed, 3 Mar 2010 17:20:27 +0000 (UTC) From: "Ruyue Ma (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Created: (MAPREDUCE-1555) Maybe some code of MapTask is wrong. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Maybe some code of MapTask is wrong. ------------------------------------ Key: MAPREDUCE-1555 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1555 Project: Hadoop Map/Reduce Issue Type: Bug Components: task Reporter: Ruyue Ma {code:title=MapTask.java|borderStyle=solid} public void write(DataOutput out) throws IOException { super.write(out); if (isMapOrReduce()) { splitMetaInfo.write(out); splitMetaInfo = null; // HERE: why set null ?????? } } {code} In above code, if the splitMetaInfo is set null, Second Serialization (will invoke write) will throw NullPointerException. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Wed Mar 03 19:34:56 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 50783 invoked from network); 3 Mar 2010 19:34:55 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 3 Mar 2010 19:34:55 -0000 Received: (qmail 11190 invoked by uid 500); 3 Mar 2010 19:34:47 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 11153 invoked by uid 500); 3 Mar 2010 19:34:47 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 11137 invoked by uid 99); 3 Mar 2010 19:34:47 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Mar 2010 19:34:47 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Mar 2010 19:34:47 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 402A9234C4BC for <schneiderjacob@example.net>; Wed, 3 Mar 2010 19:34:27 +0000 (UTC) Message-ID: <schneiderjacob@example.net> Date: Wed, 3 Mar 2010 19:34:27 +0000 (UTC) From: "Doug Cutting (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Created: (MAPREDUCE-1556) upgrade to Avro 1.3.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 upgrade to Avro 1.3.0 --------------------- Key: MAPREDUCE-1556 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1556 Project: Hadoop Map/Reduce Issue Type: Improvement Components: jobtracker Reporter: Doug Cutting Assignee: Doug Cutting Fix For: 0.22.0 Avro 1.3.0 has now been released. HADOOP-6486 and HDFS-892 require it, and the version of Avro used by MapReduce should be synchronized with these projects. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Wed Mar 03 20:06:56 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 58457 invoked from network); 3 Mar 2010 20:06:56 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 3 Mar 2010 20:06:56 -0000 Received: (qmail 43731 invoked by uid 500); 3 Mar 2010 20:06:48 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 43513 invoked by uid 500); 3 Mar 2010 20:06:47 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 43504 invoked by uid 99); 3 Mar 2010 20:06:47 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Mar 2010 20:06:47 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Mar 2010 20:06:47 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 3F962234C4C0 for <schneiderjacob@example.net>; Wed, 3 Mar 2010 20:06:27 +0000 (UTC) Message-ID: <schneiderjacob@example.net> Date: Wed, 3 Mar 2010 20:06:27 +0000 (UTC) From: "Ravi Phulari (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Created: (MAPREDUCE-1557) MapReduce teragen example should print correct error message for invalid inputs. Currently throws ArrayIndexOutOfBoundsException . MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 MapReduce teragen example should print correct error message for invalid inputs. Currently throws ArrayIndexOutOfBoundsException . ----------------------------------------------------------------------------------------------------------------------------------- Key: MAPREDUCE-1557 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1557 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Ravi Phulari Assignee: Ravi Phulari Priority: Trivial MapReduce teragen example should print correct error message for invalid inputs. Currently for invalid CLI arguments stack trace is thrown with ArrayIndexOutOfBoundsException. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Wed Mar 03 22:48:59 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 10202 invoked from network); 3 Mar 2010 22:48:59 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 3 Mar 2010 22:48:59 -0000 Received: (qmail 76098 invoked by uid 500); 3 Mar 2010 22:48:50 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 76044 invoked by uid 500); 3 Mar 2010 22:48:50 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 76036 invoked by uid 99); 3 Mar 2010 22:48:50 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Mar 2010 22:48:50 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Mar 2010 22:48:50 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 09C8F234C4BB for <schneiderjacob@example.net>; Wed, 3 Mar 2010 22:48:29 +0000 (UTC) Message-ID: <schneiderjacob@example.net> Date: Wed, 3 Mar 2010 22:48:29 +0000 (UTC) From: "Boris Shkolnik (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Created: (MAPREDUCE-1558) specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in MRAdmin (for HADOOP-6612) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in MRAdmin (for HADOOP-6612) ----------------------------------------------------------------------------------------------------------------------------------------------------- Key: MAPREDUCE-1558 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1558 Project: Hadoop Map/Reduce Issue Type: Bug Components: security Reporter: Boris Shkolnik -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Thu Mar 04 01:03:59 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 52890 invoked from network); 4 Mar 2010 01:03:58 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 4 Mar 2010 01:03:58 -0000 Received: (qmail 5408 invoked by uid 500); 4 Mar 2010 01:03:50 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 5364 invoked by uid 500); 4 Mar 2010 01:03:49 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 5306 invoked by uid 99); 4 Mar 2010 01:03:49 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Mar 2010 01:03:49 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Mar 2010 01:03:48 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 2AA4B234C4BC for <schneiderjacob@example.net>; Thu, 4 Mar 2010 01:03:27 +0000 (UTC) Message-ID: <schneiderjacob@example.net> Date: Thu, 4 Mar 2010 01:03:27 +0000 (UTC) From: "Devaraj Das (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Created: (MAPREDUCE-1559) The DelegationTokenRenewal timer task should use the jobtracker's credentials to create the filesystem MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org The DelegationTokenRenewal timer task should use the jobtracker's credentials to create the filesystem ------------------------------------------------------------------------------------------------------ Key: MAPREDUCE-1559 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1559 Project: Hadoop Map/Reduce Issue Type: Bug Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.22.0 The submitJob RPC finally creates a timer task for renewing the delegation tokens of the submitting user. This timer task inherits the context of the RPC handler that runs in the context of the job submitting user, and when it tries to create a filesystem, the RPC client tries to use the user's credentials. This should instead use the JobTracker's credentials. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Thu Mar 04 03:54:05 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 85981 invoked from network); 4 Mar 2010 03:54:05 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 4 Mar 2010 03:54:05 -0000 Received: (qmail 24500 invoked by uid 500); 4 Mar 2010 03:53:55 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 24398 invoked by uid 500); 4 Mar 2010 03:53:55 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 24389 invoked by uid 99); 4 Mar 2010 03:53:55 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Mar 2010 03:53:55 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of schneiderjacob@example.net designates 83.161.120.155 as permitted sender) Received: from [83.161.120.155] (HELO mail-vw0-f48.google.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Mar 2010 03:53:46 +0000 Received: by vws8 with SMTP id 8so653681vws.35 for <schneiderjacob@example.net>; Wed, 03 Mar 2010 19:53:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from :user-agent:mime-version:to:subject:content-type :content-transfer-encoding; bh=wrU9BexDIgfzREEzhrvth2Zxb60rqABrVxQO6zpeKk8=; b=nXOYyO3xVKO6NNiJ/fvFdm95K5rIyCnylskPNgdZ0jgrbvgXJoP4oskBEc0yKwT2z9 YUpGIK3zpHooj1TInrZTnO5mTAOb/uSZyqMtG5IfoA36CLKLm8Pb3pWOgtb1infZRXbk qWwSu34YfcghW9k2HvmrjjZ0gbO5AvOlsUpO8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:subject :content-type:content-transfer-encoding; b=yGHSO1GOsNgdGYZl9lpAb69Ae4dij1bVv2ApjMQMArvr7zodJpUemo1dOeKLvC1IeN JBXFozfdLcF0sJSy0wVKy+/gWX1jNZGr3nFcxRKwH+aeHBhL82lChMrq/lWquZ/fOjcq XmvgF2DvYp07m5pm23wx/UYeT/bdpFXLcAeCg= Received: by 83.161.120.155 with SMTP id z17mr347273vcl.108.1267674804937; Wed, 03 Mar 2010 19:53:24 -0800 (PST) Received: from ?83.161.120.155? (c-69-140-248-212.hsd1.md.comcast.net [83.161.120.155]) by mx.google.com with ESMTPS id 39sm11566371vws.1.283.161.120.155.53.23 (version=SSLv3 cipher=RC4-MD5); Wed, 03 Mar 2010 19:53:24 -0800 (PST) Message-ID: <schneiderjacob@example.net> Date: Wed, 03 Mar 2010 22:53:25 -0500 From: Chris White <schneiderjacob@example.net> User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-GB; rv:83.161.120.155) Gecko/20100111 Thunderbird/3.0.1 MIME-Version: 1.0 To: schneiderjacob@example.net Subject: MRUnit Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit What's the current development state of MRUnit? I'm currently using the 0.20.1+152 version from cloudera but the implementation lacks some important features (all relating to the new API) * MapReduceDriver doesn't allow configuration of a combiner * ReducerDriver doesn't allow you to configure the Reducer.Context such that the TaskAttemptID.isMapper() returns true/false (allowing you to test a Reducer class that relies on this to perform different functionality depending on the current phase of the execution chain * Neither MapDriver, ReduceDriver and MapReduceDriver allow you to configure the Configuration object which is presented to the map/reducer through the mocked Context object Looking through the SVN tree, the current MRUnit code lives in the contrib folder at http://svn.apache.org/repos/asf/hadoop/mapreduce/trunk/src/contrib/mrunit, but the most recent revision (or even the base revision) won't compile with the 0.20.1 core (org.apache.hadoop.mapreduce.TaskType enum is not part of 0.20.1) If i wanted to go about making these changes where would be the best place to do it, bearing in mind that it would effectively be a branch of the 807942 revision, made to work for 0.20.1 Thanks From mapreduce-dev-returnschneiderjacob@example.net Fri Mar 05 01:24:45 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 77908 invoked from network); 5 Mar 2010 01:24:45 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 5 Mar 2010 01:24:45 -0000 Received: (qmail 11619 invoked by uid 500); 5 Mar 2010 01:24:33 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 11454 invoked by uid 500); 5 Mar 2010 01:24:33 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 11446 invoked by uid 99); 5 Mar 2010 01:24:33 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 05 Mar 2010 01:24:33 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [83.161.120.155] (HELO mail-pz0-f189.google.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 05 Mar 2010 01:24:25 +0000 Received: by pzk27 with SMTP id 27so47937pzk.2 for <schneiderjacob@example.net>; Thu, 04 Mar 2010 17:24:03 -0800 (PST) MIME-Version: 1.0 Received: by 83.161.120.155 with SMTP id e6mr150561rvi.86.1267752243139; Thu, 04 Mar 2010 17:24:03 -0800 (PST) In-Reply-To: <schneiderjacob@example.net> References: <schneiderjacob@example.net> From: Aaron Kimball <schneiderjacob@example.net> Date: Thu, 4 Mar 2010 17:23:43 -0800 Message-ID: <schneiderjacob@example.net> Subject: Re: MRUnit To: schneiderjacob@example.net Content-Type: multipart/alternative; boundary=000e0cd11ae81d9498048103929b X-Virus-Checked: Checked by ClamAV on apache.org --000e0cd11ae81d9498048103929b Content-Type: text/plain; charset=ISO-8859-1 Hi Chris, The current development state is that I'm not pro-actively adding new code to MRUnit, but am happy to address bugs people bring to my attention (subject to the other demands on my work time). But I'm super-happy to help you with pointers in patching issues you raise yourself. :) These are all definitely legitimate issues in MRUnit that should be addressed. At minimum, you should file issues on the Hadoop JIRA ( http://issues.apache.org/jira) to get these bugs logged. They should be made under the MAPREDUCE project; tag them with the 'contrib/mrunit' component so they're in the correct spot. I can try to add them to my work queue myself, but they'll be addressed faster if you'd like to help contribute. As you note, Hadoop 0.20 and the development "trunk" branch do diverge. Apache Hadoop 0.20 does not contain an MRUnit implementation. The version available in CDH is a backport of the trunk branch, with slight modifications made so that it compiles against Hadoop 0.20 (you correctly note a couple inconsistencies in Hadoop's API that the backport needs to work around). The correct way to address these bugs is to check out the trunk of Hadoop MapReduce (see the Hadoop wiki for instructions on how to set your development environment up, using either svn or git). Then make modifications against the trunk branch and test them there, and generate a patch that improves MRUnit in trunk. This way MRUnit work stays apace of the rest of Hadoop's development. The changes should be committed to Hadoop trunk (after posting the patch on the JIRA). Ideally you'd write a separate patch (and have a separate JIRA filed) for each of the different issues you've raised. The CDH development team has an ongoing process of reviewing recent trunk patches for backporting to the CDH build. We'll then take a look at how to best backport your patches so that they apply on top of CDH (likely there won't be too much effort). Those would then be made available in a subsequent CDH release. It's actually extremely likely that your changes themselves wouldn't need specific effort to backport; in most cases involving contribs, small bugfix patches written against trunk will apply directly on top of CDH (or you may need to change just a line or two where a TaskType or something of the like is involved). Please ping me off-list and let me know if you've got further questions about this, or whether you'd like some help writing bugfixes. I'm happy to offer guidance as needed. Regards, - Aaron Kimball On Wed, Mar 3, 2010 at 7:53 PM, Chris White <schneiderjacob@example.net>wrote: > What's the current development state of MRUnit? I'm currently using the > 0.20.1+152 version from cloudera but the implementation lacks some important > features (all relating to the new API) > > * MapReduceDriver doesn't allow configuration of a combiner > * ReducerDriver doesn't allow you to configure the Reducer.Context such > that the TaskAttemptID.isMapper() returns true/false (allowing you to test a > Reducer class that relies on this to perform different functionality > depending on the current phase of the execution chain > * Neither MapDriver, ReduceDriver and MapReduceDriver allow you to > configure the Configuration object which is presented to the map/reducer > through the mocked Context object > > Looking through the SVN tree, the current MRUnit code lives in the contrib > folder at > http://svn.apache.org/repos/asf/hadoop/mapreduce/trunk/src/contrib/mrunit, > but the most recent revision (or even the base revision) won't compile with > the 0.20.1 core (org.apache.hadoop.mapreduce.TaskType enum is not part of > 0.20.1) > > If i wanted to go about making these changes where would be the best place > to do it, bearing in mind that it would effectively be a branch of the > 807942 revision, made to work for 0.20.1 > > Thanks > --000e0cd11ae81d9498048103929b-- From mapreduce-dev-returnschneiderjacob@example.net Fri Mar 05 03:44:10 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 12000 invoked from network); 5 Mar 2010 03:44:10 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 5 Mar 2010 03:44:10 -0000 Received: (qmail 28587 invoked by uid 500); 5 Mar 2010 03:43:57 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 28266 invoked by uid 500); 5 Mar 2010 03:43:57 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing list schneiderjacob@example.net Received: (qmail 28204 invoked by uid 99); 5 Mar 2010 03:43:55 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 05 Mar 2010 03:43:55 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 05 Mar 2010 03:43:54 +0000 Received: from brutus.apache.org (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 69D49234C4DE for <schneiderjacob@example.net>; Fri, 5 Mar 2010 03:43:34 +0000 (UTC) Message-ID: <schneiderjacob@example.net> Date: Fri, 5 Mar 2010 03:43:34 +0000 (UTC) From: "Arun C Murthy (JIRA)" <schneiderjacob@example.net> To: schneiderjacob@example.net Subject: [jira] Created: (MAPREDUCE-1560) Better diagnostic message for tasks killed for going over vmem limit MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Better diagnostic message for tasks killed for going over vmem limit -------------------------------------------------------------------- Key: MAPREDUCE-1560 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1560 Project: Hadoop Map/Reduce Issue Type: Bug Components: tasktracker Reporter: Arun C Murthy Assignee: Arun C Murthy Fix For: 0.22.0 Currently the user has no indication of his tasks getting killed due to vmem limit, the only way to know is by looking at TT logs. We should get the TT to insert a diagnostic string for the task to indicate this. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From mapreduce-dev-returnschneiderjacob@example.net Fri Mar 05 06:34:07 2010 Return-Path: <mapreduce-dev-returnschneiderjacob@example.net> Delivered-To: schneiderjacob@example.net Received: (qmail 42468 invoked from network); 5 Mar 2010 06:34:07 -0000 Received: from unknown (HELO mail.apache.org) (83.161.120.155) by 83.161.120.155 with SMTP; 5 Mar 2010 06:34:07 -0000 Received: (qmail 51001 invoked by uid 500); 5 Mar 2010 06:33:54 -0000 Delivered-To: schneiderjacob@example.net Received: (qmail 50770 invoked by uid 500); 5 Mar 2010 06:33:51 -0000 Mailing-List: contact schneiderjacob@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:schneiderjacob@example.net> List-Unsubscribe: <mailto:schneiderjacob@example.net> List-Post: <mailto:schneiderjacob@example.net> List-Id: <mapreduce-dev.hadoop.apache.org> Reply-To: schneiderjacob@example.net Delivered-To: mailing
{'source': 'Apache Software Foundation Public Mail Archives'}