From hdfsjennifer84@example.org Mon Aug 03 21:56:35 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 29373 invoked from network); 3 Aug 2009 21:56:35 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Aug 2009 21:56:35 -0000 Received: (qmail 54277 invoked by uid 500); 3 Aug 2009 21:56:40 -0000 Delivered-To: jennifer84@example.org Received: (qmail 54173 invoked by uid 500); 3 Aug 2009 21:56:39 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 53836 invoked by uid 99); 3 Aug 2009 21:56:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Aug 2009 21:56:39 +0000 X-ASF-Spam-Status: No, hits=-1998.8 required=10.0 tests=ALL_TRUSTED,FS_REPLICA X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Aug 2009 21:56:36 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 24429234C1E6 for <jennifer84@example.org>; Mon, 3 Aug 2009 14:56:15 -0700 (PDT) Message-ID: <154350825.1249336575147.JavaMail.jira@brutus> Date: Mon, 3 Aug 2009 14:56:15 -0700 (PDT) From: "Konstantin Shvachko (JIRA)" <jennifer84@example.org> To: jennifer84@example.org Subject: [jira] Created: (HDFS-517) Introduce BlockInfoUnderConstruction to reflect block replica states while writing. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Introduce BlockInfoUnderConstruction to reflect block replica states while writing. ----------------------------------------------------------------------------------- Key: HDFS-517 URL: https://issues.apache.org/jira/browse/HDFS-517 Project: Hadoop HDFS Issue Type: Sub-task Components: name-node Affects Versions: 0.21.0 Reporter: Konstantin Shvachko Assignee: Konstantin Shvachko Fix For: Append Branch Currently when a block is created its locations are stored in {{INodeFileUnderConstruction.targets}}, which correspond to the last allocated block. With the new append design we will need to keep track of block replicas for several blocks rather than just the last one. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hdfsjennifer84@example.org Mon Aug 03 22:02:34 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 31643 invoked from network); 3 Aug 2009 22:02:34 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Aug 2009 22:02:34 -0000 Received: (qmail 64350 invoked by uid 500); 3 Aug 2009 22:02:38 -0000 Delivered-To: jennifer84@example.org Received: (qmail 64310 invoked by uid 500); 3 Aug 2009 22:02:38 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 64275 invoked by uid 99); 3 Aug 2009 22:02:38 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Aug 2009 22:02:38 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Aug 2009 22:02:35 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id EB0F9234C046 for <jennifer84@example.org>; Mon, 3 Aug 2009 15:02:14 -0700 (PDT) Message-ID: <687522152.1249336934961.JavaMail.jira@brutus> Date: Mon, 3 Aug 2009 15:02:14 -0700 (PDT) From: "Konstantin Boudnik (JIRA)" <jennifer84@example.org> To: jennifer84@example.org Subject: [jira] Created: (HDFS-518) Create new tests for Append's hflush MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Create new tests for Append's hflush ------------------------------------ Key: HDFS-518 URL: https://issues.apache.org/jira/browse/HDFS-518 Project: Hadoop HDFS Issue Type: Sub-task Components: test Reporter: Konstantin Boudnik According to the test plan a number of new features are going to be implemented as a part of this umbrella (HDFS-265) JIRA. These new features are have to be tested properly. hflush is one of new functionality which require new tests to be developed. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hdfsjennifer84@example.org Mon Aug 03 22:02:34 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 31733 invoked from network); 3 Aug 2009 22:02:34 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Aug 2009 22:02:34 -0000 Received: (qmail 64492 invoked by uid 500); 3 Aug 2009 22:02:39 -0000 Delivered-To: jennifer84@example.org Received: (qmail 64456 invoked by uid 500); 3 Aug 2009 22:02:39 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 64446 invoked by uid 99); 3 Aug 2009 22:02:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Aug 2009 22:02:39 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Aug 2009 22:02:36 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 798FA29A001A for <jennifer84@example.org>; Mon, 3 Aug 2009 15:02:15 -0700 (PDT) Message-ID: <113392901.1249336935497.JavaMail.jira@brutus> Date: Mon, 3 Aug 2009 15:02:15 -0700 (PDT) From: "Konstantin Boudnik (JIRA)" <jennifer84@example.org> To: jennifer84@example.org Subject: [jira] Created: (HDFS-519) Create new tests for lease recovery MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Create new tests for lease recovery ----------------------------------- Key: HDFS-519 URL: https://issues.apache.org/jira/browse/HDFS-519 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Konstantin Boudnik -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hdfsjennifer84@example.org Mon Aug 03 22:04:32 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 32892 invoked from network); 3 Aug 2009 22:04:32 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Aug 2009 22:04:32 -0000 Received: (qmail 68164 invoked by uid 500); 3 Aug 2009 22:04:37 -0000 Delivered-To: jennifer84@example.org Received: (qmail 68073 invoked by uid 500); 3 Aug 2009 22:04:36 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 68054 invoked by uid 99); 3 Aug 2009 22:04:36 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Aug 2009 22:04:36 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Aug 2009 22:04:35 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id DA464234C053 for <jennifer84@example.org>; Mon, 3 Aug 2009 15:04:14 -0700 (PDT) Message-ID: <1023140863.1249337054893.JavaMail.jira@brutus> Date: Mon, 3 Aug 2009 15:04:14 -0700 (PDT) From: "Konstantin Boudnik (JIRA)" <jennifer84@example.org> To: jennifer84@example.org Subject: [jira] Created: (HDFS-520) Create new tests for block recovery MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Create new tests for block recovery ----------------------------------- Key: HDFS-520 URL: https://issues.apache.org/jira/browse/HDFS-520 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Konstantin Boudnik -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hdfsjennifer84@example.org Mon Aug 03 22:04:55 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 33270 invoked from network); 3 Aug 2009 22:04:55 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Aug 2009 22:04:55 -0000 Received: (qmail 68976 invoked by uid 500); 3 Aug 2009 22:05:00 -0000 Delivered-To: jennifer84@example.org Received: (qmail 68894 invoked by uid 500); 3 Aug 2009 22:05:00 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 68884 invoked by uid 99); 3 Aug 2009 22:05:00 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Aug 2009 22:05:00 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Aug 2009 22:04:57 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 00012234C495 for <jennifer84@example.org>; Mon, 3 Aug 2009 15:04:14 -0700 (PDT) Message-ID: <1714313.1249337054999.JavaMail.jira@brutus> Date: Mon, 3 Aug 2009 15:04:14 -0700 (PDT) From: "Konstantin Boudnik (JIRA)" <jennifer84@example.org> To: jennifer84@example.org Subject: [jira] Created: (HDFS-521) Create new tests for pipeline MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Create new tests for pipeline ----------------------------- Key: HDFS-521 URL: https://issues.apache.org/jira/browse/HDFS-521 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Konstantin Boudnik -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hdfsjennifer84@example.org Mon Aug 03 22:15:32 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 38525 invoked from network); 3 Aug 2009 22:15:32 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Aug 2009 22:15:32 -0000 Received: (qmail 92604 invoked by uid 500); 3 Aug 2009 22:15:37 -0000 Delivered-To: jennifer84@example.org Received: (qmail 92527 invoked by uid 500); 3 Aug 2009 22:15:37 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 92507 invoked by uid 99); 3 Aug 2009 22:15:37 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Aug 2009 22:15:37 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Aug 2009 22:15:35 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 0EA9D234C046 for <jennifer84@example.org>; Mon, 3 Aug 2009 15:15:15 -0700 (PDT) Message-ID: <248475856.1249337715059.JavaMail.jira@brutus> Date: Mon, 3 Aug 2009 15:15:15 -0700 (PDT) From: "Konstantin Boudnik (JIRA)" <jennifer84@example.org> To: jennifer84@example.org Subject: [jira] Created: (HDFS-522) Create stress tests for append feature MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Create stress tests for append feature -------------------------------------- Key: HDFS-522 URL: https://issues.apache.org/jira/browse/HDFS-522 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Konstantin Boudnik -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hdfsjennifer84@example.org Mon Aug 03 22:19:32 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 40701 invoked from network); 3 Aug 2009 22:19:32 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Aug 2009 22:19:32 -0000 Received: (qmail 97348 invoked by uid 500); 3 Aug 2009 22:19:37 -0000 Delivered-To: jennifer84@example.org Received: (qmail 97309 invoked by uid 500); 3 Aug 2009 22:19:36 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 97273 invoked by uid 99); 3 Aug 2009 22:19:36 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Aug 2009 22:19:36 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Aug 2009 22:19:35 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id DF54A234C055 for <jennifer84@example.org>; Mon, 3 Aug 2009 15:19:14 -0700 (PDT) Message-ID: <468.594.9881.1249337954913.JavaMail.jira@brutus> Date: Mon, 3 Aug 2009 15:19:14 -0700 (PDT) From: "Konstantin Boudnik (JIRA)" <jennifer84@example.org> To: jennifer84@example.org Subject: [jira] Created: (HDFS-523) Create performance/scalability tests for append feature MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Create performance/scalability tests for append feature ------------------------------------------------------- Key: HDFS-523 URL: https://issues.apache.org/jira/browse/HDFS-523 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Konstantin Boudnik -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hdfsjennifer84@example.org Mon Aug 03 22:45:34 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 49364 invoked from network); 3 Aug 2009 22:45:33 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Aug 2009 22:45:33 -0000 Received: (qmail 27257 invoked by uid 500); 3 Aug 2009 22:45:38 -0000 Delivered-To: jennifer84@example.org Received: (qmail 27192 invoked by uid 500); 3 Aug 2009 22:45:38 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 27182 invoked by uid 99); 3 Aug 2009 22:45:38 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Aug 2009 22:45:38 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Aug 2009 22:45:35 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id D8D91234C046 for <jennifer84@example.org>; Mon, 3 Aug 2009 15:45:14 -0700 (PDT) Message-ID: <742181586.1249339514887.JavaMail.jira@brutus> Date: Mon, 3 Aug 2009 15:45:14 -0700 (PDT) From: "Tsz Wo (Nicholas), SZE (JIRA)" <jennifer84@example.org> To: jennifer84@example.org Subject: [jira] Created: (HDFS-524) Further DataTransferProtocol code refactoring. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Further DataTransferProtocol code refactoring. ---------------------------------------------- Key: HDFS-524 URL: https://issues.apache.org/jira/browse/HDFS-524 Project: Hadoop HDFS Issue Type: Improvement Components: data-node Affects Versions: 0.21.0 Reporter: Tsz Wo (Nicholas), SZE Assignee: Tsz Wo (Nicholas), SZE Fix For: 0.21.0 This is a further refactoring over HDFS-377 to move generic codes from DataXceiver to DataTransferProtocol. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hdfsjennifer84@example.org Tue Aug 04 01:42:32 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 20017 invoked from network); 4 Aug 2009 01:42:32 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 4 Aug 2009 01:42:32 -0000 Received: (qmail 25433 invoked by uid 500); 4 Aug 2009 01:42:37 -0000 Delivered-To: jennifer84@example.org Received: (qmail 25346 invoked by uid 500); 4 Aug 2009 01:42:36 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 25334 invoked by uid 99); 4 Aug 2009 01:42:36 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Aug 2009 01:42:36 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Aug 2009 01:42:34 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id D4465234C046 for <jennifer84@example.org>; Mon, 3 Aug 2009 18:42:14 -0700 (PDT) Message-ID: <282402160.1249350134868.JavaMail.jira@brutus> Date: Mon, 3 Aug 2009 18:42:14 -0700 (PDT) From: "Suresh Srinivas (JIRA)" <jennifer84@example.org> To: jennifer84@example.org Subject: [jira] Created: (HDFS-525) ListPathsServlet.java uses static SimpleDateFormat that has threading issues MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org ListPathsServlet.java uses static SimpleDateFormat that has threading issues ---------------------------------------------------------------------------- Key: HDFS-525 URL: https://issues.apache.org/jira/browse/HDFS-525 Project: Hadoop HDFS Issue Type: Bug Reporter: Suresh Srinivas Assignee: Suresh Srinivas SimpleDateFormat is not thread safe. Multiple threads accessing the servlet can cause threading issues -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hdfsjennifer84@example.org Tue Aug 04 23:18:34 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 33027 invoked from network); 4 Aug 2009 23:18:33 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 4 Aug 2009 23:18:33 -0000 Received: (qmail 79148 invoked by uid 500); 4 Aug 2009 23:18:38 -0000 Delivered-To: jennifer84@example.org Received: (qmail 78768 invoked by uid 500); 4 Aug 2009 23:18:38 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 78369 invoked by uid 99); 4 Aug 2009 23:18:37 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Aug 2009 23:18:37 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Aug 2009 23:18:35 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 1545729A0020 for <jennifer84@example.org>; Tue, 4 Aug 2009 16:18:15 -0700 (PDT) Message-ID: <8230604.1249427895086.JavaMail.jira@brutus> Date: Tue, 4 Aug 2009 16:18:15 -0700 (PDT) From: "Jakob Homan (JIRA)" <jennifer84@example.org> To: jennifer84@example.org Subject: [jira] Created: (HDFS-526) TestBackupNode is currently flaky and shouldn't be in commit test MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org TestBackupNode is currently flaky and shouldn't be in commit test ----------------------------------------------------------------- Key: HDFS-526 URL: https://issues.apache.org/jira/browse/HDFS-526 Project: Hadoop HDFS Issue Type: Bug Components: test Reporter: Jakob Homan As documented in HDFS-192 TestBackupNode is currently failing regularly and is impacting our continuous integration tests. Although it has good code coverage value, perhaps it should be removed from the suite until its reliability can be improved? -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hdfsjennifer84@example.org Tue Aug 04 23:38:34 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 41285 invoked from network); 4 Aug 2009 23:38:34 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 4 Aug 2009 23:38:34 -0000 Received: (qmail 98361 invoked by uid 500); 4 Aug 2009 23:38:39 -0000 Delivered-To: jennifer84@example.org Received: (qmail 98292 invoked by uid 500); 4 Aug 2009 23:38:39 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 98282 invoked by uid 99); 4 Aug 2009 23:38:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Aug 2009 23:38:39 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Aug 2009 23:38:36 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id DB5E329A0015 for <jennifer84@example.org>; Tue, 4 Aug 2009 16:38:14 -0700 (PDT) Message-ID: <1401278745.1249429094897.JavaMail.jira@brutus> Date: Tue, 4 Aug 2009 16:38:14 -0700 (PDT) From: "Tsz Wo (Nicholas), SZE (JIRA)" <jennifer84@example.org> To: jennifer84@example.org Subject: [jira] Created: (HDFS-527) Refactor DFSClient constructors MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Refactor DFSClient constructors ------------------------------- Key: HDFS-527 URL: https://issues.apache.org/jira/browse/HDFS-527 Project: Hadoop HDFS Issue Type: Improvement Components: hdfs client Reporter: Tsz Wo (Nicholas), SZE There are 5 constructors in DFSClient. It seems unnecessary. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hdfsjennifer84@example.org Wed Aug 05 00:18:33 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 64152 invoked from network); 5 Aug 2009 00:18:32 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 5 Aug 2009 00:18:32 -0000 Received: (qmail 42461 invoked by uid 500); 5 Aug 2009 00:18:37 -0000 Delivered-To: jennifer84@example.org Received: (qmail 42373 invoked by uid 500); 5 Aug 2009 00:18:37 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 42363 invoked by uid 99); 5 Aug 2009 00:18:37 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Aug 2009 00:18:37 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Aug 2009 00:18:35 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id F1BC329A001E for <jennifer84@example.org>; Tue, 4 Aug 2009 17:18:14 -0700 (PDT) Message-ID: <282551127.1249431494989.JavaMail.jira@brutus> Date: Tue, 4 Aug 2009 17:18:14 -0700 (PDT) From: "Todd Lipcon (JIRA)" <jennifer84@example.org> To: jennifer84@example.org Subject: [jira] Created: (HDFS-528) Add dfsadmin -waitDatanodes feature to block until DNs have reported MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Add dfsadmin -waitDatanodes feature to block until DNs have reported -------------------------------------------------------------------- Key: HDFS-528 URL: https://issues.apache.org/jira/browse/HDFS-528 Project: Hadoop HDFS Issue Type: New Feature Components: scripts Reporter: Todd Lipcon Assignee: Todd Lipcon When starting up a fresh cluster programatically, users often want to wait until DFS is "writable" before continuing in a script. "dfsadmin -safemode wait" doesn't quite work for this on a completely fresh cluster, since when there are 0 blocks on the system, 100% of them are accounted for before any DNs have reported. This JIRA is to add a command which waits until a certain number of DNs have reported as alive to the NN. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hdfsjennifer84@example.org Wed Aug 05 01:50:32 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 48710 invoked from network); 5 Aug 2009 01:50:32 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 5 Aug 2009 01:50:32 -0000 Received: (qmail 3038 invoked by uid 500); 5 Aug 2009 01:22:38 -0000 Delivered-To: jennifer84@example.org Received: (qmail 2920 invoked by uid 500); 5 Aug 2009 01:22:38 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 2890 invoked by uid 99); 5 Aug 2009 01:22:37 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Aug 2009 01:22:37 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Aug 2009 01:22:35 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 3537D234C045 for <jennifer84@example.org>; Tue, 4 Aug 2009 18:22:15 -0700 (PDT) Message-ID: <393795471.1249435335217.JavaMail.jira@brutus> Date: Tue, 4 Aug 2009 18:22:15 -0700 (PDT) From: "Konstantin Shvachko (JIRA)" <jennifer84@example.org> To: jennifer84@example.org Subject: [jira] Created: (HDFS-529) More redundant block searches in BlockManager. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org More redundant block searches in BlockManager. ---------------------------------------------- Key: HDFS-529 URL: https://issues.apache.org/jira/browse/HDFS-529 Project: Hadoop HDFS Issue Type: Improvement Components: name-node Affects Versions: 0.21.0 Reporter: Konstantin Shvachko Assignee: Konstantin Shvachko Fix For: 0.21.0 Found more redundant searches in {{BlockManager.addStoredBLock()}} and {{BlockManager.getNodes(Block)}}. The pattern here is that we first call {{BlocksMap.numNodes(Block)}} in order to determine the size of the array of data-nodes. This is one search in {{blocksMap}}. Then we call {{BlocksMap.nodeIterator(Block)}}, which also performs a search. This is all not necessary because we already have the block in the form of BlockInfo from {{blocksMap}} and do not need to search for it. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hdfsjennifer84@example.org Wed Aug 05 14:13:48 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 38627 invoked from network); 5 Aug 2009 14:13:48 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 5 Aug 2009 14:13:48 -0000 Received: (qmail 20587 invoked by uid 500); 5 Aug 2009 14:13:54 -0000 Delivered-To: jennifer84@example.org Received: (qmail 20517 invoked by uid 500); 5 Aug 2009 14:13:53 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 20488 invoked by uid 99); 5 Aug 2009 14:13:53 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Aug 2009 14:13:53 +0000 X-ASF-Spam-Status: No, hits=4.2 required=10.0 tests=HTML_MESSAGE,NO_RDNS_DOTCOM_HELO,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [83.161.120.155] (HELO mrout1.yahoo.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Aug 2009 14:13:40 +0000 Received: from SP1-EX07CAS02.ds.corp.yahoo.com (sp1-ex07cas02.ds.corp.yahoo.com [83.161.120.155]) by mrout1.yahoo.com (8.13.6/8.13.6/y.out) with ESMTP id n75EBbQe030631; Wed, 5 Aug 2009 07:11:37 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; s=serpent; d=yahoo-inc.com; c=nofws; q=dns; h=received:from:to:cc:date:subject:thread-topic: thread-index:message-id:accept-language:content-language: x-ms-has-attach:x-ms-tnef-correlator:x-cr-puzzleid:x-cr-hashedpuzzle: acceptlanguage:content-type:mime-version; b=zsDEsAEMDM6nppAyk82T/RSHSH/8w46xVZQLgFUj1Y1Go5CmHCBSjMhnmYZ2yPWZ Received: from SP1-EX07VS02.ds.corp.yahoo.com ([83.161.120.155]) by SP1-EX07CAS02.ds.corp.yahoo.com ([83.161.120.155]) with mapi; Wed, 5 Aug 2009 07:11:37 -0700 From: "Giridharan Kesavan" <jennifer84@example.org> To: "jennifer84@example.org" <jennifer84@example.org>, "jennifer84@example.org" <jennifer84@example.org>, "jennifer84@example.org" <jennifer84@example.org> CC: Nigel Daley <jennifer84@example.org>, Lee Tucker <jennifer84@example.org> Date: Wed, 5 Aug 2009 07:11:25 -0700 Subject: hudson patch test builds Thread-Topic: hudson patch test builds Thread-Index: AcoV1p4ThoeK65hHSqiyyRt04fhoqQ== Message-ID: <jennifer84@example.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-cr-puzzleid: {595F77A3-CFC7-49F6-B5D4-296627C5E304} x-cr-hashedpuzzle: cQc= EAyG JJRh JRqg Jkfh Jur/ KZc4 WLrl ZbMm Z6Xq ajg/ bJe9 eNjN iNB/ makT m8NV;4;YwBvAG0AbQBvAG4ALQBkAGUAdgBAAGgAYQBkAG8AbwBwAC4AYQBwAGEAYwBoAGUALgBvAHIAZwA7AGgAZABmAHMALQBkAGUAdgBAAGgAYQBkAG8AbwBwAC4AYQBwAGEAYwBoAGUALgBvAHIAZwA7AG0AYQBwAHIAZQBkAHUAYwBlAC0AZABlAHYAQABoAGEAbwBvAHAALgBhAHAAYQBjAGgAZQAuAG8AcgBnADsAbgBpAGcAZQBsAEAAYQBwAGEAYwBoAGUALgBvAHIAZwA=;Sosha1_v1;7;{595F77A3-CFC7-49F6-B5D4-296627C5E304};ZwBrAGUAcwBhAHYAYQBuAEAAeQBhAGgAbwBvAC0AaQBuAGMALgBjAG8AbQA=;Wed, 05 Aug 2009 14:11:25 GMT;aAB1AGQAcwBvAG4AIABwAGEAdABjAGgAIAB0AGUAcwB0ACAAYgB1AGkAbABkAHMA acceptlanguage: en-US Content-Type: multipart/alternative; boundary="_000_DD41E660026FAC43B650B91482509DD2440F127CBDSP1EX07VS02ds_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_DD41E660026FAC43B650B91482509DD2440F127CBDSP1EX07VS02ds_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Sendmail issue on hudson.zones is fixed and the patch builds are restarted. If you have changed the jira status to patch available in the last couple o= f days please resubmit your patch for hudson to pick your patch for testing= . Thanks, -Giri --_000_DD41E660026FAC43B650B91482509DD2440F127CBDSP1EX07VS02ds_-- From hdfsjennifer84@example.org Wed Aug 05 20:13:33 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 3197 invoked from network); 5 Aug 2009 20:13:32 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 5 Aug 2009 20:13:32 -0000 Received: (qmail 10613 invoked by uid 500); 5 Aug 2009 20:13:39 -0000 Delivered-To: jennifer84@example.org Received: (qmail 10499 invoked by uid 500); 5 Aug 2009 20:13:39 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 10447 invoked by uid 99); 5 Aug 2009 20:13:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Aug 2009 20:13:39 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Aug 2009 20:13:36 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id E6EB429A0019 for <jennifer84@example.org>; Wed, 5 Aug 2009 13:13:14 -0700 (PDT) Message-ID: <305934505.1249503194945.JavaMail.jira@brutus> Date: Wed, 5 Aug 2009 13:13:14 -0700 (PDT) From: "Konstantin Boudnik (JIRA)" <jennifer84@example.org> To: jennifer84@example.org Subject: [jira] Created: (HDFS-530) Refactor TestFileAppend* to remove code duplications MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Refactor TestFileAppend* to remove code duplications ---------------------------------------------------- Key: HDFS-530 URL: https://issues.apache.org/jira/browse/HDFS-530 Project: Hadoop HDFS Issue Type: Improvement Components: test Reporter: Konstantin Boudnik Clearly, TestFileAppend* were created in a copy-cat mode which produces a number of duplications. As more tests for the new append feature are going to be developed, I'd like to get rid of these duplications and allow some a better code reuse. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hdfsjennifer84@example.org Thu Aug 06 03:46:58 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 66774 invoked from network); 6 Aug 2009 03:46:57 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 6 Aug 2009 03:46:57 -0000 Received: (qmail 56688 invoked by uid 500); 6 Aug 2009 03:47:03 -0000 Delivered-To: jennifer84@example.org Received: (qmail 56486 invoked by uid 500); 6 Aug 2009 03:47:02 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 56440 invoked by uid 99); 6 Aug 2009 03:47:02 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Aug 2009 03:47:02 +0000 X-ASF-Spam-Status: No, hits=4.2 required=10.0 tests=HTML_MESSAGE,NO_RDNS_DOTCOM_HELO,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [83.161.120.155] (HELO mrout2.yahoo.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Aug 2009 03:46:51 +0000 Received: from SP1-EX07CAS02.ds.corp.yahoo.com (sp1-ex07cas02.ds.corp.yahoo.com [83.161.120.155]) by mrout2.yahoo.com (8.13.6/8.13.6/y.out) with ESMTP id n763kCj6017599; Wed, 5 Aug 2009 20:46:12 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; s=serpent; d=yahoo-inc.com; c=nofws; q=dns; h=received:from:to:date:subject:thread-topic:thread-index: message-id:accept-language:content-language:x-ms-has-attach: x-ms-tnef-correlator:acceptlanguage:content-type:mime-version; b=IXi05TZTLep17uxH3q+gc0rfSir7LLG1OvK1TJYEovpebCFzk2/lxuTrqjW8aDnQ Received: from SP1-EX07VS02.ds.corp.yahoo.com ([83.161.120.155]) by SP1-EX07CAS02.ds.corp.yahoo.com ([83.161.120.155]) with mapi; Wed, 5 Aug 2009 20:46:12 -0700 From: "Giridharan Kesavan" <jennifer84@example.org> To: "jennifer84@example.org" <jennifer84@example.org>, "jennifer84@example.org" <jennifer84@example.org>, "jennifer84@example.org" <jennifer84@example.org>, "jennifer84@example.org" <jennifer84@example.org>, "jennifer84@example.org" <jennifer84@example.org> Date: Wed, 5 Aug 2009 20:46:10 -0700 Subject: build failures on hudson zones Thread-Topic: build failures on hudson zones Thread-Index: AcoWSG/X14pPlnETRZqfvFdixt5fLQ== Message-ID: <jennifer84@example.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: multipart/alternative; boundary="_000_DD41E660026FAC43B650B91482509DD2440F127F7BSP1EX07VS02ds_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_DD41E660026FAC43B650B91482509DD2440F127F7BSP1EX07VS02ds_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Build on hudson.zones are failing as the zonestorage for hudson is full. I 've sent an email to the ASF infra team about the space issues on hudson = zones. Once the issues is resolved I would restart hudson for builds. Thanks, Giri --_000_DD41E660026FAC43B650B91482509DD2440F127F7BSP1EX07VS02ds_-- From hdfsjennifer84@example.org Thu Aug 06 04:51:00 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 75353 invoked from network); 6 Aug 2009 04:51:00 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 6 Aug 2009 04:50:59 -0000 Received: (qmail 96947 invoked by uid 500); 6 Aug 2009 04:51:05 -0000 Delivered-To: jennifer84@example.org Received: (qmail 96765 invoked by uid 500); 6 Aug 2009 04:51:05 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 96721 invoked by uid 99); 6 Aug 2009 04:51:05 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Aug 2009 04:51:05 +0000 X-ASF-Spam-Status: No, hits=3.8 required=10.0 tests=NO_RDNS_DOTCOM_HELO,SPF_NEUTRAL,SUBJ_ALL_CAPS X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [83.161.120.155] (HELO mrout2-b.corp.re1.yahoo.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Aug 2009 04:50:52 +0000 Received: from sp1-ex07cas01.ds.corp.yahoo.com (sp1-ex07cas01.ds.corp.yahoo.com [83.161.120.155]) by mrout2-b.corp.re1.yahoo.com (8.13.8/8.13.8/y.out) with ESMTP id n764o3P7088893; Wed, 5 Aug 2009 21:50:03 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; s=serpent; d=yahoo-inc.com; c=nofws; q=dns; h=received:from:to:date:subject:thread-topic:thread-index: message-id:references:in-reply-to:accept-language: content-language:x-ms-has-attach:x-ms-tnef-correlator:acceptlanguage: content-type:content-transfer-encoding:mime-version; b=uD/3/MG9AQaqbZ2ptXZlkFLzBG7oLeRypGI5Jci6DB0i094V2pkGLkuZ84ui1g1f Received: from SP1-EX07VS02.ds.corp.yahoo.com ([83.161.120.155]) by sp1-ex07cas01.ds.corp.yahoo.com ([83.161.120.155]) with mapi; Wed, 5 Aug 2009 21:50:03 -0700 From: "Giridharan Kesavan" <jennifer84@example.org> To: "jennifer84@example.org" <jennifer84@example.org>, "jennifer84@example.org" <jennifer84@example.org>, "jennifer84@example.org" <jennifer84@example.org>, "jennifer84@example.org" <jennifer84@example.org>, "jennifer84@example.org" <jennifer84@example.org> Date: Wed, 5 Aug 2009 21:50:01 -0700 Subject: BUILDS ARE BACK NORMAL Thread-Topic: BUILDS ARE BACK NORMAL Thread-Index: AcoWSG/X14pPlnETRZqfvFdixt5fLQACILZA Message-ID: <jennifer84@example.org> References: <jennifer84@example.org> In-Reply-To: <jennifer84@example.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org Restarted all the build jobs on hudson; Builds are running fine. Build failures are due to " /tmp: File system full, swap space limit excee= ded " Thanks, -Giri > -----Original Message----- > From: Giridharan Kesavan [mailto:jennifer84@example.org] > Sent: Thursday, August 06, 2009 9:16 AM > To: jennifer84@example.org; jennifer84@example.org; > jennifer84@example.org; jennifer84@example.org; zookeeper- > jennifer84@example.org > Subject: build failures on hudson zones >=20 > Build on hudson.zones are failing as the zonestorage for hudson is > full. > I 've sent an email to the ASF infra team about the space issues on > hudson zones. >=20 > Once the issues is resolved I would restart hudson for builds. >=20 > Thanks, > Giri >=20 From hdfsjennifer84@example.org Thu Aug 06 17:54:30 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 12420 invoked from network); 6 Aug 2009 17:54:30 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 6 Aug 2009 17:54:30 -0000 Received: (qmail 50149 invoked by uid 500); 6 Aug 2009 17:54:37 -0000 Delivered-To: jennifer84@example.org Received: (qmail 50058 invoked by uid 500); 6 Aug 2009 17:54:37 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 50046 invoked by uid 99); 6 Aug 2009 17:54:37 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Aug 2009 17:54:37 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Aug 2009 17:54:35 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id DF14C234C044 for <jennifer84@example.org>; Thu, 6 Aug 2009 10:54:14 -0700 (PDT) Message-ID: <303281761.1249581254898.JavaMail.jira@brutus> Date: Thu, 6 Aug 2009 10:54:14 -0700 (PDT) From: "Tsz Wo (Nicholas), SZE (JIRA)" <jennifer84@example.org> To: jennifer84@example.org Subject: [jira] Resolved: (HDFS-435) Add orthogonal fault injection mechanism/framework MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HDFS-435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-435. ----------------------------------------- Resolution: Fixed Closing this since all subtasks are fixed. > Add orthogonal fault injection mechanism/framework > -------------------------------------------------- > > Key: HDFS-435 > URL: https://issues.apache.org/jira/browse/HDFS-435 > Project: Hadoop HDFS > Issue Type: Test > Components: test > Reporter: Konstantin Boudnik > Assignee: Konstantin Boudnik > Attachments: Fault injection development guide and Framework HowTo.pdf, Fault injection development guide and Framework HowTo.pdf > > > It'd be great to have a fault injection mechanism for Hadoop. > Having such solution in place will allow to increase test coverage of error handling and recovery mechanisms, reduce reproduction time and increase the reproduction rate of the problems. > Ideally, the system has to be orthogonal to the current code and test base. E.g. faults have to be injected at build time and would have to be configurable, e.g. all faults could be turned off, or only some of them would be allowed to happen. Also, fault injection has to be separated from production build. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hdfsjennifer84@example.org Thu Aug 06 18:02:32 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 16401 invoked from network); 6 Aug 2009 18:02:31 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 6 Aug 2009 18:02:31 -0000 Received: (qmail 57135 invoked by uid 500); 6 Aug 2009 18:02:39 -0000 Delivered-To: jennifer84@example.org Received: (qmail 57046 invoked by uid 500); 6 Aug 2009 18:02:39 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 57036 invoked by uid 99); 6 Aug 2009 18:02:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Aug 2009 18:02:39 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Aug 2009 18:02:35 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id D74A6234C04B for <jennifer84@example.org>; Thu, 6 Aug 2009 11:02:14 -0700 (PDT) Message-ID: <971019825.1249581734880.JavaMail.jira@brutus> Date: Thu, 6 Aug 2009 11:02:14 -0700 (PDT) From: "Jitendra Nath Pandey (JIRA)" <jennifer84@example.org> To: jennifer84@example.org Subject: [jira] Created: (HDFS-531) Renaming of configuration keys MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Renaming of configuration keys ------------------------------ Key: HDFS-531 URL: https://issues.apache.org/jira/browse/HDFS-531 Project: Hadoop HDFS Issue Type: Improvement Reporter: Jitendra Nath Pandey Assignee: Jitendra Nath Pandey Fix For: 0.21.0 Keys in configuration files should be standardized so that key names reflect the components they are used in. For example: dfs.backup.address should be renamed to dfs.namenode.backup.address dfs.data.dir should be renamed to dfs.datanode.backup.address This change will impact both hdfs and common sources. Following convention is proposed: 1. Any key related hdfs should begin with 'dfs'. 2. Any key related to namenode, datanode or client should begin with dfs.namenode, dfs.datanode or dfs.client respectively. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hdfsjennifer84@example.org Thu Aug 06 19:33:32 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 66723 invoked from network); 6 Aug 2009 19:33:32 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 6 Aug 2009 19:33:32 -0000 Received: (qmail 82015 invoked by uid 500); 6 Aug 2009 19:33:39 -0000 Delivered-To: jennifer84@example.org Received: (qmail 81967 invoked by uid 500); 6 Aug 2009 19:33:39 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 81957 invoked by uid 99); 6 Aug 2009 19:33:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Aug 2009 19:33:39 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Aug 2009 19:33:36 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 4E779234C055 for <jennifer84@example.org>; Thu, 6 Aug 2009 12:33:15 -0700 (PDT) Message-ID: <468.594.9881.1249587195320.JavaMail.jira@brutus> Date: Thu, 6 Aug 2009 12:33:15 -0700 (PDT) From: "dhruba borthakur (JIRA)" <jennifer84@example.org> To: jennifer84@example.org Subject: [jira] Created: (HDFS-532) Allow applications to know that a read failed beucase block is missing MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Allow applications to know that a read failed beucase block is missing ---------------------------------------------------------------------- Key: HDFS-532 URL: https://issues.apache.org/jira/browse/HDFS-532 Project: Hadoop HDFS Issue Type: Improvement Reporter: dhruba borthakur Assignee: dhruba borthakur I have an application that has intelligence to retrieve data from alternate locations if HDFS cannot provide this data. This can happen when data in HDFS is corrupted or the block is missing. HDFS already throws ChecksumException if the block is corrupted and throws a generic IOException if the block is missing. I would like HDFS to throw BlockMissingException when a read request encounters a block that has no locations associated with it. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hdfsjennifer84@example.org Sat Aug 08 17:47:16 2009 Return-Path: <hdfsjennifer84@example.org> Delivered-To: jennifer84@example.org Received: (qmail 18307 invoked from network); 8 Aug 2009 17:47:15 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 8 Aug 2009 17:47:15 -0000 Received: (qmail 60704 invoked by uid 500); 8 Aug 2009 17:47:22 -0000 Delivered-To: jennifer84@example.org Received: (qmail 60616 invoked by uid 500); 8 Aug 2009 17:47:22 -0000 Mailing-List: contact jennifer84@example.org; run by ezmlm Precedence: bulk List-Help: <mailto:jennifer84@example.org> List-Unsubscribe: <mailto:jennifer84@example.org> List-Post: <mailto:jennifer84@example.org> List-Id: <hdfs-dev.hadoop.apache.org> Reply-To: jennifer84@example.org Delivered-To: mailing list jennifer84@example.org Received: (qmail 60606 invoked by uid 99); 8 Aug 2009 17:47:22 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 08 Aug 2009 17:47:22 +0000 X-ASF-Spam-Status: No, hits=-1998.5 required=10.0 tests=ALL_TRUSTED,WEIRD_PORT X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hudson.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 08 Aug 2009 17:47:17 +0000 Received: from hudson.zones.apache.org (localhost [83.161.120.155]) by hudson.zones.apache.org (8.13.8+Sun/8.13.8) with ESMTP id n78HkrTT024605 for <jennifer84@example.org>; Sat, 8 Aug 2009 13:46:54 -0400 (EDT) Date: Sat, 8 Aug 2009 17:46:44 +0000 (UTC) From: Apache Hudson Server <jennifer84@example.org> To: jennifer84@example.org Message-ID: <jennifer84@example.org> Subject: Build failed in Hudson: Hadoop-Hdfs-trunk #43 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/43/changes Changes: [szetszwo] HDFS-451. Add fault injection tests, Pipeline_Fi_06,07,14,15, for DataTransferProtocol. [szetszwo] Update hadoop-core-0.21.0-dev.jar and hadoop-core-test-0.21.0-dev.jar. ------------------------------------------ [...truncated 312630 lines...] [junit] 2009-08-08 17:14:19,643 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ... [junit] 2009-08-08 17:14:19,927 INFO datanode.DataNode (FSDataset.java:registerMBean(1417)) - Registered FSDatasetStatusMBean [junit] 2009-08-08 17:14:19,928 INFO datanode.DataNode (DataNode.java:startDataNode(326)) - Opened info server at 54191 [junit] 2009-08-08 17:14:19,928 INFO datanode.DataNode (DataXceiverServer.java:<init>(74)) - Balancing bandwith is 1048576 bytes/s [junit] 2009-08-08 17:14:19,928 INFO datanode.DirectoryScanner (DirectoryScanner.java:<init>(133)) - scan starts at 1249762895928 with interval 21600000 [junit] 2009-08-08 17:14:19,930 INFO http.HttpServer (HttpServer.java:start(425)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0 [junit] 2009-08-08 17:14:19,930 INFO http.HttpServer (HttpServer.java:start(430)) - listener.getLocalPort() returned 42641 webServer.getConnectors()[0].getLocalPort() returned 42641 [junit] 2009-08-08 17:14:19,930 INFO http.HttpServer (HttpServer.java:start(463)) - Jetty bound to port 42641 [junit] 2009-08-08 17:14:19,930 INFO mortbay.log (?:invoke(?)) - jetty-6.1.14 [junit] 2009-08-08 17:14:20,005 INFO mortbay.log (?:invoke(?)) - Started SelectChannelConnector@localhost:42641 [junit] 2009-08-08 17:14:20,006 INFO jvm.JvmMetrics (JvmMetrics.java:init(66)) - Cannot initialize JVM Metrics with processName=DataNode, sessionId=null - already initialized [junit] 2009-08-08 17:14:20,007 INFO metrics.RpcMetrics (RpcMetrics.java:<init>(58)) - Initializing RPC Metrics with hostName=DataNode, port=54116 [junit] 2009-08-08 17:14:20,007 INFO ipc.Server (Server.java:run(474)) - IPC Server Responder: starting [junit] 2009-08-08 17:14:20,007 INFO datanode.DataNode (DataNode.java:startDataNode(404)) - dnRegistration = DatanodeRegistration(vesta.apache.org:54191, storageID=, infoPort=42641, ipcPort=54116) [junit] 2009-08-08 17:14:20,007 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 0 on 54116: starting [junit] 2009-08-08 17:14:20,007 INFO ipc.Server (Server.java:run(313)) - IPC Server listener on 54116: starting [junit] 2009-08-08 17:14:20,009 INFO hdfs.StateChange (FSNamesystem.java:registerDatanode(1774)) - BLOCK* NameSystem.registerDatanode: node registration from 83.161.120.155:54191 storage DS-1647170729-83.161.120.155-54191-1249751660008 [junit] 2009-08-08 17:14:20,009 INFO net.NetworkTopology (NetworkTopology.java:add(327)) - Adding a new node: /default-rack/83.161.120.155:54191 [junit] 2009-08-08 17:14:20,054 INFO datanode.DataNode (DataNode.java:register(571)) - New storage id DS-1647170729-83.161.120.155-54191-1249751660008 is assigned to data-node 83.161.120.155:54191 [junit] 2009-08-08 17:14:20,054 INFO datanode.DataNode (DataNode.java:run(1258)) - DatanodeRegistration(83.161.120.155:54191, storageID=DS-1647170729-83.161.120.155-54191-1249751660008, infoPort=42641, ipcPort=54116)In DataNode.run, data = FSDataset{dirpath='http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/ws/trunk/build-fi/test/data/dfs/data/data3/current,/home/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build-fi/test/data/dfs/data/data4/current'} [junit] Starting DataNode 2 with dfs.data.dir: http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/ws/trunk/build-fi/test/data/dfs/data/data5,/home/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build-fi/test/data/dfs/data/data6 [junit] 2009-08-08 17:14:20,055 INFO datanode.DataNode (DataNode.java:offerService(739)) - using BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec [junit] 2009-08-08 17:14:20,062 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/ws/trunk/build-fi/test/data/dfs/data/data5 is not formatted. [junit] 2009-08-08 17:14:20,062 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ... [junit] 2009-08-08 17:14:20,092 INFO datanode.DataNode (DataNode.java:blockReport(974)) - BlockReport of 0 blocks got processed in 1 msecs [junit] 2009-08-08 17:14:20,092 INFO datanode.DataNode (DataNode.java:offerService(782)) - Starting Periodic block scanner. [junit] 2009-08-08 17:14:20,244 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/ws/trunk/build-fi/test/data/dfs/data/data6 is not formatted. [junit] 2009-08-08 17:14:20,245 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ... [junit] 2009-08-08 17:14:20,533 INFO datanode.DataNode (FSDataset.java:registerMBean(1417)) - Registered FSDatasetStatusMBean [junit] 2009-08-08 17:14:20,534 INFO datanode.DataNode (DataNode.java:startDataNode(326)) - Opened info server at 34975 [junit] 2009-08-08 17:14:20,534 INFO datanode.DataNode (DataXceiverServer.java:<init>(74)) - Balancing bandwith is 1048576 bytes/s [junit] 2009-08-08 17:14:20,535 INFO datanode.DirectoryScanner (DirectoryScanner.java:<init>(133)) - scan starts at 1249761925535 with interval 21600000 [junit] 2009-08-08 17:14:20,536 INFO http.HttpServer (HttpServer.java:start(425)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0 [junit] 2009-08-08 17:14:20,536 INFO http.HttpServer (HttpServer.java:start(430)) - listener.getLocalPort() returned 47612 webServer.getConnectors()[0].getLocalPort() returned 47612 [junit] 2009-08-08 17:14:20,536 INFO http.HttpServer (HttpServer.java:start(463)) - Jetty bound to port 47612 [junit] 2009-08-08 17:14:20,537 INFO mortbay.log (?:invoke(?)) - jetty-6.1.14 [junit] 2009-08-08 17:14:20,601 INFO mortbay.log (?:invoke(?)) - Started SelectChannelConnector@localhost:47612 [junit] 2009-08-08 17:14:20,602 INFO jvm.JvmMetrics (JvmMetrics.java:init(66)) - Cannot initialize JVM Metrics with processName=DataNode, sessionId=null - already initialized [junit] 2009-08-08 17:14:20,603 INFO metrics.RpcMetrics (RpcMetrics.java:<init>(58)) - Initializing RPC Metrics with hostName=DataNode, port=44352 [junit] 2009-08-08 17:14:20,604 INFO ipc.Server (Server.java:run(474)) - IPC Server Responder: starting [junit] 2009-08-08 17:14:20,604 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 0 on 44352: starting [junit] 2009-08-08 17:14:20,604 INFO ipc.Server (Server.java:run(313)) - IPC Server listener on 44352: starting [junit] 2009-08-08 17:14:20,605 INFO datanode.DataNode (DataNode.java:startDataNode(404)) - dnRegistration = DatanodeRegistration(vesta.apache.org:34975, storageID=, infoPort=47612, ipcPort=44352) [junit] 2009-08-08 17:14:20,606 INFO hdfs.StateChange (FSNamesystem.java:registerDatanode(1774)) - BLOCK* NameSystem.registerDatanode: node registration from 83.161.120.155:34975 storage DS-123548898-83.161.120.155-34975-1249751660605 [junit] 2009-08-08 17:14:20,606 INFO net.NetworkTopology (NetworkTopology.java:add(327)) - Adding a new node: /default-rack/83.161.120.155:34975 [junit] 2009-08-08 17:14:20,647 INFO datanode.DataNode (DataNode.java:register(571)) - New storage id DS-123548898-83.161.120.155-34975-1249751660605 is assigned to data-node 83.161.120.155:34975 [junit] 2009-08-08 17:14:20,647 INFO datanode.DataNode (DataNode.java:run(1258)) - DatanodeRegistration(83.161.120.155:34975, storageID=DS-123548898-83.161.120.155-34975-1249751660605, infoPort=47612, ipcPort=44352)In DataNode.run, data = FSDataset{dirpath='http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/ws/trunk/build-fi/test/data/dfs/data/data5/current,/home/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build-fi/test/data/dfs/data/data6/current'} [junit] 2009-08-08 17:14:20,648 INFO datanode.DataNode (DataNode.java:offerService(739)) - using BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec [junit] 2009-08-08 17:14:20,687 INFO datanode.DataNode (DataNode.java:blockReport(974)) - BlockReport of 0 blocks got processed in 1 msecs [junit] 2009-08-08 17:14:20,687 INFO datanode.DataNode (DataNode.java:offerService(782)) - Starting Periodic block scanner. [junit] 2009-08-08 17:14:20,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(114)) - ugi=hudson,hudson ip=/83.161.120.155 cmd=create src=/testPipelineFi15/foo dst=null perm=hudson:supergroup:rw-r--r-- [junit] 2009-08-08 17:14:20,749 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1303)) - BLOCK* NameSystem.allocateBlock: /testPipelineFi15/foo. blk_-5657119858028835158_1001 [junit] 2009-08-08 17:14:20,781 INFO protocol.ClientProtocolAspects (ClientProtocolAspects.aj:ajc$afterReturning$org_apache_hadoop_hdfs_protocol_ClientProtocolAspects$1$7076326d(32)) - FI: addBlock Pipeline[83.161.120.155:54191, 83.161.120.155:42259, 83.161.120.155:34975] [junit] 2009-08-08 17:14:20,782 INFO datanode.DataTransferProtocolAspects (DataTransferProtocolAspects.aj:ajc$afterReturning$org_apache_hadoop_hdfs_server_datanode_DataTransferProtocolAspects$1$8f59fdd7(50)) - FI: receiverOp WRITE_BLOCK, datanode=83.161.120.155:54191 [junit] 2009-08-08 17:14:20,783 INFO datanode.DataTransferProtocolAspects (DataTransferProtocolAspects.aj:ajc$before$org_apache_hadoop_hdfs_server_datanode_DataTransferProtocolAspects$3$3251489(70)) - FI: receiverOpWriteBlock [junit] 2009-08-08 17:14:20,783 INFO datanode.DataNode (DataXceiver.java:opWriteBlock(222)) - Receiving block blk_-5657119858028835158_1001 src: /83.161.120.155:37959 dest: /83.161.120.155:54191 [junit] 2009-08-08 17:14:20,784 INFO datanode.DataTransferProtocolAspects (DataTransferProtocolAspects.aj:ajc$afterReturning$org_apache_hadoop_hdfs_server_datanode_DataTransferProtocolAspects$1$8f59fdd7(50)) - FI: receiverOp WRITE_BLOCK, datanode=83.161.120.155:42259 [junit] 2009-08-08 17:14:20,785 INFO datanode.DataTransferProtocolAspects (DataTransferProtocolAspects.aj:ajc$before$org_apache_hadoop_hdfs_server_datanode_DataTransferProtocolAspects$3$3251489(70)) - FI: receiverOpWriteBlock [junit] 2009-08-08 17:14:20,785 INFO datanode.DataNode (DataXceiver.java:opWriteBlock(222)) - Receiving block blk_-5657119858028835158_1001 src: /83.161.120.155:46736 dest: /83.161.120.155:42259 [junit] 2009-08-08 17:14:20,787 INFO datanode.DataTransferProtocolAspects (DataTransferProtocolAspects.aj:ajc$afterReturning$org_apache_hadoop_hdfs_server_datanode_DataTransferProtocolAspects$1$8f59fdd7(50)) - FI: receiverOp WRITE_BLOCK, datanode=83.161.120.155:34975 [junit] 2009-08-08 17:14:20,787 INFO datanode.DataTransferProtocolAspects (DataTransferProtocolAspects.aj:ajc$before$org_apache_hadoop_hdfs_server_datanode_DataTransferProtocolAspects$3$3251489(70)) - FI: receiverOpWriteBlock [junit] 2009-08-08 17:14:20,787 INFO datanode.DataNode (DataXceiver.java:opWriteBlock(222)) - Receiving block blk_-5657119858028835158_1001 src: /83.161.120.155:58987 dest: /83.161.120.155:34975 [junit] 2009-08-08 17:14:20,788 INFO datanode.DataTransferProtocolAspects (DataTransferProtocolAspects.aj:ajc$afterReturning$org_apache_hadoop_hdfs_server_datanode_DataTransferProtocolAspects$2$d4f6605f(60)) - FI: statusRead SUCCESS, datanode=83.161.120.155:42259 [junit] 2009-08-08 17:14:20,788 INFO datanode.DataTransferProtocolAspects (DataTransferProtocolAspects.aj:ajc$afterReturning$org_apache_hadoop_hdfs_server_datanode_DataTransferProtocolAspects$2$d4f6605f(60)) - FI: statusRead SUCCESS, datanode=83.161.120.155:54191 [junit] 2009-08-08 17:14:20,790 INFO datanode.BlockReceiverAspects (BlockReceiverAspects.aj:ajc$before$org_apache_hadoop_hdfs_server_datanode_BlockReceiverAspects$1$4c211928(46)) - FI: callReceivePacket [junit] 2009-08-08 17:14:20,790 INFO datanode.BlockReceiverAspects (BlockReceiverAspects.aj:ajc$before$org_apache_hadoop_hdfs_server_datanode_BlockReceiverAspects$1$4c211928(46)) - FI: callReceivePacket [junit] 2009-08-08 17:14:20,790 INFO datanode.BlockReceiverAspects (BlockReceiverAspects.aj:ajc$before$org_apache_hadoop_hdfs_server_datanode_BlockReceiverAspects$1$4c211928(46)) - FI: callReceivePacket [junit] 2009-08-08 17:14:20,790 INFO datanode.BlockReceiverAspects (BlockReceiverAspects.aj:ajc$before$org_apache_hadoop_hdfs_server_datanode_BlockReceiverAspects$1$4c211928(46)) - FI: callReceivePacket [junit] 2009-08-08 17:14:20,791 INFO fi.FiTestUtil (DataTransferTestUtil.java:run(158)) - FI: testPipelineFi15, index=1, datanode=83.161.120.155:42259 [junit] 2009-08-08 17:14:20,791 INFO datanode.DataNode (BlockReceiver.java:handleMirrorOutError(185)) - DatanodeRegistration(83.161.120.155:42259, storageID=DS-1381817528-83.161.120.155-42259-1249751659354, infoPort=36286, ipcPort=41586):Exception writing block blk_-5657119858028835158_1001 to mirror 83.161.120.155:34975 [junit] org.apache.hadoop.util.DiskChecker$DiskOutOfSpaceException: FI: testPipelineFi15, index=1, datanode=83.161.120.155:42259 [junit] at org.apache.hadoop.fi.DataTransferTestUtil$DoosAction.run(DataTransferTestUtil.java:159) [junit] at org.apache.hadoop.fi.DataTransferTestUtil$DoosAction.run(DataTransferTestUtil.java:1) [junit] at org.apache.hadoop.fi.FiTestUtil$ActionContainer.run(FiTestUtil.java:66) [junit] at org.apache.hadoop.hdfs.server.datanode.BlockReceiverAspects.ajc$before$org_apache_hadoop_hdfs_server_datanode_BlockReceiverAspects$1$4c211928(BlockReceiverAspects.aj:47) [junit] at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:408) [junit] at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:532) [junit] at org.apache.hadoop.hdfs.server.datanode.DataXceiver.opWriteBlock(DataXceiver.java:339) [junit] at org.apache.hadoop.hdfs.protocol.DataTransferProtocol$Receiver.opWriteBlock(DataTransferProtocol.java:324) [junit] at org.apache.hadoop.hdfs.protocol.DataTransferProtocol$Receiver.processOp(DataTransferProtocol.java:269) [junit] at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:110) [junit] at java.lang.Thread.run(Thread.java:619) [junit] [junit] 2009-08-08 17:14:20,792 INFO datanode.DataNode (BlockReceiver.java:receiveBlock(566)) - Exception in receiveBlock for block blk_-5657119858028835158_1001 org.apache.hadoop.util.DiskChecker$DiskOutOfSpaceException: FI: testPipelineFi15, index=1, datanode=83.161.120.155:42259 [junit] 2009-08-08 17:14:20,792 INFO datanode.DataNode (BlockReceiver.java:run(907)) - PacketResponder blk_-5657119858028835158_1001 1 Exception java.io.InterruptedIOException: Interruped while waiting for IO on channel java.nio.channels.SocketChannel[connected local=/83.161.120.155:58987 remote=/83.161.120.155:34975]. 59997 millis timeout left. [junit] at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:349) [junit] at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) [junit] at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:155) [junit] at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:128) [junit] at java.io.DataInputStream.readFully(DataInputStream.java:178) [junit] at java.io.DataInputStream.readLong(DataInputStream.java:399) [junit] at org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:869) [junit] at java.lang.Thread.run(Thread.java:619) [junit] [junit] 2009-08-08 17:14:20,793 INFO datanode.DataNode (BlockReceiver.java:run(922)) - PacketResponder blk_-5657119858028835158_1001 1 : Thread is interrupted. [junit] 2009-08-08 17:14:20,793 INFO datanode.DataNode (BlockReceiver.java:run(1009)) - PacketResponder 1 for block blk_-5657119858028835158_1001 terminating [junit] 2009-08-08 17:14:20,793 INFO datanode.DataNode (DataXceiver.java:opWriteBlock(358)) - writeBlock blk_-5657119858028835158_1001 received exception org.apache.hadoop.util.DiskChecker$DiskOutOfSpaceException: FI: testPipelineFi15, index=1, datanode=83.161.120.155:42259 [junit] 2009-08-08 17:14:20,793 ERROR datanode.DataNode (DataXceiver.java:run(112)) - DatanodeRegistration(83.161.120.155:42259, storageID=DS-1381817528-83.161.120.155-42259-1249751659354, infoPort=36286, ipcPort=41586):DataXceiver [junit] org.apache.hadoop.util.DiskChecker$DiskOutOfSpaceException: FI: testPipelineFi15, index=1, datanode=83.161.120.155:42259 [junit] at org.apache.hadoop.fi.DataTransferTestUtil$DoosAction.run(DataTransferTestUtil.java:159) [junit] at org.apache.hadoop.fi.DataTransferTestUtil$DoosAction.run(DataTransferTestUtil.java:1) [junit] at org.apache.hadoop.fi.FiTestUtil$ActionContainer.run(FiTestUtil.java:66) [junit] at org.apache.hadoop.hdfs.server.datanode.BlockReceiverAspects.ajc$before$org_apache_hadoop_hdfs_server_datanode_BlockReceiverAspects$1$4c211928(BlockReceiverAspects.aj:47) [junit] at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:408) [junit] at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:532) [junit] at org.apache.hadoop.hdfs.server.datanode.DataXceiver.opWriteBlock(DataXceiver.java:339) [junit] at org.apache.hadoop.hdfs.protocol.DataTransferProtocol$Receiver.opWriteBlock(DataTransferProtocol.java:324) [junit] at org.apache.hadoop.hdfs.protocol.DataTransferProtocol$Receiver.processOp(DataTransferProtocol.java:269) [junit] at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:110) [junit] at java.lang.Thread.run(Thread.java:619) [junit] 2009-08-08 17:14:20,793 INFO datanode.DataNode (BlockReceiver.java:run(907)) - PacketResponder blk_-5657119858028835158_1001 2 Exception java.io.EOFException [junit] at java.io.DataInputStream.readFully(DataInputStream.java:180) [junit] at java.io.DataInputStream.readLong(DataInputStream.java:399) [junit] at org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:869) [junit] at java.lang.Thread.run(Thread.java:619) [junit] [junit] 2009-08-08 17:14:20,793 INFO datanode.DataNode (BlockReceiver.java:receiveBlock(566)) - Exception in receiveBlock for block blk_-5657119858028835158_1001 java.io.EOFException: while trying to read 65557 bytes [junit] 2009-08-08 17:14:20,794 INFO datanode.DataNode (BlockReceiver.java:run(1009)) - PacketResponder 2 for block blk_-5657119858028835158_1001 terminating [junit] 2009-08-08 17:14:20,794 INFO datanode.DataNode (BlockReceiver.java:lastDataNodeRun(779)) - PacketResponder 0 for block blk_-5657119858028835158_1001 Interrupted. [junit] 2009-08-08 17:14:20,794 INFO datanode.DataNode (BlockReceiver.java:lastDataNodeRun(843)) - PacketResponder 0 for block blk_-5657119858028835158_1001 terminating [junit] 2009-08-08 17:14:20,794 INFO datanode.DataNode (DataXceiver.java:opWriteBlock(358)) - writeBlock blk_-5657119858028835158_1001 received exception java.io.EOFException: while trying to read 65557 bytes [junit] 2009-08-08 17:14:20,794 WARN hdfs.DFSClient (DFSClient.java:run(2593)) - DFSOutputStream ResponseProcessor exception for block blk_-5657119858028835158_1001java.io.IOException: Bad response ERROR for block blk_-5657119858028835158_1001 from datanode 83.161.120.155:42259 [junit] at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer$ResponseProcessor.run(DFSClient.java:2573) [junit] [junit] 2009-08-08 17:14:20,795 WARN hdfs.DFSClient (DFSClient.java:processDatanodeError(2622)) - Error Recovery for block blk_-5657119858028835158_1001 bad datanode[1] 83.161.120.155:42259 [junit] 2009-08-08 17:14:20,795 ERROR datanode.DataNode (DataXceiver.java:run(112)) - DatanodeRegistration(83.161.120.155:34975, storageID=DS-123548898-83.161.120.155-34975-1249751660605, infoPort=47612, ipcPort=44352):DataXceiver [junit] java.io.EOFException: while trying to read 65557 bytes [junit] at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.readToBuf(BlockReceiver.java:271) [junit] at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.readNextPacket(BlockReceiver.java:315) [junit] at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:379) [junit] at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:532) [junit] at org.apache.hadoop.hdfs.server.datanode.DataXceiver.opWriteBlock(DataXceiver.java:339) [junit] at org.apache.hadoop.hdfs.protocol.DataTransferProtocol$Receiver.opWriteBlock(DataTransferProtocol.java:324) [junit] at org.apache.hadoop.hdfs.protocol.DataTransferProtocol$Receiver.processOp(DataTransferProtocol.java:269) [junit] at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:110) [junit] at java.lang.Thread.run(Thread.java:619) [junit] 2009-08-08 17:14:20,795 WARN hdfs.DFSClient (DFSClient.java:processDatanodeError(2666)) - Error Recovery for block blk_-5657119858028835158_1001 in pipeline 83.161.120.155:54191, 83.161.120.155:42259, 83.161.120.155:34975: bad datanode 83.161.120.155:42259 [junit] 2009-08-08 17:14:20,798 INFO datanode.DataNode (DataNode.java:logRecoverBlock(1700)) - Client calls recoverBlock(block=blk_-5657119858028835158_1001, targets=[83.161.120.155:54191, 83.161.120.155:34975]) [junit] 2009-08-08 17:14:20,802 INFO datanode.DataNode (DataNode.java:updateBlock(1510)) - oldblock=blk_-5657119858028835158_1001(length=1), newblock=blk_-5657119858028835158_1002(length=0), datanode=83.161.120.155:54191 [junit] 2009-08-08 17:14:20,803 INFO datanode.DataNode (DataNode.java:updateBlock(1510)) - oldblock=blk_-5657119858028835158_1001(length=0), newblock=blk_-5657119858028835158_1002(length=0), datanode=83.161.120.155:34975 [junit] 2009-08-08 17:14:20,804 INFO namenode.FSNamesystem (FSNamesystem.java:commitBlockSynchronization(1613)) - commitBlockSynchronization(lastblock=blk_-5657119858028835158_1001, newgenerationstamp=1002, newlength=0, newtargets=[83.161.120.155:54191, 83.161.120.155:34975], closeFile=false, deleteBlock=false) [junit] 2009-08-08 17:14:20,804 INFO namenode.FSNamesystem (FSNamesystem.java:commitBlockSynchronization(1677)) - commitBlockSynchronization(blk_-5657119858028835158_1002) successful [junit] 2009-08-08 17:14:20,805 INFO datanode.DataTransferProtocolAspects (DataTransferProtocolAspects.aj:ajc$afterReturning$org_apache_hadoop_hdfs_server_datanode_DataTransferProtocolAspects$1$8f59fdd7(50)) - FI: receiverOp WRITE_BLOCK, datanode=83.161.120.155:54191 [junit] 2009-08-08 17:14:20,806 INFO datanode.DataTransferProtocolAspects (DataTransferProtocolAspects.aj:ajc$before$org_apache_hadoop_hdfs_server_datanode_DataTransferProtocolAspects$3$3251489(70)) - FI: receiverOpWriteBlock [junit] 2009-08-08 17:14:20,806 INFO datanode.DataNode (DataXceiver.java:opWriteBlock(222)) - Receiving block blk_-5657119858028835158_1002 src: /83.161.120.155:37964 dest: /83.161.120.155:54191 [junit] 2009-08-08 17:14:20,806 INFO datanode.DataNode (FSDataset.java:writeToBlock(1011)) - Reopen already-open Block for append blk_-5657119858028835158_1002 [junit] 2009-08-08 17:14:20,807 INFO datanode.DataTransferProtocolAspects (DataTransferProtocolAspects.aj:ajc$afterReturning$org_apache_hadoop_hdfs_server_datanode_DataTransferProtocolAspects$1$8f59fdd7(50)) - FI: receiverOp WRITE_BLOCK, datanode=83.161.120.155:34975 [junit] 2009-08-08 17:14:20,807 INFO datanode.DataTransferProtocolAspects (DataTransferProtocolAspects.aj:ajc$before$org_apache_hadoop_hdfs_server_datanode_DataTransferProtocolAspects$3$3251489(70)) - FI: receiverOpWriteBlock [junit] 2009-08-08 17:14:20,807 INFO datanode.DataNode (DataXceiver.java:opWriteBlock(222)) - Receiving block blk_-5657119858028835158_1002 src: /83.161.120.155:58991 dest: /83.161.120.155:34975 [junit] 2009-08-08 17:14:20,807 INFO datanode.DataNode (FSDataset.java:writeToBlock(1011)) - Reopen already-open Block for append blk_-5657119858028835158_1002 [junit] 2009-08-08 17:14:20,808 INFO datanode.DataTransferProtocolAspects (DataTransferProtocolAspects.aj:ajc$afterReturning$org_apache_hadoop_hdfs_server_datanode_DataTransferProtocolAspects$2$d4f6605f(60)) - FI: statusRead SUCCESS, datanode=83.161.120.155:54191 [junit] 2009-08-08 17:14:20,809 INFO datanode.BlockReceiverAspects (BlockReceiverAspects.aj:ajc$before$org_apache_hadoop_hdfs_server_datanode_BlockReceiverAspects$1$4c211928(46)) - FI: callReceivePacket [junit] 2009-08-08 17:14:20,809 INFO datanode.BlockReceiverAspects (BlockReceiverAspects.aj:ajc$before$org_apache_hadoop_hdfs_server_datanode_BlockReceiverAspects$1$4c211928(46)) - FI: callReceivePacket [junit] 2009-08-08 17:14:20,809 INFO datanode.BlockReceiverAspects (BlockReceiverAspects.aj:ajc$before$org_apache_hadoop_hdfs_server_datanode_BlockReceiverAspects$1$4c211928(46)) - FI: callReceivePacket [junit] 2009-08-08 17:14:20,809 INFO datanode.BlockReceiverAspects (BlockReceiverAspects.aj:ajc$before$org_apache_hadoop_hdfs_server_datanode_BlockReceiverAspects$1$4c211928(46)) - FI: callReceivePacket [junit] 2009-08-08 17:14:20,809 INFO datanode.BlockReceiverAspects (BlockReceiverAspects.aj:ajc$before$org_apache_hadoop_hdfs_server_datanode_BlockReceiverAspects$1$4c211928(46)) - FI: callReceivePacket [junit] 2009-08-08 17:14:20,811 INFO DataNode.clienttrace (BlockReceiver.java:lastDataNodeRun(819)) - src: /83.161.120.155:58991, dest: /83.161.120.155:34975, bytes: 1, op: HDFS_WRITE, cliID: DFSClient_-1504818771, offset: 0, srvID: DS-123548898-83.161.120.155-34975-1249751660605, blockid: blk_-5657119858028835158_1002, duration: 2370502 [junit] 2009-08-08 17:14:20,811 INFO datanode.DataNode (BlockReceiver.java:lastDataNodeRun(843)) - PacketResponder 0 for block blk_-5657119858028835158_1002 terminating [junit] 2009-08-08 17:14:20,851 INFO hdfs.StateChange (BlockManager.java:addStoredBlock(950)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 83.161.120.155:34975 is added to blk_-5657119858028835158_1002 size 1 [junit] 2009-08-08 17:14:20,852 INFO DataNode.clienttrace (BlockReceiver.java:run(945)) - src: /83.161.120.155:37964, dest: /83.161.120.155:54191, bytes: 1, op: HDFS_WRITE, cliID: DFSClient_-1504818771, offset: 0, srvID: DS-1647170729-83.161.120.155-54191-1249751660008, blockid: blk_-5657119858028835158_1002, duration: 3023379 [junit] 2009-08-08 17:14:20,852 INFO hdfs.StateChange (BlockManager.java:addStoredBlock(950)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 83.161.120.155:54191 is added to blk_-5657119858028835158_1002 size 1 [junit] 2009-08-08 17:14:20,852 INFO datanode.DataNode (BlockReceiver.java:run(1009)) - PacketResponder 1 for block blk_-5657119858028835158_1002 terminating [junit] 2009-08-08 17:14:20,854 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1269)) - DIR* NameSystem.completeFile: file /testPipelineFi15/foo is closed by DFSClient_-1504818771 [junit] 2009-08-08 17:14:20,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(114)) - ugi=hudson,hudson ip=/83.161.120.155 cmd=open src=/testPipelineFi15/foo dst=null perm=null [junit] 2009-08-08 17:14:20,865 INFO datanode.DataTransferProtocolAspects (DataTransferProtocolAspects.aj:ajc$afterReturning$org_apache_hadoop_hdfs_server_datanode_DataTransferProtocolAspects$1$8f59fdd7(50)) - FI: receiverOp READ_BLOCK, datanode=83.161.120.155:54191 [junit] Shutting down the Mini HDFS Cluster [junit] Shutting down DataNode 2 [junit] 2009-08-08 17:14:20,866 INFO DataNode.clienttrace (BlockSender.java:sendBlock(417)) - src: /83.161.120.155:54191, dest: /83.161.120.155:37966, bytes: 5, op: HDFS_READ, cliID: DFSClient_-1504818771, offset: 0, srvID: DS-1647170729-83.161.120.155-54191-1249751660008, blockid: blk_-5657119858028835158_1002, duration: 234440 [junit] 2009-08-08 17:14:20,867 INFO datanode.DataTransferProtocolAspects (DataTransferProtocolAspects.aj:ajc$afterReturning$org_apache_hadoop_hdfs_server_datanode_DataTransferProtocolAspects$2$d4f6605f(60)) - FI: statusRead CHECKSUM_OK, datanode=83.161.120.155:54191 [junit] 2009-08-08 17:14:20,968 INFO ipc.Server (Server.java:stop(1103)) - Stopping server on 44352 [junit] 2009-08-08 17:14:20,968 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 0 on 44352: exiting [junit] 2009-08-08 17:14:20,969 INFO ipc.Server (Server.java:run(539)) - Stopping IPC Server Responder [junit] 2009-08-08 17:14:20,969 INFO datanode.DataNode (DataNode.java:shutdown(643)) - Waiting for threadgroup to exit, active threads is 1 [junit] 2009-08-08 17:14:20,969 WARN datanode.DataNode (DataXceiverServer.java:run(137)) - DatanodeRegistration(83.161.120.155:34975, storageID=DS-123548898-83.161.120.155-34975-1249751660605, infoPort=47612, ipcPort=44352):DataXceiveServer: java.nio.channels.AsynchronousCloseException [junit] at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185) [junit] at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152) [junit] at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84) [junit] at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:130) [junit] at java.lang.Thread.run(Thread.java:619) [junit] [junit] 2009-08-08 17:14:20,970 INFO ipc.Server (Server.java:run(352)) - Stopping IPC Server listener on 44352 [junit] 2009-08-08 17:14:20,972 INFO datanode.DataNode (DataNode.java:shutdown(643)) - Waiting for threadgroup to exit, active threads is 0 [junit] 2009-08-08 17:14:20,972 INFO datanode.DataBlockScanner (DataBlockScanner.java:run(616)) - Exiting DataBlockScanner thread. [junit] 2009-08-08 17:14:20,972 INFO datanode.DataNode (DataNode.java:run(1278)) - DatanodeRegistration(83.161.120.155:34975, storageID=DS-123548898-83.161.120.155-34975-1249751660605, infoPort=47612, ipcPort=44352):Finishing DataNode in: FSDataset{dirpath='http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/ws/trunk/build-fi/test/data/dfs/data/data5/current,/home/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build-fi/test/data/dfs/data/data6/current'} [junit] 2009-08-08 17:14:20,972 INFO ipc.Server (Server.java:stop(1103)) - Stopping server on 44352 [junit] 2009-08-08 17:14:20,973 INFO datanode.DataNode (DataNode.java:shutdown(643)) - Waiting for threadgroup to exit, active threads is 0 [junit] Shutting down DataNode 1 [junit] 2009-08-08 17:14:21,075 INFO ipc.Server (Server.java:stop(1103)) - Stopping server on 54116 [junit] 2009-08-08 17:14:21,075 INFO ipc.Server (Server.java:run(352)) - Stopping IPC Server listener on 54116 [junit] 2009-08-08 17:14:21,075 INFO ipc.Server (Server.java:run(539)) - Stopping IPC Server Responder [junit] 2009-08-08 17:14:21,076 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 0 on 54116: exiting [junit] 2009-08-08 17:14:21,076 INFO datanode.DataNode (DataNode.java:shutdown(643)) - Waiting for threadgroup to exit, active threads is 1 [junit] 2009-08-08 17:14:21,075 WARN datanode.DataNode (DataXceiverServer.java:run(137)) - DatanodeRegistration(83.161.120.155:54191, storageID=DS-1647170729-83.161.120.155-54191-1249751660008, infoPort=42641, ipcPort=54116):DataXceiveServer: java.nio.channels.AsynchronousCloseException [junit] at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185) [junit] at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152) [junit] at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84) [junit] at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:130) [junit] at java.lang.Thread.run(Thread.java:619) [junit] [junit] 2009-08-08 17:14:21,077 INFO datanode.DataBlockScanner (DataBlockScanner.java:run(616)) - Exiting DataBlockScanner thread. [junit] 2009-08-08 17:14:21,077 INFO datanode.DataNode (DataNode.java:run(1278)) - DatanodeRegistration(83.161.120.155:54191, storageID=DS-1647170729-83.161.120.155-54191-1249751660008, infoPort=42641, ipcPort=54116):Finishing DataNode in: FSDataset{dirpath='http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/ws/trunk/build-fi/test/data/dfs/data/data3/current,/home/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build-fi/test/data/dfs/data/data4/current'} [junit] 2009-08-08 17:14:21,077 INFO ipc.Server (Server.java:stop(1103)) - Stopping server on 54116 [junit] 2009-08-08 17:14:21,077 INFO datanode.DataNode (DataNode.java:shutdown(643)) - Waiting for threadgroup to exit, active threads is 0 [junit] Shutting down DataNode 0 [junit] 2009-08-08 17:14:21,116 INFO ipc.Server (Server.java:stop(1103)) - Stopping server on 41586 [junit] 2009-08-08 17:14:21,116 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 0 on 41586: exiting [junit] 2009-08-08 17:14:21,117 INFO ipc.Server (Server.java:run(352)) - Stopping IPC Server listener on 41586 [junit] 2009-08-08 17:14:21,117 INFO datanode.DataNode (DataNode.java:shutdown(643)) - Waiting for threadgroup to exit, active threads is 1 [junit] 2009-08-08 17:14:21,117 INFO ipc.Server (Server.java:run(539)) - Stopping IPC Server Responder [junit] 2009-08-08 17:14:21,117 WARN datanode.DataNode (DataXceiverServer.java:run(137)) - DatanodeRegistration(83.161.120.155:42259, storageID=DS-1381817528-83.161.120.155-42259-1249751659354, infoPort=36286, ipcPort=41586):DataXceiveServer: java.nio.channels.AsynchronousCloseException [junit] at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185) [junit] at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152) [junit] at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84) [junit] at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:130) [junit] at java.lang.Thread.run(Thread.java:619) [junit] [junit] 2009-08-08 17:14:21,119 INFO datanode.DataNode (DataNode.java:shutdown(643)) - Waiting for threadgroup to exit, active threads is 0 [junit] 2009-08-08 17:14:21,120 INFO datanode.DataBlockScanner (DataBlockScanner.java:run(616)) - Exiting DataBlockScanner
{'source': 'Apache Software Foundation Public Mail Archives'}