From hive-amber38@example.com Wed Apr 01 01:12:13 2009 Return-Path: <hive-amber38@example.com> Delivered-To: amber38@example.com Received: (qmail 56514 invoked from network); 1 Apr 2009 01:12:13 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2009 01:12:13 -0000 Received: (qmail 21237 invoked by uid 500); 1 Apr 2009 01:12:13 -0000 Delivered-To: amber38@example.com Received: (qmail 21194 invoked by uid 500); 1 Apr 2009 01:12:13 -0000 Mailing-List: contact amber38@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:amber38@example.com> List-Unsubscribe: <mailto:amber38@example.com> List-Post: <mailto:amber38@example.com> List-Id: <hive-dev.hadoop.apache.org> Reply-To: amber38@example.com Delivered-To: mailing list amber38@example.com Received: (qmail 21184 invoked by uid 99); 1 Apr 2009 01:12:13 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 01:12:13 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 01:12:11 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 7C9F3234C003 for <amber38@example.com>; Tue, 31 Mar 2009 18:11:50 -0700 (PDT) Message-ID: <1142258749.1238548310495.JavaMail.jira@brutus> Date: Tue, 31 Mar 2009 18:11:50 -0700 (PDT) From: "Namit Jain (JIRA)" <amber38@example.com> To: amber38@example.com Subject: [jira] Created: (HIVE-382) for hash aggr, purge the hash table as you go along MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org for hash aggr, purge the hash table as you go along --------------------------------------------------- Key: HIVE-382 URL: https://issues.apache.org/jira/browse/HIVE-382 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Reporter: Namit Jain Assignee: Namit Jain for hash aggr, purge the hash table as you go along -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hive-amber38@example.com Wed Apr 01 03:05:14 2009 Return-Path: <hive-amber38@example.com> Delivered-To: amber38@example.com Received: (qmail 4527 invoked from network); 1 Apr 2009 03:05:14 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2009 03:05:14 -0000 Received: (qmail 2485 invoked by uid 500); 1 Apr 2009 03:05:14 -0000 Delivered-To: amber38@example.com Received: (qmail 2424 invoked by uid 500); 1 Apr 2009 03:05:14 -0000 Mailing-List: contact amber38@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:amber38@example.com> List-Unsubscribe: <mailto:amber38@example.com> List-Post: <mailto:amber38@example.com> List-Id: <hive-dev.hadoop.apache.org> Reply-To: amber38@example.com Delivered-To: mailing list amber38@example.com Received: (qmail 2412 invoked by uid 99); 1 Apr 2009 03:05:13 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 03:05:13 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 03:05:12 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id DFBEA234C003 for <amber38@example.com>; Tue, 31 Mar 2009 20:04:50 -0700 (PDT) Message-ID: <345350579.1238555090902.JavaMail.jira@brutus> Date: Tue, 31 Mar 2009 20:04:50 -0700 (PDT) From: "Richard Lee (JIRA)" <amber38@example.com> To: amber38@example.com Subject: [jira] Updated: (HIVE-309) FunctionRegistry should allow loading UDFs and UDAFs from property file In-Reply-To: <832509378.1235696161904.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HIVE-309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Lee updated HIVE-309: ----------------------------- Attachment: hive-external-functions4.diff I forgot to svn add a couple files in my previous diff... so the test cases didn't make it in. this one should fix that. added some garbage entries into the properties file to verify that broken entries get ignored. > FunctionRegistry should allow loading UDFs and UDAFs from property file > ----------------------------------------------------------------------- > > Key: HIVE-309 > URL: https://issues.apache.org/jira/browse/HIVE-309 > Project: Hadoop Hive > Issue Type: Improvement > Components: Query Processor > Reporter: Richard Lee > Attachments: hive-external-functions-2.diff, hive-external-functions.diff, hive-external-functions2.diff, hive-external-functions3.diff, hive-external-functions4.diff > > > FunctionRegistry.java hard code all UDF, UDAF definitions in a static initializer. There is no way to add new functions without directly modifying this file. > FunctionRegistry SHOULD look for a property file in which new functions and their implementations can be specified. This will allow third parties to extend hive without maintaining patches against the codebase. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hive-amber38@example.com Wed Apr 01 05:23:13 2009 Return-Path: <hive-amber38@example.com> Delivered-To: amber38@example.com Received: (qmail 27921 invoked from network); 1 Apr 2009 05:23:13 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2009 05:23:13 -0000 Received: (qmail 98085 invoked by uid 500); 1 Apr 2009 05:23:12 -0000 Delivered-To: amber38@example.com Received: (qmail 97973 invoked by uid 500); 1 Apr 2009 05:23:12 -0000 Mailing-List: contact amber38@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:amber38@example.com> List-Unsubscribe: <mailto:amber38@example.com> List-Post: <mailto:amber38@example.com> List-Id: <hive-dev.hadoop.apache.org> Reply-To: amber38@example.com Delivered-To: mailing list amber38@example.com Received: (qmail 97928 invoked by uid 99); 1 Apr 2009 05:23:12 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 05:23:12 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 05:23:11 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 60EE2234C041 for <amber38@example.com>; Tue, 31 Mar 2009 22:22:51 -0700 (PDT) Message-ID: <451216733.1238563371396.JavaMail.jira@brutus> Date: Tue, 31 Mar 2009 22:22:51 -0700 (PDT) From: "Namit Jain (JIRA)" <amber38@example.com> To: amber38@example.com Subject: [jira] Updated: (HIVE-382) for hash aggr, purge the hash table as you go along In-Reply-To: <1142258749.1238548310495.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HIVE-382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-382: ---------------------------- Status: Patch Available (was: Open) > for hash aggr, purge the hash table as you go along > --------------------------------------------------- > > Key: HIVE-382 > URL: https://issues.apache.org/jira/browse/HIVE-382 > Project: Hadoop Hive > Issue Type: Bug > Components: Query Processor > Reporter: Namit Jain > Assignee: Namit Jain > Attachments: hive.382.1.patch > > > for hash aggr, purge the hash table as you go along -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hive-amber38@example.com Wed Apr 01 05:23:14 2009 Return-Path: <hive-amber38@example.com> Delivered-To: amber38@example.com Received: (qmail 27982 invoked from network); 1 Apr 2009 05:23:14 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2009 05:23:14 -0000 Received: (qmail 98370 invoked by uid 500); 1 Apr 2009 05:23:14 -0000 Delivered-To: amber38@example.com Received: (qmail 98308 invoked by uid 500); 1 Apr 2009 05:23:14 -0000 Mailing-List: contact amber38@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:amber38@example.com> List-Unsubscribe: <mailto:amber38@example.com> List-Post: <mailto:amber38@example.com> List-Id: <hive-dev.hadoop.apache.org> Reply-To: amber38@example.com Delivered-To: mailing list amber38@example.com Received: (qmail 98294 invoked by uid 99); 1 Apr 2009 05:23:14 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 05:23:14 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 05:23:12 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 48DD2234C003 for <amber38@example.com>; Tue, 31 Mar 2009 22:22:51 -0700 (PDT) Message-ID: <1611956848.1238563371283.JavaMail.jira@brutus> Date: Tue, 31 Mar 2009 22:22:51 -0700 (PDT) From: "Namit Jain (JIRA)" <amber38@example.com> To: amber38@example.com Subject: [jira] Updated: (HIVE-382) for hash aggr, purge the hash table as you go along In-Reply-To: <1142258749.1238548310495.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HIVE-382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-382: ---------------------------- Attachment: hive.382.1.patch > for hash aggr, purge the hash table as you go along > --------------------------------------------------- > > Key: HIVE-382 > URL: https://issues.apache.org/jira/browse/HIVE-382 > Project: Hadoop Hive > Issue Type: Bug > Components: Query Processor > Reporter: Namit Jain > Assignee: Namit Jain > Attachments: hive.382.1.patch > > > for hash aggr, purge the hash table as you go along -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hive-amber38@example.com Wed Apr 01 06:13:36 2009 Return-Path: <hive-amber38@example.com> Delivered-To: amber38@example.com Received: (qmail 65191 invoked from network); 1 Apr 2009 06:13:36 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2009 06:13:36 -0000 Received: (qmail 28289 invoked by uid 500); 1 Apr 2009 06:13:36 -0000 Delivered-To: amber38@example.com Received: (qmail 28231 invoked by uid 500); 1 Apr 2009 06:13:36 -0000 Mailing-List: contact amber38@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:amber38@example.com> List-Unsubscribe: <mailto:amber38@example.com> List-Post: <mailto:amber38@example.com> List-Id: <hive-dev.hadoop.apache.org> Reply-To: amber38@example.com Delivered-To: mailing list amber38@example.com Received: (qmail 28221 invoked by uid 99); 1 Apr 2009 06:13:36 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 06:13:36 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 06:13:34 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 2C0A1234C003 for <amber38@example.com>; Tue, 31 Mar 2009 23:13:13 -0700 (PDT) Message-ID: <1606069716.1238566393157.JavaMail.jira@brutus> Date: Tue, 31 Mar 2009 23:13:13 -0700 (PDT) From: "Raghotham Murthy (JIRA)" <amber38@example.com> To: amber38@example.com Subject: [jira] Commented: (HIVE-382) for hash aggr, purge the hash table as you go along In-Reply-To: <1142258749.1238548310495.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HIVE-382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694402#action_12694402 ] Raghotham Murthy commented on HIVE-382: --------------------------------------- a few things: 1. Its not very apparently what kind of memory savings result with this change. is there a way to add a test for that? 2. do you need the clear() call at the end of the loop? 3. can you change warn to debug or info? > for hash aggr, purge the hash table as you go along > --------------------------------------------------- > > Key: HIVE-382 > URL: https://issues.apache.org/jira/browse/HIVE-382 > Project: Hadoop Hive > Issue Type: Bug > Components: Query Processor > Reporter: Namit Jain > Assignee: Namit Jain > Attachments: hive.382.1.patch > > > for hash aggr, purge the hash table as you go along -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hive-amber38@example.com Wed Apr 01 06:40:40 2009 Return-Path: <hive-amber38@example.com> Delivered-To: amber38@example.com Received: (qmail 82952 invoked from network); 1 Apr 2009 06:40:39 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2009 06:40:39 -0000 Received: (qmail 48284 invoked by uid 500); 1 Apr 2009 06:40:39 -0000 Delivered-To: amber38@example.com Received: (qmail 48223 invoked by uid 500); 1 Apr 2009 06:40:39 -0000 Mailing-List: contact amber38@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:amber38@example.com> List-Unsubscribe: <mailto:amber38@example.com> List-Post: <mailto:amber38@example.com> List-Id: <hive-dev.hadoop.apache.org> Reply-To: amber38@example.com Delivered-To: mailing list amber38@example.com Received: (qmail 48213 invoked by uid 99); 1 Apr 2009 06:40:39 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 06:40:39 +0000 X-ASF-Spam-Status: No, hits=-4.0 required=10.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of amber38@example.com designates 83.161.120.155 as permitted sender) Received: from [83.161.120.155] (HELO mx-out.facebook.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 06:40:33 +0000 Received: from [83.161.120.155] ([83.161.120.155:53843] helo=facebook.com) by mta004.snc1.facebook.com (envelope-from <amber38@example.com>) (ecelerity 83.161.120.155 r(28805/28844)) with ESMTP id 15/90-14841-C4C03D94; Tue, 31 Mar 2009 23:40:12 -0700 Received: by devbuild002.snc1.facebook.com (Postfix, from userid 1369) id 45C90C381E1; Tue, 31 Mar 2009 23:40:12 -0700 (PDT) To: amber38@example.com Subject: JIRA_hive.382.1.patch_UNIT_TEST_SUCCEEDED Message-Id: <amber38@example.com> Date: Tue, 31 Mar 2009 23:40:12 -0700 (PDT) From: amber38@example.com (Murli Varadachari) X-Virus-Checked: Checked by ClamAV on apache.org SUCCESS: BUILD AND UNIT TEST using PATCH hive.382.1.patch PASSED!! From hive-amber38@example.com Wed Apr 01 12:25:38 2009 Return-Path: <hive-amber38@example.com> Delivered-To: amber38@example.com Received: (qmail 83326 invoked from network); 1 Apr 2009 12:25:38 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2009 12:25:38 -0000 Received: (qmail 98804 invoked by uid 500); 1 Apr 2009 12:25:37 -0000 Delivered-To: amber38@example.com Received: (qmail 98783 invoked by uid 500); 1 Apr 2009 12:25:37 -0000 Mailing-List: contact amber38@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:amber38@example.com> List-Unsubscribe: <mailto:amber38@example.com> List-Post: <mailto:amber38@example.com> List-Id: <hive-dev.hadoop.apache.org> Reply-To: amber38@example.com Delivered-To: mailing list amber38@example.com Received: (qmail 98773 invoked by uid 99); 1 Apr 2009 12:25:37 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 12:25:37 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 12:25:37 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id B2D0E234C003 for <amber38@example.com>; Wed, 1 Apr 2009 05:25:16 -0700 (PDT) Message-ID: <1650988445.1238588716717.JavaMail.jira@brutus> Date: Wed, 1 Apr 2009 05:25:16 -0700 (PDT) From: "Ashish Thusoo (JIRA)" <amber38@example.com> To: amber38@example.com Subject: [jira] Assigned: (HIVE-309) FunctionRegistry should allow loading UDFs and UDAFs from property file In-Reply-To: <832509378.1235696161904.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HIVE-309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo reassigned HIVE-309: ---------------------------------- Assignee: Richard Lee > FunctionRegistry should allow loading UDFs and UDAFs from property file > ----------------------------------------------------------------------- > > Key: HIVE-309 > URL: https://issues.apache.org/jira/browse/HIVE-309 > Project: Hadoop Hive > Issue Type: Improvement > Components: Query Processor > Reporter: Richard Lee > Assignee: Richard Lee > Attachments: hive-external-functions-2.diff, hive-external-functions.diff, hive-external-functions2.diff, hive-external-functions3.diff, hive-external-functions4.diff > > > FunctionRegistry.java hard code all UDF, UDAF definitions in a static initializer. There is no way to add new functions without directly modifying this file. > FunctionRegistry SHOULD look for a property file in which new functions and their implementations can be specified. This will allow third parties to extend hive without maintaining patches against the codebase. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hive-amber38@example.com Wed Apr 01 12:37:42 2009 Return-Path: <hive-amber38@example.com> Delivered-To: amber38@example.com Received: (qmail 89369 invoked from network); 1 Apr 2009 12:37:42 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2009 12:37:42 -0000 Received: (qmail 14156 invoked by uid 500); 1 Apr 2009 12:37:42 -0000 Delivered-To: amber38@example.com Received: (qmail 14127 invoked by uid 500); 1 Apr 2009 12:37:42 -0000 Mailing-List: contact amber38@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:amber38@example.com> List-Unsubscribe: <mailto:amber38@example.com> List-Post: <mailto:amber38@example.com> List-Id: <hive-dev.hadoop.apache.org> Reply-To: amber38@example.com Delivered-To: mailing list amber38@example.com Received: (qmail 14117 invoked by uid 99); 1 Apr 2009 12:37:42 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 12:37:42 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 12:37:40 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id B50DE234C003 for <amber38@example.com>; Wed, 1 Apr 2009 05:37:18 -0700 (PDT) Message-ID: <2011135921.1238589438726.JavaMail.jira@brutus> Date: Wed, 1 Apr 2009 05:37:18 -0700 (PDT) From: "Ashish Thusoo (JIRA)" <amber38@example.com> To: amber38@example.com Subject: [jira] Commented: (HIVE-309) FunctionRegistry should allow loading UDFs and UDAFs from property file In-Reply-To: <832509378.1235696161904.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HIVE-309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694501#action_12694501 ] Ashish Thusoo commented on HIVE-309: ------------------------------------ The latest patch does not seem to have all the files as well. Also I still have some reservations about this approach. The reasons are as follows: - This approach works quite well as long as the CLI is used to run the queries, however, as soon as you go to other clients such as the web interface this approach will break down. The reason being that in the web client there is a central server running the queries being submitted by the user and so all the users are sharing the same udf.properties file and it will be impossible for the user to actually add his functions to this udf.properties file as he will not have access to the locations where the udf.properties files exists. In this case and in other cases where there are centralized servers that serve up the queries (something that is possible to some extent now with the JDBC drivers), this approach will break as the registerUDF function is only called on the udf side. - Having said that, this approach does work well if you want to have private UDFs which you do not really share with other folks and you are using the current version of the HiveCli (though that may also be made more client serverish in the future). To me though, storing all this meta information in the metastore through the create function .. command would be able to address both those issues... Thoughts? > FunctionRegistry should allow loading UDFs and UDAFs from property file > ----------------------------------------------------------------------- > > Key: HIVE-309 > URL: https://issues.apache.org/jira/browse/HIVE-309 > Project: Hadoop Hive > Issue Type: Improvement > Components: Query Processor > Reporter: Richard Lee > Assignee: Richard Lee > Attachments: hive-external-functions-2.diff, hive-external-functions.diff, hive-external-functions2.diff, hive-external-functions3.diff, hive-external-functions4.diff > > > FunctionRegistry.java hard code all UDF, UDAF definitions in a static initializer. There is no way to add new functions without directly modifying this file. > FunctionRegistry SHOULD look for a property file in which new functions and their implementations can be specified. This will allow third parties to extend hive without maintaining patches against the codebase. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hive-amber38@example.com Wed Apr 01 12:39:41 2009 Return-Path: <hive-amber38@example.com> Delivered-To: amber38@example.com Received: (qmail 90124 invoked from network); 1 Apr 2009 12:39:41 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2009 12:39:41 -0000 Received: (qmail 16683 invoked by uid 500); 1 Apr 2009 12:39:41 -0000 Delivered-To: amber38@example.com Received: (qmail 16656 invoked by uid 500); 1 Apr 2009 12:39:40 -0000 Mailing-List: contact amber38@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:amber38@example.com> List-Unsubscribe: <mailto:amber38@example.com> List-Post: <mailto:amber38@example.com> List-Id: <hive-dev.hadoop.apache.org> Reply-To: amber38@example.com Delivered-To: mailing list amber38@example.com Received: (qmail 16481 invoked by uid 99); 1 Apr 2009 12:39:40 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 12:39:40 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 12:39:38 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 67C91234C052 for <amber38@example.com>; Wed, 1 Apr 2009 05:39:17 -0700 (PDT) Message-ID: <814718252.1238589557423.JavaMail.jira@brutus> Date: Wed, 1 Apr 2009 05:39:17 -0700 (PDT) From: "Ashish Thusoo (JIRA)" <amber38@example.com> To: amber38@example.com Subject: [jira] Assigned: (HIVE-381) [JDBC component] HiveResultSet next() always returned true due to bad string comparison In-Reply-To: <(844)701-5042.1238493590586.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HIVE-381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo reassigned HIVE-381: ---------------------------------- Assignee: Kim P. > [JDBC component] HiveResultSet next() always returned true due to bad string comparison > --------------------------------------------------------------------------------------- > > Key: HIVE-381 > URL: https://issues.apache.org/jira/browse/HIVE-381 > Project: Hadoop Hive > Issue Type: Bug > Affects Versions: 0.2.0, 0.3.0, 0.4.0 > Reporter: Kim P. > Assignee: Kim P. > Attachments: HiveResultSet.java > > > Method next() is comparing String using "!=" operator resulted in "true" being returned all the time. Can be fix by using String equals() operation to check. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hive-amber38@example.com Wed Apr 01 12:49:45 2009 Return-Path: <hive-amber38@example.com> Delivered-To: amber38@example.com Received: (qmail 96493 invoked from network); 1 Apr 2009 12:49:45 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2009 12:49:45 -0000 Received: (qmail 41090 invoked by uid 500); 1 Apr 2009 12:49:45 -0000 Delivered-To: amber38@example.com Received: (qmail 41063 invoked by uid 500); 1 Apr 2009 12:49:45 -0000 Mailing-List: contact amber38@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:amber38@example.com> List-Unsubscribe: <mailto:amber38@example.com> List-Post: <mailto:amber38@example.com> List-Id: <hive-dev.hadoop.apache.org> Reply-To: amber38@example.com Delivered-To: mailing list amber38@example.com Received: (qmail 41053 invoked by uid 99); 1 Apr 2009 12:49:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 12:49:45 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 12:49:43 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 7E8AE234C003 for <amber38@example.com>; Wed, 1 Apr 2009 05:49:22 -0700 (PDT) Message-ID: <1966477954.1238590162504.JavaMail.jira@brutus> Date: Wed, 1 Apr 2009 05:49:22 -0700 (PDT) From: "Ashish Thusoo (JIRA)" <amber38@example.com> To: amber38@example.com Subject: [jira] Commented: (HIVE-377) Some ANT jars should be included into hive In-Reply-To: <299846988.1238367110413.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HIVE-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694508#action_12694508 ] Ashish Thusoo commented on HIVE-377: ------------------------------------ I don't see a big problem adding this to hive_hwi.jar. If we just add it to that jar we would not be adding it to the cli jars or the execution jars. > Some ANT jars should be included into hive > ------------------------------------------ > > Key: HIVE-377 > URL: https://issues.apache.org/jira/browse/HIVE-377 > Project: Hadoop Hive > Issue Type: Bug > Components: Web UI > Affects Versions: 0.2.0, 0.3.0 > Reporter: Edward Capriolo > Fix For: 0.4.0 > > > The WEB UI requires > HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/opt/ant/lib/ant.jar > HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/opt/ant/lib/ant-launcher.jar > Right now the start script does this. > {noformat} > #hwi requires ant jars > # if [ "$ANT_LIB" = "" ] ; then > # ANT_LIB=/opt/ant/libs > # fi > # for f in ${ANT_LIB}/*.jar; do > # if [[ ! -f $f ]]; then > # continue; > # fi > # HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:$f > # done > {noformat} > Can we add these jars? This will add 1.4 MB to the hive. If we do not want to add these I would like to make the startup script fail if the environment variable is not correct. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hive-amber38@example.com Wed Apr 01 12:53:40 2009 Return-Path: <hive-amber38@example.com> Delivered-To: amber38@example.com Received: (qmail 4532 invoked from network); 1 Apr 2009 12:53:39 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2009 12:53:39 -0000 Received: (qmail 43640 invoked by uid 500); 1 Apr 2009 12:53:39 -0000 Delivered-To: amber38@example.com Received: (qmail 43577 invoked by uid 500); 1 Apr 2009 12:53:39 -0000 Mailing-List: contact amber38@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:amber38@example.com> List-Unsubscribe: <mailto:amber38@example.com> List-Post: <mailto:amber38@example.com> List-Id: <hive-dev.hadoop.apache.org> Reply-To: amber38@example.com Delivered-To: mailing list amber38@example.com Received: (qmail 43567 invoked by uid 99); 1 Apr 2009 12:53:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 12:53:39 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 12:53:37 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id B6150234C051 for <amber38@example.com>; Wed, 1 Apr 2009 05:53:16 -0700 (PDT) Message-ID: <629905640.1238590396744.JavaMail.jira@brutus> Date: Wed, 1 Apr 2009 05:53:16 -0700 (PDT) From: "Ashish Thusoo (JIRA)" <amber38@example.com> To: amber38@example.com Subject: [jira] Assigned: (HIVE-360) Generalize the FileFormat Interface in Hive In-Reply-To: <1412351953.1237882313248.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HIVE-360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo reassigned HIVE-360: ---------------------------------- Assignee: He Yongqiang > Generalize the FileFormat Interface in Hive > ------------------------------------------- > > Key: HIVE-360 > URL: https://issues.apache.org/jira/browse/HIVE-360 > Project: Hadoop Hive > Issue Type: Improvement > Reporter: Zheng Shao > Assignee: He Yongqiang > Attachments: hive-360-2009-03-31.patch > > > Currently the FileFormat support in Hive is not generalized - we do "if ... else" to support TextFileFormat and SequenceFileFormat. There is no way to support a 3rd one without changing the "if...else" structure. We should make an interface for the FileFormat need for Hive. > The OutputFileFormat interface that Hive requires will contain one more method than the Hadoop OutputFileFormat - create a File with a specific name. > Hive.g:409 (Hive.g already supports the custom file format but DDLSemanticAnalyzer.java is not recognizing it yet > {code} > KW_STORED KW_AS KW_INPUTFORMAT inFmt=StringLiteral KW_OUTPUTFORMAT outFmt=StringLiteral > {code} > Please add the handling of TOK_TABLEFILEFORMAT here: > DDLSemanticAnalyzer.java:223 > {code} > case HiveParser.TOK_TBLSEQUENCEFILE: > ... > {code} > Please add the handling of custom outputFormat here by adding a new interface (and cast the user-provided file format to that interface), instead of doing "if ... else" > FileSinkOperator.java:129-174: > {code} > if(outputFormat instanceof IgnoreKeyTextOutputFormat) { > finalPath = new Path(Utilities.toTempPath(conf.getDirName()), Utilities.getTaskId(hconf) + > Utilities.getFileExtension(jc, isCompressed)); > ... > {code} -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hive-amber38@example.com Wed Apr 01 12:55:36 2009 Return-Path: <hive-amber38@example.com> Delivered-To: amber38@example.com Received: (qmail 5482 invoked from network); 1 Apr 2009 12:55:36 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2009 12:55:36 -0000 Received: (qmail 44576 invoked by uid 500); 1 Apr 2009 12:55:36 -0000 Delivered-To: amber38@example.com Received: (qmail 44514 invoked by uid 500); 1 Apr 2009 12:55:36 -0000 Mailing-List: contact amber38@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:amber38@example.com> List-Unsubscribe: <mailto:amber38@example.com> List-Post: <mailto:amber38@example.com> List-Id: <hive-dev.hadoop.apache.org> Reply-To: amber38@example.com Delivered-To: mailing list amber38@example.com Received: (qmail 44499 invoked by uid 99); 1 Apr 2009 12:55:36 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 12:55:36 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 12:55:35 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 3F36E234C003 for <amber38@example.com>; Wed, 1 Apr 2009 05:55:15 -0700 (PDT) Message-ID: <136243019.1238590515243.JavaMail.jira@brutus> Date: Wed, 1 Apr 2009 05:55:15 -0700 (PDT) From: "Ashish Thusoo (JIRA)" <amber38@example.com> To: amber38@example.com Subject: [jira] Updated: (HIVE-360) Generalize the FileFormat Interface in Hive In-Reply-To: <1412351953.1237882313248.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HIVE-360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-360: ------------------------------- Affects Version/s: 0.4.0 Status: Patch Available (was: Open) Marking this as patch submitted. That helps to get this on the radar for the reviewers. Thanks, Ashish > Generalize the FileFormat Interface in Hive > ------------------------------------------- > > Key: HIVE-360 > URL: https://issues.apache.org/jira/browse/HIVE-360 > Project: Hadoop Hive > Issue Type: Improvement > Affects Versions: 0.4.0 > Reporter: Zheng Shao > Assignee: He Yongqiang > Attachments: hive-360-2009-03-31.patch > > > Currently the FileFormat support in Hive is not generalized - we do "if ... else" to support TextFileFormat and SequenceFileFormat. There is no way to support a 3rd one without changing the "if...else" structure. We should make an interface for the FileFormat need for Hive. > The OutputFileFormat interface that Hive requires will contain one more method than the Hadoop OutputFileFormat - create a File with a specific name. > Hive.g:409 (Hive.g already supports the custom file format but DDLSemanticAnalyzer.java is not recognizing it yet > {code} > KW_STORED KW_AS KW_INPUTFORMAT inFmt=StringLiteral KW_OUTPUTFORMAT outFmt=StringLiteral > {code} > Please add the handling of TOK_TABLEFILEFORMAT here: > DDLSemanticAnalyzer.java:223 > {code} > case HiveParser.TOK_TBLSEQUENCEFILE: > ... > {code} > Please add the handling of custom outputFormat here by adding a new interface (and cast the user-provided file format to that interface), instead of doing "if ... else" > FileSinkOperator.java:129-174: > {code} > if(outputFormat instanceof IgnoreKeyTextOutputFormat) { > finalPath = new Path(Utilities.toTempPath(conf.getDirName()), Utilities.getTaskId(hconf) + > Utilities.getFileExtension(jc, isCompressed)); > ... > {code} -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hive-amber38@example.com Wed Apr 01 13:10:32 2009 Return-Path: <hive-amber38@example.com> Delivered-To: amber38@example.com Received: (qmail 14950 invoked from network); 1 Apr 2009 13:10:32 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2009 13:10:32 -0000 Received: (qmail 67459 invoked by uid 500); 1 Apr 2009 13:10:32 -0000 Delivered-To: amber38@example.com Received: (qmail 67423 invoked by uid 500); 1 Apr 2009 13:10:32 -0000 Mailing-List: contact amber38@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:amber38@example.com> List-Unsubscribe: <mailto:amber38@example.com> List-Post: <mailto:amber38@example.com> List-Id: <hive-dev.hadoop.apache.org> Reply-To: amber38@example.com Delivered-To: mailing list amber38@example.com Received: (qmail 67413 invoked by uid 99); 1 Apr 2009 13:10:32 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 13:10:32 +0000 X-ASF-Spam-Status: No, hits=-4.0 required=10.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of amber38@example.com designates 83.161.120.155 as permitted sender) Received: from [83.161.120.155] (HELO mx-out.facebook.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 13:10:24 +0000 Received: from [83.161.120.155] ([83.161.120.155:42765] helo=facebook.com) by mta007.snc1.facebook.com (envelope-from <amber38@example.com>) (ecelerity 83.161.120.155 r(28805/28844)) with ESMTP id A3/A3-30135-AA763D94; Wed, 01 Apr 2009 06:10:03 -0700 Received: by devbuild002.snc1.facebook.com (Postfix, from userid 1369) id D6F3DC381E1; Wed, 1 Apr 2009 06:10:01 -0700 (PDT) To: amber38@example.com Subject: JIRA_hive-360-2009-03-31.patch_UNIT_TEST_FAILED Message-Id: <amber38@example.com> Date: Wed, 1 Apr 2009 06:10:01 -0700 (PDT) From: amber38@example.com (Murli Varadachari) X-Virus-Checked: Checked by ClamAV on apache.org ERROR: UNIT TEST using PATCH hive-360-2009-03-31.patch FAILED!! [junit] FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask [junit] FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask [junit] Test org.apache.hadoop.hive.hwi.TestHWISessionManager FAILED BUILD FAILED From hive-amber38@example.com Wed Apr 01 14:00:29 2009 Return-Path: <hive-amber38@example.com> Delivered-To: amber38@example.com Received: (qmail 52274 invoked from network); 1 Apr 2009 14:00:29 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2009 14:00:29 -0000 Received: (qmail 62221 invoked by uid 500); 1 Apr 2009 14:00:29 -0000 Delivered-To: amber38@example.com Received: (qmail 62199 invoked by uid 500); 1 Apr 2009 14:00:28 -0000 Mailing-List: contact amber38@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:amber38@example.com> List-Unsubscribe: <mailto:amber38@example.com> List-Post: <mailto:amber38@example.com> List-Id: <hive-dev.hadoop.apache.org> Reply-To: amber38@example.com Delivered-To: mailing list amber38@example.com Received: (qmail 62166 invoked by uid 99); 1 Apr 2009 14:00:22 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 14:00:22 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hudson.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 14:00:19 +0000 Received: from hudson.zones.apache.org (localhost [83.161.120.155]) by hudson.zones.apache.org (8.13.8+Sun/8.13.8) with ESMTP id n31DxvJ3014011 for <amber38@example.com>; Wed, 1 Apr 2009 09:59:57 -0400 (EDT) Date: Wed, 1 Apr 2009 13:59:57 +0000 (UTC) From: Apache Hudson Server <amber38@example.com> To: amber38@example.com Message-ID: <amber38@example.com> In-Reply-To: <amber38@example.com> References: <amber38@example.com> Subject: Build failed in Hudson: Hive-trunk-h0.17 #49 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org See http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/49/changes Changes: [namit] HIVE-375. LazySimpleSerDe directly creates a UTF8 buffer for primitive types. (Zheng Shao via namit) ------------------------------------------ [...truncated 577 lines...] [echo] hive: anttasks configure: compile: [echo] Compiling: ql jar: [echo] Jar: ql [unzip] Expanding: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/ql/lib/commons-jexl-1.1.jar into http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/jexl/classes [unzip] Expanding: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/lib/libthrift.jar into http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/thrift/classes [unzip] Expanding: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/lib/commons-lang-2.4.jar into http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/commons-lang/classes [unzip] Expanding: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/lib/json.jar into http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/json/classes deploy: [echo] hive: ql init: [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/cli/test [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/cli/test/src [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/cli/test/classes download-ivy: init-ivy: settings-ivy: resolve: 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 loading settings 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 file = http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/ivy/ivysettings.xml [ivy:retrieve] 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 resolving dependencies 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 org.apache.hadoop.hive#cli;amber38@example.com [ivy:retrieve] confs: [default] [ivy:retrieve] found hadoop#core;83.161.120.155 in hadoop-resolver [ivy:retrieve] 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 resolution report 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 resolve 11ms 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 artifacts dl 1ms --------------------------------------------------------------------- | | modules || artifacts | | conf | number| search|dwnlded|evicted|| number|dwnlded| --------------------------------------------------------------------- | default | 1 | 0 | 0 | 0 || 1 | 0 | --------------------------------------------------------------------- [ivy:retrieve] 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 retrieving 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 org.apache.hadoop.hive#cli [ivy:retrieve] confs: [default] [ivy:retrieve] 0 artifacts copied, 1 already retrieved (0kB/1ms) install-hadoopcore: compile: [echo] Compiling: cli jar: [echo] Jar: cli deploy: [echo] hive: cli init: [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/service/test [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/service/test/src [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/service/test/classes core-compile: compile: jar: [echo] Jar: service deploy: [echo] hive: service init: [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/jdbc/test [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/jdbc/test/src [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/jdbc/test/classes core-compile: compile: jar: [echo] Jar: jdbc deploy: [echo] hive: jdbc hwi-init: [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/hwi/test/classes [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/hwi/test/src compile: [echo] Compiling: hwi [javac] Compiling 7 source files to http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/hwi/classes jar: [echo] Jar: hwi [jar] Building jar: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/hwi/hive_hwi.jar deploy: [echo] hive: hwi [copy] Copying 1 file to http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build test: test: [echo] Nothing to do! test: [echo] Nothing to do! test-conditions: gen-test: hwi-init: compile: [echo] Compiling: hwi [javac] Compiling 7 source files to http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/hwi/classes compile-test: [javac] Compiling 1 source file to http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/hwi/test/classes test-jar: [jar] Building MANIFEST-only jar: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/hwi/test/test-udfs.jar test-init: [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/hwi/test/data [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/hwi/test/logs/clientpositive [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/hwi/test/logs/clientnegative [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/hwi/test/logs/positive [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/hwi/test/logs/negative [copy] Copying 24 files to http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/hwi/test/data [copy] Copied 6 empty directories to 2 empty directories under http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/hwi/test/data test: [junit] Running org.apache.hadoop.hive.hwi.TestHWISessionManager [junit] Hive history file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/hwi/../build/ql/tmp/hive_job_log_hudson_200904010714_808247510.txt [junit] Hive history file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/hwi/../build/ql/tmp/hive_job_log_hudson_200904010714_1529223604.txt [junit] Hive history file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/hwi/../build/ql/tmp/hive_job_log_hudson_200904010714_(844)701-5042.txt [junit] OK [junit] Hive history file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/hwi/../build/ql/tmp/hive_job_log_hudson_200904010714_376454533.txt [junit] Copying data from http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/data/files/kv1.txt [junit] Loading data to table test_hwi_table [junit] OK [junit] plan = /tmp/plan3501076966760641104.xml [junit] plan = /tmp/plan48871256536315062.xml [junit] Number of reduce tasks not specified. Defaulting to jobconf value of: 1 [junit] 09/04/01 07:14:42 INFO exec.ExecDriver: Number of reduce tasks not specified. Defaulting to jobconf value of: 1 [junit] 09/04/01 07:14:42 INFO exec.ExecDriver: In order to change the average load for a reducer (in bytes): [junit] 09/04/01 07:14:42 INFO exec.ExecDriver: set hive.exec.reducers.bytes.per.reducer=<number> [junit] In order to change the average load for a reducer (in bytes): [junit] 09/04/01 07:14:42 INFO exec.ExecDriver: In order to limit the maximum number of reducers: [junit] 09/04/01 07:14:42 INFO exec.ExecDriver: set hive.exec.reducers.max=<number> [junit] 09/04/01 07:14:42 INFO exec.ExecDriver: In order to set a constant number of reducers: [junit] 09/04/01 07:14:42 INFO exec.ExecDriver: set mapred.reduce.tasks=<number> [junit] set hive.exec.reducers.bytes.per.reducer=<number> [junit] In order to limit the maximum number of reducers: [junit] set hive.exec.reducers.max=<number> [junit] In order to set a constant number of reducers: [junit] set mapred.reduce.tasks=<number> [junit] Number of reduce tasks not specified. Defaulting to jobconf value of: 1 [junit] 09/04/01 07:14:43 INFO exec.ExecDriver: Number of reduce tasks not specified. Defaulting to jobconf value of: 1 [junit] In order to change the average load for a reducer (in bytes): [junit] 09/04/01 07:14:43 INFO exec.ExecDriver: In order to change the average load for a reducer (in bytes): [junit] set hive.exec.reducers.bytes.per.reducer=<number> [junit] 09/04/01 07:14:43 INFO exec.ExecDriver: set hive.exec.reducers.bytes.per.reducer=<number> [junit] In order to limit the maximum number of reducers: [junit] 09/04/01 07:14:43 INFO exec.ExecDriver: In order to limit the maximum number of reducers: [junit] set hive.exec.reducers.max=<number> [junit] 09/04/01 07:14:43 INFO exec.ExecDriver: set hive.exec.reducers.max=<number> [junit] In order to set a constant number of reducers: [junit] 09/04/01 07:14:43 INFO exec.ExecDriver: In order to set a constant number of reducers: [junit] set mapred.reduce.tasks=<number> [junit] 09/04/01 07:14:43 INFO exec.ExecDriver: set mapred.reduce.tasks=<number> [junit] 09/04/01 07:14:43 INFO exec.ExecDriver: Adding input file http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/ql/test/data/warehouse/test_hwi_table [junit] 09/04/01 07:14:43 INFO exec.ExecDriver: adding libjars: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/hwi/test/test-udfs.jar,/home/hudson/hudson-slave/workspace/Hive-trunk-h0.17/hive/data/files/TestSerDe.jar [junit] 09/04/01 07:14:43 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId= [junit] Job Submission failed with exception 'org.apache.hadoop.util.Shell$ExitCodeException(chmod: cannot access `/tmp/hadoop-hudson/mapred/system/651012123/job_local_1': No such file or directory [junit] )' [junit] 09/04/01 07:14:43 ERROR exec.ExecDriver: Job Submission failed with exception 'org.apache.hadoop.util.Shell$ExitCodeException(chmod: cannot access `/tmp/hadoop-hudson/mapred/system/651012123/job_local_1': No such file or directory [junit] )' [junit] org.apache.hadoop.util.Shell$ExitCodeException: chmod: cannot access `/tmp/hadoop-hudson/mapred/system/651012123/job_local_1': No such file or directory [junit] [junit] at org.apache.hadoop.util.Shell.runCommand(Shell.java:195) [junit] at org.apache.hadoop.util.Shell.run(Shell.java:134) [junit] at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:286) [junit] at org.apache.hadoop.util.Shell.execCommand(Shell.java:317) [junit] at org.apache.hadoop.fs.RawLocalFileSystem.execCommand(RawLocalFileSystem.java:522) [junit] at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:514) [junit] at org.apache.hadoop.fs.FilterFileSystem.setPermission(FilterFileSystem.java:267) [junit] at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:273) [junit] at org.apache.hadoop.mapred.JobClient.configureCommandLineOptions(JobClient.java:549) [junit] at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:700) [junit] at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:393) [junit] at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:556) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [junit] at java.lang.reflect.Method.invoke(Method.java:597) [junit] at org.apache.hadoop.util.RunJar.main(RunJar.java:155) [junit] at org.apache.hadoop.mapred.JobShell.run(JobShell.java:194) [junit] at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) [junit] at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) [junit] at org.apache.hadoop.mapred.JobShell.main(JobShell.java:220) [junit] [junit] Job Failed [junit] 09/04/01 07:14:43 INFO exec.ExecDriver: Adding input file http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/ql/test/data/warehouse/test_hwi_table [junit] 09/04/01 07:14:43 INFO exec.ExecDriver: adding libjars: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/hwi/test/test-udfs.jar,/home/hudson/hudson-slave/workspace/Hive-trunk-h0.17/hive/data/files/TestSerDe.jar [junit] 09/04/01 07:14:43 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId= [junit] Job Submission failed with exception 'org.apache.hadoop.util.Shell$ExitCodeException(chmod: cannot access `/tmp/hadoop-hudson/mapred/system/517141089/job_local_1': No such file or directory [junit] )' [junit] 09/04/01 07:14:43 ERROR exec.ExecDriver: Job Submission failed with exception 'org.apache.hadoop.util.Shell$ExitCodeException(chmod: cannot access `/tmp/hadoop-hudson/mapred/system/517141089/job_local_1': No such file or directory [junit] )' [junit] org.apache.hadoop.util.Shell$ExitCodeException: chmod: cannot access `/tmp/hadoop-hudson/mapred/system/517141089/job_local_1': No such file or directory [junit] [junit] at org.apache.hadoop.util.Shell.runCommand(Shell.java:195) [junit] at org.apache.hadoop.util.Shell.run(Shell.java:134) [junit] at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:286) [junit] at org.apache.hadoop.util.Shell.execCommand(Shell.java:317) [junit] at org.apache.hadoop.fs.RawLocalFileSystem.execCommand(RawLocalFileSystem.java:522) [junit] at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:514) [junit] at org.apache.hadoop.fs.FilterFileSystem.setPermission(FilterFileSystem.java:267) [junit] at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:273) [junit] at org.apache.hadoop.mapred.JobClient.configureCommandLineOptions(JobClient.java:549) [junit] at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:700) [junit] at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:393) [junit] at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:556) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [junit] at java.lang.reflect.Method.invoke(Method.java:597) [junit] at org.apache.hadoop.util.RunJar.main(RunJar.java:155) [junit] at org.apache.hadoop.mapred.JobShell.run(JobShell.java:194) [junit] at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) [junit] at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) [junit] at org.apache.hadoop.mapred.JobShell.main(JobShell.java:220) [junit] [junit] Job Failed [junit] FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask [junit] FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 5.948 sec [junit] Test org.apache.hadoop.hive.hwi.TestHWISessionManager FAILED BUILD FAILED http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build.xml :117: The following error occurred while executing this line: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build-common.xml :273: Tests failed! Total time: 26 seconds Recording test results From hive-amber38@example.com Wed Apr 01 14:23:37 2009 Return-Path: <hive-amber38@example.com> Delivered-To: amber38@example.com Received: (qmail 71284 invoked from network); 1 Apr 2009 14:23:37 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2009 14:23:37 -0000 Received: (qmail 23767 invoked by uid 500); 1 Apr 2009 14:23:37 -0000 Delivered-To: amber38@example.com Received: (qmail 23752 invoked by uid 500); 1 Apr 2009 14:23:36 -0000 Mailing-List: contact amber38@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:amber38@example.com> List-Unsubscribe: <mailto:amber38@example.com> List-Post: <mailto:amber38@example.com> List-Id: <hive-dev.hadoop.apache.org> Reply-To: amber38@example.com Delivered-To: mailing list amber38@example.com Received: (qmail 23742 invoked by uid 99); 1 Apr 2009 14:23:36 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 14:23:36 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 14:23:34 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 9AB6F234C051 for <amber38@example.com>; Wed, 1 Apr 2009 07:23:13 -0700 (PDT) Message-ID: <1149888801.1238595793632.JavaMail.jira@brutus> Date: Wed, 1 Apr 2009 07:23:13 -0700 (PDT) From: "He Yongqiang (JIRA)" <amber38@example.com> To: amber38@example.com Subject: [jira] Commented: (HIVE-360) Generalize the FileFormat Interface in Hive In-Reply-To: <1412351953.1237882313248.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HIVE-360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694543#action_12694543 ] He Yongqiang commented on HIVE-360: ----------------------------------- Thanks, Thusoo. Actually i am refactoring the code now. I have talked with Zheng about the current patch. There are some improvements: (1) make HiveInputFormat as an interface, and extends from InputFormat. Add a new getRecordWriter. The main different between its getRecordWriter and Hadoop OutputFormat's getRecordWriter is that the new getRecordWriter accepts a path parameter, and create the out file at the calling. (2) make HiveSequenceFileOutputFormat extend Hadoop's SequenceFileOutputFormat and implement the new HiveOutputFormat (3) Deprecate Hive's IgnoreKeyOutputFormat and replace it with a new IgnoreKeyOutputFormat which uses the new HiveOutputFormat In this way, the code will be more clear. The disadvantage is that the HiveOutputFormat's signature is like: {code} HiveOutputFormat extends OutputFormat<WritableComparable, Writable> {code} It can only use subclasses of WritableComparable as its key and subclasses of Writable as its value. I think it is ok in Hive, isn't it? Should i cancel the patch now and resubmit one once the refactory is done? > Generalize the FileFormat Interface in Hive > ------------------------------------------- > > Key: HIVE-360 > URL: https://issues.apache.org/jira/browse/HIVE-360 > Project: Hadoop Hive > Issue Type: Improvement > Affects Versions: 0.4.0 > Reporter: Zheng Shao > Assignee: He Yongqiang > Attachments: hive-360-2009-03-31.patch > > > Currently the FileFormat support in Hive is not generalized - we do "if ... else" to support TextFileFormat and SequenceFileFormat. There is no way to support a 3rd one without changing the "if...else" structure. We should make an interface for the FileFormat need for Hive. > The OutputFileFormat interface that Hive requires will contain one more method than the Hadoop OutputFileFormat - create a File with a specific name. > Hive.g:409 (Hive.g already supports the custom file format but DDLSemanticAnalyzer.java is not recognizing it yet > {code} > KW_STORED KW_AS KW_INPUTFORMAT inFmt=StringLiteral KW_OUTPUTFORMAT outFmt=StringLiteral > {code} > Please add the handling of TOK_TABLEFILEFORMAT here: > DDLSemanticAnalyzer.java:223 > {code} > case HiveParser.TOK_TBLSEQUENCEFILE: > ... > {code} > Please add the handling of custom outputFormat here by adding a new interface (and cast the user-provided file format to that interface), instead of doing "if ... else" > FileSinkOperator.java:129-174: > {code} > if(outputFormat instanceof IgnoreKeyTextOutputFormat) { > finalPath = new Path(Utilities.toTempPath(conf.getDirName()), Utilities.getTaskId(hconf) + > Utilities.getFileExtension(jc, isCompressed)); > ... > {code} -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From hive-amber38@example.com Wed Apr 01 15:18:50 2009 Return-Path: <hive-amber38@example.com> Delivered-To: amber38@example.com Received: (qmail 521 invoked from network); 1 Apr 2009 15:18:49 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2009 15:18:49 -0000 Received: (qmail 44747 invoked by uid 500); 1 Apr 2009 15:17:57 -0000 Delivered-To: amber38@example.com Received: (qmail 44205 invoked by uid 500); 1 Apr 2009 15:17:55 -0000 Mailing-List: contact amber38@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:amber38@example.com> List-Unsubscribe: <mailto:amber38@example.com> List-Post: <mailto:amber38@example.com> List-Id: <hive-dev.hadoop.apache.org> Reply-To: amber38@example.com Delivered-To: mailing list amber38@example.com Received: (qmail 43132 invoked by uid 99); 1 Apr 2009 15:14:52 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 15:14:52 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hudson.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 15:14:49 +0000 Received: from hudson.zones.apache.org (localhost [83.161.120.155]) by hudson.zones.apache.org (8.13.8+Sun/8.13.8) with ESMTP id n31FER5P014584 for <amber38@example.com>; Wed, 1 Apr 2009 11:14:27 -0400 (EDT) Date: Wed, 1 Apr 2009 15:14:27 +0000 (UTC) From: Apache Hudson Server <amber38@example.com> To: amber38@example.com Message-ID: <amber38@example.com> In-Reply-To: <amber38@example.com> References: <amber38@example.com> Subject: Build failed in Hudson: Hive-trunk-h0.18 #50 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org See http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/50/changes Changes: [namit] HIVE-375. LazySimpleSerDe directly creates a UTF8 buffer for primitive types. (Zheng Shao via namit) ------------------------------------------ [...truncated 579 lines...] configure: compile: [echo] Compiling: ql jar: [echo] Jar: ql [unzip] Expanding: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/ql/lib/commons-jexl-1.1.jar into http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/jexl/classes [unzip] Expanding: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/lib/libthrift.jar into http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/thrift/classes [unzip] Expanding: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/lib/commons-lang-2.4.jar into http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/commons-lang/classes [unzip] Expanding: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/lib/json.jar into http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/json/classes deploy: [echo] hive: ql init: [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/cli/test [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/cli/test/src [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/cli/test/classes download-ivy: init-ivy: settings-ivy: resolve: 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 loading settings 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 file = http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/ivy/ivysettings.xml [ivy:retrieve] 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 resolving dependencies 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 org.apache.hadoop.hive#cli;amber38@example.com [ivy:retrieve] confs: [default] [ivy:retrieve] found hadoop#core;0.18.3 in hadoop-resolver [ivy:retrieve] 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 resolution report 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 resolve 11ms 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 artifacts dl 0ms --------------------------------------------------------------------- | | modules || artifacts | | conf | number| search|dwnlded|evicted|| number|dwnlded| --------------------------------------------------------------------- | default | 1 | 0 | 0 | 0 || 1 | 0 | --------------------------------------------------------------------- [ivy:retrieve] 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 retrieving 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 org.apache.hadoop.hive#cli [ivy:retrieve] confs: [default] [ivy:retrieve] 0 artifacts copied, 1 already retrieved (0kB/2ms) install-hadoopcore: compile: [echo] Compiling: cli jar: [echo] Jar: cli deploy: [echo] hive: cli init: [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/service/test [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/service/test/src [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/service/test/classes core-compile: compile: jar: [echo] Jar: service deploy: [echo] hive: service init: [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/jdbc/test [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/jdbc/test/src [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/jdbc/test/classes core-compile: compile: jar: [echo] Jar: jdbc deploy: [echo] hive: jdbc hwi-init: [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/hwi/test/classes [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/hwi/test/src compile: [echo] Compiling: hwi [javac] Compiling 7 source files to http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/hwi/classes jar: [echo] Jar: hwi [jar] Building jar: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/hwi/hive_hwi.jar deploy: [echo] hive: hwi [copy] Copying 1 file to http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build test: test: [echo] Nothing to do! test: [echo] Nothing to do! test-conditions: gen-test: hwi-init: compile: [echo] Compiling: hwi [javac] Compiling 7 source files to http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/hwi/classes compile-test: [javac] Compiling 1 source file to http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/hwi/test/classes test-jar: [jar] Building MANIFEST-only jar: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/hwi/test/test-udfs.jar test-init: [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/hwi/test/data [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/hwi/test/logs/clientpositive [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/hwi/test/logs/clientnegative [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/hwi/test/logs/positive [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/hwi/test/logs/negative [copy] Copying 24 files to http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/hwi/test/data [copy] Copied 6 empty directories to 2 empty directories under http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/hwi/test/data test: [junit] Running org.apache.hadoop.hive.hwi.TestHWISessionManager [junit] Hive history file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/hwi/../build/ql/tmp/hive_job_log_hudson_200904010829_646036600.txt [junit] Hive history file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/hwi/../build/ql/tmp/hive_job_log_hudson_200904010829_1381574087.txt [junit] Hive history file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/hwi/../build/ql/tmp/hive_job_log_hudson_200904010829_484100607.txt [junit] OK [junit] Hive history file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/hwi/../build/ql/tmp/hive_job_log_hudson_200904010829_1900681330.txt [junit] Copying data from http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/data/files/kv1.txt [junit] Loading data to table test_hwi_table [junit] OK [junit] plan = /tmp/plan5716799448543269285.xml [junit] Number of reduce tasks not specified. Defaulting to jobconf value of: 1 [junit] 09/04/01 08:29:16 INFO exec.ExecDriver: Number of reduce tasks not specified. Defaulting to jobconf value of: 1 [junit] In order to change the average load for a reducer (in bytes): [junit] set hive.exec.reducers.bytes.per.reducer=<number> [junit] In order to limit the maximum number of reducers: [junit] 09/04/01 08:29:16 INFO exec.ExecDriver: In order to change the average load for a reducer (in bytes): [junit] 09/04/01 08:29:16 INFO exec.ExecDriver: set hive.exec.reducers.bytes.per.reducer=<number> [junit] 09/04/01 08:29:16 INFO exec.ExecDriver: In order to limit the maximum number of reducers: [junit] 09/04/01 08:29:16 INFO exec.ExecDriver: set hive.exec.reducers.max=<number> [junit] 09/04/01 08:29:16 INFO exec.ExecDriver: In order to set a constant number of reducers: [junit] set hive.exec.reducers.max=<number> [junit] In order to set a constant number of reducers: [junit] set mapred.reduce.tasks=<number> [junit] 09/04/01 08:29:16 INFO exec.ExecDriver: set mapred.reduce.tasks=<number> [junit] plan = /tmp/plan1607594593880838559.xml [junit] 09/04/01 08:29:16 INFO exec.ExecDriver: Adding input file http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/ql/test/data/warehouse/test_hwi_table [junit] 09/04/01 08:29:16 INFO exec.ExecDriver: adding libjars: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/hwi/test/test-udfs.jar,/home/hudson/hudson-slave/workspace/Hive-trunk-h0.18/hive/data/files/TestSerDe.jar [junit] 09/04/01 08:29:16 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId= [junit] 09/04/01 08:29:16 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. [junit] Number of reduce tasks not specified. Defaulting to jobconf value of: 1 [junit] 09/04/01 08:29:16 INFO exec.ExecDriver: Number of reduce tasks not specified. Defaulting to jobconf value of: 1 [junit] In order to change the average load for a reducer (in bytes): [junit] 09/04/01 08:29:16 INFO exec.ExecDriver: In order to change the average load for a reducer (in bytes): [junit] set hive.exec.reducers.bytes.per.reducer=<number> [junit] 09/04/01 08:29:16 INFO exec.ExecDriver: set hive.exec.reducers.bytes.per.reducer=<number> [junit] In order to limit the maximum number of reducers: [junit] 09/04/01 08:29:16 INFO exec.ExecDriver: In order to limit the maximum number of reducers: [junit] set hive.exec.reducers.max=<number> [junit] 09/04/01 08:29:16 INFO exec.ExecDriver: set hive.exec.reducers.max=<number> [junit] In order to set a constant number of reducers: [junit] 09/04/01 08:29:16 INFO exec.ExecDriver: In order to set a constant number of reducers: [junit] set mapred.reduce.tasks=<number> [junit] 09/04/01 08:29:16 INFO exec.ExecDriver: set mapred.reduce.tasks=<number> [junit] Job Submission failed with exception 'org.apache.hadoop.util.Shell$ExitCodeException(chmod: cannot access `/tmp/hadoop-hudson/mapred/system/568204738/job_local_0001': No such file or directory [junit] )' [junit] 09/04/01 08:29:16 ERROR exec.ExecDriver: Job Submission failed with exception 'org.apache.hadoop.util.Shell$ExitCodeException(chmod: cannot access `/tmp/hadoop-hudson/mapred/system/568204738/job_local_0001': No such file or directory [junit] )' [junit] org.apache.hadoop.util.Shell$ExitCodeException: chmod: cannot access `/tmp/hadoop-hudson/mapred/system/568204738/job_local_0001': No such file or directory [junit] [junit] at org.apache.hadoop.util.Shell.runCommand(Shell.java:195) [junit] at org.apache.hadoop.util.Shell.run(Shell.java:134) [junit] at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:286) [junit] at org.apache.hadoop.util.Shell.execCommand(Shell.java:317) [junit] at org.apache.hadoop.fs.RawLocalFileSystem.execCommand(RawLocalFileSystem.java:540) [junit] at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:532) [junit] at org.apache.hadoop.fs.FilterFileSystem.setPermission(FilterFileSystem.java:284) [junit] at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:283) [junit] at org.apache.hadoop.mapred.JobClient.configureCommandLineOptions(JobClient.java:578) [junit] at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:729) [junit] at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:393) [junit] at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:556) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [junit] Job Failed [junit] at java.lang.reflect.Method.invoke(Method.java:597) [junit] at org.apache.hadoop.util.RunJar.main(RunJar.java:155) [junit] at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54) [junit] at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) [junit] at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) [junit] at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68) [junit] [junit] FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask [junit] 09/04/01 08:29:17 INFO exec.ExecDriver: Adding input file http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/ql/test/data/warehouse/test_hwi_table [junit] 09/04/01 08:29:17 INFO exec.ExecDriver: adding libjars: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/hwi/test/test-udfs.jar,/home/hudson/hudson-slave/workspace/Hive-trunk-h0.18/hive/data/files/TestSerDe.jar [junit] 09/04/01 08:29:17 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId= [junit] 09/04/01 08:29:17 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. [junit] Job Submission failed with exception 'org.apache.hadoop.util.Shell$ExitCodeException(chmod: cannot access `/tmp/hadoop-hudson/mapred/system/-2007109393/job_local_0001': No such file or directory [junit] )' [junit] 09/04/01 08:29:17 ERROR exec.ExecDriver: Job Submission failed with exception 'org.apache.hadoop.util.Shell$ExitCodeException(chmod: cannot access `/tmp/hadoop-hudson/mapred/system/-2007109393/job_local_0001': No such file or directory [junit] )' [junit] org.apache.hadoop.util.Shell$ExitCodeException: chmod: cannot access `/tmp/hadoop-hudson/mapred/system/-2007109393/job_local_0001': No such file or directory [junit] [junit] at org.apache.hadoop.util.Shell.runCommand(Shell.java:195) [junit] at org.apache.hadoop.util.Shell.run(Shell.java:134) [junit] at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:286) [junit] at org.apache.hadoop.util.Shell.execCommand(Shell.java:317) [junit] at org.apache.hadoop.fs.RawLocalFileSystem.execCommand(RawLocalFileSystem.java:540) [junit] at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:532) [junit] at org.apache.hadoop.fs.FilterFileSystem.setPermission(FilterFileSystem.java:284) [junit] at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:283) [junit] at org.apache.hadoop.mapred.JobClient.configureCommandLineOptions(JobClient.java:578) [junit] at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:729) [junit] at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:393) [junit] at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:556) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [junit] at java.lang.reflect.Method.invoke(Method.java:597) [junit] at org.apache.hadoop.util.RunJar.main(RunJar.java:155) [junit] at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54) [junit] at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) [junit] at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) [junit] at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68) [junit] [junit] Job Failed [junit] FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 5.745 sec [junit] Test org.apache.hadoop.hive.hwi.TestHWISessionManager FAILED BUILD FAILED http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build.xml :117: The following error occurred while executing this line: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build-common.xml :273: Tests failed! Total time: 28 seconds Recording test results From hive-amber38@example.com Wed Apr 01 15:20:48 2009 Return-Path: <hive-amber38@example.com> Delivered-To: amber38@example.com Received: (qmail 3143 invoked from network); 1 Apr 2009 15:20:48 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2009 15:20:48 -0000 Received: (qmail 74942 invoked by uid 500); 1 Apr 2009 15:20:48 -0000 Delivered-To: amber38@example.com Received: (qmail 74922 invoked by uid 500); 1 Apr 2009 15:20:48 -0000 Mailing-List: contact amber38@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:amber38@example.com> List-Unsubscribe: <mailto:amber38@example.com> List-Post: <mailto:amber38@example.com> List-Id: <hive-dev.hadoop.apache.org> Reply-To: amber38@example.com Delivered-To: mailing list amber38@example.com Received: (qmail 74912 invoked by uid 99); 1 Apr 2009 15:20:48 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 15:20:48 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hudson.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Apr 2009 15:20:46 +0000 Received: from hudson.zones.apache.org (localhost [83.161.120.155]) by hudson.zones.apache.org (8.13.8+Sun/8.13.8) with ESMTP id n31FKOXa015604 for <amber38@example.com>; Wed, 1 Apr 2009 11:20:24 -0400 (EDT) Date: Wed, 1 Apr 2009 15:20:24 +0000 (UTC) From: Apache Hudson Server <amber38@example.com> To: amber38@example.com Message-ID: <amber38@example.com> In-Reply-To: <amber38@example.com> References: <amber38@example.com> Subject: Build failed in Hudson: Hive-trunk-h0.19 #49 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org See http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/49/changes Changes: [namit] HIVE-375. LazySimpleSerDe directly creates a UTF8 buffer for primitive types. (Zheng Shao via namit) ------------------------------------------ [...truncated 579 lines...] [echo] hive: anttasks configure: compile: [echo] Compiling: ql jar: [echo] Jar: ql [unzip] Expanding: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/lib/commons-jexl-1.1.jar into http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/jexl/classes [unzip] Expanding: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/lib/libthrift.jar into http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/thrift/classes [unzip] Expanding: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/lib/commons-lang-2.4.jar into http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/commons-lang/classes [unzip] Expanding: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/lib/json.jar into http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/json/classes deploy: [echo] hive: ql init: [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/cli/test [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/cli/test/src [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/cli/test/classes download-ivy: init-ivy: settings-ivy: resolve: 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 loading settings 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 file = http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ivy/ivysettings.xml [ivy:retrieve] 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 resolving dependencies 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 org.apache.hadoop.hive#cli;amber38@example.com [ivy:retrieve] confs: [default] [ivy:retrieve] found hadoop#core;0.19.0 in hadoop-resolver [ivy:retrieve] 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 resolution report 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 resolve 11ms 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 artifacts dl 1ms --------------------------------------------------------------------- | | modules || artifacts | | conf | number| search|dwnlded|evicted|| number|dwnlded| --------------------------------------------------------------------- | default | 1 | 0 | 0 | 0 || 1 | 0 | --------------------------------------------------------------------- [ivy:retrieve] 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 retrieving 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4 org.apache.hadoop.hive#cli [ivy:retrieve] confs: [default] [ivy:retrieve] 0 artifacts copied, 1 already retrieved (0kB/1ms) install-hadoopcore: compile: [echo] Compiling: cli jar: [echo] Jar: cli deploy: [echo] hive: cli init: [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/service/test [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/service/test/src [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/service/test/classes core-compile: compile: jar: [echo] Jar: service deploy: [echo] hive: service init: [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/jdbc/test [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/jdbc/test/src [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/jdbc/test/classes core-compile: compile: jar: [echo] Jar: jdbc deploy: [echo] hive: jdbc hwi-init: [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/hwi/test/classes [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/hwi/test/src compile: [echo] Compiling: hwi [javac] Compiling 7 source files to http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/hwi/classes jar: [echo] Jar: hwi deploy: [echo] hive: hwi test: test: [echo] Nothing to do! test: [echo] Nothing to do! test-conditions: gen-test: hwi-init: compile: [echo] Compiling: hwi [javac] Compiling 7 source files to http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/hwi/classes compile-test: [javac] Compiling 1 source file to http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/hwi/test/classes test-jar: [jar] Building MANIFEST-only jar: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/hwi/test/test-udfs.jar test-init: [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/hwi/test/data [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/hwi/test/logs/clientpositive [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/hwi/test/logs/clientnegative [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/hwi/test/logs/positive [mkdir] Created dir: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/hwi/test/logs/negative [copy] Copying 24 files to http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/hwi/test/data [copy] Copied 6 empty directories to 3 empty directories under http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/hwi/test/data test: [junit] Running org.apache.hadoop.hive.hwi.TestHWISessionManager
{'source': 'Apache Software Foundation Public Mail Archives'}