From pigbenjaminwalker@example.net Mon Mar 02 09:22:37 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 64152 invoked from network); 2 Mar 2009 09:22:37 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Mar 2009 09:22:37 -0000 Received: (qmail 13759 invoked by uid 500); 2 Mar 2009 09:22:36 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 13635 invoked by uid 500); 2 Mar 2009 09:22:36 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 12870 invoked by uid 99); 2 Mar 2009 09:22:34 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 01:22:34 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 09:22:33 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id CA3E8234C4AD for <benjaminwalker@example.net>; Mon, 2 Mar 2009 01:22:12 -0800 (PST) Message-ID: <1217742111.1235985732827.JavaMail.jira@brutus> Date: Mon, 2 Mar 2009 01:22:12 -0800 (PST) From: "Viraj Bhat (JIRA)" <benjaminwalker@example.net> To: benjaminwalker@example.net Subject: [jira] Created: (PIG-693) Parameter to UDF which is an alias returned in another UDF in nested foreach causes incorrect results MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org Parameter to UDF which is an alias returned in another UDF in nested foreach causes incorrect results ----------------------------------------------------------------------------------------------------- Key: PIG-693 URL: https://issues.apache.org/jira/browse/PIG-693 Project: Pig Issue Type: Bug Components: impl Affects Versions: types_branch Reporter: Viraj Bhat Fix For: types_branch Consider the following Pig Script {code} register myudf.jar; A = load 'one.txt' using PigStorage() as ( one: int ); --use this dummy file to start execution B = foreach A { dec = myudf.URLDECODE('hello'); str1 = myudf.REPLACEALL(dec, '[\\u0000-\\u0020]', ' '); -- ERROR str2 = myudf.REPLACEALL('hello', '[\\u0000-\\u0020]', ' '); generate dec, str1, str2; }; describe B; dump B; {code} where one.txt is a file which contains number one (1) for starting execution of the Pig script!! {code} describe B; {code} returns the following: B: {urldecode_9: chararray,replaceall_urldecode_10_11: chararray,replaceall_12: chararray} {code} dump B; {code} returns (hello,[\u0000-\u0020],hello) The result should be: There is a workaround for the same, {code} register myudf.jar; A = load 'one.txt' using PigStorage() as ( one: int ); B = foreach A { dec = myudf.URLDECODE('hello'); generate dec as dec, myudf.REPLACEALL(dec, '[\\u0000-\\u0020]', ' ') as str1, myudf.REPLACEALL('hello', '[\\u0000-\\u0020]', ' ') as str2; }; describe B; dump B; {code} where {code} dump B; {code} returns (hello,hello,hello) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From pigbenjaminwalker@example.net Mon Mar 02 09:34:34 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 75437 invoked from network); 2 Mar 2009 09:34:34 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Mar 2009 09:34:34 -0000 Received: (qmail 28150 invoked by uid 500); 2 Mar 2009 09:34:34 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 28020 invoked by uid 500); 2 Mar 2009 09:34:33 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 28009 invoked by uid 99); 2 Mar 2009 09:34:33 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 01:34:33 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 09:34:33 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id E2D4B234C48C for <benjaminwalker@example.net>; Mon, 2 Mar 2009 01:34:12 -0800 (PST) Message-ID: <1055987080.1235986452924.JavaMail.jira@brutus> Date: Mon, 2 Mar 2009 01:34:12 -0800 (PST) From: "Viraj Bhat (JIRA)" <benjaminwalker@example.net> To: benjaminwalker@example.net Subject: [jira] Updated: (PIG-693) Parameter to UDF which is an alias returned in another UDF in nested foreach causes incorrect results In-Reply-To: <1217742111.1235985732827.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Bhat updated PIG-693: --------------------------- Attachment: URLDECODE.java Eval UDF > Parameter to UDF which is an alias returned in another UDF in nested foreach causes incorrect results > ----------------------------------------------------------------------------------------------------- > > Key: PIG-693 > URL: https://issues.apache.org/jira/browse/PIG-693 > Project: Pig > Issue Type: Bug > Components: impl > Affects Versions: types_branch > Reporter: Viraj Bhat > Fix For: types_branch > > Attachments: URLDECODE.java > > > Consider the following Pig Script > {code} > register myudf.jar; > A = load 'one.txt' using PigStorage() as ( one: int ); --use this dummy file to start execution > B = foreach A { > dec = myudf.URLDECODE('hello'); > str1 = myudf.REPLACEALL(dec, '[\\u0000-\\u0020]', ' '); -- ERROR > str2 = myudf.REPLACEALL('hello', '[\\u0000-\\u0020]', ' '); > generate > dec, > str1, > str2; > }; > describe B; > dump B; > {code} > where one.txt is a file which contains number one (1) for starting execution of the Pig script!! > {code} > describe B; > {code} > returns the following: > B: {urldecode_9: chararray,replaceall_urldecode_10_11: chararray,replaceall_12: chararray} > {code} > dump B; > {code} > returns > (hello,[\u0000-\u0020],hello) > The result should be: > There is a workaround for the same, > {code} > register myudf.jar; > A = load 'one.txt' using PigStorage() as ( one: int ); > B = foreach A { > dec = myudf.URLDECODE('hello'); > generate > dec as dec, > myudf.REPLACEALL(dec, '[\\u0000-\\u0020]', ' ') as str1, > myudf.REPLACEALL('hello', '[\\u0000-\\u0020]', ' ') as str2; > }; > describe B; > dump B; > {code} > where > {code} > dump B; > {code} > returns (hello,hello,hello) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From pigbenjaminwalker@example.net Mon Mar 02 09:36:34 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 77357 invoked from network); 2 Mar 2009 09:36:33 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Mar 2009 09:36:33 -0000 Received: (qmail 29453 invoked by uid 500); 2 Mar 2009 09:36:33 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 29435 invoked by uid 500); 2 Mar 2009 09:36:33 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 29422 invoked by uid 99); 2 Mar 2009 09:36:33 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 01:36:33 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 09:36:33 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id EE683234C4AC for <benjaminwalker@example.net>; Mon, 2 Mar 2009 01:36:12 -0800 (PST) Message-ID: <549731922.1235986572975.JavaMail.jira@brutus> Date: Mon, 2 Mar 2009 01:36:12 -0800 (PST) From: "Viraj Bhat (JIRA)" <benjaminwalker@example.net> To: benjaminwalker@example.net Subject: [jira] Updated: (PIG-693) Parameter to UDF which is an alias returned in another UDF in nested foreach causes incorrect results In-Reply-To: <1217742111.1235985732827.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Bhat updated PIG-693: --------------------------- Attachment: one.txt Test input file to start execution > Parameter to UDF which is an alias returned in another UDF in nested foreach causes incorrect results > ----------------------------------------------------------------------------------------------------- > > Key: PIG-693 > URL: https://issues.apache.org/jira/browse/PIG-693 > Project: Pig > Issue Type: Bug > Components: impl > Affects Versions: types_branch > Reporter: Viraj Bhat > Fix For: types_branch > > Attachments: one.txt, REPLACEALL.java, URLDECODE.java > > > Consider the following Pig Script > {code} > register myudf.jar; > A = load 'one.txt' using PigStorage() as ( one: int ); --use this dummy file to start execution > B = foreach A { > dec = myudf.URLDECODE('hello'); > str1 = myudf.REPLACEALL(dec, '[\\u0000-\\u0020]', ' '); -- ERROR > str2 = myudf.REPLACEALL('hello', '[\\u0000-\\u0020]', ' '); > generate > dec, > str1, > str2; > }; > describe B; > dump B; > {code} > where one.txt is a file which contains number one (1) for starting execution of the Pig script!! > {code} > describe B; > {code} > returns the following: > B: {urldecode_9: chararray,replaceall_urldecode_10_11: chararray,replaceall_12: chararray} > {code} > dump B; > {code} > returns > (hello,[\u0000-\u0020],hello) > The result should be: > There is a workaround for the same, > {code} > register myudf.jar; > A = load 'one.txt' using PigStorage() as ( one: int ); > B = foreach A { > dec = myudf.URLDECODE('hello'); > generate > dec as dec, > myudf.REPLACEALL(dec, '[\\u0000-\\u0020]', ' ') as str1, > myudf.REPLACEALL('hello', '[\\u0000-\\u0020]', ' ') as str2; > }; > describe B; > dump B; > {code} > where > {code} > dump B; > {code} > returns (hello,hello,hello) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From pigbenjaminwalker@example.net Mon Mar 02 09:36:36 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 77419 invoked from network); 2 Mar 2009 09:36:36 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Mar 2009 09:36:36 -0000 Received: (qmail 29719 invoked by uid 500); 2 Mar 2009 09:36:36 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 29589 invoked by uid 500); 2 Mar 2009 09:36:36 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 29578 invoked by uid 99); 2 Mar 2009 09:36:36 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 01:36:36 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 09:36:34 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id DFD51234C48C for <benjaminwalker@example.net>; Mon, 2 Mar 2009 01:36:12 -0800 (PST) Message-ID: <62225017.1235986572902.JavaMail.jira@brutus> Date: Mon, 2 Mar 2009 01:36:12 -0800 (PST) From: "Viraj Bhat (JIRA)" <benjaminwalker@example.net> To: benjaminwalker@example.net Subject: [jira] Updated: (PIG-693) Parameter to UDF which is an alias returned in another UDF in nested foreach causes incorrect results In-Reply-To: <1217742111.1235985732827.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Bhat updated PIG-693: --------------------------- Attachment: REPLACEALL.java EVAL UDF > Parameter to UDF which is an alias returned in another UDF in nested foreach causes incorrect results > ----------------------------------------------------------------------------------------------------- > > Key: PIG-693 > URL: https://issues.apache.org/jira/browse/PIG-693 > Project: Pig > Issue Type: Bug > Components: impl > Affects Versions: types_branch > Reporter: Viraj Bhat > Fix For: types_branch > > Attachments: one.txt, REPLACEALL.java, URLDECODE.java > > > Consider the following Pig Script > {code} > register myudf.jar; > A = load 'one.txt' using PigStorage() as ( one: int ); --use this dummy file to start execution > B = foreach A { > dec = myudf.URLDECODE('hello'); > str1 = myudf.REPLACEALL(dec, '[\\u0000-\\u0020]', ' '); -- ERROR > str2 = myudf.REPLACEALL('hello', '[\\u0000-\\u0020]', ' '); > generate > dec, > str1, > str2; > }; > describe B; > dump B; > {code} > where one.txt is a file which contains number one (1) for starting execution of the Pig script!! > {code} > describe B; > {code} > returns the following: > B: {urldecode_9: chararray,replaceall_urldecode_10_11: chararray,replaceall_12: chararray} > {code} > dump B; > {code} > returns > (hello,[\u0000-\u0020],hello) > The result should be: > There is a workaround for the same, > {code} > register myudf.jar; > A = load 'one.txt' using PigStorage() as ( one: int ); > B = foreach A { > dec = myudf.URLDECODE('hello'); > generate > dec as dec, > myudf.REPLACEALL(dec, '[\\u0000-\\u0020]', ' ') as str1, > myudf.REPLACEALL('hello', '[\\u0000-\\u0020]', ' ') as str2; > }; > describe B; > dump B; > {code} > where > {code} > dump B; > {code} > returns (hello,hello,hello) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From pigbenjaminwalker@example.net Mon Mar 02 16:31:18 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 40657 invoked from network); 2 Mar 2009 16:31:18 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Mar 2009 16:31:18 -0000 Received: (qmail 68929 invoked by uid 500); 2 Mar 2009 16:31:17 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 68912 invoked by uid 500); 2 Mar 2009 16:31:17 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 68900 invoked by uid 99); 2 Mar 2009 16:31:17 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 08:31:17 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 16:31:16 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 2368F234C48C for <benjaminwalker@example.net>; Mon, 2 Mar 2009 08:30:56 -0800 (PST) Message-ID: <1584033305.1236011456129.JavaMail.jira@brutus> Date: Mon, 2 Mar 2009 08:30:56 -0800 (PST) From: "Olga Natkovich (JIRA)" <benjaminwalker@example.net> To: benjaminwalker@example.net Subject: [jira] Assigned: (PIG-532) Casting a field removes its alias. In-Reply-To: <1755307768.1226709165206.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-532: ---------------------------------- Assignee: Thejas M Nair > Casting a field removes its alias. > ---------------------------------- > > Key: PIG-532 > URL: https://issues.apache.org/jira/browse/PIG-532 > Project: Pig > Issue Type: Bug > Components: impl > Affects Versions: types_branch > Reporter: Alan Gates > Assignee: Thejas M Nair > Priority: Minor > Fix For: types_branch > > > Given a script like: > {code} > a = loader 'myfile' as (x, y); > b = foreach a generate (int)x, (double)y; > c = group a by x; > {code} > you will get an error that x is an unknown alias. The cast operator is not carrying through the alias. It should. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From pigbenjaminwalker@example.net Mon Mar 02 19:19:21 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 39054 invoked from network); 2 Mar 2009 19:19:18 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Mar 2009 19:19:18 -0000 Received: (qmail 40378 invoked by uid 500); 2 Mar 2009 19:19:18 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 40360 invoked by uid 500); 2 Mar 2009 19:19:18 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 40349 invoked by uid 99); 2 Mar 2009 19:19:17 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 11:19:17 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 19:19:16 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 53005234C4A8 for <benjaminwalker@example.net>; Mon, 2 Mar 2009 11:18:56 -0800 (PST) Message-ID: <222631920.1236021536338.JavaMail.jira@brutus> Date: Mon, 2 Mar 2009 11:18:56 -0800 (PST) From: "Thejas M Nair (JIRA)" <benjaminwalker@example.net> To: benjaminwalker@example.net Subject: [jira] Updated: (PIG-684) outputSchema method in TOKENIZE is broken In-Reply-To: <355303103.1235073001772.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated PIG-684: ------------------------------ Attachment: (was: PIG-684.txt) > outputSchema method in TOKENIZE is broken > ----------------------------------------- > > Key: PIG-684 > URL: https://issues.apache.org/jira/browse/PIG-684 > Project: Pig > Issue Type: Bug > Components: impl > Affects Versions: types_branch > Reporter: Santhosh Srinivasan > Assignee: Thejas M Nair > Fix For: types_branch > > > The outputSchema method in TOKENIZE is broken. It should return a bag with a tuple that contains a string and not just a string. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From pigbenjaminwalker@example.net Mon Mar 02 19:23:18 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 40824 invoked from network); 2 Mar 2009 19:23:18 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Mar 2009 19:23:18 -0000 Received: (qmail 45496 invoked by uid 500); 2 Mar 2009 19:23:17 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 45474 invoked by uid 500); 2 Mar 2009 19:23:17 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 45460 invoked by uid 99); 2 Mar 2009 19:23:17 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 11:23:17 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 19:23:16 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 3C74E234C48C for <benjaminwalker@example.net>; Mon, 2 Mar 2009 11:22:56 -0800 (PST) Message-ID: <1736270935.1236021776178.JavaMail.jira@brutus> Date: Mon, 2 Mar 2009 11:22:56 -0800 (PST) From: "Thejas M Nair (JIRA)" <benjaminwalker@example.net> To: benjaminwalker@example.net Subject: [jira] Updated: (PIG-684) outputSchema method in TOKENIZE is broken In-Reply-To: <355303103.1235073001772.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated PIG-684: ------------------------------ Attachment: PIG-684.txt Updated patch. (Patch updated to add bagSchema.setTwoLevelAccessRequired(true); in TOKENIZE.java to handle the use of flatten(TOKENIZE(..)) ) > outputSchema method in TOKENIZE is broken > ----------------------------------------- > > Key: PIG-684 > URL: https://issues.apache.org/jira/browse/PIG-684 > Project: Pig > Issue Type: Bug > Components: impl > Affects Versions: types_branch > Reporter: Santhosh Srinivasan > Assignee: Thejas M Nair > Fix For: types_branch > > Attachments: PIG-684.txt > > > The outputSchema method in TOKENIZE is broken. It should return a bag with a tuple that contains a string and not just a string. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From pigbenjaminwalker@example.net Mon Mar 02 22:57:19 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 33171 invoked from network); 2 Mar 2009 22:57:19 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Mar 2009 22:57:19 -0000 Received: (qmail 30011 invoked by uid 500); 2 Mar 2009 22:57:19 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 29987 invoked by uid 500); 2 Mar 2009 22:57:19 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 29976 invoked by uid 99); 2 Mar 2009 22:57:19 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 14:57:19 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 22:57:17 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 4199B234C4B6 for <benjaminwalker@example.net>; Mon, 2 Mar 2009 14:56:56 -0800 (PST) Message-ID: <1657195246.1236034616267.JavaMail.jira@brutus> Date: Mon, 2 Mar 2009 14:56:56 -0800 (PST) From: "Santhosh Srinivasan (JIRA)" <benjaminwalker@example.net> To: benjaminwalker@example.net Subject: [jira] Commented: (PIG-684) outputSchema method in TOKENIZE is broken In-Reply-To: <355303103.1235073001772.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12678145#action_12678145 ] Santhosh Srinivasan commented on PIG-684: ----------------------------------------- I am reviewing this patch > outputSchema method in TOKENIZE is broken > ----------------------------------------- > > Key: PIG-684 > URL: https://issues.apache.org/jira/browse/PIG-684 > Project: Pig > Issue Type: Bug > Components: impl > Affects Versions: types_branch > Reporter: Santhosh Srinivasan > Assignee: Thejas M Nair > Fix For: types_branch > > Attachments: PIG-684.txt > > > The outputSchema method in TOKENIZE is broken. It should return a bag with a tuple that contains a string and not just a string. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From pigbenjaminwalker@example.net Mon Mar 02 23:03:39 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 34861 invoked from network); 2 Mar 2009 23:03:39 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Mar 2009 23:03:39 -0000 Received: (qmail 37959 invoked by uid 500); 2 Mar 2009 23:03:21 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 37931 invoked by uid 500); 2 Mar 2009 23:03:21 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 37907 invoked by uid 99); 2 Mar 2009 23:03:21 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 15:03:21 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 23:03:16 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 08BF2234C4A8 for <benjaminwalker@example.net>; Mon, 2 Mar 2009 15:02:56 -0800 (PST) Message-ID: <1206451783.1236034976020.JavaMail.jira@brutus> Date: Mon, 2 Mar 2009 15:02:56 -0800 (PST) From: "Santhosh Srinivasan (JIRA)" <benjaminwalker@example.net> To: benjaminwalker@example.net Subject: [jira] Commented: (PIG-684) outputSchema method in TOKENIZE is broken In-Reply-To: <355303103.1235073001772.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12678148#action_12678148 ] Santhosh Srinivasan commented on PIG-684: ----------------------------------------- Review Comment: Index: src/org/apache/pig/builtin/TOKENIZE.java ====================================== The RuntimeException should have a reasonable error message. Otherwise it make it hard for users and developers to make sense of the exception. There are two possible options: 1. Include an appropriate message (preferred) OR 2. return a NULL schema. {code} + // throwing RTE because + //above schema creation is not expected to throw an exception + // and also because superclass does not throw exception + throw new RuntimeException(); {code} > outputSchema method in TOKENIZE is broken > ----------------------------------------- > > Key: PIG-684 > URL: https://issues.apache.org/jira/browse/PIG-684 > Project: Pig > Issue Type: Bug > Components: impl > Affects Versions: types_branch > Reporter: Santhosh Srinivasan > Assignee: Thejas M Nair > Fix For: types_branch > > Attachments: PIG-684.txt > > > The outputSchema method in TOKENIZE is broken. It should return a bag with a tuple that contains a string and not just a string. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From pigbenjaminwalker@example.net Mon Mar 02 23:14:30 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 37802 invoked from network); 2 Mar 2009 23:14:29 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Mar 2009 23:14:29 -0000 Received: (qmail 54891 invoked by uid 500); 2 Mar 2009 23:14:20 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 54875 invoked by uid 500); 2 Mar 2009 23:14:20 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 54836 invoked by uid 99); 2 Mar 2009 23:14:20 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 15:14:20 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 23:14:19 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 363A7234C4A8 for <benjaminwalker@example.net>; Mon, 2 Mar 2009 15:13:59 -0800 (PST) Message-ID: <1870920895.1236035639180.JavaMail.jira@brutus> Date: Mon, 2 Mar 2009 15:13:59 -0800 (PST) From: "Pradeep Kamath (JIRA)" <benjaminwalker@example.net> To: benjaminwalker@example.net Subject: [jira] Updated: (PIG-691) BinStorage skips tuples when ^A is present in data In-Reply-To: <1462471437.1235767992849.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-691: ------------------------------- Fix Version/s: types_branch Affects Version/s: types_branch Status: Patch Available (was: Open) Binstorage uses RECORD_1, RECORD_2 and RECORD_3 byte markers (the bytes 0x01, 0x02, 0x03) as the beginning of a new record. The current bug in BinStorage is that in getNext(), the code looks for RECORD_1 and if it finds RECORD_1, it looks for RECORD_2. If it fails to find RECORD_2, it goes back to look for entire sequence starting with looking for RECORD_1. However this failes when we have the following sequence:RECORD_1-RECORD_1-RECORD_2-RECORD_3. After reading the second RECORD_1 in the above sequence, we should not look for RECORD_1 again but start by looking for RECORD_2. This is an issue only when a record in binstorage spans two blocks and the part in the head of the second block has the above sequence. This can happen when the last field in the record is null (null is represented by the byte 0x01 which is RECORD_1). The attached patch fixes this issue. > BinStorage skips tuples when ^A is present in data > -------------------------------------------------- > > Key: PIG-691 > URL: https://issues.apache.org/jira/browse/PIG-691 > Project: Pig > Issue Type: Bug > Affects Versions: types_branch > Reporter: Olga Natkovich > Assignee: Pradeep Kamath > Fix For: types_branch > > > Pradeep found a problem with BinStorage.getNext function that causes data loss. He is working on the fix -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From pigbenjaminwalker@example.net Mon Mar 02 23:16:19 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 38516 invoked from network); 2 Mar 2009 23:16:19 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Mar 2009 23:16:19 -0000 Received: (qmail 59055 invoked by uid 500); 2 Mar 2009 23:16:18 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 59031 invoked by uid 500); 2 Mar 2009 23:16:18 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 59020 invoked by uid 99); 2 Mar 2009 23:16:18 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 15:16:18 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 23:16:17 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 1F2FA234C4A8 for <benjaminwalker@example.net>; Mon, 2 Mar 2009 15:15:56 -0800 (PST) Message-ID: <1482509334.1236035756112.JavaMail.jira@brutus> Date: Mon, 2 Mar 2009 15:15:56 -0800 (PST) From: "Pradeep Kamath (JIRA)" <benjaminwalker@example.net> To: benjaminwalker@example.net Subject: [jira] Updated: (PIG-691) BinStorage skips tuples when ^A is present in data In-Reply-To: <1462471437.1235767992849.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-691: ------------------------------- Attachment: PIG-691.patch > BinStorage skips tuples when ^A is present in data > -------------------------------------------------- > > Key: PIG-691 > URL: https://issues.apache.org/jira/browse/PIG-691 > Project: Pig > Issue Type: Bug > Affects Versions: types_branch > Reporter: Olga Natkovich > Assignee: Pradeep Kamath > Fix For: types_branch > > Attachments: PIG-691.patch > > > Pradeep found a problem with BinStorage.getNext function that causes data loss. He is working on the fix -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From pigbenjaminwalker@example.net Mon Mar 02 23:58:19 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 50819 invoked from network); 2 Mar 2009 23:58:19 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Mar 2009 23:58:19 -0000 Received: (qmail 95253 invoked by uid 500); 2 Mar 2009 23:58:19 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 95231 invoked by uid 500); 2 Mar 2009 23:58:19 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 95220 invoked by uid 99); 2 Mar 2009 23:58:19 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 15:58:19 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 23:58:17 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id A3C6B234C4AC for <benjaminwalker@example.net>; Mon, 2 Mar 2009 15:57:56 -0800 (PST) Message-ID: <1860795797.1236038276655.JavaMail.jira@brutus> Date: Mon, 2 Mar 2009 15:57:56 -0800 (PST) From: "Santhosh Srinivasan (JIRA)" <benjaminwalker@example.net> To: benjaminwalker@example.net Subject: [jira] Commented: (PIG-691) BinStorage skips tuples when ^A is present in data In-Reply-To: <1462471437.1235767992849.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12678165#action_12678165 ] Santhosh Srinivasan commented on PIG-691: ----------------------------------------- I will be reviewing this patch. > BinStorage skips tuples when ^A is present in data > -------------------------------------------------- > > Key: PIG-691 > URL: https://issues.apache.org/jira/browse/PIG-691 > Project: Pig > Issue Type: Bug > Affects Versions: types_branch > Reporter: Olga Natkovich > Assignee: Pradeep Kamath > Fix For: types_branch > > Attachments: PIG-691.patch > > > Pradeep found a problem with BinStorage.getNext function that causes data loss. He is working on the fix -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From pigbenjaminwalker@example.net Tue Mar 03 02:33:19 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 24626 invoked from network); 3 Mar 2009 02:33:19 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Mar 2009 02:33:19 -0000 Received: (qmail 96088 invoked by uid 500); 3 Mar 2009 02:33:18 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 96058 invoked by uid 500); 3 Mar 2009 02:33:18 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 95553 invoked by uid 99); 3 Mar 2009 02:33:18 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 18:33:17 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Mar 2009 02:33:16 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 444F0234C4AF for <benjaminwalker@example.net>; Mon, 2 Mar 2009 18:32:56 -0800 (PST) Message-ID: <1358312562.1236047576272.JavaMail.jira@brutus> Date: Mon, 2 Mar 2009 18:32:56 -0800 (PST) From: "Pradeep Kamath (JIRA)" <benjaminwalker@example.net> To: benjaminwalker@example.net Subject: [jira] Updated: (PIG-690) UNION doesn't work in the latest code In-Reply-To: <458955339.1235736012675.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-690: ------------------------------- Fix Version/s: types_branch Assignee: Pradeep Kamath Affects Version/s: types_branch Status: Patch Available (was: Open) The root cause of the issue is while merging schemas, the code recursively merges subschemas if a field is a tuple or a bag. At that point, it does not properly attribute the type to be bag if that was the case. It always marks the type as tuple whenever the field schema is of type bag or tuple. This is fixed in the patch and a unit test case has been added which tries to union two relations which have a bag field. > UNION doesn't work in the latest code > ------------------------------------- > > Key: PIG-690 > URL: https://issues.apache.org/jira/browse/PIG-690 > Project: Pig > Issue Type: Bug > Affects Versions: types_branch > Environment: mapred mode. local mode.has the same problem under linux. > code is taken from trunk > Reporter: Amir Youssefi > Assignee: Pradeep Kamath > Fix For: types_branch > > Attachments: PIG-690.patch > > > grunt> a = load 'tmp/f1' using BinStorage(); > grunt> b = load 'tmp/f2' using BinStorage(); > grunt> describe a; > a: {int,chararray,int,{(int,chararray,chararray)}} > grunt> describe b; > b: {int,chararray,int,{(int,chararray,chararray)}} > grunt> c = union a,b; > grunt> describe c; > 2009-02-27 11:51:46,012 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1052: Cannot cast bag with schema bag({(int,chararray,chararray)}) to tuple with schema tuple > Details at logfile: /homes/amiry/pig_1235735380348.log > dump a and dump b work fine. > Sample data provided to dev team in an e-mail. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From pigbenjaminwalker@example.net Tue Mar 03 02:33:21 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 24754 invoked from network); 3 Mar 2009 02:33:20 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Mar 2009 02:33:20 -0000 Received: (qmail 96228 invoked by uid 500); 3 Mar 2009 02:33:20 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 96211 invoked by uid 500); 3 Mar 2009 02:33:20 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 96200 invoked by uid 99); 3 Mar 2009 02:33:20 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 18:33:20 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Mar 2009 02:33:17 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 51845234C4B4 for <benjaminwalker@example.net>; Mon, 2 Mar 2009 18:32:56 -0800 (PST) Message-ID: <1505343064.1236047576313.JavaMail.jira@brutus> Date: Mon, 2 Mar 2009 18:32:56 -0800 (PST) From: "Pradeep Kamath (JIRA)" <benjaminwalker@example.net> To: benjaminwalker@example.net Subject: [jira] Updated: (PIG-690) UNION doesn't work in the latest code In-Reply-To: <458955339.1235736012675.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-690: ------------------------------- Attachment: PIG-690.patch > UNION doesn't work in the latest code > ------------------------------------- > > Key: PIG-690 > URL: https://issues.apache.org/jira/browse/PIG-690 > Project: Pig > Issue Type: Bug > Affects Versions: types_branch > Environment: mapred mode. local mode.has the same problem under linux. > code is taken from trunk > Reporter: Amir Youssefi > Assignee: Pradeep Kamath > Fix For: types_branch > > Attachments: PIG-690.patch > > > grunt> a = load 'tmp/f1' using BinStorage(); > grunt> b = load 'tmp/f2' using BinStorage(); > grunt> describe a; > a: {int,chararray,int,{(int,chararray,chararray)}} > grunt> describe b; > b: {int,chararray,int,{(int,chararray,chararray)}} > grunt> c = union a,b; > grunt> describe c; > 2009-02-27 11:51:46,012 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1052: Cannot cast bag with schema bag({(int,chararray,chararray)}) to tuple with schema tuple > Details at logfile: /homes/amiry/pig_1235735380348.log > dump a and dump b work fine. > Sample data provided to dev team in an e-mail. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From pigbenjaminwalker@example.net Tue Mar 03 02:37:17 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 26934 invoked from network); 3 Mar 2009 02:37:17 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Mar 2009 02:37:17 -0000 Received: (qmail 97976 invoked by uid 500); 3 Mar 2009 02:37:17 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 97959 invoked by uid 500); 3 Mar 2009 02:37:17 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 97948 invoked by uid 99); 3 Mar 2009 02:37:17 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 18:37:17 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Mar 2009 02:37:16 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 1201E234C4AC for <benjaminwalker@example.net>; Mon, 2 Mar 2009 18:36:56 -0800 (PST) Message-ID: <1154091720.1236047816059.JavaMail.jira@brutus> Date: Mon, 2 Mar 2009 18:36:56 -0800 (PST) From: "Pradeep Kamath (JIRA)" <benjaminwalker@example.net> To: benjaminwalker@example.net Subject: [jira] Commented: (PIG-655) Comparison of schemas of bincond operands is flawed In-Reply-To: <643323788.1233790919619.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12678210#action_12678210 ] Pradeep Kamath commented on PIG-655: ------------------------------------ I will be reviewing this patch > Comparison of schemas of bincond operands is flawed > --------------------------------------------------- > > Key: PIG-655 > URL: https://issues.apache.org/jira/browse/PIG-655 > Project: Pig > Issue Type: Bug > Components: impl > Affects Versions: types_branch > Reporter: Santhosh Srinivasan > Assignee: Santhosh Srinivasan > Fix For: types_branch > > Attachments: PIG-655.patch > > > The comparison of schemas of bincond is flawed. Instead of comparing the field schemas, the type checker is comparing the schemas. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From pigbenjaminwalker@example.net Tue Mar 03 02:55:19 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 31787 invoked from network); 3 Mar 2009 02:55:19 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Mar 2009 02:55:19 -0000 Received: (qmail 2358 invoked by uid 500); 3 Mar 2009 02:55:19 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 2324 invoked by uid 500); 3 Mar 2009 02:55:19 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 2313 invoked by uid 99); 3 Mar 2009 02:55:19 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 18:55:19 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Mar 2009 02:55:17 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 1DBCE234C4AC for <benjaminwalker@example.net>; Mon, 2 Mar 2009 18:54:56 -0800 (PST) Message-ID: <5068934660.1236048896106.JavaMail.jira@brutus> Date: Mon, 2 Mar 2009 18:54:56 -0800 (PST) From: "Pradeep Kamath (JIRA)" <benjaminwalker@example.net> To: benjaminwalker@example.net Subject: [jira] Commented: (PIG-655) Comparison of schemas of bincond operands is flawed In-Reply-To: <643323788.1233790919619.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12678213#action_12678213 ] Pradeep Kamath commented on PIG-655: ------------------------------------ +1, Patch committed. Thanks for the contribution Santhosh. > Comparison of schemas of bincond operands is flawed > --------------------------------------------------- > > Key: PIG-655 > URL: https://issues.apache.org/jira/browse/PIG-655 > Project: Pig > Issue Type: Bug > Components: impl > Affects Versions: types_branch > Reporter: Santhosh Srinivasan > Assignee: Santhosh Srinivasan > Fix For: types_branch > > Attachments: PIG-655.patch > > > The comparison of schemas of bincond is flawed. Instead of comparing the field schemas, the type checker is comparing the schemas. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From pigbenjaminwalker@example.net Tue Mar 03 04:27:19 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 57377 invoked from network); 3 Mar 2009 04:27:19 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Mar 2009 04:27:19 -0000 Received: (qmail 63554 invoked by uid 500); 3 Mar 2009 04:27:19 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 63534 invoked by uid 500); 3 Mar 2009 04:27:19 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 63523 invoked by uid 99); 3 Mar 2009 04:27:19 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 20:27:19 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Mar 2009 04:27:17 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 1BA11234C4AC for <benjaminwalker@example.net>; Mon, 2 Mar 2009 20:26:56 -0800 (PST) Message-ID: <944384791.1236054416097.JavaMail.jira@brutus> Date: Mon, 2 Mar 2009 20:26:56 -0800 (PST) From: "Santhosh Srinivasan (JIRA)" <benjaminwalker@example.net> To: benjaminwalker@example.net Subject: [jira] Updated: (PIG-691) BinStorage skips tuples when ^A is present in data In-Reply-To: <1462471437.1235767992849.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-691: ------------------------------------ Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Patch has been comiited. Thanks for the fix Pradeep. > BinStorage skips tuples when ^A is present in data > -------------------------------------------------- > > Key: PIG-691 > URL: https://issues.apache.org/jira/browse/PIG-691 > Project: Pig > Issue Type: Bug > Affects Versions: types_branch > Reporter: Olga Natkovich > Assignee: Pradeep Kamath > Fix For: types_branch > > Attachments: PIG-691.patch > > > Pradeep found a problem with BinStorage.getNext function that causes data loss. He is working on the fix -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From pigbenjaminwalker@example.net Tue Mar 03 04:29:19 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 57897 invoked from network); 3 Mar 2009 04:29:19 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Mar 2009 04:29:19 -0000 Received: (qmail 64498 invoked by uid 500); 3 Mar 2009 04:29:19 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 64478 invoked by uid 500); 3 Mar 2009 04:29:19 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 64467 invoked by uid 99); 3 Mar 2009 04:29:19 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2009 20:29:19 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Mar 2009 04:29:17 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 252C7234C4AC for <benjaminwalker@example.net>; Mon, 2 Mar 2009 20:28:56 -0800 (PST) Message-ID: <5068934660.1236054536137.JavaMail.jira@brutus> Date: Mon, 2 Mar 2009 20:28:56 -0800 (PST) From: "Santhosh Srinivasan (JIRA)" <benjaminwalker@example.net> To: benjaminwalker@example.net Subject: [jira] Updated: (PIG-684) outputSchema method in TOKENIZE is broken In-Reply-To: <355303103.1235073001772.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-684: ------------------------------------ Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Patch has been committed. Thanks for the fix Tejas. > outputSchema method in TOKENIZE is broken > ----------------------------------------- > > Key: PIG-684 > URL: https://issues.apache.org/jira/browse/PIG-684 > Project: Pig > Issue Type: Bug > Components: impl > Affects Versions: types_branch > Reporter: Santhosh Srinivasan > Assignee: Thejas M Nair > Fix For: types_branch > > Attachments: PIG-684.txt > > > The outputSchema method in TOKENIZE is broken. It should return a bag with a tuple that contains a string and not just a string. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From pigbenjaminwalker@example.net Tue Mar 03 16:55:15 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 10034 invoked from network); 3 Mar 2009 16:55:14 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Mar 2009 16:55:14 -0000 Received: (qmail 24250 invoked by uid 500); 3 Mar 2009 16:55:14 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 24116 invoked by uid 500); 3 Mar 2009 16:55:14 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 23864 invoked by uid 99); 3 Mar 2009 16:55:13 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Mar 2009 08:55:13 -0800 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [83.161.120.155] (HELO mrout2.yahoo.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Mar 2009 16:55:03 +0000 Received: from [83.161.120.155] (snvvpn1-10-73-153-c65.hq.corp.yahoo.com [83.161.120.155]) by mrout2.yahoo.com (8.13.6/8.13.6/y.out) with ESMTP id n23GsV1p064448; Tue, 3 Mar 2009 08:54:31 -0800 (PST) DomainKey-Signature: a=rsa-sha1; s=serpent; d=yahoo-inc.com; c=nofws; q=dns; h=message-id:from:to:content-type: content-transfer-encoding:mime-version:subject:date:references:x-mailer; b=kaYEvtIrhVOES19FM1Rt8ttPSHg2cDWzPMgE/8r3s9RZNau7pZKL9MKrCLqByxs8 Message-Id: <benjaminwalker@example.net> From: Alan Gates <benjaminwalker@example.net> To: benjaminwalker@example.net, benjaminwalker@example.net Content-Type: text/plain; charset=GB2312; format=flowed; delsp=yes Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Apple Message framework v930.3) Subject: Fwd: Core For Paper ---- Grid and Cloud Middleware Workshop, in conjunction with GCC2009 Date: Tue, 3 Mar 2009 08:54:31 -0800 References: <benjaminwalker@example.net> X-Mailer: Apple Mail (2.930.3) X-Virus-Checked: Checked by ClamAV on apache.org Begin forwarded message: > From: Yongqiang He <benjaminwalker@example.net> > Date: March 1, 2009 10:18:03 PM PST > To: "benjaminwalker@example.net" <benjaminwalker@example.net>, = "benjaminwalker@example.net=20 > " <benjaminwalker@example.net>, "benjaminwalker@example.net" = <benjaminwalker@example.net=20 > >, "benjaminwalker@example.net" <benjaminwalker@example.net>, = "benjaminwalker@example.net=20 > " <benjaminwalker@example.net> > Subject: Core For Paper ---- Grid and Cloud Middleware Workshop, in =20= > conjunction with GCC2009 > Reply-To: benjaminwalker@example.net > > Call for Paper > The grid and cloud computing technologies both aim to aggregate =20 > distributed > resources in local- or wide-area environment and to provide a uniform > computing environment. The fundamental of grid and cloud systems is =20= > the > underlying middleware which sustains the variety of applications by =20= > system > level abstracts and common functionalities. The grid and cloud =20 > middleware > synthesizes multiple similar research issues. Software architecture, =20= > naming > space, distributed data organization and storage, high performance =20 > data > processing, task scheduling and so on are all corresponding focuses. =20= > This > workshop is conveyed to promote the related information exchange and > communication. We also hope to advance the research and development =20= > of grid > and cloud middleware. Topics include but are not limited to: > > l Middleware architecture and implementation, > l Virtualization, isolation and multi-tenant environment, > l Distributed information organization, > l Structured, semi-structured and unstructured data management =20= > and > processing, > l Map-Reduce or other novel programming models, > l Language, language extension and tools for large scale =20 > computing, > l Performance analysis/benchmark, > l Web based user interface, > l Scheduling, security, monitoring, and accounting, > l Application or case study. > > Important dates > Deadline of submission April 15, 2009 > Notification of acceptance May 15, 2009 > Delivery of camera-ready June 5, 2009 > > For More, Please Visit: = http://grid.lzu.edu.cn/gcc2009/item/item.jsp?id=3D5 > > --=20 > Best regards! > > He Yongqiang > Email: benjaminwalker@example.net > Tel: 86-10-62600969(O) > Fax=A3=BA86-10-626000900 > Key Laboratory of Network Science and Technology/ > Research Center for Grid and Service Computing, > Institute of Computing Technology, Chinese Academy of Sciences, > No.3 Kexueyuan South Road, > Beijing 100190, China > > From pigbenjaminwalker@example.net Tue Mar 03 18:09:27 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 49836 invoked from network); 3 Mar 2009 18:09:27 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Mar 2009 18:09:27 -0000 Received: (qmail 90380 invoked by uid 500); 3 Mar 2009 18:09:19 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 90360 invoked by uid 500); 3 Mar 2009 18:09:19 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 90327 invoked by uid 99); 3 Mar 2009 18:09:19 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Mar 2009 10:09:19 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Mar 2009 18:09:17 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id 3A122234C4AA for <benjaminwalker@example.net>; Tue, 3 Mar 2009 10:08:56 -0800 (PST) Message-ID: <65056519.1236103736221.JavaMail.jira@brutus> Date: Tue, 3 Mar 2009 10:08:56 -0800 (PST) From: "Alan Gates (JIRA)" <benjaminwalker@example.net> To: benjaminwalker@example.net Subject: [jira] Commented: (PIG-692) when running script file, automatically set up job name based on the file name In-Reply-To: <1900274474.1235788392697.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12678376#action_12678376 ] Alan Gates commented on PIG-692: -------------------------------- I'm reviewing this script. > when running script file, automatically set up job name based on the file name > ------------------------------------------------------------------------------ > > Key: PIG-692 > URL: https://issues.apache.org/jira/browse/PIG-692 > Project: Pig > Issue Type: Improvement > Components: tools > Affects Versions: types_branch > Reporter: Vadim Zaliva > Priority: Trivial > Fix For: types_branch > > Attachments: pig-job-name.patch > > > When running pig script from command like like this: > pig scriptfile > right now default job name is used. it is convenient to have it automatically set up based on the script name. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. From pigbenjaminwalker@example.net Tue Mar 03 18:43:18 2009 Return-Path: <pigbenjaminwalker@example.net> Delivered-To: benjaminwalker@example.net Received: (qmail 81200 invoked from network); 3 Mar 2009 18:43:18 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Mar 2009 18:43:18 -0000 Received: (qmail 48671 invoked by uid 500); 3 Mar 2009 18:43:17 -0000 Delivered-To: benjaminwalker@example.net Received: (qmail 48651 invoked by uid 500); 3 Mar 2009 18:43:17 -0000 Mailing-List: contact benjaminwalker@example.net; run by ezmlm Precedence: bulk List-Help: <mailto:benjaminwalker@example.net> List-Unsubscribe: <mailto:benjaminwalker@example.net> List-Post: <mailto:benjaminwalker@example.net> List-Id: <pig-dev.hadoop.apache.org> Reply-To: benjaminwalker@example.net Delivered-To: mailing list benjaminwalker@example.net Received: (qmail 48640 invoked by uid 99); 3 Mar 2009 18:43:17 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Mar 2009 10:43:17 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO brutus.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Mar 2009 18:43:16 +0000 Received: from brutus (localhost [83.161.120.155]) by brutus.apache.org (Postfix) with ESMTP id A77FE234C4B5 for <benjaminwalker@example.net>; Tue, 3 Mar 2009 10:42:56 -0800 (PST) Message-ID: <1814064718.1236105776685.JavaMail.jira@brutus> Date: Tue, 3 Mar 2009 10:42:56 -0800 (PST) From: "Santhosh Srinivasan (JIRA)" <benjaminwalker@example.net> To: benjaminwalker@example.net Subject: [jira] Updated: (PIG-577) outer join query looses name information In-Reply-To: <1803982068.1230080684165.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-577: ------------------------------------ Patch Info: [Patch Available] > outer join query looses name information > ---------------------------------------- > > Key: PIG-577 > URL: https://issues.apache.org/jira/browse/PIG-577 > Project: Pig > Issue Type: Bug > Affects Versions: types_branch > Reporter: Olga Natkovich > Assignee: Santhosh Srinivasan > Fix For: types_branch > > Attachments: PIG-577.patch > > > The following query: > A = LOAD 'student_data' AS (name: chararray, age: int, gpa: float); > B = LOAD 'voter_data' AS (name: chararray, age: int, registration: chararray, contributions: float); > C = COGROUP A BY name, B BY name; > D = FOREACH C GENERATE group, flatten((IsEmpty(A) ? null : A)), flatten((IsEmpty(B) ? null : B)); > describe D; > E = FOREACH D GENERATE 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4gpa, 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4contributions; > Give the following error: (Even though describe shows correct information: D: {group: chararray,888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4name: chararray,888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4age: int,888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4gpa: float,888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4name: chararray,888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4age: int,888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4registration: chararray,888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4contributions: float} > java.io.IOException: Invalid alias: 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4gpa in {group: chararray,bytearray,bytearray} > at org.apache.pig.PigServer.parseQuery(PigServer.java:298) > at org.apache.pig.PigServer.registerQuery(PigServer.java:263) > at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:439) > at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:249) > at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:84) > at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:64) > at org.apache.pig.Main.main(Main.java:306) > Caused by: org.apache.pig.impl.logicalLayer.parser.ParseException: Invalid alias: 888a:dbb7:2d49:b3f6:8605:bf4e:caed:e5a4gpa in {group: chararray,bytearray,bytearray} > at org.apache.pig.impl.logicalLayer.parser.QueryParser.AliasFieldOrSpec(QueryParser.java:5930) > at org.apache.pig.impl.logicalLayer.parser.QueryParser.ColOrSpec(QueryParser.java:5788) > at org.apache.pig.impl.logicalLayer.parser.QueryParser.BaseEvalSpec(QueryParser.java:3974) > at org.apache.pig.impl.logicalLayer.parser.QueryParser.UnaryExpr(QueryParser.java:3871) > at org.apache.pig.impl.logicalLayer.parser.QueryParser.CastExpr(QueryParser.java:3825) > at org.apache.pig.impl.logicalLayer.parser.QueryParser.MultiplicativeExpr(QueryParser.java:3734) > at org.apache.pig.impl.logicalLayer.parser.QueryParser.AdditiveExpr(QueryParser.java:3660) > at org.apache.pig.impl.logicalLayer.parser.QueryParser.InfixExpr(QueryParser.java:3626) > at org.apache.pig.impl.logicalLayer.parser.QueryParser.FlattenedGenerateItem(QueryParser.java:3552) > at org.apache.pig.impl.logicalLayer.parser.QueryParser.FlattenedGenerateItemList(QueryParser.java:3462) > at org.apache.pig.impl.logicalLayer.parser.QueryParser.GenerateStatement(QueryParser.java:3419) > at org.apache.pig.impl.logicalLayer.parser.QueryParser.NestedBlock(QueryParser.java:2894) > at org.apache.pig.impl.logicalLayer.parser.QueryParser.ForEachClause(QueryParser.java:2309) > at org.apache.pig.impl.logicalLayer.parser.QueryParser.BaseExpr(QueryParser.java:966) > at org.apache.pig.impl.logicalLayer.parser.QueryParser.Expr(QueryParser.java:742) > at org.apache.pig.impl.logicalLayer.parser.QueryParser.Parse(QueryParser.java:537) > at org.apache.pig.impl.logicalLayer.LogicalPlanBuilder.parse(LogicalPlanBuilder.java:60) > at org.apache.pig.PigServer.parseQuery(PigServer.java:295) > ... 6 more -- This message is automatically generated by JIRA. -
{'source': 'Apache Software Foundation Public Mail Archives'}