Daniel Dai (JIRA | 21 Sep 06:30 2014
Picon

[Resolved] (PIG-4187) Fix Orc e2e tests


     [
https://issues.apache.org/jira/browse/PIG-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai resolved PIG-4187.
-----------------------------
      Resolution: Fixed
    Hadoop Flags: Reviewed

Patch committed to trunk. Thanks Rohini for review!

> Fix Orc e2e tests
> -----------------
>
>                 Key: PIG-4187
>                 URL: https://issues.apache.org/jira/browse/PIG-4187
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.14.0
>
>         Attachments: PIG-4187-1.patch
>
>
> Several Orc e2e tests still fail on trunk. There are several causes:
> 1. kryo.jar is missing if using PPD
> 2. UDFContext.tss is not updated in tez container reuse (Orc_3 on tez fail, the second vertex get old UDFContext)
> 3. An old time bug PreCombinerLocalRearrange inner plan does not reset parentPlan (Orc_3 on mr fail, the
(Continue reading)

Rohini Palaniswamy (JIRA | 20 Sep 23:11 2014
Picon

[Commented] (PIG-4187) Fix Orc e2e tests


    [
https://issues.apache.org/jira/browse/PIG-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14142202#comment-14142202
] 

Rohini Palaniswamy commented on PIG-4187:
-----------------------------------------

+1

> Fix Orc e2e tests
> -----------------
>
>                 Key: PIG-4187
>                 URL: https://issues.apache.org/jira/browse/PIG-4187
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.14.0
>
>         Attachments: PIG-4187-1.patch
>
>
> Several Orc e2e tests still fail on trunk. There are several causes:
> 1. kryo.jar is missing if using PPD
> 2. UDFContext.tss is not updated in tez container reuse (Orc_3 on tez fail, the second vertex get old UDFContext)
> 3. An old time bug PreCombinerLocalRearrange inner plan does not reset parentPlan (Orc_3 on mr fail, the
third MR job fail with ClassNotFound exception for Orc class, because a stale parentPlan contains the
(Continue reading)

Daniel Dai (JIRA | 20 Sep 19:56 2014
Picon

[Updated] (PIG-4187) Fix Orc e2e tests


     [
https://issues.apache.org/jira/browse/PIG-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai updated PIG-4187:
----------------------------
    Attachment: PIG-4187-1.patch

> Fix Orc e2e tests
> -----------------
>
>                 Key: PIG-4187
>                 URL: https://issues.apache.org/jira/browse/PIG-4187
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.14.0
>
>         Attachments: PIG-4187-1.patch
>
>
> Several Orc e2e tests still fail on trunk. There are several causes:
> 1. kryo.jar is missing if using PPD
> 2. UDFContext.tss is not updated in tez container reuse (Orc_3 on tez fail, the second vertex get old UDFContext)
> 3. An old time bug PreCombinerLocalRearrange inner plan does not reset parentPlan (Orc_3 on mr fail, the
third MR job fail with ClassNotFound exception for Orc class, because a stale parentPlan contains the
whole physicalPlan)

(Continue reading)

Daniel Dai (JIRA | 20 Sep 19:55 2014
Picon

[Created] (PIG-4187) Fix Orc e2e tests

Daniel Dai created PIG-4187:
-------------------------------

             Summary: Fix Orc e2e tests
                 Key: PIG-4187
                 URL: https://issues.apache.org/jira/browse/PIG-4187
             Project: Pig
          Issue Type: Bug
          Components: impl
            Reporter: Daniel Dai
            Assignee: Daniel Dai
             Fix For: 0.14.0

Several Orc e2e tests still fail on trunk. There are several causes:
1. kryo.jar is missing if using PPD
2. UDFContext.tss is not updated in tez container reuse (Orc_3 on tez fail, the second vertex get old UDFContext)
3. An old time bug PreCombinerLocalRearrange inner plan does not reset parentPlan (Orc_3 on mr fail, the
third MR job fail with ClassNotFound exception for Orc class, because a stale parentPlan contains the
whole physicalPlan)

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Hudson (JIRA | 20 Sep 16:45 2014
Picon

[Commented] (PIG-4186) Fix e2e run against new build of pig and some enhancements


    [
https://issues.apache.org/jira/browse/PIG-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14142011#comment-14142011
] 

Hudson commented on PIG-4186:
-----------------------------

FAILURE: Integrated in Hive-branch-0.12-hadoop2 #35 (See [https://builds.apache.org/job/Hive-branch-0.12-hadoop2/35/])
PIG-4186: Fix e2e run against new build of pig and some enhancements (rohini) (rohini: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1626356)
* /pig/trunk/CHANGES.txt
* /pig/trunk/test/e2e/harness/TestDriver.pm
* /pig/trunk/test/e2e/harness/xmlReport.pl
* /pig/trunk/test/e2e/pig/build.xml
* /pig/trunk/test/e2e/pig/conf/default.conf
* /pig/trunk/test/e2e/pig/conf/local.conf
* /pig/trunk/test/e2e/pig/conf/tez.conf
* /pig/trunk/test/e2e/pig/drivers/TestDriverPig.pm
* /pig/trunk/test/e2e/pig/tests/nightly.conf
* /pig/trunk/test/e2e/pig/udfs/java/build.xml

> Fix e2e run against new build of pig and some enhancements
> ----------------------------------------------------------
>
>                 Key: PIG-4186
>                 URL: https://issues.apache.org/jira/browse/PIG-4186
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
(Continue reading)

Hudson (JIRA | 20 Sep 01:05 2014
Picon

[Commented] (PIG-4186) Fix e2e run against new build of pig and some enhancements


    [
https://issues.apache.org/jira/browse/PIG-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14141505#comment-14141505
] 

Hudson commented on PIG-4186:
-----------------------------

FAILURE: Integrated in Hive-branch-0.12-hadoop1 #45 (See [https://builds.apache.org/job/Hive-branch-0.12-hadoop1/45/])
PIG-4186: Fix e2e run against new build of pig and some enhancements (rohini) (rohini: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1626356)
* /pig/trunk/CHANGES.txt
* /pig/trunk/test/e2e/harness/TestDriver.pm
* /pig/trunk/test/e2e/harness/xmlReport.pl
* /pig/trunk/test/e2e/pig/build.xml
* /pig/trunk/test/e2e/pig/conf/default.conf
* /pig/trunk/test/e2e/pig/conf/local.conf
* /pig/trunk/test/e2e/pig/conf/tez.conf
* /pig/trunk/test/e2e/pig/drivers/TestDriverPig.pm
* /pig/trunk/test/e2e/pig/tests/nightly.conf
* /pig/trunk/test/e2e/pig/udfs/java/build.xml

> Fix e2e run against new build of pig and some enhancements
> ----------------------------------------------------------
>
>                 Key: PIG-4186
>                 URL: https://issues.apache.org/jira/browse/PIG-4186
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
(Continue reading)

Rohini Palaniswamy (JIRA | 20 Sep 00:38 2014
Picon

[Updated] (PIG-4186) Fix e2e run against new build of pig and some enhancements


     [
https://issues.apache.org/jira/browse/PIG-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rohini Palaniswamy updated PIG-4186:
------------------------------------
      Resolution: Fixed
    Hadoop Flags: Reviewed
          Status: Resolved  (was: Patch Available)

 Committed to trunk (0.14). Thanks Daniel for the review.

 Also added information on the xmlReport.pl
in
https://cwiki.apache.org/confluence/pages/diffpagesbyversion.action?pageId=27825753&selectedPageVersions=15&selectedPageVersions=14
. I did not change other code blocks but the diff shows some spacing changes in them. Checked that it is not an
issue and page looks fine .

> Fix e2e run against new build of pig and some enhancements
> ----------------------------------------------------------
>
>                 Key: PIG-4186
>                 URL: https://issues.apache.org/jira/browse/PIG-4186
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: 0.14.0
>
>         Attachments: PIG-4186-1.patch
(Continue reading)

Daniel Dai (JIRA | 20 Sep 00:10 2014
Picon

[Commented] (PIG-4186) Fix e2e run against new build of pig and some enhancements


    [
https://issues.apache.org/jira/browse/PIG-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14141404#comment-14141404
] 

Daniel Dai commented on PIG-4186:
---------------------------------

I see. +1

> Fix e2e run against new build of pig and some enhancements
> ----------------------------------------------------------
>
>                 Key: PIG-4186
>                 URL: https://issues.apache.org/jira/browse/PIG-4186
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: 0.14.0
>
>         Attachments: PIG-4186-1.patch
>
>
>   Some recent changes in trunk has broken the ability to run against a new packaged version of pig. Running
against source code is fine. Also making few enhancements like 
>   - making piggybank jar path really configurable, 
>   - adding a script that we used to parse the e2e result log and output in junit xml format for jenkins job.

--
(Continue reading)

Rohini Palaniswamy (JIRA | 19 Sep 23:48 2014
Picon

[Commented] (PIG-4186) Fix e2e run against new build of pig and some enhancements


    [
https://issues.apache.org/jira/browse/PIG-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14141360#comment-14141360
] 

Rohini Palaniswamy commented on PIG-4186:
-----------------------------------------

No. Before it was expected to be always under contrib/piggybank/java. In our package, we have it in the lib directory.

> Fix e2e run against new build of pig and some enhancements
> ----------------------------------------------------------
>
>                 Key: PIG-4186
>                 URL: https://issues.apache.org/jira/browse/PIG-4186
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: 0.14.0
>
>         Attachments: PIG-4186-1.patch
>
>
>   Some recent changes in trunk has broken the ability to run against a new packaged version of pig. Running
against source code is fine. Also making few enhancements like 
>   - making piggybank jar path really configurable, 
>   - adding a script that we used to parse the e2e result log and output in junit xml format for jenkins job.

--
(Continue reading)

Daniel Dai (JIRA | 19 Sep 23:44 2014
Picon

[Commented] (PIG-4186) Fix e2e run against new build of pig and some enhancements


    [
https://issues.apache.org/jira/browse/PIG-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14141354#comment-14141354
] 

Daniel Dai commented on PIG-4186:
---------------------------------

Is that because you have a different name for piggybank.jar?

> Fix e2e run against new build of pig and some enhancements
> ----------------------------------------------------------
>
>                 Key: PIG-4186
>                 URL: https://issues.apache.org/jira/browse/PIG-4186
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: 0.14.0
>
>         Attachments: PIG-4186-1.patch
>
>
>   Some recent changes in trunk has broken the ability to run against a new packaged version of pig. Running
against source code is fine. Also making few enhancements like 
>   - making piggybank jar path really configurable, 
>   - adding a script that we used to parse the e2e result log and output in junit xml format for jenkins job.

--
(Continue reading)

Rohini Palaniswamy (JIRA | 19 Sep 22:16 2014
Picon

[Updated] (PIG-4186) Fix e2e run against new build of pig and some enhancements


     [
https://issues.apache.org/jira/browse/PIG-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rohini Palaniswamy updated PIG-4186:
------------------------------------
    Status: Patch Available  (was: Open)

> Fix e2e run against new build of pig and some enhancements
> ----------------------------------------------------------
>
>                 Key: PIG-4186
>                 URL: https://issues.apache.org/jira/browse/PIG-4186
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: 0.14.0
>
>         Attachments: PIG-4186-1.patch
>
>
>   Some recent changes in trunk has broken the ability to run against a new packaged version of pig. Running
against source code is fine. Also making few enhancements like 
>   - making piggybank jar path really configurable, 
>   - adding a script that we used to parse the e2e result log and output in junit xml format for jenkins job.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
(Continue reading)


Gmane