Andrew Purtell | 19 Apr 16:28 2014
Picon

0.98.2

I'd like to start the RC for 0.98.2 at the end of the month. I'm thinking
next weekend with voting concluded (if nothing sinks the RC) by the
following weekend, so the 3rd or 4th of May, just in time for HBaseCon.

If there are any criticals or blockers for 0.98.2, can we get them in this
week? Thanks!

--

-- 
Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Andrew Purtell (JIRA | 19 Apr 16:19 2014
Picon

[jira] [Created] (HBASE-11039) [VisibilityController] Integration test for labeled data set mixing and filtered excise

Andrew Purtell created HBASE-11039:
--------------------------------------

             Summary: [VisibilityController] Integration test for labeled data set mixing and filtered excise
                 Key: HBASE-11039
                 URL: https://issues.apache.org/jira/browse/HBASE-11039
             Project: HBase
          Issue Type: Test
    Affects Versions: 0.98.1
            Reporter: Andrew Purtell
             Fix For: 0.99.0, 0.98.3

Create an integration test for the VisibilityController that:
1. Create several tables of test data
2. Assign a set of auths to each table. Label all entries in the table with appropriate visibility
expressions. Insure that some data in every table overlaps with data in other tables at common
row/family/qualifier coordinates. Generate data like ITBLL so we can verify all data present later.
3. Mix the data from the different tables into a new common table
4. Verify for each set of auths defined in step #2 that all entries found in the source table can be found in the
common table. Like the ITBLL verification step.
5. Choose one of the source tables. Get its set of auths. Perform a deletion with visibility expression from
the common table using those auths.
6. Verify that no data in the common table with the auth set chosen in #5 remains. A simple row count with the
set of auths chosen in #5 that should return 0.

--
This message was sent by Atlassian JIRA
(v6.2#6252)

(Continue reading)

Ted Yu (JIRA | 19 Apr 11:11 2014
Picon

[jira] [Reopened] (HBASE-11031) Some HTable's are not closed in TestLogRolling


     [
https://issues.apache.org/jira/browse/HBASE-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ted Yu reopened HBASE-11031:
----------------------------

> Some HTable's are not closed in TestLogRolling
> ----------------------------------------------
>
>                 Key: HBASE-11031
>                 URL: https://issues.apache.org/jira/browse/HBASE-11031
>             Project: HBase
>          Issue Type: Test
>            Reporter: Ted Yu
>            Assignee: Ted Yu
>            Priority: Trivial
>             Fix For: 0.99.0
>
>         Attachments: 11031-v1.txt
>
>
> The following pattern appears in several methods:
> {code}
>     // When the hbase:meta table can be opened, the region servers are running
>     new HTable(TEST_UTIL.getConfiguration(), TableName.META_TABLE_NAME);
> {code}
> The HTable instance should be closed.

--
(Continue reading)

Lars Hofhansl (JIRA | 19 Apr 07:26 2014
Picon

[jira] [Resolved] (HBASE-11037) Race condition in TestZKBasedOpenCloseRegion


     [
https://issues.apache.org/jira/browse/HBASE-11037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Lars Hofhansl resolved HBASE-11037.
-----------------------------------

      Resolution: Fixed
        Assignee: Lars Hofhansl
    Hadoop Flags: Reviewed

Committed to all branches. Thanks [~stack]

> Race condition in TestZKBasedOpenCloseRegion
> --------------------------------------------
>
>                 Key: HBASE-11037
>                 URL: https://issues.apache.org/jira/browse/HBASE-11037
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Lars Hofhansl
>            Assignee: Lars Hofhansl
>             Fix For: 0.99.0, 0.94.19, 0.98.2, 0.96.3
>
>         Attachments: 11037-0.94.txt, 11037-trunk.txt
>
>
> testCloseRegion is called before testReOpenRegion.
> Here's the sequence of events:
> {code}
(Continue reading)

Nick Dimiduk (JIRA | 19 Apr 02:47 2014
Picon

[jira] [Created] (HBASE-11038) Filtered scans can bypass metrics collection

Nick Dimiduk created HBASE-11038:
------------------------------------

             Summary: Filtered scans can bypass metrics collection
                 Key: HBASE-11038
                 URL: https://issues.apache.org/jira/browse/HBASE-11038
             Project: HBase
          Issue Type: Bug
          Components: Scanners
    Affects Versions: 0.99.0
            Reporter: Nick Dimiduk
            Priority: Minor

In RegionScannerImpl#nextRaw, after a batch of results are retrieved, delegates to the filter regarding
continuation of the scan. If filterAllRemaining returns true, the method exits immediately, without
calling MetricsRegion#updateNextScan.

--
This message was sent by Atlassian JIRA
(v6.2#6252)

Lars Hofhansl (JIRA | 19 Apr 01:28 2014
Picon

[jira] [Created] (HBASE-11037) Race condition in TestZKBasedOpenCloseRegion

Lars Hofhansl created HBASE-11037:
-------------------------------------

             Summary: Race condition in TestZKBasedOpenCloseRegion
                 Key: HBASE-11037
                 URL: https://issues.apache.org/jira/browse/HBASE-11037
             Project: HBase
          Issue Type: Bug
            Reporter: Lars Hofhansl
             Fix For: 0.94.19

testCloseRegion is called before testReOpenRegion.

Here's the sequence of events:
{code}
2014-04-18 20:58:05,645 INFO  [Thread-380] master.TestZKBasedOpenCloseRegion(313): Running testCloseRegion
2014-04-18 20:58:05,645 INFO  [Thread-380] master.TestZKBasedOpenCloseRegion(315): Number of
region servers = 2
2014-04-18 20:58:05,645 INFO  [Thread-380] master.TestZKBasedOpenCloseRegion(164): -ROOT-,,0.70236052
2014-04-18 20:58:05,646 DEBUG [Thread-380] master.TestZKBasedOpenCloseRegion(320): Asking RS to
close region -ROOT-,,0.70236052
...
2014-04-18 20:58:06,237 INFO  [RS_CLOSE_ROOT-hemera.apache.org,46533,1397854669633-0]
regionserver.HRegion(1148): Closed -ROOT-,,0.70236052
...
2014-04-18 20:58:06,404 INFO  [Thread-380] master.TestZKBasedOpenCloseRegion(333): Done with testCloseRegion
{code}
Then
{code}
2014-04-18 20:58:06,431 INFO  [pool-1-thread-1] hbase.ResourceChecker(157): before
(Continue reading)

Enis Soztutar (JIRA | 19 Apr 01:22 2014
Picon

[jira] [Created] (HBASE-11036) Online schema change with region merge may cause data loss

Enis Soztutar created HBASE-11036:
-------------------------------------

             Summary: Online schema change with region merge may cause data loss 
                 Key: HBASE-11036
                 URL: https://issues.apache.org/jira/browse/HBASE-11036
             Project: HBase
          Issue Type: Bug
            Reporter: Enis Soztutar
             Fix For: 0.99.0, 0.98.2

We have found out that online schema change and region merges may still cause issues about merged regions
coming back online, and thus causing data loss. 

Recently ITBLL failed reporting 800K missing rows out of 720M. We've been running this test for some
extended period of time, and this is the first we are seeing it, meaning that it is more rare. But it is still
concerning. 

From master's log:
The merge has happened:
{code}
2014-04-16 18:26:37,247 INFO  [AM.ZK.Worker-pool2-t73] master.AssignmentManager: Handled MERGED
event;
merged=IntegrationTestBigLinkedList,\xB2\xFE\x03s,1397672795119.80159738a0167e20a2e29fb2c46702f2.,
	
	region_a=IntegrationTestBigLinkedList,\xB2\xFE\x03s,1397670978959.0ac116e4d7da87922d3a8f218ca21079.,

	region_b=IntegrationTestBigLinkedList,\xB8\x03\x94\x15,1397672587456.1265d06478082ced65dd9a0c1c2b63c2.,
on hor13n03.gq1.ygridcore.net,60020,1397672668647
{code}
(Continue reading)

Adela Maznikar (JIRA | 19 Apr 00:56 2014
Picon

[jira] [Created] (HBASE-11035) [0.89-fb] Online configuration change for regionobservers

Adela Maznikar created HBASE-11035:
--------------------------------------

             Summary: [0.89-fb] Online configuration change for regionobservers
                 Key: HBASE-11035
                 URL: https://issues.apache.org/jira/browse/HBASE-11035
             Project: HBase
          Issue Type: Improvement
          Components: Coprocessors
            Reporter: Adela Maznikar
            Assignee: Adela Maznikar
             Fix For: 0.89-fb

We can use online configuration change to specify the active list of coprocessors in CoprocessorHost
(RegionCoprocessorHost). That way we don't need to close regions when we want to add/remove new
coprocessors (regionobservers)

--
This message was sent by Atlassian JIRA
(v6.2#6252)

Nick Dimiduk (JIRA | 19 Apr 00:18 2014
Picon

[jira] [Created] (HBASE-11034) Get path validates column families twice

Nick Dimiduk created HBASE-11034:
------------------------------------

             Summary: Get path validates column families twice
                 Key: HBASE-11034
                 URL: https://issues.apache.org/jira/browse/HBASE-11034
             Project: HBase
          Issue Type: Improvement
          Components: regionserver
            Reporter: Nick Dimiduk
            Assignee: Nick Dimiduk
            Priority: Minor

HRegion#get(Get) adds/validates column families. The resulting RegionScanner goes through the same
validation dance a second time. That second implementation is slightly less efficient, always checking
the families, even if there were no user-provided families and the prepareScanner() call already did
this. The current logic in HRegion#get() is smarter actually. Let's do the work only once.

--
This message was sent by Atlassian JIRA
(v6.2#6252)

Ted Yu (JIRA | 19 Apr 00:10 2014
Picon

[jira] [Created] (HBASE-11033) Allow test-patch.sh to run selected test(s) if patch contains changes to test classes only

Ted Yu created HBASE-11033:
------------------------------

             Summary: Allow test-patch.sh to run selected test(s) if patch contains changes to test classes only
                 Key: HBASE-11033
                 URL: https://issues.apache.org/jira/browse/HBASE-11033
             Project: HBase
          Issue Type: Task
            Reporter: Ted Yu
            Priority: Minor

A patch may touch test classes only.

In this case, test-patch.sh can detect the tests affected and run these tests only.

Special case: if TestingUtility (HConnectionTestingUtility, HBaseTestingUtility, etc) is changed,
all tests need to be run.

--
This message was sent by Atlassian JIRA
(v6.2#6252)

Demai Ni | 18 Apr 23:27 2014
Picon

a way to record # of rows 'deleted' due to TTL

hi, folks,

Understand that TTL plays its role in the background, I am wondering
whether there is a way to have some information of the retired rows?

for example,
1) 100 rows were put initially
2) during one day period, 2 rows was deleted by user, and 10 rows 'retired'
due to TTL

is there a way to figure out the '10'? Is there a way to plug in a
co-processor for that purpose?

Many thanks

Demai

Gmane