cuijianwei (JIRA | 27 Jan 14:37 2015
Picon

[jira] [Created] (HBASE-12930) Check single row size not exceed configured max row size across families for Get/Scan

cuijianwei created HBASE-12930:
----------------------------------

             Summary: Check single row size not exceed configured max row size across families for Get/Scan
                 Key: HBASE-12930
                 URL: https://issues.apache.org/jira/browse/HBASE-12930
             Project: HBase
          Issue Type: Improvement
          Components: Scanners
            Reporter: cuijianwei
            Priority: Minor
             Fix For: 0.99.2

StoreScanner#next will check the 'totalBytesRead' not exceed configured
‘hbase.table.max.rowsize’ for each family. However, if there are several families, the single row
will also achieve unexpected big size even if 'totalBytesRead' of each family not exceed
'hbase.table.max.rowsize'. This may cause the region server fail because of OOM. What about checking
single row size across families in StoreScanner#next(List<Cell>, int)?
{code}
    long totalBytesRead = 0;
    // ==> compute the size of cells have been read
    for (Cell cell : outResult) {
      totalBytesRead += CellUtil.estimatedSerializedSizeOf(old);
    }

    LOOP: while((cell = this.heap.peek()) != null) {
    ...
{code}

--
(Continue reading)

Will Temperley (JIRA | 27 Jan 09:55 2015
Picon

[jira] [Created] (HBASE-12929) TableMapReduceUtil.initTableMapperJob unnecessarily limits the types of outputKeyClass and outputValueClass

Will Temperley created HBASE-12929:
--------------------------------------

             Summary: TableMapReduceUtil.initTableMapperJob unnecessarily limits the types of outputKeyClass
and outputValueClass
                 Key: HBASE-12929
                 URL: https://issues.apache.org/jira/browse/HBASE-12929
             Project: HBase
          Issue Type: Improvement
          Components: mapreduce
            Reporter: Will Temperley
            Priority: Minor

The initTableMapperJob methods in TableMapReduceUtil which take multiple scans unnecessarily limit
the types of the outputKeyClass and outputValueClass parameters, requiring them to extend
WritableComparable and Writable respectively.  

In my specific use case, therefore, I cannot create a mapper job which outputs an hbase.client.Result.

The methods in the MapReduce API to set map output key and value types do not impose this restriction.

The other overloads of initTableMapperJob do not have this limitation - the restrictions were removed by https://issues.apache.org/jira/browse/HBASE-7024

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Purtell | 27 Jan 07:33 2015
Picon

[VOTE] The 1st HBase 0.98.10 release candidate (RC0) is available, vote closing 2/2/2015

​​​​​The 1st HBase 0.98.10 release candidate (RC0) is available for
download at http://people.apache.org/~apurtell/0.98.10RC0/ and Maven
artifacts are also available in the temporary repository
https://repository.apache.org/content/repositories/orgapachehbase-1057/

Signed with my code signing key D5365CCD.

The issues resolved in this release can be found at http://s.apache.org/7hO

Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
-0800 GMT) on ​February 2​ ​on whether or not we should release this as​
​0.98.10. Three +1 votes from PMC will be required to release.

--

-- 
Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
cuijianwei (JIRA | 27 Jan 03:11 2015
Picon

[jira] [Created] (HBASE-12928) BaseLoadBalancer#needsBalance only checks the sloppiness of region count before balancing

cuijianwei created HBASE-12928:
----------------------------------

             Summary: BaseLoadBalancer#needsBalance only checks the sloppiness of region count before balancing
                 Key: HBASE-12928
                 URL: https://issues.apache.org/jira/browse/HBASE-12928
             Project: HBase
          Issue Type: Improvement
          Components: Balancer
    Affects Versions: 0.99.2
            Reporter: cuijianwei
            Priority: Minor

BaseLoadBalancer#needsBalance will be invoked to judge whether needs to do balancing.
StochasticLoadBalancer do balancing by considering region count skew cost, read/write request cost,
locality cost, etc. However, it seems that only sloppiness of region count is checked in
BaseLoadBalancer#needsBalance, there may be cases that request/locality cost is high when region
count is even, this will skip the actual balancing so that can't achieve lower cost. There, Do we need to
check sloppiness of other factors(read/write request, locality, etc) in needsBalance?

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Jonathan Lawlor (JIRA | 27 Jan 02:09 2015
Picon

[jira] [Created] (HBASE-12927) TestFromClientSide#testScanMetrics() failing due to duplicate createTable commands

Jonathan Lawlor created HBASE-12927:
---------------------------------------

             Summary: TestFromClientSide#testScanMetrics() failing due to duplicate createTable commands
                 Key: HBASE-12927
                 URL: https://issues.apache.org/jira/browse/HBASE-12927
             Project: HBase
          Issue Type: Bug
            Reporter: Jonathan Lawlor
            Assignee: Jonathan Lawlor
            Priority: Minor
             Fix For: 1.1.0

The testScanMetrics test is failing because a createTable command was not removed in the branch-1 patch
from HBASE-7541. 

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Purtell (JIRA | 27 Jan 02:03 2015
Picon

[jira] [Created] (HBASE-12926) Backport HBASE-12688 (Update site with a bootstrap-based UI) for HBASE-12918

Andrew Purtell created HBASE-12926:
--------------------------------------

             Summary: Backport HBASE-12688 (Update site with a bootstrap-based UI) for HBASE-12918
                 Key: HBASE-12926
                 URL: https://issues.apache.org/jira/browse/HBASE-12926
             Project: HBase
          Issue Type: Sub-task
            Reporter: Andrew Purtell
            Assignee: Andrew Purtell

Backport HBASE-12688 (Update site with a bootstrap-based UI) for HBASE-12918

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Srikanth Srungarapu (JIRA | 26 Jan 22:44 2015
Picon

[jira] [Created] (HBASE-12925) Use acl cache for doing access control checks in prepare and clean phases of Bulkloading.

Srikanth Srungarapu created HBASE-12925:
-------------------------------------------

             Summary: Use acl cache for doing access control checks in prepare and clean phases of Bulkloading.
                 Key: HBASE-12925
                 URL: https://issues.apache.org/jira/browse/HBASE-12925
             Project: HBase
          Issue Type: Bug
            Reporter: Srikanth Srungarapu
            Assignee: Srikanth Srungarapu

Currently, prepareBulkLoad and cleanupBulkLoad are using "hasSomeAccess", which performs scan on ACL
table, instead of using TableAuthManager. Also, the method "hasSomeAccess" has a logical error, as it
doesn't filter the acl scan results by the current active user. More specifically 
{code}
for (UserPermission userPerm: perms) {
        for (Action userAction: userPerm.getActions()) {
          if (userAction.equals(action)) {
            return AuthResult.allow(method, "Access allowed", requestUser,
              action, tableName, null, null);
          }
        }
      }
{code} 
The if clause ideally should be having something like userPerm.getUser.equals(requestUser). This
issue will help us in getting rid of this problematic implementation.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
(Continue reading)

Jonathan Lawlor (JIRA | 26 Jan 21:52 2015
Picon

[jira] [Created] (HBASE-12924) HRegionServer#MovedRegionsCleaner Chore does not start

Jonathan Lawlor created HBASE-12924:
---------------------------------------

             Summary: HRegionServer#MovedRegionsCleaner Chore does not start
                 Key: HBASE-12924
                 URL: https://issues.apache.org/jira/browse/HBASE-12924
             Project: HBase
          Issue Type: Bug
            Reporter: Jonathan Lawlor
            Priority: Minor

This issue is very similar to the one described in HBASE-11354. The method createAndStart in
MovedRegionsCleaner creates an instance of the chore but never starts the underlying thread:

{code}
    static MovedRegionsCleaner createAndStart(HRegionServer rs){
      Stoppable stoppable = new Stoppable() {
        private volatile boolean isStopped = false;
         <at> Override public void stop(String why) { isStopped = true;}
         <at> Override public boolean isStopped() {return isStopped;}
      };

      return new MovedRegionsCleaner(rs, stoppable);
    }
{code}

Nobody has noticed this issue so far so the Chore may not be that important

--
This message was sent by Atlassian JIRA
(Continue reading)

Andrew Purtell (JIRA | 26 Jan 19:17 2015
Picon

[jira] [Resolved] (HBASE-11431) Add support of running from command line for 'hbase shell'


     [
https://issues.apache.org/jira/browse/HBASE-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell resolved HBASE-11431.
------------------------------------
    Resolution: Not a Problem

> Add support of running from command line for 'hbase shell'
> ----------------------------------------------------------
>
>                 Key: HBASE-11431
>                 URL: https://issues.apache.org/jira/browse/HBASE-11431
>             Project: HBase
>          Issue Type: New Feature
>          Components: Admin
>    Affects Versions: 0.89-fb
>            Reporter:  <at> deprecated Yi Deng
>            Priority: Minor
>              Labels: shell
>             Fix For: 0.89-fb
>
>
> Add support of running from command line for 'hbase shell'.
> Now you can execute shell command from the bash like this:
>   bin/hbase shell --exec='scan ".META"' 
> The result can be piped to grep or other command.

--
This message was sent by Atlassian JIRA
(Continue reading)

Ted Yu (JIRA | 26 Jan 19:09 2015
Picon

[jira] [Created] (HBASE-12923) ResultScanner is not closed in ModifyTableHandler#removeReplicaColumnsIfNeeded()

Ted Yu created HBASE-12923:
------------------------------

             Summary: ResultScanner is not closed in ModifyTableHandler#removeReplicaColumnsIfNeeded()
                 Key: HBASE-12923
                 URL: https://issues.apache.org/jira/browse/HBASE-12923
             Project: HBase
          Issue Type: Bug
            Reporter: Ted Yu
            Assignee: Ted Yu

In ModifyTableHandler#removeReplicaColumnsIfNeeded():
{code}
      ResultScanner resScanner = metaTable.getScanner(scan);
      for (Result result : resScanner) {
{code}
The ResultScanner is not closed upon exit from the method.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

William Temperley | 26 Jan 15:07 2015
Picon

TableMapReduceUtil.initTableMapperJob

Dear all,

Issue HBASE-7024 <https://issues.apache.org/jira/browse/HBASE-7024> has
been closed and the restrictions on types of outputKeyClass and
outputValueClass were removed for most overloads of
TableMapReduceUtil.initTableMapperJob. These restrictions however remain
for the  three overloads which take List<Scan>.   I'm not sure if these
overloads were added later, or just missed in the previous patch.

I can't seem to reopen this issue, perhaps because I don't have permissions
as I only just signed up on JIRA.  Anyway I attached a patch to the issue,
which removes these type restrictions on the three methods taking multiple
scans.

Best regards,

Will Temperley

Gmane