louis hust (JIRA | 31 Jul 15:31 2014
Picon

[jira] [Created] (HBASE-11627) RegionSplitter's rollingSplit terminated with "/ by zero", and the _balancedSplit file was not deleted properly

louis hust created HBASE-11627:
----------------------------------

             Summary: RegionSplitter's rollingSplit terminated with "/ by zero", and the _balancedSplit file was not
deleted properly
                 Key: HBASE-11627
                 URL: https://issues.apache.org/jira/browse/HBASE-11627
             Project: HBase
          Issue Type: Bug
          Components: Admin, util
    Affects Versions: 0.98.1, 0.96.2
         Environment: CentOS release 6.4 (Final)   x86_64  && hbase-0.98.1-cdh5.1.0

            Reporter: louis hust
            Priority: Critical

First create a table
{quote}
> create 't1', 'f1'
{quote}
Then split the table with util:
{quote}
> bin/hbase org.apache.hadoop.hbase.util.RegionSplitter -r -o 2 t1 UniformSplit
{quote}

*Finally get the following error :*
{quote}
12/11/08 19:21:12 DEBUG util.RegionSplitter: All regions have been successfully split!
12/11/08 19:21:12 DEBUG util.RegionSplitter: TOTAL TIME = 30sec
12/11/08 19:21:12 DEBUG util.RegionSplitter: Splits = 0
(Continue reading)

cuijianwei (JIRA | 31 Jul 14:26 2014
Picon

[jira] [Created] (HBASE-11626) Region will be closed if user try to move it to an error destination server

cuijianwei created HBASE-11626:
----------------------------------

             Summary: Region will be closed if user try to move it to an error destination server
                 Key: HBASE-11626
                 URL: https://issues.apache.org/jira/browse/HBASE-11626
             Project: HBase
          Issue Type: Improvement
          Components: master
    Affects Versions: 0.98.4
            Reporter: cuijianwei
            Priority: Minor

When moving region to a destination server by hbase shell command, such as:
{code}
move '7dbe79eb3a77df085c8546b2ee540e7f', 'localhost,58220,1406806842691'
{code}
user could pass an error destination server name, such as misspellings the server name. Then, HMaster will
close the region firstly and then assign the region to a random server when finding the destination server
is not online, and the region can not serve before it is online again. Do we need to check the destination
server name corresponds to an online server before closing region?(in HMaster.move(...)) 
{code}
...
if (destServerName == null || destServerName.length == 0) {
      ....
    } else {
      dest = ServerName.valueOf(Bytes.toString(destServerName));
      if (dest.equals(regionState.getServerName())) {
         ...
      }
(Continue reading)

stack (JIRA | 31 Jul 08:41 2014
Picon

[jira] [Resolved] (HBASE-10577) Remove unnecessary looping in FSHLog


     [
https://issues.apache.org/jira/browse/HBASE-10577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

stack resolved HBASE-10577.
---------------------------

    Resolution: Won't Fix

(You are right [~busbey])

> Remove unnecessary looping in FSHLog
> ------------------------------------
>
>                 Key: HBASE-10577
>                 URL: https://issues.apache.org/jira/browse/HBASE-10577
>             Project: HBase
>          Issue Type: Bug
>          Components: wal
>    Affects Versions: 0.99.0
>            Reporter: Himanshu Vashishtha
>
> In the new disruptor based FSHLog, the Syncer threads are handed a batch of SyncFuture objects from the
RingBufferHandler. The Syncer then invokes a sync call on the current writer instance.
> This handing of batch is done in serially in RingBufferHandler, that is, every syncer receives a non
overlapping batch of SyncFutures. Once synced, Syncer thread updates highestSyncedSequence.
> In the run method of Syncer, we have:
> {code}
>             long currentHighestSyncedSequence = highestSyncedSequence.get();
>             if (currentSequence < currentHighestSyncedSequence) {
(Continue reading)

qian wang (JIRA | 31 Jul 08:24 2014
Picon

[jira] [Created] (HBASE-11625) Reading datablock throws "Invalid HFile block magic" and can not switch to hdfs checksum

qian wang created HBASE-11625:
---------------------------------

             Summary: Reading datablock throws "Invalid HFile block magic" and can not switch to hdfs checksum 
                 Key: HBASE-11625
                 URL: https://issues.apache.org/jira/browse/HBASE-11625
             Project: HBase
          Issue Type: Bug
          Components: HFile
    Affects Versions: 0.98.4, 0.94.21
            Reporter: qian wang

when using hbase checksum,call readBlockDataInternal() in hfileblock.java, it could happen file
corruption but it only can switch to hdfs checksum inputstream till validateBlockChecksum(). If the
datablock's header corrupted when b = new HFileBlock(),it throws the exception "Invalid HFile block
magic" and the rpc call fail

--
This message was sent by Atlassian JIRA
(v6.2#6252)

Sean Busbey | 31 Jul 07:47 2014

adding a profile to build thrift generated classes

Hiya!

Currently, the only instructions for generating our RPC classes via thrift
that I can find are in a package javadoc[1].

While I doubt we rebuild them very often, I was thinking we could ease the
process by adding a maven profile that took care of the rebuilding and
copying into place.

It would still require having thrift installed on the build system, so it
would need to be disabled by default.

Wanted to check for concerns / objections before filing a jira.

[1]: http://s.apache.org/hZv

--

-- 
Sean
Ted Yu (JIRA | 31 Jul 07:39 2014
Picon

[jira] [Created] (HBASE-11624) TestScannerResource hangs in trunk

Ted Yu created HBASE-11624:
------------------------------

             Summary: TestScannerResource hangs in trunk
                 Key: HBASE-11624
                 URL: https://issues.apache.org/jira/browse/HBASE-11624
             Project: HBase
          Issue Type: Test
            Reporter: Ted Yu
            Priority: Minor

I checked console log for the recent trunk builds - I couldn't find TestScannerResource.
I got the following stack trace when running the test locally:
{code}
"pool-1-thread-1" prio=10 tid=0x00007f7d8c787000 nid=0x3803 runnable [0x00007f7d63783000]
   java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.read(SocketInputStream.java:150)
        at java.net.SocketInputStream.read(SocketInputStream.java:121)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:254)
        - locked <0x00000007fb156098> (a java.io.BufferedInputStream)
        at org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:78)
        at org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:106)
        at org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:1116)
        at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.readLine(MultiThreadedHttpConnectionManager.java:1413)
        at org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1973)
        at org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735)
        at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098)
        at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)
(Continue reading)

abhishek1015 | 31 Jul 07:19 2014
Picon

Re: hbase project compilation

I am able to compile now.

I had upgraded from jdk 6 to jdk 7. but, i forgot to set javac to newer
version.

Abhishek

--
View this message in context: http://apache-hbase.679495.n3.nabble.com/hbase-project-compilation-tp4062116p4062128.html
Sent from the HBase Developer mailing list archive at Nabble.com.

cuijianwei (JIRA | 31 Jul 06:50 2014
Picon

[jira] [Created] (HBASE-11623) mutateRowsWithLocks might require updatesLock.readLock with waitTime=0

cuijianwei created HBASE-11623:
----------------------------------

             Summary: mutateRowsWithLocks might require updatesLock.readLock with waitTime=0
                 Key: HBASE-11623
                 URL: https://issues.apache.org/jira/browse/HBASE-11623
             Project: HBase
          Issue Type: Improvement
          Components: regionserver
    Affects Versions: 0.98.4, 0.94.21, 0.96.1.1
            Reporter: cuijianwei
            Priority: Minor

mutateRowsWithLocks will acquire updatesLock.readLock by the following code:
{code}
...
lock(this.updatesLock.readLock(), acquiredRowLocks.size());
...
{code}
However, acquiredRowLocks might be empty, and then the waitTime of HRegion.lock(...) will be set to 0,
which will make mutateRowsWithLocks fail if can not acquire updatesLock.readLock immediately. 
In our environment, we implement a region coprocessor which need to hold row locks before invoke
mutateRowsWithLocks. Then, the rowsToLock(passed to mutateRowsWithLocks) will be an empty set, and we
get the following exception occasionally:
{code}
org.apache.hadoop.hbase.RegionTooBusyException: failed to get a lock in 0ms                                                                                                  
 582   at org.apache.hadoop.hbase.regionserver.HRegion.lock(HRegion.java:6191)
 583   at org.apache.hadoop.hbase.regionserver.HRegion.mutateRowsWithLocks(HRegion.java:5126)
 584   at org.apache.hadoop.hbase.regionserver.HRegion.mutateRowsWithLocks(HRegion.java:5034)
...
(Continue reading)

abhishek1015 | 31 Jul 03:09 2014
Picon

hbase project compilation

Hello,

I have clone the hbase git repository using command provided in the hbase
home page.

git clone https://git-wip-us.apache.org/repos/asf/hbase.git

While I compile this project using 'mvn clean package' command, I see
following error:

Project ID: com.sun.jersey:jersey-project:pom:1.9

Reason: Cannot find parent: net.java:jvnet-parent for project:
com.sun.jersey:jersey-project:pom:1.9 for project
com.sun.jersey:jersey-project:pom:1.9

I am wondering if this is a known problem with this repository.

Can anyone suggest me how can I package the recent version of HBase? For my
project, I require to use hbase 0.99 or higher.

Thanks
Abhishek 

--
View this message in context: http://apache-hbase.679495.n3.nabble.com/hbase-project-compilation-tp4062116.html
Sent from the HBase Developer mailing list archive at Nabble.com.

Jianshi Huang (JIRA | 31 Jul 04:33 2014
Picon

[jira] [Resolved] (HBASE-11622) completebulkload/loadIncrementalHFiles cannot specify table with namespace


     [
https://issues.apache.org/jira/browse/HBASE-11622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jianshi Huang resolved HBASE-11622.
-----------------------------------

      Resolution: Fixed
    Release Note: Already fixed by HBASE-11609

> completebulkload/loadIncrementalHFiles cannot specify table with namespace
> --------------------------------------------------------------------------
>
>                 Key: HBASE-11622
>                 URL: https://issues.apache.org/jira/browse/HBASE-11622
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.98.0
>            Reporter: Jianshi Huang
>
> I'm using completebulkload to load 500GB of data to a table (presplitted). However, it reports the
following errors:
> Looks like completebulkload didn't recognize the namespace part (namespace:table).
> Caused by: java.net.URISyntaxException: Relative path in absolute URI: grapple:vertices,37.bottom
>         at java.net.URI.checkPath(URI.java:1804)
>         at java.net.URI.<init>(URI.java:752)
>         at org.apache.hadoop.fs.Path.initialize(Path.java:203)
> By looking at the source code of LoadIncrementalHFiles.java, it seems the temporary path created for
splitting will contain ':',
> The error part should be this:
(Continue reading)

Jianshi Huang (JIRA | 31 Jul 04:02 2014
Picon

[jira] [Created] (HBASE-11622) completebulkload/loadIncrementalHFiles cannot specify table with namespace

Jianshi Huang created HBASE-11622:
-------------------------------------

             Summary: completebulkload/loadIncrementalHFiles cannot specify table with namespace
                 Key: HBASE-11622
                 URL: https://issues.apache.org/jira/browse/HBASE-11622
             Project: HBase
          Issue Type: Bug
    Affects Versions: 0.98.0
            Reporter: Jianshi Huang

I'm using completebulkload to load 500GB of data to a table (presplitted). However, it reports the
following errors:

Looks like completebulkload didn't recognize the namespace part (namespace:table).

Caused by: java.net.URISyntaxException: Relative path in absolute URI: grapple:vertices,37.bottom
        at java.net.URI.checkPath(URI.java:1804)
        at java.net.URI.<init>(URI.java:752)
        at org.apache.hadoop.fs.Path.initialize(Path.java:203)

By looking at the source code of LoadIncrementalHFiles.java, it seems the temporary path created for
splitting will contain ':',

The error part should be this:
String uniqueName = getUniqueName(table.getName());
    HColumnDescriptor familyDesc = table.getTableDescriptor().getFamily(item.family);
    Path botOut = new Path(tmpDir, uniqueName + ".bottom");
    Path topOut = new Path(tmpDir, uniqueName + ".top");
    splitStoreFile(getConf(), hfilePath, familyDesc, splitKey,
(Continue reading)


Gmane