Nicolas Liochon (JIRA | 27 Aug 16:54 2014
Picon

[jira] [Created] (HBASE-11836) IntegrationTestTimeBoundedMultiGetRequestsWithRegionReplicas tests simple get by default

Nicolas Liochon created HBASE-11836:
---------------------------------------

             Summary: IntegrationTestTimeBoundedMultiGetRequestsWithRegionReplicas tests simple get by default
                 Key: HBASE-11836
                 URL: https://issues.apache.org/jira/browse/HBASE-11836
             Project: HBase
          Issue Type: Bug
          Components: test
    Affects Versions: 1.0.0, 2.0.0
            Reporter: Nicolas Liochon
            Assignee: Nicolas Liochon
            Priority: Trivial
             Fix For: 1.0.0, 2.0.0
         Attachments: itMG.patch

Counter intuitive behavior, trivial to fix. 

--
This message was sent by Atlassian JIRA
(v6.2#6252)

Nicolas Liochon (JIRA | 27 Aug 16:50 2014
Picon

[jira] [Created] (HBASE-11835) Wrong managenement of non expected calls in the client

Nicolas Liochon created HBASE-11835:
---------------------------------------

             Summary: Wrong managenement of non expected calls in the client
                 Key: HBASE-11835
                 URL: https://issues.apache.org/jira/browse/HBASE-11835
             Project: HBase
          Issue Type: Bug
          Components: Client
    Affects Versions: 0.98.6, 1.0.0, 2.0.0
            Reporter: Nicolas Liochon
            Assignee: Nicolas Liochon
             Fix For: 1.0.0, 2.0.0, 0.98.7
         Attachments: rpcClient.patch

If a call is purged or canceled we try to skip the reply from the server, but we read the wrong number of bytes so
we corrupt the tcp channel. It's hidden as it triggers retry and so on, but it's bad for performances obviously.

It happens with cell blocks.

[~ram_krish_86], [~saint.ack@...], you know this part better
than me, do you agree with the analysis and the patch?

The changes in rpcServer are not fully related: as the client close the connections in such situation, I
observed  both ClosedChannelException and CancelledKeyException. 

--
This message was sent by Atlassian JIRA
(v6.2#6252)

(Continue reading)

Picon

[jira] [Resolved] (HBASE-11790) Bulk load should use HFileOutputFormat2 in all cases


     [
https://issues.apache.org/jira/browse/HBASE-11790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ramkrishna.s.vasudevan resolved HBASE-11790.
--------------------------------------------

    Resolution: Invalid

My intention was not right here. Will close this for now.

> Bulk load should use HFileOutputFormat2 in all cases
> ----------------------------------------------------
>
>                 Key: HBASE-11790
>                 URL: https://issues.apache.org/jira/browse/HBASE-11790
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: ramkrishna.s.vasudevan
>            Assignee: ramkrishna.s.vasudevan
>             Fix For: 0.99.0, 2.0.0, 0.98.7
>
>
> While debugging HBASE-11591 it was found that we in case of bulk load either thro TSV and by using
LoadIncrementalHFiles we should be able to use the HFileOutputFormat2 so that the the metadata
BULKLOAD_TIME_KEY is added to the HFile.  If not this file will not be considered as part of bulk load and we
end up in not reading from these files.  

--
This message was sent by Atlassian JIRA
(Continue reading)

stack (JIRA | 27 Aug 09:01 2014
Picon

[jira] [Created] (HBASE-11834) TestHRegionBusyWait.testParallelAppendWithMemStoreFlush fails sporadically

stack created HBASE-11834:
-----------------------------

             Summary: TestHRegionBusyWait.testParallelAppendWithMemStoreFlush fails sporadically
                 Key: HBASE-11834
                 URL: https://issues.apache.org/jira/browse/HBASE-11834
             Project: HBase
          Issue Type: Bug
          Components: test
            Reporter: stack
            Assignee: stack

See https://builds.apache.org/view/H-L/view/HBase/job/HBase-TRUNK/5431/testReport/junit/org.apache.hadoop.hbase.regionserver/TestHRegionBusyWait/testParallelAppendWithMemStoreFlush/

Fails locally for me regularly.  TIming.  Turns out that on if we go to flush and no edits to flush, we can take
the update lock and not release it.

--
This message was sent by Atlassian JIRA
(v6.2#6252)

Picon

[jira] [Reopened] (HBASE-11440) Make KeyValueCodecWithTags as the default codec for replication in trunk


     [
https://issues.apache.org/jira/browse/HBASE-11440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ramkrishna.s.vasudevan reopened HBASE-11440:
--------------------------------------------

Will reopen and close once the commit to branch-1 is resolved.

> Make KeyValueCodecWithTags as the default codec for replication in trunk
> ------------------------------------------------------------------------
>
>                 Key: HBASE-11440
>                 URL: https://issues.apache.org/jira/browse/HBASE-11440
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 0.99.0
>            Reporter: ramkrishna.s.vasudevan
>            Assignee: ramkrishna.s.vasudevan
>             Fix For: 0.99.0
>
>         Attachments: HBASE-11440.patch, HBASE-11440_1.patch, HBASE-11440_2.patch
>
>
> Set 
> {code}
> <property>
>         <name>hbase.replication.rpc.codec</name>      <value>org.apache.hadoop.hbase.codec.KeyValueCodecWithTags</value>
> </property>
> {code}
(Continue reading)

steven xu (JIRA | 27 Aug 05:02 2014
Picon

[jira] [Created] (HBASE-11833) Hbase does not closing a closed socket resulting in thousand of CLOSE_WAIT sockets

steven xu created HBASE-11833:
---------------------------------

             Summary: Hbase does not closing a closed socket resulting in thousand of CLOSE_WAIT sockets
                 Key: HBASE-11833
                 URL: https://issues.apache.org/jira/browse/HBASE-11833
             Project: HBase
          Issue Type: Bug
          Components: regionserver
    Affects Versions: 0.98.0
         Environment: RHEL 6.3 -HDP 2.1 -6 RegionServers/Datanode -18T per node -3108Regions
            Reporter: steven xu

HBase dose not close a dead connection with the datanode.
This resulting in over 30K+ CLOSE_WAIT and at some point HBase can not connect to the datanode because too
many mapped sockets from one host to another on the same port:50010. 
After I restart all RSs,  the count of CLOSE_WAIT will increase always.
$ netstat -an|grep CLOSE_WAIT|wc -l
2545
# netstat -nap|grep CLOSE_WAIT|grep 6569|wc -l
2545
# ps -ef|grep 6569
hbase     6569  6556 21 Aug25 ?        09:52:33 /opt/jdk1.6.0_25/bin/java -Dproc_regionserver
-XX:OnOutOfMemoryError=kill -9 %p -Xmx1000m -XX:+UseConcMarkSweepGC 

I aslo have reviewed these issues:
[HBASE-9393|https://issues.apache.org/jira/browse/HBASE-9393]
[HDFS-5671|https://issues.apache.org/jira/browse/HDFS-5671]
[HDFS-1836|https://issues.apache.org/jira/browse/HDFS-1836]
I found HBase 0.98/Hadoop 2.4.0 I uesed which source codes are different from these patches.
(Continue reading)

lars hofhansl | 27 Aug 04:38 2014
Picon

[VOTE] The 1st hbase 0.94.23 release candidate is available for download

The 1st 0.94.23 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.23-rc0/
Signed with my code signing key: C7CFE328

HBase 0.94.23 is a small bug fix release with 12 fixes:
    [HBASE-9746] - RegionServer can't start when replication tries to replicate to an unknown host
    [HBASE-10834] - Better error messaging on issuing grant commands in non-authz mode
    [HBASE-11232] - Add MultiRowMutation tests.
    [HBASE-11536] - Puts of region location to Meta may be out of order which causes inconsistent of
region location
    [HBASE-11641] - TestDistributedLogSplitting.testMasterStartsUpWithLogSplittingWork
fails frequently
    [HBASE-11652] - Port HBASE-3270 and HBASE-11650 to 0.94 - create cluster id and version file in a tmp
location and move it into place
    [HBASE-11767] - [0.94] Unnecessary garbage produced by schema metrics during scanning
    [HBASE-11667] - Comment ClientScanner logic for NSREs.
    [HBASE-11754] - [Shell] Record table property SPLITS_FILE in descriptor
    [HBASE-11690] - Backport HBASE-5934 (Add the ability for Performance Evaluation to set the table
compression) to 0.94
    [HBASE-11691] - Backport HBASE-7156 (Add Data Block Encoding and -D opts to Performance
Evaluation) to 0.94
    [HBASE-11693] - Backport HBASE-11026 (Provide option to filter out all rows in
PerformanceEvaluation tool) to 0.94

TThe list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12327363

Here's the test run for this RC: https://builds.apache.org/job/HBase-0.94.23/39/

Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by EOD September 2nd on whether
we should release this as 0.94.23.

(Continue reading)

Enoch Hsu (JIRA | 26 Aug 23:53 2014
Picon

[jira] [Created] (HBASE-11832) maven release plugin overrides command line arguments

Enoch Hsu created HBASE-11832:
---------------------------------

             Summary: maven release plugin overrides command line arguments
                 Key: HBASE-11832
                 URL: https://issues.apache.org/jira/browse/HBASE-11832
             Project: HBase
          Issue Type: Bug
    Affects Versions: 0.98.4
            Reporter: Enoch Hsu
            Assignee: Enoch Hsu
            Priority: Minor
             Fix For: 0.99.0

Inside the pom under the maven-release-plugin there is a configuration that defines what the
release-plugin uses like so
<configuration>
            <!--You need this profile. It'll sign your artifacts.
                I'm not sure if this config. actually works though.
                I've been specifying -Papache-release on the command-line
             -->
            <releaseProfiles>apache-release</releaseProfiles>
            <!--This stops our running tests for each stage of maven release.
                But it builds the test jar.  From SUREFIRE-172.
              -->
            <arguments>-Dmaven.test.skip.exec</arguments>
            <pomFileName>pom.xml</pomFileName>
          </configuration>

The arguments are hardcoded in and will automatically override any arguments the user passes in from the
(Continue reading)

Elliott Clark (JIRA | 26 Aug 23:13 2014
Picon

[jira] [Created] (HBASE-11831) Running a HBase ZK server shouldn't check memstore/block cache.

Elliott Clark created HBASE-11831:
-------------------------------------

             Summary: Running a HBase ZK server shouldn't check memstore/block cache.
                 Key: HBASE-11831
                 URL: https://issues.apache.org/jira/browse/HBASE-11831
             Project: HBase
          Issue Type: Bug
            Reporter: Elliott Clark
            Assignee: Elliott Clark

--
This message was sent by Atlassian JIRA
(v6.2#6252)

Enis Söztutar | 26 Aug 20:35 2014
Picon

Will cut 0.99 first RC on Sep 2

Hi,

This is past due but I was focussed elsewhere. I am thinking of cutting the
first RC for 0.99.0 release on Sep 2.

As a reminder, this will be a developer release, not for production. There
will be no guarantees for backwards and forwards binary / source compat.
But this release will allow us to test compatibility for eventual 1.0 which
should support rolling upgrades from 0.98 and migration from 0.94.

There has been some progress on the API front (thanks to Carter and others)
and I intend to continue on this line of work (HBASE-10602 etc) before
final 1.0 which should not be long.

Some major portion of other subtasks of
https://issues.apache.org/jira/browse/HBASE-10856 are still open. I'll be
more active in kicking these out unless there is some progress around it.
Feel free to leave a comment here or in the issue, if you want to get your
issue in.

Cheers,
Enis
Lars Hofhansl (JIRA | 26 Aug 20:04 2014
Picon

[jira] [Resolved] (HBASE-9746) RegionServer can't start when replication tries to replicate to an unknown host


     [
https://issues.apache.org/jira/browse/HBASE-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Lars Hofhansl resolved HBASE-9746.
----------------------------------

    Resolution: Fixed

Committed addendum.
Meh, that was more painful than it should have been.

> RegionServer can't start when replication tries to replicate to an unknown host
> -------------------------------------------------------------------------------
>
>                 Key: HBASE-9746
>                 URL: https://issues.apache.org/jira/browse/HBASE-9746
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.94.12
>            Reporter: Lars Hofhansl
>            Assignee: Lars Hofhansl
>             Fix For: 0.99.0, 2.0.0, 0.94.23, 0.98.6
>
>         Attachments: 9746-0.98.txt, 9746-addendum.txt, 9746-trunk.txt
>
>
> Just ran into this:
> {code}
> 13/10/11 00:37:02 [regionserver60020] WARN  zookeeper.ZKConfig(204):
(Continue reading)


Gmane