Hi all,
i wanted to run some programs that requires hbase table data, to
evaluate my programs. The dataset can be of 3-4GB size, any number of
column families and columns and rows. please somebody provide this. Or else
if some links which provide such dataset for hbase are available for
download, please send me. Thank you
--
--
*Regards*
*
Vamshi Krishna
*
Hello, On Tue, Jan 31, 2012 at 3:45 PM, Stack <stack@...> wrote: > On Mon, Jan 30, 2012 at 5:27 PM, Zheng Da <zhengda1936@...> wrote: > > Hello, > > > > I'm thinking of using HBase to store a matrix, so each subblock of a > matrix > > is stored as a value in HBase, and the key of the value is the location > of > > the subblock in the matrix. At beginning, I wanted the subblock to be as > > large as 8MB. But when I read > > http://www.larsgeorge.com/2009/10/hbase-architecture-101-storage.html, I > > found HBase splits keyvalue pairs into blocks and the block size is > usually > > much smaller than 8MB. So what happens if I store data of 8MB as a value > in > > HBase? I tried, and it seems to work fine. But how about the performance? > > > > Please point to what in that blog has you thinking we split keyvalues. > We do not. > It mentions "block size" and also the figure shows data is split into blocks and each block starts with a magic header, which shows whether data in the block is compressed or not. Also blocks in HBase is indexed. "Minimum block size. We recommend a setting of minimum block size between 8KB to 1MB for general usage. Larger block size is preferred if files are(Continue reading)
Pe 01.02.2012 05:14, Vamshi Krishna a scris: > Hi all, > i wanted to run some programs that requires hbase table data, to > evaluate my programs. The dataset can be of 3-4GB size, any number of > column families and columns and rows. please somebody provide this. Or else > if some links which provide such dataset for hbase are available for > download, please send me. Thank you Check out BigTop [1]. From what I heard talking to a committer, they have tests that generate a lot of random data. They need them to find issues in HBase/Hadoop systems. They have some load tests and all the basic infrastructure set up so you could customize them. [1] http://incubator.apache.org/bigtop/ -- -- Ioan Eugen Stan http://ieugen.blogspot.com
Suppose i have a relationship 1 to N, for example Student , College. Student Attributes: Name,Surname,CollegeFKey, College attributes: CollegeKey,Other,Other. Suppose that i have a program which read students and Exams from a plain text file. And on this file i have duplicated Colleges and Duplicated Studens. Like in denormalized tabels: CollegeId,Other,Other,Name,Surname,CollegeFkey. 1,x,y,Mike,M,1 1,x,y,R,P,1 ... ... you see i have to check in this case always that in my normalized db, i have still not inserted in the Table College 2 times the key 1, how can i solve this in Hbase ? i mean if i have 1000.. tables and rows i dont want check for every Primary Key and then for every Fk if it was inserted ok ? how can i solve that ? -- -- francesco.tangari.inf@... Inviato con Sparrow (http://www.sparrowmailapp.com/?sig)
i think that this is Usually a problem that i find always in the Information Extraction i hope to not be So wrong in that i m telling you. -- francesco.tangari.inf <at> gmail.com Inviato con Sparrow (http://www.sparrowmailapp.com/?sig) Il giorno mercoledì 1 febbraio 2012, alle ore 08.51, francesco.tangari.inf <at> gmail.com ha scritto: > Suppose i have a relationship 1 to N, for example > Student , College. > Student Attributes: > Name,Surname,CollegeFKey, > College attributes: > CollegeKey,Other,Other. > > Suppose that i have a program which read students and Exams from a plain text file. > And on this file i have duplicated Colleges and Duplicated Studens. > Like in denormalized tabels: > CollegeId,Other,Other,Name,Surname,CollegeFkey. > 1,x,y,Mike,M,1 > 1,x,y,R,P,1 > ... > ... > > you see i have to check in this case always that in my normalized db, i have still not inserted in the Table College > 2 times the key 1, how can i solve this in Hbase ? i mean if i have 1000.. tables and rows i dont want check > for every Primary Key and then for every Fk if it was inserted ok ? > how can i solve that ? >(Continue reading)
Hi hbasers. A hbase blog regarding coprocessors has been posted to apache blog site. Here is the link: https://blogs.apache.org/hbase/entry/coprocessor_introduction Your comments are welcome. Thanks, Mingjie
On Mon, Jan 30, 2012 at 6:39 AM, Galed FriedmannCan you thread dump the thrift server when its all hung up?
<galed.friedmann-eRx5tXgheRcAvxtiuMwx3w@public.gmane.org> wrote:
> Lately we're having weird issues with Thrift, after several hours the
> Thrift server "hangs" - the scripts that are using it to access HBase get
> connection timeouts, we're also using Heroku and ruby on rails apps that
> use Thrift and they simply get stuck. Only when restarting the Thrift
> process everything goes back to normal.
>
Have you enabledZK is establishing a session w/ 90second timeout and then timing out
> 2012-01-30 10:52:08,823 INFO org.apache.zookeeper.server.NIOServerCnxn:
> Established session 0x1352a393d18051e with negotiated timeout 90000 for
> client /10.217.55.193:35940
> 2012-01-30 10:52:28,001 INFO org.apache.zookeeper.server.ZooKeeperServer:
> Expiring session 0x1352a393d18051b, timeout of 90000ms exceeded
> 2012-01-30 10:52:28,001 INFO
> org.apache.zookeeper.server.PrepRequestProcessor: Processed session
> termination for sessionid: 0x1352a393d18051b
immediately?Client went away? All the lease expireds happen always or just around
> 2012-01-30 10:51:36,382 WARN org.apache.hadoop.ipc.HBaseServer: IPC Server
> listener on 60020: readAndProcess threw exception java.io.IOException:
> Connection rese
> t by peer. Count of bytes read: 0
> java.io.IOException: Connection reset by peer
> at sun.nio.ch.FileDispatcher.read0(Native Method)
> at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:21)
> at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:237)
> at sun.nio.ch.IOUtil.read(IOUtil.java:210)
> at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:236)
> at
> org.apache.hadoop.hbase.ipc.HBaseServer.channelRead(HBaseServer.java:1359)
> at
> org.apache.hadoop.hbase.ipc.HBaseServer$Connection.readAndProcess(HBaseServer.java:900)
> at
> org.apache.hadoop.hbase.ipc.HBaseServer$Listener.doRead(HBaseServer.java:522)
> at
> org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:316)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:619)
> 2012-01-30 10:52:24,016 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
> -4511393305838866925 lease expired
> 2012-01-30 10:52:24,016 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
> -5818959718437063034 lease expired
> 2012-01-30 10:52:24,016 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner
> -1408921590864341720 lease expired
>
time of the hangup (You are closing scanners when done?)
St.Ack
Master status for domU-3F.compute-1.internal:60000 as of Wed Feb 01 04:45:21 UTC 2012
Version Info:
===========================================================
HBase 0.90.4-cdh3u2
Subversion git://ubuntu-slave01/var/lib/jenkins/workspace/CDH3u2-Full-RC/build/cdh3/hbase/0.90.4-cdh3u2/source -r
Compiled by jenkins on Thu Oct 13 20:32:26 PDT 2011
Hadoop 0.20.2-cdh3u2
Subversion file:///tmp/topdir/BUILD/hadoop-0.20.2-cdh3u2 -r 95a824e4005b2a94fe1c11f1ef9db4c672ba43cb
Compiled by root on Thu Oct 13 21:50:22 PDT 2011
Tasks:
===========================================================
Servers:
===========================================================
domU-2F.compute-1.internal,60020,1327853415871: serverName=domU-2F.compute-1.internal,60020,1327853415871, load=(requests=275, regions=20, usedHeap=1610, maxHeap=4070)
domU-76.compute-1.internal,60020,1327853417601: serverName=domU-76.compute-1.internal,60020,1327853417601, load=(requests=405, regions=21, usedHeap=2529, maxHeap=4070)
ip-255.ec2.internal,60020,1327853408824: serverName=ip-255.ec2.internal,60020,1327853408824, load=(requests=70, regions=21, usedHeap=1707, maxHeap=4070)
Regions-in-transition:
===========================================================
Executors:
===========================================================
Status for executor: MASTER_TABLE_OPERATIONS-domU-3F.compute-1.internal:60000
=======================================
0 events queued, 0 running
Status for executor: MASTER_META_SERVER_OPERATIONS-domU-3F.compute-1.internal:60000
=======================================
0 events queued, 0 running
Status for executor: MASTER_CLOSE_REGION-domU-3F.compute-1.internal:60000
=======================================
0 events queued, 0 running
Status for executor: MASTER_SERVER_OPERATIONS-domU-3F.compute-1.internal:60000
=======================================
0 events queued, 0 running
Status for executor: MASTER_OPEN_REGION-domU-3F.compute-1.internal:60000
=======================================
0 events queued, 0 running
Stacks:
===========================================================
Process Thread Dump:
55 active threads
Thread 4895 (IPC Client (47) connection to domU-3F.compute-1.internal/10..193:8020 from hbase):
State: TIMED_WAITING
Blocked count: 0
Waited count: 1
Stack:
java.lang.Object.wait(Native Method)
org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:680)
org.apache.hadoop.ipc.Client$Connection.run(Client.java:723)
Thread 4894 (IPC Client (47) connection to /10..255:60020 from an unknown user):
State: TIMED_WAITING
Blocked count: 0
Waited count: 1
Stack:
java.lang.Object.wait(Native Method)
org.apache.hadoop.hbase.ipc.HBaseClient$Connection.waitForWork(HBaseClient.java:431)
org.apache.hadoop.hbase.ipc.HBaseClient$Connection.run(HBaseClient.java:476)
Thread 4888 (sendParams-421):
State: TIMED_WAITING
Blocked count: 1
Waited count: 4
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
java.lang.Thread.run(Thread.java:619)
Thread 1788 (408631784 <at> qtp-1682756992-7):
State: RUNNABLE
Blocked count: 4942
Waited count: 7162
Stack:
sun.management.ThreadImpl.getThreadInfo0(Native Method)
sun.management.ThreadImpl.getThreadInfo(ThreadImpl.java:147)
sun.management.ThreadImpl.getThreadInfo(ThreadImpl.java:123)
org.apache.hadoop.util.ReflectionUtils.printThreadInfo(ReflectionUtils.java:149)
org.apache.hadoop.hbase.master.MasterDumpServlet.doGet(MasterDumpServlet.java:81)
javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221)
org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:829)
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
org.mortbay.jetty.Server.handle(Server.java:326)
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
Thread 76 (MASTER_CLOSE_REGION-domU-3F.compute-1.internal:60000-4):
State: WAITING
Blocked count: 38
Waited count: 30
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 7c9b87f6
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
java.lang.Thread.run(Thread.java:619)
Thread 74 (MASTER_CLOSE_REGION-domU-3F.compute-1.internal:60000-3):
State: WAITING
Blocked count: 39
Waited count: 30
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 7c9b87f6
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
java.lang.Thread.run(Thread.java:619)
Thread 73 (MASTER_CLOSE_REGION-domU-3F.compute-1.internal:60000-2):
State: WAITING
Blocked count: 52
Waited count: 40
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 7c9b87f6
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
java.lang.Thread.run(Thread.java:619)
Thread 72 (MASTER_CLOSE_REGION-domU-3F.compute-1.internal:60000-1):
State: WAITING
Blocked count: 47
Waited count: 39
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 7c9b87f6
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
java.lang.Thread.run(Thread.java:619)
Thread 71 (MASTER_CLOSE_REGION-domU-3F.compute-1.internal:60000-0):
State: WAITING
Blocked count: 49
Waited count: 39
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 7c9b87f6
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
java.lang.Thread.run(Thread.java:619)
Thread 60 (MASTER_OPEN_REGION-domU-3F.compute-1.internal:60000-4):
State: WAITING
Blocked count: 62
Waited count: 60
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 7e413fc6
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
java.lang.Thread.run(Thread.java:619)
Thread 59 (MASTER_OPEN_REGION-domU-3F.compute-1.internal:60000-3):
State: WAITING
Blocked count: 63
Waited count: 60
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 7e413fc6
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
java.lang.Thread.run(Thread.java:619)
Thread 58 (MASTER_OPEN_REGION-domU-3F.compute-1.internal:60000-2):
State: WAITING
Blocked count: 66
Waited count: 64
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 7e413fc6
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
java.lang.Thread.run(Thread.java:619)
Thread 57 (domU-3F.compute-1.internal:60000-CatalogJanitor):
State: TIMED_WAITING
Blocked count: 51044
Waited count: 51688
Stack:
java.lang.Object.wait(Native Method)
org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:91)
org.apache.hadoop.hbase.Chore.run(Chore.java:74)
Thread 56 (domU-3F.compute-1.internal:60000-BalancerChore):
State: TIMED_WAITING
Blocked count: 55
Waited count: 769
Stack:
java.lang.Object.wait(Native Method)
org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:91)
org.apache.hadoop.hbase.Chore.run(Chore.java:74)
Thread 54 (MASTER_OPEN_REGION-domU-3F.compute-1.internal:60000-1):
State: WAITING
Blocked count: 63
Waited count: 63
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 7e413fc6
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
java.lang.Thread.run(Thread.java:619)
Thread 52 (MASTER_OPEN_REGION-domU-3F.compute-1.internal:60000-0):
State: WAITING
Blocked count: 65
Waited count: 63
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 7e413fc6
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
java.lang.Thread.run(Thread.java:619)
Thread 49 (Timer-0):
State: TIMED_WAITING
Blocked count: 0
Waited count: 7270
Stack:
java.lang.Object.wait(Native Method)
java.util.TimerThread.mainLoop(Timer.java:509)
java.util.TimerThread.run(Timer.java:462)
Thread 48 (1519664580 <at> qtp-1682756992-1 - Acceptor0 SelectChannelConnector <at> 0.0.0.0:60010):
State: RUNNABLE
Blocked count: 14
Waited count: 1
Stack:
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:511)
org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:193)
org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124)
org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708)
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Thread 45 (master-domU-3F.compute-1.internal:60000.oldLogCleaner):
State: TIMED_WAITING
Blocked count: 3770
Waited count: 11172
Stack:
java.lang.Object.wait(Native Method)
org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:91)
org.apache.hadoop.hbase.Chore.run(Chore.java:74)
org.apache.hadoop.hbase.master.LogCleaner.run(LogCleaner.java:154)
Thread 44 (domU-3F.compute-1.internal:60000.timeoutMonitor):
State: TIMED_WAITING
Blocked count: 0
Waited count: 21804
Stack:
java.lang.Object.wait(Native Method)
org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:91)
org.apache.hadoop.hbase.Chore.run(Chore.java:74)
Thread 43 (master-domU-3F.compute-1.internal:60000-EventThread):
State: WAITING
Blocked count: 2
Waited count: 7
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 7591777e
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
Thread 42 (master-domU-3F.compute-1.internal:60000-SendThread(domU-3F.compute-1.internal:2181)):
State: RUNNABLE
Blocked count: 0
Waited count: 0
Stack:
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1107)
Thread 10 (master-domU-3F.compute-1.internal:60000):
State: TIMED_WAITING
Blocked count: 116
Waited count: 217422
Stack:
java.lang.Object.wait(Native Method)
org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:91)
org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:55)
org.apache.hadoop.hbase.master.HMaster.loop(HMaster.java:326)
org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:296)
Thread 38 (Timer thread for monitoring jvm):
State: TIMED_WAITING
Blocked count: 0
Waited count: 3636
Stack:
java.lang.Object.wait(Native Method)
java.util.TimerThread.mainLoop(Timer.java:509)
java.util.TimerThread.run(Timer.java:462)
Thread 37 (Timer thread for monitoring hbase):
State: TIMED_WAITING
Blocked count: 0
Waited count: 3636
Stack:
java.lang.Object.wait(Native Method)
java.util.TimerThread.mainLoop(Timer.java:509)
java.util.TimerThread.run(Timer.java:462)
Thread 36 (main-EventThread):
State: WAITING
Blocked count: 650
Waited count: 953
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 5979b7b0
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
Thread 35 (main-SendThread(domU-3F.compute-1.internal:2181)):
State: RUNNABLE
Blocked count: 63
Waited count: 0
Stack:
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1107)
Thread 34 (IPC Server handler 9 on 60000):
State: WAITING
Blocked count: 0
Waited count: 21711
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 460ab1b4
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1025)
Thread 33 (IPC Server handler 8 on 60000):
State: WAITING
Blocked count: 0
Waited count: 21711
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 460ab1b4
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1025)
Thread 32 (IPC Server handler 7 on 60000):
State: WAITING
Blocked count: 0
Waited count: 21711
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 460ab1b4
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1025)
Thread 31 (IPC Server handler 6 on 60000):
State: WAITING
Blocked count: 0
Waited count: 21711
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 460ab1b4
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1025)
Thread 30 (IPC Server handler 5 on 60000):
State: WAITING
Blocked count: 0
Waited count: 21711
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 460ab1b4
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1025)
Thread 29 (IPC Server handler 4 on 60000):
State: WAITING
Blocked count: 0
Waited count: 21711
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 460ab1b4
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1025)
Thread 28 (IPC Server handler 3 on 60000):
State: WAITING
Blocked count: 0
Waited count: 21711
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 460ab1b4
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1025)
Thread 27 (IPC Server handler 2 on 60000):
State: WAITING
Blocked count: 0
Waited count: 21711
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 460ab1b4
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1025)
Thread 26 (IPC Server handler 1 on 60000):
State: WAITING
Blocked count: 0
Waited count: 21711
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 460ab1b4
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1025)
Thread 25 (IPC Server handler 0 on 60000):
State: WAITING
Blocked count: 0
Waited count: 21712
Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject <at> 460ab1b4
Stack:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1025)
Thread 11 (IPC Server listener on 60000):
State: RUNNABLE
Blocked count: 19
Waited count: 0
Stack:
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:84)
org.apache.hadoop.hbase.ipc.HBaseServer$Listener.run(HBaseServer.java:414)
Thread 23 (IPC Server Responder):
State: RUNNABLE
Blocked count: 0
Waited count: 0
Stack:
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
org.apache.hadoop.hbase.ipc.HBaseServer$Responder.run(HBaseServer.java:588)
Thread 24 (Timer thread for monitoring ugi):
State: TIMED_WAITING
Blocked count: 0
Waited count: 3636
Stack:
java.lang.Object.wait(Native Method)
java.util.TimerThread.mainLoop(Timer.java:509)
java.util.TimerThread.run(Timer.java:462)
Thread 22 (Timer thread for monitoring rpc):
State: TIMED_WAITING
Blocked count: 1
Waited count: 3637
Stack:
java.lang.Object.wait(Native Method)
java.util.TimerThread.mainLoop(Timer.java:509)
java.util.TimerThread.run(Timer.java:462)
Thread 21 (IPC Reader 9 on port 60000):
State: RUNNABLE
Blocked count: 2
Waited count: 2
Stack:
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:84)
org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:305)
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
java.lang.Thread.run(Thread.java:619)
Thread 20 (IPC Reader 8 on port 60000):
State: RUNNABLE
Blocked count: 2
Waited count: 2
Stack:
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:84)
org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:305)
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
java.lang.Thread.run(Thread.java:619)
Thread 19 (IPC Reader 7 on port 60000):
State: RUNNABLE
Blocked count: 2
Waited count: 2
Stack:
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:84)
org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:305)
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
java.lang.Thread.run(Thread.java:619)
Thread 18 (IPC Reader 6 on port 60000):
State: RUNNABLE
Blocked count: 2
Waited count: 2
Stack:
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:84)
org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:305)
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
java.lang.Thread.run(Thread.java:619)
Thread 17 (IPC Reader 5 on port 60000):
State: RUNNABLE
Blocked count: 2
Waited count: 2
Stack:
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:84)
org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:305)
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
java.lang.Thread.run(Thread.java:619)
Thread 16 (IPC Reader 4 on port 60000):
State: RUNNABLE
Blocked count: 2
Waited count: 2
Stack:
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:84)
org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:305)
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
java.lang.Thread.run(Thread.java:619)
Thread 15 (IPC Reader 3 on port 60000):
State: RUNNABLE
Blocked count: 2
Waited count: 2
Stack:
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:84)
org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:305)
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
java.lang.Thread.run(Thread.java:619)
Thread 14 (IPC Reader 2 on port 60000):
State: RUNNABLE
Blocked count: 2
Waited count: 2
Stack:
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:84)
org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:305)
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
java.lang.Thread.run(Thread.java:619)
Thread 13 (IPC Reader 1 on port 60000):
State: RUNNABLE
Blocked count: 2
Waited count: 2
Stack:
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:84)
org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:305)
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
java.lang.Thread.run(Thread.java:619)
Thread 12 (IPC Reader 0 on port 60000):
State: RUNNABLE
Blocked count: 1
Waited count: 1
Stack:
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:84)
org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:305)
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
java.lang.Thread.run(Thread.java:619)
Thread 5 (Signal Dispatcher):
State: RUNNABLE
Blocked count: 0
Waited count: 0
Stack:
Thread 3 (Finalizer):
State: WAITING
Blocked count: 493
Waited count: 492
Waiting on java.lang.ref.ReferenceQueue$Lock <at> 4b0e18ba
Stack:
java.lang.Object.wait(Native Method)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
Thread 2 (Reference Handler):
State: WAITING
Blocked count: 499
Waited count: 492
Waiting on java.lang.ref.Reference$Lock <at> a7981d5
Stack:
java.lang.Object.wait(Native Method)
java.lang.Object.wait(Object.java:485)
java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
Thread 1 (main):
State: WAITING
Blocked count: 5
Waited count: 5
Waiting on org.apache.hadoop.hbase.master.HMaster <at> 2f3acc52
Stack:
java.lang.Object.wait(Native Method)
java.lang.Thread.join(Thread.java:1143)
java.lang.Thread.join(Thread.java:1196)
org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:148)
org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:102)
org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:76)
org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1135)
Master configuration:
===========================================================
<?xml version="1.0" encoding="UTF-8" standalone="no"?><configuration>
<property><!--Loaded from mapred-default.xml--><name>job.end.retry.interval</name><value>30000</value></property>
<property><!--Loaded from core-default.xml--><name>io.bytes.per.checksum</name><value>512</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.job.tracker.retiredjobs.cache.size</name><value>1000</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.regions.slop</name><value>0</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.task.profile.reduces</name><value>0-2</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapreduce.jobtracker.staging.root.dir</name><value>${hadoop.tmp.dir}/mapred/staging</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.zookeeper.leaderport</name><value>3888</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.regionserver.info.port</name><value>60030</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.job.reuse.jvm.num.tasks</name><value>1</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.block.access.token.lifetime</name><value>600</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.reduce.tasks.speculative.execution</name><value>true</value></property>
<property><!--Loaded from core-default.xml--><name>hadoop.http.authentication.kerberos.keytab</name><value>${user.home}/hadoop.keytab</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.permissions.supergroup</name><value>supergroup</value></property>
<property><!--Loaded from core-default.xml--><name>io.seqfile.sorter.recordlimit</name><value>1000000</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.master.dns.nameserver</name><value>default</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.task.tracker.http.address</name><value>0.0.0.0:50060</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.namenode.delegation.token.renew-interval</name><value>86400000</value></property>
<property><!--Loaded from core-default.xml--><name>hadoop.workaround.non.threadsafe.getpwuid</name><value>false</value></property>
<property><!--Loaded from core-default.xml--><name>fs.ramfs.impl</name><value>org.apache.hadoop.fs.InMemoryFileSystem</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.system.dir</name><value>${hadoop.tmp.dir}/mapred/system</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.task.tracker.report.address</name><value>127.0.0.1:0</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapreduce.reduce.shuffle.connect.timeout</name><value>180000</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.healthChecker.interval</name><value>60000</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.hregion.memstore.flush.size</name><value>67108864</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapreduce.job.complete.cancel.delegation.tokens</name><value>true</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.regionserver.logroll.period</name><value>3600000</value></property>
<property><!--Loaded from core-default.xml--><name>fs.trash.interval</name><value>0</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.skip.map.auto.incr.proc.count</name><value>true</value></property>
<property><!--Loaded from core-default.xml--><name>hadoop.http.authentication.kerberos.principal</name><value>HTTP/localhost <at> LOCALHOST</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.child.tmp</name><value>./tmp</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.regionserver.dns.interface</name><value>default</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.tasktracker.taskmemorymanager.monitoring-interval</name><value>5000</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.datanode.http.address</name><value>0.0.0.0:50075</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.hstore.blockingStoreFiles</name><value>7</value></property>
<property><!--Loaded from mapred-default.xml--><name>io.sort.spill.percent</name><value>0.80</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.job.shuffle.input.buffer.percent</name><value>0.70</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.max.objects</name><value>0</value></property>
<property><!--Loaded from hbase-site.xml--><name>hbase.client.write.buffer</name><value>20971520</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.skip.map.max.skip.records</name><value>0</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapreduce.reduce.shuffle.maxfetchfailures</name><value>10</value></property>
<property><!--Loaded from core-site.xml--><name>hadoop.security.authorization</name><value>false</value></property>
<property><!--Loaded from hbase-site.xml--><name>hbase.zookeeper.property.clientPort</name><value>2181</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.regionserver.info.port.auto</name><value>false</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.task.profile.maps</name><value>0-2</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.https.server.keystore.resource</name><value>ssl-server.xml</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.replication.interval</name><value>3</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.local.dir</name><value>${hadoop.tmp.dir}/mapred/local</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.merge.recordsBeforeProgress</name><value>10000</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.job.tracker.http.address</name><value>0.0.0.0:50030</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.master.logcleaner.ttl</name><value>600000</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.compress.map.output</name><value>false</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.userlog.retain.hours</name><value>24</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.regionserver.optionallogflushinterval</name><value>1000</value></property>
<property><!--Loaded from Unknown--><name>mapred.used.genericoptionsparser</name><value>true</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.tasktracker.reduce.tasks.maximum</name><value>2</value></property>
<property><!--Loaded from core-default.xml--><name>hadoop.security.uid.cache.secs</name><value>14400</value></property>
<property><!--Loaded from hbase-site.xml--><name>hbase.rootdir</name><value>hdfs://domU-3F.compute-1.internal:8020/hbase</value></property>
<property><!--Loaded from core-default.xml--><name>fs.har.impl.disable.cache</name><value>true</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.cluster.map.memory.mb</name><value>-1</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.zookeeper.dns.interface</name><value>default</value></property>
<property><!--Loaded from hbase-default.xml--><name>zookeeper.session.timeout</name><value>180000</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.data.dir</name><value>${hadoop.tmp.dir}/dfs/data</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.mapreduce.hfileoutputformat.blocksize</name><value>65536</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.access.time.precision</name><value>3600000</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.hstore.compaction.max</name><value>10</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.replication.min</name><value>1</value></property>
<property><!--Loaded from Unknown--><name>mapred.task.id</name><value>hb_m_domU-3F.compute-1.internal:60000_1327853409097</value></property>
<property><!--Loaded from core-default.xml--><name>fs.checkpoint.dir</name><value>${hadoop.tmp.dir}/dfs/namesecondary</value></property>
<property><!--Loaded from core-default.xml--><name>fs.s3n.impl</name><value>org.apache.hadoop.fs.s3native.NativeS3FileSystem</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapreduce.tasktracker.outofband.heartbeat</name><value>false</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.master.info.bindAddress</name><value>0.0.0.0</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.jobtracker.restart.recover</name><value>false</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.hstore.compactionThreshold</name><value>3</value></property>
<property><!--Loaded from core-default.xml--><name>hadoop.logfile.size</name><value>10000000</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.regionserver.nbreservationblocks</name><value>4</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.support.append</name><value>true</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.inmem.merge.threshold</name><value>1000</value></property>
<property><!--Loaded from core-default.xml--><name>ipc.client.connection.maxidletime</name><value>10000</value></property>
<property><!--Loaded from core-default.xml--><name>fs.checkpoint.size</name><value>67108864</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.blockreport.intervalMsec</name><value>3600000</value></property>
<property><!--Loaded from core-default.xml--><name>fs.s3.sleepTimeSeconds</name><value>10</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.client.block.write.retries</name><value>3</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.balancer.period</name><value>300000</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.reduce.tasks</name><value>1</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.queue.names</name><value>default</value></property>
<property><!--Loaded from core-default.xml--><name>io.seqfile.lazydecompress</name><value>true</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.https.enable</name><value>false</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.zookeeper.property.maxClientCnxns</name><value>2000</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.replication</name><value>3</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.regionserver.thread.splitcompactcheckfrequency</name><value>20000</value></property>
<property><!--Loaded from core-default.xml--><name>ipc.client.tcpnodelay</name><value>false</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.client.scanner.caching</name><value>1</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.acls.enabled</name><value>false</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.tasktracker.dns.nameserver</name><value>default</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.submit.replication</name><value>10</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.client.retries.number</name><value>10</value></property>
<property><!--Loaded from core-default.xml--><name>io.compression.codecs</name><value>org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.BZip2Codec,org.apache.hadoop.io.compress.DeflateCodec,org.apache.hadoop.io.compress.SnappyCodec</value></property>
<property><!--Loaded from core-default.xml--><name>io.file.buffer.size</name><value>4096</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.zookeeper.dns.nameserver</name><value>default</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.regionserver.hlog.reader.impl</name><value>org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.map.tasks.speculative.execution</name><value>true</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.zookeeper.property.dataDir</name><value>${hbase.tmp.dir}/zookeeper</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.hregion.memstore.mslab.enabled</name><value>false</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.regionserver.dns.nameserver</name><value>default</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.map.max.attempts</name><value>4</value></property>
<property><!--Loaded from hbase-default.xml--><name>hfile.block.cache.size</name><value>0.2</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.job.shuffle.merge.percent</name><value>0.66</value></property>
<property><!--Loaded from core-default.xml--><name>fs.har.impl</name><value>org.apache.hadoop.fs.HarFileSystem</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.regionserver.class</name><value>org.apache.hadoop.hbase.ipc.HRegionInterface</value></property>
<property><!--Loaded from core-site.xml--><name>hadoop.security.authentication</name><value>simple</value></property>
<property><!--Loaded from core-default.xml--><name>fs.s3.buffer.dir</name><value>${hadoop.tmp.dir}/s3</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.skip.reduce.auto.incr.proc.count</name><value>true</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.http.address</name><value>0.0.0.0:50070</value></property>
<property><!--Loaded from hbase-site.xml--><name>hbase.master.info.port</name><value>60010</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.job.tracker.jobhistory.lru.cache.size</name><value>5</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.replication.considerLoad</name><value>true</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.block.access.token.enable</name><value>false</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapreduce.job.acl-view-job</name><value> </value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.job.queue.name</name><value>default</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.permissions</name><value>true</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.job.tracker.persist.jobstatus.hours</name><value>0</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapreduce.tasktracker.cache.local.numberdirectories</name><value>10000</value></property>
<property><!--Loaded from core-default.xml--><name>fs.file.impl</name><value>org.apache.hadoop.fs.LocalFileSystem</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.block.size</name><value>67108864</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.hash.type</name><value>murmur</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.https.address</name><value>0.0.0.0:50470</value></property>
<property><!--Loaded from core-default.xml--><name>ipc.client.kill.max</name><value>10</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.healthChecker.script.timeout</name><value>600000</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.tasktracker.map.tasks.maximum</name><value>2</value></property>
<property><!--Loaded from mapred-default.xml--><name>jobclient.completion.poll.interval</name><value>5000</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.job.tracker.persist.jobstatus.dir</name><value>/jobtracker/jobsInfo</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.default.chunk.view.size</name><value>32768</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.reduce.slowstart.completed.maps</name><value>0.05</value></property>
<property><!--Loaded from mapred-default.xml--><name>io.sort.mb</name><value>100</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.datanode.failed.volumes.tolerated</name><value>0</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.https.need.client.auth</name><value>false</value></property>
<property><!--Loaded from core-default.xml--><name>hadoop.http.authentication.type</name><value>simple</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.regionserver.regionSplitLimit</name><value>2147483647</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.rest.port</name><value>8080</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.datanode.data.dir.perm</name><value>700</value></property>
<property><!--Loaded from core-default.xml--><name>ipc.server.listen.queue.size</name><value>128</value></property>
<property><!--Loaded from core-default.xml--><name>io.mapfile.bloom.size</name><value>1048576</value></property>
<property><!--Loaded from core-default.xml--><name>fs.hsftp.impl</name><value>org.apache.hadoop.hdfs.HsftpFileSystem</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.datanode.dns.nameserver</name><value>default</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.client.pause</name><value>1000</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.child.java.opts</name><value>-Xmx200m</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.replication.max</name><value>512</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.queue.default.state</name><value>RUNNING</value></property>
<property><!--Loaded from mapred-default.xml--><name>map.sort.class</name><value>org.apache.hadoop.util.QuickSort</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.jobtracker.instrumentation</name><value>org.apache.hadoop.mapred.JobTrackerMetricsInst</value></property>
<property><!--Loaded from core-default.xml--><name>hadoop.util.hash.type</name><value>murmur</value></property>
<property><!--Loaded from core-default.xml--><name>topology.node.switch.mapping.impl</name><value>org.apache.hadoop.net.ScriptBasedMapping</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.block.access.key.update.interval</name><value>600</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.datanode.dns.interface</name><value>default</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.output.compression.type</name><value>RECORD</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.skip.attempts.to.start.skipping</name><value>2</value></property>
<property><!--Loaded from mapred-default.xml--><name>io.map.index.skip</name><value>0</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.cluster.max.map.memory.mb</name><value>-1</value></property>
<property><!--Loaded from core-default.xml--><name>fs.s3.maxRetries</name><value>4</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.namenode.logging.level</name><value>info</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.task.tracker.task-controller</name><value>org.apache.hadoop.mapred.DefaultTaskController</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.userlog.limit.kb</name><value>0</value></property>
<property><!--Loaded from core-default.xml--><name>hadoop.http.authentication.simple.anonymous.allowed</name><value>true</value></property>
<property><!--Loaded from core-default.xml--><name>hadoop.rpc.socket.factory.class.default</name><value>org.apache.hadoop.net.StandardSocketFactory</value></property>
<property><!--Loaded from core-default.xml--><name>fs.hftp.impl</name><value>org.apache.hadoop.hdfs.HftpFileSystem</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.hstore.blockingWaitTime</name><value>90000</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.namenode.handler.count</name><value>10</value></property>
<property><!--Loaded from core-default.xml--><name>fs.automatic.close</name><value>true</value></property>
<property><!--Loaded from core-default.xml--><name>fs.kfs.impl</name><value>org.apache.hadoop.fs.kfs.KosmosFileSystem</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.map.tasks</name><value>2</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.local.dir.minspacekill</name><value>0</value></property>
<property><!--Loaded from core-default.xml--><name>fs.hdfs.impl</name><value>org.apache.hadoop.hdfs.DistributedFileSystem</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.job.map.memory.mb</name><value>-1</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.jobtracker.completeuserjobs.maximum</name><value>100</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapreduce.jobtracker.split.metainfo.maxsize</name><value>10000000</value></property>
<property><!--Loaded from hbase-site.xml--><name>hbase.zookeeper.quorum</name><value>domU-3F.compute-1.internal</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.defaults.for.version</name><value>0.90.4-cdh3u2</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.hregion.max.filesize</name><value>268435456</value></property>
<property><!--Loaded from mapred-default.xml--><name>jobclient.progress.monitor.poll.interval</name><value>1000</value></property>
<property><!--Loaded from hbase-site.xml--><name>zookeeper.znode.parent</name><value>/hbase</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.blockreport.initialDelay</name><value>0</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.min.split.size</name><value>0</value></property>
<property><!--Loaded from core-default.xml--><name>hadoop.http.authentication.token.validity</name><value>36000</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.namenode.delegation.token.max-lifetime</name><value>604800000</value></property>
<property><!--Loaded from core-default.xml--><name>fs.ftp.impl</name><value>org.apache.hadoop.fs.ftp.FTPFileSystem</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.secondary.http.address</name><value>0.0.0.0:50090</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.output.compression.codec</name><value>org.apache.hadoop.io.compress.DefaultCodec</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.cluster.max.reduce.memory.mb</name><value>-1</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.cluster.reduce.memory.mb</name><value>-1</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.regionserver.hlog.writer.impl</name><value>org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogWriter</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.web.ugi</name><value>webuser,webgroup</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.task.profile</name><value>false</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.reduce.parallel.copies</name><value>5</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.heartbeat.interval</name><value>3</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.zookeeper.property.syncLimit</name><value>5</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.regionserver.lease.period</name><value>60000</value></property>
<property><!--Loaded from mapred-default.xml--><name>local.cache.size</name><value>10737418240</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.regionserver.msginterval</name><value>3000</value></property>
<property><!--Loaded from hbase-site.xml--><name>zookeeper.znode.rootserver</name><value>root-region-server</value></property>
<property><!--Loaded from mapred-default.xml--><name>io.sort.factor</name><value>10</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.task.timeout</name><value>600000</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.safemode.extension</name><value>30000</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.master.logcleaner.plugins</name><value>org.apache.hadoop.hbase.master.TimeToLiveLogCleaner</value></property>
<property><!--Loaded from core-default.xml--><name>ipc.client.idlethreshold</name><value>4000</value></property>
<property><!--Loaded from core-default.xml--><name>ipc.server.tcpnodelay</name><value>false</value></property>
<property><!--Loaded from core-default.xml--><name>hadoop.logfile.count</name><value>10</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.heartbeats.in.second</name><value>100</value></property>
<property><!--Loaded from core-default.xml--><name>fs.s3.block.size</name><value>67108864</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.map.output.compression.codec</name><value>org.apache.hadoop.io.compress.DefaultCodec</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.task.cache.levels</name><value>2</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.tasktracker.dns.interface</name><value>default</value></property>
<property><!--Loaded from core-site.xml--><name>hadoop.security.auth_to_local</name><value>DEFAULT</value></property>
<property><!--Loaded from Unknown--><name>fs.defaultFS</name><value>hdfs://domU-3F.compute-1.internal</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.safemode.min.datanodes</name><value>0</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.job.reduce.memory.mb</name><value>-1</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.tmp.dir</name><value>/tmp/hbase-${user.name}</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.zookeeper.property.initLimit</name><value>10</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.max.tracker.failures</name><value>4</value></property>
<property><!--Loaded from hbase-site.xml--><name>hbase.cluster.distributed</name><value>true</value></property>
<property><!--Loaded from core-default.xml--><name>hadoop.http.authentication.signature.secret.file</name><value>${user.home}/hadoop-http-auth-signature-secret</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.df.interval</name><value>60000</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapreduce.reduce.shuffle.read.timeout</name><value>180000</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.tasktracker.tasks.sleeptime-before-sigkill</name><value>5000</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.max.tracker.blacklists</name><value>4</value></property>
<property><!--Loaded from mapred-default.xml--><name>jobclient.output.filter</name><value>FAILED</value></property>
<property><!--Loaded from core-default.xml--><name>io.serializations</name><value>org.apache.hadoop.io.serializer.WritableSerialization</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.rest.readonly</name><value>false</value></property>
<property><!--Loaded from core-default.xml--><name>io.seqfile.compress.blocksize</name><value>1000000</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.jobtracker.taskScheduler</name><value>org.apache.hadoop.mapred.JobQueueTaskScheduler</value></property>
<property><!--Loaded from mapred-default.xml--><name>job.end.retry.attempts</name><value>0</value></property>
<property><!--Loaded from core-default.xml--><name>ipc.client.connect.max.retries</name><value>10</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.namenode.delegation.key.update-interval</name><value>86400000</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.regionserver.port</name><value>60020</value></property>
<property><!--Loaded from core-default.xml--><name>webinterface.private.actions</name><value>false</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.tasktracker.indexcache.mb</name><value>10</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.regionserver.handler.count</name><value>10</value></property>
<property><!--Loaded from core-default.xml--><name>fs.checkpoint.edits.dir</name><value>${fs.checkpoint.dir}</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapreduce.reduce.input.limit</name><value>-1</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.hregion.majorcompaction</name><value>86400000</value></property>
<property><!--Loaded from mapred-default.xml--><name>tasktracker.http.threads</name><value>40</value></property>
<property><!--Loaded from core-default.xml--><name>fs.s3n.block.size</name><value>67108864</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.job.tracker.handler.count</name><value>10</value></property>
<property><!--Loaded from mapred-default.xml--><name>keep.failed.task.files</name><value>false</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.output.compress</name><value>false</value></property>
<property><!--Loaded from core-default.xml--><name>hadoop.security.group.mapping</name><value>org.apache.hadoop.security.ShellBasedUnixGroupsMapping</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.https.client.keystore.resource</name><value>ssl-client.xml</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.jobtracker.job.history.block.size</name><value>3145728</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.skip.reduce.max.skip.groups</name><value>0</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.datanode.address</name><value>0.0.0.0:50010</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.datanode.https.address</name><value>0.0.0.0:50475</value></property>
<property><!--Loaded from core-default.xml--><name>fs.s3.impl</name><value>org.apache.hadoop.fs.s3.S3FileSystem</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.regionserver.global.memstore.upperLimit</name><value>0.4</value></property>
<property><!--Loaded from core-default.xml--><name>hadoop.tmp.dir</name><value>/tmp/hadoop-${user.name}</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.line.input.format.linespermap</name><value>1</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.regionserver.global.memstore.lowerLimit</name><value>0.35</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.hregion.preclose.flush.size</name><value>5242880</value></property>
<property><!--Loaded from core-default.xml--><name>hadoop.kerberos.kinit.command</name><value>kinit</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.datanode.du.reserved</name><value>0</value></property>
<property><!--Loaded from core-default.xml--><name>topology.script.number.args</name><value>100</value></property>
<property><!--Loaded from Unknown--><name>fs.default.name</name><value>hdfs://domU-3F.compute-1.internal</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.balance.bandwidthPerSec</name><value>1048576</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.master.dns.interface</name><value>default</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.local.dir.minspacestart</name><value>0</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.jobtracker.maxtasks.per.job</name><value>-1</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.user.jobconf.limit</name><value>5242880</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.reduce.max.attempts</name><value>4</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.job.tracker</name><value>local</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.namenode.decommission.interval</name><value>30</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.defaults.for.version.skip</name><value>false</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.name.edits.dir</name><value>${dfs.name.dir}</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.tasktracker.instrumentation</name><value>org.apache.hadoop.mapred.TaskTrackerMetricsInst</value></property>
<property><!--Loaded from core-default.xml--><name>io.mapfile.bloom.error.rate</name><value>0.005</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.tasktracker.expiry.interval</name><value>600000</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.regionserver.info.bindAddress</name><value>0.0.0.0</value></property>
<property><!--Loaded from mapred-default.xml--><name>io.sort.record.percent</name><value>0.05</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.safemode.threshold.pct</name><value>0.999f</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.job.tracker.persist.jobstatus.active</name><value>false</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.name.dir</name><value>${hadoop.tmp.dir}/dfs/name</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapreduce.job.acl-modify-job</name><value> </value></property>
<property><!--Loaded from core-default.xml--><name>fs.checkpoint.period</name><value>3600</value></property>
<property><!--Loaded from core-default.xml--><name>io.skip.checksum.errors</name><value>false</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.zookeeper.peerport</name><value>2888</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.datanode.handler.count</name><value>3</value></property>
<property><!--Loaded from hbase-site.xml--><name>hbase.master.port</name><value>60000</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.namenode.decommission.nodes.per.interval</name><value>5</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.temp.dir</name><value>${hadoop.tmp.dir}/mapred/temp</value></property>
<property><!--Loaded from core-default.xml--><name>hadoop.native.lib</name><value>true</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapreduce.job.counters.limit</name><value>120</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.client.keyvalue.maxsize</name><value>10485760</value></property>
<property><!--Loaded from hdfs-default.xml--><name>dfs.datanode.ipc.address</name><value>0.0.0.0:50020</value></property>
<property><!--Loaded from mapred-default.xml--><name>mapred.job.reduce.input.buffer.percent</name><value>0.0</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.hregion.memstore.block.multiplier</name><value>2</value></property>
<property><!--Loaded from hbase-default.xml--><name>hbase.server.thread.wakefrequency</name><value>10000</value></property>
</configuration>
Recent regionserver aborts:
===========================================================
Logs
===========================================================
+++++++++++++++++++++++++++++++
/var/log/hbase/hbase-cmf-hbase1-MASTER-domU-3F.compute-1.internal.log.out
+++++++++++++++++++++++++++++++
2012-02-01 00:05:16,939 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 00:10:16,943 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 00:15:16,945 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 00:20:16,948 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 00:25:16,951 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 00:30:16,954 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 00:35:16,956 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 00:40:16,959 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 00:45:16,962 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 00:50:16,964 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 00:55:16,967 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 01:00:16,970 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 01:05:16,973 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 01:10:16,975 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 01:15:16,978 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 01:20:16,981 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 01:25:16,983 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 01:30:16,986 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 01:35:16,988 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 01:40:16,991 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 01:45:16,994 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 01:50:16,997 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 01:55:16,999 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 02:00:17,002 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 02:05:17,004 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 02:10:17,006 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 02:15:17,010 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 02:20:17,012 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 02:25:17,015 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 02:30:17,017 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 02:35:17,019 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 02:40:17,020 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 02:45:17,021 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 02:50:17,024 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 02:55:17,028 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 03:00:17,031 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 03:05:17,035 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 03:10:17,037 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 03:15:17,041 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 03:20:17,041 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 03:25:17,043 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 03:30:17,044 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 03:35:17,047 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 03:40:17,050 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 03:45:17,053 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 03:50:17,057 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 03:55:17,058 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 04:00:17,061 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 04:05:17,064 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 04:10:17,067 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 04:15:17,069 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 04:20:17,072 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 04:25:17,075 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 04:30:17,076 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 04:35:17,079 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 04:40:17,081 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
2012-02-01 04:44:42,096 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=domU-3F.compute-1.internal:2181 sessionTimeout=180000 watcher=hconnection
2012-02-01 04:44:42,097 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server domU-3F.compute-1.internal/10..193:2181
2012-02-01 04:44:42,097 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to domU-3F.compute-1.internal/10..193:2181, initiating session
2012-02-01 04:44:42,100 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server domU-3F.compute-1.internal/10.217.55.193:2181, sessionid = 0x1352a393d180fc6, negotiated timeout = 90000
2012-02-01 04:44:42,121 INFO org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation: Closed zookeeper sessionid=0x1352a393d180fc6
2012-02-01 04:44:42,122 INFO org.apache.zookeeper.ZooKeeper: Session: 0x1352a393d180fc6 closed
2012-02-01 04:44:42,124 INFO org.apache.zookeeper.ClientCnxn: EventThread shut down
2012-02-01 04:45:17,084 INFO org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. servers=3 regions=62 average=20.666666 mostloaded=21 leastloaded=20
Great job! We will use the feature! -----邮件原件----- 发件人: Mingjie Lai [mailto:mlai <at> apache.org] 发送时间: 2012年2月1日 16:26 收件人: user <at> hbase.apache.org; dev <at> hbase.apache.org 主题: HBase coprocessors blog posted Hi hbasers. A hbase blog regarding coprocessors has been posted to apache blog site. Here is the link: https://blogs.apache.org/hbase/entry/coprocessor_introduction Your comments are welcome. Thanks, Mingjie
Anyone out there using R with HBase? I found HBaseR https://bitbucket.org/jspies/hbaser/src/cc8bf79e8d99/hbase.r Are there other choices? Do they work? Thanks Peter
Hi all, We have a 3 node cluster (CD3u2) with the following hardware: RegionServers (+DN + TT) CPU: 2x Intel(R) Xeon(R) CPU E5630 <at> 2.53GHz (quad) Disks: 6x250G SATA 5.4K Memory: 24GB Master (+ZK, JT, NN) CPU: Intel(R) Xeon(R) CPU X3363 <at> 2.83GHz, 2x6MB (quad) Disks: 2x500G SATA 7.2K Memory: 8GB Memory wise, we have: Master: NN: 1GB JT: 1GB HBase master: 6GB ZK: 1GB RegionServers: RegionServer: 6GB TaskTracker: 1GB 11 Mappers <at> 1GB each 7 Reducers <at> 1GB each HDFS was empty, and I ran randomWrite and scan both with number clients of 50 (seemed to spawn 500 Mappers though...) randomWrite: 12/02/01 13:27:47 INFO mapred.JobClient: ROWS=52428500 12/02/01 13:27:47 INFO mapred.JobClient: ELAPSED_TIME=84504886 scan: 12/02/01 13:42:52 INFO mapred.JobClient: ROWS=52428500 12/02/01 13:42:52 INFO mapred.JobClient: ELAPSED_TIME=8158664 Would I be correct in thinking that this is way below what is to be expected of this hardware? We're setting up ganglia now to start debugging, but any suggestions on how to diagnose this would be greatly appreciated. Thanks! Tim
RSS Feed356 | |
|---|---|
740 | |
692 | |
796 | |
783 | |
753 | |
740 | |
791 | |
687 | |
810 | |
803 | |
586 | |
744 | |
502 | |
632 | |
598 | |
643 | |
556 | |
544 | |
536 | |
659 | |
733 | |
761 | |
815 | |
812 | |
1016 | |
1081 | |
740 | |
978 | |
752 | |
553 | |
521 | |
732 | |
443 | |
617 | |
170 | |
308 | |
507 | |
817 | |
367 | |
571 | |
419 | |
533 | |
575 | |
426 | |
512 | |
615 | |
456 | |
352 | |
356 | |
330 | |
301 | |
342 | |
343 | |
272 | |
364 | |
309 | |
299 | |
325 | |
157 | |
194 | |
165 | |
146 | |
101 |
