EC2에 설치된 standalone HBase에 java client가 연결이 안됩니다.

Question

안녕하세요 ㅎㅎ 요새 거의 하루에 하나씩 질문을 올리는 것 같습니다.(특히나 HBase가 많네요) 세팅은 EC2에 HBase 1.1.3 standalone으로 설치했구요. http://itnp.kr/roller/home/entry/hbase_java_api_client_example 요 블로그 글 보고 따라서 작성을 해보고 있었습니다.제 PC쪽에서 구동되는 자바 어플리케이션에서 HBase에 연결을 해서 put/scan을 시도하고 있는데이거 잘 안되네요. ㅎㅎ 자바 어플리케이션 로그는 이렇게 뜨고요, zookeeper와 소켓연결은 된 것 같은데 뭐가 문제인지 모르겠네요 ㅠㅠ16/03/24 13:26:07 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=[ec2 public ip]:2181 sessionTimeout=180000 watcher=hconnection 16/03/24 13:26:07 INFO zookeeper.ClientCnxn: Opening socket connection to server /[ec2 public ip]:2181 16/03/24 13:26:07 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 10784@WIN-J3DPU4RDR15 16/03/24 13:26:07 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration. 16/03/24 13:26:07 INFO zookeeper.ClientCnxn: Socket connection established to [ec2 DNS]/[ec2 public ip]:2181, initiating session 16/03/24 13:26:07 INFO zookeeper.ClientCnxn: Session establishment complete on server [ec2 DNS]/[ec2 public ip]:2181, sessionid = 0x153a38557d80010, negotiated timeout = 40000 org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find region for test,,99999999999999 after 10 tries. at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:955) at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:860) at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:962) at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:864) at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:821) at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:234) at org.apache.hadoop.hbase.client.HTable.(HTable.java:174) at org.apache.hadoop.hbase.client.HTable.(HTable.java:133) at kr.stocktalk.chat.ChatServer.main(ChatServer.java:42) Exception in thread "main" java.lang.NullPointerException at kr.stocktalk.chat.ChatServer.main(ChatServer.java:72)이거는 HBase에서 쌓인 로그입니다.2016-03-24 06:00:23,360 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.NIOServerCnxnFactory: Accepted socket connection from /106.249.235.42:59761 2016-03-24 06:00:23,362 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.ZooKeeperServer: Client attempting to establish new session at /106.249.235.42:59761 2016-03-24 06:00:23,364 INFO [SyncThread:0] server.ZooKeeperServer: Established session 0x153a73408bd0007 with negotiated timeout 40000 for client /106.249.235.42:59761 2016-03-24 06:00:50,000 INFO [SessionTracker] server.ZooKeeperServer: Expiring session 0x153a73408bd0006, timeout of 40000ms exceeded 2016-03-24 06:00:50,000 INFO [ProcessThread(sid:0 cport:-1):] server.PrepRequestProcessor: Processed session termination for sessionid: 0x153a73408bd0006 2016-03-24 06:03:43,406 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=211.27 KB, freeSize=195.67 MB, max=195.88 MB, blockCount=3, accesses=12, hits=9, hitRatio=75.00%, , cachingAccesses=12, cachingHits=9, cachingHitsRatio=75.00%, evictions=29, evicted=0, evictedPerRun=0.0 2016-03-24 06:03:53,517 INFO [ip-172-31-17-139.ap-northeast-2.compute.internal,53920,1458799121922_ChoreService_1] regionserver.HRegionServer: ip-172-31-17-139.ap-northeast-2.compute.internal,53920,1458799121922-MemstoreFlusherChore requesting flush for region hbase:meta,,1.1588230740 after a delay of 19313 2016-03-24 06:04:03,516 INFO [ip-172-31-17-139.ap-northeast-2.compute.internal,53920,1458799121922_ChoreService_1] regionserver.HRegionServer: ip-172-31-17-139.ap-northeast-2.compute.internal,53920,1458799121922-MemstoreFlusherChore requesting flush for region hbase:meta,,1.1588230740 after a delay of 18912 2016-03-24 06:04:12,836 INFO [MemStoreFlusher.0] regionserver.HRegion: Started memstore flush for hbase:meta,,1.1588230740, current region memstore size 2.45 KB, and 1/1 column families' memstores are being flushed. 2016-03-24 06:04:12,857 WARN [MemStoreFlusher.0] hfile.HFileWriterV2: A minimum HFile version of 3 is required to support cell attributes/tags. Consider setting hfile.format.version accordingly. 2016-03-24 06:04:12,862 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=48, memsize=2.4 K, hasBloomFilter=false, into tmp file file:/home/ec2-user/hbase/data/hbase/meta/1588230740/.tmp/8f5ad5e16858425ba49f12e645bd5d39 2016-03-24 06:04:12,887 INFO [MemStoreFlusher.0] regionserver.HStore: Added file:/home/ec2-user/hbase/data/hbase/meta/1588230740/info/8f5ad5e16858425ba49f12e645bd5d39, entries=10, sequenceid=48, filesize=5.9 K 2016-03-24 06:04:12,888 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~2.45 KB/2504, currentsize=0 B/0 for region hbase:meta,,1.1588230740 in 52ms, sequenceid=48, compaction requested=false 2016-03-24 06:08:43,406 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=211.27 KB, freeSize=195.67 MB, max=195.88 MB, blockCount=3, accesses=13, hits=10, hitRatio=76.92%, , cachingAccesses=13, cachingHits=10, cachingHitsRatio=76.92%, evictions=59, evicted=0, evictedPerRun=0.0 2016-03-24 06:11:03,418 WARN [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.NIOServerCnxn: Exception causing close of session 0x153a73408bd0007 due to java.io.IOException: Connection reset by peer 2016-03-24 06:11:03,419 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.NIOServerCnxn: Closed socket connection for client /106.249.235.42:59761 which had sessionid 0x153a73408bd0007 2016-03-24 06:11:38,001 INFO [SessionTracker] server.ZooKeeperServer: Expiring session 0x153a73408bd0007, timeout of 40000ms exceeded 2016-03-24 06:11:38,001 INFO [ProcessThread(sid:0 cport:-1):] server.PrepRequestProcessor: Processed session termination for sessionid: 0x153a73408bd0007 2016-03-24 06:13:43,406 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=213.09 KB, freeSize=195.67 MB, max=195.88 MB, blockCount=4, accesses=15, hits=11, hitRatio=73.33%, , cachingAccesses=15, cachingHits=11, cachingHitsRatio=73.33%, evictions=89, evicted=0, evictedPerRun=0.0 HBase의 hbase-site.xml코드는 아래 내용만 작성했습니다. hbase.rootdir file:///home/${user.name}/hbase The directory shared by region servers and into which HBase persists. The URL should be 'fully-qualified' to include the filesystem scheme. For example, to specify the HDFS directory '/hbase' where the HDFS instance's namenode is running at namenode.example.org on port 9000, set this value to: hdfs://namenode.example.org:9000/hbase. By default HBase writes into /tmp. Change this configuration else all data will be lost on machine restart. hbase.master.port 60000 The port the HBase Master should bind to. hbase.cluster.distributed false The mode the cluster will be in. Possible values are false for standalone mode and true for distributed mode. If false, startup will run all HBase and ZooKeeper daemons together in the one JVM. hbase.master.info.port 60010 The port for the HBase Master web UI. Set to -1 if you do not want a UI instance run. hbase.master.info.bindAddress 0.0.0.0 The bind address for the HBase Master web UI hbase.zookeeper.quorum 52.79.129.151 Comma separated list of servers in the ZooKeeper Quorum. For example, "host1.mydomain.com,host2.mydomain.com,host3.mydomain.com". By default this is set to localhost for local and pseudo-distributed modes of operation. For a fully-distributed setup, this should be set to a full list of ZooKeeper quorum servers. If HBASE_MANAGES_ZK is set in hbase-env.sh this is the list of servers which we will start/stop ZooKeeper on. 자바 코드는 이렇게 작성했었습니다.ChatServer.javapublic static void main(String[] args) { HBaseChatConfiguration conf = HBaseChatConfiguration.getInstance(); conf.set("hbase.zookeeper.quorum", [ec2 public ip]); conf.set("hbase.zookeeper.property.clientPort","2181"); HTable table = null; try { table = new HTable(conf.getConfiguration(), "test"); System.out.println("table initiated"); Put p = new Put(Bytes.toBytes("testRow1")); p.add(Bytes.toBytes("cf1"), Bytes.toBytes("cfs"), Bytes.toBytes("test")); table.put(p); System.out.println("put end"); Scan s = new Scan(); ResultScanner rs = table.getScanner(s); for (Result r : rs) { for (KeyValue kv : r.raw()) { System.out.println("row:" + new String(kv.getRow()) +""); System.out.println("family:" + new String(kv.getFamily()) +":"); System.out.println("qualifier:" + new String(kv.getQualifier()) +""); System.out.println("value:" + new String(kv.getValue())); System.out.println("timestamp:" + kv.getTimestamp() +""); System.out.println("-------------------------------------------"); } } System.out.println("scan end"); } catch (IOException e1) { // TODO Auto-generated catch block e1.printStackTrace(); } finally { try { table.close(); } catch (IOException e) { // TODO Auto-generated catch block e.printStackTrace(); } } ... HBaseChatConfiguration public class HBaseChatConfiguration { private static HBaseChatConfiguration mInst = null; private Configuration mConfig = null; public static HBaseChatConfiguration getInstance(){ if(mInst == null){ mInst = new HBaseChatConfiguration(); } return mInst; } public HBaseChatConfiguration(){ mConfig = HBaseConfiguration.create(); mConfig.clear(); } public Configuration getConfiguration(){ return mConfig; } public void set(String name, String value){ mConfig.set(name, value); } }

EC2에 설치된 standalone HBase에 java client가 연결이 안됩니다.

0개의 답변

#hbase 목록