Hbase数据备份，

和通数据库htsjk.Com2019-12-29 23:37 来源:未知阅读:11406 评论 452 热度3

标签：

Hbase数据备份，

创建表：

hbase(main):001:0>create 'member','member_id','address','info'

插入数据：

put 'member','xueba','info:age','25'
put 'member','xueba','info:birthday','1989-06-19'
put 'member','xueba','info:company','tecent'
put 'member','xueba','address:contry','china'
put 'member','xueba','address:province','guangdong'
put 'member','xueba','address:city','shenzhen'
put 'member','xiaoming','info:age','24'
put 'member','xiaoming','info:birthday','1990-03-22'
put 'member','xiaoming','info:company','tecent'
put 'member','xiaoming','info:favorite','movie'
put 'member','xiaoming','address:contry','china'
put 'member','xiaoming','address:province','guangdong'
put 'member','xiaoming','address:city','guangzhou'

查询表

扫描表：

hdfs上创建demo目录：

将hbase表member的数据导出到hdfs的路径/demo上面:

hbase org.apache.hadoop.hbase.mapreduce.Export member /demo

查看生成的目录:
将hbase数据备份到本地文件:

创建备份到的目标hbase表

注： Column family address must exist in region memberdemo
将备份的数据导入到备份目标表中

全表扫描新表：

**

注：

 2019-01-21 23:36:21,199 INFO  [main] mapreduce.Job: Job job_1548140399871_0002 running in uber mode : false
2019-01-21 23:36:21,225 INFO  [main] mapreduce.Job:  map 0% reduce 0%
2019-01-21 23:36:21,266 INFO  [main] mapreduce.Job: Job job_1548140399871_0002 failed with state FAILED due to: Application application_1548140399871_0002 failed 2 times due to Error launching appattempt_1548140399871_0002_000002. Got exception: org.apache.hadoop.yarn.exceptions.YarnException: Unauthorized request to start container.
This token is expired. current time is 1548159795772 found 1548143180339
Note: System times on machines may be out of sync. Check system time and time zones.
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.instantiateException(SerializedExceptionPBImpl.java:168)
        at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.deSerialize(SerializedExceptionPBImpl.java:106)
        at org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher.launch(AMLauncher.java:122)
        at org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher.run(AMLauncher.java:250)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:748)
. Failing the application.
2019-01-21 23:36:21,328 INFO  [main] mapreduce.Job: Counters: 0

可用date查看时间，发现不同步，so需时间同步，

例：ntpdate 1.cn.pool.ntp.org

 2019-01-22 00:21:24,851 INFO  [main] mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/hadoop/.staging/job_1548140399871_00092019-01-22 00:21:24,851 INFO  [main] mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/hadoop/.staging/job_1548140399871_0009
Exception in thread "main" java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.hbase.mapreduce.Driver.main(Driver.java:61)
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input Pattern file:/home/hadoop/member/* matches 0 files
        at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:321)
        at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:264)

解决：

hbase org.apache.hadoop.hbase.mapreduce.Driver import tablename **hdfspath**
hbase org.apache.hadoop.hbase.mapreduce.Import tablename **hdfspath**